2024-03-30T12:53:52.500 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-30T12:53:52.500 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining} --verbose --name mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi --archive /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148 --owner scheduled_mchangir@teuthology -- /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148/orig.config.yaml 2024-03-30T12:53:52.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T12:53:52.631 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148 branch: wip-mchangir-testing1-main-20240328-072412 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining} email: mchangir@redhat.com first_in_suite: false job_id: '7629148' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing1-main-20240328-072412 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing1-main-20240328-072412 sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 owner: scheduled_mchangir@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 364 sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-mchangir-testing1-main-20240328-072412 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDZULCtdpAoiI+VPGR22ZzcGvpezNcmJBRbXqUsn+mA96c3DhVejkFteJv2TM5YffEKHKFC/mmHqqmHSv0+TKxk= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBn+oUoitFPlnaBPd+LEUHydfuxrtCvEzj4aACGLaJ2Zmxr+uQT5Smte+l5jyHFm1gEF53mO2IDokoMkom8tAfk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_uninlining teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-29_13:38:54 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-30T12:53:52.631 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa; will attempt to use it 2024-03-30T12:53:52.632 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks 2024-03-30T12:53:52.632 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-30T12:53:52.633 INFO:teuthology.task.internal:Checking packages... 2024-03-30T12:53:52.656 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7' 2024-03-30T12:53:52.657 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T12:53:52.657 INFO:teuthology.packaging:ref: None 2024-03-30T12:53:52.657 INFO:teuthology.packaging:tag: None 2024-03-30T12:53:52.657 INFO:teuthology.packaging:branch: wip-mchangir-testing1-main-20240328-072412 2024-03-30T12:53:52.657 INFO:teuthology.packaging:sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T12:53:52.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing1-main-20240328-072412 2024-03-30T12:53:52.875 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2519.gac171039 2024-03-30T12:53:52.877 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-30T12:53:52.884 INFO:teuthology.task.internal:no buildpackages task found 2024-03-30T12:53:52.884 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-30T12:53:52.905 INFO:teuthology.task.internal:Saving configuration 2024-03-30T12:53:52.923 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-30T12:53:52.929 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T12:53:52.955 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:48:50.672603', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDZULCtdpAoiI+VPGR22ZzcGvpezNcmJBRbXqUsn+mA96c3DhVejkFteJv2TM5YffEKHKFC/mmHqqmHSv0+TKxk='} 2024-03-30T12:53:52.982 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:48:50.671127', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBn+oUoitFPlnaBPd+LEUHydfuxrtCvEzj4aACGLaJ2Zmxr+uQT5Smte+l5jyHFm1gEF53mO2IDokoMkom8tAfk='} 2024-03-30T12:53:52.982 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-30T12:53:52.988 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-30T12:53:52.988 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-30T12:53:52.988 INFO:teuthology.run_tasks:Running task console_log... 2024-03-30T12:53:53.080 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f40ca96bf70>, signals=[15]) 2024-03-30T12:53:53.080 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-30T12:53:53.087 INFO:teuthology.task.internal:Opening connections... 2024-03-30T12:53:53.087 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T12:53:53.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:53:53.180 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T12:53:53.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:53:53.275 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-30T12:53:53.283 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-03-30T12:53:53.300 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-03-30T12:53:53.300 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-03-30T12:53:53.357 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-03-30T12:53:53.357 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-03-30T12:53:53.357 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-03-30T12:53:53.357 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-03-30T12:53:53.357 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-03-30T12:53:53.357 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-03-30T12:53:53.357 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T12:53:53.358 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-03-30T12:53:53.358 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-03-30T12:53:53.358 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T12:53:53.358 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-03-30T12:53:53.358 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T12:53:53.358 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T12:53:53.358 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T12:53:53.359 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-03-30T12:53:53.395 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-03-30T12:53:53.413 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-03-30T12:53:53.413 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-03-30T12:53:53.470 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-03-30T12:53:53.470 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-03-30T12:53:53.470 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-03-30T12:53:53.470 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-03-30T12:53:53.471 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-03-30T12:53:53.471 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-03-30T12:53:53.471 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T12:53:53.471 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-03-30T12:53:53.471 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-03-30T12:53:53.471 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T12:53:53.471 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-03-30T12:53:53.471 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T12:53:53.471 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T12:53:53.471 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T12:53:53.471 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-03-30T12:53:53.494 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-30T12:53:53.506 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-30T12:53:53.523 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-30T12:53:53.523 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-03-30T12:53:53.525 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-03-30T12:53:53.541 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-30T12:53:53.549 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-30T12:53:53.549 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-03-30T12:53:53.582 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-03-30T12:53:53.660 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-30T12:53:53.716 INFO:teuthology.run_tasks:Running task kernel... 2024-03-30T12:53:53.731 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-30T12:53:53.731 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-03-30T12:53:53.731 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-03-30T12:53:53.732 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T12:53:53.732 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T12:53:53.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:53:53.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-30T12:53:53.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:53:53.753 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-30T12:53:53.945 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:53:53.945 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-30T12:53:53.946 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-03-30T12:53:53.963 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-361.el9.x86_64 2024-03-30T12:53:53.963 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:53:53.963 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-30T12:53:53.964 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum upgrade -y linux-firmware 2024-03-30T12:53:54.085 DEBUG:teuthology.task.kernel:sha1 for client.1 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:53:54.085 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-30T12:53:54.085 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-03-30T12:53:54.103 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-361.el9.x86_64 2024-03-30T12:53:54.103 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:53:54.103 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-30T12:53:54.104 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum upgrade -y linux-firmware 2024-03-30T12:53:56.434 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 8.9 MB/s | 6.7 MB 00:00 2024-03-30T12:53:56.529 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - AppStream 8.1 MB/s | 6.7 MB 00:00 2024-03-30T12:53:58.285 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 2.7 MB/s | 2.0 MB 00:00 2024-03-30T12:53:58.371 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - BaseOS 3.0 MB/s | 2.0 MB 00:00 2024-03-30T12:54:00.311 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.0 MB 00:01 2024-03-30T12:54:01.503 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.0 MB 00:02 2024-03-30T12:54:02.210 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-03-30T12:54:06.288 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 19 MB 00:03 2024-03-30T12:54:07.068 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.1 MB 00:01 2024-03-30T12:54:09.027 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 16 kB 00:00 2024-03-30T12:54:10.430 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.1 MB 00:00 2024-03-30T12:54:11.772 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 16 kB 00:00 2024-03-30T12:54:14.181 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 21 MB 00:02 2024-03-30T12:54:19.173 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-03-30T12:54:21.526 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-03-30T12:54:21.539 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-03-30T12:54:21.539 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-03-30T12:54:21.539 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-03-30T12:54:21.539 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-03-30T12:54:21.539 INFO:teuthology.orchestra.run.smithi181.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-30T12:54:21.539 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T12:54:21.539 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-03-30T12:54:21.539 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-03-30T12:54:21.540 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 1 Package 2024-03-30T12:54:21.540 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T12:54:21.540 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 375 M 2024-03-30T12:54:21.540 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-03-30T12:54:28.557 INFO:teuthology.orchestra.run.smithi181.stdout:linux-firmware-20240219-143.el9.noarch.rpm 53 MB/s | 375 MB 00:07 2024-03-30T12:54:28.558 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-03-30T12:54:28.558 INFO:teuthology.orchestra.run.smithi181.stdout:Total 53 MB/s | 375 MB 00:07 2024-03-30T12:54:28.559 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-03-30T12:54:28.644 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-03-30T12:54:28.644 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-03-30T12:54:31.044 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-03-30T12:54:31.044 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-03-30T12:54:37.346 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-03-30T12:54:37.574 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T12:54:37.657 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:54:39.045 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:54:39.045 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T12:54:39.424 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:54:39.424 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T12:54:39.425 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-03-30T12:54:39.425 INFO:teuthology.orchestra.run.smithi181.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-30T12:54:39.425 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T12:54:39.425 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-03-30T12:54:39.716 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.1... 2024-03-30T12:54:39.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:54:39.942 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-30T12:54:39.942 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-30T12:54:39.945 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi181.front.sepia.ceph.com to complete... 2024-03-30T12:54:51.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30 12:54:51 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-30T12:54:51.662 INFO:teuthology.orchestra.run.smithi181.stderr:FINISHED --2024-03-30 12:54:51-- 2024-03-30T12:54:51.662 INFO:teuthology.orchestra.run.smithi181.stderr:Total wall clock time: 12s 2024-03-30T12:54:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:Downloaded: 1 files, 321M in 11s (28.3 MB/s) 2024-03-30T12:54:51.665 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.1... 2024-03-30T12:54:51.665 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-30T12:54:53.595 INFO:teuthology.orchestra.run.smithi181.stdout:Verifying... ######################################## 2024-03-30T12:54:53.654 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing... ######################################## 2024-03-30T12:54:53.734 INFO:teuthology.orchestra.run.smithi181.stdout:Updating / installing... 2024-03-30T12:55:01.272 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-30T12:55:17.349 INFO:teuthology.orchestra.run.smithi181.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-30T12:55:39.730 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-30T12:55:39.731 DEBUG:teuthology.orchestra.run.smithi181:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-30T12:55:39.795 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-30T12:55:39.796 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-30T12:55:39.797 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-30T12:55:39.798 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-30T12:55:39.799 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-30T12:55:39.800 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-30T12:55:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-30T12:55:39.802 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-30T12:55:39.803 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-30T12:55:39.804 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-30T12:55:39.805 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-30T12:55:39.806 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-30T12:55:39.807 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-30T12:55:39.808 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-30T12:55:39.809 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-30T12:55:39.810 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-30T12:55:39.811 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-30T12:55:39.811 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-30T12:55:39.811 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-30T12:55:39.811 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-30T12:55:39.811 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-30T12:55:39.811 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-30T12:55:39.811 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-30T12:55:39.811 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-30T12:55:39.811 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-30T12:55:39.811 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-30T12:55:39.811 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-30T12:55:39.812 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-30T12:55:39.812 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-30T12:55:39.812 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-30T12:55:39.812 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-30T12:55:39.812 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-30T12:55:39.812 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-30T12:55:39.812 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-30T12:55:39.813 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-30T12:55:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-30T12:55:39.815 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-30T12:55:39.816 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-30T12:55:39.817 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-30T12:55:39.818 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-30T12:55:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-30T12:55:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-30T12:55:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-30T12:55:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-30T12:55:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-30T12:55:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-30T12:55:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-30T12:55:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-30T12:55:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-30T12:55:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-30T12:55:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-30T12:55:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-30T12:55:39.821 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-30T12:55:39.821 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-30T12:55:39.821 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-30T12:55:39.822 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-30T12:55:39.823 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-30T12:55:39.823 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-30T12:55:39.823 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-30T12:55:39.823 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-30T12:55:39.823 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-30T12:55:39.823 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-30T12:55:39.823 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-30T12:55:39.823 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-30T12:55:39.823 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-30T12:55:39.824 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-30T12:55:39.825 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-30T12:55:39.826 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-30T12:55:39.827 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-30T12:55:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-30T12:55:39.829 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-30T12:55:39.830 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-30T12:55:39.831 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-30T12:55:39.831 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-30T12:55:39.831 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-30T12:55:39.831 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-30T12:55:39.831 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-30T12:55:39.831 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-30T12:55:39.831 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-30T12:55:39.831 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-30T12:55:39.831 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-30T12:55:39.831 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-30T12:55:39.831 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-30T12:55:39.832 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-30T12:55:39.833 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-30T12:55:39.833 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-30T12:55:39.833 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-30T12:55:39.833 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-30T12:55:39.833 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-30T12:55:39.833 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-30T12:55:39.833 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-30T12:55:39.833 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-30T12:55:39.833 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-30T12:55:39.833 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-30T12:55:39.834 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-30T12:55:39.835 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-30T12:55:39.836 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-30T12:55:39.837 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-30T12:55:39.838 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-30T12:55:39.839 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-30T12:55:39.840 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-30T12:55:39.841 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-30T12:55:39.842 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-30T12:55:39.842 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-30T12:55:39.842 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-30T12:55:39.842 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-30T12:55:39.842 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-30T12:55:39.842 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-30T12:55:39.842 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-30T12:55:39.842 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-30T12:55:39.842 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-30T12:55:39.843 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-30T12:55:39.844 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-30T12:55:39.845 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-30T12:55:39.846 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-30T12:55:39.847 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-30T12:55:39.848 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-30T12:55:39.849 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-30T12:55:39.850 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-30T12:55:39.853 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-30T12:55:39.853 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-30T12:55:39.853 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-30T12:55:39.853 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-30T12:55:39.853 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-30T12:55:39.853 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-30T12:55:39.853 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-30T12:55:39.853 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-30T12:55:39.854 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-30T12:55:39.855 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-30T12:55:39.856 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-30T12:55:39.857 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-30T12:55:39.858 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-30T12:55:39.859 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-30T12:55:39.860 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-30T12:55:39.861 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-30T12:55:39.862 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-30T12:55:39.863 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-30T12:55:39.864 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-30T12:55:39.865 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-30T12:55:39.866 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-30T12:55:39.867 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-30T12:55:39.868 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-30T12:55:39.869 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-30T12:55:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-30T12:55:39.871 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-30T12:55:39.872 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-30T12:55:39.873 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-30T12:55:39.874 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-30T12:55:39.875 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-30T12:55:39.876 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-30T12:55:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-30T12:55:39.878 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-30T12:55:39.879 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-30T12:55:39.880 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-30T12:55:39.881 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-30T12:55:39.882 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-30T12:55:39.883 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-30T12:55:39.884 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-30T12:55:39.885 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-30T12:55:39.886 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-30T12:55:39.887 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-30T12:55:39.888 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-30T12:55:39.889 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-30T12:55:39.890 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-30T12:55:39.891 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-30T12:55:39.892 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-30T12:55:39.893 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-30T12:55:39.894 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-30T12:55:39.895 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-30T12:55:39.896 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-30T12:55:39.897 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-30T12:55:39.898 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-30T12:55:39.899 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-30T12:55:39.900 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-30T12:55:39.901 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-30T12:55:39.902 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-30T12:55:39.903 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-30T12:55:39.904 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-30T12:55:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-30T12:55:39.906 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-30T12:55:39.907 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-30T12:55:39.908 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-30T12:55:39.909 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-30T12:55:39.910 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-30T12:55:39.911 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-30T12:55:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-30T12:55:39.913 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-30T12:55:39.914 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-30T12:55:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-30T12:55:39.916 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-30T12:55:39.917 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-30T12:55:39.918 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-30T12:55:39.919 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-30T12:55:39.920 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-30T12:55:39.921 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-30T12:55:39.922 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-30T12:55:39.923 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-30T12:55:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-30T12:55:39.925 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-30T12:55:39.926 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-30T12:55:39.927 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-30T12:55:39.928 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-30T12:55:39.929 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-30T12:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-30T12:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-30T12:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-30T12:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-30T12:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-30T12:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-30T12:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-30T12:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-30T12:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-30T12:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-30T12:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-30T12:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-30T12:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-30T12:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-30T12:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-30T12:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-30T12:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-30T12:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-30T12:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-30T12:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-30T12:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-30T12:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-30T12:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T12:55:39.947 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-30T12:55:39.947 DEBUG:teuthology.orchestra.run.smithi181:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-30T12:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout:postinstall scriptlet (using /bin/sh): 2024-03-30T12:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-30T12:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T12:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout:fi 2024-03-30T12:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout:for file in vmlinuz System.map config; do 2024-03-30T12:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-30T12:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-30T12:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: fi 2024-03-30T12:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout:done 2024-03-30T12:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-30T12:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-30T12:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-30T12:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-30T12:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-30T12:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout:fi 2024-03-30T12:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-30T12:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-30T12:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-30T12:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout:fi 2024-03-30T12:55:39.971 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2024-03-30T12:55:40.045 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2024-03-30T12:55:40.045 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2024-03-30T12:55:40.045 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.06 2024-03-30T12:55:40.045 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 68.el9 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:Group : Unspecified 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 8264254 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : builder@centos.org 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2024-03-30T12:55:40.046 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-30T12:55:40.047 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2024-03-30T12:55:40.047 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2024-03-30T12:55:40.047 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T12:55:40.047 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-30T12:55:40.047 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-30T12:55:40.047 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-30T12:55:40.047 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2024-03-30T12:55:40.047 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T12:55:40.047 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2024-03-30T12:55:40.048 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-30T12:55:40.048 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 6.8.0-g1df0c7e8a235 2024-03-30T12:55:40.048 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-30T12:55:40.624 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-03-30T12:55:42.099 INFO:teuthology.orchestra.run.smithi181.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-30T12:55:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-03-30T12:55:42.134 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-03-30T12:55:42.148 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.XJkIqa8mZc 2024-03-30T12:55:42.149 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XJkIqa8mZc 2024-03-30T12:55:42.224 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.XJkIqa8mZc 2024-03-30T12:55:42.362 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.XJkIqa8mZc is 6KB 2024-03-30T12:55:42.411 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.XJkIqa8mZc 2024-03-30T12:55:42.425 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2024-03-30T12:55:42.491 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-30T12:55:42.492 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-30T12:55:42.492 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-30T12:55:42.492 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-30T12:55:42.493 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-30T12:55:42.648 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-03-30T12:56:12.651 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-30T12:56:12.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-30T12:56:12.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:56:22.079 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 160 kB/s | 21 MB 02:12 2024-03-30T12:56:27.002 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-03-30T12:56:29.349 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-03-30T12:56:29.356 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-03-30T12:56:29.356 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-03-30T12:56:29.356 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-03-30T12:56:29.356 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-03-30T12:56:29.357 INFO:teuthology.orchestra.run.smithi099.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-30T12:56:29.357 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T12:56:29.357 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-03-30T12:56:29.357 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-03-30T12:56:29.357 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 1 Package 2024-03-30T12:56:29.357 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T12:56:29.357 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 375 M 2024-03-30T12:56:29.357 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-03-30T12:56:37.785 INFO:teuthology.orchestra.run.smithi099.stdout:linux-firmware-20240219-143.el9.noarch.rpm 44 MB/s | 375 MB 00:08 2024-03-30T12:56:37.786 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-03-30T12:56:37.787 INFO:teuthology.orchestra.run.smithi099.stdout:Total 44 MB/s | 375 MB 00:08 2024-03-30T12:56:37.787 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-03-30T12:56:37.876 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-03-30T12:56:37.876 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-03-30T12:56:40.424 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-03-30T12:56:40.424 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-03-30T12:56:46.765 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-03-30T12:56:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T12:56:47.127 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:56:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:56:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T12:56:48.752 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:56:48.752 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T12:56:48.752 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-03-30T12:56:48.752 INFO:teuthology.orchestra.run.smithi099.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-30T12:56:48.752 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T12:56:48.753 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-03-30T12:56:49.045 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-30T12:56:49.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:56:49.195 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-30T12:56:49.196 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-30T12:56:49.198 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi099.front.sepia.ceph.com to complete... 2024-03-30T12:57:01.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30 12:57:01 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-30T12:57:01.294 INFO:teuthology.orchestra.run.smithi099.stderr:FINISHED --2024-03-30 12:57:01-- 2024-03-30T12:57:01.294 INFO:teuthology.orchestra.run.smithi099.stderr:Total wall clock time: 12s 2024-03-30T12:57:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:Downloaded: 1 files, 321M in 12s (27.3 MB/s) 2024-03-30T12:57:01.299 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-30T12:57:01.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-30T12:57:03.222 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying... ######################################## 2024-03-30T12:57:03.366 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing... ######################################## 2024-03-30T12:57:03.445 INFO:teuthology.orchestra.run.smithi099.stdout:Updating / installing... 2024-03-30T12:57:10.973 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-30T12:57:12.656 DEBUG:teuthology.orchestra.remote:timed out 2024-03-30T12:57:21.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-30T12:57:21.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:57:27.285 INFO:teuthology.orchestra.run.smithi099.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-30T12:57:29.314 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-03-30T12:57:29.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-30T12:57:29.961 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-g1df0c7e8a235"... 2024-03-30T12:57:29.962 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-03-30T12:57:30.000 INFO:teuthology.orchestra.run.smithi181.stdout:6.8.0-g1df0c7e8a235 2024-03-30T12:57:30.000 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-30T12:57:30.000 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T12:57:30.000 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-30T12:57:31.003 DEBUG:teuthology.parallel:result is None 2024-03-30T12:57:49.776 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-30T12:57:49.777 DEBUG:teuthology.orchestra.run.smithi099:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-30T12:57:49.864 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-30T12:57:49.865 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-30T12:57:49.865 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-30T12:57:49.865 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-30T12:57:49.865 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-30T12:57:49.865 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-30T12:57:49.865 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-30T12:57:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-30T12:57:49.867 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-30T12:57:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-30T12:57:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-30T12:57:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-30T12:57:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-30T12:57:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-30T12:57:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-30T12:57:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-30T12:57:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-30T12:57:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-30T12:57:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-30T12:57:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-30T12:57:49.869 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-30T12:57:49.869 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-30T12:57:49.869 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-30T12:57:49.869 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-30T12:57:49.869 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-30T12:57:49.869 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-30T12:57:49.869 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-30T12:57:49.869 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-30T12:57:49.870 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-30T12:57:49.870 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-30T12:57:49.870 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-30T12:57:49.870 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-30T12:57:49.870 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-30T12:57:49.870 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-30T12:57:49.870 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-30T12:57:49.870 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-30T12:57:49.871 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-30T12:57:49.872 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-30T12:57:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-30T12:57:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-30T12:57:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-30T12:57:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-30T12:57:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-30T12:57:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-30T12:57:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-30T12:57:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-30T12:57:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-30T12:57:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-30T12:57:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-30T12:57:49.874 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-30T12:57:49.875 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-30T12:57:49.876 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-30T12:57:49.877 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-30T12:57:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-30T12:57:49.879 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-30T12:57:49.879 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-30T12:57:49.879 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-30T12:57:49.879 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-30T12:57:49.879 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-30T12:57:49.879 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-30T12:57:49.879 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-30T12:57:49.879 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-30T12:57:49.879 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-30T12:57:49.879 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-30T12:57:49.880 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-30T12:57:49.880 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-30T12:57:49.880 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-30T12:57:49.880 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-30T12:57:49.880 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-30T12:57:49.880 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-30T12:57:49.880 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-30T12:57:49.880 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-30T12:57:49.880 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-30T12:57:49.880 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-30T12:57:49.881 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-30T12:57:49.881 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-30T12:57:49.881 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-30T12:57:49.881 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-30T12:57:49.881 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-30T12:57:49.881 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-30T12:57:49.881 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-30T12:57:49.881 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-30T12:57:49.881 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-30T12:57:49.882 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-30T12:57:49.882 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-30T12:57:49.882 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-30T12:57:49.882 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-30T12:57:49.882 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-30T12:57:49.882 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-30T12:57:49.883 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-30T12:57:49.883 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-30T12:57:49.883 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-30T12:57:49.883 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-30T12:57:49.883 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-30T12:57:49.883 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-30T12:57:49.884 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-30T12:57:49.884 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-30T12:57:49.884 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-30T12:57:49.884 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-30T12:57:49.884 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-30T12:57:49.884 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-30T12:57:49.885 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-30T12:57:49.885 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-30T12:57:49.885 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-30T12:57:49.885 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-30T12:57:49.885 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-30T12:57:49.885 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-30T12:57:49.886 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-30T12:57:49.886 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-30T12:57:49.886 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-30T12:57:49.886 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-30T12:57:49.886 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-30T12:57:49.886 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-30T12:57:49.887 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-30T12:57:49.888 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-30T12:57:49.889 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-30T12:57:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-30T12:57:49.891 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-30T12:57:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-30T12:57:49.893 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-30T12:57:49.894 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-30T12:57:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-30T12:57:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-30T12:57:49.897 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-30T12:57:49.898 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-30T12:57:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-30T12:57:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-30T12:57:49.901 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-30T12:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-30T12:57:49.903 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-30T12:57:49.904 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-30T12:57:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-30T12:57:49.906 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-30T12:57:49.907 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-30T12:57:49.908 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-30T12:57:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-30T12:57:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-30T12:57:49.911 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-30T12:57:49.912 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-30T12:57:49.913 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-30T12:57:49.914 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-30T12:57:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-30T12:57:49.916 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-30T12:57:49.917 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-30T12:57:49.918 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-30T12:57:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-30T12:57:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-30T12:57:49.921 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-30T12:57:49.922 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-30T12:57:49.923 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-30T12:57:49.924 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-30T12:57:49.925 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-30T12:57:49.926 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-30T12:57:49.927 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-30T12:57:49.928 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-30T12:57:49.929 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-30T12:57:49.930 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-30T12:57:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-30T12:57:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-30T12:57:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-30T12:57:49.934 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-30T12:57:49.935 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-30T12:57:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-30T12:57:49.937 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-30T12:57:49.938 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-30T12:57:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-30T12:57:49.940 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-30T12:57:49.941 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-30T12:57:49.942 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-30T12:57:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-30T12:57:49.944 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-30T12:57:49.945 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-30T12:57:49.946 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-30T12:57:49.947 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-30T12:57:49.948 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-30T12:57:49.949 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-30T12:57:49.950 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-30T12:57:49.951 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-30T12:57:49.952 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-30T12:57:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-30T12:57:49.954 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-30T12:57:49.955 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-30T12:57:49.955 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-30T12:57:49.959 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-30T12:57:49.959 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-30T12:57:49.959 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-30T12:57:49.959 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-30T12:57:49.959 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-30T12:57:49.959 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-30T12:57:49.959 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-30T12:57:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-30T12:57:49.961 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-30T12:57:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-30T12:57:49.963 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-30T12:57:49.964 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-30T12:57:49.965 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-30T12:57:49.966 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-30T12:57:49.967 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-30T12:57:49.968 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-30T12:57:49.969 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-30T12:57:49.970 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-30T12:57:49.971 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-30T12:57:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-30T12:57:49.973 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-30T12:57:49.974 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-30T12:57:49.975 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-30T12:57:49.976 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-30T12:57:49.977 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-30T12:57:49.978 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-30T12:57:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-30T12:57:49.980 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-30T12:57:49.981 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-30T12:57:49.982 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-30T12:57:49.983 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-30T12:57:49.984 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-30T12:57:49.985 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-30T12:57:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-30T12:57:49.987 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-30T12:57:49.988 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-30T12:57:49.989 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-30T12:57:49.990 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-30T12:57:49.991 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-30T12:57:49.992 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-30T12:57:49.993 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-30T12:57:49.994 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-30T12:57:49.995 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-30T12:57:49.996 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-30T12:57:49.997 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-30T12:57:49.998 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-30T12:57:49.999 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-30T12:57:50.000 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-30T12:57:50.001 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-30T12:57:50.002 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-30T12:57:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-30T12:57:50.004 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-30T12:57:50.005 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-30T12:57:50.006 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-30T12:57:50.007 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-30T12:57:50.008 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-30T12:57:50.009 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-30T12:57:50.010 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-30T12:57:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-30T12:57:50.012 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-30T12:57:50.013 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-30T12:57:50.014 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-30T12:57:50.015 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-30T12:57:50.016 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-30T12:57:50.017 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-30T12:57:50.017 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T12:57:50.020 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-30T12:57:50.020 DEBUG:teuthology.orchestra.run.smithi099:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-30T12:57:50.042 INFO:teuthology.orchestra.run.smithi099.stdout:postinstall scriptlet (using /bin/sh): 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout:for file in vmlinuz System.map config; do 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout: fi 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout:done 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-30T12:57:50.043 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2024-03-30T12:57:50.044 INFO:teuthology.orchestra.run.smithi099.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-30T12:57:50.044 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-30T12:57:50.044 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-30T12:57:50.044 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2024-03-30T12:57:50.045 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 68.el9 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8264254 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-30T12:57:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T12:57:50.120 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2024-03-30T12:57:50.121 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-30T12:57:50.121 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 6.8.0-g1df0c7e8a235 2024-03-30T12:57:50.122 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-30T12:57:50.720 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-03-30T12:57:52.174 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-30T12:57:52.222 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-03-30T12:57:52.225 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-03-30T12:57:52.240 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.gnJEDXTydG 2024-03-30T12:57:52.240 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gnJEDXTydG 2024-03-30T12:57:52.318 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.gnJEDXTydG 2024-03-30T12:57:52.463 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.gnJEDXTydG is 6KB 2024-03-30T12:57:52.512 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.gnJEDXTydG 2024-03-30T12:57:52.526 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2024-03-30T12:57:52.590 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-30T12:57:52.591 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-30T12:57:52.591 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-30T12:57:52.591 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-30T12:57:52.592 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-30T12:57:52.751 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-03-30T12:58:22.754 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-30T12:58:22.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-30T12:58:22.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:59:22.758 DEBUG:teuthology.orchestra.remote:timed out 2024-03-30T12:59:31.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-30T12:59:31.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:59:32.836 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-03-30T12:59:33.442 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-30T12:59:33.442 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-g1df0c7e8a235"... 2024-03-30T12:59:33.442 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-03-30T12:59:33.479 INFO:teuthology.orchestra.run.smithi099.stdout:6.8.0-g1df0c7e8a235 2024-03-30T12:59:33.479 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-30T12:59:33.479 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T12:59:33.479 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-30T12:59:34.482 DEBUG:teuthology.parallel:result is None 2024-03-30T12:59:34.483 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-30T12:59:34.491 INFO:teuthology.task.internal:Creating test directory... 2024-03-30T12:59:34.491 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T12:59:34.498 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T12:59:34.560 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-30T12:59:34.568 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-30T12:59:34.593 INFO:teuthology.task.internal:Creating archive directory... 2024-03-30T12:59:34.593 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T12:59:34.601 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T12:59:34.678 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-30T12:59:34.685 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-30T12:59:34.685 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T12:59:34.690 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T12:59:34.817 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:59:34.883 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:59:34.900 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:59:34.951 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:59:34.955 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-30T12:59:34.963 INFO:teuthology.task.internal:Configuring sudo... 2024-03-30T12:59:34.963 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T12:59:34.968 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T12:59:35.064 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-30T12:59:35.073 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-30T12:59:35.074 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T12:59:35.078 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T12:59:35.134 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T12:59:35.227 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T12:59:35.329 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T12:59:35.408 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T12:59:35.488 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T12:59:35.488 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T12:59:35.579 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T12:59:35.666 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T12:59:35.775 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T12:59:35.859 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T12:59:35.956 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T12:59:35.956 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T12:59:36.047 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-03-30T12:59:36.054 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-03-30T12:59:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T12:59:36.248 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T12:59:36.453 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-30T12:59:36.461 INFO:teuthology.task.internal:Starting timer... 2024-03-30T12:59:36.461 INFO:teuthology.run_tasks:Running task pcp... 2024-03-30T12:59:36.521 INFO:teuthology.run_tasks:Running task selinux... 2024-03-30T12:59:36.595 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-30T12:59:36.595 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-03-30T12:59:36.717 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-03-30T12:59:36.722 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-03-30T12:59:36.852 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-03-30T12:59:36.857 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-30T12:59:36.857 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-03-30T12:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-03-30T12:59:36.917 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-03-30T12:59:36.968 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-03-30T12:59:36.968 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-03-30T12:59:36.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-30T12:59:37.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:59:37.054 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-30T12:59:37.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:59:37.130 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-30T12:59:37.131 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-03-30T12:59:37.229 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-03-30T12:59:37.332 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-30T12:59:37.342 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-30T12:59:37.349 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-30T12:59:37.471 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-30T12:59:37.487 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-30T12:59:37.489 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-30T13:07:15.624 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-03-30T13:07:15.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-30T13:07:15.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:07:15.772 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-03-30T13:07:15.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-30T13:07:15.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-30T13:07:15.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:07:16.071 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-03-30T13:07:16.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-30T13:07:16.219 INFO:teuthology.run_tasks:Running task clock... 2024-03-30T13:07:16.230 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-30T13:07:16.230 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T13:07:16.230 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:07:16.238 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T13:07:16.239 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:07:16.335 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-30T13:07:16.343 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-30T13:07:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-30T13:07:16.393 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-30T13:07:16.481 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-03-30T13:07:16.482 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-03-30T13:07:16.521 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-03-30T13:07:16.524 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-03-30T13:07:16.570 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-30T13:07:16.575 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-30T13:07:16.621 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-30T13:07:16.628 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-30T13:07:16.746 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-03-30T13:07:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T13:07:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-03-30T13:07:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:07:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:07:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:07:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:07:16.760 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-03-30T13:07:16.769 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T13:07:16.769 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-03-30T13:07:16.769 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:07:16.769 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:07:16.769 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:07:16.769 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:07:16.770 INFO:teuthology.run_tasks:Running task install... 2024-03-30T13:07:16.788 DEBUG:teuthology.task.install:project ceph 2024-03-30T13:07:16.789 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}} 2024-03-30T13:07:16.789 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'} 2024-03-30T13:07:16.789 INFO:teuthology.task.install:Using flavor: default 2024-03-30T13:07:16.795 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-30T13:07:16.795 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-30T13:07:16.795 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'tag': None, 'wait_for_package': False} 2024-03-30T13:07:16.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:07:16.797 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'tag': None, 'wait_for_package': False} 2024-03-30T13:07:16.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:07:16.946 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/ 2024-03-30T13:07:16.946 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2519.gac171039 2024-03-30T13:07:16.959 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/ 2024-03-30T13:07:16.959 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2519.gac171039 2024-03-30T13:07:17.070 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-30T13:07:17.071 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:07:17.071 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-30T13:07:17.119 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-30T13:07:17.119 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:07:17.119 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-30T13:07:17.171 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-30T13:07:17.171 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-30T13:07:17.217 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-30T13:07:17.218 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-30T13:07:17.308 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-30T13:07:17.351 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-30T13:07:17.440 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-30T13:07:17.480 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-30T13:07:17.530 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-03-30T13:07:17.534 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-03-30T13:07:17.571 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-03-30T13:07:17.575 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-03-30T13:07:17.883 INFO:teuthology.orchestra.run.smithi181.stdout:74 files removed 2024-03-30T13:07:17.920 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-30T13:07:17.940 INFO:teuthology.orchestra.run.smithi099.stdout:74 files removed 2024-03-30T13:07:17.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-30T13:07:18.884 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 207 kB/s | 83 kB 00:00 2024-03-30T13:07:18.932 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 167 kB/s | 83 kB 00:00 2024-03-30T13:07:19.334 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 32 kB/s | 12 kB 00:00 2024-03-30T13:07:19.421 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-03-30T13:07:19.894 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-03-30T13:07:19.921 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-03-30T13:07:21.206 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - AppStream 5.5 MB/s | 6.7 MB 00:01 2024-03-30T13:07:22.091 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 3.1 MB/s | 6.7 MB 00:02 2024-03-30T13:07:23.400 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - BaseOS 2.3 MB/s | 2.0 MB 00:00 2024-03-30T13:07:23.831 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.0 MB 00:00 2024-03-30T13:07:24.350 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-03-30T13:07:24.802 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-03-30T13:07:28.419 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 19 MB 00:02 2024-03-30T13:07:29.056 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 19 MB 00:03 2024-03-30T13:07:34.178 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.1 MB 00:01 2024-03-30T13:07:36.246 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 16 kB 00:00 2024-03-30T13:07:38.131 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-03-30T13:07:41.381 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 741 kB/s | 6.1 MB 00:08 2024-03-30T13:07:43.251 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 16 kB 00:00 2024-03-30T13:07:43.913 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-30T13:07:45.197 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-03-30T13:07:46.652 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T13:07:46.653 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T13:07:46.673 INFO:teuthology.orchestra.run.smithi099.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-30T13:07:46.675 INFO:teuthology.orchestra.run.smithi099.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-30T13:07:46.676 INFO:teuthology.orchestra.run.smithi099.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-30T13:07:46.677 INFO:teuthology.orchestra.run.smithi099.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-30T13:07:46.679 INFO:teuthology.orchestra.run.smithi099.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-30T13:07:46.683 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-30T13:07:46.684 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-30T13:07:46.773 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-03-30T13:07:46.795 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2024-03-30T13:07:46.795 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-03-30T13:07:46.795 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2024-03-30T13:07:46.795 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-03-30T13:07:46.795 INFO:teuthology.orchestra.run.smithi099.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-30T13:07:46.795 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:19.0.0-2519.gac171039.el9 ceph 6.6 k 2024-03-30T13:07:46.795 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:19.0.0-2519.gac171039.el9 ceph 5.4 M 2024-03-30T13:07:46.795 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:19.0.0-2519.gac171039.el9 ceph 891 k 2024-03-30T13:07:46.795 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2519.gac171039.el9 ceph 145 k 2024-03-30T13:07:46.795 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:19.0.0-2519.gac171039.el9 ceph 1.5 M 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 141 k 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 3.5 M 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 7.4 M 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 49 k 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:19.0.0-2519.gac171039.el9 ceph 9.8 M 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:19.0.0-2519.gac171039.el9 ceph 48 M 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 264 k 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 762 k 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror x86_64 2:19.0.0-2519.gac171039.el9 ceph 221 k 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell x86_64 2:19.0.0-2519.gac171039.el9 ceph 27 k 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 18 k 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-30T13:07:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:19.0.0-2519.gac171039.el9 ceph 32 k 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 746 k 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:19.0.0-2519.gac171039.el9 ceph 127 k 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:19.0.0-2519.gac171039.el9 ceph 162 k 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:19.0.0-2519.gac171039.el9 ceph 321 k 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:19.0.0-2519.gac171039.el9 ceph 298 k 2024-03-30T13:07:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:19.0.0-2519.gac171039.el9 ceph 99 k 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:19.0.0-2519.gac171039.el9 ceph 85 k 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.1 M 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:19.0.0-2519.gac171039.el9 ceph 170 k 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-30T13:07:46.798 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.4 M 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.1 M 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-30T13:07:46.799 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:19.0.0-2519.gac171039.el9 ceph 21 M 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 34 k 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:19.0.0-2519.gac171039.el9 ceph 2.4 M 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 249 k 2024-03-30T13:07:46.800 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:19.0.0-2519.gac171039.el9 ceph 4.7 M 2024-03-30T13:07:46.801 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:19.0.0-2519.gac171039.el9 ceph 17 M 2024-03-30T13:07:46.801 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 16 k 2024-03-30T13:07:46.801 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:19.0.0-2519.gac171039.el9 ceph 25 k 2024-03-30T13:07:46.801 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-30T13:07:46.801 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-30T13:07:46.801 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-30T13:07:46.801 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-30T13:07:46.801 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-30T13:07:46.801 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-30T13:07:46.801 INFO:teuthology.orchestra.run.smithi099.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-30T13:07:46.801 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:19.0.0-2519.gac171039.el9 ceph 164 k 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:19.0.0-2519.gac171039.el9 ceph 500 k 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 5.1 M 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-30T13:07:46.802 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-30T13:07:46.803 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:19.0.0-2519.gac171039.el9 ceph 45 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:19.0.0-2519.gac171039.el9 ceph 134 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-30T13:07:46.804 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-30T13:07:46.805 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-30T13:07:46.806 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-30T13:07:46.807 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-30T13:07:46.808 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-30T13:07:46.809 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2024-03-30T13:07:46.809 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-30T13:07:46.809 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:07:46.809 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-03-30T13:07:46.809 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2024-03-30T13:07:46.809 INFO:teuthology.orchestra.run.smithi099.stdout:Install 150 Packages 2024-03-30T13:07:46.809 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 24 Packages 2024-03-30T13:07:46.809 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:07:46.810 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 226 M 2024-03-30T13:07:46.810 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-03-30T13:07:48.106 INFO:teuthology.orchestra.run.smithi099.stdout:(1/174): ceph-19.0.0-2519.gac171039.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-03-30T13:07:48.948 INFO:teuthology.orchestra.run.smithi099.stdout:(2/174): ceph-fuse-19.0.0-2519.gac171039.el9.x8 1.0 MB/s | 891 kB 00:00 2024-03-30T13:07:49.206 INFO:teuthology.orchestra.run.smithi099.stdout:(3/174): ceph-common-19.0.0-2519.gac171039.el9. 14 MB/s | 21 MB 00:01 2024-03-30T13:07:49.239 INFO:teuthology.orchestra.run.smithi099.stdout:(4/174): ceph-immutable-object-cache-19.0.0-251 498 kB/s | 145 kB 00:00 2024-03-30T13:07:49.382 INFO:teuthology.orchestra.run.smithi099.stdout:(5/174): ceph-mds-19.0.0-2519.gac171039.el9.x86 14 MB/s | 2.4 MB 00:00 2024-03-30T13:07:49.665 INFO:teuthology.orchestra.run.smithi099.stdout:(6/174): ceph-mon-19.0.0-2519.gac171039.el9.x86 17 MB/s | 4.7 MB 00:00 2024-03-30T13:07:49.816 INFO:teuthology.orchestra.run.smithi099.stdout:(7/174): ceph-mgr-19.0.0-2519.gac171039.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-03-30T13:07:50.618 INFO:teuthology.orchestra.run.smithi099.stdout:(8/174): ceph-osd-19.0.0-2519.gac171039.el9.x86 18 MB/s | 17 MB 00:00 2024-03-30T13:07:50.742 INFO:teuthology.orchestra.run.smithi099.stdout:(9/174): ceph-base-19.0.0-2519.gac171039.el9.x8 1.8 MB/s | 5.4 MB 00:02 2024-03-30T13:07:50.767 INFO:teuthology.orchestra.run.smithi099.stdout:(10/174): ceph-selinux-19.0.0-2519.gac171039.el 171 kB/s | 25 kB 00:00 2024-03-30T13:07:50.817 INFO:teuthology.orchestra.run.smithi099.stdout:(11/174): cephfs-mirror-19.0.0-2519.gac171039.e 4.4 MB/s | 221 kB 00:00 2024-03-30T13:07:50.892 INFO:teuthology.orchestra.run.smithi099.stdout:(12/174): cephfs-shell-19.0.0-2519.gac171039.el 365 kB/s | 27 kB 00:00 2024-03-30T13:07:50.968 INFO:teuthology.orchestra.run.smithi099.stdout:(13/174): libcephfs-devel-19.0.0-2519.gac171039 428 kB/s | 32 kB 00:00 2024-03-30T13:07:51.143 INFO:teuthology.orchestra.run.smithi099.stdout:(14/174): libcephfs2-19.0.0-2519.gac171039.el9. 4.2 MB/s | 746 kB 00:00 2024-03-30T13:07:51.149 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-03-30T13:07:51.218 INFO:teuthology.orchestra.run.smithi099.stdout:(15/174): libcephsqlite-19.0.0-2519.gac171039.e 2.2 MB/s | 164 kB 00:00 2024-03-30T13:07:51.285 INFO:teuthology.orchestra.run.smithi099.stdout:(16/174): librados-devel-19.0.0-2519.gac171039. 1.9 MB/s | 127 kB 00:00 2024-03-30T13:07:51.377 INFO:teuthology.orchestra.run.smithi099.stdout:(17/174): libradosstriper1-19.0.0-2519.gac17103 5.4 MB/s | 500 kB 00:00 2024-03-30T13:07:52.269 INFO:teuthology.orchestra.run.smithi099.stdout:(18/174): librgw2-19.0.0-2519.gac171039.el9.x86 5.8 MB/s | 5.1 MB 00:00 2024-03-30T13:07:52.427 INFO:teuthology.orchestra.run.smithi099.stdout:(19/174): ceph-radosgw-19.0.0-2519.gac171039.el 3.8 MB/s | 9.8 MB 00:02 2024-03-30T13:07:52.453 INFO:teuthology.orchestra.run.smithi099.stdout:(20/174): python3-ceph-argparse-19.0.0-2519.gac 247 kB/s | 45 kB 00:00 2024-03-30T13:07:52.520 INFO:teuthology.orchestra.run.smithi099.stdout:(21/174): python3-ceph-common-19.0.0-2519.gac17 1.4 MB/s | 134 kB 00:00 2024-03-30T13:07:52.553 INFO:teuthology.orchestra.run.smithi099.stdout:(22/174): python3-cephfs-19.0.0-2519.gac171039. 1.6 MB/s | 162 kB 00:00 2024-03-30T13:07:52.662 INFO:teuthology.orchestra.run.smithi099.stdout:(23/174): python3-rbd-19.0.0-2519.gac171039.el9 2.7 MB/s | 298 kB 00:00 2024-03-30T13:07:52.704 INFO:teuthology.orchestra.run.smithi099.stdout:(24/174): python3-rados-19.0.0-2519.gac171039.e 1.7 MB/s | 321 kB 00:00 2024-03-30T13:07:52.738 INFO:teuthology.orchestra.run.smithi099.stdout:(25/174): python3-rgw-19.0.0-2519.gac171039.el9 1.3 MB/s | 99 kB 00:00 2024-03-30T13:07:52.813 INFO:teuthology.orchestra.run.smithi099.stdout:(26/174): rbd-fuse-19.0.0-2519.gac171039.el9.x8 793 kB/s | 85 kB 00:00 2024-03-30T13:07:52.930 INFO:teuthology.orchestra.run.smithi099.stdout:(27/174): rbd-nbd-19.0.0-2519.gac171039.el9.x86 1.4 MB/s | 170 kB 00:00 2024-03-30T13:07:53.045 INFO:teuthology.orchestra.run.smithi099.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2519.g 316 kB/s | 34 kB 00:00 2024-03-30T13:07:53.155 INFO:teuthology.orchestra.run.smithi099.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2519.gac17103 1.2 MB/s | 141 kB 00:00 2024-03-30T13:07:53.246 INFO:teuthology.orchestra.run.smithi099.stdout:(30/174): rbd-mirror-19.0.0-2519.gac171039.el9. 6.2 MB/s | 3.1 MB 00:00 2024-03-30T13:07:54.029 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T13:07:54.030 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T13:07:54.051 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-30T13:07:54.053 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-30T13:07:54.054 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-30T13:07:54.055 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-30T13:07:54.058 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-30T13:07:54.061 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-30T13:07:54.063 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-30T13:07:54.149 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-03-30T13:07:54.170 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================================ 2024-03-30T13:07:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-03-30T13:07:54.170 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================================ 2024-03-30T13:07:54.170 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-03-30T13:07:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-30T13:07:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.0.0-2519.gac171039.el9 ceph 6.6 k 2024-03-30T13:07:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.0.0-2519.gac171039.el9 ceph 5.4 M 2024-03-30T13:07:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.0.0-2519.gac171039.el9 ceph 891 k 2024-03-30T13:07:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2519.gac171039.el9 ceph 145 k 2024-03-30T13:07:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.0.0-2519.gac171039.el9 ceph 1.5 M 2024-03-30T13:07:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 141 k 2024-03-30T13:07:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 3.5 M 2024-03-30T13:07:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 7.4 M 2024-03-30T13:07:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 49 k 2024-03-30T13:07:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.0.0-2519.gac171039.el9 ceph 9.8 M 2024-03-30T13:07:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.0.0-2519.gac171039.el9 ceph 48 M 2024-03-30T13:07:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 264 k 2024-03-30T13:07:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 762 k 2024-03-30T13:07:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.0.0-2519.gac171039.el9 ceph 221 k 2024-03-30T13:07:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.0.0-2519.gac171039.el9 ceph 27 k 2024-03-30T13:07:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 18 k 2024-03-30T13:07:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-30T13:07:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-30T13:07:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-30T13:07:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.0.0-2519.gac171039.el9 ceph 32 k 2024-03-30T13:07:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 746 k 2024-03-30T13:07:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.0.0-2519.gac171039.el9 ceph 127 k 2024-03-30T13:07:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-30T13:07:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-30T13:07:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-30T13:07:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-30T13:07:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-30T13:07:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-30T13:07:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.0.0-2519.gac171039.el9 ceph 162 k 2024-03-30T13:07:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.0.0-2519.gac171039.el9 ceph 321 k 2024-03-30T13:07:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.0.0-2519.gac171039.el9 ceph 298 k 2024-03-30T13:07:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.0.0-2519.gac171039.el9 ceph 99 k 2024-03-30T13:07:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.0.0-2519.gac171039.el9 ceph 85 k 2024-03-30T13:07:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.1 M 2024-03-30T13:07:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.0.0-2519.gac171039.el9 ceph 170 k 2024-03-30T13:07:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-30T13:07:54.174 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-03-30T13:07:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-30T13:07:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-30T13:07:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-30T13:07:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-30T13:07:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-30T13:07:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-30T13:07:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-30T13:07:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-30T13:07:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-30T13:07:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-30T13:07:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-30T13:07:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-30T13:07:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-30T13:07:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.4 M 2024-03-30T13:07:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.1 M 2024-03-30T13:07:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-30T13:07:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-30T13:07:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-30T13:07:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-30T13:07:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-30T13:07:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-30T13:07:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-30T13:07:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.0.0-2519.gac171039.el9 ceph 21 M 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 34 k 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.0.0-2519.gac171039.el9 ceph 2.4 M 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 249 k 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.0.0-2519.gac171039.el9 ceph 4.7 M 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.0.0-2519.gac171039.el9 ceph 17 M 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 16 k 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.0.0-2519.gac171039.el9 ceph 25 k 2024-03-30T13:07:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-30T13:07:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-30T13:07:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-30T13:07:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-30T13:07:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-30T13:07:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-30T13:07:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-30T13:07:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-30T13:07:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-30T13:07:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.0.0-2519.gac171039.el9 ceph 164 k 2024-03-30T13:07:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-30T13:07:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-30T13:07:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-30T13:07:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-30T13:07:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-30T13:07:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.0.0-2519.gac171039.el9 ceph 500 k 2024-03-30T13:07:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-30T13:07:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 5.1 M 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-30T13:07:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-30T13:07:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-30T13:07:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-30T13:07:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-30T13:07:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-30T13:07:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-30T13:07:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.0.0-2519.gac171039.el9 ceph 45 k 2024-03-30T13:07:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.0.0-2519.gac171039.el9 ceph 134 k 2024-03-30T13:07:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-30T13:07:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-30T13:07:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-30T13:07:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-30T13:07:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-30T13:07:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-30T13:07:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-30T13:07:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-30T13:07:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-30T13:07:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-30T13:07:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-30T13:07:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-30T13:07:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-30T13:07:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-30T13:07:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-30T13:07:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-30T13:07:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-30T13:07:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-30T13:07:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-30T13:07:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-30T13:07:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-30T13:07:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-30T13:07:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-30T13:07:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-30T13:07:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-30T13:07:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-30T13:07:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-30T13:07:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-30T13:07:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-30T13:07:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-30T13:07:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-30T13:07:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-30T13:07:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-30T13:07:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-30T13:07:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-30T13:07:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-30T13:07:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-30T13:07:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-30T13:07:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-30T13:07:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-30T13:07:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-30T13:07:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================================ 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout:Install 150 Packages 2024-03-30T13:07:54.188 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 24 Packages 2024-03-30T13:07:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:07:54.189 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 226 M 2024-03-30T13:07:54.189 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-03-30T13:07:54.281 INFO:teuthology.orchestra.run.smithi099.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 7.1 MB/s | 7.4 MB 00:01 2024-03-30T13:07:54.365 INFO:teuthology.orchestra.run.smithi099.stdout:(32/174): ceph-mgr-dashboard-19.0.0-2519.gac171 2.9 MB/s | 3.5 MB 00:01 2024-03-30T13:07:54.398 INFO:teuthology.orchestra.run.smithi099.stdout:(33/174): ceph-mgr-modules-core-19.0.0-2519.gac 2.1 MB/s | 249 kB 00:00 2024-03-30T13:07:54.466 INFO:teuthology.orchestra.run.smithi099.stdout:(34/174): ceph-mgr-rook-19.0.0-2519.gac171039.e 494 kB/s | 49 kB 00:00 2024-03-30T13:07:54.516 INFO:teuthology.orchestra.run.smithi099.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2519.ga 141 kB/s | 16 kB 00:00 2024-03-30T13:07:54.549 INFO:teuthology.orchestra.run.smithi099.stdout:(36/174): ceph-volume-19.0.0-2519.gac171039.el9 3.1 MB/s | 264 kB 00:00 2024-03-30T13:07:54.658 INFO:teuthology.orchestra.run.smithi099.stdout:(37/174): cephadm-19.0.0-2519.gac171039.el9.noa 5.3 MB/s | 762 kB 00:00 2024-03-30T13:07:54.709 INFO:teuthology.orchestra.run.smithi099.stdout:(38/174): cephfs-top-19.0.0-2519.gac171039.el9. 115 kB/s | 18 kB 00:00 2024-03-30T13:07:54.926 INFO:teuthology.orchestra.run.smithi099.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 662 kB 00:00 2024-03-30T13:07:54.992 INFO:teuthology.orchestra.run.smithi099.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 920 kB 00:00 2024-03-30T13:07:55.018 INFO:teuthology.orchestra.run.smithi099.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 106 kB 00:00 2024-03-30T13:07:55.051 INFO:teuthology.orchestra.run.smithi099.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 307 kB 00:00 2024-03-30T13:07:55.093 INFO:teuthology.orchestra.run.smithi099.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 439 kB/s | 32 kB 00:00 2024-03-30T13:07:55.268 INFO:teuthology.orchestra.run.smithi099.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-03-30T13:07:55.310 INFO:teuthology.orchestra.run.smithi099.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 81 kB/s | 17 kB 00:00 2024-03-30T13:07:55.361 INFO:teuthology.orchestra.run.smithi099.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 206 kB/s | 10 kB 00:00 2024-03-30T13:07:55.371 INFO:teuthology.orchestra.run.smithi181.stdout:(1/174): ceph-19.0.0-2519.gac171039.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-03-30T13:07:55.386 INFO:teuthology.orchestra.run.smithi099.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-03-30T13:07:55.428 INFO:teuthology.orchestra.run.smithi099.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 677 kB/s | 44 kB 00:00 2024-03-30T13:07:55.470 INFO:teuthology.orchestra.run.smithi099.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 661 kB 00:00 2024-03-30T13:07:55.512 INFO:teuthology.orchestra.run.smithi099.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2024-03-30T13:07:55.554 INFO:teuthology.orchestra.run.smithi099.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 595 kB/s | 46 kB 00:00 2024-03-30T13:07:55.588 INFO:teuthology.orchestra.run.smithi099.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-03-30T13:07:55.621 INFO:teuthology.orchestra.run.smithi099.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-30T13:07:55.655 INFO:teuthology.orchestra.run.smithi099.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-03-30T13:07:55.697 INFO:teuthology.orchestra.run.smithi099.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 470 kB/s | 34 kB 00:00 2024-03-30T13:07:55.910 INFO:teuthology.orchestra.run.smithi181.stdout:(2/174): ceph-base-19.0.0-2519.gac171039.el9.x8 5.6 MB/s | 5.4 MB 00:00 2024-03-30T13:07:55.931 INFO:teuthology.orchestra.run.smithi099.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-03-30T13:07:55.989 INFO:teuthology.orchestra.run.smithi099.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 5.4 MB/s | 1.5 MB 00:00 2024-03-30T13:07:56.018 INFO:teuthology.orchestra.run.smithi181.stdout:(3/174): ceph-fuse-19.0.0-2519.gac171039.el9.x8 1.3 MB/s | 891 kB 00:00 2024-03-30T13:07:56.051 INFO:teuthology.orchestra.run.smithi181.stdout:(4/174): ceph-immutable-object-cache-19.0.0-251 1.0 MB/s | 145 kB 00:00 2024-03-30T13:07:56.054 INFO:teuthology.orchestra.run.smithi099.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 7.3 MB/s | 817 kB 00:00 2024-03-30T13:07:56.081 INFO:teuthology.orchestra.run.smithi099.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 1.5 MB/s | 132 kB 00:00 2024-03-30T13:07:56.318 INFO:teuthology.orchestra.run.smithi181.stdout:(5/174): ceph-mgr-19.0.0-2519.gac171039.el9.x86 5.6 MB/s | 1.5 MB 00:00 2024-03-30T13:07:56.324 INFO:teuthology.orchestra.run.smithi099.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 21 MB/s | 5.7 MB 00:00 2024-03-30T13:07:56.374 INFO:teuthology.orchestra.run.smithi099.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-03-30T13:07:56.399 INFO:teuthology.orchestra.run.smithi099.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 78 kB 00:00 2024-03-30T13:07:56.608 INFO:teuthology.orchestra.run.smithi099.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 5.8 MB 00:00 2024-03-30T13:07:56.633 INFO:teuthology.orchestra.run.smithi099.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 106 kB/s | 24 kB 00:00 2024-03-30T13:07:56.652 INFO:teuthology.orchestra.run.smithi181.stdout:(6/174): ceph-mds-19.0.0-2519.gac171039.el9.x86 3.8 MB/s | 2.4 MB 00:00 2024-03-30T13:07:56.675 INFO:teuthology.orchestra.run.smithi099.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 447 kB/s | 18 kB 00:00 2024-03-30T13:07:56.701 INFO:teuthology.orchestra.run.smithi099.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-03-30T13:07:56.726 INFO:teuthology.orchestra.run.smithi099.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 655 kB/s | 32 kB 00:00 2024-03-30T13:07:56.918 INFO:teuthology.orchestra.run.smithi099.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2024-03-30T13:07:56.951 INFO:teuthology.orchestra.run.smithi099.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2024-03-30T13:07:56.976 INFO:teuthology.orchestra.run.smithi099.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.0 MB/s | 174 kB 00:00 2024-03-30T13:07:57.010 INFO:teuthology.orchestra.run.smithi099.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 69 kB 00:00 2024-03-30T13:07:57.036 INFO:teuthology.orchestra.run.smithi099.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 709 kB/s | 41 kB 00:00 2024-03-30T13:07:57.053 INFO:teuthology.orchestra.run.smithi181.stdout:(7/174): ceph-mon-19.0.0-2519.gac171039.el9.x86 6.4 MB/s | 4.7 MB 00:00 2024-03-30T13:07:57.069 INFO:teuthology.orchestra.run.smithi099.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-03-30T13:07:57.094 INFO:teuthology.orchestra.run.smithi099.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-03-30T13:07:57.148 INFO:teuthology.orchestra.run.smithi099.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-03-30T13:07:57.179 INFO:teuthology.orchestra.run.smithi099.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 573 kB/s | 47 kB 00:00 2024-03-30T13:07:57.212 INFO:teuthology.orchestra.run.smithi099.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 683 kB/s | 43 kB 00:00 2024-03-30T13:07:57.479 INFO:teuthology.orchestra.run.smithi099.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 152 kB/s | 39 kB 00:00 2024-03-30T13:07:57.671 INFO:teuthology.orchestra.run.smithi099.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-03-30T13:07:57.696 INFO:teuthology.orchestra.run.smithi099.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 195 kB/s | 41 kB 00:00 2024-03-30T13:07:57.746 INFO:teuthology.orchestra.run.smithi099.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2024-03-30T13:07:57.772 INFO:teuthology.orchestra.run.smithi099.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 466 kB/s | 35 kB 00:00 2024-03-30T13:07:57.814 INFO:teuthology.orchestra.run.smithi099.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 695 kB/s | 46 kB 00:00 2024-03-30T13:07:57.856 INFO:teuthology.orchestra.run.smithi099.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.5 MB/s | 300 kB 00:00 2024-03-30T13:07:57.881 INFO:teuthology.orchestra.run.smithi099.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 842 kB/s | 56 kB 00:00 2024-03-30T13:07:57.990 INFO:teuthology.orchestra.run.smithi099.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 469 kB/s | 63 kB 00:00 2024-03-30T13:07:58.015 INFO:teuthology.orchestra.run.smithi099.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 330 kB/s | 44 kB 00:00 2024-03-30T13:07:58.082 INFO:teuthology.orchestra.run.smithi099.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 79 kB 00:00 2024-03-30T13:07:58.107 INFO:teuthology.orchestra.run.smithi099.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2024-03-30T13:07:58.161 INFO:teuthology.orchestra.run.smithi181.stdout:(8/174): ceph-radosgw-19.0.0-2519.gac171039.el9 8.9 MB/s | 9.8 MB 00:01 2024-03-30T13:07:58.183 INFO:teuthology.orchestra.run.smithi099.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-03-30T13:07:58.203 INFO:teuthology.orchestra.run.smithi181.stdout:(9/174): ceph-selinux-19.0.0-2519.gac171039.el9 620 kB/s | 25 kB 00:00 2024-03-30T13:07:58.226 INFO:teuthology.orchestra.run.smithi099.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 875 kB/s | 103 kB 00:00 2024-03-30T13:07:58.258 INFO:teuthology.orchestra.run.smithi099.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2024-03-30T13:07:58.292 INFO:teuthology.orchestra.run.smithi099.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 187 kB 00:00 2024-03-30T13:07:58.409 INFO:teuthology.orchestra.run.smithi099.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-03-30T13:07:58.534 INFO:teuthology.orchestra.run.smithi099.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-03-30T13:07:58.576 INFO:teuthology.orchestra.run.smithi099.stdout:(96/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-03-30T13:07:58.602 INFO:teuthology.orchestra.run.smithi099.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-03-30T13:07:58.835 INFO:teuthology.orchestra.run.smithi099.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 83 kB/s | 21 kB 00:00 2024-03-30T13:07:58.869 INFO:teuthology.orchestra.run.smithi099.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 96 kB/s | 25 kB 00:00 2024-03-30T13:07:59.036 INFO:teuthology.orchestra.run.smithi099.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 1.4 MB/s | 245 kB 00:00 2024-03-30T13:07:59.245 INFO:teuthology.orchestra.run.smithi099.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.2 MB/s | 248 kB 00:00 2024-03-30T13:07:59.453 INFO:teuthology.orchestra.run.smithi099.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 451 kB/s | 94 kB 00:00 2024-03-30T13:07:59.612 INFO:teuthology.orchestra.run.smithi099.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 142 kB/s | 22 kB 00:00 2024-03-30T13:08:00.029 INFO:teuthology.orchestra.run.smithi099.stdout:(104/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-03-30T13:08:00.237 INFO:teuthology.orchestra.run.smithi099.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.6 MB/s | 548 kB 00:00 2024-03-30T13:08:00.304 INFO:teuthology.orchestra.run.smithi099.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 4.6 MB/s | 309 kB 00:00 2024-03-30T13:08:00.346 INFO:teuthology.orchestra.run.smithi099.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 477 kB/s | 19 kB 00:00 2024-03-30T13:08:00.563 INFO:teuthology.orchestra.run.smithi099.stdout:(108/174): libarrow-9.0.0-10.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-03-30T13:08:00.605 INFO:teuthology.orchestra.run.smithi099.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 638 kB/s | 26 kB 00:00 2024-03-30T13:08:00.647 INFO:teuthology.orchestra.run.smithi099.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-03-30T13:08:00.689 INFO:teuthology.orchestra.run.smithi099.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-03-30T13:08:00.815 INFO:teuthology.orchestra.run.smithi099.stdout:(112/174): openssl-devel-3.0.7-27.el9.x86_64.rp 2.1 MB/s | 4.1 MB 00:01 2024-03-30T13:08:00.848 INFO:teuthology.orchestra.run.smithi099.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 955 kB/s | 151 kB 00:00 2024-03-30T13:08:00.923 INFO:teuthology.orchestra.run.smithi099.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 7.3 MB/s | 548 kB 00:00 2024-03-30T13:08:00.982 INFO:teuthology.orchestra.run.smithi099.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 749 kB/s | 43 kB 00:00 2024-03-30T13:08:01.041 INFO:teuthology.orchestra.run.smithi099.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 561 kB/s | 32 kB 00:00 2024-03-30T13:08:01.100 INFO:teuthology.orchestra.run.smithi099.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 261 kB/s | 15 kB 00:00 2024-03-30T13:08:01.142 INFO:teuthology.orchestra.run.smithi099.stdout:(118/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.5 MB/s | 838 kB 00:00 2024-03-30T13:08:01.175 INFO:teuthology.orchestra.run.smithi099.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.3 MB/s | 172 kB 00:00 2024-03-30T13:08:01.226 INFO:teuthology.orchestra.run.smithi099.stdout:(120/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.0 MB/s | 303 kB 00:00 2024-03-30T13:08:01.259 INFO:teuthology.orchestra.run.smithi099.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-03-30T13:08:01.310 INFO:teuthology.orchestra.run.smithi099.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 426 kB/s | 35 kB 00:00 2024-03-30T13:08:01.343 INFO:teuthology.orchestra.run.smithi099.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-03-30T13:08:01.420 INFO:teuthology.orchestra.run.smithi181.stdout:(10/174): ceph-test-19.0.0-2519.gac171039.el9.x 15 MB/s | 48 MB 00:03 2024-03-30T13:08:01.443 INFO:teuthology.orchestra.run.smithi099.stdout:(124/174): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-03-30T13:08:01.495 INFO:teuthology.orchestra.run.smithi181.stdout:(11/174): cephfs-mirror-19.0.0-2519.gac171039.e 2.9 MB/s | 221 kB 00:00 2024-03-30T13:08:01.501 INFO:teuthology.orchestra.run.smithi099.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 918 kB/s | 144 kB 00:00 2024-03-30T13:08:01.537 INFO:teuthology.orchestra.run.smithi181.stdout:(12/174): cephfs-shell-19.0.0-2519.gac171039.el 664 kB/s | 27 kB 00:00 2024-03-30T13:08:01.544 INFO:teuthology.orchestra.run.smithi099.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-03-30T13:08:01.578 INFO:teuthology.orchestra.run.smithi181.stdout:(13/174): libcephfs-devel-19.0.0-2519.gac171039 778 kB/s | 32 kB 00:00 2024-03-30T13:08:01.586 INFO:teuthology.orchestra.run.smithi099.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-03-30T13:08:01.628 INFO:teuthology.orchestra.run.smithi099.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 280 kB/s | 23 kB 00:00 2024-03-30T13:08:01.670 INFO:teuthology.orchestra.run.smithi099.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 235 kB/s | 19 kB 00:00 2024-03-30T13:08:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:(14/174): libcephfs2-19.0.0-2519.gac171039.el9. 6.8 MB/s | 746 kB 00:00 2024-03-30T13:08:01.712 INFO:teuthology.orchestra.run.smithi099.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 238 kB/s | 20 kB 00:00 2024-03-30T13:08:01.737 INFO:teuthology.orchestra.run.smithi181.stdout:(15/174): libcephsqlite-19.0.0-2519.gac171039.e 3.3 MB/s | 164 kB 00:00 2024-03-30T13:08:01.770 INFO:teuthology.orchestra.run.smithi099.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-03-30T13:08:01.813 INFO:teuthology.orchestra.run.smithi099.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 466 kB/s | 46 kB 00:00 2024-03-30T13:08:01.813 INFO:teuthology.orchestra.run.smithi181.stdout:(16/174): librados-devel-19.0.0-2519.gac171039. 1.7 MB/s | 127 kB 00:00 2024-03-30T13:08:01.838 INFO:teuthology.orchestra.run.smithi099.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-03-30T13:08:01.879 INFO:teuthology.orchestra.run.smithi181.stdout:(17/174): libradosstriper1-19.0.0-2519.gac17103 7.5 MB/s | 500 kB 00:00 2024-03-30T13:08:01.883 INFO:teuthology.orchestra.run.smithi099.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 833 kB/s | 58 kB 00:00 2024-03-30T13:08:01.917 INFO:teuthology.orchestra.run.smithi099.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.4 MB/s | 272 kB 00:00 2024-03-30T13:08:01.959 INFO:teuthology.orchestra.run.smithi099.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 221 kB/s | 16 kB 00:00 2024-03-30T13:08:01.984 INFO:teuthology.orchestra.run.smithi099.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-03-30T13:08:02.027 INFO:teuthology.orchestra.run.smithi099.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2024-03-30T13:08:02.069 INFO:teuthology.orchestra.run.smithi099.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 369 kB/s | 31 kB 00:00 2024-03-30T13:08:02.127 INFO:teuthology.orchestra.run.smithi099.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-03-30T13:08:02.153 INFO:teuthology.orchestra.run.smithi099.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-03-30T13:08:02.195 INFO:teuthology.orchestra.run.smithi099.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 541 kB/s | 36 kB 00:00 2024-03-30T13:08:02.213 INFO:teuthology.orchestra.run.smithi181.stdout:(18/174): librgw2-19.0.0-2519.gac171039.el9.x86 15 MB/s | 5.1 MB 00:00 2024-03-30T13:08:02.237 INFO:teuthology.orchestra.run.smithi099.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 614 kB/s | 51 kB 00:00 2024-03-30T13:08:02.271 INFO:teuthology.orchestra.run.smithi099.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-30T13:08:02.289 INFO:teuthology.orchestra.run.smithi181.stdout:(19/174): python3-ceph-argparse-19.0.0-2519.gac 607 kB/s | 45 kB 00:00 2024-03-30T13:08:02.295 INFO:teuthology.orchestra.run.smithi099.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-03-30T13:08:02.329 INFO:teuthology.orchestra.run.smithi099.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 7.2 MB/s | 427 kB 00:00 2024-03-30T13:08:02.339 INFO:teuthology.orchestra.run.smithi181.stdout:(20/174): python3-ceph-common-19.0.0-2519.gac17 2.7 MB/s | 134 kB 00:00 2024-03-30T13:08:02.380 INFO:teuthology.orchestra.run.smithi099.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 241 kB/s | 20 kB 00:00 2024-03-30T13:08:02.389 INFO:teuthology.orchestra.run.smithi181.stdout:(21/174): python3-cephfs-19.0.0-2519.gac171039. 3.2 MB/s | 162 kB 00:00 2024-03-30T13:08:02.413 INFO:teuthology.orchestra.run.smithi099.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2024-03-30T13:08:02.681 INFO:teuthology.orchestra.run.smithi181.stdout:(22/174): ceph-osd-19.0.0-2519.gac171039.el9.x8 2.8 MB/s | 17 MB 00:06 2024-03-30T13:08:02.740 INFO:teuthology.orchestra.run.smithi181.stdout:(23/174): python3-rados-19.0.0-2519.gac171039.e 918 kB/s | 321 kB 00:00 2024-03-30T13:08:02.755 INFO:teuthology.orchestra.run.smithi099.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 4.2 MB/s | 1.6 MB 00:00 2024-03-30T13:08:02.782 INFO:teuthology.orchestra.run.smithi181.stdout:(24/174): python3-rgw-19.0.0-2519.gac171039.el9 2.4 MB/s | 99 kB 00:00 2024-03-30T13:08:02.832 INFO:teuthology.orchestra.run.smithi181.stdout:(25/174): rbd-fuse-19.0.0-2519.gac171039.el9.x8 1.7 MB/s | 85 kB 00:00 2024-03-30T13:08:02.866 INFO:teuthology.orchestra.run.smithi181.stdout:(26/174): python3-rbd-19.0.0-2519.gac171039.el9 1.6 MB/s | 298 kB 00:00 2024-03-30T13:08:02.916 INFO:teuthology.orchestra.run.smithi181.stdout:(27/174): rbd-nbd-19.0.0-2519.gac171039.el9.x86 3.4 MB/s | 170 kB 00:00 2024-03-30T13:08:02.966 INFO:teuthology.orchestra.run.smithi181.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2519.g 692 kB/s | 34 kB 00:00 2024-03-30T13:08:03.014 INFO:teuthology.orchestra.run.smithi099.stdout:(150/174): librados2-19.0.0-2519.gac171039.el9. 5.7 MB/s | 3.4 MB 00:00 2024-03-30T13:08:03.017 INFO:teuthology.orchestra.run.smithi181.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2519.gac17103 2.8 MB/s | 141 kB 00:00 2024-03-30T13:08:03.222 INFO:teuthology.orchestra.run.smithi099.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-03-30T13:08:03.298 INFO:teuthology.orchestra.run.smithi099.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 25 MB/s | 1.8 MB 00:00 2024-03-30T13:08:03.300 INFO:teuthology.orchestra.run.smithi181.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2519.gac171 13 MB/s | 3.5 MB 00:00 2024-03-30T13:08:03.357 INFO:teuthology.orchestra.run.smithi099.stdout:(153/174): NetworkManager-team-1.47.2-1.el9.x86 712 kB/s | 41 kB 00:00 2024-03-30T13:08:03.398 INFO:teuthology.orchestra.run.smithi099.stdout:(154/174): NetworkManager-tui-1.47.2-1.el9.x86_ 5.9 MB/s | 247 kB 00:00 2024-03-30T13:08:03.440 INFO:teuthology.orchestra.run.smithi099.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2024-03-30T13:08:03.541 INFO:teuthology.orchestra.run.smithi099.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 724 kB/s | 71 kB 00:00 2024-03-30T13:08:03.791 INFO:teuthology.orchestra.run.smithi099.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 146 kB/s | 36 kB 00:00 2024-03-30T13:08:03.834 INFO:teuthology.orchestra.run.smithi181.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 14 MB/s | 7.4 MB 00:00 2024-03-30T13:08:03.875 INFO:teuthology.orchestra.run.smithi099.stdout:(158/174): librbd1-19.0.0-2519.gac171039.el9.x8 2.8 MB/s | 3.1 MB 00:01 2024-03-30T13:08:03.884 INFO:teuthology.orchestra.run.smithi181.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2519.gac 4.9 MB/s | 249 kB 00:00 2024-03-30T13:08:03.908 INFO:teuthology.orchestra.run.smithi099.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.6 MB/s | 192 kB 00:00 2024-03-30T13:08:03.934 INFO:teuthology.orchestra.run.smithi181.stdout:(33/174): ceph-mgr-rook-19.0.0-2519.gac171039.e 1.0 MB/s | 49 kB 00:00 2024-03-30T13:08:03.967 INFO:teuthology.orchestra.run.smithi099.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 401 kB/s | 23 kB 00:00 2024-03-30T13:08:03.985 INFO:teuthology.orchestra.run.smithi181.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2519.ga 335 kB/s | 16 kB 00:00 2024-03-30T13:08:04.017 INFO:teuthology.orchestra.run.smithi099.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.2 MB/s | 108 kB 00:00 2024-03-30T13:08:04.051 INFO:teuthology.orchestra.run.smithi099.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.4 MB/s | 256 kB 00:00 2024-03-30T13:08:04.085 INFO:teuthology.orchestra.run.smithi099.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 155 kB 00:00 2024-03-30T13:08:04.094 INFO:teuthology.orchestra.run.smithi181.stdout:(35/174): rbd-mirror-19.0.0-2519.gac171039.el9. 2.5 MB/s | 3.1 MB 00:01 2024-03-30T13:08:04.118 INFO:teuthology.orchestra.run.smithi099.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 136 kB 00:00 2024-03-30T13:08:04.127 INFO:teuthology.orchestra.run.smithi181.stdout:(36/174): ceph-volume-19.0.0-2519.gac171039.el9 1.8 MB/s | 264 kB 00:00 2024-03-30T13:08:04.169 INFO:teuthology.orchestra.run.smithi099.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 772 kB/s | 64 kB 00:00 2024-03-30T13:08:04.177 INFO:teuthology.orchestra.run.smithi181.stdout:(37/174): cephfs-top-19.0.0-2519.gac171039.el9. 366 kB/s | 18 kB 00:00 2024-03-30T13:08:04.211 INFO:teuthology.orchestra.run.smithi099.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 315 kB/s | 29 kB 00:00 2024-03-30T13:08:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 10 MB/s | 1.2 MB 00:00 2024-03-30T13:08:04.361 INFO:teuthology.orchestra.run.smithi181.stdout:(38/174): cephadm-19.0.0-2519.gac171039.el9.noa 2.8 MB/s | 762 kB 00:00 2024-03-30T13:08:04.370 INFO:teuthology.orchestra.run.smithi099.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 14 MB/s | 2.2 MB 00:00 2024-03-30T13:08:04.394 INFO:teuthology.orchestra.run.smithi181.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 662 kB 00:00 2024-03-30T13:08:04.428 INFO:teuthology.orchestra.run.smithi099.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 7.9 MB/s | 465 kB 00:00 2024-03-30T13:08:04.445 INFO:teuthology.orchestra.run.smithi181.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 920 kB 00:00 2024-03-30T13:08:04.470 INFO:teuthology.orchestra.run.smithi181.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.5 MB/s | 106 kB 00:00 2024-03-30T13:08:04.495 INFO:teuthology.orchestra.run.smithi099.stdout:(170/174): util-linux-2.37.4-18.el9.x86_64.rpm 11 MB/s | 2.3 MB 00:00 2024-03-30T13:08:04.521 INFO:teuthology.orchestra.run.smithi181.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 4.0 MB/s | 307 kB 00:00 2024-03-30T13:08:04.537 INFO:teuthology.orchestra.run.smithi099.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 289 kB/s | 31 kB 00:00 2024-03-30T13:08:04.554 INFO:teuthology.orchestra.run.smithi181.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 394 kB/s | 32 kB 00:00 2024-03-30T13:08:04.596 INFO:teuthology.orchestra.run.smithi099.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-03-30T13:08:04.654 INFO:teuthology.orchestra.run.smithi181.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 23 MB/s | 3.0 MB 00:00 2024-03-30T13:08:04.679 INFO:teuthology.orchestra.run.smithi181.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 155 kB/s | 17 kB 00:00 2024-03-30T13:08:04.696 INFO:teuthology.orchestra.run.smithi099.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 472 kB/s | 74 kB 00:00 2024-03-30T13:08:04.713 INFO:teuthology.orchestra.run.smithi181.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 312 kB/s | 10 kB 00:00 2024-03-30T13:08:04.738 INFO:teuthology.orchestra.run.smithi181.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-30T13:08:04.764 INFO:teuthology.orchestra.run.smithi181.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 914 kB/s | 44 kB 00:00 2024-03-30T13:08:04.806 INFO:teuthology.orchestra.run.smithi181.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2024-03-30T13:08:04.848 INFO:teuthology.orchestra.run.smithi181.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2024-03-30T13:08:04.873 INFO:teuthology.orchestra.run.smithi181.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 755 kB/s | 46 kB 00:00 2024-03-30T13:08:04.906 INFO:teuthology.orchestra.run.smithi181.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-03-30T13:08:04.940 INFO:teuthology.orchestra.run.smithi181.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-30T13:08:04.999 INFO:teuthology.orchestra.run.smithi181.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.4 MB/s | 217 kB 00:00 2024-03-30T13:08:05.024 INFO:teuthology.orchestra.run.smithi181.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 420 kB/s | 34 kB 00:00 2024-03-30T13:08:05.150 INFO:teuthology.orchestra.run.smithi181.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-03-30T13:08:05.208 INFO:teuthology.orchestra.run.smithi181.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 9.1 MB/s | 1.5 MB 00:00 2024-03-30T13:08:05.258 INFO:teuthology.orchestra.run.smithi181.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 8.2 MB/s | 817 kB 00:00 2024-03-30T13:08:05.284 INFO:teuthology.orchestra.run.smithi181.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 132 kB 00:00 2024-03-30T13:08:05.551 INFO:teuthology.orchestra.run.smithi181.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 20 MB/s | 5.7 MB 00:00 2024-03-30T13:08:05.593 INFO:teuthology.orchestra.run.smithi181.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 3.3 MB/s | 1.0 MB 00:00 2024-03-30T13:08:05.626 INFO:teuthology.orchestra.run.smithi181.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 2.4 MB/s | 78 kB 00:00 2024-03-30T13:08:05.776 INFO:teuthology.orchestra.run.smithi181.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 5.8 MB 00:00 2024-03-30T13:08:05.802 INFO:teuthology.orchestra.run.smithi181.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 153 kB/s | 24 kB 00:00 2024-03-30T13:08:05.844 INFO:teuthology.orchestra.run.smithi181.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 447 kB/s | 18 kB 00:00 2024-03-30T13:08:05.893 INFO:teuthology.orchestra.run.smithi181.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 144 kB 00:00 2024-03-30T13:08:05.952 INFO:teuthology.orchestra.run.smithi181.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 546 kB/s | 32 kB 00:00 2024-03-30T13:08:06.086 INFO:teuthology.orchestra.run.smithi181.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2024-03-30T13:08:06.111 INFO:teuthology.orchestra.run.smithi181.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2024-03-30T13:08:06.153 INFO:teuthology.orchestra.run.smithi181.stdout:(70/174): python3-packaging-20.9-5.el9.noarch.r 1.7 MB/s | 69 kB 00:00 2024-03-30T13:08:06.178 INFO:teuthology.orchestra.run.smithi181.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2024-03-30T13:08:06.204 INFO:teuthology.orchestra.run.smithi181.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 857 kB/s | 41 kB 00:00 2024-03-30T13:08:06.237 INFO:teuthology.orchestra.run.smithi181.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-03-30T13:08:06.263 INFO:teuthology.orchestra.run.smithi181.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-03-30T13:08:06.296 INFO:teuthology.orchestra.run.smithi181.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-03-30T13:08:06.354 INFO:teuthology.orchestra.run.smithi181.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 535 kB/s | 47 kB 00:00 2024-03-30T13:08:06.380 INFO:teuthology.orchestra.run.smithi181.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 520 kB/s | 43 kB 00:00 2024-03-30T13:08:06.547 INFO:teuthology.orchestra.run.smithi181.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 251 kB/s | 39 kB 00:00 2024-03-30T13:08:06.881 INFO:teuthology.orchestra.run.smithi181.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-03-30T13:08:06.906 INFO:teuthology.orchestra.run.smithi181.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 118 kB/s | 41 kB 00:00 2024-03-30T13:08:06.940 INFO:teuthology.orchestra.run.smithi181.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 3.8 MB/s | 220 kB 00:00 2024-03-30T13:08:06.965 INFO:teuthology.orchestra.run.smithi181.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 619 kB/s | 35 kB 00:00 2024-03-30T13:08:06.991 INFO:teuthology.orchestra.run.smithi181.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 938 kB/s | 46 kB 00:00 2024-03-30T13:08:07.024 INFO:teuthology.orchestra.run.smithi181.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 300 kB 00:00 2024-03-30T13:08:07.049 INFO:teuthology.orchestra.run.smithi181.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-03-30T13:08:07.075 INFO:teuthology.orchestra.run.smithi181.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-30T13:08:07.100 INFO:teuthology.orchestra.run.smithi181.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 900 kB/s | 44 kB 00:00 2024-03-30T13:08:07.126 INFO:teuthology.orchestra.run.smithi181.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2024-03-30T13:08:07.159 INFO:teuthology.orchestra.run.smithi181.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-03-30T13:08:07.218 INFO:teuthology.orchestra.run.smithi181.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2024-03-30T13:08:07.243 INFO:teuthology.orchestra.run.smithi181.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-03-30T13:08:07.268 INFO:teuthology.orchestra.run.smithi181.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-03-30T13:08:07.334 INFO:teuthology.orchestra.run.smithi181.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.0 MB/s | 187 kB 00:00 2024-03-30T13:08:07.594 INFO:teuthology.orchestra.run.smithi181.stdout:(94/174): ceph-common-19.0.0-2519.gac171039.el9 1.6 MB/s | 21 MB 00:12 2024-03-30T13:08:07.919 INFO:teuthology.orchestra.run.smithi181.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 289 kB/s | 187 kB 00:00 2024-03-30T13:08:07.953 INFO:teuthology.orchestra.run.smithi181.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 546 kB/s | 195 kB 00:00 2024-03-30T13:08:08.020 INFO:teuthology.orchestra.run.smithi181.stdout:(97/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2024-03-30T13:08:08.045 INFO:teuthology.orchestra.run.smithi181.stdout:(98/174): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-03-30T13:08:08.262 INFO:teuthology.orchestra.run.smithi181.stdout:(99/174): elfutils-libelf-devel-0.190-2.el9.x86 70 kB/s | 21 kB 00:00 2024-03-30T13:08:08.287 INFO:teuthology.orchestra.run.smithi181.stdout:(100/174): libuuid-devel-2.37.4-18.el9.x86_64.r 95 kB/s | 25 kB 00:00 2024-03-30T13:08:08.637 INFO:teuthology.orchestra.run.smithi181.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 709 kB/s | 248 kB 00:00 2024-03-30T13:08:08.754 INFO:teuthology.orchestra.run.smithi181.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 807 kB/s | 94 kB 00:00 2024-03-30T13:08:08.863 INFO:teuthology.orchestra.run.smithi181.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 207 kB/s | 22 kB 00:00 2024-03-30T13:08:08.980 INFO:teuthology.orchestra.run.smithi181.stdout:(104/174): openssl-devel-3.0.7-27.el9.x86_64.rp 4.4 MB/s | 4.1 MB 00:00 2024-03-30T13:08:09.088 INFO:teuthology.orchestra.run.smithi181.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 5.0 MB/s | 548 kB 00:00 2024-03-30T13:08:09.155 INFO:teuthology.orchestra.run.smithi181.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-03-30T13:08:09.189 INFO:teuthology.orchestra.run.smithi181.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-03-30T13:08:09.231 INFO:teuthology.orchestra.run.smithi181.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 261 kB/s | 19 kB 00:00 2024-03-30T13:08:09.273 INFO:teuthology.orchestra.run.smithi181.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 633 kB/s | 26 kB 00:00 2024-03-30T13:08:09.315 INFO:teuthology.orchestra.run.smithi181.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-03-30T13:08:09.365 INFO:teuthology.orchestra.run.smithi181.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-03-30T13:08:09.457 INFO:teuthology.orchestra.run.smithi181.stdout:(112/174): libarrow-9.0.0-10.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-03-30T13:08:09.483 INFO:teuthology.orchestra.run.smithi181.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-03-30T13:08:09.549 INFO:teuthology.orchestra.run.smithi181.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.0 MB/s | 838 kB 00:00 2024-03-30T13:08:09.608 INFO:teuthology.orchestra.run.smithi181.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-03-30T13:08:09.633 INFO:teuthology.orchestra.run.smithi181.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 525 kB/s | 43 kB 00:00 2024-03-30T13:08:09.658 INFO:teuthology.orchestra.run.smithi181.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 652 kB/s | 32 kB 00:00 2024-03-30T13:08:09.684 INFO:teuthology.orchestra.run.smithi181.stdout:(118/174): python3-devel-3.9.17-2.el9.x86_64.rp 173 kB/s | 245 kB 00:01 2024-03-30T13:08:09.709 INFO:teuthology.orchestra.run.smithi181.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 200 kB/s | 15 kB 00:00 2024-03-30T13:08:09.743 INFO:teuthology.orchestra.run.smithi181.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-03-30T13:08:09.776 INFO:teuthology.orchestra.run.smithi181.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-03-30T13:08:09.835 INFO:teuthology.orchestra.run.smithi181.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 391 kB/s | 35 kB 00:00 2024-03-30T13:08:09.868 INFO:teuthology.orchestra.run.smithi181.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-03-30T13:08:09.910 INFO:teuthology.orchestra.run.smithi181.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-03-30T13:08:09.961 INFO:teuthology.orchestra.run.smithi181.stdout:(125/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.2 MB/s | 303 kB 00:00 2024-03-30T13:08:09.986 INFO:teuthology.orchestra.run.smithi181.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-03-30T13:08:10.012 INFO:teuthology.orchestra.run.smithi181.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 355 kB/s | 18 kB 00:00 2024-03-30T13:08:10.062 INFO:teuthology.orchestra.run.smithi181.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 311 kB/s | 23 kB 00:00 2024-03-30T13:08:10.087 INFO:teuthology.orchestra.run.smithi181.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 261 kB/s | 19 kB 00:00 2024-03-30T13:08:10.113 INFO:teuthology.orchestra.run.smithi181.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 398 kB/s | 20 kB 00:00 2024-03-30T13:08:10.179 INFO:teuthology.orchestra.run.smithi181.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-03-30T13:08:10.205 INFO:teuthology.orchestra.run.smithi181.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 508 kB/s | 46 kB 00:00 2024-03-30T13:08:10.263 INFO:teuthology.orchestra.run.smithi181.stdout:(133/174): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-03-30T13:08:10.289 INFO:teuthology.orchestra.run.smithi181.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 729 kB/s | 79 kB 00:00 2024-03-30T13:08:10.314 INFO:teuthology.orchestra.run.smithi181.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 534 kB/s | 58 kB 00:00 2024-03-30T13:08:10.347 INFO:teuthology.orchestra.run.smithi181.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 510 kB/s | 16 kB 00:00 2024-03-30T13:08:10.373 INFO:teuthology.orchestra.run.smithi181.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-03-30T13:08:10.406 INFO:teuthology.orchestra.run.smithi181.stdout:(138/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-03-30T13:08:10.431 INFO:teuthology.orchestra.run.smithi181.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 339 kB/s | 28 kB 00:00 2024-03-30T13:08:10.457 INFO:teuthology.orchestra.run.smithi181.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 370 kB/s | 31 kB 00:00 2024-03-30T13:08:10.515 INFO:teuthology.orchestra.run.smithi181.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-03-30T13:08:10.529 INFO:teuthology.orchestra.run.smithi099.stdout:(174/174): ceph-test-19.0.0-2519.gac171039.el9. 2.4 MB/s | 48 MB 00:19 2024-03-30T13:08:10.541 INFO:teuthology.orchestra.run.smithi181.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 434 kB/s | 36 kB 00:00 2024-03-30T13:08:10.542 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-03-30T13:08:10.542 INFO:teuthology.orchestra.run.smithi099.stdout:Total 9.5 MB/s | 226 MB 00:23 2024-03-30T13:08:10.566 INFO:teuthology.orchestra.run.smithi181.stdout:(143/174): python3-rsa-4.9-2.el9.noarch.rpm 548 kB/s | 59 kB 00:00 2024-03-30T13:08:10.591 INFO:teuthology.orchestra.run.smithi181.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 682 kB/s | 51 kB 00:00 2024-03-30T13:08:10.616 INFO:teuthology.orchestra.run.smithi181.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-03-30T13:08:10.650 INFO:teuthology.orchestra.run.smithi181.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-03-30T13:08:10.667 INFO:teuthology.orchestra.run.smithi181.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 405 kB/s | 20 kB 00:00 2024-03-30T13:08:10.701 INFO:teuthology.orchestra.run.smithi181.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2024-03-30T13:08:10.751 INFO:teuthology.orchestra.run.smithi181.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-03-30T13:08:10.876 INFO:teuthology.orchestra.run.smithi181.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-03-30T13:08:11.135 INFO:teuthology.orchestra.run.smithi181.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-03-30T13:08:11.210 INFO:teuthology.orchestra.run.smithi181.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 25 MB/s | 1.8 MB 00:00 2024-03-30T13:08:11.252 INFO:teuthology.orchestra.run.smithi181.stdout:(153/174): NetworkManager-team-1.47.2-1.el9.x86 1.0 MB/s | 41 kB 00:00 2024-03-30T13:08:11.294 INFO:teuthology.orchestra.run.smithi181.stdout:(154/174): NetworkManager-tui-1.47.2-1.el9.x86_ 5.9 MB/s | 247 kB 00:00 2024-03-30T13:08:11.336 INFO:teuthology.orchestra.run.smithi181.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2024-03-30T13:08:11.428 INFO:teuthology.orchestra.run.smithi181.stdout:(156/174): librados2-19.0.0-2519.gac171039.el9. 4.7 MB/s | 3.4 MB 00:00 2024-03-30T13:08:11.512 INFO:teuthology.orchestra.run.smithi181.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 442 kB/s | 36 kB 00:00 2024-03-30T13:08:11.529 INFO:teuthology.orchestra.run.smithi181.stdout:(158/174): acl-2.3.1-4.el9.x86_64.rpm 373 kB/s | 71 kB 00:00 2024-03-30T13:08:11.596 INFO:teuthology.orchestra.run.smithi181.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-03-30T13:08:11.646 INFO:teuthology.orchestra.run.smithi181.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.2 MB/s | 256 kB 00:00 2024-03-30T13:08:11.648 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-03-30T13:08:11.721 INFO:teuthology.orchestra.run.smithi181.stdout:(161/174): librbd1-19.0.0-2519.gac171039.el9.x8 3.5 MB/s | 3.1 MB 00:00 2024-03-30T13:08:11.746 INFO:teuthology.orchestra.run.smithi181.stdout:(162/174): libacl-2.3.1-4.el9.x86_64.rpm 154 kB/s | 23 kB 00:00 2024-03-30T13:08:11.780 INFO:teuthology.orchestra.run.smithi181.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 815 kB/s | 108 kB 00:00 2024-03-30T13:08:11.847 INFO:teuthology.orchestra.run.smithi181.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 155 kB 00:00 2024-03-30T13:08:11.872 INFO:teuthology.orchestra.run.smithi181.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-03-30T13:08:11.897 INFO:teuthology.orchestra.run.smithi181.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 548 kB/s | 64 kB 00:00 2024-03-30T13:08:11.923 INFO:teuthology.orchestra.run.smithi181.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 383 kB/s | 29 kB 00:00 2024-03-30T13:08:11.998 INFO:teuthology.orchestra.run.smithi181.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2024-03-30T13:08:12.028 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-03-30T13:08:12.028 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-03-30T13:08:12.140 INFO:teuthology.orchestra.run.smithi181.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 8.9 MB/s | 2.2 MB 00:00 2024-03-30T13:08:12.173 INFO:teuthology.orchestra.run.smithi181.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 4.2 MB/s | 465 kB 00:00 2024-03-30T13:08:12.215 INFO:teuthology.orchestra.run.smithi181.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 418 kB/s | 31 kB 00:00 2024-03-30T13:08:12.385 INFO:teuthology.orchestra.run.smithi181.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 5.1 MB/s | 1.1 MB 00:00 2024-03-30T13:08:12.474 INFO:teuthology.orchestra.run.smithi181.stdout:(173/174): util-linux-2.37.4-18.el9.x86_64.rpm 4.1 MB/s | 2.3 MB 00:00 2024-03-30T13:08:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 129 kB/s | 74 kB 00:00 2024-03-30T13:08:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-03-30T13:08:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:Total 12 MB/s | 226 MB 00:18 2024-03-30T13:08:13.935 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-03-30T13:08:14.315 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-03-30T13:08:14.315 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-03-30T13:08:14.622 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-03-30T13:08:14.622 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-03-30T13:08:16.685 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-03-30T13:08:16.686 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-03-30T13:08:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-03-30T13:08:21.967 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-30T13:08:22.006 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-30T13:08:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-30T13:08:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-30T13:08:22.188 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-30T13:08:22.288 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-30T13:08:22.352 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-30T13:08:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-30T13:08:22.483 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-30T13:08:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-30T13:08:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:08:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:08:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:08:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:08:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 12/198 2024-03-30T13:08:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-30T13:08:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-30T13:08:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-30T13:08:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:08:23.838 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:08:23.864 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 17/198 2024-03-30T13:08:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 17/198 2024-03-30T13:08:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-30T13:08:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-30T13:08:24.116 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-03-30T13:08:24.122 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-30T13:08:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-30T13:08:24.300 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-30T13:08:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-30T13:08:24.381 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-30T13:08:24.420 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-30T13:08:24.462 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-30T13:08:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-30T13:08:24.508 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-30T13:08:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-30T13:08:24.654 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-30T13:08:24.695 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-30T13:08:24.784 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-30T13:08:24.850 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-30T13:08:25.023 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-30T13:08:25.161 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-30T13:08:25.204 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-30T13:08:25.251 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:08:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:08:25.402 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:08:25.409 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:08:25.438 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:08:25.575 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:08:25.611 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 12/198 2024-03-30T13:08:25.677 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-30T13:08:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:08:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-30T13:08:25.974 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-30T13:08:26.038 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-30T13:08:26.068 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:08:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-30T13:08:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-30T13:08:26.161 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-30T13:08:26.220 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-30T13:08:26.221 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:08:26.252 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 17/198 2024-03-30T13:08:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-30T13:08:26.342 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 17/198 2024-03-30T13:08:26.399 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-30T13:08:26.421 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-30T13:08:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-30T13:08:26.454 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-30T13:08:26.526 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-30T13:08:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-30T13:08:26.587 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-30T13:08:26.647 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-30T13:08:26.693 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-30T13:08:26.740 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-30T13:08:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-30T13:08:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-30T13:08:26.894 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:19.0.0-2519.gac171039.el9. 39/198 2024-03-30T13:08:26.904 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-30T13:08:26.947 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:19.0.0-2519.gac171039.el 40/198 2024-03-30T13:08:26.954 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-30T13:08:26.984 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_6 41/198 2024-03-30T13:08:27.102 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-30T13:08:27.174 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-30T13:08:27.269 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-30T13:08:27.279 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-30T13:08:27.461 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-30T13:08:27.470 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-30T13:08:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-30T13:08:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-30T13:08:27.748 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:08:27.839 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:08:28.155 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-30T13:08:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:08:28.255 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-30T13:08:28.374 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-30T13:08:28.383 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-30T13:08:28.421 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-30T13:08:28.447 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-30T13:08:28.481 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-30T13:08:28.507 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-30T13:08:28.532 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-30T13:08:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-30T13:08:28.583 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:19.0.0-2519.gac171039.el9.x86_6 53/198 2024-03-30T13:08:28.603 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-30T13:08:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-30T13:08:28.699 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-30T13:08:29.001 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-30T13:08:29.125 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-30T13:08:29.200 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-30T13:08:29.228 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-30T13:08:29.248 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-30T13:08:29.315 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-30T13:08:29.351 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-30T13:08:29.374 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-30T13:08:29.418 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-30T13:08:29.482 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-30T13:08:29.576 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-30T13:08:29.580 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-30T13:08:29.623 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-30T13:08:29.629 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-30T13:08:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-30T13:08:29.746 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-30T13:08:29.785 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.0.0-2519.gac171039.el9. 39/198 2024-03-30T13:08:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-30T13:08:29.838 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.0.0-2519.gac171039.el 40/198 2024-03-30T13:08:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-30T13:08:29.874 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_6 41/198 2024-03-30T13:08:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-30T13:08:29.953 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-30T13:08:29.993 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-30T13:08:30.010 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-30T13:08:30.061 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-30T13:08:30.073 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-30T13:08:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-30T13:08:30.161 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-30T13:08:30.337 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-30T13:08:30.340 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-30T13:08:30.391 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-30T13:08:30.404 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-30T13:08:30.437 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-30T13:08:30.486 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-30T13:08:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-30T13:08:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-30T13:08:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-30T13:08:30.734 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-30T13:08:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-30T13:08:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-30T13:08:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-30T13:08:31.125 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-30T13:08:31.217 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-30T13:08:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-30T13:08:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-30T13:08:31.346 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-30T13:08:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-30T13:08:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-30T13:08:31.440 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-30T13:08:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-30T13:08:31.517 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-30T13:08:31.583 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-30T13:08:31.645 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.0.0-2519.gac171039.el9.x86_6 53/198 2024-03-30T13:08:31.691 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-30T13:08:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-30T13:08:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-30T13:08:31.929 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-30T13:08:31.969 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-30T13:08:32.012 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-30T13:08:32.047 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-30T13:08:32.087 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-30T13:08:32.104 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-30T13:08:32.133 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-30T13:08:32.191 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-30T13:08:32.244 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-30T13:08:32.285 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-30T13:08:32.314 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-30T13:08:32.409 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-30T13:08:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-30T13:08:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-30T13:08:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-30T13:08:32.489 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-30T13:08:32.542 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-30T13:08:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-30T13:08:32.691 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-30T13:08:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-30T13:08:32.782 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-30T13:08:32.839 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-30T13:08:32.868 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-30T13:08:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-30T13:08:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-30T13:08:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-30T13:08:33.025 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-30T13:08:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-30T13:08:33.102 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-30T13:08:33.121 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-30T13:08:33.172 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-30T13:08:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-30T13:08:33.219 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-30T13:08:33.281 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-30T13:08:33.347 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-30T13:08:33.537 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-30T13:08:33.591 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-30T13:08:33.653 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-30T13:08:33.711 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-30T13:08:33.843 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-30T13:08:33.885 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-30T13:08:33.931 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-30T13:08:33.968 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-30T13:08:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-30T13:08:34.178 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-30T13:08:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-30T13:08:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-30T13:08:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-30T13:08:34.362 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-30T13:08:34.379 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-30T13:08:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-30T13:08:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-30T13:08:34.516 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-30T13:08:34.570 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-30T13:08:34.641 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-30T13:08:34.716 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-30T13:08:34.748 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-30T13:08:34.779 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-30T13:08:34.878 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-30T13:08:34.963 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-30T13:08:35.034 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-30T13:08:35.209 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-30T13:08:35.256 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-30T13:08:35.296 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-30T13:08:35.334 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-30T13:08:35.382 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-30T13:08:35.455 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-30T13:08:35.526 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-30T13:08:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-30T13:08:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-30T13:08:35.674 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-30T13:08:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-30T13:08:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-30T13:08:35.827 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-30T13:08:35.896 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-30T13:08:35.963 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-30T13:08:36.006 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-30T13:08:36.153 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-30T13:08:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-30T13:08:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-30T13:08:36.397 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-30T13:08:36.457 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-30T13:08:36.605 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-30T13:08:36.670 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-30T13:08:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-30T13:08:37.632 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-30T13:08:37.691 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-30T13:08:37.711 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-30T13:08:37.746 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-30T13:08:37.805 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-30T13:08:37.917 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-30T13:08:37.948 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-30T13:08:37.971 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-30T13:08:37.986 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-30T13:08:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-30T13:08:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-30T13:08:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-30T13:08:38.333 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-30T13:08:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-30T13:08:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:19.0.0-2519.gac171039.el9.x86_64 124/198 2024-03-30T13:08:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:19.0.0-2519.gac171039.el9.x86_64 124/198 2024-03-30T13:08:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 125/198 2024-03-30T13:08:38.747 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-30T13:08:39.126 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-30T13:08:39.265 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-30T13:08:39.301 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-30T13:08:39.342 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:19.0.0-2519.gac171039.el9.x86_64 128/198 2024-03-30T13:08:39.468 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:19.0.0-2519.gac171039.el9.x86_64 128/198 2024-03-30T13:08:39.494 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 129/198 2024-03-30T13:08:40.774 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-30T13:08:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-30T13:08:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-30T13:08:40.950 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-30T13:08:40.991 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-30T13:08:41.393 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-30T13:08:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.0.0-2519.gac171039.el9.x86_64 124/198 2024-03-30T13:08:41.549 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.0.0-2519.gac171039.el9.x86_64 124/198 2024-03-30T13:08:41.594 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 125/198 2024-03-30T13:08:41.656 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-30T13:08:42.108 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:08:42.148 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:08:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-30T13:08:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.0.0-2519.gac171039.el9.x86_64 128/198 2024-03-30T13:08:42.307 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.0.0-2519.gac171039.el9.x86_64 128/198 2024-03-30T13:08:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 129/198 2024-03-30T13:08:42.767 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:08:42.810 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 131/198 2024-03-30T13:08:42.979 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 131/198 2024-03-30T13:08:42.979 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-30T13:08:42.980 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-30T13:08:42.980 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:08:43.029 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 132/198 2024-03-30T13:08:44.981 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:08:45.106 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:08:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:08:45.818 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 131/198 2024-03-30T13:08:45.971 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 131/198 2024-03-30T13:08:45.971 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-30T13:08:45.971 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-30T13:08:45.971 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:08:46.027 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 132/198 2024-03-30T13:08:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 132/198 2024-03-30T13:08:56.102 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-03-30T13:08:56.102 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-03-30T13:08:56.102 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-03-30T13:08:56.102 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-03-30T13:08:56.102 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-03-30T13:08:56.102 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2024-03-30T13:08:56.102 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-03-30T13:08:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:08:56.291 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 133/198 2024-03-30T13:08:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 133/198 2024-03-30T13:08:56.333 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:08:56.333 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-30T13:08:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:08:57.876 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 134/198 2024-03-30T13:08:57.951 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 134/198 2024-03-30T13:08:57.951 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:08:57.951 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-30T13:08:57.951 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T13:08:57.951 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T13:08:57.951 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:08:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 135/198 2024-03-30T13:08:58.263 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 135/198 2024-03-30T13:08:58.263 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:08:58.263 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-30T13:08:58.263 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T13:08:58.264 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T13:08:58.264 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:08:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 136/198 2024-03-30T13:08:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 132/198 2024-03-30T13:08:58.766 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-03-30T13:08:58.766 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-03-30T13:08:58.766 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-03-30T13:08:58.766 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-03-30T13:08:58.766 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-03-30T13:08:58.766 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-03-30T13:08:58.766 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-03-30T13:08:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:08:58.820 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 136/198 2024-03-30T13:08:58.820 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:08:58.820 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-30T13:08:58.820 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T13:08:58.820 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T13:08:58.820 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:08:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-30T13:08:59.008 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 133/198 2024-03-30T13:08:59.055 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 133/198 2024-03-30T13:08:59.055 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:08:59.055 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-30T13:08:59.055 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:08:59.554 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.0.0-2519.gac171039.el9.noarch 138/198 2024-03-30T13:08:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:19.0.0-2519.gac171039.el9.noarch 138/198 2024-03-30T13:08:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2519.gac171039.e 139/198 2024-03-30T13:08:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2519.gac171039. 140/198 2024-03-30T13:08:59.766 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 141/198 2024-03-30T13:09:00.652 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 134/198 2024-03-30T13:09:00.728 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 134/198 2024-03-30T13:09:00.728 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:00.728 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-30T13:09:00.729 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T13:09:00.729 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T13:09:00.729 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:00.977 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 135/198 2024-03-30T13:09:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 135/198 2024-03-30T13:09:01.046 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:01.046 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-30T13:09:01.047 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T13:09:01.047 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T13:09:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 141/198 2024-03-30T13:09:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 142/198 2024-03-30T13:09:01.528 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 136/198 2024-03-30T13:09:01.596 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 136/198 2024-03-30T13:09:01.596 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:01.596 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-30T13:09:01.596 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T13:09:01.597 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T13:09:01.597 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:01.721 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-30T13:09:02.186 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 142/198 2024-03-30T13:09:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 143/198 2024-03-30T13:09:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 143/198 2024-03-30T13:09:02.364 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.0.0-2519.gac171039.el9.noarch 138/198 2024-03-30T13:09:02.406 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.0.0-2519.gac171039.el9.noarch 138/198 2024-03-30T13:09:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2519.gac171039.e 139/198 2024-03-30T13:09:02.530 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el 144/198 2024-03-30T13:09:02.562 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 145/198 2024-03-30T13:09:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2519.gac171039. 140/198 2024-03-30T13:09:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 141/198 2024-03-30T13:09:02.628 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 145/198 2024-03-30T13:09:02.628 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:02.628 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-30T13:09:02.628 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T13:09:02.628 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T13:09:02.628 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 146/198 2024-03-30T13:09:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 146/198 2024-03-30T13:09:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:19.0.0-2519.gac171039.el9.x86_64 147/198 2024-03-30T13:09:03.752 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-30T13:09:03.781 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 149/198 2024-03-30T13:09:03.854 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 149/198 2024-03-30T13:09:03.854 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:03.854 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-30T13:09:03.854 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:09:03.855 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:09:03.855 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:03.915 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 141/198 2024-03-30T13:09:03.962 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 142/198 2024-03-30T13:09:03.973 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2519.gac171 150/198 2024-03-30T13:09:04.041 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2519.gac171 150/198 2024-03-30T13:09:04.041 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:04.041 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-30T13:09:04.041 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:09:04.199 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:09:04.199 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:04.199 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-30T13:09:04.199 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:09:04.199 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:09:04.199 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:04.533 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 152/198 2024-03-30T13:09:04.602 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 152/198 2024-03-30T13:09:04.602 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:04.602 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-30T13:09:04.602 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T13:09:04.602 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T13:09:04.603 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:05.047 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 142/198 2024-03-30T13:09:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 143/198 2024-03-30T13:09:05.220 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 143/198 2024-03-30T13:09:05.428 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el 144/198 2024-03-30T13:09:05.464 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 145/198 2024-03-30T13:09:05.550 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 145/198 2024-03-30T13:09:05.551 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:05.551 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-30T13:09:05.551 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T13:09:05.551 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T13:09:05.551 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:05.615 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 146/198 2024-03-30T13:09:05.651 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 146/198 2024-03-30T13:09:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.0.0-2519.gac171039.el9.x86_64 147/198 2024-03-30T13:09:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-30T13:09:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 149/198 2024-03-30T13:09:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 149/198 2024-03-30T13:09:06.823 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:06.823 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-30T13:09:06.823 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:09:06.823 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:09:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:06.885 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2519.gac171 150/198 2024-03-30T13:09:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2519.gac171 150/198 2024-03-30T13:09:06.978 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:06.978 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-30T13:09:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:07.094 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:09:07.198 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:09:07.198 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:07.198 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-30T13:09:07.198 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:09:07.198 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:09:07.198 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:07.603 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 152/198 2024-03-30T13:09:07.694 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 152/198 2024-03-30T13:09:07.694 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:07.694 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-30T13:09:07.694 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T13:09:07.695 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T13:09:07.695 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:09.380 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 153/198 2024-03-30T13:09:09.435 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 154/198 2024-03-30T13:09:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 155/198 2024-03-30T13:09:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-30T13:09:09.796 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 157/198 2024-03-30T13:09:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-30T13:09:09.962 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 159/198 2024-03-30T13:09:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-30T13:09:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-30T13:09:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-30T13:09:10.140 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_ 163/198 2024-03-30T13:09:10.177 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-30T13:09:10.229 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-30T13:09:10.320 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-30T13:09:10.418 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-30T13:09:10.455 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-30T13:09:11.389 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:09:11.552 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:09:11.624 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:09:12.526 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 153/198 2024-03-30T13:09:12.581 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 154/198 2024-03-30T13:09:12.615 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 155/198 2024-03-30T13:09:12.653 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-30T13:09:12.950 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 157/198 2024-03-30T13:09:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 170/198 2024-03-30T13:09:13.071 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-30T13:09:13.073 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-30T13:09:13.125 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-30T13:09:13.126 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 159/198 2024-03-30T13:09:13.184 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-30T13:09:13.252 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-30T13:09:13.259 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-30T13:09:13.284 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-30T13:09:13.305 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-30T13:09:13.309 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-30T13:09:13.339 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_ 163/198 2024-03-30T13:09:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-30T13:09:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-30T13:09:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-30T13:09:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-30T13:09:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-30T13:09:13.523 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-30T13:09:13.552 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-30T13:09:13.565 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-30T13:09:13.565 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-30T13:09:13.663 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-30T13:09:13.702 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-30T13:09:13.702 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-30T13:09:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-30T13:09:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-30T13:09:13.826 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-30T13:09:13.850 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-30T13:09:13.918 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-30T13:09:13.988 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-30T13:09:14.047 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-30T13:09:14.085 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-30T13:09:14.113 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-30T13:09:14.146 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-30T13:09:14.180 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-30T13:09:14.217 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:09:14.217 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:09:14.547 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:09:14.547 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-30T13:09:14.639 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:09:14.669 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-30T13:09:14.690 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:09:14.699 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-30T13:09:14.750 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:09:14.753 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-30T13:09:14.786 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-30T13:09:14.826 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-30T13:09:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-30T13:09:15.197 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-30T13:09:15.197 INFO:teuthology.orchestra.run.smithi099.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-30T13:09:15.197 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:16.099 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 170/198 2024-03-30T13:09:16.212 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-30T13:09:16.264 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-30T13:09:16.397 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-30T13:09:16.431 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-30T13:09:16.464 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-30T13:09:16.490 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-30T13:09:16.530 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-30T13:09:16.530 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-30T13:09:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-30T13:09:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-30T13:09:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-30T13:09:16.849 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-30T13:09:16.888 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-30T13:09:16.931 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-30T13:09:16.964 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-30T13:09:16.996 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-30T13:09:17.083 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-30T13:09:17.168 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-30T13:09:17.209 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-30T13:09:17.243 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-30T13:09:17.276 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-30T13:09:17.310 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-30T13:09:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-30T13:09:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:09:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:09:17.718 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:09:17.718 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-30T13:09:17.858 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-30T13:09:17.888 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-30T13:09:17.941 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-30T13:09:17.982 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-30T13:09:18.022 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-30T13:09:18.143 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-30T13:09:18.398 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-30T13:09:18.399 INFO:teuthology.orchestra.run.smithi181.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-30T13:09:18.399 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:20.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:19.0.0-2519.gac171039.el9.x86_64 1/198 2024-03-30T13:09:20.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 2/198 2024-03-30T13:09:20.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 3/198 2024-03-30T13:09:20.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 4/198 2024-03-30T13:09:20.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2519.gac171 5/198 2024-03-30T13:09:20.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 6/198 2024-03-30T13:09:20.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 7/198 2024-03-30T13:09:20.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 8/198 2024-03-30T13:09:20.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 9/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 12/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 13/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 14/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_ 15/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 17/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:19.0.0-2519.gac171039.el9.x86_6 18/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 19/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:19.0.0-2519.gac171039.el9.x86_64 20/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2519.gac171039.el 21/198 2024-03-30T13:09:20.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:19.0.0-2519.gac171039.el9. 22/198 2024-03-30T13:09:20.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_6 23/198 2024-03-30T13:09:20.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 24/198 2024-03-30T13:09:20.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 25/198 2024-03-30T13:09:20.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 26/198 2024-03-30T13:09:20.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 27/198 2024-03-30T13:09:20.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 28/198 2024-03-30T13:09:20.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 29/198 2024-03-30T13:09:20.698 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2519.gac171039. 30/198 2024-03-30T13:09:20.698 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 31/198 2024-03-30T13:09:20.698 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 32/198 2024-03-30T13:09:20.698 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 33/198 2024-03-30T13:09:20.698 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el 34/198 2024-03-30T13:09:20.698 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 35/198 2024-03-30T13:09:20.698 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2519.gac171039.e 36/198 2024-03-30T13:09:20.698 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 37/198 2024-03-30T13:09:20.698 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:19.0.0-2519.gac171039.el9.noarch 38/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 39/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-30T13:09:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-30T13:09:20.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-30T13:09:20.701 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-30T13:09:20.702 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-30T13:09:20.703 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-30T13:09:20.704 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-30T13:09:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-30T13:09:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:19.0.0-2519.gac171039.el9.x86_64 153/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-30T13:09:20.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-30T13:09:20.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-30T13:09:20.709 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-30T13:09:20.710 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-30T13:09:20.710 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-30T13:09:20.710 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-30T13:09:20.710 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-30T13:09:20.710 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-30T13:09:20.710 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-30T13:09:20.710 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-30T13:09:20.710 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-30T13:09:20.710 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-30T13:09:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-30T13:09:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:23.181 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-03-30T13:09:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: acl-2.3.1-4.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-30T13:09:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-30T13:09:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: automake-1.16.2-8.el9.noarch 2024-03-30T13:09:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: bison-3.7.4-5.el9.x86_64 2024-03-30T13:09:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-30T13:09:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-30T13:09:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: flex-2.6.4-9.el9.x86_64 2024-03-30T13:09:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-30T13:09:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-30T13:09:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-30T13:09:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-30T13:09:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-30T13:09:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-30T13:09:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: jq-1.6-16.el9.x86_64 2024-03-30T13:09:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-30T13:09:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-30T13:09:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-30T13:09:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: lua-5.4.4-4.el9.x86_64 2024-03-30T13:09:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-13.14-1.el9.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-30T13:09:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-30T13:09:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-30T13:09:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-30T13:09:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-30T13:09:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-3.el9.x86_64 2024-03-30T13:09:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-30T13:09:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-30T13:09:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-30T13:09:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-30T13:09:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-30T13:09:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-30T13:09:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:23.196 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-03-30T13:09:23.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.0.0-2519.gac171039.el9.x86_64 1/198 2024-03-30T13:09:23.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 2/198 2024-03-30T13:09:23.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 3/198 2024-03-30T13:09:23.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 4/198 2024-03-30T13:09:23.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2519.gac171 5/198 2024-03-30T13:09:23.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 6/198 2024-03-30T13:09:23.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 7/198 2024-03-30T13:09:23.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 8/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 9/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 12/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 13/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 14/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_ 15/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 17/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.0.0-2519.gac171039.el9.x86_6 18/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 19/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.0.0-2519.gac171039.el9.x86_64 20/198 2024-03-30T13:09:23.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2519.gac171039.el 21/198 2024-03-30T13:09:23.838 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.0.0-2519.gac171039.el9. 22/198 2024-03-30T13:09:23.838 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_6 23/198 2024-03-30T13:09:23.838 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 24/198 2024-03-30T13:09:23.838 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 25/198 2024-03-30T13:09:23.838 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 26/198 2024-03-30T13:09:23.838 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 27/198 2024-03-30T13:09:23.838 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 28/198 2024-03-30T13:09:23.838 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 29/198 2024-03-30T13:09:23.838 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2519.gac171039. 30/198 2024-03-30T13:09:23.838 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 31/198 2024-03-30T13:09:23.838 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 32/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 33/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el 34/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 35/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2519.gac171039.e 36/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 37/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.0.0-2519.gac171039.el9.noarch 38/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 39/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-30T13:09:23.839 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-30T13:09:23.840 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-30T13:09:23.841 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-30T13:09:23.841 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-30T13:09:23.841 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-30T13:09:23.841 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-30T13:09:23.841 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-30T13:09:23.841 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-30T13:09:23.841 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-30T13:09:23.841 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-30T13:09:23.841 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-30T13:09:23.841 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-30T13:09:23.842 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-30T13:09:23.843 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-30T13:09:23.843 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-30T13:09:23.843 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-30T13:09:23.843 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-30T13:09:23.843 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-30T13:09:23.843 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-30T13:09:23.843 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-30T13:09:23.844 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-30T13:09:23.845 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-30T13:09:23.845 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-30T13:09:23.845 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-30T13:09:23.845 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-30T13:09:23.845 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-30T13:09:23.845 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-30T13:09:23.845 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-30T13:09:23.845 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-30T13:09:23.845 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-30T13:09:23.846 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-30T13:09:23.847 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-30T13:09:23.847 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-30T13:09:23.847 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-30T13:09:23.847 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-30T13:09:23.847 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-30T13:09:23.847 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-30T13:09:23.847 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-30T13:09:23.847 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-30T13:09:23.847 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-30T13:09:23.847 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-30T13:09:23.847 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-30T13:09:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-30T13:09:23.849 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-30T13:09:23.849 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-30T13:09:23.849 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-30T13:09:23.849 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-30T13:09:23.849 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-30T13:09:23.849 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-30T13:09:23.849 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-30T13:09:23.849 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-30T13:09:23.849 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-30T13:09:23.849 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:09:23.849 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.0.0-2519.gac171039.el9.x86_64 153/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-30T13:09:23.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-30T13:09:23.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-30T13:09:23.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-30T13:09:23.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-30T13:09:23.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-30T13:09:23.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-30T13:09:23.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-30T13:09:23.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-30T13:09:23.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-30T13:09:23.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-30T13:09:23.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-30T13:09:23.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-30T13:09:23.852 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-30T13:09:23.853 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-30T13:09:23.853 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-30T13:09:23.853 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-30T13:09:23.853 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-30T13:09:23.853 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-30T13:09:23.853 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-30T13:09:23.853 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-30T13:09:23.853 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-30T13:09:23.853 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-30T13:09:23.853 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-30T13:09:23.903 DEBUG:teuthology.parallel:result is None 2024-03-30T13:09:26.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-30T13:09:26.480 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:26.480 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: acl-2.3.1-4.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-30T13:09:26.481 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-03-30T13:09:26.482 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:26.483 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-03-30T13:09:26.484 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: jq-1.6-16.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-30T13:09:26.485 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-30T13:09:26.486 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.14-1.el9.x86_64 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-30T13:09:26.487 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-30T13:09:26.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-30T13:09:26.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-30T13:09:26.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-30T13:09:26.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-30T13:09:26.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-30T13:09:26.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-30T13:09:26.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-30T13:09:26.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-30T13:09:26.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-03-30T13:09:26.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-30T13:09:26.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-30T13:09:26.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-30T13:09:26.491 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.492 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.493 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:09:26.493 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-3.el9.x86_64 2024-03-30T13:09:26.493 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-30T13:09:26.493 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-30T13:09:26.493 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-30T13:09:26.493 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-30T13:09:26.493 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-30T13:09:26.493 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-30T13:09:26.493 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:26.493 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-03-30T13:09:27.190 DEBUG:teuthology.parallel:result is None 2024-03-30T13:09:27.190 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:09:27.417 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-30T13:09:27.473 INFO:teuthology.orchestra.run.smithi099.stdout:19.0.0-2519.gac171039.el9 2024-03-30T13:09:27.473 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2519.gac171039.el9 2024-03-30T13:09:27.473 INFO:teuthology.task.install:The correct ceph version 19.0.0-2519.gac171039 is installed. 2024-03-30T13:09:27.475 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:09:27.626 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-30T13:09:27.683 INFO:teuthology.orchestra.run.smithi181.stdout:19.0.0-2519.gac171039.el9 2024-03-30T13:09:27.683 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2519.gac171039.el9 2024-03-30T13:09:27.683 INFO:teuthology.task.install:The correct ceph version 19.0.0-2519.gac171039 is installed. 2024-03-30T13:09:27.685 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-30T13:09:27.685 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:09:27.685 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T13:09:27.762 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:09:27.762 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T13:09:27.835 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-30T13:09:27.835 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:09:27.835 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T13:09:27.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T13:09:28.049 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:09:28.049 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T13:09:28.122 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T13:09:28.237 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-30T13:09:28.237 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:09:28.238 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T13:09:28.312 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T13:09:28.436 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:09:28.436 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T13:09:28.507 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T13:09:28.628 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-30T13:09:28.628 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:09:28.629 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T13:09:28.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T13:09:28.836 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:09:28.836 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T13:09:28.909 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T13:09:29.024 INFO:teuthology.run_tasks:Running task ceph... 2024-03-30T13:09:29.112 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-30T13:09:29.112 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2024-03-30T13:09:29.120 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2024-03-30T13:09:29.199 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-30T13:09:29.199 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-30T13:09:29.206 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-30T13:09:29.280 INFO:tasks.ceph:Creating extra log directories... 2024-03-30T13:09:29.280 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-30T13:09:29.284 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-30T13:09:29.359 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-30T13:09:29.359 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-30T13:09:29.359 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-30T13:09:29.360 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:09:29.360 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-30T13:09:29.404 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-30T13:09:29.656 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-30T13:09:29.756 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:09:29.756 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-30T13:09:29.800 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-30T13:09:30.008 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-30T13:09:30.085 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-30T13:09:30.085 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-30T13:09:30.085 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148', 'branch': 'wip-mchangir-testing1-main-20240328-072412', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7629148', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing1-main-20240328-072412'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing1-main-20240328-072412', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 364, 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-mchangir-testing1-main-20240328-072412', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDZULCtdpAoiI+VPGR22ZzcGvpezNcmJBRbXqUsn+mA96c3DhVejkFteJv2TM5YffEKHKFC/mmHqqmHSv0+TKxk=', 'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBn+oUoitFPlnaBPd+LEUHydfuxrtCvEzj4aACGLaJ2Zmxr+uQT5Smte+l5jyHFm1gEF53mO2IDokoMkom8tAfk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_uninlining']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-29_13:38:54', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-30T13:09:30.086 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-30T13:09:30.094 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-30T13:09:30.145 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2024-03-30T13:09:30.150 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2024-03-30T13:09:30.242 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:09:30.242 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T13:09:30.294 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T13:09:30.294 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-03-30T13:09:30.344 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T13:09:30.344 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:09:30.344 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-30T13:09:30.344 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:09:30.344 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:09:30.344 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-30 13:09:15.628699469 +0000 2024-03-30T13:09:30.344 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-30 13:06:43.832030000 +0000 2024-03-30T13:09:30.344 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-30 13:06:43.832030000 +0000 2024-03-30T13:09:30.344 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-03-30 13:06:43.832030000 +0000 2024-03-30T13:09:30.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T13:09:30.422 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-30T13:09:30.422 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-30T13:09:30.422 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000344443 s, 1.5 MB/s 2024-03-30T13:09:30.426 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T13:09:30.479 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-03-30T13:09:30.525 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T13:09:30.525 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:09:30.525 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-03-30T13:09:30.525 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:09:30.525 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:09:30.526 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-30 13:09:15.629699446 +0000 2024-03-30T13:09:30.526 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-30 13:06:44.391016958 +0000 2024-03-30T13:09:30.526 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-30 13:06:44.391016958 +0000 2024-03-30T13:09:30.526 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-03-30 13:06:44.391016958 +0000 2024-03-30T13:09:30.526 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T13:09:30.656 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-30T13:09:30.656 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-30T13:09:30.656 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000325046 s, 1.6 MB/s 2024-03-30T13:09:30.660 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T13:09:30.718 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-03-30T13:09:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T13:09:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:09:30.770 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-03-30T13:09:30.770 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:09:30.770 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:09:30.770 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-30 13:09:15.630699423 +0000 2024-03-30T13:09:30.770 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-30 13:06:44.951003892 +0000 2024-03-30T13:09:30.770 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-30 13:06:44.951003892 +0000 2024-03-30T13:09:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-03-30 13:06:44.951003892 +0000 2024-03-30T13:09:30.771 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T13:09:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-30T13:09:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-30T13:09:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000335793 s, 1.5 MB/s 2024-03-30T13:09:30.865 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T13:09:30.924 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-03-30T13:09:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T13:09:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:09:30.975 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-30T13:09:30.975 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:09:30.975 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:09:30.975 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-30 13:09:15.630699423 +0000 2024-03-30T13:09:30.976 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-30 13:06:45.505990943 +0000 2024-03-30T13:09:30.976 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-30 13:06:45.505990943 +0000 2024-03-30T13:09:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-03-30 13:06:45.505990943 +0000 2024-03-30T13:09:30.976 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T13:09:31.066 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-30T13:09:31.066 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-30T13:09:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000338827 s, 1.5 MB/s 2024-03-30T13:09:31.071 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T13:09:31.123 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:09:31.123 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:09:31.123 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T13:09:31.180 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T13:09:31.181 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-03-30T13:09:31.231 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T13:09:31.231 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:09:31.231 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 634 Links: 1 2024-03-30T13:09:31.231 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:09:31.232 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:09:31.232 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-03-30 13:09:18.827348350 +0000 2024-03-30T13:09:31.232 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-03-30 13:05:14.062677920 +0000 2024-03-30T13:09:31.232 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-03-30 13:05:14.062677920 +0000 2024-03-30T13:09:31.232 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-03-30 13:05:14.062677920 +0000 2024-03-30T13:09:31.232 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T13:09:31.311 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-03-30T13:09:31.311 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-03-30T13:09:31.312 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000379646 s, 1.3 MB/s 2024-03-30T13:09:31.315 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T13:09:31.370 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-03-30T13:09:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T13:09:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:09:31.419 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-03-30T13:09:31.419 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:09:31.419 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:09:31.419 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-03-30 13:09:18.828348330 +0000 2024-03-30T13:09:31.419 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-03-30 13:05:14.625666865 +0000 2024-03-30T13:09:31.419 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-03-30 13:05:14.625666865 +0000 2024-03-30T13:09:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-03-30 13:05:14.625666865 +0000 2024-03-30T13:09:31.419 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T13:09:31.506 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-03-30T13:09:31.507 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-03-30T13:09:31.507 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000323623 s, 1.6 MB/s 2024-03-30T13:09:31.510 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T13:09:31.563 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-03-30T13:09:31.609 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T13:09:31.609 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:09:31.609 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-03-30T13:09:31.609 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:09:31.609 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:09:31.609 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-03-30 13:09:18.828348330 +0000 2024-03-30T13:09:31.609 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-03-30 13:05:15.215655279 +0000 2024-03-30T13:09:31.609 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-03-30 13:05:15.215655279 +0000 2024-03-30T13:09:31.609 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-03-30 13:05:15.215655279 +0000 2024-03-30T13:09:31.610 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T13:09:31.732 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-03-30T13:09:31.732 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-03-30T13:09:31.732 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000359513 s, 1.4 MB/s 2024-03-30T13:09:31.734 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T13:09:31.783 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-03-30T13:09:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T13:09:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:09:31.829 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-03-30T13:09:31.829 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:09:31.829 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:09:31.829 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-03-30 13:09:18.829348310 +0000 2024-03-30T13:09:31.829 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-03-30 13:05:15.801643771 +0000 2024-03-30T13:09:31.829 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-03-30 13:05:15.801643771 +0000 2024-03-30T13:09:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-03-30 13:05:15.801643771 +0000 2024-03-30T13:09:31.830 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T13:09:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-03-30T13:09:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-03-30T13:09:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000324646 s, 1.6 MB/s 2024-03-30T13:09:31.967 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T13:09:32.023 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:09:32.023 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-30T13:09:32.023 INFO:tasks.ceph:Generating config... 2024-03-30T13:09:32.024 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-30T13:09:32.025 INFO:tasks.ceph:[client] debug client = 20 2024-03-30T13:09:32.025 INFO:tasks.ceph:[client] debug ms = 1 2024-03-30T13:09:32.025 INFO:tasks.ceph:[client] pid file = 2024-03-30T13:09:32.025 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-30T13:09:32.025 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-30T13:09:32.025 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-30T13:09:32.025 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-30T13:09:32.025 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-30T13:09:32.025 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-30T13:09:32.025 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-30T13:09:32.025 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-30T13:09:32.025 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-30T13:09:32.025 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-30T13:09:32.025 INFO:tasks.ceph:[mds] mds_bal_replicate_threshold = 1 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mgr] debug client = 20 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-03-30T13:09:32.026 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-30T13:09:32.026 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-30T13:09:32.026 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-30T13:09:32.027 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-30T13:09:32.028 INFO:tasks.ceph:Setting up mon.a... 2024-03-30T13:09:32.028 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-30T13:09:32.159 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.keyring 2024-03-30T13:09:32.167 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-30T13:09:32.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T13:09:32.388 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.99'), ('mon.b', '172.21.15.181'), ('mon.c', '[v2:172.21.15.181:3301,v1:172.21.15.181:6790]')] 2024-03-30T13:09:32.388 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.99,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-30T13:09:32.389 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:09:32.389 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-30T13:09:32.442 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.99 --add b 172.21.15.181 --addv c '[v2:172.21.15.181:3301,v1:172.21.15.181:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:09:32.597 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:09:32.597 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: generated fsid e28e230a-999b-4d07-a5bd-ee507abf8d14 2024-03-30T13:09:32.597 INFO:teuthology.orchestra.run.smithi099.stdout:setting min_mon_release = quincy 2024-03-30T13:09:32.597 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 0 2024-03-30T13:09:32.597 INFO:teuthology.orchestra.run.smithi099.stdout:fsid e28e230a-999b-4d07-a5bd-ee507abf8d14 2024-03-30T13:09:32.597 INFO:teuthology.orchestra.run.smithi099.stdout:last_changed 2024-03-30T13:09:32.594677+0000 2024-03-30T13:09:32.598 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-03-30T13:09:32.594677+0000 2024-03-30T13:09:32.598 INFO:teuthology.orchestra.run.smithi099.stdout:min_mon_release 17 (quincy) 2024-03-30T13:09:32.598 INFO:teuthology.orchestra.run.smithi099.stdout:election_strategy: 1 2024-03-30T13:09:32.598 INFO:teuthology.orchestra.run.smithi099.stdout:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-30T13:09:32.598 INFO:teuthology.orchestra.run.smithi099.stdout:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-03-30T13:09:32.598 INFO:teuthology.orchestra.run.smithi099.stdout:2: [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] mon.c 2024-03-30T13:09:32.598 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-30T13:09:32.600 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-30T13:09:32.649 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e28e230a-999b-4d07-a5bd-ee507abf8d14... 2024-03-30T13:09:32.650 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-30T13:09:32.655 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-30T13:09:32.814 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-03-30T13:09:32.814 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2024-03-30T13:09:32.814 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-30T13:09:32.814 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2024-03-30T13:09:32.814 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.814 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2024-03-30T13:09:32.815 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2024-03-30T13:09:32.816 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.99,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on skipped message = False 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = e28e230a-999b-4d07-a5bd-ee507abf8d14 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.817 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2024-03-30T13:09:32.818 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2024-03-30T13:09:32.819 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: bdev async discard = True 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: bdev enable discard = True 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore allocator = bitmap 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 1/20 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 1/20 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 4/10 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2024-03-30T13:09:32.820 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: debug finisher = 20 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.821 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2024-03-30T13:09:32.822 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: mon down mkfs grace = 300 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: mon op complaint time = 120 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2024-03-30T13:09:32.823 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout: client mount timeout = 600 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = "" 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2024-03-30T13:09:32.824 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout:[mds] 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds = 20 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds balancer = 20 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug frag = True 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug scatterstat = True 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout: mds op complaint time = 180 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout: mds verify scatter = True 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout: mds_bal_replicate_threshold = 1 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2024-03-30T13:09:32.825 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2024-03-30T13:09:32.826 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-03-30T13:09:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-03-30T13:09:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-30T13:09:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-03-30T13:09:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-03-30T13:09:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-03-30T13:09:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-30T13:09:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.99,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on skipped message = False 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = e28e230a-999b-4d07-a5bd-ee507abf8d14 2024-03-30T13:09:32.829 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-03-30T13:09:32.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug trim objects = true 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.831 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: bdev async discard = True 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: bdev enable discard = True 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore allocator = bitmap 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 1/20 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 1/20 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 4/10 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-03-30T13:09:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: debug finisher = 20 2024-03-30T13:09:32.833 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-30T13:09:32.834 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: mon down mkfs grace = 300 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: mon op complaint time = 120 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:09:32.835 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout: client mount timeout = 600 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = "" 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-03-30T13:09:32.836 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout:[mds] 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds = 20 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds balancer = 20 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug frag = True 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug scatterstat = True 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout: mds op complaint time = 180 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout: mds verify scatter = True 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout: mds_bal_replicate_threshold = 1 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-03-30T13:09:32.837 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-03-30T13:09:32.869 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-30T13:09:32.869 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-30T13:09:33.011 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-30T13:09:33.011 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:09:33.011 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-30T13:09:33.058 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:09:33.058 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-30T13:09:33.151 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:09:33.151 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:09:33.151 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-30T13:09:33.151 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T13:09:33.294 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:09:33.294 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:09:33.393 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:09:33.393 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:09:33.393 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-30T13:09:33.394 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T13:09:33.548 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:09:33.548 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:09:33.645 INFO:tasks.ceph:Setting up mon nodes... 2024-03-30T13:09:33.645 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-30T13:09:33.645 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-30T13:09:33.829 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-30T13:09:33.839 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-30T13:09:34.042 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-30T13:09:34.053 INFO:tasks.ceph:Setting up mds nodes... 2024-03-30T13:09:34.053 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-30T13:09:34.234 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-30T13:09:34.243 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-30T13:09:34.337 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-30T13:09:34.513 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-30T13:09:34.522 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-30T13:09:34.615 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-30T13:09:34.795 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-30T13:09:34.804 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-30T13:09:34.903 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-30T13:09:35.076 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-30T13:09:35.085 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-30T13:09:35.180 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-30T13:09:35.180 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-30T13:09:35.310 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-30T13:09:35.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-30T13:09:35.483 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-30T13:09:35.537 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-30T13:09:35.667 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-30T13:09:35.735 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-30T13:09:35.860 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-30T13:09:35.915 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-30T13:09:35.915 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-30T13:09:35.916 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-30T13:09:36.014 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:09:36.014 INFO:tasks.ceph:role: osd.0 2024-03-30T13:09:36.014 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:09:36.014 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-30T13:09:36.116 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:09:36.116 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:09:36.117 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:09:36.117 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:09:36.117 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:09:36.117 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:09:36.117 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:09:36.117 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:09:36.117 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:09:36.117 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:09:36.606 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-03-30T13:09:36.613 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-03-30T13:09:36.613 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-30T13:09:36.789 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-30T13:09:36.895 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-30T13:09:36.983 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:09:36.983 INFO:tasks.ceph:role: osd.1 2024-03-30T13:09:36.983 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:09:36.983 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-30T13:09:37.077 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:09:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:09:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:09:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:09:37.078 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:09:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:09:37.078 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:09:37.078 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:09:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:09:37.078 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:09:37.542 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-03-30T13:09:37.550 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-03-30T13:09:37.550 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-30T13:09:37.694 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-30T13:09:37.785 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-30T13:09:37.878 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:09:37.879 INFO:tasks.ceph:role: osd.2 2024-03-30T13:09:37.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:09:37.879 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-30T13:09:37.977 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:09:37.977 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:09:37.977 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:09:37.977 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:09:37.977 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:09:37.977 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:09:37.977 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:09:37.977 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:09:37.977 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:09:37.977 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:09:38.491 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-03-30T13:09:38.497 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-03-30T13:09:38.497 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-30T13:09:38.685 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-30T13:09:38.787 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-30T13:09:38.867 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:09:38.867 INFO:tasks.ceph:role: osd.3 2024-03-30T13:09:38.867 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:09:38.867 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-30T13:09:38.961 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:09:38.961 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:09:38.961 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:09:38.961 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:09:38.961 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:09:38.961 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:09:38.961 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:09:38.961 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:09:38.961 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:09:38.961 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:09:39.422 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-03-30T13:09:39.430 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-03-30T13:09:39.430 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-30T13:09:39.572 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-30T13:09:39.667 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:09:39.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:39.814+0000 7fe0020f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-30T13:09:39.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:39.816+0000 7fe0020f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-30T13:09:39.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:39.817+0000 7fe0020f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T13:09:39.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:39.817+0000 7fe0020f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T13:09:39.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:39.817+0000 7fe0020f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T13:09:39.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:39.826+0000 7fe0020f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-30T13:09:42.778 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T13:09:42.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:09:43.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:43.013+0000 7f1c6da9b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-30T13:09:43.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:43.014+0000 7f1c6da9b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-30T13:09:43.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:43.014+0000 7f1c6da9b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T13:09:43.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:43.014+0000 7f1c6da9b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T13:09:43.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:43.014+0000 7f1c6da9b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T13:09:43.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:43.016+0000 7f1c6da9b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-30T13:09:45.959 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T13:09:46.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:09:46.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:46.183+0000 7f94af41e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-30T13:09:46.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:46.184+0000 7f94af41e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-30T13:09:46.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:46.184+0000 7f94af41e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T13:09:46.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:46.184+0000 7f94af41e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T13:09:46.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:46.184+0000 7f94af41e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T13:09:46.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:46.186+0000 7f94af41e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-30T13:09:49.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T13:09:49.204 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:09:49.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:49.336+0000 7f9b2401a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-30T13:09:49.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:49.337+0000 7f9b2401a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-30T13:09:49.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:49.337+0000 7f9b2401a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T13:09:49.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:49.337+0000 7f9b2401a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T13:09:49.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:49.337+0000 7f9b2401a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T13:09:49.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:09:49.339+0000 7f9b2401a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-30T13:09:52.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T13:09:52.375 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-30T13:09:52.475 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:09:52.475 INFO:tasks.ceph:role: osd.4 2024-03-30T13:09:52.475 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:09:52.475 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-30T13:09:52.570 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:09:52.570 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:09:52.571 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:09:52.571 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:09:52.571 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:09:52.571 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:09:52.571 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:09:52.571 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:09:52.571 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:09:52.571 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:09:53.089 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-03-30T13:09:53.098 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-03-30T13:09:53.098 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-30T13:09:53.287 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-30T13:09:53.368 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-30T13:09:53.440 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:09:53.440 INFO:tasks.ceph:role: osd.5 2024-03-30T13:09:53.440 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:09:53.441 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-30T13:09:53.517 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:09:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:09:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:09:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:09:53.518 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:09:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:09:53.518 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:09:53.518 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:09:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:09:53.518 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:09:53.986 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-03-30T13:09:53.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-03-30T13:09:53.993 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-30T13:09:54.126 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-30T13:09:54.214 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-30T13:09:54.292 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:09:54.292 INFO:tasks.ceph:role: osd.6 2024-03-30T13:09:54.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:09:54.292 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-30T13:09:54.373 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:09:54.373 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:09:54.373 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:09:54.374 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:09:54.374 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:09:54.374 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:09:54.374 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:09:54.374 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:09:54.374 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:09:54.374 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:09:54.898 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-03-30T13:09:54.905 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-03-30T13:09:54.906 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-30T13:09:55.099 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-30T13:09:55.203 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-30T13:09:55.294 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:09:55.295 INFO:tasks.ceph:role: osd.7 2024-03-30T13:09:55.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:09:55.295 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-30T13:09:55.393 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:09:55.393 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:09:55.393 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:09:55.393 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:09:55.393 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:09:55.393 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:09:55.393 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:09:55.393 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:09:55.393 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:09:55.393 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:09:55.842 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-03-30T13:09:55.848 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-03-30T13:09:55.848 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-30T13:09:55.990 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-30T13:09:56.078 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:09:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:56.223+0000 7f7fae106640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-30T13:09:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:56.226+0000 7f7fae106640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-30T13:09:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:56.227+0000 7f7fae106640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T13:09:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:56.227+0000 7f7fae106640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T13:09:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:56.227+0000 7f7fae106640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T13:09:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:56.231+0000 7f7fae106640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-30T13:09:59.425 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T13:09:59.519 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:09:59.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:59.645+0000 7f53d9e8b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-30T13:09:59.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:59.646+0000 7f53d9e8b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-30T13:09:59.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:59.646+0000 7f53d9e8b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T13:09:59.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:59.646+0000 7f53d9e8b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T13:09:59.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:59.646+0000 7f53d9e8b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T13:09:59.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:09:59.648+0000 7f53d9e8b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-30T13:10:00.087 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:00.095 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:02.837 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T13:10:02.932 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:03.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:03.063+0000 7f677d61f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-30T13:10:03.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:03.063+0000 7f677d61f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-30T13:10:03.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:03.064+0000 7f677d61f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T13:10:03.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:03.064+0000 7f677d61f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T13:10:03.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:03.064+0000 7f677d61f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T13:10:03.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:03.066+0000 7f677d61f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-30T13:10:05.975 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T13:10:06.070 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:06.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:06.202+0000 7f151920e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-30T13:10:06.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:06.202+0000 7f151920e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-30T13:10:06.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:06.203+0000 7f151920e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T13:10:06.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:06.203+0000 7f151920e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T13:10:06.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:06.203+0000 7f151920e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T13:10:06.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:06.204+0000 7f151920e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-30T13:10:09.390 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T13:10:09.486 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-30T13:10:09.486 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:09.487 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-30T13:10:09.589 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:09.589 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-30T13:10:09.682 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:09.682 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-30T13:10:09.778 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:09.778 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-30T13:10:09.870 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:09.870 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-30T13:10:09.958 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:09.958 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-30T13:10:10.097 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:10.097 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-30T13:10:10.190 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:10.190 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-30T13:10:10.291 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:10.291 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-30T13:10:10.381 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:10.381 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-30T13:10:10.465 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:10.465 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-30T13:10:10.603 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:10.603 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-30T13:10:10.697 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:10.697 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-30T13:10:10.789 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:10.789 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-30T13:10:10.883 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:10.883 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-30T13:10:10.939 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:10.939 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-30T13:10:10.991 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:10.991 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-30T13:10:11.047 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:11.047 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-30T13:10:11.099 INFO:tasks.ceph:Adding keys to all mons... 2024-03-30T13:10:11.099 DEBUG:teuthology.orchestra.run.smithi099:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-30T13:10:11.107 DEBUG:teuthology.orchestra.run.smithi181:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-30T13:10:11.193 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.y] 2024-03-30T13:10:11.193 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQANDwhmq0lLMRAAeaF3DcrJXHqEG8bvHiGmVA== 2024-03-30T13:10:11.193 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-03-30T13:10:11.193 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAODwhmP7HRDRAA8NMmT4JCax3iRyXyh/wkEw== 2024-03-30T13:10:11.193 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2024-03-30T13:10:11.193 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAODwhmaWpzHhAAdz2L8LoRb0LE3A/+vPxANA== 2024-03-30T13:10:11.193 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.0] 2024-03-30T13:10:11.193 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQATDwhmRUiUMBAAZGj6JwbrL7FVdi2PMEIPmA== 2024-03-30T13:10:11.194 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.1] 2024-03-30T13:10:11.194 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAXDwhmLF3VABAAsY91R1ApayM/aeSjtuFaow== 2024-03-30T13:10:11.194 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.2] 2024-03-30T13:10:11.194 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAaDwhmJ4UDCxAAAMR3I0gA4+6dTxo800TMsA== 2024-03-30T13:10:11.194 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.3] 2024-03-30T13:10:11.194 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAdDwhm108hFBAAmzE/hQDRurtRYA4CVYpm6A== 2024-03-30T13:10:11.194 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.x] 2024-03-30T13:10:11.194 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAODwhmtSxiAhAAEce22e+VUrrUXiI+nbBMdQ== 2024-03-30T13:10:11.194 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAODwhmwRxBLxAAN/8w22SdCe4qaATXvdfzhw== 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAPDwhme5JtBBAAnOiaypXSgWLI5R1lzmUIXQ== 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.4] 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAkDwhmpcpeDRAACT+uYHkAO2vl/j6O5YGJpw== 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.5] 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAnDwhmzluOJhAAnmp5BHuTJWOIL7bPU0gPIA== 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.6] 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQArDwhmYLjYAxAAVhcQAXPwmmu6sehJ81dvdQ== 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.7] 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAuDwhmKA4cDBAAOFGPqCvvn96WA3b8zxGnUg== 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-03-30T13:10:11.195 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAPDwhm6lNaEhAAeg1SFtdfeWCF8xpQ5LFMYA== 2024-03-30T13:10:11.196 INFO:teuthology.orchestra.run.smithi099.stdout:[client.2] 2024-03-30T13:10:11.196 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAPDwhmQVqnHBAAmnn6+7SsAmPqWuO4HDXYxw== 2024-03-30T13:10:11.196 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2024-03-30T13:10:11.196 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAPDwhmxoqkJxAA1Pj7GyHALzz2URro7nJl3g== 2024-03-30T13:10:11.196 INFO:teuthology.orchestra.run.smithi099.stdout:[client.3] 2024-03-30T13:10:11.196 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAPDwhm1gwfMxAAjkUUpB4vr7OP4jur6glICg== 2024-03-30T13:10:11.196 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.y] 2024-03-30T13:10:11.196 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQANDwhmq0lLMRAAeaF3DcrJXHqEG8bvHiGmVA== 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAODwhmP7HRDRAA8NMmT4JCax3iRyXyh/wkEw== 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAODwhmaWpzHhAAdz2L8LoRb0LE3A/+vPxANA== 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.0] 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQATDwhmRUiUMBAAZGj6JwbrL7FVdi2PMEIPmA== 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.1] 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAXDwhmLF3VABAAsY91R1ApayM/aeSjtuFaow== 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.2] 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAaDwhmJ4UDCxAAAMR3I0gA4+6dTxo800TMsA== 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.3] 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAdDwhm108hFBAAmzE/hQDRurtRYA4CVYpm6A== 2024-03-30T13:10:11.197 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.x] 2024-03-30T13:10:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAODwhmtSxiAhAAEce22e+VUrrUXiI+nbBMdQ== 2024-03-30T13:10:11.198 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-03-30T13:10:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAODwhmwRxBLxAAN/8w22SdCe4qaATXvdfzhw== 2024-03-30T13:10:11.198 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-03-30T13:10:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAPDwhme5JtBBAAnOiaypXSgWLI5R1lzmUIXQ== 2024-03-30T13:10:11.198 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.4] 2024-03-30T13:10:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAkDwhmpcpeDRAACT+uYHkAO2vl/j6O5YGJpw== 2024-03-30T13:10:11.198 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.5] 2024-03-30T13:10:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAnDwhmzluOJhAAnmp5BHuTJWOIL7bPU0gPIA== 2024-03-30T13:10:11.198 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.6] 2024-03-30T13:10:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQArDwhmYLjYAxAAVhcQAXPwmmu6sehJ81dvdQ== 2024-03-30T13:10:11.199 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.7] 2024-03-30T13:10:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAuDwhmKA4cDBAAOFGPqCvvn96WA3b8zxGnUg== 2024-03-30T13:10:11.199 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-03-30T13:10:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAPDwhm6lNaEhAAeg1SFtdfeWCF8xpQ5LFMYA== 2024-03-30T13:10:11.199 INFO:teuthology.orchestra.run.smithi181.stdout:[client.2] 2024-03-30T13:10:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAPDwhmQVqnHBAAmnn6+7SsAmPqWuO4HDXYxw== 2024-03-30T13:10:11.199 INFO:teuthology.orchestra.run.smithi181.stdout:[client.1] 2024-03-30T13:10:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAPDwhmxoqkJxAA1Pj7GyHALzz2URro7nJl3g== 2024-03-30T13:10:11.199 INFO:teuthology.orchestra.run.smithi181.stdout:[client.3] 2024-03-30T13:10:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAPDwhm1gwfMxAAjkUUpB4vr7OP4jur6glICg== 2024-03-30T13:10:11.201 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:10:11.206 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:10:11.380 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:10:11.388 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:10:11.530 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:10:11.539 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:10:11.685 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:11.695 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:11.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:11.837 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:11.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:11.982 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:12.124 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:12.129 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:12.266 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:10:12.273 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:10:12.412 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:10:12.419 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:10:12.563 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:10:12.570 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:10:12.707 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:12.713 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:12.855 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:12.859 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:13.002 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:13.008 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:13.140 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:13.144 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:10:13.288 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:10:13.296 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:10:13.440 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:10:13.445 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:10:13.587 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:10:13.592 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:10:13.740 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:10:13.747 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:10:13.891 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-30T13:10:13.892 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-30T13:10:13.987 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T13:10:14.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-30T13:10:14.223 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-30T13:10:14.318 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T13:10:14.476 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-30T13:10:14.558 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-30T13:10:14.647 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T13:10:14.802 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-30T13:10:14.878 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:14.885 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:14.936 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-30T13:10:14.937 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-30T13:10:14.937 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-30T13:10:14.943 INFO:tasks.ceph.mon.a:Started 2024-03-30T13:10:14.944 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-30T13:10:14.944 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-30T13:10:14.949 INFO:tasks.ceph.mon.b:Started 2024-03-30T13:10:14.949 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-30T13:10:14.949 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-30T13:10:14.954 INFO:tasks.ceph.mon.c:Started 2024-03-30T13:10:14.954 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-30T13:10:14.954 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-30T13:10:14.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-30T13:10:14.959 INFO:tasks.ceph.mgr.y:Started 2024-03-30T13:10:14.961 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-30T13:10:14.962 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-30T13:10:14.967 INFO:tasks.ceph.mgr.x:Started 2024-03-30T13:10:14.967 INFO:tasks.ceph:Setting crush tunables to default 2024-03-30T13:10:14.967 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd crush tunables default 2024-03-30T13:10:15.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.135+0000 7f9896a00640 1 Processor -- start 2024-03-30T13:10:15.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.136+0000 7f9896a00640 1 -- start start 2024-03-30T13:10:15.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.137+0000 7f9896a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:15.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.137+0000 7f9896a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989015d650 con 0x7f98900d0410 2024-03-30T13:10:15.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.137+0000 7f9896a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989015d930 con 0x7f989015a1e0 2024-03-30T13:10:15.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.137+0000 7f9896a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f989015a5c0 con 0x7f989015cb30 2024-03-30T13:10:15.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.137+0000 7f9887400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:15.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.137+0000 7f9894a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f98900d0410 0x7f98900b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48858/0 (socket says 172.21.15.99:48858) 2024-03-30T13:10:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.137+0000 7f9894a00640 1 -- 172.21.15.99:0/1831881782 learned_addr learned my addr 172.21.15.99:0/1831881782 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.137+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 msgr2=0x7f989015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:10:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.137+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 msgr2=0x7f989015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.137+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.137+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T13:10:15.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.338+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:15.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.339+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 msgr2=0x7f989015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:10:15.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.339+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 msgr2=0x7f989015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:15.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.339+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:15.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.339+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T13:10:15.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.740+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:15.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.741+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 msgr2=0x7f989015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:10:15.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.741+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 msgr2=0x7f989015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:15.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.741+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:15.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:15.741+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T13:10:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:16.543+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:16.543+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 msgr2=0x7f989015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:10:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:16.543+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 msgr2=0x7f989015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:16.543+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:16.543+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T13:10:18.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.138+0000 7f988e000640 1 -- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 msgr2=0x7f989015cfb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:10:18.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.138+0000 7f988e000640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f989015cb30 0x7f989015cfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:18.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.138+0000 7f988e000640 1 -- 172.21.15.99:0/1831881782 >> v1:172.21.15.181:6789/0 conn(0x7f989015a1e0 legacy=0x7f9890160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:18.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.138+0000 7f988e000640 1 -- 172.21.15.99:0/1831881782 >> v1:172.21.15.99:6789/0 conn(0x7f98900d0410 legacy=0x7f98900b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:18.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.138+0000 7f988e000640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:18.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.138+0000 7f988e000640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:18.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.138+0000 7f988e000640 1 -- 172.21.15.99:0/1831881782 --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f989015a5c0 con 0x7f986c0061c0 2024-03-30T13:10:18.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.138+0000 7f988e000640 1 -- 172.21.15.99:0/1831881782 --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f986c008d10 con 0x7f986c003710 2024-03-30T13:10:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.139+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.139+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.139+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 msgr2=0x7f986c008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:10:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.139+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 msgr2=0x7f986c008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.139+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.139+0000 7f988fe00640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 msgr2=0x7f986c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T13:10:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.139+0000 7f988fe00640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 msgr2=0x7f986c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.139+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.139+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T13:10:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.140+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T13:10:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.341+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.341+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.342+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 msgr2=0x7f986c008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T13:10:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.342+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 msgr2=0x7f986c008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.342+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.342+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T13:10:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.342+0000 7f988fe00640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 msgr2=0x7f986c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:10:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.342+0000 7f988fe00640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 msgr2=0x7f986c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.342+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.342+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T13:10:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.743+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.743+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.744+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 msgr2=0x7f986c008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T13:10:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.744+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 msgr2=0x7f986c008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.744+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.744+0000 7f988fe00640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 msgr2=0x7f986c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:10:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.744+0000 7f988fe00640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 msgr2=0x7f986c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.744+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.744+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T13:10:18.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:18.744+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T13:10:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:19.545+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:19.546+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:19.546+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 msgr2=0x7f986c008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-30T13:10:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:19.546+0000 7f9887400640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 msgr2=0x7f986c008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:19.546+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:19.546+0000 7f988fe00640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 msgr2=0x7f986c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:10:19.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:19.546+0000 7f988fe00640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 msgr2=0x7f986c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:10:19.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:19.546+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:10:19.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:19.546+0000 7f9887400640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T13:10:19.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:19.546+0000 7f988fe00640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T13:10:20.992 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:20.989+0000 7f12c5045040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:10:21.060 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:21.057+0000 7f12c5045040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:10:21.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.138+0000 7f988e000640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 msgr2=0x7f986c005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:10:21.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.138+0000 7f988e000640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.181:3300/0 conn(0x7f986c003710 0x7f986c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:21.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.138+0000 7f988e000640 1 -- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 msgr2=0x7f986c008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:10:21.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.138+0000 7f988e000640 1 --2- 172.21.15.99:0/1831881782 >> v2:172.21.15.99:3300/0 conn(0x7f986c0061c0 0x7f986c008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:21.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.139+0000 7f9894a00640 1 -- 172.21.15.99:0/1831881782 reap_dead start 2024-03-30T13:10:21.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.139+0000 7f988e000640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f986c007cf0 0x7f986c008170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.139+0000 7f988e000640 1 -- 172.21.15.99:0/1831881782 --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9890160320 con 0x7f98900d0410 2024-03-30T13:10:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.139+0000 7f988e000640 1 -- 172.21.15.99:0/1831881782 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c0088a0 con 0x7f986c003b40 2024-03-30T13:10:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.139+0000 7f988e000640 1 -- 172.21.15.99:0/1831881782 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f989015a5c0 con 0x7f986c007cf0 2024-03-30T13:10:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.140+0000 7f9894a00640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f986c007cf0 0x7f986c008170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.140+0000 7f9894a00640 1 -- 172.21.15.99:0/1831881782 >> v1:172.21.15.181:6789/0 conn(0x7f986c003b40 legacy=0x7f986c0065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.140+0000 7f9894a00640 1 -- 172.21.15.99:0/1831881782 >> v1:172.21.15.99:6789/0 conn(0x7f98900d0410 legacy=0x7f986c00b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.140+0000 7f9894a00640 1 -- 172.21.15.99:0/1831881782 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c010920 con 0x7f986c007cf0 2024-03-30T13:10:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.140+0000 7f988f400640 1 -- 172.21.15.99:0/1831881782 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161584575 0 0) 0x7f9890160320 con 0x7f98900d0410 2024-03-30T13:10:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.143+0000 7f9894a00640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f986c007cf0 0x7f986c008170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f989006f290 tx=0x7f988802bb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e69ab6e254524201 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.144+0000 7f988f400640 1 -- 172.21.15.99:0/1831881782 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988802c930 con 0x7f986c007cf0 2024-03-30T13:10:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.144+0000 7f988f400640 1 -- 172.21.15.99:0/1831881782 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9888030070 con 0x7f986c007cf0 2024-03-30T13:10:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.144+0000 7f988f400640 1 -- 172.21.15.99:0/1831881782 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988802ccd0 con 0x7f986c007cf0 2024-03-30T13:10:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.145+0000 7f9896a00640 1 -- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f986c007cf0 msgr2=0x7f986c008170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.145+0000 7f9896a00640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f986c007cf0 0x7f986c008170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f989006f290 tx=0x7f988802bb80 comp rx=0 tx=0).stop 2024-03-30T13:10:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.145+0000 7f9896a00640 1 -- 172.21.15.99:0/1831881782 shutdown_connections 2024-03-30T13:10:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.145+0000 7f9896a00640 1 --2- 172.21.15.99:0/1831881782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f986c007cf0 0x7f986c008170 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.145+0000 7f9896a00640 1 -- 172.21.15.99:0/1831881782 >> 172.21.15.99:0/1831881782 conn(0x7f989006b6f0 msgr2=0x7f989006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.145+0000 7f9896a00640 1 -- 172.21.15.99:0/1831881782 shutdown_connections 2024-03-30T13:10:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.145+0000 7f9896a00640 1 -- 172.21.15.99:0/1831881782 wait complete. 2024-03-30T13:10:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.147+0000 7f9896a00640 1 Processor -- start 2024-03-30T13:10:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.148+0000 7f9896a00640 1 -- start start 2024-03-30T13:10:21.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.149+0000 7f9896a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f986c003b40 0x7f98900cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:21.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.149+0000 7f9896a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c007cf0 0x7f9890155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:21.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.149+0000 7f9896a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98900d0410 0x7f9890155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:21.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.149+0000 7f9896a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f989015d130 con 0x7f986c007cf0 2024-03-30T13:10:21.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.149+0000 7f9896a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f989015cfb0 con 0x7f98900d0410 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.149+0000 7f9896a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f989015d2b0 con 0x7f986c003b40 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.149+0000 7f9887400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c007cf0 0x7f9890155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.149+0000 7f9887400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c007cf0 0x7f9890155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54354/0 (socket says 172.21.15.99:54354) 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.149+0000 7f9887400640 1 -- 172.21.15.99:0/1192429809 learned_addr learned my addr 172.21.15.99:0/1192429809 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.149+0000 7f988fe00640 1 --2- 172.21.15.99:0/1192429809 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f986c003b40 0x7f98900cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.149+0000 7f9894a00640 1 --2- 172.21.15.99:0/1192429809 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98900d0410 0x7f9890155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.150+0000 7f9887400640 1 -- 172.21.15.99:0/1192429809 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f986c003b40 msgr2=0x7f98900cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.150+0000 7f9887400640 1 --2- 172.21.15.99:0/1192429809 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f986c003b40 0x7f98900cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.150+0000 7f9887400640 1 -- 172.21.15.99:0/1192429809 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98900d0410 msgr2=0x7f9890155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.150+0000 7f9887400640 1 --2- 172.21.15.99:0/1192429809 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98900d0410 0x7f9890155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.150+0000 7f9887400640 1 -- 172.21.15.99:0/1192429809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9890156650 con 0x7f986c007cf0 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.150+0000 7f9887400640 1 --2- 172.21.15.99:0/1192429809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c007cf0 0x7f9890155980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f98780178b0 tx=0x7f9878017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.150+0000 7f988cc00640 1 -- 172.21.15.99:0/1192429809 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878027070 con 0x7f986c007cf0 2024-03-30T13:10:21.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.150+0000 7f988cc00640 1 -- 172.21.15.99:0/1192429809 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9878016bc0 con 0x7f986c007cf0 2024-03-30T13:10:21.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.150+0000 7f988cc00640 1 -- 172.21.15.99:0/1192429809 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878016d90 con 0x7f986c007cf0 2024-03-30T13:10:21.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.150+0000 7f9896a00640 1 -- 172.21.15.99:0/1192429809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98900d0b00 con 0x7f986c007cf0 2024-03-30T13:10:21.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.150+0000 7f9896a00640 1 -- 172.21.15.99:0/1192429809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98900b2320 con 0x7f986c007cf0 2024-03-30T13:10:21.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.151+0000 7f988cc00640 1 -- 172.21.15.99:0/1192429809 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f987802a070 con 0x7f986c007cf0 2024-03-30T13:10:21.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.151+0000 7f988cc00640 1 -- 172.21.15.99:0/1192429809 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9878022610 con 0x7f986c007cf0 2024-03-30T13:10:21.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.152+0000 7f9896a00640 1 -- 172.21.15.99:0/1192429809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989009e520 con 0x7f986c007cf0 2024-03-30T13:10:21.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.154+0000 7f988cc00640 1 -- 172.21.15.99:0/1192429809 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9878031020 con 0x7f986c007cf0 2024-03-30T13:10:21.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.246+0000 7f9896a00640 1 -- 172.21.15.99:0/1192429809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f989004f9d0 con 0x7f986c007cf0 2024-03-30T13:10:21.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.250+0000 7f988cc00640 1 -- 172.21.15.99:0/1192429809 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f9878022810 con 0x7f986c007cf0 2024-03-30T13:10:21.253 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2024-03-30T13:10:21.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.251+0000 7f9896a00640 1 -- 172.21.15.99:0/1192429809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c007cf0 msgr2=0x7f9890155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:21.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.251+0000 7f9896a00640 1 --2- 172.21.15.99:0/1192429809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c007cf0 0x7f9890155980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f98780178b0 tx=0x7f9878017d70 comp rx=0 tx=0).stop 2024-03-30T13:10:21.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.251+0000 7f9896a00640 1 -- 172.21.15.99:0/1192429809 shutdown_connections 2024-03-30T13:10:21.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.251+0000 7f9896a00640 1 --2- 172.21.15.99:0/1192429809 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98900d0410 0x7f9890155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.251+0000 7f9896a00640 1 --2- 172.21.15.99:0/1192429809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c007cf0 0x7f9890155980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.251+0000 7f9896a00640 1 --2- 172.21.15.99:0/1192429809 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f986c003b40 0x7f98900cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.251+0000 7f9896a00640 1 -- 172.21.15.99:0/1192429809 >> 172.21.15.99:0/1192429809 conn(0x7f989006b6f0 msgr2=0x7f989015b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.251+0000 7f9896a00640 1 -- 172.21.15.99:0/1192429809 shutdown_connections 2024-03-30T13:10:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:21.252+0000 7f9896a00640 1 -- 172.21.15.99:0/1192429809 wait complete. 2024-03-30T13:10:21.272 INFO:tasks.ceph:check_enable_crimson: False 2024-03-30T13:10:21.272 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-30T13:10:21.273 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:21.273 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-30T13:10:21.353 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:21.353 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-30T13:10:21.481 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:21.481 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-30T13:10:21.604 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:10:21.604 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-30T13:10:21.710 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:21.708+0000 7f12c5045040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:10:21.733 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:21.733 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-30T13:10:21.741 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:21.736+0000 7f7d23e0d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:10:21.781 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:21.776+0000 7f12c5045040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:10:21.828 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:21.806+0000 7f7d23e0d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:10:21.831 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:21.831 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-30T13:10:21.832 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:21.827+0000 7f12c5045040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:10:21.898 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:21.895+0000 7f12c5045040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:10:21.909 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:21.910 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-30T13:10:21.947 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:21.944+0000 7f12c5045040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:10:22.042 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:10:22.042 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-30T13:10:22.076 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:22.073+0000 7f12c5045040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:10:22.155 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:22.152+0000 7f12c5045040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:10:22.176 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2 0 2024-03-30T13:10:22.208 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:22.204+0000 7f12c5045040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:10:22.268 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:22.264+0000 7f12c5045040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:10:22.322 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:22.318+0000 7f12c5045040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:10:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.407+0000 7fe2aca00640 1 Processor -- start 2024-03-30T13:10:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.408+0000 7fe2aca00640 1 -- start start 2024-03-30T13:10:22.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.409+0000 7fe2aca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe2a80d4ae0 0x7fe2a806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:22.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2aca00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a815e6e0 0x7fe2a80d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:22.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2aca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a806caf0 con 0x7fe2a815e300 2024-03-30T13:10:22.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2aca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a806d3e0 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2aca00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a806cd90 con 0x7fe2a815e6e0 2024-03-30T13:10:22.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2a7200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a815e6e0 0x7fe2a80d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:22.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2a6800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe2a815e300 0x7fe2a80d43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.181:55354/0 (socket says 172.21.15.181:55354) 2024-03-30T13:10:22.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe29fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe2a80d4ae0 0x7fe2a806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:22.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2a6800640 1 -- 172.21.15.181:0/1072929981 learned_addr learned my addr 172.21.15.181:0/1072929981 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-03-30T13:10:22.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2a7200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a815e6e0 0x7fe2a80d0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:54888/0 (socket says 172.21.15.181:54888) 2024-03-30T13:10:22.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2a7200640 1 -- 172.21.15.181:0/1072929981 >> v2:172.21.15.99:3300/0 conn(0x7fe2a80d4ae0 msgr2=0x7fe2a806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:22.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2a7200640 1 --2- 172.21.15.181:0/1072929981 >> v2:172.21.15.99:3300/0 conn(0x7fe2a80d4ae0 0x7fe2a806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2a7200640 1 -- 172.21.15.181:0/1072929981 >> v1:172.21.15.99:6789/0 conn(0x7fe2a815e300 legacy=0x7fe2a80d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:22.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2a7200640 1 -- 172.21.15.181:0/1072929981 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a806d070 con 0x7fe2a815e6e0 2024-03-30T13:10:22.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.410+0000 7fe2a5e00640 1 -- 172.21.15.181:0/1072929981 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328613584 0 0) 0x7fe2a806caf0 con 0x7fe2a815e300 2024-03-30T13:10:22.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.412+0000 7fe2a7200640 1 --2- 172.21.15.181:0/1072929981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a815e6e0 0x7fe2a80d0fa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2a806d560 tx=0x7fe2a002be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b8eb729befd3720 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:22.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.412+0000 7fe2a5e00640 1 -- 172.21.15.181:0/1072929981 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0039070 con 0x7fe2a815e6e0 2024-03-30T13:10:22.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.412+0000 7fe2a5e00640 1 -- 172.21.15.181:0/1072929981 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a002cc40 con 0x7fe2a815e6e0 2024-03-30T13:10:22.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.412+0000 7fe2a5e00640 1 -- 172.21.15.181:0/1072929981 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0034440 con 0x7fe2a815e6e0 2024-03-30T13:10:22.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.412+0000 7fe2aca00640 1 -- 172.21.15.181:0/1072929981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a815e6e0 msgr2=0x7fe2a80d0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:22.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.412+0000 7fe2aca00640 1 --2- 172.21.15.181:0/1072929981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a815e6e0 0x7fe2a80d0fa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2a806d560 tx=0x7fe2a002be90 comp rx=0 tx=0).stop 2024-03-30T13:10:22.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.413+0000 7fe2aca00640 1 -- 172.21.15.181:0/1072929981 shutdown_connections 2024-03-30T13:10:22.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.413+0000 7fe2aca00640 1 --2- 172.21.15.181:0/1072929981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a815e6e0 0x7fe2a80d0fa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.413+0000 7fe2aca00640 1 --2- 172.21.15.181:0/1072929981 >> v2:172.21.15.99:3300/0 conn(0x7fe2a80d4ae0 0x7fe2a806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.413+0000 7fe2aca00640 1 -- 172.21.15.181:0/1072929981 >> 172.21.15.181:0/1072929981 conn(0x7fe2a809d7c0 msgr2=0x7fe2a808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:22.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.413+0000 7fe2aca00640 1 -- 172.21.15.181:0/1072929981 shutdown_connections 2024-03-30T13:10:22.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.413+0000 7fe2aca00640 1 -- 172.21.15.181:0/1072929981 wait complete. 2024-03-30T13:10:22.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.414+0000 7fe2aca00640 1 Processor -- start 2024-03-30T13:10:22.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.415+0000 7fe2aca00640 1 -- start start 2024-03-30T13:10:22.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.415+0000 7fe2aca00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a80d4ae0 0x7fe2a80b9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:22.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.415+0000 7fe2aca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2a815e300 0x7fe2a80b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:22.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.415+0000 7fe2aca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2a815e6e0 0x7fe2a80b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:22.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.415+0000 7fe2aca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a80d1660 con 0x7fe2a815e300 2024-03-30T13:10:22.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.415+0000 7fe2aca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a80d14e0 con 0x7fe2a815e6e0 2024-03-30T13:10:22.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.415+0000 7fe2aca00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a80d17e0 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.416+0000 7fe2a6800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a80d4ae0 0x7fe2a80b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:22.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.416+0000 7fe2a6800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a80d4ae0 0x7fe2a80b9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:54894/0 (socket says 172.21.15.181:54894) 2024-03-30T13:10:22.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.416+0000 7fe2a6800640 1 -- 172.21.15.181:0/875617923 learned_addr learned my addr 172.21.15.181:0/875617923 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-03-30T13:10:22.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.416+0000 7fe2a7200640 1 --2- 172.21.15.181:0/875617923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2a815e6e0 0x7fe2a80b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:22.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.416+0000 7fe29fe00640 1 --2- 172.21.15.181:0/875617923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2a815e300 0x7fe2a80b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:22.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.416+0000 7fe2a6800640 1 -- 172.21.15.181:0/875617923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2a815e6e0 msgr2=0x7fe2a80b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:22.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.416+0000 7fe2a6800640 1 --2- 172.21.15.181:0/875617923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2a815e6e0 0x7fe2a80b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.416+0000 7fe2a6800640 1 -- 172.21.15.181:0/875617923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2a815e300 msgr2=0x7fe2a80b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:22.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.416+0000 7fe2a6800640 1 --2- 172.21.15.181:0/875617923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2a815e300 0x7fe2a80b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.416+0000 7fe2a6800640 1 -- 172.21.15.181:0/875617923 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a80b5560 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.416+0000 7fe2a6800640 1 --2- 172.21.15.181:0/875617923 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a80d4ae0 0x7fe2a80b9900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c500 tx=0x7fe29800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:22.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.417+0000 7fe29ea00640 1 -- 172.21.15.181:0/875617923 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298018070 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.417+0000 7fe29ea00640 1 -- 172.21.15.181:0/875617923 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe298007580 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.417+0000 7fe29ea00640 1 -- 172.21.15.181:0/875617923 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298004a20 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.417+0000 7fe2aca00640 1 -- 172.21.15.181:0/875617923 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a815f8c0 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.417+0000 7fe2aca00640 1 -- 172.21.15.181:0/875617923 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a80b5ab0 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.417+0000 7fe29ea00640 1 -- 172.21.15.181:0/875617923 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe298004bc0 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.417+0000 7fe29ea00640 1 -- 172.21.15.181:0/875617923 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fe29801c3f0 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.418+0000 7fe2aca00640 1 -- 172.21.15.181:0/875617923 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a804f8f0 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.421+0000 7fe29ea00640 1 -- 172.21.15.181:0/875617923 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe298012400 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.503 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:22.499+0000 7f7d23e0d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:10:22.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.500+0000 7fe2aca00640 1 -- 172.21.15.181:0/875617923 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2", "id": 0} v 0) -- 0x7fe2a80b6c60 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.505+0000 7fe29ea00640 1 -- 172.21.15.181:0/875617923 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fe2980126b0 con 0x7fe2a80d4ae0 2024-03-30T13:10:22.509 INFO:teuthology.orchestra.run.smithi181.stdout:0 2024-03-30T13:10:22.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.507+0000 7fe2aca00640 1 -- 172.21.15.181:0/875617923 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a80d4ae0 msgr2=0x7fe2a80b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:22.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.507+0000 7fe2aca00640 1 --2- 172.21.15.181:0/875617923 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a80d4ae0 0x7fe2a80b9900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c500 tx=0x7fe29800c9c0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.507+0000 7fe2aca00640 1 -- 172.21.15.181:0/875617923 shutdown_connections 2024-03-30T13:10:22.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.507+0000 7fe2aca00640 1 --2- 172.21.15.181:0/875617923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2a815e6e0 0x7fe2a80b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.507+0000 7fe2aca00640 1 --2- 172.21.15.181:0/875617923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2a815e300 0x7fe2a80b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.507+0000 7fe2aca00640 1 --2- 172.21.15.181:0/875617923 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a80d4ae0 0x7fe2a80b9900 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.507+0000 7fe2aca00640 1 -- 172.21.15.181:0/875617923 >> 172.21.15.181:0/875617923 conn(0x7fe2a809d7c0 msgr2=0x7fe2a80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:22.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.507+0000 7fe2aca00640 1 -- 172.21.15.181:0/875617923 shutdown_connections 2024-03-30T13:10:22.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.507+0000 7fe2aca00640 1 -- 172.21.15.181:0/875617923 wait complete. 2024-03-30T13:10:22.529 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new c50d9187-00e9-4737-8ecc-6adda3776c33 1 2024-03-30T13:10:22.574 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:22.570+0000 7f7d23e0d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:10:22.628 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:22.624+0000 7f7d23e0d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:10:22.692 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:22.688+0000 7f7d23e0d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.718+0000 7fb523800640 1 Processor -- start 2024-03-30T13:10:22.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.719+0000 7fb523800640 1 -- start start 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.720+0000 7fb523800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb51c15e920 0x7fb51c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.720+0000 7fb523800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c0cfde0 0x7fb51c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.720+0000 7fb523800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51c15ed00 con 0x7fb51c0d0f90 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.720+0000 7fb523800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb51c0d37c0 con 0x7fb51c15e920 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.720+0000 7fb523800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c0d21e0 con 0x7fb51c0cfde0 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.720+0000 7fb51be00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c0cfde0 0x7fb51c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.720+0000 7fb51be00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c0cfde0 0x7fb51c0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:54910/0 (socket says 172.21.15.181:54910) 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.720+0000 7fb51be00640 1 -- 172.21.15.181:0/2139609583 learned_addr learned my addr 172.21.15.181:0/2139609583 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.720+0000 7fb520e00640 1 --2- 172.21.15.181:0/2139609583 >> v2:172.21.15.181:3300/0 conn(0x7fb51c15e920 0x7fb51c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.721+0000 7fb51be00640 1 -- 172.21.15.181:0/2139609583 >> v2:172.21.15.181:3300/0 conn(0x7fb51c15e920 msgr2=0x7fb51c0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.721+0000 7fb51be00640 1 --2- 172.21.15.181:0/2139609583 >> v2:172.21.15.181:3300/0 conn(0x7fb51c15e920 0x7fb51c0d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.721+0000 7fb51be00640 1 -- 172.21.15.181:0/2139609583 >> v1:172.21.15.181:6789/0 conn(0x7fb51c0d0f90 legacy=0x7fb51c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.721+0000 7fb51be00640 1 -- 172.21.15.181:0/2139609583 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c0d24c0 con 0x7fb51c0cfde0 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.721+0000 7fb520e00640 1 --2- 172.21.15.181:0/2139609583 >> v2:172.21.15.181:3300/0 conn(0x7fb51c15e920 0x7fb51c0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.722+0000 7fb51be00640 1 --2- 172.21.15.181:0/2139609583 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c0cfde0 0x7fb51c0d0240 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb508009870 tx=0x7fb50802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=708bdc289a1818e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.722+0000 7fb51b400640 1 -- 172.21.15.181:0/2139609583 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508034070 con 0x7fb51c0cfde0 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.722+0000 7fb51b400640 1 -- 172.21.15.181:0/2139609583 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb508030840 con 0x7fb51c0cfde0 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.722+0000 7fb51b400640 1 -- 172.21.15.181:0/2139609583 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508030c10 con 0x7fb51c0cfde0 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.723+0000 7fb523800640 1 -- 172.21.15.181:0/2139609583 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c0cfde0 msgr2=0x7fb51c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.723+0000 7fb523800640 1 --2- 172.21.15.181:0/2139609583 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c0cfde0 0x7fb51c0d0240 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb508009870 tx=0x7fb50802b980 comp rx=0 tx=0).stop 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.723+0000 7fb523800640 1 -- 172.21.15.181:0/2139609583 shutdown_connections 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.723+0000 7fb523800640 1 --2- 172.21.15.181:0/2139609583 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c0cfde0 0x7fb51c0d0240 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.723+0000 7fb523800640 1 --2- 172.21.15.181:0/2139609583 >> v2:172.21.15.181:3300/0 conn(0x7fb51c15e920 0x7fb51c0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.723+0000 7fb523800640 1 -- 172.21.15.181:0/2139609583 >> 172.21.15.181:0/2139609583 conn(0x7fb51c08bfc0 msgr2=0x7fb51c0d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.723+0000 7fb523800640 1 -- 172.21.15.181:0/2139609583 shutdown_connections 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.723+0000 7fb523800640 1 -- 172.21.15.181:0/2139609583 wait complete. 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.725+0000 7fb523800640 1 Processor -- start 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.725+0000 7fb523800640 1 -- start start 2024-03-30T13:10:22.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb523800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb51c0cfde0 0x7fb51c15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:22.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb523800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb51c0d0f90 0x7fb51c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:22.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb523800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c15e920 0x7fb51c1ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:22.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb523800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c0d2d60 con 0x7fb51c0d0f90 2024-03-30T13:10:22.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb523800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c0d2a80 con 0x7fb51c0cfde0 2024-03-30T13:10:22.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb523800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c0d4f50 con 0x7fb51c15e920 2024-03-30T13:10:22.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb520e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb51c0cfde0 0x7fb51c15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:22.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb520e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb51c0cfde0 0x7fb51c15c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51280/0 (socket says 172.21.15.181:51280) 2024-03-30T13:10:22.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb520e00640 1 -- 172.21.15.181:0/2031826028 learned_addr learned my addr 172.21.15.181:0/2031826028 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-03-30T13:10:22.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb521800640 1 --2- 172.21.15.181:0/2031826028 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c15e920 0x7fb51c1ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:22.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb51be00640 1 --2- 172.21.15.181:0/2031826028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb51c0d0f90 0x7fb51c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:22.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb520e00640 1 -- 172.21.15.181:0/2031826028 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c15e920 msgr2=0x7fb51c1ea5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:22.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb520e00640 1 --2- 172.21.15.181:0/2031826028 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c15e920 0x7fb51c1ea5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb520e00640 1 -- 172.21.15.181:0/2031826028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb51c0d0f90 msgr2=0x7fb51c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:22.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb520e00640 1 --2- 172.21.15.181:0/2031826028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb51c0d0f90 0x7fb51c15a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.726+0000 7fb520e00640 1 -- 172.21.15.181:0/2031826028 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c1f4b30 con 0x7fb51c0cfde0 2024-03-30T13:10:22.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.727+0000 7fb520e00640 1 --2- 172.21.15.181:0/2031826028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb51c0cfde0 0x7fb51c15c0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb51000e960 tx=0x7fb51000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:22.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.727+0000 7fb518c00640 1 -- 172.21.15.181:0/2031826028 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510017070 con 0x7fb51c0cfde0 2024-03-30T13:10:22.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.727+0000 7fb518c00640 1 -- 172.21.15.181:0/2031826028 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51000ca00 con 0x7fb51c0cfde0 2024-03-30T13:10:22.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.727+0000 7fb518c00640 1 -- 172.21.15.181:0/2031826028 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51000cdd0 con 0x7fb51c0cfde0 2024-03-30T13:10:22.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.727+0000 7fb523800640 1 -- 172.21.15.181:0/2031826028 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51c15c5e0 con 0x7fb51c0cfde0 2024-03-30T13:10:22.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.727+0000 7fb523800640 1 -- 172.21.15.181:0/2031826028 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51c15b070 con 0x7fb51c0cfde0 2024-03-30T13:10:22.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.727+0000 7fb518c00640 1 -- 172.21.15.181:0/2031826028 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb51001a070 con 0x7fb51c0cfde0 2024-03-30T13:10:22.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.727+0000 7fb518c00640 1 -- 172.21.15.181:0/2031826028 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fb510013470 con 0x7fb51c0cfde0 2024-03-30T13:10:22.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.728+0000 7fb523800640 1 -- 172.21.15.181:0/2031826028 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb51c0a2560 con 0x7fb51c0cfde0 2024-03-30T13:10:22.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.731+0000 7fb518c00640 1 -- 172.21.15.181:0/2031826028 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb5100093e0 con 0x7fb51c0cfde0 2024-03-30T13:10:22.746 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:22.742+0000 7f7d23e0d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:10:22.772 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:22.769+0000 7f12c5045040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:10:22.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.810+0000 7fb523800640 1 -- 172.21.15.181:0/2031826028 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c50d9187-00e9-4737-8ecc-6adda3776c33", "id": 1} v 0) -- 0x7fb51c15e140 con 0x7fb51c0cfde0 2024-03-30T13:10:22.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.818+0000 7fb518c00640 1 -- 172.21.15.181:0/2031826028 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c50d9187-00e9-4737-8ecc-6adda3776c33", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fb510004020 con 0x7fb51c0cfde0 2024-03-30T13:10:22.822 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-03-30T13:10:22.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.819+0000 7fb523800640 1 -- 172.21.15.181:0/2031826028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb51c0cfde0 msgr2=0x7fb51c15c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:22.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.819+0000 7fb523800640 1 --2- 172.21.15.181:0/2031826028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb51c0cfde0 0x7fb51c15c0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb51000e960 tx=0x7fb51000ee20 comp rx=0 tx=0).stop 2024-03-30T13:10:22.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.820+0000 7fb523800640 1 -- 172.21.15.181:0/2031826028 shutdown_connections 2024-03-30T13:10:22.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.820+0000 7fb523800640 1 --2- 172.21.15.181:0/2031826028 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb51c15e920 0x7fb51c1ea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.820+0000 7fb523800640 1 --2- 172.21.15.181:0/2031826028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb51c0d0f90 0x7fb51c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.820+0000 7fb523800640 1 --2- 172.21.15.181:0/2031826028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb51c0cfde0 0x7fb51c15c0a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:22.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.820+0000 7fb523800640 1 -- 172.21.15.181:0/2031826028 >> 172.21.15.181:0/2031826028 conn(0x7fb51c08bfc0 msgr2=0x7fb51c0d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:22.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.820+0000 7fb523800640 1 -- 172.21.15.181:0/2031826028 shutdown_connections 2024-03-30T13:10:22.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:22.820+0000 7fb523800640 1 -- 172.21.15.181:0/2031826028 wait complete. 2024-03-30T13:10:22.840 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 263da3f3-3f63-46f9-b01b-951f50bc1200 2 2024-03-30T13:10:22.887 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:22.881+0000 7f7d23e0d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:10:22.932 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:22.929+0000 7f12c5045040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:10:22.970 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:22.966+0000 7f7d23e0d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:10:23.026 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:23.022+0000 7f7d23e0d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:10:23.057 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:23.054+0000 7f12c5045040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:10:23.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.065+0000 7f3428e00640 1 Processor -- start 2024-03-30T13:10:23.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.065+0000 7f3428e00640 1 -- start start 2024-03-30T13:10:23.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.066+0000 7f3428e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f342406b510 0x7f342409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.066+0000 7f3428e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34240b2b40 con 0x7f342415e950 2024-03-30T13:10:23.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.066+0000 7f3428e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34240b62a0 con 0x7f3424072c20 2024-03-30T13:10:23.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.066+0000 7f3428e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f34240b6580 con 0x7f342406b510 2024-03-30T13:10:23.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.066+0000 7f3423400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f342406b510 0x7f342409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.066+0000 7f3423400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f342406b510 0x7f342409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51292/0 (socket says 172.21.15.181:51292) 2024-03-30T13:10:23.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.066+0000 7f3423400640 1 -- 172.21.15.181:0/1959074608 learned_addr learned my addr 172.21.15.181:0/1959074608 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-03-30T13:10:23.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.067+0000 7f3423400640 1 -- 172.21.15.181:0/1959074608 >> v1:172.21.15.181:6789/0 conn(0x7f3424072c20 legacy=0x7f34240ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.067+0000 7f3423400640 1 -- 172.21.15.181:0/1959074608 >> v1:172.21.15.99:6789/0 conn(0x7f342415e950 legacy=0x7f342406b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.067+0000 7f3423400640 1 -- 172.21.15.181:0/1959074608 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34240b1d00 con 0x7f342406b510 2024-03-30T13:10:23.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.068+0000 7f3423400640 1 --2- 172.21.15.181:0/1959074608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f342406b510 0x7f342409aa30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3414009870 tx=0x7f341402b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3df3ea863985613a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:23.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.068+0000 7f3422000640 1 -- 172.21.15.181:0/1959074608 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3414035020 con 0x7f342406b510 2024-03-30T13:10:23.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.068+0000 7f3422000640 1 -- 172.21.15.181:0/1959074608 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341402d040 con 0x7f342406b510 2024-03-30T13:10:23.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.068+0000 7f3422000640 1 -- 172.21.15.181:0/1959074608 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3414031a80 con 0x7f342406b510 2024-03-30T13:10:23.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.069+0000 7f3428e00640 1 -- 172.21.15.181:0/1959074608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f342406b510 msgr2=0x7f342409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.069+0000 7f3428e00640 1 --2- 172.21.15.181:0/1959074608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f342406b510 0x7f342409aa30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3414009870 tx=0x7f341402b900 comp rx=0 tx=0).stop 2024-03-30T13:10:23.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.069+0000 7f3428e00640 1 -- 172.21.15.181:0/1959074608 shutdown_connections 2024-03-30T13:10:23.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.069+0000 7f3428e00640 1 --2- 172.21.15.181:0/1959074608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f342406b510 0x7f342409aa30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.069+0000 7f3428e00640 1 -- 172.21.15.181:0/1959074608 >> 172.21.15.181:0/1959074608 conn(0x7f34240b6790 msgr2=0x7f34240b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:23.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.069+0000 7f3428e00640 1 -- 172.21.15.181:0/1959074608 shutdown_connections 2024-03-30T13:10:23.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.069+0000 7f3428e00640 1 -- 172.21.15.181:0/1959074608 wait complete. 2024-03-30T13:10:23.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.070+0000 7f3428e00640 1 Processor -- start 2024-03-30T13:10:23.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.070+0000 7f3428e00640 1 -- start start 2024-03-30T13:10:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3428e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f342406b510 0x7f342414bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3428e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3424072c20 0x7f34240cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3428e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f342415e950 0x7f34240af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3428e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f34240b6060 con 0x7f342406b510 2024-03-30T13:10:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3428e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f34240b5ee0 con 0x7f3424072c20 2024-03-30T13:10:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3428e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f34240b2500 con 0x7f342415e950 2024-03-30T13:10:23.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3422a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3424072c20 0x7f34240cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3422a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3424072c20 0x7f34240cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51294/0 (socket says 172.21.15.181:51294) 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3422a00640 1 -- 172.21.15.181:0/3396246510 learned_addr learned my addr 172.21.15.181:0/3396246510 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3423e00640 1 --2- 172.21.15.181:0/3396246510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f342415e950 0x7f34240af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3423400640 1 --2- 172.21.15.181:0/3396246510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f342406b510 0x7f342414bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3422a00640 1 -- 172.21.15.181:0/3396246510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f342415e950 msgr2=0x7f34240af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3422a00640 1 --2- 172.21.15.181:0/3396246510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f342415e950 0x7f34240af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3422a00640 1 -- 172.21.15.181:0/3396246510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f342406b510 msgr2=0x7f342414bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3422a00640 1 --2- 172.21.15.181:0/3396246510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f342406b510 0x7f342414bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3422a00640 1 -- 172.21.15.181:0/3396246510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34240cb7b0 con 0x7f3424072c20 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.072+0000 7f3422a00640 1 --2- 172.21.15.181:0/3396246510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3424072c20 0x7f34240cd870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c3c0 tx=0x7f340c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.073+0000 7f341b400640 1 -- 172.21.15.181:0/3396246510 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c0052d0 con 0x7f3424072c20 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.073+0000 7f341b400640 1 -- 172.21.15.181:0/3396246510 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340c005490 con 0x7f3424072c20 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.073+0000 7f341b400640 1 -- 172.21.15.181:0/3396246510 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c007260 con 0x7f3424072c20 2024-03-30T13:10:23.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.073+0000 7f3428e00640 1 -- 172.21.15.181:0/3396246510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34240cba20 con 0x7f3424072c20 2024-03-30T13:10:23.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.073+0000 7f3428e00640 1 -- 172.21.15.181:0/3396246510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34240d0830 con 0x7f3424072c20 2024-03-30T13:10:23.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.073+0000 7f341b400640 1 -- 172.21.15.181:0/3396246510 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f340c007400 con 0x7f3424072c20 2024-03-30T13:10:23.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.073+0000 7f341b400640 1 -- 172.21.15.181:0/3396246510 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f340c0067d0 con 0x7f3424072c20 2024-03-30T13:10:23.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.074+0000 7f3428e00640 1 -- 172.21.15.181:0/3396246510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342404f8f0 con 0x7f3424072c20 2024-03-30T13:10:23.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.076+0000 7f341b400640 1 -- 172.21.15.181:0/3396246510 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f340c0035f0 con 0x7f3424072c20 2024-03-30T13:10:23.092 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:23.087+0000 7f7d23e0d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:10:23.111 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:23.107+0000 7f12c5045040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:10:23.148 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:23.144+0000 7f7d23e0d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:10:23.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.155+0000 7f3428e00640 1 -- 172.21.15.181:0/3396246510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "263da3f3-3f63-46f9-b01b-951f50bc1200", "id": 2} v 0) -- 0x7f34240d15c0 con 0x7f3424072c20 2024-03-30T13:10:23.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.162+0000 7f341b400640 1 -- 172.21.15.181:0/3396246510 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "263da3f3-3f63-46f9-b01b-951f50bc1200", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f340c006af0 con 0x7f3424072c20 2024-03-30T13:10:23.166 INFO:teuthology.orchestra.run.smithi181.stdout:2 2024-03-30T13:10:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.164+0000 7f3428e00640 1 -- 172.21.15.181:0/3396246510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3424072c20 msgr2=0x7f34240cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.164+0000 7f3428e00640 1 --2- 172.21.15.181:0/3396246510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3424072c20 0x7f34240cd870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c3c0 tx=0x7f340c00c880 comp rx=0 tx=0).stop 2024-03-30T13:10:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.164+0000 7f3428e00640 1 -- 172.21.15.181:0/3396246510 shutdown_connections 2024-03-30T13:10:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.164+0000 7f3428e00640 1 --2- 172.21.15.181:0/3396246510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f342415e950 0x7f34240af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.164+0000 7f3428e00640 1 --2- 172.21.15.181:0/3396246510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3424072c20 0x7f34240cd870 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.164+0000 7f3428e00640 1 --2- 172.21.15.181:0/3396246510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f342406b510 0x7f342414bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.164+0000 7f3428e00640 1 -- 172.21.15.181:0/3396246510 >> 172.21.15.181:0/3396246510 conn(0x7f34240b6790 msgr2=0x7f342406f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:23.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.164+0000 7f3428e00640 1 -- 172.21.15.181:0/3396246510 shutdown_connections 2024-03-30T13:10:23.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.164+0000 7f3428e00640 1 -- 172.21.15.181:0/3396246510 wait complete. 2024-03-30T13:10:23.186 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new daa541ec-08f2-4a10-ae99-dd366ad5f8b2 3 2024-03-30T13:10:23.237 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:23.234+0000 7f12c5045040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:10:23.347 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:23.344+0000 7f12c5045040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:10:23.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.366+0000 7f78af200640 1 Processor -- start 2024-03-30T13:10:23.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.366+0000 7f78af200640 1 -- start start 2024-03-30T13:10:23.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.367+0000 7f78af200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.367+0000 7f78af200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f78a80d16a0 0x7f78a80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.367+0000 7f78af200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a815ed00 con 0x7f78a80cfde0 2024-03-30T13:10:23.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.367+0000 7f78af200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f78a80d37c0 con 0x7f78a80d16a0 2024-03-30T13:10:23.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.367+0000 7f78af200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f78a80d21e0 con 0x7f78a815e920 2024-03-30T13:10:23.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.368+0000 7f78a7e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.368+0000 7f78a7e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:54934/0 (socket says 172.21.15.181:54934) 2024-03-30T13:10:23.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.368+0000 7f78a7e00640 1 -- 172.21.15.181:0/3729770687 learned_addr learned my addr 172.21.15.181:0/3729770687 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-03-30T13:10:23.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.368+0000 7f78ad200640 1 --2- 172.21.15.181:0/3729770687 >> v2:172.21.15.99:3300/0 conn(0x7f78a80d16a0 0x7f78a80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.368+0000 7f78a7e00640 1 -- 172.21.15.181:0/3729770687 >> v2:172.21.15.99:3300/0 conn(0x7f78a80d16a0 msgr2=0x7f78a80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:23.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.368+0000 7f78a7e00640 1 --2- 172.21.15.181:0/3729770687 >> v2:172.21.15.99:3300/0 conn(0x7f78a80d16a0 0x7f78a80d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.368+0000 7f78a7e00640 1 -- 172.21.15.181:0/3729770687 >> v1:172.21.15.181:6789/0 conn(0x7f78a80cfde0 legacy=0x7f78a80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.368+0000 7f78a6a00640 1 -- 172.21.15.181:0/3729770687 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286099244 0 0) 0x7f78a815ed00 con 0x7f78a80cfde0 2024-03-30T13:10:23.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.368+0000 7f78a7e00640 1 -- 172.21.15.181:0/3729770687 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a80d24c0 con 0x7f78a815e920 2024-03-30T13:10:23.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.369+0000 7f78a7e00640 1 --2- 172.21.15.181:0/3729770687 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80d3280 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7898009870 tx=0x7f789802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e17de5691accc4c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:23.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.370+0000 7f78a6a00640 1 -- 172.21.15.181:0/3729770687 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898034070 con 0x7f78a815e920 2024-03-30T13:10:23.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.370+0000 7f78a6a00640 1 -- 172.21.15.181:0/3729770687 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7898030840 con 0x7f78a815e920 2024-03-30T13:10:23.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.370+0000 7f78a6a00640 1 -- 172.21.15.181:0/3729770687 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898030c10 con 0x7f78a815e920 2024-03-30T13:10:23.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.370+0000 7f78af200640 1 -- 172.21.15.181:0/3729770687 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 msgr2=0x7f78a80d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.370+0000 7f78af200640 1 --2- 172.21.15.181:0/3729770687 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80d3280 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7898009870 tx=0x7f789802b980 comp rx=0 tx=0).stop 2024-03-30T13:10:23.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.370+0000 7f78af200640 1 -- 172.21.15.181:0/3729770687 shutdown_connections 2024-03-30T13:10:23.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.370+0000 7f78af200640 1 --2- 172.21.15.181:0/3729770687 >> v2:172.21.15.99:3300/0 conn(0x7f78a80d16a0 0x7f78a80d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.370+0000 7f78af200640 1 --2- 172.21.15.181:0/3729770687 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80d3280 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.370+0000 7f78af200640 1 -- 172.21.15.181:0/3729770687 >> 172.21.15.181:0/3729770687 conn(0x7f78a808bfc0 msgr2=0x7f78a80d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:23.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.370+0000 7f78af200640 1 -- 172.21.15.181:0/3729770687 shutdown_connections 2024-03-30T13:10:23.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.370+0000 7f78af200640 1 -- 172.21.15.181:0/3729770687 wait complete. 2024-03-30T13:10:23.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.372+0000 7f78af200640 1 Processor -- start 2024-03-30T13:10:23.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.372+0000 7f78af200640 1 -- start start 2024-03-30T13:10:23.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.373+0000 7f78af200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a80cfde0 0x7f78a8160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.373+0000 7f78af200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78a80d16a0 0x7f78a8161510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.373+0000 7f78af200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.373+0000 7f78af200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f78a80d2d60 con 0x7f78a80cfde0 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.373+0000 7f78af200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f78a80d2a80 con 0x7f78a80d16a0 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.373+0000 7f78af200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f78a80d4f50 con 0x7f78a815e920 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.373+0000 7f78ad200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.373+0000 7f78a7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78a80d16a0 0x7f78a8161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.373+0000 7f78ad200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:54946/0 (socket says 172.21.15.181:54946) 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.373+0000 7f78ad200640 1 -- 172.21.15.181:0/805280975 learned_addr learned my addr 172.21.15.181:0/805280975 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.373+0000 7f78a7e00640 1 --2- 172.21.15.181:0/805280975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a80cfde0 0x7f78a8160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.374+0000 7f78ad200640 1 -- 172.21.15.181:0/805280975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78a80d16a0 msgr2=0x7f78a8161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.374+0000 7f78ad200640 1 --2- 172.21.15.181:0/805280975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78a80d16a0 0x7f78a8161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.374+0000 7f78ad200640 1 -- 172.21.15.181:0/805280975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a80cfde0 msgr2=0x7f78a8160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.374+0000 7f78ad200640 1 --2- 172.21.15.181:0/805280975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a80cfde0 0x7f78a8160fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.374+0000 7f78ad200640 1 -- 172.21.15.181:0/805280975 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a80b77f0 con 0x7f78a815e920 2024-03-30T13:10:23.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.374+0000 7f78ad200640 1 --2- 172.21.15.181:0/805280975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80b4070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f78a0007e60 tx=0x7f78a000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:23.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.374+0000 7f789fe00640 1 -- 172.21.15.181:0/805280975 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0014420 con 0x7f78a815e920 2024-03-30T13:10:23.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.374+0000 7f789fe00640 1 -- 172.21.15.181:0/805280975 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a0019070 con 0x7f78a815e920 2024-03-30T13:10:23.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.374+0000 7f789fe00640 1 -- 172.21.15.181:0/805280975 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0014820 con 0x7f78a815e920 2024-03-30T13:10:23.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.374+0000 7f78af200640 1 -- 172.21.15.181:0/805280975 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a80b7ad0 con 0x7f78a815e920 2024-03-30T13:10:23.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.374+0000 7f78af200640 1 -- 172.21.15.181:0/805280975 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a80b8090 con 0x7f78a815e920 2024-03-30T13:10:23.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.375+0000 7f789fe00640 1 -- 172.21.15.181:0/805280975 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f78a00149c0 con 0x7f78a815e920 2024-03-30T13:10:23.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.375+0000 7f789fe00640 1 -- 172.21.15.181:0/805280975 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f78a0014cb0 con 0x7f78a815e920 2024-03-30T13:10:23.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.376+0000 7f78af200640 1 -- 172.21.15.181:0/805280975 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a80a2560 con 0x7f78a815e920 2024-03-30T13:10:23.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.378+0000 7f789fe00640 1 -- 172.21.15.181:0/805280975 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f78a001e460 con 0x7f78a815e920 2024-03-30T13:10:23.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.457+0000 7f78af200640 1 -- 172.21.15.181:0/805280975 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "daa541ec-08f2-4a10-ae99-dd366ad5f8b2", "id": 3} v 0) -- 0x7f78a804f9d0 con 0x7f78a815e920 2024-03-30T13:10:23.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.464+0000 7f789fe00640 1 -- 172.21.15.181:0/805280975 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "daa541ec-08f2-4a10-ae99-dd366ad5f8b2", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f78a001e6e0 con 0x7f78a815e920 2024-03-30T13:10:23.468 INFO:teuthology.orchestra.run.smithi181.stdout:3 2024-03-30T13:10:23.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.466+0000 7f78af200640 1 -- 172.21.15.181:0/805280975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 msgr2=0x7f78a80b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.466+0000 7f78af200640 1 --2- 172.21.15.181:0/805280975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80b4070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f78a0007e60 tx=0x7f78a000e4b0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.466+0000 7f78af200640 1 -- 172.21.15.181:0/805280975 shutdown_connections 2024-03-30T13:10:23.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.466+0000 7f78af200640 1 --2- 172.21.15.181:0/805280975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a815e920 0x7f78a80b4070 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.466+0000 7f78af200640 1 --2- 172.21.15.181:0/805280975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78a80d16a0 0x7f78a8161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.466+0000 7f78af200640 1 --2- 172.21.15.181:0/805280975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a80cfde0 0x7f78a8160fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.466+0000 7f78af200640 1 -- 172.21.15.181:0/805280975 >> 172.21.15.181:0/805280975 conn(0x7f78a808bfc0 msgr2=0x7f78a80b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:23.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.466+0000 7f78af200640 1 -- 172.21.15.181:0/805280975 shutdown_connections 2024-03-30T13:10:23.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.466+0000 7f78af200640 1 -- 172.21.15.181:0/805280975 wait complete. 2024-03-30T13:10:23.487 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 9f92ef13-fc60-45f1-943a-bf0cccf1e3b8 4 2024-03-30T13:10:23.525 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:23.521+0000 7f12c5045040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:10:23.574 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:23.571+0000 7f12c5045040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:10:23.625 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:23.621+0000 7f7d23e0d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:10:23.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.665+0000 7f4587800640 1 Processor -- start 2024-03-30T13:10:23.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.665+0000 7f4587800640 1 -- start start 2024-03-30T13:10:23.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.666+0000 7f4587800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f458015e920 0x7f45800d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.667+0000 7f4587800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f458015ed00 con 0x7f45800cfde0 2024-03-30T13:10:23.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.667+0000 7f4587800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45800d21e0 con 0x7f45800d16a0 2024-03-30T13:10:23.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.667+0000 7f4587800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f45800d37c0 con 0x7f458015e920 2024-03-30T13:10:23.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.667+0000 7f4585800640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f45800d16a0 0x7f458006c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60658/0 (socket says 172.21.15.181:60658) 2024-03-30T13:10:23.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.667+0000 7f4585800640 1 -- 172.21.15.181:0/4063850329 learned_addr learned my addr 172.21.15.181:0/4063850329 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-03-30T13:10:23.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.667+0000 7f4584e00640 1 --2- 172.21.15.181:0/4063850329 >> v2:172.21.15.99:3300/0 conn(0x7f458015e920 0x7f45800d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.667+0000 7f457f400640 1 -- 172.21.15.181:0/4063850329 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4085710230 0 0) 0x7f45800d21e0 con 0x7f45800d16a0 2024-03-30T13:10:23.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.667+0000 7f457f400640 1 -- 172.21.15.181:0/4063850329 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4568003520 con 0x7f45800d16a0 2024-03-30T13:10:23.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.668+0000 7f457f400640 1 -- 172.21.15.181:0/4063850329 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037953812 0 0) 0x7f458015ed00 con 0x7f45800cfde0 2024-03-30T13:10:23.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.668+0000 7f457f400640 1 -- 172.21.15.181:0/4063850329 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45800d21e0 con 0x7f45800cfde0 2024-03-30T13:10:23.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.668+0000 7f4584e00640 1 -- 172.21.15.181:0/4063850329 >> v1:172.21.15.181:6789/0 conn(0x7f45800d16a0 legacy=0x7f458006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.668+0000 7f4584e00640 1 -- 172.21.15.181:0/4063850329 >> v1:172.21.15.99:6789/0 conn(0x7f45800cfde0 legacy=0x7f45800d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.668+0000 7f4584e00640 1 -- 172.21.15.181:0/4063850329 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45800d24c0 con 0x7f458015e920 2024-03-30T13:10:23.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.669+0000 7f4584e00640 1 --2- 172.21.15.181:0/4063850329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458015e920 0x7f45800d3280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45740097a0 tx=0x7f457402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd04c9cf36aaa59f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:23.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.669+0000 7f457f400640 1 -- 172.21.15.181:0/4063850329 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574034070 con 0x7f458015e920 2024-03-30T13:10:23.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.669+0000 7f457f400640 1 -- 172.21.15.181:0/4063850329 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4574030610 con 0x7f458015e920 2024-03-30T13:10:23.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.669+0000 7f457f400640 1 -- 172.21.15.181:0/4063850329 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45740309e0 con 0x7f458015e920 2024-03-30T13:10:23.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.670+0000 7f4587800640 1 -- 172.21.15.181:0/4063850329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458015e920 msgr2=0x7f45800d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.670+0000 7f4587800640 1 --2- 172.21.15.181:0/4063850329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458015e920 0x7f45800d3280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45740097a0 tx=0x7f457402b960 comp rx=0 tx=0).stop 2024-03-30T13:10:23.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.670+0000 7f4587800640 1 -- 172.21.15.181:0/4063850329 shutdown_connections 2024-03-30T13:10:23.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.670+0000 7f4587800640 1 --2- 172.21.15.181:0/4063850329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458015e920 0x7f45800d3280 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.670+0000 7f4587800640 1 -- 172.21.15.181:0/4063850329 >> 172.21.15.181:0/4063850329 conn(0x7f458008bfc0 msgr2=0x7f45800d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:23.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.670+0000 7f4587800640 1 -- 172.21.15.181:0/4063850329 shutdown_connections 2024-03-30T13:10:23.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.670+0000 7f4587800640 1 -- 172.21.15.181:0/4063850329 wait complete. 2024-03-30T13:10:23.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.672+0000 7f4587800640 1 Processor -- start 2024-03-30T13:10:23.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.672+0000 7f4587800640 1 -- start start 2024-03-30T13:10:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.673+0000 7f4587800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800cfde0 0x7f45800b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.673+0000 7f4587800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45800d16a0 0x7f45800b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.673+0000 7f4587800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f458015e920 0x7f458014d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.673+0000 7f4587800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f45800d2d60 con 0x7f45800cfde0 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.673+0000 7f4587800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45800d2a80 con 0x7f45800d16a0 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.673+0000 7f4587800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f45800d4f50 con 0x7f458015e920 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.673+0000 7f457fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45800d16a0 0x7f45800b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.673+0000 7f457fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45800d16a0 0x7f45800b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51312/0 (socket says 172.21.15.181:51312) 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.673+0000 7f4585800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f458015e920 0x7f458014d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.673+0000 7f457fe00640 1 -- 172.21.15.181:0/373695436 learned_addr learned my addr 172.21.15.181:0/373695436 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.673+0000 7f4584e00640 1 --2- 172.21.15.181:0/373695436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800cfde0 0x7f45800b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.674+0000 7f457fe00640 1 -- 172.21.15.181:0/373695436 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f458015e920 msgr2=0x7f458014d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.674+0000 7f457fe00640 1 --2- 172.21.15.181:0/373695436 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f458015e920 0x7f458014d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.674+0000 7f457fe00640 1 -- 172.21.15.181:0/373695436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800cfde0 msgr2=0x7f45800b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.674+0000 7f457fe00640 1 --2- 172.21.15.181:0/373695436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800cfde0 0x7f45800b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.674+0000 7f457fe00640 1 -- 172.21.15.181:0/373695436 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4580159f80 con 0x7f45800d16a0 2024-03-30T13:10:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.674+0000 7f457fe00640 1 --2- 172.21.15.181:0/373695436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45800d16a0 0x7f45800b4070 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f457000c4c0 tx=0x7f457000c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.674+0000 7f457cc00640 1 -- 172.21.15.181:0/373695436 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45700052d0 con 0x7f45800d16a0 2024-03-30T13:10:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.674+0000 7f457cc00640 1 -- 172.21.15.181:0/373695436 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4570005470 con 0x7f45800d16a0 2024-03-30T13:10:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.674+0000 7f457cc00640 1 -- 172.21.15.181:0/373695436 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570012870 con 0x7f45800d16a0 2024-03-30T13:10:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.674+0000 7f4587800640 1 -- 172.21.15.181:0/373695436 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45800b7770 con 0x7f45800d16a0 2024-03-30T13:10:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.674+0000 7f4587800640 1 -- 172.21.15.181:0/373695436 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45800b7d30 con 0x7f45800d16a0 2024-03-30T13:10:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.675+0000 7f457cc00640 1 -- 172.21.15.181:0/373695436 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4570012a10 con 0x7f45800d16a0 2024-03-30T13:10:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.675+0000 7f457cc00640 1 -- 172.21.15.181:0/373695436 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4570012d00 con 0x7f45800d16a0 2024-03-30T13:10:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.676+0000 7f4587800640 1 -- 172.21.15.181:0/373695436 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45800a2560 con 0x7f45800d16a0 2024-03-30T13:10:23.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.680+0000 7f457cc00640 1 -- 172.21.15.181:0/373695436 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4580159f80 con 0x7f45800d16a0 2024-03-30T13:10:23.750 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:23.746+0000 7f12c5045040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:10:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.758+0000 7f4587800640 1 -- 172.21.15.181:0/373695436 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f92ef13-fc60-45f1-943a-bf0cccf1e3b8", "id": 4} v 0) -- 0x7f458004f9d0 con 0x7f45800d16a0 2024-03-30T13:10:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.768+0000 7f457cc00640 1 -- 172.21.15.181:0/373695436 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f92ef13-fc60-45f1-943a-bf0cccf1e3b8", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f45700036c0 con 0x7f45800d16a0 2024-03-30T13:10:23.771 INFO:teuthology.orchestra.run.smithi181.stdout:4 2024-03-30T13:10:23.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.769+0000 7f4587800640 1 -- 172.21.15.181:0/373695436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45800d16a0 msgr2=0x7f45800b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.769+0000 7f4587800640 1 --2- 172.21.15.181:0/373695436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45800d16a0 0x7f45800b4070 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f457000c4c0 tx=0x7f457000c980 comp rx=0 tx=0).stop 2024-03-30T13:10:23.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.769+0000 7f4587800640 1 -- 172.21.15.181:0/373695436 shutdown_connections 2024-03-30T13:10:23.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.769+0000 7f4587800640 1 --2- 172.21.15.181:0/373695436 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f458015e920 0x7f458014d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.769+0000 7f4587800640 1 --2- 172.21.15.181:0/373695436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45800d16a0 0x7f45800b4070 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.769+0000 7f4587800640 1 --2- 172.21.15.181:0/373695436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45800cfde0 0x7f45800b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.769+0000 7f4587800640 1 -- 172.21.15.181:0/373695436 >> 172.21.15.181:0/373695436 conn(0x7f458008bfc0 msgr2=0x7f45800cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:23.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.769+0000 7f4587800640 1 -- 172.21.15.181:0/373695436 shutdown_connections 2024-03-30T13:10:23.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.769+0000 7f4587800640 1 -- 172.21.15.181:0/373695436 wait complete. 2024-03-30T13:10:23.791 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new dc0751e0-e85a-43f3-b448-e24aa675e599 5 2024-03-30T13:10:23.796 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:23.792+0000 7f7d23e0d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:10:23.932 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:23.928+0000 7f7d23e0d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:10:23.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.969+0000 7f8062200640 1 Processor -- start 2024-03-30T13:10:23.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.969+0000 7f8062200640 1 -- start start 2024-03-30T13:10:23.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.970+0000 7f8062200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c15e300 0x7f805c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.970+0000 7f8062200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f805c06caf0 con 0x7f805c0d4ae0 2024-03-30T13:10:23.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.971+0000 7f8062200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f805c06cd90 con 0x7f805c15e6e0 2024-03-30T13:10:23.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.971+0000 7f8062200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f805c06d3e0 con 0x7f805c15e300 2024-03-30T13:10:23.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.971+0000 7f805be00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f805c15e6e0 0x7f805c0d43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60670/0 (socket says 172.21.15.181:60670) 2024-03-30T13:10:23.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.971+0000 7f805be00640 1 -- 172.21.15.181:0/1907838985 learned_addr learned my addr 172.21.15.181:0/1907838985 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-03-30T13:10:23.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.971+0000 7f8060e00640 1 --2- 172.21.15.181:0/1907838985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c15e300 0x7f805c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.971+0000 7f805b400640 1 -- 172.21.15.181:0/1907838985 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394611403 0 0) 0x7f805c06cd90 con 0x7f805c15e6e0 2024-03-30T13:10:23.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.971+0000 7f805b400640 1 -- 172.21.15.181:0/1907838985 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8044003520 con 0x7f805c15e6e0 2024-03-30T13:10:23.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.971+0000 7f8060e00640 1 -- 172.21.15.181:0/1907838985 >> v1:172.21.15.181:6789/0 conn(0x7f805c15e6e0 legacy=0x7f805c0d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.971+0000 7f8060e00640 1 -- 172.21.15.181:0/1907838985 >> v1:172.21.15.99:6789/0 conn(0x7f805c0d4ae0 legacy=0x7f805c0d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.971+0000 7f8060e00640 1 -- 172.21.15.181:0/1907838985 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805c06d070 con 0x7f805c15e300 2024-03-30T13:10:23.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.973+0000 7f8060e00640 1 --2- 172.21.15.181:0/1907838985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c15e300 0x7f805c06d870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f80500097d0 tx=0x7f805002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f80b73dc0f9ce229 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:23.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.973+0000 7f805b400640 1 -- 172.21.15.181:0/1907838985 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050034070 con 0x7f805c15e300 2024-03-30T13:10:23.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.973+0000 7f805b400640 1 -- 172.21.15.181:0/1907838985 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8050030800 con 0x7f805c15e300 2024-03-30T13:10:23.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.973+0000 7f805b400640 1 -- 172.21.15.181:0/1907838985 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050030bd0 con 0x7f805c15e300 2024-03-30T13:10:23.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.973+0000 7f8062200640 1 -- 172.21.15.181:0/1907838985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c15e300 msgr2=0x7f805c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.973+0000 7f8062200640 1 --2- 172.21.15.181:0/1907838985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c15e300 0x7f805c06d870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f80500097d0 tx=0x7f805002b940 comp rx=0 tx=0).stop 2024-03-30T13:10:23.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.974+0000 7f8062200640 1 -- 172.21.15.181:0/1907838985 shutdown_connections 2024-03-30T13:10:23.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.974+0000 7f8062200640 1 --2- 172.21.15.181:0/1907838985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c15e300 0x7f805c06d870 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.974+0000 7f8062200640 1 -- 172.21.15.181:0/1907838985 >> 172.21.15.181:0/1907838985 conn(0x7f805c09d7c0 msgr2=0x7f805c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:23.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.974+0000 7f8062200640 1 -- 172.21.15.181:0/1907838985 shutdown_connections 2024-03-30T13:10:23.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.974+0000 7f8062200640 1 -- 172.21.15.181:0/1907838985 wait complete. 2024-03-30T13:10:23.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.975+0000 7f8062200640 1 Processor -- start 2024-03-30T13:10:23.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.975+0000 7f8062200640 1 -- start start 2024-03-30T13:10:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.976+0000 7f8062200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c0d4ae0 0x7f805c0b9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.976+0000 7f8062200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f805c15e300 0x7f805c154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.976+0000 7f8062200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f805c15e6e0 0x7f805c0b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.976+0000 7f8062200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f805c0d1830 con 0x7f805c15e6e0 2024-03-30T13:10:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.976+0000 7f8062200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f805c0d16b0 con 0x7f805c15e300 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.976+0000 7f8062200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f805c0d19b0 con 0x7f805c0d4ae0 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f8060e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c0d4ae0 0x7f805c0b9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f805be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f805c15e300 0x7f805c154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f8060e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c0d4ae0 0x7f805c0b9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:54954/0 (socket says 172.21.15.181:54954) 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f8060e00640 1 -- 172.21.15.181:0/813242730 learned_addr learned my addr 172.21.15.181:0/813242730 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f8061800640 1 --2- 172.21.15.181:0/813242730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f805c15e6e0 0x7f805c0b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f8060e00640 1 -- 172.21.15.181:0/813242730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f805c15e300 msgr2=0x7f805c154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f8060e00640 1 --2- 172.21.15.181:0/813242730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f805c15e300 0x7f805c154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f8060e00640 1 -- 172.21.15.181:0/813242730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f805c15e6e0 msgr2=0x7f805c0b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f8060e00640 1 --2- 172.21.15.181:0/813242730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f805c15e6e0 0x7f805c0b80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f8060e00640 1 -- 172.21.15.181:0/813242730 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805c0b8b00 con 0x7f805c0d4ae0 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f805be00640 1 --2- 172.21.15.181:0/813242730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f805c15e300 0x7f805c154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:10:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.977+0000 7f8060e00640 1 --2- 172.21.15.181:0/813242730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c0d4ae0 0x7f805c0b9ba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f80500098f0 tx=0x7f80500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.978+0000 7f8058c00640 1 -- 172.21.15.181:0/813242730 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050034040 con 0x7f805c0d4ae0 2024-03-30T13:10:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.978+0000 7f8058c00640 1 -- 172.21.15.181:0/813242730 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8050030600 con 0x7f805c0d4ae0 2024-03-30T13:10:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.978+0000 7f8058c00640 1 -- 172.21.15.181:0/813242730 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050006e10 con 0x7f805c0d4ae0 2024-03-30T13:10:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.978+0000 7f8062200640 1 -- 172.21.15.181:0/813242730 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f805c0b8de0 con 0x7f805c0d4ae0 2024-03-30T13:10:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.978+0000 7f8062200640 1 -- 172.21.15.181:0/813242730 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f805c0b93a0 con 0x7f805c0d4ae0 2024-03-30T13:10:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.978+0000 7f8058c00640 1 -- 172.21.15.181:0/813242730 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8050037070 con 0x7f805c0d4ae0 2024-03-30T13:10:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.978+0000 7f8058c00640 1 -- 172.21.15.181:0/813242730 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f80500307b0 con 0x7f805c0d4ae0 2024-03-30T13:10:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.979+0000 7f8062200640 1 -- 172.21.15.181:0/813242730 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f805c04f8f0 con 0x7f805c0d4ae0 2024-03-30T13:10:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:23.983+0000 7f8058c00640 1 -- 172.21.15.181:0/813242730 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f805004bc70 con 0x7f805c0d4ae0 2024-03-30T13:10:23.991 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:23.987+0000 7f7d23e0d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:10:24.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.062+0000 7f8062200640 1 -- 172.21.15.181:0/813242730 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dc0751e0-e85a-43f3-b448-e24aa675e599", "id": 5} v 0) -- 0x7f805c06b510 con 0x7f805c0d4ae0 2024-03-30T13:10:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.072+0000 7f8058c00640 1 -- 172.21.15.181:0/813242730 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc0751e0-e85a-43f3-b448-e24aa675e599", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f805004b400 con 0x7f805c0d4ae0 2024-03-30T13:10:24.076 INFO:teuthology.orchestra.run.smithi181.stdout:5 2024-03-30T13:10:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.073+0000 7f8062200640 1 -- 172.21.15.181:0/813242730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c0d4ae0 msgr2=0x7f805c0b9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.073+0000 7f8062200640 1 --2- 172.21.15.181:0/813242730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c0d4ae0 0x7f805c0b9ba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f80500098f0 tx=0x7f80500046c0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.074+0000 7f8062200640 1 -- 172.21.15.181:0/813242730 shutdown_connections 2024-03-30T13:10:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.074+0000 7f8062200640 1 --2- 172.21.15.181:0/813242730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f805c15e6e0 0x7f805c0b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.074+0000 7f8062200640 1 --2- 172.21.15.181:0/813242730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f805c15e300 0x7f805c154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.074+0000 7f8062200640 1 --2- 172.21.15.181:0/813242730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f805c0d4ae0 0x7f805c0b9ba0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.074+0000 7f8062200640 1 -- 172.21.15.181:0/813242730 >> 172.21.15.181:0/813242730 conn(0x7f805c09d7c0 msgr2=0x7f805c0c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.074+0000 7f8062200640 1 -- 172.21.15.181:0/813242730 shutdown_connections 2024-03-30T13:10:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.074+0000 7f8062200640 1 -- 172.21.15.181:0/813242730 wait complete. 2024-03-30T13:10:24.094 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 9ca858b8-ab1e-4a5c-8706-9dffffd1d793 6 2024-03-30T13:10:24.128 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:24.124+0000 7f7d23e0d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:10:24.247 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:24.243+0000 7f7d23e0d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:10:24.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.284+0000 7f5a4fe00640 1 Processor -- start 2024-03-30T13:10:24.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.284+0000 7f5a4fe00640 1 -- start start 2024-03-30T13:10:24.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.286+0000 7f5a4fe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5a50072d80 0x7f5a50166170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:24.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.286+0000 7f5a4fe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a5006e6d0 con 0x7f5a5015b480 2024-03-30T13:10:24.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.286+0000 7f5a4fe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a5006e9b0 con 0x7f5a500b05b0 2024-03-30T13:10:24.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.286+0000 7f5a4fe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5a500cea50 con 0x7f5a50072d80 2024-03-30T13:10:24.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.286+0000 7f5a47e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5a500b05b0 0x7f5a50072670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60672/0 (socket says 172.21.15.181:60672) 2024-03-30T13:10:24.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.286+0000 7f5a47e00640 1 -- 172.21.15.181:0/1336968768 learned_addr learned my addr 172.21.15.181:0/1336968768 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-03-30T13:10:24.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.286+0000 7f5a4f400640 1 --2- 172.21.15.181:0/1336968768 >> v2:172.21.15.181:3300/0 conn(0x7f5a50072d80 0x7f5a50166170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:24.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.287+0000 7f5a4f400640 1 -- 172.21.15.181:0/1336968768 >> v1:172.21.15.181:6789/0 conn(0x7f5a500b05b0 legacy=0x7f5a50072670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.287+0000 7f5a4f400640 1 -- 172.21.15.181:0/1336968768 >> v1:172.21.15.99:6789/0 conn(0x7f5a5015b480 legacy=0x7f5a500ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.287+0000 7f5a4f400640 1 -- 172.21.15.181:0/1336968768 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a500cb7f0 con 0x7f5a50072d80 2024-03-30T13:10:24.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.288+0000 7f5a4f400640 1 --2- 172.21.15.181:0/1336968768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a50072d80 0x7f5a50166170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009d90 tx=0x7f5a4802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0fc2d50941903af server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:24.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.288+0000 7f5a4e000640 1 -- 172.21.15.181:0/1336968768 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48039070 con 0x7f5a50072d80 2024-03-30T13:10:24.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.288+0000 7f5a4e000640 1 -- 172.21.15.181:0/1336968768 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a4802cd00 con 0x7f5a50072d80 2024-03-30T13:10:24.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.288+0000 7f5a4e000640 1 -- 172.21.15.181:0/1336968768 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48034660 con 0x7f5a50072d80 2024-03-30T13:10:24.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.289+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1336968768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a50072d80 msgr2=0x7f5a50166170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.289+0000 7f5a4fe00640 1 --2- 172.21.15.181:0/1336968768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a50072d80 0x7f5a50166170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009d90 tx=0x7f5a4802bf50 comp rx=0 tx=0).stop 2024-03-30T13:10:24.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.289+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1336968768 shutdown_connections 2024-03-30T13:10:24.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.289+0000 7f5a4fe00640 1 --2- 172.21.15.181:0/1336968768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a50072d80 0x7f5a50166170 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.289+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1336968768 >> 172.21.15.181:0/1336968768 conn(0x7f5a500b2c50 msgr2=0x7f5a500b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:24.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.289+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1336968768 shutdown_connections 2024-03-30T13:10:24.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.289+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1336968768 wait complete. 2024-03-30T13:10:24.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.291+0000 7f5a4fe00640 1 Processor -- start 2024-03-30T13:10:24.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.291+0000 7f5a4fe00640 1 -- start start 2024-03-30T13:10:24.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4fe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a50072d80 0x7f5a500b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:24.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a500b05b0 0x7f5a501561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:24.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a5015b480 0x7f5a501e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:24.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4fe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5006ee10 con 0x7f5a500b05b0 2024-03-30T13:10:24.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4fe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5006ec90 con 0x7f5a5015b480 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4fe00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5a500cd000 con 0x7f5a50072d80 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4ea00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a50072d80 0x7f5a500b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a5015b480 0x7f5a501e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4ea00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a50072d80 0x7f5a500b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:54956/0 (socket says 172.21.15.181:54956) 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4ea00640 1 -- 172.21.15.181:0/1234738827 learned_addr learned my addr 172.21.15.181:0/1234738827 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a5015b480 0x7f5a501e7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51342/0 (socket says 172.21.15.181:51342) 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a47e00640 1 --2- 172.21.15.181:0/1234738827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a500b05b0 0x7f5a501561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4f400640 1 -- 172.21.15.181:0/1234738827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a50072d80 msgr2=0x7f5a500b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4f400640 1 --2- 172.21.15.181:0/1234738827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a50072d80 0x7f5a500b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4f400640 1 -- 172.21.15.181:0/1234738827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a500b05b0 msgr2=0x7f5a501561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4f400640 1 --2- 172.21.15.181:0/1234738827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a500b05b0 0x7f5a501561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4f400640 1 -- 172.21.15.181:0/1234738827 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5015ba00 con 0x7f5a5015b480 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.292+0000 7f5a4ea00640 1 --2- 172.21.15.181:0/1234738827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a50072d80 0x7f5a500b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:10:24.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.293+0000 7f5a4f400640 1 --2- 172.21.15.181:0/1234738827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a5015b480 0x7f5a501e7ef0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5a48033000 tx=0x7f5a48004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:24.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.293+0000 7f5a47400640 1 -- 172.21.15.181:0/1234738827 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48039050 con 0x7f5a5015b480 2024-03-30T13:10:24.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.293+0000 7f5a47400640 1 -- 172.21.15.181:0/1234738827 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a48045070 con 0x7f5a5015b480 2024-03-30T13:10:24.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.293+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1234738827 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5015bca0 con 0x7f5a5015b480 2024-03-30T13:10:24.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.293+0000 7f5a47400640 1 -- 172.21.15.181:0/1234738827 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4803e850 con 0x7f5a5015b480 2024-03-30T13:10:24.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.293+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1234738827 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a501566e0 con 0x7f5a5015b480 2024-03-30T13:10:24.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.293+0000 7f5a47400640 1 -- 172.21.15.181:0/1234738827 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5a4803e9f0 con 0x7f5a5015b480 2024-03-30T13:10:24.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.294+0000 7f5a47400640 1 -- 172.21.15.181:0/1234738827 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5a4803ece0 con 0x7f5a5015b480 2024-03-30T13:10:24.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.294+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1234738827 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a5004f8f0 con 0x7f5a5015b480 2024-03-30T13:10:24.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.297+0000 7f5a47400640 1 -- 172.21.15.181:0/1234738827 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5a4804a460 con 0x7f5a5015b480 2024-03-30T13:10:24.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.376+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1234738827 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9ca858b8-ab1e-4a5c-8706-9dffffd1d793", "id": 6} v 0) -- 0x7f5a500b3a80 con 0x7f5a5015b480 2024-03-30T13:10:24.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.386+0000 7f5a47400640 1 -- 172.21.15.181:0/1234738827 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ca858b8-ab1e-4a5c-8706-9dffffd1d793", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5a4804a640 con 0x7f5a5015b480 2024-03-30T13:10:24.391 INFO:teuthology.orchestra.run.smithi181.stdout:6 2024-03-30T13:10:24.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.388+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1234738827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a5015b480 msgr2=0x7f5a501e7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.388+0000 7f5a4fe00640 1 --2- 172.21.15.181:0/1234738827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a5015b480 0x7f5a501e7ef0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5a48033000 tx=0x7f5a48004a40 comp rx=0 tx=0).stop 2024-03-30T13:10:24.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.388+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1234738827 shutdown_connections 2024-03-30T13:10:24.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.388+0000 7f5a4fe00640 1 --2- 172.21.15.181:0/1234738827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a5015b480 0x7f5a501e7ef0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.388+0000 7f5a4fe00640 1 --2- 172.21.15.181:0/1234738827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a500b05b0 0x7f5a501561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.388+0000 7f5a4fe00640 1 --2- 172.21.15.181:0/1234738827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5a50072d80 0x7f5a500b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.388+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1234738827 >> 172.21.15.181:0/1234738827 conn(0x7f5a500b2c50 msgr2=0x7f5a50072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:24.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.388+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1234738827 shutdown_connections 2024-03-30T13:10:24.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.388+0000 7f5a4fe00640 1 -- 172.21.15.181:0/1234738827 wait complete. 2024-03-30T13:10:24.407 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 8dff6b7a-96d0-47b7-9b86-7d9726045c69 7 2024-03-30T13:10:24.433 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:24.429+0000 7f7d23e0d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:10:24.485 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:24.482+0000 7f7d23e0d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:10:24.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.622+0000 7fb081000640 1 Processor -- start 2024-03-30T13:10:24.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.623+0000 7fb081000640 1 -- start start 2024-03-30T13:10:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.624+0000 7fb081000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb07c0d3280 0x7fb07c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.624+0000 7fb081000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb07c15ed00 con 0x7fb07c0d14d0 2024-03-30T13:10:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.624+0000 7fb081000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb07c0d21e0 con 0x7fb07c15e920 2024-03-30T13:10:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.624+0000 7fb081000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb07c0d24c0 con 0x7fb07c0d3280 2024-03-30T13:10:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.624+0000 7fb079e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb07c15e920 0x7fb07c0cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60678/0 (socket says 172.21.15.181:60678) 2024-03-30T13:10:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.624+0000 7fb079e00640 1 -- 172.21.15.181:0/639549416 learned_addr learned my addr 172.21.15.181:0/639549416 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-03-30T13:10:24.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb071400640 1 --2- 172.21.15.181:0/639549416 >> v2:172.21.15.99:3300/0 conn(0x7fb07c0d3280 0x7fb07c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:24.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4199989196 0 0) 0x7fb07c0d21e0 con 0x7fb07c15e920 2024-03-30T13:10:24.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb060003520 con 0x7fb07c15e920 2024-03-30T13:10:24.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2950291300 0 0) 0x7fb060003520 con 0x7fb07c15e920 2024-03-30T13:10:24.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 >> v2:172.21.15.99:3300/0 conn(0x7fb07c0d3280 msgr2=0x7fb07c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:24.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 --2- 172.21.15.181:0/639549416 >> v2:172.21.15.99:3300/0 conn(0x7fb07c0d3280 0x7fb07c0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 >> v1:172.21.15.99:6789/0 conn(0x7fb07c0d14d0 legacy=0x7fb07c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c0d27a0 con 0x7fb07c15e920 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fb06c001670 con 0x7fb07c15e920 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 >> v1:172.21.15.181:6789/0 conn(0x7fb07c15e920 legacy=0x7fb07c0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0600039b0 0x7fb060003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb060004800 0x7fb060004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0600051c0 0x7fb06000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c0d24c0 con 0x7fb0600039b0 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb06000c060 con 0x7fb0600051c0 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.625+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb06000c260 con 0x7fb060004800 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.626+0000 7fb071400640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb060004800 0x7fb060004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.626+0000 7fb07a800640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0600051c0 0x7fb06000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.626+0000 7fb079e00640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0600039b0 0x7fb060003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.626+0000 7fb071400640 1 -- 172.21.15.181:0/639549416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0600051c0 msgr2=0x7fb06000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.626+0000 7fb071400640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0600051c0 0x7fb06000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.626+0000 7fb071400640 1 -- 172.21.15.181:0/639549416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0600039b0 msgr2=0x7fb060003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:24.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.626+0000 7fb071400640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0600039b0 0x7fb060003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.626+0000 7fb071400640 1 -- 172.21.15.181:0/639549416 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb060003520 con 0x7fb060004800 2024-03-30T13:10:24.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.626+0000 7fb079e00640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0600039b0 0x7fb060003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:24.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.626+0000 7fb07a800640 1 -- 172.21.15.181:0/639549416 reap_dead start 2024-03-30T13:10:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.627+0000 7fb071400640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb060004800 0x7fb060004c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb064009ac0 tx=0x7fb060005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eeb846a74d934d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.627+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064039070 con 0x7fb060004800 2024-03-30T13:10:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.627+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06402c6b0 con 0x7fb060004800 2024-03-30T13:10:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.627+0000 7fb079400640 1 -- 172.21.15.181:0/639549416 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064009690 con 0x7fb060004800 2024-03-30T13:10:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.628+0000 7fb081000640 1 -- 172.21.15.181:0/639549416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb060004800 msgr2=0x7fb060004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.628+0000 7fb081000640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb060004800 0x7fb060004c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb064009ac0 tx=0x7fb060005830 comp rx=0 tx=0).stop 2024-03-30T13:10:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.628+0000 7fb081000640 1 -- 172.21.15.181:0/639549416 shutdown_connections 2024-03-30T13:10:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.628+0000 7fb081000640 1 --2- 172.21.15.181:0/639549416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb060004800 0x7fb060004c80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.628+0000 7fb081000640 1 -- 172.21.15.181:0/639549416 >> 172.21.15.181:0/639549416 conn(0x7fb07c08bfc0 msgr2=0x7fb07c0d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.628+0000 7fb081000640 1 -- 172.21.15.181:0/639549416 shutdown_connections 2024-03-30T13:10:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.628+0000 7fb081000640 1 -- 172.21.15.181:0/639549416 wait complete. 2024-03-30T13:10:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.630+0000 7fb081000640 1 Processor -- start 2024-03-30T13:10:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.630+0000 7fb081000640 1 -- start start 2024-03-30T13:10:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb081000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb060004800 0x7fb07c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb081000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb07c0b7230 0x7fb07c0b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb081000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb07c1f6e40 0x7fb07c1f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb081000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c0d4f50 con 0x7fb07c0b7230 2024-03-30T13:10:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb081000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c0d2d60 con 0x7fb060004800 2024-03-30T13:10:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb081000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb07c0d36e0 con 0x7fb07c1f6e40 2024-03-30T13:10:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb079e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb060004800 0x7fb07c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb079e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb060004800 0x7fb07c0b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51352/0 (socket says 172.21.15.181:51352) 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb079e00640 1 -- 172.21.15.181:0/3775917766 learned_addr learned my addr 172.21.15.181:0/3775917766 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb07a800640 1 --2- 172.21.15.181:0/3775917766 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb07c1f6e40 0x7fb07c1f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb071400640 1 --2- 172.21.15.181:0/3775917766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb07c0b7230 0x7fb07c0b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb079e00640 1 -- 172.21.15.181:0/3775917766 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb07c1f6e40 msgr2=0x7fb07c1f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb079e00640 1 --2- 172.21.15.181:0/3775917766 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb07c1f6e40 0x7fb07c1f7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb079e00640 1 -- 172.21.15.181:0/3775917766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb07c0b7230 msgr2=0x7fb07c0b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb079e00640 1 --2- 172.21.15.181:0/3775917766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb07c0b7230 0x7fb07c0b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.631+0000 7fb079e00640 1 -- 172.21.15.181:0/3775917766 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c0b7cd0 con 0x7fb060004800 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.632+0000 7fb079e00640 1 --2- 172.21.15.181:0/3775917766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb060004800 0x7fb07c0b5420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00e800 tx=0x7fb06c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.632+0000 7fb072a00640 1 -- 172.21.15.181:0/3775917766 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00c8d0 con 0x7fb060004800 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.632+0000 7fb072a00640 1 -- 172.21.15.181:0/3775917766 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06c018070 con 0x7fb060004800 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.632+0000 7fb072a00640 1 -- 172.21.15.181:0/3775917766 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00cc90 con 0x7fb060004800 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.632+0000 7fb081000640 1 -- 172.21.15.181:0/3775917766 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07c0b7fb0 con 0x7fb060004800 2024-03-30T13:10:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.632+0000 7fb081000640 1 -- 172.21.15.181:0/3775917766 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07c0b8850 con 0x7fb060004800 2024-03-30T13:10:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.632+0000 7fb072a00640 1 -- 172.21.15.181:0/3775917766 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb06c01d460 con 0x7fb060004800 2024-03-30T13:10:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.633+0000 7fb072a00640 1 -- 172.21.15.181:0/3775917766 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fb06c01ddb0 con 0x7fb060004800 2024-03-30T13:10:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.633+0000 7fb081000640 1 -- 172.21.15.181:0/3775917766 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07c0a2560 con 0x7fb060004800 2024-03-30T13:10:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.636+0000 7fb072a00640 1 -- 172.21.15.181:0/3775917766 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb06c01d750 con 0x7fb060004800 2024-03-30T13:10:24.671 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:24.668+0000 7f7d23e0d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:10:24.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.714+0000 7fb081000640 1 -- 172.21.15.181:0/3775917766 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8dff6b7a-96d0-47b7-9b86-7d9726045c69", "id": 7} v 0) -- 0x7fb07c0b8a20 con 0x7fb060004800 2024-03-30T13:10:24.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.720+0000 7fb072a00640 1 -- 172.21.15.181:0/3775917766 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8dff6b7a-96d0-47b7-9b86-7d9726045c69", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fb06c01d930 con 0x7fb060004800 2024-03-30T13:10:24.724 INFO:teuthology.orchestra.run.smithi181.stdout:7 2024-03-30T13:10:24.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.721+0000 7fb081000640 1 -- 172.21.15.181:0/3775917766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb060004800 msgr2=0x7fb07c0b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:24.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.721+0000 7fb081000640 1 --2- 172.21.15.181:0/3775917766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb060004800 0x7fb07c0b5420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00e800 tx=0x7fb06c00ecc0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.721+0000 7fb081000640 1 -- 172.21.15.181:0/3775917766 shutdown_connections 2024-03-30T13:10:24.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.721+0000 7fb081000640 1 --2- 172.21.15.181:0/3775917766 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb07c1f6e40 0x7fb07c1f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.721+0000 7fb081000640 1 --2- 172.21.15.181:0/3775917766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb07c0b7230 0x7fb07c0b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.721+0000 7fb081000640 1 --2- 172.21.15.181:0/3775917766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb060004800 0x7fb07c0b5420 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:24.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.721+0000 7fb081000640 1 -- 172.21.15.181:0/3775917766 >> 172.21.15.181:0/3775917766 conn(0x7fb07c08bfc0 msgr2=0x7fb07c0d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:24.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.721+0000 7fb081000640 1 -- 172.21.15.181:0/3775917766 shutdown_connections 2024-03-30T13:10:24.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:10:24.722+0000 7fb081000640 1 -- 172.21.15.181:0/3775917766 wait complete. 2024-03-30T13:10:24.742 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-30T13:10:24.742 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-30T13:10:24.750 INFO:tasks.ceph.osd.0:Started 2024-03-30T13:10:24.750 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-30T13:10:24.750 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-30T13:10:24.759 INFO:tasks.ceph.osd.1:Started 2024-03-30T13:10:24.759 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-30T13:10:24.759 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-30T13:10:24.764 INFO:tasks.ceph.osd.2:Started 2024-03-30T13:10:24.764 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-30T13:10:24.765 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-30T13:10:24.774 INFO:tasks.ceph.osd.3:Started 2024-03-30T13:10:24.774 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-30T13:10:24.774 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-30T13:10:24.781 INFO:tasks.ceph.osd.4:Started 2024-03-30T13:10:24.781 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-30T13:10:24.781 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-30T13:10:24.787 INFO:tasks.ceph.osd.5:Started 2024-03-30T13:10:24.788 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-30T13:10:24.788 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-30T13:10:24.792 INFO:tasks.ceph.osd.6:Started 2024-03-30T13:10:24.792 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-30T13:10:24.792 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-30T13:10:24.799 INFO:tasks.ceph.osd.7:Started 2024-03-30T13:10:24.801 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:10:24.872 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:24.869+0000 7f12c5045040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:10:25.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.024+0000 7f4704400640 1 Processor -- start 2024-03-30T13:10:25.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.024+0000 7f4704400640 1 -- start start 2024-03-30T13:10:25.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.025+0000 7f4704400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f46fc15b370 0x7f46fc0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:25.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.025+0000 7f4704400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46fc06f3f0 0x7f46fc072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:25.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.025+0000 7f4704400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f46fc0730c0 0x7f46fc0ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:25.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.025+0000 7f4704400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f46fc071ae0 con 0x7f46fc15b370 2024-03-30T13:10:25.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.025+0000 7f4704400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f46fc071dc0 con 0x7f46fc0730c0 2024-03-30T13:10:25.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4704400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f46fc0720a0 con 0x7f46fc06f3f0 2024-03-30T13:10:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4701a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f46fc15b370 0x7f46fc0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4701a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f46fc15b370 0x7f46fc0b32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59970/0 (socket says 172.21.15.99:59970) 2024-03-30T13:10:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4701a00640 1 -- 172.21.15.99:0/1938921415 learned_addr learned my addr 172.21.15.99:0/1938921415 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4702400640 1 --2- 172.21.15.99:0/1938921415 >> v2:172.21.15.181:3300/0 conn(0x7f46fc0730c0 0x7f46fc0ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4701000640 1 --2- 172.21.15.99:0/1938921415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46fc06f3f0 0x7f46fc072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4701a00640 1 -- 172.21.15.99:0/1938921415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46fc06f3f0 msgr2=0x7f46fc072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4701a00640 1 --2- 172.21.15.99:0/1938921415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46fc06f3f0 0x7f46fc072b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4701a00640 1 -- 172.21.15.99:0/1938921415 >> v2:172.21.15.181:3300/0 conn(0x7f46fc0730c0 msgr2=0x7f46fc0ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4701a00640 1 --2- 172.21.15.99:0/1938921415 >> v2:172.21.15.181:3300/0 conn(0x7f46fc0730c0 0x7f46fc0ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4701a00640 1 -- 172.21.15.99:0/1938921415 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46fc072380 con 0x7f46fc15b370 2024-03-30T13:10:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.026+0000 7f4702400640 1 --2- 172.21.15.99:0/1938921415 >> v2:172.21.15.181:3300/0 conn(0x7f46fc0730c0 0x7f46fc0ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:25.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.027+0000 7f4701a00640 1 --2- 172.21.15.99:0/1938921415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46fc15b370 0x7f46fc0b32c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f46fc06c5a0 tx=0x7f46f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f042f005b44a22d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:25.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f46fbe00640 1 -- 172.21.15.99:0/1938921415 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0035020 con 0x7f46fc15b370 2024-03-30T13:10:25.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f46fbe00640 1 -- 172.21.15.99:0/1938921415 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f0031870 con 0x7f46fc15b370 2024-03-30T13:10:25.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f46fbe00640 1 -- 172.21.15.99:0/1938921415 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0031c40 con 0x7f46fc15b370 2024-03-30T13:10:25.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f4704400640 1 -- 172.21.15.99:0/1938921415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46fc15b370 msgr2=0x7f46fc0b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:25.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f4704400640 1 --2- 172.21.15.99:0/1938921415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46fc15b370 0x7f46fc0b32c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f46fc06c5a0 tx=0x7f46f002b910 comp rx=0 tx=0).stop 2024-03-30T13:10:25.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f4704400640 1 -- 172.21.15.99:0/1938921415 shutdown_connections 2024-03-30T13:10:25.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f4704400640 1 --2- 172.21.15.99:0/1938921415 >> v2:172.21.15.181:3300/0 conn(0x7f46fc0730c0 0x7f46fc0ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:25.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f4704400640 1 --2- 172.21.15.99:0/1938921415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46fc06f3f0 0x7f46fc072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:25.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f4704400640 1 --2- 172.21.15.99:0/1938921415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46fc15b370 0x7f46fc0b32c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:25.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f4704400640 1 -- 172.21.15.99:0/1938921415 >> 172.21.15.99:0/1938921415 conn(0x7f46fc06b510 msgr2=0x7f46fc06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:25.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f4704400640 1 -- 172.21.15.99:0/1938921415 shutdown_connections 2024-03-30T13:10:25.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.028+0000 7f4704400640 1 -- 172.21.15.99:0/1938921415 wait complete. 2024-03-30T13:10:25.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.030+0000 7f4704400640 1 Processor -- start 2024-03-30T13:10:25.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.030+0000 7f4704400640 1 -- start start 2024-03-30T13:10:25.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.031+0000 7f4704400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46fc06f3f0 0x7f46fc1f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:25.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.031+0000 7f4704400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46fc0730c0 0x7f46fc09a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:25.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.031+0000 7f4704400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46fc15b370 0x7f46fc09ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:25.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.031+0000 7f4704400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc0b3800 con 0x7f46fc0730c0 2024-03-30T13:10:25.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.031+0000 7f4704400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc073550 con 0x7f46fc15b370 2024-03-30T13:10:25.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.031+0000 7f4704400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f46fc0b3980 con 0x7f46fc06f3f0 2024-03-30T13:10:25.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.031+0000 7f4701000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46fc0730c0 0x7f46fc09a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:25.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.031+0000 7f4701000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46fc0730c0 0x7f46fc09a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59986/0 (socket says 172.21.15.99:59986) 2024-03-30T13:10:25.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.031+0000 7f4701000640 1 -- 172.21.15.99:0/338969343 learned_addr learned my addr 172.21.15.99:0/338969343 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:25.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.031+0000 7f4701a00640 1 --2- 172.21.15.99:0/338969343 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46fc06f3f0 0x7f46fc1f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.031+0000 7f4702400640 1 --2- 172.21.15.99:0/338969343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46fc15b370 0x7f46fc09ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f4701000640 1 -- 172.21.15.99:0/338969343 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46fc06f3f0 msgr2=0x7f46fc1f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f4701000640 1 --2- 172.21.15.99:0/338969343 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46fc06f3f0 0x7f46fc1f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f4701000640 1 -- 172.21.15.99:0/338969343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46fc15b370 msgr2=0x7f46fc09ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f4701000640 1 --2- 172.21.15.99:0/338969343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46fc15b370 0x7f46fc09ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f4701000640 1 -- 172.21.15.99:0/338969343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46fc150fd0 con 0x7f46fc0730c0 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f4701000640 1 --2- 172.21.15.99:0/338969343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46fc0730c0 0x7f46fc09a7e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46e800d830 tx=0x7f46e800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f46f9600640 1 -- 172.21.15.99:0/338969343 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8018030 con 0x7f46fc0730c0 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f46f9600640 1 -- 172.21.15.99:0/338969343 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e800be10 con 0x7f46fc0730c0 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f46f9600640 1 -- 172.21.15.99:0/338969343 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e80098b0 con 0x7f46fc0730c0 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f4704400640 1 -- 172.21.15.99:0/338969343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46fc1512b0 con 0x7f46fc0730c0 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f4704400640 1 -- 172.21.15.99:0/338969343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46fc151870 con 0x7f46fc0730c0 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.032+0000 7f46f9600640 1 -- 172.21.15.99:0/338969343 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f46e801b070 con 0x7f46fc0730c0 2024-03-30T13:10:25.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.033+0000 7f46f9600640 1 -- 172.21.15.99:0/338969343 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f46e801db90 con 0x7f46fc0730c0 2024-03-30T13:10:25.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.033+0000 7f4704400640 1 -- 172.21.15.99:0/338969343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46fc068640 con 0x7f46fc0730c0 2024-03-30T13:10:25.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.036+0000 7f46f9600640 1 -- 172.21.15.99:0/338969343 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f46e801d410 con 0x7f46fc0730c0 2024-03-30T13:10:25.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.099+0000 7f4704400640 1 -- 172.21.15.99:0/338969343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46fc0d0000 con 0x7f46fc0730c0 2024-03-30T13:10:25.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.101+0000 7f46f9600640 1 -- 172.21.15.99:0/338969343 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f46e801d5f0 con 0x7f46fc0730c0 2024-03-30T13:10:25.104 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:25.104 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":10,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:24.717053+0000","last_up_change":"0.000000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:10:25.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.102+0000 7f4704400640 1 -- 172.21.15.99:0/338969343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46fc0730c0 msgr2=0x7f46fc09a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:25.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.102+0000 7f4704400640 1 --2- 172.21.15.99:0/338969343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46fc0730c0 0x7f46fc09a7e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46e800d830 tx=0x7f46e800dcf0 comp rx=0 tx=0).stop 2024-03-30T13:10:25.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.103+0000 7f4704400640 1 -- 172.21.15.99:0/338969343 shutdown_connections 2024-03-30T13:10:25.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.103+0000 7f4704400640 1 --2- 172.21.15.99:0/338969343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46fc15b370 0x7f46fc09ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:25.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.103+0000 7f4704400640 1 --2- 172.21.15.99:0/338969343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46fc0730c0 0x7f46fc09a7e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:25.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.103+0000 7f4704400640 1 --2- 172.21.15.99:0/338969343 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46fc06f3f0 0x7f46fc1f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:25.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.103+0000 7f4704400640 1 -- 172.21.15.99:0/338969343 >> 172.21.15.99:0/338969343 conn(0x7f46fc06b510 msgr2=0x7f46fc0b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:25.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.103+0000 7f4704400640 1 -- 172.21.15.99:0/338969343 shutdown_connections 2024-03-30T13:10:25.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:25.103+0000 7f4704400640 1 -- 172.21.15.99:0/338969343 wait complete. 2024-03-30T13:10:25.121 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-30T13:10:25.121 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-30T13:10:25.223 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:25.221+0000 7f12c5045040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:10:25.286 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:25.283+0000 7f12c5045040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:10:25.416 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:25.413+0000 7f12c5045040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:10:25.463 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-03-30T13:10:25.460+0000 7fb5668bd640 -1 Falling back to public interface 2024-03-30T13:10:25.463 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-03-30T13:10:25.461+0000 7f37c9cb5640 -1 Falling back to public interface 2024-03-30T13:10:25.471 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-03-30T13:10:25.467+0000 7ff3ad015640 -1 Falling back to public interface 2024-03-30T13:10:25.478 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-03-30T13:10:25.475+0000 7fe0c620f640 -1 Falling back to public interface 2024-03-30T13:10:25.479 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-03-30T13:10:25.476+0000 7f09e4f9a640 -1 Falling back to public interface 2024-03-30T13:10:25.482 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-03-30T13:10:25.479+0000 7f4e6be13640 -1 Falling back to public interface 2024-03-30T13:10:25.488 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-03-30T13:10:25.485+0000 7fe0c4600640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6831/0: (98) Address already in use 2024-03-30T13:10:25.510 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-03-30T13:10:25.506+0000 7f0fdb419640 -1 Falling back to public interface 2024-03-30T13:10:25.510 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-03-30T13:10:25.506+0000 7fbf3a3e1640 -1 Falling back to public interface 2024-03-30T13:10:25.821 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:25.818+0000 7f7d23e0d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:10:25.928 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T13:10:26.107 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.103+0000 7f3167e00640 1 Processor -- start 2024-03-30T13:10:26.107 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.103+0000 7f3167e00640 1 -- start start 2024-03-30T13:10:26.109 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3167e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31600719c0 0x7f3160071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.109 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3167e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f31600cf190 0x7f31600b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.109 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3167e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31600722e0 con 0x7f316006f100 2024-03-30T13:10:26.109 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3167e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f316006d9e0 con 0x7f31600cf190 2024-03-30T13:10:26.109 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3167e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f316006dc30 con 0x7f31600719c0 2024-03-30T13:10:26.109 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3165e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f31600cf190 0x7f31600b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.109 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3165e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f31600cf190 0x7f31600b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60044/0 (socket says 172.21.15.99:60044) 2024-03-30T13:10:26.109 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3165e00640 1 -- 172.21.15.99:0/2769397985 learned_addr learned my addr 172.21.15.99:0/2769397985 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:26.109 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3165400640 1 --2- 172.21.15.99:0/2769397985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31600719c0 0x7f3160071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.109 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3165e00640 1 -- 172.21.15.99:0/2769397985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31600719c0 msgr2=0x7f3160071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:26.110 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3165e00640 1 --2- 172.21.15.99:0/2769397985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31600719c0 0x7f3160071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.110 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3165e00640 1 -- 172.21.15.99:0/2769397985 >> v1:172.21.15.181:6789/0 conn(0x7f316006f100 legacy=0x7f31600b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.110 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.105+0000 7f3165e00640 1 -- 172.21.15.99:0/2769397985 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316006df10 con 0x7f31600cf190 2024-03-30T13:10:26.111 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.107+0000 7f3165e00640 1 --2- 172.21.15.99:0/2769397985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31600cf190 0x7f31600b3ab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3158009e50 tx=0x7f315802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62e38b1b062f60d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:26.112 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.107+0000 7f315fe00640 1 -- 172.21.15.99:0/2769397985 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315802cb00 con 0x7f31600cf190 2024-03-30T13:10:26.112 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.107+0000 7f315fe00640 1 -- 172.21.15.99:0/2769397985 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f315802cca0 con 0x7f31600cf190 2024-03-30T13:10:26.112 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.107+0000 7f315fe00640 1 -- 172.21.15.99:0/2769397985 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158034610 con 0x7f31600cf190 2024-03-30T13:10:26.112 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.107+0000 7f3167e00640 1 -- 172.21.15.99:0/2769397985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31600cf190 msgr2=0x7f31600b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.112 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.107+0000 7f3167e00640 1 --2- 172.21.15.99:0/2769397985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31600cf190 0x7f31600b3ab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3158009e50 tx=0x7f315802bf60 comp rx=0 tx=0).stop 2024-03-30T13:10:26.112 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.107+0000 7f3167e00640 1 -- 172.21.15.99:0/2769397985 shutdown_connections 2024-03-30T13:10:26.112 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.108+0000 7f3167e00640 1 --2- 172.21.15.99:0/2769397985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31600cf190 0x7f31600b3ab0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.112 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.108+0000 7f3167e00640 1 --2- 172.21.15.99:0/2769397985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31600719c0 0x7f3160071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.112 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.108+0000 7f3167e00640 1 -- 172.21.15.99:0/2769397985 >> 172.21.15.99:0/2769397985 conn(0x7f3160074a70 msgr2=0x7f316006b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:26.112 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.108+0000 7f3167e00640 1 -- 172.21.15.99:0/2769397985 shutdown_connections 2024-03-30T13:10:26.112 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.108+0000 7f3167e00640 1 -- 172.21.15.99:0/2769397985 wait complete. 2024-03-30T13:10:26.116 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.109+0000 7f3167e00640 1 Processor -- start 2024-03-30T13:10:26.116 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.109+0000 7f3167e00640 1 -- start start 2024-03-30T13:10:26.116 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.110+0000 7f3167e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f316006f100 0x7f3160157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.116 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.110+0000 7f3167e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31600719c0 0x7f31601535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.116 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.110+0000 7f3167e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31600cf190 0x7f316015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:26.116 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.110+0000 7f3167e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f316006e7b0 con 0x7f31600719c0 2024-03-30T13:10:26.116 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.110+0000 7f3167e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f316006e4d0 con 0x7f31600cf190 2024-03-30T13:10:26.117 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.110+0000 7f3167e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f31600b5730 con 0x7f316006f100 2024-03-30T13:10:26.117 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.110+0000 7f3164a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31600719c0 0x7f31601535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.117 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f3164a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31600719c0 0x7f31601535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60054/0 (socket says 172.21.15.99:60054) 2024-03-30T13:10:26.117 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f3165e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31600cf190 0x7f316015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.117 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f3164a00640 1 -- 172.21.15.99:0/3023916745 learned_addr learned my addr 172.21.15.99:0/3023916745 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:26.117 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f3165400640 1 --2- 172.21.15.99:0/3023916745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f316006f100 0x7f3160157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:26.117 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f3164a00640 1 -- 172.21.15.99:0/3023916745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f316006f100 msgr2=0x7f3160157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.117 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f3164a00640 1 --2- 172.21.15.99:0/3023916745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f316006f100 0x7f3160157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.117 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f3164a00640 1 -- 172.21.15.99:0/3023916745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31600cf190 msgr2=0x7f316015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.117 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f3164a00640 1 --2- 172.21.15.99:0/3023916745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31600cf190 0x7f316015a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.118 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f3164a00640 1 -- 172.21.15.99:0/3023916745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316015a9e0 con 0x7f31600719c0 2024-03-30T13:10:26.118 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f3165e00640 1 --2- 172.21.15.99:0/3023916745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31600cf190 0x7f316015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:10:26.118 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f3164a00640 1 --2- 172.21.15.99:0/3023916745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31600719c0 0x7f31601535e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c430 tx=0x7f314c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:26.118 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f315d600640 1 -- 172.21.15.99:0/3023916745 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c0052d0 con 0x7f31600719c0 2024-03-30T13:10:26.118 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f315d600640 1 -- 172.21.15.99:0/3023916745 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f314c005490 con 0x7f31600719c0 2024-03-30T13:10:26.118 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.111+0000 7f315d600640 1 -- 172.21.15.99:0/3023916745 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c007260 con 0x7f31600719c0 2024-03-30T13:10:26.118 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.112+0000 7f3167e00640 1 -- 172.21.15.99:0/3023916745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31601544c0 con 0x7f31600719c0 2024-03-30T13:10:26.118 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.112+0000 7f3167e00640 1 -- 172.21.15.99:0/3023916745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3160153b20 con 0x7f31600719c0 2024-03-30T13:10:26.118 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.113+0000 7f315d600640 1 -- 172.21.15.99:0/3023916745 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 2) ==== 45453+0+0 (secure 0 0 0) 0x7f314c007400 con 0x7f31600719c0 2024-03-30T13:10:26.118 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.113+0000 7f3167e00640 1 -- 172.21.15.99:0/3023916745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3160073370 con 0x7f31600719c0 2024-03-30T13:10:26.118 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.113+0000 7f315d600640 1 -- 172.21.15.99:0/3023916745 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f314c049e20 con 0x7f31600719c0 2024-03-30T13:10:26.119 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.115+0000 7f315d600640 1 -- 172.21.15.99:0/3023916745 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f314c0067d0 con 0x7f31600719c0 2024-03-30T13:10:26.159 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:26.156+0000 7f7d23e0d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:10:26.180 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.177+0000 7f3167e00640 1 -- 172.21.15.99:0/3023916745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f316004f9d0 con 0x7f31600719c0 2024-03-30T13:10:26.181 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.178+0000 7f315d600640 1 -- 172.21.15.99:0/3023916745 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f314c012a60 con 0x7f31600719c0 2024-03-30T13:10:26.181 INFO:teuthology.misc.health.smithi099.stdout: 2024-03-30T13:10:26.182 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":10,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:24.717053+0000","last_up_change":"0.000000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:10:26.182 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.179+0000 7f3167e00640 1 -- 172.21.15.99:0/3023916745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31600719c0 msgr2=0x7f31601535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:26.183 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.179+0000 7f3167e00640 1 --2- 172.21.15.99:0/3023916745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31600719c0 0x7f31601535e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c430 tx=0x7f314c00c8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.183 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.180+0000 7f3167e00640 1 -- 172.21.15.99:0/3023916745 shutdown_connections 2024-03-30T13:10:26.183 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.180+0000 7f3167e00640 1 --2- 172.21.15.99:0/3023916745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31600cf190 0x7f316015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.183 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.180+0000 7f3167e00640 1 --2- 172.21.15.99:0/3023916745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31600719c0 0x7f31601535e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.183 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.180+0000 7f3167e00640 1 --2- 172.21.15.99:0/3023916745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f316006f100 0x7f3160157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:26.183 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.180+0000 7f3167e00640 1 -- 172.21.15.99:0/3023916745 >> 172.21.15.99:0/3023916745 conn(0x7f3160074a70 msgr2=0x7f3160160a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:26.183 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.180+0000 7f3167e00640 1 -- 172.21.15.99:0/3023916745 shutdown_connections 2024-03-30T13:10:26.183 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:26.180+0000 7f3167e00640 1 -- 172.21.15.99:0/3023916745 wait complete. 2024-03-30T13:10:26.195 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-30T13:10:26.218 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:26.215+0000 7f7d23e0d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:10:26.350 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-03-30T13:10:26.348+0000 7f7d23e0d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:10:26.464 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:26.461+0000 7f1265a00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-30T13:10:26.465 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-30T13:10:26.462+0000 7f1265a00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-30T13:10:28.535 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-03-30T13:10:28.532+0000 7fbf3a3e1640 -1 osd.7 0 log_to_monitors true 2024-03-30T13:10:28.781 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-03-30T13:10:28.778+0000 7f37c9cb5640 -1 osd.2 0 log_to_monitors true 2024-03-30T13:10:28.970 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-03-30T13:10:28.966+0000 7fb5668bd640 -1 osd.3 0 log_to_monitors true 2024-03-30T13:10:28.999 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-03-30T13:10:28.995+0000 7ff3ad015640 -1 osd.4 0 log_to_monitors true 2024-03-30T13:10:29.038 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-03-30T13:10:29.034+0000 7f4e6be13640 -1 osd.6 0 log_to_monitors true 2024-03-30T13:10:29.045 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-03-30T13:10:29.041+0000 7f09e4f9a640 -1 osd.0 0 log_to_monitors true 2024-03-30T13:10:29.054 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-03-30T13:10:29.050+0000 7f0fdb419640 -1 osd.5 0 log_to_monitors true 2024-03-30T13:10:29.071 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-03-30T13:10:29.067+0000 7fe0c620f640 -1 osd.1 0 log_to_monitors true 2024-03-30T13:10:30.244 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:30.252 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:30.801 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-03-30T13:10:30.798+0000 7fbf35200640 -1 osd.7 0 waiting for initial osdmap 2024-03-30T13:10:30.865 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-03-30T13:10:30.861+0000 7fbf2b200640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:10:32.551 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-03-30T13:10:32.547+0000 7f0fd5e00640 -1 osd.5 0 waiting for initial osdmap 2024-03-30T13:10:32.561 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-03-30T13:10:32.558+0000 7f0fcbe00640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:10:32.574 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-03-30T13:10:32.570+0000 7ff3a8200640 -1 osd.4 0 waiting for initial osdmap 2024-03-30T13:10:32.581 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-03-30T13:10:32.578+0000 7ff39d800640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:10:32.607 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-03-30T13:10:32.603+0000 7f4e67000640 -1 osd.6 0 waiting for initial osdmap 2024-03-30T13:10:32.622 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-03-30T13:10:32.619+0000 7f4e5c600640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:10:33.002 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T13:10:33.039 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-03-30T13:10:33.034+0000 7fb562200640 -1 osd.3 0 waiting for initial osdmap 2024-03-30T13:10:33.057 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-03-30T13:10:33.052+0000 7fb557800640 -1 osd.3 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:10:33.077 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-03-30T13:10:33.073+0000 7f09dfe00640 -1 osd.0 0 waiting for initial osdmap 2024-03-30T13:10:33.095 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-03-30T13:10:33.091+0000 7f09d5e00640 -1 osd.0 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:10:33.096 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-03-30T13:10:33.093+0000 7fe0c1400640 -1 osd.1 0 waiting for initial osdmap 2024-03-30T13:10:33.104 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-03-30T13:10:33.100+0000 7fe0b6a00640 -1 osd.1 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:10:33.132 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-03-30T13:10:33.129+0000 7f37c4c00640 -1 osd.2 0 waiting for initial osdmap 2024-03-30T13:10:33.138 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-03-30T13:10:33.134+0000 7f37bac00640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:10:33.177 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.173+0000 7f4be7000640 1 Processor -- start 2024-03-30T13:10:33.177 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.173+0000 7f4be7000640 1 -- start start 2024-03-30T13:10:33.178 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4be7000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4be015eae0 0x7f4be00d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:33.178 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4be7000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be00cfd80 con 0x7f4be00d1d40 2024-03-30T13:10:33.178 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4be7000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be00d2b10 con 0x7f4be00d3b30 2024-03-30T13:10:33.178 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4be7000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4be00d2df0 con 0x7f4be015eae0 2024-03-30T13:10:33.178 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4bdfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4be015eae0 0x7f4be00d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:33.178 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4bdfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4be015eae0 0x7f4be00d35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60094/0 (socket says 172.21.15.99:60094) 2024-03-30T13:10:33.178 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4bdfe00640 1 -- 172.21.15.99:0/1937552000 learned_addr learned my addr 172.21.15.99:0/1937552000 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:33.178 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4be5000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4be00d1d40 0x7f4be00b7b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35326/0 (socket says 172.21.15.99:35326) 2024-03-30T13:10:33.179 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4bdfe00640 1 -- 172.21.15.99:0/1937552000 >> v1:172.21.15.181:6789/0 conn(0x7f4be00d3b30 legacy=0x7f4be00d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:33.179 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4bdfe00640 1 -- 172.21.15.99:0/1937552000 >> v1:172.21.15.99:6789/0 conn(0x7f4be00d1d40 legacy=0x7f4be00b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:33.180 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4bdfe00640 1 -- 172.21.15.99:0/1937552000 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be00d30d0 con 0x7f4be015eae0 2024-03-30T13:10:33.180 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.174+0000 7f4bdf400640 1 -- 172.21.15.99:0/1937552000 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2012643089 0 0) 0x7f4be00cfd80 con 0x7f4be00d1d40 2024-03-30T13:10:33.180 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.175+0000 7f4bdfe00640 1 --2- 172.21.15.99:0/1937552000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4be015eae0 0x7f4be00d35f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009870 tx=0x7f4bd002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141027a290f3f2b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:33.180 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.176+0000 7f4bdf400640 1 -- 172.21.15.99:0/1937552000 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0034070 con 0x7f4be015eae0 2024-03-30T13:10:33.180 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.176+0000 7f4bdf400640 1 -- 172.21.15.99:0/1937552000 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd0030860 con 0x7f4be015eae0 2024-03-30T13:10:33.180 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.176+0000 7f4bdf400640 1 -- 172.21.15.99:0/1937552000 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0030c30 con 0x7f4be015eae0 2024-03-30T13:10:33.181 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.176+0000 7f4be7000640 1 -- 172.21.15.99:0/1937552000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4be015eae0 msgr2=0x7f4be00d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:33.181 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.176+0000 7f4be7000640 1 --2- 172.21.15.99:0/1937552000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4be015eae0 0x7f4be00d35f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009870 tx=0x7f4bd002b9a0 comp rx=0 tx=0).stop 2024-03-30T13:10:33.181 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.176+0000 7f4be7000640 1 -- 172.21.15.99:0/1937552000 shutdown_connections 2024-03-30T13:10:33.181 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.176+0000 7f4be7000640 1 --2- 172.21.15.99:0/1937552000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4be015eae0 0x7f4be00d35f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:33.181 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.176+0000 7f4be7000640 1 -- 172.21.15.99:0/1937552000 >> 172.21.15.99:0/1937552000 conn(0x7f4be006cd00 msgr2=0x7f4be006d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:33.181 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.176+0000 7f4be7000640 1 -- 172.21.15.99:0/1937552000 shutdown_connections 2024-03-30T13:10:33.181 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.176+0000 7f4be7000640 1 -- 172.21.15.99:0/1937552000 wait complete. 2024-03-30T13:10:33.182 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.178+0000 7f4be7000640 1 Processor -- start 2024-03-30T13:10:33.182 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.178+0000 7f4be7000640 1 -- start start 2024-03-30T13:10:33.184 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.179+0000 7f4be7000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4be00d1d40 0x7f4be015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:33.184 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.179+0000 7f4be7000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4be015eae0 0x7f4be00ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.179+0000 7f4be7000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4be00cc7f0 0x7f4be00ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.179+0000 7f4be7000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4be00d01e0 con 0x7f4be00d1d40 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.179+0000 7f4be7000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4be00d0060 con 0x7f4be00cc7f0 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.179+0000 7f4be7000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4be00b8260 con 0x7f4be015eae0 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.179+0000 7f4bdfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4be00d1d40 0x7f4be015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.179+0000 7f4bdfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4be00d1d40 0x7f4be015aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60098/0 (socket says 172.21.15.99:60098) 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.179+0000 7f4bdfe00640 1 -- 172.21.15.99:0/4166963884 learned_addr learned my addr 172.21.15.99:0/4166963884 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.180+0000 7f4bdfe00640 1 -- 172.21.15.99:0/4166963884 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4be015eae0 msgr2=0x7f4be00ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.180+0000 7f4bdfe00640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4be015eae0 0x7f4be00ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.180+0000 7f4bdfe00640 1 -- 172.21.15.99:0/4166963884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4be00cc7f0 msgr2=0x7f4be00ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.180+0000 7f4bdfe00640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4be00cc7f0 0x7f4be00ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.180+0000 7f4bdfe00640 1 -- 172.21.15.99:0/4166963884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be00ccd60 con 0x7f4be00d1d40 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.180+0000 7f4bdfe00640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4be00d1d40 0x7f4be015aaa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009870 tx=0x7f4bd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:33.185 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.180+0000 7f4bdcc00640 1 -- 172.21.15.99:0/4166963884 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0034040 con 0x7f4be00d1d40 2024-03-30T13:10:33.186 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.180+0000 7f4bdcc00640 1 -- 172.21.15.99:0/4166963884 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd0039d90 con 0x7f4be00d1d40 2024-03-30T13:10:33.186 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.180+0000 7f4bdcc00640 1 -- 172.21.15.99:0/4166963884 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0043610 con 0x7f4be00d1d40 2024-03-30T13:10:33.186 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.180+0000 7f4be7000640 1 -- 172.21.15.99:0/4166963884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be00cd040 con 0x7f4be00d1d40 2024-03-30T13:10:33.186 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.180+0000 7f4be7000640 1 -- 172.21.15.99:0/4166963884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be00cd600 con 0x7f4be00d1d40 2024-03-30T13:10:33.186 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.181+0000 7f4be7000640 1 -- 172.21.15.99:0/4166963884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be00adba0 con 0x7f4be00d1d40 2024-03-30T13:10:33.190 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.182+0000 7f4bdcc00640 1 -- 172.21.15.99:0/4166963884 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) ==== 90800+0+0 (secure 0 0 0) 0x7f4bd004a060 con 0x7f4be00d1d40 2024-03-30T13:10:33.191 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.183+0000 7f4bdcc00640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4bbc06c4a0 0x7f4bbc06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:33.191 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.183+0000 7f4bdcc00640 1 -- 172.21.15.99:0/4166963884 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3351+0+0 (secure 0 0 0) 0x7f4bd00acef0 con 0x7f4be00d1d40 2024-03-30T13:10:33.191 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.183+0000 7f4bd7e00640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4bbc06c4a0 0x7f4bbc06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:33.191 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.184+0000 7f4bd7e00640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4bbc06c4a0 0x7f4bbc06e960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4be00cb370 tx=0x7f4bc8007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:33.192 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.188+0000 7f4bdcc00640 1 -- 172.21.15.99:0/4166963884 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4bd003e070 con 0x7f4be00d1d40 2024-03-30T13:10:33.377 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.373+0000 7f4be7000640 1 -- 172.21.15.99:0/4166963884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4be004f9d0 con 0x7f4be00d1d40 2024-03-30T13:10:33.378 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.375+0000 7f4bdcc00640 1 -- 172.21.15.99:0/4166963884 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9036 (secure 0 0 0) 0x7f4bd0037360 con 0x7f4be00d1d40 2024-03-30T13:10:33.379 INFO:teuthology.misc.health.smithi099.stdout: 2024-03-30T13:10:33.379 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":15,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:32.931063+0000","last_up_change":"2024-03-30T13:10:32.931063+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:10:33.381 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 -- 172.21.15.99:0/4166963884 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4bbc06c4a0 msgr2=0x7f4bbc06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:33.381 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4bbc06c4a0 0x7f4bbc06e960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4be00cb370 tx=0x7f4bc8007990 comp rx=0 tx=0).stop 2024-03-30T13:10:33.381 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 -- 172.21.15.99:0/4166963884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4be00d1d40 msgr2=0x7f4be015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:33.382 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4be00d1d40 0x7f4be015aaa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009870 tx=0x7f4bd00046c0 comp rx=0 tx=0).stop 2024-03-30T13:10:33.382 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 -- 172.21.15.99:0/4166963884 shutdown_connections 2024-03-30T13:10:33.382 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4bbc06c4a0 0x7f4bbc06e960 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:33.382 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4be00cc7f0 0x7f4be00ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:33.382 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4be015eae0 0x7f4be00ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:33.382 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 --2- 172.21.15.99:0/4166963884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4be00d1d40 0x7f4be015aaa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:33.382 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 -- 172.21.15.99:0/4166963884 >> 172.21.15.99:0/4166963884 conn(0x7f4be006cd00 msgr2=0x7f4be00b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:33.382 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 -- 172.21.15.99:0/4166963884 shutdown_connections 2024-03-30T13:10:33.382 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:33.377+0000 7f4be7000640 1 -- 172.21.15.99:0/4166963884 wait complete. 2024-03-30T13:10:33.394 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-03-30T13:10:40.202 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T13:10:40.383 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.379+0000 7fb9b2400640 1 Processor -- start 2024-03-30T13:10:40.384 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.380+0000 7fb9b2400640 1 -- start start 2024-03-30T13:10:40.385 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.381+0000 7fb9b2400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb9ac06f200 0x7fb9ac0cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:40.385 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.381+0000 7fb9b2400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ac145100 con 0x7fb9ac0cf770 2024-03-30T13:10:40.385 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.381+0000 7fb9b2400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ac0cffa0 con 0x7fb9ac144d20 2024-03-30T13:10:40.385 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.381+0000 7fb9b2400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ac0719c0 con 0x7fb9ac06f200 2024-03-30T13:10:40.386 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.381+0000 7fb9a2a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb9ac06f200 0x7fb9ac0cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:40.386 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.381+0000 7fb9abe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb9ac0cf770 0x7fb9ac0b3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45988/0 (socket says 172.21.15.99:45988) 2024-03-30T13:10:40.386 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.381+0000 7fb9abe00640 1 -- 172.21.15.99:0/1777087817 learned_addr learned my addr 172.21.15.99:0/1777087817 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:40.386 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.382+0000 7fb9a2a00640 1 -- 172.21.15.99:0/1777087817 >> v1:172.21.15.181:6789/0 conn(0x7fb9ac144d20 legacy=0x7fb9ac06eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:40.386 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.382+0000 7fb9a2a00640 1 -- 172.21.15.99:0/1777087817 >> v1:172.21.15.99:6789/0 conn(0x7fb9ac0cf770 legacy=0x7fb9ac0b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:40.386 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.382+0000 7fb9a2a00640 1 -- 172.21.15.99:0/1777087817 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac071c10 con 0x7fb9ac06f200 2024-03-30T13:10:40.387 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.382+0000 7fb9aaa00640 1 -- 172.21.15.99:0/1777087817 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479872050 0 0) 0x7fb9ac145100 con 0x7fb9ac0cf770 2024-03-30T13:10:40.387 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.383+0000 7fb9a2a00640 1 --2- 172.21.15.99:0/1777087817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac06f200 0x7fb9ac0cf230 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac071b40 tx=0x7fb99402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95095283d9edca93 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:40.387 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.383+0000 7fb9aaa00640 1 -- 172.21.15.99:0/1777087817 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994035020 con 0x7fb9ac06f200 2024-03-30T13:10:40.387 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.383+0000 7fb9aaa00640 1 -- 172.21.15.99:0/1777087817 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb994031830 con 0x7fb9ac06f200 2024-03-30T13:10:40.387 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.383+0000 7fb9aaa00640 1 -- 172.21.15.99:0/1777087817 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994031c00 con 0x7fb9ac06f200 2024-03-30T13:10:40.388 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.384+0000 7fb9b2400640 1 -- 172.21.15.99:0/1777087817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac06f200 msgr2=0x7fb9ac0cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:40.388 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.384+0000 7fb9b2400640 1 --2- 172.21.15.99:0/1777087817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac06f200 0x7fb9ac0cf230 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac071b40 tx=0x7fb99402b8d0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.388 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.384+0000 7fb9b2400640 1 -- 172.21.15.99:0/1777087817 shutdown_connections 2024-03-30T13:10:40.388 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.384+0000 7fb9b2400640 1 --2- 172.21.15.99:0/1777087817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac06f200 0x7fb9ac0cf230 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.389 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.384+0000 7fb9b2400640 1 -- 172.21.15.99:0/1777087817 >> 172.21.15.99:0/1777087817 conn(0x7fb9ac074a70 msgr2=0x7fb9ac06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:40.389 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.384+0000 7fb9b2400640 1 -- 172.21.15.99:0/1777087817 shutdown_connections 2024-03-30T13:10:40.389 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.384+0000 7fb9b2400640 1 -- 172.21.15.99:0/1777087817 wait complete. 2024-03-30T13:10:40.390 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.386+0000 7fb9b2400640 1 Processor -- start 2024-03-30T13:10:40.390 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.386+0000 7fb9b2400640 1 -- start start 2024-03-30T13:10:40.392 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.387+0000 7fb9b2400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac06f200 0x7fb9ac0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:40.393 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.387+0000 7fb9b2400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac0cf770 0x7fb9ac15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:40.393 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.387+0000 7fb9b2400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac144d20 0x7fb9ac0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:40.393 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.387+0000 7fb9b2400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac0cfbb0 con 0x7fb9ac06f200 2024-03-30T13:10:40.393 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.387+0000 7fb9b2400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac072260 con 0x7fb9ac0cf770 2024-03-30T13:10:40.393 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.387+0000 7fb9b2400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb9ac0cfd30 con 0x7fb9ac144d20 2024-03-30T13:10:40.393 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.387+0000 7fb9ab400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac06f200 0x7fb9ac0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:40.393 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.387+0000 7fb9ab400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac06f200 0x7fb9ac0c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47334/0 (socket says 172.21.15.99:47334) 2024-03-30T13:10:40.393 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.387+0000 7fb9ab400640 1 -- 172.21.15.99:0/2574990553 learned_addr learned my addr 172.21.15.99:0/2574990553 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:40.393 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.388+0000 7fb9ab400640 1 -- 172.21.15.99:0/2574990553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac144d20 msgr2=0x7fb9ac0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:40.394 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.388+0000 7fb9ab400640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac144d20 0x7fb9ac0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.394 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.388+0000 7fb9ab400640 1 -- 172.21.15.99:0/2574990553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac0cf770 msgr2=0x7fb9ac15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:40.394 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.388+0000 7fb9ab400640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac0cf770 0x7fb9ac15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.394 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.388+0000 7fb9ab400640 1 -- 172.21.15.99:0/2574990553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac0c7170 con 0x7fb9ac06f200 2024-03-30T13:10:40.394 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.388+0000 7fb9ab400640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac06f200 0x7fb9ac0c6170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00ba80 tx=0x7fb99c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:40.394 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.388+0000 7fb9a3e00640 1 -- 172.21.15.99:0/2574990553 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c00cc00 con 0x7fb9ac06f200 2024-03-30T13:10:40.394 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.388+0000 7fb9a3e00640 1 -- 172.21.15.99:0/2574990553 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99c00cda0 con 0x7fb9ac06f200 2024-03-30T13:10:40.394 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.388+0000 7fb9a3e00640 1 -- 172.21.15.99:0/2574990553 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c003bb0 con 0x7fb9ac06f200 2024-03-30T13:10:40.394 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.388+0000 7fb9b2400640 1 -- 172.21.15.99:0/2574990553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ac0c53b0 con 0x7fb9ac06f200 2024-03-30T13:10:40.394 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.388+0000 7fb9b2400640 1 -- 172.21.15.99:0/2574990553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ac0c5970 con 0x7fb9ac06f200 2024-03-30T13:10:40.395 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.389+0000 7fb9b2400640 1 -- 172.21.15.99:0/2574990553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ac073370 con 0x7fb9ac06f200 2024-03-30T13:10:40.395 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.390+0000 7fb9a3e00640 1 -- 172.21.15.99:0/2574990553 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb99c014440 con 0x7fb9ac06f200 2024-03-30T13:10:40.395 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.391+0000 7fb9a3e00640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb98806c530 0x7fb98806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:40.395 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.391+0000 7fb9a3e00640 1 -- 172.21.15.99:0/2574990553 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fb99c08b370 con 0x7fb9ac06f200 2024-03-30T13:10:40.395 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.392+0000 7fb9a2a00640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb98806c530 0x7fb98806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:40.396 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.392+0000 7fb9a2a00640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb98806c530 0x7fb98806e9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb994036000 tx=0x7fb994030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:40.400 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.397+0000 7fb9a3e00640 1 -- 172.21.15.99:0/2574990553 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb99c059cd0 con 0x7fb9ac06f200 2024-03-30T13:10:40.601 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.597+0000 7fb9b2400640 1 -- 172.21.15.99:0/2574990553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9ac04f9d0 con 0x7fb9ac06f200 2024-03-30T13:10:40.602 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.599+0000 7fb9a3e00640 1 -- 172.21.15.99:0/2574990553 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12884 (secure 0 0 0) 0x7fb99c0595d0 con 0x7fb9ac06f200 2024-03-30T13:10:40.603 INFO:teuthology.misc.health.smithi099.stdout: 2024-03-30T13:10:40.603 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":18,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:35.966755+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.601+0000 7fb9b2400640 1 -- 172.21.15.99:0/2574990553 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb98806c530 msgr2=0x7fb98806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.601+0000 7fb9b2400640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb98806c530 0x7fb98806e9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb994036000 tx=0x7fb994030000 comp rx=0 tx=0).stop 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.601+0000 7fb9b2400640 1 -- 172.21.15.99:0/2574990553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac06f200 msgr2=0x7fb9ac0c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.601+0000 7fb9b2400640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac06f200 0x7fb9ac0c6170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00ba80 tx=0x7fb99c00bf40 comp rx=0 tx=0).stop 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.601+0000 7fb9b2400640 1 -- 172.21.15.99:0/2574990553 shutdown_connections 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.601+0000 7fb9b2400640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb98806c530 0x7fb98806e9f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.601+0000 7fb9b2400640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac144d20 0x7fb9ac0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.601+0000 7fb9b2400640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac0cf770 0x7fb9ac15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.601+0000 7fb9b2400640 1 --2- 172.21.15.99:0/2574990553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac06f200 0x7fb9ac0c6170 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.601+0000 7fb9b2400640 1 -- 172.21.15.99:0/2574990553 >> 172.21.15.99:0/2574990553 conn(0x7fb9ac074a70 msgr2=0x7fb9ac0af6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.601+0000 7fb9b2400640 1 -- 172.21.15.99:0/2574990553 shutdown_connections 2024-03-30T13:10:40.606 INFO:teuthology.misc.health.smithi099.stderr:2024-03-30T13:10:40.602+0000 7fb9b2400640 1 -- 172.21.15.99:0/2574990553 wait complete. 2024-03-30T13:10:40.620 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-30T13:10:40.620 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-30T13:10:40.620 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-30T13:10:40.620 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-30T13:10:40.627 INFO:tasks.ceph.mds.a:Started 2024-03-30T13:10:40.627 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-30T13:10:40.627 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-30T13:10:40.634 INFO:tasks.ceph.mds.c:Started 2024-03-30T13:10:40.634 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-30T13:10:40.634 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-30T13:10:40.642 INFO:tasks.ceph.mds.b:Started 2024-03-30T13:10:40.642 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-30T13:10:40.642 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-30T13:10:40.650 INFO:tasks.ceph.mds.d:Started 2024-03-30T13:10:40.650 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-30T13:10:40.650 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:10:40.780 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-03-30T13:10:40.788 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-03-30T13:10:40.802 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-03-30T13:10:40.804 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-03-30T13:10:40.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.830+0000 7f6ed4200640 1 Processor -- start 2024-03-30T13:10:40.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.831+0000 7f6ed4200640 1 -- start start 2024-03-30T13:10:40.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ed4200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ecc0d4e20 0x7f6ecc162d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:40.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ed4200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ecc0cf390 con 0x7f6ecc15f9d0 2024-03-30T13:10:40.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ed4200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ecc0cf630 con 0x7f6ecc0d1150 2024-03-30T13:10:40.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ed4200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6ecc0d06d0 con 0x7f6ecc0d4e20 2024-03-30T13:10:40.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ed2200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ecc0d4e20 0x7f6ecc162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:40.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ed0e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6ecc15f9d0 0x7f6ecc0d2940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46018/0 (socket says 172.21.15.99:46018) 2024-03-30T13:10:40.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ed2200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ecc0d4e20 0x7f6ecc162d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47358/0 (socket says 172.21.15.99:47358) 2024-03-30T13:10:40.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ed0e00640 1 -- 172.21.15.99:0/1284580218 learned_addr learned my addr 172.21.15.99:0/1284580218 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:40.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ed2200640 1 -- 172.21.15.99:0/1284580218 >> v1:172.21.15.181:6789/0 conn(0x7f6ecc0d1150 legacy=0x7f6ecc0d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:40.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ed2200640 1 -- 172.21.15.99:0/1284580218 >> v1:172.21.15.99:6789/0 conn(0x7f6ecc15f9d0 legacy=0x7f6ecc0d2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:40.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ed2200640 1 -- 172.21.15.99:0/1284580218 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ecc0cf910 con 0x7f6ecc0d4e20 2024-03-30T13:10:40.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.832+0000 7f6ecbe00640 1 -- 172.21.15.99:0/1284580218 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3470436417 0 0) 0x7f6ecc0cf390 con 0x7f6ecc15f9d0 2024-03-30T13:10:40.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.833+0000 7f6ed2200640 1 --2- 172.21.15.99:0/1284580218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ecc0d4e20 0x7f6ecc162d30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009d90 tx=0x7f6ec402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95640b34e0a9c11a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:40.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.834+0000 7f6ecbe00640 1 -- 172.21.15.99:0/1284580218 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4039070 con 0x7f6ecc0d4e20 2024-03-30T13:10:40.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.834+0000 7f6ecbe00640 1 -- 172.21.15.99:0/1284580218 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec402cc60 con 0x7f6ecc0d4e20 2024-03-30T13:10:40.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.834+0000 7f6ecbe00640 1 -- 172.21.15.99:0/1284580218 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4034660 con 0x7f6ecc0d4e20 2024-03-30T13:10:40.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.834+0000 7f6ed4200640 1 -- 172.21.15.99:0/1284580218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ecc0d4e20 msgr2=0x7f6ecc162d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:40.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.834+0000 7f6ed4200640 1 --2- 172.21.15.99:0/1284580218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ecc0d4e20 0x7f6ecc162d30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009d90 tx=0x7f6ec402beb0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.834+0000 7f6ed4200640 1 -- 172.21.15.99:0/1284580218 shutdown_connections 2024-03-30T13:10:40.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.834+0000 7f6ed4200640 1 --2- 172.21.15.99:0/1284580218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ecc0d4e20 0x7f6ecc162d30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.834+0000 7f6ed4200640 1 -- 172.21.15.99:0/1284580218 >> 172.21.15.99:0/1284580218 conn(0x7f6ecc08bfc0 msgr2=0x7f6ecc0d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:40.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.834+0000 7f6ed4200640 1 -- 172.21.15.99:0/1284580218 shutdown_connections 2024-03-30T13:10:40.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.834+0000 7f6ed4200640 1 -- 172.21.15.99:0/1284580218 wait complete. 2024-03-30T13:10:40.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.836+0000 7f6ed4200640 1 Processor -- start 2024-03-30T13:10:40.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.836+0000 7f6ed4200640 1 -- start start 2024-03-30T13:10:40.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed4200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ecc0d1150 0x7f6ecc152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:40.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed4200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ecc0d4e20 0x7f6ecc0b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:40.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed4200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ecc15f9d0 0x7f6ecc0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:40.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed4200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc0cfed0 con 0x7f6ecc0d1150 2024-03-30T13:10:40.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed4200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc0d0240 con 0x7f6ecc15f9d0 2024-03-30T13:10:40.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed4200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6ecc0d1530 con 0x7f6ecc0d4e20 2024-03-30T13:10:40.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed1800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ecc0d1150 0x7f6ecc152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed1800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ecc0d1150 0x7f6ecc152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47374/0 (socket says 172.21.15.99:47374) 2024-03-30T13:10:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed1800640 1 -- 172.21.15.99:0/2298372776 learned_addr learned my addr 172.21.15.99:0/2298372776 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed1800640 1 -- 172.21.15.99:0/2298372776 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ecc0d4e20 msgr2=0x7f6ecc0b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed1800640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ecc0d4e20 0x7f6ecc0b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed1800640 1 -- 172.21.15.99:0/2298372776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ecc15f9d0 msgr2=0x7f6ecc0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed1800640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ecc15f9d0 0x7f6ecc0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.837+0000 7f6ed1800640 1 -- 172.21.15.99:0/2298372776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ecc0ccc40 con 0x7f6ecc0d1150 2024-03-30T13:10:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.838+0000 7f6ed1800640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ecc0d1150 0x7f6ecc152be0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c430 tx=0x7f6ec000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.838+0000 7f6ec9600640 1 -- 172.21.15.99:0/2298372776 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0011790 con 0x7f6ecc0d1150 2024-03-30T13:10:40.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.838+0000 7f6ec9600640 1 -- 172.21.15.99:0/2298372776 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec0017070 con 0x7f6ecc0d1150 2024-03-30T13:10:40.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.838+0000 7f6ed4200640 1 -- 172.21.15.99:0/2298372776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ecc0ccf20 con 0x7f6ecc0d1150 2024-03-30T13:10:40.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.838+0000 7f6ec9600640 1 -- 172.21.15.99:0/2298372776 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0011bb0 con 0x7f6ecc0d1150 2024-03-30T13:10:40.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.838+0000 7f6ed4200640 1 -- 172.21.15.99:0/2298372776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ecc0cd4e0 con 0x7f6ecc0d1150 2024-03-30T13:10:40.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.839+0000 7f6ed4200640 1 -- 172.21.15.99:0/2298372776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ecc068640 con 0x7f6ecc0d1150 2024-03-30T13:10:40.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.840+0000 7f6ec9600640 1 -- 172.21.15.99:0/2298372776 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6ec001c460 con 0x7f6ecc0d1150 2024-03-30T13:10:40.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.841+0000 7f6ec9600640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6eac06c530 0x7f6eac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:40.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.841+0000 7f6ec9600640 1 -- 172.21.15.99:0/2298372776 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f6ec008b220 con 0x7f6ecc0d1150 2024-03-30T13:10:40.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.841+0000 7f6ed0e00640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6eac06c530 0x7f6eac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:40.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.841+0000 7f6ed0e00640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6eac06c530 0x7f6eac06e9f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8007fd0 tx=0x7f6eb8007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:40.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:40.845+0000 7f6ec9600640 1 -- 172.21.15.99:0/2298372776 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6ec0059b90 con 0x7f6ecc0d1150 2024-03-30T13:10:41.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.047+0000 7f6ed4200640 1 -- 172.21.15.99:0/2298372776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ecc0d1e10 con 0x7f6ecc0d1150 2024-03-30T13:10:41.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.050+0000 7f6ec9600640 1 -- 172.21.15.99:0/2298372776 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12884 (secure 0 0 0) 0x7f6ec0059490 con 0x7f6ecc0d1150 2024-03-30T13:10:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:41.054 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":18,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:35.966755+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:10:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.052+0000 7f6ed4200640 1 -- 172.21.15.99:0/2298372776 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6eac06c530 msgr2=0x7f6eac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.052+0000 7f6ed4200640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6eac06c530 0x7f6eac06e9f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8007fd0 tx=0x7f6eb8007960 comp rx=0 tx=0).stop 2024-03-30T13:10:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.052+0000 7f6ed4200640 1 -- 172.21.15.99:0/2298372776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ecc0d1150 msgr2=0x7f6ecc152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.052+0000 7f6ed4200640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ecc0d1150 0x7f6ecc152be0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c430 tx=0x7f6ec000c8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.053+0000 7f6ed4200640 1 -- 172.21.15.99:0/2298372776 shutdown_connections 2024-03-30T13:10:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.053+0000 7f6ed4200640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6eac06c530 0x7f6eac06e9f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.053+0000 7f6ed4200640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ecc15f9d0 0x7f6ecc0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.053+0000 7f6ed4200640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ecc0d4e20 0x7f6ecc0b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.053+0000 7f6ed4200640 1 --2- 172.21.15.99:0/2298372776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ecc0d1150 0x7f6ecc152be0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.053+0000 7f6ed4200640 1 -- 172.21.15.99:0/2298372776 >> 172.21.15.99:0/2298372776 conn(0x7f6ecc08bfc0 msgr2=0x7f6ecc0b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:41.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.053+0000 7f6ed4200640 1 -- 172.21.15.99:0/2298372776 shutdown_connections 2024-03-30T13:10:41.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.053+0000 7f6ed4200640 1 -- 172.21.15.99:0/2298372776 wait complete. 2024-03-30T13:10:41.075 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:10:41.075 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:10:41.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.276+0000 7fb1f3a00640 1 Processor -- start 2024-03-30T13:10:41.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.276+0000 7fb1f3a00640 1 -- start start 2024-03-30T13:10:41.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.278+0000 7fb1f3a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec162e50 0x7fb1ec099730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.278+0000 7fb1f3a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb1ec0cddb0 0x7fb1ec0ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.278+0000 7fb1f3a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ec0c56e0 con 0x7fb1ec099c70 2024-03-30T13:10:41.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.278+0000 7fb1f3a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb1ec0c59c0 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.278+0000 7fb1f3a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ec0c5ca0 con 0x7fb1ec162e50 2024-03-30T13:10:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.279+0000 7fb1f1000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec162e50 0x7fb1ec099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.279+0000 7fb1f1000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec162e50 0x7fb1ec099730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:46058/0 (socket says 172.21.15.99:46058) 2024-03-30T13:10:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.279+0000 7fb1f1000640 1 -- 172.21.15.99:0/3753060734 learned_addr learned my addr 172.21.15.99:0/3753060734 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.279+0000 7fb1f1a00640 1 --2- 172.21.15.99:0/3753060734 >> v2:172.21.15.181:3300/0 conn(0x7fb1ec0cddb0 0x7fb1ec0ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.280+0000 7fb1f1000640 1 -- 172.21.15.99:0/3753060734 >> v2:172.21.15.181:3300/0 conn(0x7fb1ec0cddb0 msgr2=0x7fb1ec0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.280+0000 7fb1f1000640 1 --2- 172.21.15.99:0/3753060734 >> v2:172.21.15.181:3300/0 conn(0x7fb1ec0cddb0 0x7fb1ec0ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.280+0000 7fb1f1000640 1 -- 172.21.15.99:0/3753060734 >> v1:172.21.15.181:6789/0 conn(0x7fb1ec099c70 legacy=0x7fb1ec0c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.280+0000 7fb1f1000640 1 -- 172.21.15.99:0/3753060734 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ec0c5f80 con 0x7fb1ec162e50 2024-03-30T13:10:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.280+0000 7fb1ebe00640 1 -- 172.21.15.99:0/3753060734 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98410051 0 0) 0x7fb1ec0c56e0 con 0x7fb1ec099c70 2024-03-30T13:10:41.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.281+0000 7fb1f1000640 1 --2- 172.21.15.99:0/3753060734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec162e50 0x7fb1ec099730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009870 tx=0x7fb1dc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e319d269dc760a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.281+0000 7fb1ebe00640 1 -- 172.21.15.99:0/3753060734 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc035020 con 0x7fb1ec162e50 2024-03-30T13:10:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.281+0000 7fb1ebe00640 1 -- 172.21.15.99:0/3753060734 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1dc031640 con 0x7fb1ec162e50 2024-03-30T13:10:41.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.281+0000 7fb1ebe00640 1 -- 172.21.15.99:0/3753060734 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc02d040 con 0x7fb1ec162e50 2024-03-30T13:10:41.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.282+0000 7fb1f3a00640 1 -- 172.21.15.99:0/3753060734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec162e50 msgr2=0x7fb1ec099730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.282+0000 7fb1f3a00640 1 --2- 172.21.15.99:0/3753060734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec162e50 0x7fb1ec099730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009870 tx=0x7fb1dc02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.282+0000 7fb1f3a00640 1 -- 172.21.15.99:0/3753060734 shutdown_connections 2024-03-30T13:10:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.282+0000 7fb1f3a00640 1 --2- 172.21.15.99:0/3753060734 >> v2:172.21.15.181:3300/0 conn(0x7fb1ec0cddb0 0x7fb1ec0ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.282+0000 7fb1f3a00640 1 --2- 172.21.15.99:0/3753060734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec162e50 0x7fb1ec099730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.282+0000 7fb1f3a00640 1 -- 172.21.15.99:0/3753060734 >> 172.21.15.99:0/3753060734 conn(0x7fb1ec0d0450 msgr2=0x7fb1ec0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.282+0000 7fb1f3a00640 1 -- 172.21.15.99:0/3753060734 shutdown_connections 2024-03-30T13:10:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.282+0000 7fb1f3a00640 1 -- 172.21.15.99:0/3753060734 wait complete. 2024-03-30T13:10:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.284+0000 7fb1f3a00640 1 Processor -- start 2024-03-30T13:10:41.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.284+0000 7fb1f3a00640 1 -- start start 2024-03-30T13:10:41.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.285+0000 7fb1f3a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec099c70 0x7fb1ec15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.285+0000 7fb1f3a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1ec0cddb0 0x7fb1ec072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.285+0000 7fb1f3a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1ec162e50 0x7fb1ec0730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.285+0000 7fb1f3a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec0cfd70 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.285+0000 7fb1f3a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec0c6e90 con 0x7fb1ec162e50 2024-03-30T13:10:41.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.285+0000 7fb1f3a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ec0cfef0 con 0x7fb1ec099c70 2024-03-30T13:10:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.286+0000 7fb1e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1ec0cddb0 0x7fb1ec072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.286+0000 7fb1e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1ec0cddb0 0x7fb1ec072bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47378/0 (socket says 172.21.15.99:47378) 2024-03-30T13:10:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.286+0000 7fb1e3e00640 1 -- 172.21.15.99:0/1857105051 learned_addr learned my addr 172.21.15.99:0/1857105051 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.286+0000 7fb1f1000640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec099c70 0x7fb1ec15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.286+0000 7fb1f1a00640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1ec162e50 0x7fb1ec0730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.286+0000 7fb1e3e00640 1 -- 172.21.15.99:0/1857105051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec099c70 msgr2=0x7fb1ec15c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.286+0000 7fb1e3e00640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec099c70 0x7fb1ec15c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.286+0000 7fb1e3e00640 1 -- 172.21.15.99:0/1857105051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1ec162e50 msgr2=0x7fb1ec0730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.286+0000 7fb1e3e00640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1ec162e50 0x7fb1ec0730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.286+0000 7fb1e3e00640 1 -- 172.21.15.99:0/1857105051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ec160a60 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.287+0000 7fb1e3e00640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1ec0cddb0 0x7fb1ec072bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400c520 tx=0x7fb1d400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.287+0000 7fb1e9600640 1 -- 172.21.15.99:0/1857105051 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4017070 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.287+0000 7fb1e9600640 1 -- 172.21.15.99:0/1857105051 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d40035f0 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.287+0000 7fb1e9600640 1 -- 172.21.15.99:0/1857105051 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40039e0 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.287+0000 7fb1f3a00640 1 -- 172.21.15.99:0/1857105051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ec160d40 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.287+0000 7fb1f3a00640 1 -- 172.21.15.99:0/1857105051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ec161300 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.288+0000 7fb1f3a00640 1 -- 172.21.15.99:0/1857105051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1ec09e520 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.289+0000 7fb1e9600640 1 -- 172.21.15.99:0/1857105051 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb1d401a070 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.290+0000 7fb1e9600640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb1c806c530 0x7fb1c806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.290+0000 7fb1e9600640 1 -- 172.21.15.99:0/1857105051 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fb1d408a810 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.290+0000 7fb1f1000640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb1c806c530 0x7fb1c806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.291+0000 7fb1f1000640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb1c806c530 0x7fb1c806e9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc036000 tx=0x7fb1dc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.295+0000 7fb1e9600640 1 -- 172.21.15.99:0/1857105051 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb1d4059170 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.493+0000 7fb1f3a00640 1 -- 172.21.15.99:0/1857105051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb1ec06f3f0 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.494+0000 7fb1e9600640 1 -- 172.21.15.99:0/1857105051 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7fb1d4058a70 con 0x7fb1ec0cddb0 2024-03-30T13:10:41.498 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.497+0000 7fb1f3a00640 1 -- 172.21.15.99:0/1857105051 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb1c806c530 msgr2=0x7fb1c806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.497+0000 7fb1f3a00640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb1c806c530 0x7fb1c806e9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc036000 tx=0x7fb1dc03c040 comp rx=0 tx=0).stop 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.497+0000 7fb1f3a00640 1 -- 172.21.15.99:0/1857105051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1ec0cddb0 msgr2=0x7fb1ec072bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.497+0000 7fb1f3a00640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1ec0cddb0 0x7fb1ec072bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400c520 tx=0x7fb1d400c9e0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.497+0000 7fb1f3a00640 1 -- 172.21.15.99:0/1857105051 shutdown_connections 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.497+0000 7fb1f3a00640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb1c806c530 0x7fb1c806e9f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.497+0000 7fb1f3a00640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1ec162e50 0x7fb1ec0730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.497+0000 7fb1f3a00640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1ec0cddb0 0x7fb1ec072bb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.497+0000 7fb1f3a00640 1 --2- 172.21.15.99:0/1857105051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1ec099c70 0x7fb1ec15c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.497+0000 7fb1f3a00640 1 -- 172.21.15.99:0/1857105051 >> 172.21.15.99:0/1857105051 conn(0x7fb1ec0d0450 msgr2=0x7fb1ec0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.497+0000 7fb1f3a00640 1 -- 172.21.15.99:0/1857105051 shutdown_connections 2024-03-30T13:10:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.498+0000 7fb1f3a00640 1 -- 172.21.15.99:0/1857105051 wait complete. 2024-03-30T13:10:41.518 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:10:41.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.714+0000 7f4fe3800640 1 Processor -- start 2024-03-30T13:10:41.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.714+0000 7f4fe3800640 1 -- start start 2024-03-30T13:10:41.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.716+0000 7f4fe3800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc0d1150 0x7f4fdc162d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.716+0000 7f4fe3800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4fdc0d4e20 0x7f4fdc0d2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.716+0000 7f4fe3800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fdc0cf390 con 0x7f4fdc0d1530 2024-03-30T13:10:41.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.716+0000 7f4fe3800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4fdc0d06d0 con 0x7f4fdc0d4e20 2024-03-30T13:10:41.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.716+0000 7f4fe3800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4fdc0d0240 con 0x7f4fdc0d1150 2024-03-30T13:10:41.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.716+0000 7f4fe1800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4fdc0d1530 0x7f4fdc0d2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46032/0 (socket says 172.21.15.99:46032) 2024-03-30T13:10:41.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.716+0000 7f4fe1800640 1 -- 172.21.15.99:0/3973834628 learned_addr learned my addr 172.21.15.99:0/3973834628 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:41.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fe0e00640 1 --2- 172.21.15.99:0/3973834628 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc0d1150 0x7f4fdc162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2615694166 0 0) 0x7f4fdc0cf390 con 0x7f4fdc0d1530 2024-03-30T13:10:41.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc0003520 con 0x7f4fdc0d1530 2024-03-30T13:10:41.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdbe00640 1 --2- 172.21.15.99:0/3973834628 >> v2:172.21.15.181:3300/0 conn(0x7f4fdc0d4e20 0x7f4fdc0d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1712697747 0 0) 0x7f4fc0003520 con 0x7f4fdc0d1530 2024-03-30T13:10:41.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc0d1150 msgr2=0x7f4fdc162d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:41.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 --2- 172.21.15.99:0/3973834628 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc0d1150 0x7f4fdc162d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 >> v2:172.21.15.181:3300/0 conn(0x7f4fdc0d4e20 msgr2=0x7f4fdc0d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:41.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 --2- 172.21.15.99:0/3973834628 >> v2:172.21.15.181:3300/0 conn(0x7f4fdc0d4e20 0x7f4fdc0d2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc0cf630 con 0x7f4fdc0d1530 2024-03-30T13:10:41.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f4fd40019f0 con 0x7f4fdc0d1530 2024-03-30T13:10:41.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 >> v1:172.21.15.99:6789/0 conn(0x7f4fdc0d1530 legacy=0x7f4fdc0d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 --2- 172.21.15.99:0/3973834628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fc00039b0 0x7f4fc0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 --2- 172.21.15.99:0/3973834628 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc0d1150 0x7f4fc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 --2- 172.21.15.99:0/3973834628 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fc0004d40 0x7f4fc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0d06d0 con 0x7f4fc00039b0 2024-03-30T13:10:41.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0d0240 con 0x7f4fc0004d40 2024-03-30T13:10:41.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc000baf0 con 0x7f4fdc0d1150 2024-03-30T13:10:41.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.717+0000 7f4fe0e00640 1 --2- 172.21.15.99:0/3973834628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fc00039b0 0x7f4fc0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.718+0000 7f4fe0e00640 1 -- 172.21.15.99:0/3973834628 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc0d1150 msgr2=0x7f4fc0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:41.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.718+0000 7f4fe0e00640 1 --2- 172.21.15.99:0/3973834628 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc0d1150 0x7f4fc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.718+0000 7f4fe0e00640 1 -- 172.21.15.99:0/3973834628 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fc0004d40 msgr2=0x7f4fc00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:41.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.718+0000 7f4fe0e00640 1 --2- 172.21.15.99:0/3973834628 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fc0004d40 0x7f4fc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.718+0000 7f4fe0e00640 1 -- 172.21.15.99:0/3973834628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc0003520 con 0x7f4fc00039b0 2024-03-30T13:10:41.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.719+0000 7f4fe0e00640 1 --2- 172.21.15.99:0/3973834628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fc00039b0 0x7f4fc0003dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00ba30 tx=0x7f4fc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9eb4d276682f3f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:41.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.719+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc036020 con 0x7f4fc00039b0 2024-03-30T13:10:41.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.719+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fcc032680 con 0x7f4fc00039b0 2024-03-30T13:10:41.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.719+0000 7f4fdb400640 1 -- 172.21.15.99:0/3973834628 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc00b600 con 0x7f4fc00039b0 2024-03-30T13:10:41.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.719+0000 7f4fe3800640 1 -- 172.21.15.99:0/3973834628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fc00039b0 msgr2=0x7f4fc0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.719+0000 7f4fe3800640 1 --2- 172.21.15.99:0/3973834628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fc00039b0 0x7f4fc0003dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00ba30 tx=0x7f4fc0005830 comp rx=0 tx=0).stop 2024-03-30T13:10:41.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.719+0000 7f4fe1800640 1 -- 172.21.15.99:0/3973834628 reap_dead start 2024-03-30T13:10:41.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.719+0000 7f4fe3800640 1 -- 172.21.15.99:0/3973834628 shutdown_connections 2024-03-30T13:10:41.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.719+0000 7f4fe3800640 1 -- 172.21.15.99:0/3973834628 >> 172.21.15.99:0/3973834628 conn(0x7f4fdc08bfc0 msgr2=0x7f4fdc0d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:41.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.720+0000 7f4fe3800640 1 -- 172.21.15.99:0/3973834628 shutdown_connections 2024-03-30T13:10:41.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.720+0000 7f4fe3800640 1 -- 172.21.15.99:0/3973834628 wait complete. 2024-03-30T13:10:41.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.721+0000 7f4fe3800640 1 Processor -- start 2024-03-30T13:10:41.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.721+0000 7f4fe3800640 1 -- start start 2024-03-30T13:10:41.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.722+0000 7f4fe3800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fc00039b0 0x7f4fdc0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.722+0000 7f4fe3800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fdc0c8a40 0x7f4fdc156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.722+0000 7f4fe3800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc1613d0 0x7f4fdc161850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.722+0000 7f4fe3800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0cfed0 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.722+0000 7f4fe3800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0cfbf0 con 0x7f4fc00039b0 2024-03-30T13:10:41.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.722+0000 7f4fe3800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4fdc15f9d0 con 0x7f4fdc1613d0 2024-03-30T13:10:41.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fdbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fdc0c8a40 0x7f4fdc156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fdbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fdc0c8a40 0x7f4fdc156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47386/0 (socket says 172.21.15.99:47386) 2024-03-30T13:10:41.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fdbe00640 1 -- 172.21.15.99:0/799843486 learned_addr learned my addr 172.21.15.99:0/799843486 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:41.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fe1800640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc1613d0 0x7f4fdc161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fdbe00640 1 -- 172.21.15.99:0/799843486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc1613d0 msgr2=0x7f4fdc161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fdbe00640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc1613d0 0x7f4fdc161850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fe0e00640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fc00039b0 0x7f4fdc0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fdbe00640 1 -- 172.21.15.99:0/799843486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fc00039b0 msgr2=0x7f4fdc0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fdbe00640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fc00039b0 0x7f4fdc0c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fdbe00640 1 -- 172.21.15.99:0/799843486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc1f8350 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fe1800640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc1613d0 0x7f4fdc161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:41.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fdbe00640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fdc0c8a40 0x7f4fdc156230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800d800 tx=0x7f4fc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:41.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.723+0000 7f4fd8c00640 1 -- 172.21.15.99:0/799843486 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800b660 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.724+0000 7f4fd8c00640 1 -- 172.21.15.99:0/799843486 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc8019070 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.724+0000 7f4fe3800640 1 -- 172.21.15.99:0/799843486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc0c8ec0 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.724+0000 7f4fd8c00640 1 -- 172.21.15.99:0/799843486 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800ba40 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.724+0000 7f4fe3800640 1 -- 172.21.15.99:0/799843486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc1f88a0 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.725+0000 7f4fe3800640 1 -- 172.21.15.99:0/799843486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc068640 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.726+0000 7f4fd8c00640 1 -- 172.21.15.99:0/799843486 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4fc800bbe0 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.726+0000 7f4fd8c00640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4fbc06c530 0x7f4fbc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:41.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.727+0000 7f4fd8c00640 1 -- 172.21.15.99:0/799843486 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f4fc808b780 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.727+0000 7f4fe0e00640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4fbc06c530 0x7f4fbc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:41.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.727+0000 7f4fe0e00640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4fbc06c530 0x7f4fbc06e9f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00ba00 tx=0x7f4fcc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:41.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.731+0000 7f4fd8c00640 1 -- 172.21.15.99:0/799843486 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4fc805a050 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.954+0000 7f4fe3800640 1 -- 172.21.15.99:0/799843486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fdc0d5570 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.955+0000 7f4fd8c00640 1 -- 172.21.15.99:0/799843486 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7f4fc8059950 con 0x7f4fdc0c8a40 2024-03-30T13:10:41.959 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:41.959 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2695284429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2695284429},{"type":"v1","addr":"172.21.15.181:6835","nonce":2695284429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1658040869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1658040869},{"type":"v1","addr":"172.21.15.181:6833","nonce":1658040869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/951752489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":951752489},{"type":"v1","addr":"172.21.15.99:6835","nonce":951752489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/245796495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":245796495},{"type":"v1","addr":"172.21.15.99:6837","nonce":245796495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-30T13:10:41.960 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 3 2024-03-30T13:10:41.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 -- 172.21.15.99:0/799843486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4fbc06c530 msgr2=0x7f4fbc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4fbc06c530 0x7f4fbc06e9f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00ba00 tx=0x7f4fcc030000 comp rx=0 tx=0).stop 2024-03-30T13:10:41.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 -- 172.21.15.99:0/799843486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fdc0c8a40 msgr2=0x7f4fdc156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:41.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fdc0c8a40 0x7f4fdc156230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800d800 tx=0x7f4fc800dcc0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 -- 172.21.15.99:0/799843486 shutdown_connections 2024-03-30T13:10:41.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4fbc06c530 0x7f4fbc06e9f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fdc1613d0 0x7f4fdc161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fdc0c8a40 0x7f4fdc156230 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 --2- 172.21.15.99:0/799843486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fc00039b0 0x7f4fdc0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:41.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 -- 172.21.15.99:0/799843486 >> 172.21.15.99:0/799843486 conn(0x7f4fdc08bfc0 msgr2=0x7f4fdc0b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:41.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 -- 172.21.15.99:0/799843486 shutdown_connections 2024-03-30T13:10:41.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:41.958+0000 7f4fe3800640 1 -- 172.21.15.99:0/799843486 wait complete. 2024-03-30T13:10:41.979 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:10:42.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.184+0000 7f3186c00640 1 Processor -- start 2024-03-30T13:10:42.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.184+0000 7f3186c00640 1 -- start start 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.186+0000 7f3186c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f318006f3f0 0x7f3180072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.186+0000 7f3186c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31800730c0 0x7f318015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.186+0000 7f3186c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3180071ae0 con 0x7f318015b370 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.186+0000 7f3186c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f31800b39d0 con 0x7f318006f3f0 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.186+0000 7f3186c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3180071dc0 con 0x7f31800730c0 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.186+0000 7f317f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f318006f3f0 0x7f3180072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.186+0000 7f317f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f318006f3f0 0x7f3180072b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47398/0 (socket says 172.21.15.99:47398) 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.186+0000 7f317f400640 1 -- 172.21.15.99:0/2207213901 learned_addr learned my addr 172.21.15.99:0/2207213901 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.187+0000 7f3184c00640 1 --2- 172.21.15.99:0/2207213901 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31800730c0 0x7f318015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.187+0000 7f317f400640 1 -- 172.21.15.99:0/2207213901 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31800730c0 msgr2=0x7f318015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.187+0000 7f317f400640 1 --2- 172.21.15.99:0/2207213901 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31800730c0 0x7f318015f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.187+0000 7f317f400640 1 -- 172.21.15.99:0/2207213901 >> v1:172.21.15.181:6789/0 conn(0x7f318015b370 legacy=0x7f31800b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.187+0000 7f317f400640 1 -- 172.21.15.99:0/2207213901 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31800720a0 con 0x7f318006f3f0 2024-03-30T13:10:42.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.188+0000 7f317f400640 1 --2- 172.21.15.99:0/2207213901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f318006f3f0 0x7f3180072b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f316c009870 tx=0x7f316c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecc3af5093830e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:42.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.188+0000 7f317ea00640 1 -- 172.21.15.99:0/2207213901 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c035020 con 0x7f318006f3f0 2024-03-30T13:10:42.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.188+0000 7f317ea00640 1 -- 172.21.15.99:0/2207213901 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c031640 con 0x7f318006f3f0 2024-03-30T13:10:42.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.188+0000 7f317ea00640 1 -- 172.21.15.99:0/2207213901 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c02d040 con 0x7f318006f3f0 2024-03-30T13:10:42.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.189+0000 7f3186c00640 1 -- 172.21.15.99:0/2207213901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f318006f3f0 msgr2=0x7f3180072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:42.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.189+0000 7f3186c00640 1 --2- 172.21.15.99:0/2207213901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f318006f3f0 0x7f3180072b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f316c009870 tx=0x7f316c02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.189+0000 7f3186c00640 1 -- 172.21.15.99:0/2207213901 shutdown_connections 2024-03-30T13:10:42.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.189+0000 7f3186c00640 1 --2- 172.21.15.99:0/2207213901 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31800730c0 0x7f318015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.189+0000 7f3186c00640 1 --2- 172.21.15.99:0/2207213901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f318006f3f0 0x7f3180072b80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.189+0000 7f3186c00640 1 -- 172.21.15.99:0/2207213901 >> 172.21.15.99:0/2207213901 conn(0x7f318006b510 msgr2=0x7f318006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:42.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.189+0000 7f3186c00640 1 -- 172.21.15.99:0/2207213901 shutdown_connections 2024-03-30T13:10:42.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.189+0000 7f3186c00640 1 -- 172.21.15.99:0/2207213901 wait complete. 2024-03-30T13:10:42.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.191+0000 7f3186c00640 1 Processor -- start 2024-03-30T13:10:42.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.191+0000 7f3186c00640 1 -- start start 2024-03-30T13:10:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.192+0000 7f3186c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f318006f3f0 0x7f3180099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.192+0000 7f3186c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800730c0 0x7f31800ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.192+0000 7f3186c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f318015b370 0x7f31801575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.192+0000 7f3186c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3180073550 con 0x7f31800730c0 2024-03-30T13:10:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.192+0000 7f3186c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3180072660 con 0x7f318015b370 2024-03-30T13:10:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.192+0000 7f3186c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f318015b750 con 0x7f318006f3f0 2024-03-30T13:10:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.193+0000 7f317f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800730c0 0x7f31800ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.193+0000 7f317f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800730c0 0x7f31800ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47404/0 (socket says 172.21.15.99:47404) 2024-03-30T13:10:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.193+0000 7f317f400640 1 -- 172.21.15.99:0/1088350363 learned_addr learned my addr 172.21.15.99:0/1088350363 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.193+0000 7f3184c00640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f318015b370 0x7f31801575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.193+0000 7f317fe00640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f318006f3f0 0x7f3180099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:42.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.193+0000 7f317f400640 1 -- 172.21.15.99:0/1088350363 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f318006f3f0 msgr2=0x7f3180099850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:42.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.193+0000 7f317f400640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f318006f3f0 0x7f3180099850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.193+0000 7f317f400640 1 -- 172.21.15.99:0/1088350363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f318015b370 msgr2=0x7f31801575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:42.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.193+0000 7f317f400640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f318015b370 0x7f31801575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.193+0000 7f317f400640 1 -- 172.21.15.99:0/1088350363 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31800cf1e0 con 0x7f31800730c0 2024-03-30T13:10:42.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.194+0000 7f317f400640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800730c0 0x7f31800ce790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f316c02b930 tx=0x7f316c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:42.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.194+0000 7f3177e00640 1 -- 172.21.15.99:0/1088350363 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c040070 con 0x7f31800730c0 2024-03-30T13:10:42.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.194+0000 7f3177e00640 1 -- 172.21.15.99:0/1088350363 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c039c10 con 0x7f31800730c0 2024-03-30T13:10:42.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.194+0000 7f3177e00640 1 -- 172.21.15.99:0/1088350363 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c035040 con 0x7f31800730c0 2024-03-30T13:10:42.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.194+0000 7f3186c00640 1 -- 172.21.15.99:0/1088350363 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31800cf4c0 con 0x7f31800730c0 2024-03-30T13:10:42.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.194+0000 7f3186c00640 1 -- 172.21.15.99:0/1088350363 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31800cfa80 con 0x7f31800730c0 2024-03-30T13:10:42.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.195+0000 7f3186c00640 1 -- 172.21.15.99:0/1088350363 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3180068640 con 0x7f31800730c0 2024-03-30T13:10:42.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.196+0000 7f3177e00640 1 -- 172.21.15.99:0/1088350363 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f316c04b060 con 0x7f31800730c0 2024-03-30T13:10:42.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.197+0000 7f3177e00640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f316006c530 0x7f316006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.197+0000 7f3177e00640 1 -- 172.21.15.99:0/1088350363 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f316c0ace90 con 0x7f31800730c0 2024-03-30T13:10:42.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.197+0000 7f317fe00640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f316006c530 0x7f316006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:42.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.198+0000 7f317fe00640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f316006c530 0x7f316006e9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3170004ea0 tx=0x7f3170009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.202+0000 7f3177e00640 1 -- 172.21.15.99:0/1088350363 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f316c02f300 con 0x7f31800730c0 2024-03-30T13:10:42.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.401+0000 7f3186c00640 1 -- 172.21.15.99:0/1088350363 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31800d0000 con 0x7f31800730c0 2024-03-30T13:10:42.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.404+0000 7f3177e00640 1 -- 172.21.15.99:0/1088350363 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12884 (secure 0 0 0) 0x7f316c07b7f0 con 0x7f31800730c0 2024-03-30T13:10:42.408 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":18,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:35.966755+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:10:42.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.406+0000 7f3186c00640 1 -- 172.21.15.99:0/1088350363 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f316006c530 msgr2=0x7f316006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:42.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.406+0000 7f3186c00640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f316006c530 0x7f316006e9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3170004ea0 tx=0x7f3170009040 comp rx=0 tx=0).stop 2024-03-30T13:10:42.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.406+0000 7f3186c00640 1 -- 172.21.15.99:0/1088350363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800730c0 msgr2=0x7f31800ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:42.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.406+0000 7f3186c00640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800730c0 0x7f31800ce790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f316c02b930 tx=0x7f316c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.406+0000 7f3186c00640 1 -- 172.21.15.99:0/1088350363 shutdown_connections 2024-03-30T13:10:42.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.406+0000 7f3186c00640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f316006c530 0x7f316006e9f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.406+0000 7f3186c00640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f318015b370 0x7f31801575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.406+0000 7f3186c00640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800730c0 0x7f31800ce790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.406+0000 7f3186c00640 1 --2- 172.21.15.99:0/1088350363 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f318006f3f0 0x7f3180099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.406+0000 7f3186c00640 1 -- 172.21.15.99:0/1088350363 >> 172.21.15.99:0/1088350363 conn(0x7f318006b510 msgr2=0x7f318006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:42.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.407+0000 7f3186c00640 1 -- 172.21.15.99:0/1088350363 shutdown_connections 2024-03-30T13:10:42.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.407+0000 7f3186c00640 1 -- 172.21.15.99:0/1088350363 wait complete. 2024-03-30T13:10:42.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:10:42.428 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:10:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.638+0000 7fe9ff200640 1 Processor -- start 2024-03-30T13:10:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.639+0000 7fe9ff200640 1 -- start start 2024-03-30T13:10:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.640+0000 7fe9ff200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea0015e7f0 0x7fea000d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.640+0000 7fe9ff200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fea000b5f60 0x7fea000b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.640+0000 7fe9ff200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea0006cce0 con 0x7fea000cf540 2024-03-30T13:10:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.640+0000 7fe9ff200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fea000d2c30 con 0x7fea000b5f60 2024-03-30T13:10:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.640+0000 7fe9ff200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fea000cfae0 con 0x7fea0015e7f0 2024-03-30T13:10:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.640+0000 7fe9f5400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fea000cf540 0x7fea0006c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46048/0 (socket says 172.21.15.99:46048) 2024-03-30T13:10:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.640+0000 7fe9f5400640 1 -- 172.21.15.99:0/34122179 learned_addr learned my addr 172.21.15.99:0/34122179 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.640+0000 7fe9fe800640 1 --2- 172.21.15.99:0/34122179 >> v2:172.21.15.99:3300/0 conn(0x7fea000b5f60 0x7fea000b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.641+0000 7fe9fde00640 1 --2- 172.21.15.99:0/34122179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea0015e7f0 0x7fea000d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.641+0000 7fe9fd400640 1 -- 172.21.15.99:0/34122179 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880942380 0 0) 0x7fea0006cce0 con 0x7fea000cf540 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.641+0000 7fe9fd400640 1 -- 172.21.15.99:0/34122179 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e4003520 con 0x7fea000cf540 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.641+0000 7fe9fe800640 1 -- 172.21.15.99:0/34122179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea0015e7f0 msgr2=0x7fea000d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.641+0000 7fe9fe800640 1 --2- 172.21.15.99:0/34122179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea0015e7f0 0x7fea000d4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.641+0000 7fe9fe800640 1 -- 172.21.15.99:0/34122179 >> v1:172.21.15.99:6789/0 conn(0x7fea000cf540 legacy=0x7fea0006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.641+0000 7fe9fe800640 1 -- 172.21.15.99:0/34122179 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea000cfdc0 con 0x7fea000b5f60 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.641+0000 7fe9fde00640 1 --2- 172.21.15.99:0/34122179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea0015e7f0 0x7fea000d4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.642+0000 7fe9fe800640 1 --2- 172.21.15.99:0/34122179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea000b5f60 0x7fea000b63f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009d90 tx=0x7fe9f802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fab6ad8ff506f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.642+0000 7fe9fd400640 1 -- 172.21.15.99:0/34122179 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8039070 con 0x7fea000b5f60 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.642+0000 7fe9fd400640 1 -- 172.21.15.99:0/34122179 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f802cc50 con 0x7fea000b5f60 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.642+0000 7fe9fd400640 1 -- 172.21.15.99:0/34122179 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8034440 con 0x7fea000b5f60 2024-03-30T13:10:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.643+0000 7fe9ff200640 1 -- 172.21.15.99:0/34122179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea000b5f60 msgr2=0x7fea000b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:42.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.643+0000 7fe9ff200640 1 --2- 172.21.15.99:0/34122179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea000b5f60 0x7fea000b63f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009d90 tx=0x7fe9f802bea0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.643+0000 7fe9ff200640 1 -- 172.21.15.99:0/34122179 shutdown_connections 2024-03-30T13:10:42.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.643+0000 7fe9ff200640 1 --2- 172.21.15.99:0/34122179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea000b5f60 0x7fea000b63f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.643+0000 7fe9ff200640 1 --2- 172.21.15.99:0/34122179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea0015e7f0 0x7fea000d4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.643+0000 7fe9ff200640 1 -- 172.21.15.99:0/34122179 >> 172.21.15.99:0/34122179 conn(0x7fea0009d7f0 msgr2=0x7fea000d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:42.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.643+0000 7fe9ff200640 1 -- 172.21.15.99:0/34122179 shutdown_connections 2024-03-30T13:10:42.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.643+0000 7fe9ff200640 1 -- 172.21.15.99:0/34122179 wait complete. 2024-03-30T13:10:42.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.644+0000 7fe9ff200640 1 Processor -- start 2024-03-30T13:10:42.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.645+0000 7fe9ff200640 1 -- start start 2024-03-30T13:10:42.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.645+0000 7fe9ff200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea000b5f60 0x7fea000c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.645+0000 7fe9ff200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea000cf540 0x7fea00151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9ff200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea0015e7f0 0x7fea000c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9ff200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fea000d5300 con 0x7fea000cf540 2024-03-30T13:10:42.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9ff200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fea0015ebd0 con 0x7fea000b5f60 2024-03-30T13:10:42.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9ff200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fea000d2570 con 0x7fea0015e7f0 2024-03-30T13:10:42.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9f5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea000cf540 0x7fea00151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:42.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9f5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea000cf540 0x7fea00151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47424/0 (socket says 172.21.15.99:47424) 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9f5400640 1 -- 172.21.15.99:0/647866354 learned_addr learned my addr 172.21.15.99:0/647866354 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9fde00640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea000b5f60 0x7fea000c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9f5400640 1 -- 172.21.15.99:0/647866354 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea0015e7f0 msgr2=0x7fea000c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9f5400640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea0015e7f0 0x7fea000c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9f5400640 1 -- 172.21.15.99:0/647866354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea000b5f60 msgr2=0x7fea000c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9f5400640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea000b5f60 0x7fea000c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9f5400640 1 -- 172.21.15.99:0/647866354 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea00151f90 con 0x7fea000cf540 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.646+0000 7fe9f5400640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea000cf540 0x7fea00151a50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800c390 tx=0x7fe9e800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.647+0000 7fe9f6a00640 1 -- 172.21.15.99:0/647866354 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8017070 con 0x7fea000cf540 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.647+0000 7fe9f6a00640 1 -- 172.21.15.99:0/647866354 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e8005ce0 con 0x7fea000cf540 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.647+0000 7fe9f6a00640 1 -- 172.21.15.99:0/647866354 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80072f0 con 0x7fea000cf540 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.647+0000 7fe9ff200640 1 -- 172.21.15.99:0/647866354 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea000c8ac0 con 0x7fea000cf540 2024-03-30T13:10:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.647+0000 7fe9ff200640 1 -- 172.21.15.99:0/647866354 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea000b97c0 con 0x7fea000cf540 2024-03-30T13:10:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.648+0000 7fe9ff200640 1 -- 172.21.15.99:0/647866354 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea000b44e0 con 0x7fea000cf540 2024-03-30T13:10:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.649+0000 7fe9f6a00640 1 -- 172.21.15.99:0/647866354 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe9e801a070 con 0x7fea000cf540 2024-03-30T13:10:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.650+0000 7fe9f6a00640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe9dc06c530 0x7fe9dc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.650+0000 7fe9f6a00640 1 -- 172.21.15.99:0/647866354 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fe9e808a710 con 0x7fea000cf540 2024-03-30T13:10:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.650+0000 7fe9fde00640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe9dc06c530 0x7fe9dc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:42.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.651+0000 7fe9fde00640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe9dc06c530 0x7fe9dc06e9f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea001f7ff0 tx=0x7fe9f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:42.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.655+0000 7fe9f6a00640 1 -- 172.21.15.99:0/647866354 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fea000b44e0 con 0x7fea000cf540 2024-03-30T13:10:42.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.838+0000 7fe9ff200640 1 -- 172.21.15.99:0/647866354 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fea0004f8f0 con 0x7fea000cf540 2024-03-30T13:10:42.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.839+0000 7fe9f6a00640 1 -- 172.21.15.99:0/647866354 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7fe9e8059110 con 0x7fea000cf540 2024-03-30T13:10:42.843 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:10:42.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.841+0000 7fe9ff200640 1 -- 172.21.15.99:0/647866354 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe9dc06c530 msgr2=0x7fe9dc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:42.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.841+0000 7fe9ff200640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe9dc06c530 0x7fe9dc06e9f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea001f7ff0 tx=0x7fe9f0008040 comp rx=0 tx=0).stop 2024-03-30T13:10:42.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.841+0000 7fe9ff200640 1 -- 172.21.15.99:0/647866354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea000cf540 msgr2=0x7fea00151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:42.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.841+0000 7fe9ff200640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea000cf540 0x7fea00151a50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800c390 tx=0x7fe9e800c850 comp rx=0 tx=0).stop 2024-03-30T13:10:42.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.841+0000 7fe9ff200640 1 -- 172.21.15.99:0/647866354 shutdown_connections 2024-03-30T13:10:42.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.841+0000 7fe9ff200640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe9dc06c530 0x7fe9dc06e9f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.841+0000 7fe9ff200640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fea0015e7f0 0x7fea000c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.841+0000 7fe9ff200640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea000cf540 0x7fea00151a50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.841+0000 7fe9ff200640 1 --2- 172.21.15.99:0/647866354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea000b5f60 0x7fea000c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:42.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.841+0000 7fe9ff200640 1 -- 172.21.15.99:0/647866354 >> 172.21.15.99:0/647866354 conn(0x7fea0009d7f0 msgr2=0x7fea0006cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:42.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.841+0000 7fe9ff200640 1 -- 172.21.15.99:0/647866354 shutdown_connections 2024-03-30T13:10:42.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:42.842+0000 7fe9ff200640 1 -- 172.21.15.99:0/647866354 wait complete. 2024-03-30T13:10:42.862 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-30T13:10:43.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.057+0000 7fe79ac00640 1 Processor -- start 2024-03-30T13:10:43.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.057+0000 7fe79ac00640 1 -- start start 2024-03-30T13:10:43.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.058+0000 7fe79ac00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe794071b00 0x7fe79415f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.058+0000 7fe79ac00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7941559b0 0x7fe79415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.058+0000 7fe79ac00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe794155e40 con 0x7fe794071ee0 2024-03-30T13:10:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.058+0000 7fe79ac00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe79415f550 con 0x7fe7941559b0 2024-03-30T13:10:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.058+0000 7fe79ac00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe794072580 con 0x7fe794071b00 2024-03-30T13:10:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.059+0000 7fe79a200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7941559b0 0x7fe79415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.059+0000 7fe79a200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7941559b0 0x7fe79415ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47430/0 (socket says 172.21.15.99:47430) 2024-03-30T13:10:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.059+0000 7fe798e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe794071ee0 0x7fe7941552a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46056/0 (socket says 172.21.15.99:46056) 2024-03-30T13:10:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.059+0000 7fe79a200640 1 -- 172.21.15.99:0/3295083284 learned_addr learned my addr 172.21.15.99:0/3295083284 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.059+0000 7fe799800640 1 --2- 172.21.15.99:0/3295083284 >> v2:172.21.15.181:3300/0 conn(0x7fe794071b00 0x7fe79415f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.059+0000 7fe79a200640 1 -- 172.21.15.99:0/3295083284 >> v2:172.21.15.181:3300/0 conn(0x7fe794071b00 msgr2=0x7fe79415f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.059+0000 7fe79a200640 1 --2- 172.21.15.99:0/3295083284 >> v2:172.21.15.181:3300/0 conn(0x7fe794071b00 0x7fe79415f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.059+0000 7fe79a200640 1 -- 172.21.15.99:0/3295083284 >> v1:172.21.15.99:6789/0 conn(0x7fe794071ee0 legacy=0x7fe7941552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:43.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.059+0000 7fe79a200640 1 -- 172.21.15.99:0/3295083284 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79415f780 con 0x7fe7941559b0 2024-03-30T13:10:43.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.059+0000 7fe793e00640 1 -- 172.21.15.99:0/3295083284 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029539620 0 0) 0x7fe794155e40 con 0x7fe794071ee0 2024-03-30T13:10:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.060+0000 7fe79a200640 1 --2- 172.21.15.99:0/3295083284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7941559b0 0x7fe79415ba20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7940b24e0 tx=0x7fe78c02e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74093978433f974 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.060+0000 7fe793e00640 1 -- 172.21.15.99:0/3295083284 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00b0d0 con 0x7fe7941559b0 2024-03-30T13:10:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.060+0000 7fe793e00640 1 -- 172.21.15.99:0/3295083284 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78c00b270 con 0x7fe7941559b0 2024-03-30T13:10:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.060+0000 7fe793e00640 1 -- 172.21.15.99:0/3295083284 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c009600 con 0x7fe7941559b0 2024-03-30T13:10:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.061+0000 7fe79ac00640 1 -- 172.21.15.99:0/3295083284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7941559b0 msgr2=0x7fe79415ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.061+0000 7fe79ac00640 1 --2- 172.21.15.99:0/3295083284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7941559b0 0x7fe79415ba20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7940b24e0 tx=0x7fe78c02e170 comp rx=0 tx=0).stop 2024-03-30T13:10:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.061+0000 7fe79ac00640 1 -- 172.21.15.99:0/3295083284 shutdown_connections 2024-03-30T13:10:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.061+0000 7fe79ac00640 1 --2- 172.21.15.99:0/3295083284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7941559b0 0x7fe79415ba20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.061+0000 7fe79ac00640 1 --2- 172.21.15.99:0/3295083284 >> v2:172.21.15.181:3300/0 conn(0x7fe794071b00 0x7fe79415f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.061+0000 7fe79ac00640 1 -- 172.21.15.99:0/3295083284 >> 172.21.15.99:0/3295083284 conn(0x7fe79406bb40 msgr2=0x7fe7940b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.061+0000 7fe79ac00640 1 -- 172.21.15.99:0/3295083284 shutdown_connections 2024-03-30T13:10:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.061+0000 7fe79ac00640 1 -- 172.21.15.99:0/3295083284 wait complete. 2024-03-30T13:10:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.063+0000 7fe79ac00640 1 Processor -- start 2024-03-30T13:10:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.063+0000 7fe79ac00640 1 -- start start 2024-03-30T13:10:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe79ac00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe794071b00 0x7fe7941f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe79ac00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe794071ee0 0x7fe79409b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe79ac00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7941559b0 0x7fe794158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe79ac00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe79406d860 con 0x7fe794071ee0 2024-03-30T13:10:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe79ac00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe79415fd40 con 0x7fe7941559b0 2024-03-30T13:10:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe79ac00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe79415bf60 con 0x7fe794071b00 2024-03-30T13:10:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe798e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe794071ee0 0x7fe79409b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe798e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe794071ee0 0x7fe79409b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47442/0 (socket says 172.21.15.99:47442) 2024-03-30T13:10:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe798e00640 1 -- 172.21.15.99:0/2479548261 learned_addr learned my addr 172.21.15.99:0/2479548261 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe798e00640 1 -- 172.21.15.99:0/2479548261 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe794071b00 msgr2=0x7fe7941f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe798e00640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe794071b00 0x7fe7941f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe798e00640 1 -- 172.21.15.99:0/2479548261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7941559b0 msgr2=0x7fe794158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe798e00640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7941559b0 0x7fe794158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe798e00640 1 -- 172.21.15.99:0/2479548261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79409b8f0 con 0x7fe794071ee0 2024-03-30T13:10:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.064+0000 7fe798e00640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe794071ee0 0x7fe79409b3b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c4d0 tx=0x7fe78000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.065+0000 7fe791600640 1 -- 172.21.15.99:0/2479548261 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780018070 con 0x7fe794071ee0 2024-03-30T13:10:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.065+0000 7fe791600640 1 -- 172.21.15.99:0/2479548261 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe780007500 con 0x7fe794071ee0 2024-03-30T13:10:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.065+0000 7fe791600640 1 -- 172.21.15.99:0/2479548261 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780004a20 con 0x7fe794071ee0 2024-03-30T13:10:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.065+0000 7fe79ac00640 1 -- 172.21.15.99:0/2479548261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe794158d50 con 0x7fe794071ee0 2024-03-30T13:10:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.065+0000 7fe79ac00640 1 -- 172.21.15.99:0/2479548261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7941f8780 con 0x7fe794071ee0 2024-03-30T13:10:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.066+0000 7fe79ac00640 1 -- 172.21.15.99:0/2479548261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe79404f8f0 con 0x7fe794071ee0 2024-03-30T13:10:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.067+0000 7fe791600640 1 -- 172.21.15.99:0/2479548261 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe78001b070 con 0x7fe794071ee0 2024-03-30T13:10:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.067+0000 7fe791600640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe77406c530 0x7fe77406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.067+0000 7fe791600640 1 -- 172.21.15.99:0/2479548261 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fe78008a750 con 0x7fe794071ee0 2024-03-30T13:10:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.068+0000 7fe799800640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe77406c530 0x7fe77406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.068+0000 7fe799800640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe77406c530 0x7fe77406e9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7880098f0 tx=0x7fe788008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:43.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.072+0000 7fe791600640 1 -- 172.21.15.99:0/2479548261 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe780059020 con 0x7fe794071ee0 2024-03-30T13:10:43.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.273+0000 7fe79ac00640 1 -- 172.21.15.99:0/2479548261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe7940b2920 con 0x7fe794071ee0 2024-03-30T13:10:43.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.274+0000 7fe791600640 1 -- 172.21.15.99:0/2479548261 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7fe780058920 con 0x7fe794071ee0 2024-03-30T13:10:43.278 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:43.278 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-03-30T13:10:43.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:10:43.279 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-03-30T13:10:43.279 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-03-30T13:10:43.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:10:43.279 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-03-30T13:10:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.276+0000 7fe79ac00640 1 -- 172.21.15.99:0/2479548261 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe77406c530 msgr2=0x7fe77406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.276+0000 7fe79ac00640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe77406c530 0x7fe77406e9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7880098f0 tx=0x7fe788008040 comp rx=0 tx=0).stop 2024-03-30T13:10:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.276+0000 7fe79ac00640 1 -- 172.21.15.99:0/2479548261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe794071ee0 msgr2=0x7fe79409b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.276+0000 7fe79ac00640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe794071ee0 0x7fe79409b3b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c4d0 tx=0x7fe78000c990 comp rx=0 tx=0).stop 2024-03-30T13:10:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.277+0000 7fe79ac00640 1 -- 172.21.15.99:0/2479548261 shutdown_connections 2024-03-30T13:10:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.277+0000 7fe79ac00640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe77406c530 0x7fe77406e9f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.277+0000 7fe79ac00640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7941559b0 0x7fe794158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.277+0000 7fe79ac00640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe794071ee0 0x7fe79409b3b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.277+0000 7fe79ac00640 1 --2- 172.21.15.99:0/2479548261 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe794071b00 0x7fe7941f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.277+0000 7fe79ac00640 1 -- 172.21.15.99:0/2479548261 >> 172.21.15.99:0/2479548261 conn(0x7fe79406bb40 msgr2=0x7fe7940cca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.277+0000 7fe79ac00640 1 -- 172.21.15.99:0/2479548261 shutdown_connections 2024-03-30T13:10:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.277+0000 7fe79ac00640 1 -- 172.21.15.99:0/2479548261 wait complete. 2024-03-30T13:10:43.298 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-30T13:10:43.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-30T13:10:43.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.509+0000 7fed8fc00640 1 Processor -- start 2024-03-30T13:10:43.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.510+0000 7fed8fc00640 1 -- start start 2024-03-30T13:10:43.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8fc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fed8815b350 0x7fed8815efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8fc00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fed880b4cf0 0x7fed8815c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8fc00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8815bad0 con 0x7fed880d0490 2024-03-30T13:10:43.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8fc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fed8815bdd0 con 0x7fed8815b350 2024-03-30T13:10:43.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8fc00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fed8815f7e0 con 0x7fed880b4cf0 2024-03-30T13:10:43.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8d200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fed8815b350 0x7fed8815efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:43.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8d200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fed8815b350 0x7fed8815efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47454/0 (socket says 172.21.15.99:47454) 2024-03-30T13:10:43.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8d200640 1 -- 172.21.15.99:0/3802686822 learned_addr learned my addr 172.21.15.99:0/3802686822 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:43.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8d200640 1 -- 172.21.15.99:0/3802686822 >> v2:172.21.15.181:3300/0 conn(0x7fed880b4cf0 msgr2=0x7fed8815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:43.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8d200640 1 --2- 172.21.15.99:0/3802686822 >> v2:172.21.15.181:3300/0 conn(0x7fed880b4cf0 0x7fed8815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8d200640 1 -- 172.21.15.99:0/3802686822 >> v1:172.21.15.181:6789/0 conn(0x7fed880d0490 legacy=0x7fed880b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:43.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.511+0000 7fed8d200640 1 -- 172.21.15.99:0/3802686822 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8815fac0 con 0x7fed8815b350 2024-03-30T13:10:43.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.512+0000 7fed8d200640 1 --2- 172.21.15.99:0/3802686822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8815b350 0x7fed8815efb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed8815bf50 tx=0x7fed7802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d011f1e953fdcfea server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:43.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.513+0000 7fed87e00640 1 -- 172.21.15.99:0/3802686822 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78035020 con 0x7fed8815b350 2024-03-30T13:10:43.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.513+0000 7fed87e00640 1 -- 172.21.15.99:0/3802686822 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed78031870 con 0x7fed8815b350 2024-03-30T13:10:43.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.513+0000 7fed87e00640 1 -- 172.21.15.99:0/3802686822 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78031c40 con 0x7fed8815b350 2024-03-30T13:10:43.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.513+0000 7fed8fc00640 1 -- 172.21.15.99:0/3802686822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8815b350 msgr2=0x7fed8815efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:43.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.513+0000 7fed8fc00640 1 --2- 172.21.15.99:0/3802686822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8815b350 0x7fed8815efb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed8815bf50 tx=0x7fed7802b910 comp rx=0 tx=0).stop 2024-03-30T13:10:43.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.514+0000 7fed8fc00640 1 -- 172.21.15.99:0/3802686822 shutdown_connections 2024-03-30T13:10:43.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.514+0000 7fed8fc00640 1 --2- 172.21.15.99:0/3802686822 >> v2:172.21.15.181:3300/0 conn(0x7fed880b4cf0 0x7fed8815c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.514+0000 7fed8fc00640 1 --2- 172.21.15.99:0/3802686822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8815b350 0x7fed8815efb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.514+0000 7fed8fc00640 1 -- 172.21.15.99:0/3802686822 >> 172.21.15.99:0/3802686822 conn(0x7fed8806b6f0 msgr2=0x7fed8806bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:43.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.514+0000 7fed8fc00640 1 -- 172.21.15.99:0/3802686822 shutdown_connections 2024-03-30T13:10:43.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.514+0000 7fed8fc00640 1 -- 172.21.15.99:0/3802686822 wait complete. 2024-03-30T13:10:43.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.515+0000 7fed8fc00640 1 Processor -- start 2024-03-30T13:10:43.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.516+0000 7fed8fc00640 1 -- start start 2024-03-30T13:10:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.516+0000 7fed8fc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed880b4cf0 0x7fed880c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.516+0000 7fed8fc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed880d0490 0x7fed880b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.516+0000 7fed8fc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed8815b350 0x7fed880b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed8fc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fed8815b730 con 0x7fed880d0490 2024-03-30T13:10:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed8fc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fed8815fda0 con 0x7fed8815b350 2024-03-30T13:10:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed8fc00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fed8815b8b0 con 0x7fed880b4cf0 2024-03-30T13:10:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed7fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed880d0490 0x7fed880b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed7fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed880d0490 0x7fed880b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47468/0 (socket says 172.21.15.99:47468) 2024-03-30T13:10:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed7fe00640 1 -- 172.21.15.99:0/2169038243 learned_addr learned my addr 172.21.15.99:0/2169038243 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed8d200640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed880b4cf0 0x7fed880c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed8dc00640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed8815b350 0x7fed880b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed7fe00640 1 -- 172.21.15.99:0/2169038243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed880b4cf0 msgr2=0x7fed880c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed7fe00640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed880b4cf0 0x7fed880c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed7fe00640 1 -- 172.21.15.99:0/2169038243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed8815b350 msgr2=0x7fed880b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed7fe00640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed8815b350 0x7fed880b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed7fe00640 1 -- 172.21.15.99:0/2169038243 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed880cf290 con 0x7fed880d0490 2024-03-30T13:10:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.517+0000 7fed8dc00640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed8815b350 0x7fed880b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:43.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.518+0000 7fed7fe00640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed880d0490 0x7fed880b20b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fed7000b4a0 tx=0x7fed7000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:43.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.518+0000 7fed85600640 1 -- 172.21.15.99:0/2169038243 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70014070 con 0x7fed880d0490 2024-03-30T13:10:43.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.518+0000 7fed85600640 1 -- 172.21.15.99:0/2169038243 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed70010610 con 0x7fed880d0490 2024-03-30T13:10:43.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.518+0000 7fed85600640 1 -- 172.21.15.99:0/2169038243 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70010a00 con 0x7fed880d0490 2024-03-30T13:10:43.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.518+0000 7fed8fc00640 1 -- 172.21.15.99:0/2169038243 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed880ce4d0 con 0x7fed880d0490 2024-03-30T13:10:43.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.518+0000 7fed8fc00640 1 -- 172.21.15.99:0/2169038243 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed880cea90 con 0x7fed880d0490 2024-03-30T13:10:43.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.519+0000 7fed8fc00640 1 -- 172.21.15.99:0/2169038243 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed88068640 con 0x7fed880d0490 2024-03-30T13:10:43.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.520+0000 7fed85600640 1 -- 172.21.15.99:0/2169038243 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fed70017070 con 0x7fed880d0490 2024-03-30T13:10:43.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.521+0000 7fed85600640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed6406c530 0x7fed6406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:43.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.521+0000 7fed85600640 1 -- 172.21.15.99:0/2169038243 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fed7008af40 con 0x7fed880d0490 2024-03-30T13:10:43.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.521+0000 7fed8d200640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed6406c530 0x7fed6406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:43.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.522+0000 7fed8d200640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed6406c530 0x7fed6406e9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed78036000 tx=0x7fed7803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:43.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.525+0000 7fed85600640 1 -- 172.21.15.99:0/2169038243 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fed70059780 con 0x7fed880d0490 2024-03-30T13:10:43.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:43.724+0000 7fed8fc00640 1 -- 172.21.15.99:0/2169038243 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fed880c9c50 con 0x7fed880d0490 2024-03-30T13:10:44.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.173+0000 7fed85600640 1 -- 172.21.15.99:0/2169038243 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fed70059080 con 0x7fed880d0490 2024-03-30T13:10:44.177 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-03-30T13:10:44.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 -- 172.21.15.99:0/2169038243 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed6406c530 msgr2=0x7fed6406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:44.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed6406c530 0x7fed6406e9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed78036000 tx=0x7fed7803c040 comp rx=0 tx=0).stop 2024-03-30T13:10:44.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 -- 172.21.15.99:0/2169038243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed880d0490 msgr2=0x7fed880b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:44.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed880d0490 0x7fed880b20b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fed7000b4a0 tx=0x7fed7000b960 comp rx=0 tx=0).stop 2024-03-30T13:10:44.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 -- 172.21.15.99:0/2169038243 shutdown_connections 2024-03-30T13:10:44.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed6406c530 0x7fed6406e9f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed8815b350 0x7fed880b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed880d0490 0x7fed880b20b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 --2- 172.21.15.99:0/2169038243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed880b4cf0 0x7fed880c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 -- 172.21.15.99:0/2169038243 >> 172.21.15.99:0/2169038243 conn(0x7fed8806b6f0 msgr2=0x7fed8815c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 -- 172.21.15.99:0/2169038243 shutdown_connections 2024-03-30T13:10:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.177+0000 7fed8fc00640 1 -- 172.21.15.99:0/2169038243 wait complete. 2024-03-30T13:10:44.208 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-30T13:10:44.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.392+0000 7fcb87400640 1 Processor -- start 2024-03-30T13:10:44.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.393+0000 7fcb87400640 1 -- start start 2024-03-30T13:10:44.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.394+0000 7fcb87400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb8015e970 0x7fcb800c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:44.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.394+0000 7fcb87400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcb800b2100 0x7fcb800b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:44.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.394+0000 7fcb87400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb800c6100 con 0x7fcb8015e590 2024-03-30T13:10:44.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.394+0000 7fcb87400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fcb800b2a70 con 0x7fcb800b2100 2024-03-30T13:10:44.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.394+0000 7fcb87400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcb800cfc90 con 0x7fcb8015e970 2024-03-30T13:10:44.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.394+0000 7fcb85400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcb800b2100 0x7fcb800b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:44.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.394+0000 7fcb84a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcb8015e590 0x7fcb800cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46068/0 (socket says 172.21.15.99:46068) 2024-03-30T13:10:44.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.394+0000 7fcb84a00640 1 -- 172.21.15.99:0/2492560714 learned_addr learned my addr 172.21.15.99:0/2492560714 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:44.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.395+0000 7fcb7fe00640 1 --2- 172.21.15.99:0/2492560714 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb8015e970 0x7fcb800c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:44.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.395+0000 7fcb85400640 1 -- 172.21.15.99:0/2492560714 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb8015e970 msgr2=0x7fcb800c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:44.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.395+0000 7fcb85400640 1 --2- 172.21.15.99:0/2492560714 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb8015e970 0x7fcb800c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:44.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.395+0000 7fcb85400640 1 -- 172.21.15.99:0/2492560714 >> v1:172.21.15.99:6789/0 conn(0x7fcb8015e590 legacy=0x7fcb800cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:44.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.395+0000 7fcb85400640 1 -- 172.21.15.99:0/2492560714 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb800cff70 con 0x7fcb800b2100 2024-03-30T13:10:44.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.395+0000 7fcb7f400640 1 -- 172.21.15.99:0/2492560714 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293985672 0 0) 0x7fcb800c6100 con 0x7fcb8015e590 2024-03-30T13:10:44.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.396+0000 7fcb85400640 1 --2- 172.21.15.99:0/2492560714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb800b2100 0x7fcb800b2530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb78009d90 tx=0x7fcb7802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3bfdc2fa35fb4f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:44.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.396+0000 7fcb7f400640 1 -- 172.21.15.99:0/2492560714 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78039070 con 0x7fcb800b2100 2024-03-30T13:10:44.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.396+0000 7fcb7f400640 1 -- 172.21.15.99:0/2492560714 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7802cbd0 con 0x7fcb800b2100 2024-03-30T13:10:44.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.396+0000 7fcb7f400640 1 -- 172.21.15.99:0/2492560714 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78034440 con 0x7fcb800b2100 2024-03-30T13:10:44.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.397+0000 7fcb87400640 1 -- 172.21.15.99:0/2492560714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb800b2100 msgr2=0x7fcb800b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:44.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.397+0000 7fcb87400640 1 --2- 172.21.15.99:0/2492560714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb800b2100 0x7fcb800b2530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb78009d90 tx=0x7fcb7802be20 comp rx=0 tx=0).stop 2024-03-30T13:10:44.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.397+0000 7fcb87400640 1 -- 172.21.15.99:0/2492560714 shutdown_connections 2024-03-30T13:10:44.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.397+0000 7fcb87400640 1 --2- 172.21.15.99:0/2492560714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb800b2100 0x7fcb800b2530 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:44.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.397+0000 7fcb87400640 1 --2- 172.21.15.99:0/2492560714 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb8015e970 0x7fcb800c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:44.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.397+0000 7fcb87400640 1 -- 172.21.15.99:0/2492560714 >> 172.21.15.99:0/2492560714 conn(0x7fcb800d0450 msgr2=0x7fcb800d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:44.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.397+0000 7fcb87400640 1 -- 172.21.15.99:0/2492560714 shutdown_connections 2024-03-30T13:10:44.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.397+0000 7fcb87400640 1 -- 172.21.15.99:0/2492560714 wait complete. 2024-03-30T13:10:44.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.399+0000 7fcb87400640 1 Processor -- start 2024-03-30T13:10:44.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.399+0000 7fcb87400640 1 -- start start 2024-03-30T13:10:44.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb87400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb800b2100 0x7fcb80157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:44.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb87400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb8015e590 0x7fcb800c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:44.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb87400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb8015e970 0x7fcb8006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:44.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb87400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcb800cc8f0 con 0x7fcb8015e590 2024-03-30T13:10:44.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb87400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcb800c66a0 con 0x7fcb8015e970 2024-03-30T13:10:44.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb87400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcb800cca70 con 0x7fcb800b2100 2024-03-30T13:10:44.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb7fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb8015e590 0x7fcb800c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:44.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb7fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb8015e590 0x7fcb800c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47494/0 (socket says 172.21.15.99:47494) 2024-03-30T13:10:44.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb7fe00640 1 -- 172.21.15.99:0/175196683 learned_addr learned my addr 172.21.15.99:0/175196683 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:44.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb7fe00640 1 -- 172.21.15.99:0/175196683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb800b2100 msgr2=0x7fcb80157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:44.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb7fe00640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb800b2100 0x7fcb80157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:44.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb7fe00640 1 -- 172.21.15.99:0/175196683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb8015e970 msgr2=0x7fcb8006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:44.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb7fe00640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb8015e970 0x7fcb8006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:44.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.400+0000 7fcb7fe00640 1 -- 172.21.15.99:0/175196683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb800c8df0 con 0x7fcb8015e590 2024-03-30T13:10:44.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.401+0000 7fcb7fe00640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb8015e590 0x7fcb800c83f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400d600 tx=0x7fcb7400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:44.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.401+0000 7fcb7cc00640 1 -- 172.21.15.99:0/175196683 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74004240 con 0x7fcb8015e590 2024-03-30T13:10:44.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.401+0000 7fcb7cc00640 1 -- 172.21.15.99:0/175196683 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb740043e0 con 0x7fcb8015e590 2024-03-30T13:10:44.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.401+0000 7fcb7cc00640 1 -- 172.21.15.99:0/175196683 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74003830 con 0x7fcb8015e590 2024-03-30T13:10:44.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.401+0000 7fcb87400640 1 -- 172.21.15.99:0/175196683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb800c90d0 con 0x7fcb8015e590 2024-03-30T13:10:44.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.401+0000 7fcb87400640 1 -- 172.21.15.99:0/175196683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb800c9690 con 0x7fcb8015e590 2024-03-30T13:10:44.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.402+0000 7fcb87400640 1 -- 172.21.15.99:0/175196683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb8009e520 con 0x7fcb8015e590 2024-03-30T13:10:44.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.403+0000 7fcb7cc00640 1 -- 172.21.15.99:0/175196683 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcb740039d0 con 0x7fcb8015e590 2024-03-30T13:10:44.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.404+0000 7fcb7cc00640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb6006c530 0x7fcb6006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:44.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.404+0000 7fcb7cc00640 1 -- 172.21.15.99:0/175196683 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7fcb7408b720 con 0x7fcb8015e590 2024-03-30T13:10:44.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.404+0000 7fcb84a00640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb6006c530 0x7fcb6006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:44.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.405+0000 7fcb84a00640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb6006c530 0x7fcb6006e9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c007fd0 tx=0x7fcb6c007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:44.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.409+0000 7fcb7cc00640 1 -- 172.21.15.99:0/175196683 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcb7401c360 con 0x7fcb8015e590 2024-03-30T13:10:44.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:44.612+0000 7fcb87400640 1 -- 172.21.15.99:0/175196683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcb8004f9d0 con 0x7fcb8015e590 2024-03-30T13:10:45.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.180+0000 7fcb7cc00640 1 -- 172.21.15.99:0/175196683 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7fcb74059fb0 con 0x7fcb8015e590 2024-03-30T13:10:45.185 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-03-30T13:10:45.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.184+0000 7fcb87400640 1 -- 172.21.15.99:0/175196683 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb6006c530 msgr2=0x7fcb6006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:45.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.184+0000 7fcb87400640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb6006c530 0x7fcb6006e9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c007fd0 tx=0x7fcb6c007920 comp rx=0 tx=0).stop 2024-03-30T13:10:45.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.184+0000 7fcb87400640 1 -- 172.21.15.99:0/175196683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb8015e590 msgr2=0x7fcb800c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:45.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.184+0000 7fcb87400640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb8015e590 0x7fcb800c83f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400d600 tx=0x7fcb7400dac0 comp rx=0 tx=0).stop 2024-03-30T13:10:45.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.185+0000 7fcb87400640 1 -- 172.21.15.99:0/175196683 shutdown_connections 2024-03-30T13:10:45.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.185+0000 7fcb87400640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb6006c530 0x7fcb6006e9f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:45.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.185+0000 7fcb87400640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb8015e970 0x7fcb8006d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:45.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.185+0000 7fcb87400640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb8015e590 0x7fcb800c83f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:45.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.185+0000 7fcb87400640 1 --2- 172.21.15.99:0/175196683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb800b2100 0x7fcb80157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:45.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.185+0000 7fcb87400640 1 -- 172.21.15.99:0/175196683 >> 172.21.15.99:0/175196683 conn(0x7fcb800d0450 msgr2=0x7fcb800d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:45.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.185+0000 7fcb87400640 1 -- 172.21.15.99:0/175196683 shutdown_connections 2024-03-30T13:10:45.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.185+0000 7fcb87400640 1 -- 172.21.15.99:0/175196683 wait complete. 2024-03-30T13:10:45.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-30T13:10:45.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.403+0000 7f885e400640 1 Processor -- start 2024-03-30T13:10:45.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.403+0000 7f885e400640 1 -- start start 2024-03-30T13:10:45.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.404+0000 7f885e400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f88580cf330 0x7f885815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:45.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.404+0000 7f885e400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f885815d190 0x7f88580ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:45.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.404+0000 7f885e400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f885815d7b0 con 0x7f88580acf20 2024-03-30T13:10:45.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.404+0000 7f885e400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f885806d840 con 0x7f885815d190 2024-03-30T13:10:45.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.404+0000 7f885e400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f885806db20 con 0x7f88580cf330 2024-03-30T13:10:45.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.405+0000 7f885da00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f885815d190 0x7f88580ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:45.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.405+0000 7f885da00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f885815d190 0x7f88580ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39840/0 (socket says 172.21.15.99:39840) 2024-03-30T13:10:45.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.405+0000 7f885da00640 1 -- 172.21.15.99:0/4014587760 learned_addr learned my addr 172.21.15.99:0/4014587760 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:45.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.405+0000 7f885da00640 1 -- 172.21.15.99:0/4014587760 >> v2:172.21.15.181:3300/0 conn(0x7f88580cf330 msgr2=0x7f885815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:45.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.405+0000 7f885da00640 1 --2- 172.21.15.99:0/4014587760 >> v2:172.21.15.181:3300/0 conn(0x7f88580cf330 0x7f885815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:45.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.405+0000 7f885da00640 1 -- 172.21.15.99:0/4014587760 >> v1:172.21.15.181:6789/0 conn(0x7f88580acf20 legacy=0x7f885815ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:45.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.405+0000 7f885da00640 1 -- 172.21.15.99:0/4014587760 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885806de00 con 0x7f885815d190 2024-03-30T13:10:45.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.406+0000 7f885da00640 1 --2- 172.21.15.99:0/4014587760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f885815d190 0x7f88580ad3a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f885806c450 tx=0x7f885002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df6bef28d0b02a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:45.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.406+0000 7f8857e00640 1 -- 172.21.15.99:0/4014587760 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885002ca80 con 0x7f885815d190 2024-03-30T13:10:45.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.406+0000 7f8857e00640 1 -- 172.21.15.99:0/4014587760 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f885002cc20 con 0x7f885815d190 2024-03-30T13:10:45.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.406+0000 7f8857e00640 1 -- 172.21.15.99:0/4014587760 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88500343f0 con 0x7f885815d190 2024-03-30T13:10:45.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.407+0000 7f885e400640 1 -- 172.21.15.99:0/4014587760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f885815d190 msgr2=0x7f88580ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:45.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.407+0000 7f885e400640 1 --2- 172.21.15.99:0/4014587760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f885815d190 0x7f88580ad3a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f885806c450 tx=0x7f885002bee0 comp rx=0 tx=0).stop 2024-03-30T13:10:45.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.407+0000 7f885e400640 1 -- 172.21.15.99:0/4014587760 shutdown_connections 2024-03-30T13:10:45.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.407+0000 7f885e400640 1 --2- 172.21.15.99:0/4014587760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f885815d190 0x7f88580ad3a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:45.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.407+0000 7f885e400640 1 --2- 172.21.15.99:0/4014587760 >> v2:172.21.15.181:3300/0 conn(0x7f88580cf330 0x7f885815dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:45.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.407+0000 7f885e400640 1 -- 172.21.15.99:0/4014587760 >> 172.21.15.99:0/4014587760 conn(0x7f885806bb40 msgr2=0x7f88580b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:45.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.407+0000 7f885e400640 1 -- 172.21.15.99:0/4014587760 shutdown_connections 2024-03-30T13:10:45.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.407+0000 7f885e400640 1 -- 172.21.15.99:0/4014587760 wait complete. 2024-03-30T13:10:45.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.409+0000 7f885e400640 1 Processor -- start 2024-03-30T13:10:45.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.409+0000 7f885e400640 1 -- start start 2024-03-30T13:10:45.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.410+0000 7f885e400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88580acf20 0x7f885814ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:45.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.410+0000 7f885e400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88580cf330 0x7f88581e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:45.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.410+0000 7f885e400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f885815d190 0x7f885814b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:45.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.410+0000 7f885e400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f885806e6b0 con 0x7f88580acf20 2024-03-30T13:10:45.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.410+0000 7f885e400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f885806e530 con 0x7f88580cf330 2024-03-30T13:10:45.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.410+0000 7f885e400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f885806e830 con 0x7f885815d190 2024-03-30T13:10:45.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.410+0000 7f885d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88580acf20 0x7f885814ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:45.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.410+0000 7f885d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88580acf20 0x7f885814ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39852/0 (socket says 172.21.15.99:39852) 2024-03-30T13:10:45.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.410+0000 7f885d000640 1 -- 172.21.15.99:0/3882162659 learned_addr learned my addr 172.21.15.99:0/3882162659 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:45.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.411+0000 7f885d000640 1 -- 172.21.15.99:0/3882162659 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f885815d190 msgr2=0x7f885814b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:45.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.411+0000 7f885d000640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f885815d190 0x7f885814b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:45.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.411+0000 7f884fe00640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88580cf330 0x7f88581e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:45.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.411+0000 7f885d000640 1 -- 172.21.15.99:0/3882162659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88580cf330 msgr2=0x7f88581e5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:45.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.411+0000 7f885d000640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88580cf330 0x7f88581e5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:45.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.411+0000 7f885d000640 1 -- 172.21.15.99:0/3882162659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885809c380 con 0x7f88580acf20 2024-03-30T13:10:45.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.411+0000 7f885d000640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88580acf20 0x7f885814ab60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f884800b4d0 tx=0x7f884800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:45.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.411+0000 7f8855600640 1 -- 172.21.15.99:0/3882162659 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8848014070 con 0x7f88580acf20 2024-03-30T13:10:45.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.411+0000 7f8855600640 1 -- 172.21.15.99:0/3882162659 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8848010870 con 0x7f88580acf20 2024-03-30T13:10:45.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.411+0000 7f8855600640 1 -- 172.21.15.99:0/3882162659 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8848010c60 con 0x7f88580acf20 2024-03-30T13:10:45.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.412+0000 7f885e400640 1 -- 172.21.15.99:0/3882162659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885809c600 con 0x7f88580acf20 2024-03-30T13:10:45.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.412+0000 7f885e400640 1 -- 172.21.15.99:0/3882162659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885809cbc0 con 0x7f88580acf20 2024-03-30T13:10:45.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.413+0000 7f885e400640 1 -- 172.21.15.99:0/3882162659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885804f8f0 con 0x7f88580acf20 2024-03-30T13:10:45.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.414+0000 7f8855600640 1 -- 172.21.15.99:0/3882162659 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8848017070 con 0x7f88580acf20 2024-03-30T13:10:45.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.415+0000 7f8855600640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f883406c560 0x7f883406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:45.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.415+0000 7f8855600640 1 -- 172.21.15.99:0/3882162659 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f884808b4b0 con 0x7f88580acf20 2024-03-30T13:10:45.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.415+0000 7f884fe00640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f883406c560 0x7f883406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:45.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.416+0000 7f884fe00640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f883406c560 0x7f883406ea20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88581f7890 tx=0x7f8840009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:45.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.420+0000 7f8855600640 1 -- 172.21.15.99:0/3882162659 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f885809c380 con 0x7f88580acf20 2024-03-30T13:10:45.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:45.655+0000 7f885e400640 1 -- 172.21.15.99:0/3882162659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f88580b28f0 con 0x7f88580acf20 2024-03-30T13:10:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.229+0000 7f8855600640 1 -- 172.21.15.99:0/3882162659 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8848059a90 con 0x7f88580acf20 2024-03-30T13:10:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 2 and data pool 3 2024-03-30T13:10:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.239+0000 7f885e400640 1 -- 172.21.15.99:0/3882162659 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f883406c560 msgr2=0x7f883406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.239+0000 7f885e400640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f883406c560 0x7f883406ea20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88581f7890 tx=0x7f8840009040 comp rx=0 tx=0).stop 2024-03-30T13:10:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.239+0000 7f885e400640 1 -- 172.21.15.99:0/3882162659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88580acf20 msgr2=0x7f885814ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.239+0000 7f885e400640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88580acf20 0x7f885814ab60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f884800b4d0 tx=0x7f884800b990 comp rx=0 tx=0).stop 2024-03-30T13:10:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.240+0000 7f885e400640 1 -- 172.21.15.99:0/3882162659 shutdown_connections 2024-03-30T13:10:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.240+0000 7f885e400640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f883406c560 0x7f883406ea20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.240+0000 7f885e400640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f885815d190 0x7f885814b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.240+0000 7f885e400640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88580cf330 0x7f88581e5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.240+0000 7f885e400640 1 --2- 172.21.15.99:0/3882162659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88580acf20 0x7f885814ab60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.240+0000 7f885e400640 1 -- 172.21.15.99:0/3882162659 >> 172.21.15.99:0/3882162659 conn(0x7f885806bb40 msgr2=0x7f88580b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:46.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.243+0000 7f885e400640 1 -- 172.21.15.99:0/3882162659 shutdown_connections 2024-03-30T13:10:46.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.246+0000 7f885e400640 1 -- 172.21.15.99:0/3882162659 wait complete. 2024-03-30T13:10:46.278 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:10:46.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.448+0000 7f2ee8400640 1 Processor -- start 2024-03-30T13:10:46.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.448+0000 7f2ee8400640 1 -- start start 2024-03-30T13:10:46.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.449+0000 7f2ee8400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ee015c670 0x7f2ee006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.449+0000 7f2ee8400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2ee006f060 0x7f2ee006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.449+0000 7f2ee8400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee0146230 con 0x7f2ee00ad230 2024-03-30T13:10:46.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.449+0000 7f2ee8400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee006dfc0 con 0x7f2ee006f060 2024-03-30T13:10:46.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.449+0000 7f2ee8400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee006e2a0 con 0x7f2ee015c670 2024-03-30T13:10:46.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.450+0000 7f2ee5000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2ee006f060 0x7f2ee006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.450+0000 7f2ee6400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2ee00ad230 0x7f2ee00b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54798/0 (socket says 172.21.15.99:54798) 2024-03-30T13:10:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.450+0000 7f2ee6400640 1 -- 172.21.15.99:0/477345653 learned_addr learned my addr 172.21.15.99:0/477345653 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.450+0000 7f2ee5a00640 1 --2- 172.21.15.99:0/477345653 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ee015c670 0x7f2ee006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.451+0000 7f2ee5000640 1 -- 172.21.15.99:0/477345653 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ee015c670 msgr2=0x7f2ee006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.451+0000 7f2ee5000640 1 --2- 172.21.15.99:0/477345653 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ee015c670 0x7f2ee006c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.451+0000 7f2ee5000640 1 -- 172.21.15.99:0/477345653 >> v1:172.21.15.99:6789/0 conn(0x7f2ee00ad230 legacy=0x7f2ee00b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.451+0000 7f2ee5000640 1 -- 172.21.15.99:0/477345653 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee006e580 con 0x7f2ee006f060 2024-03-30T13:10:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.452+0000 7f2ee5000640 1 --2- 172.21.15.99:0/477345653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ee006f060 0x7f2ee006d930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0097a0 tx=0x7f2ecc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a17bf48f1c16b95 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:46.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.452+0000 7f2edfe00640 1 -- 172.21.15.99:0/477345653 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc031780 con 0x7f2ee006f060 2024-03-30T13:10:46.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.452+0000 7f2edfe00640 1 -- 172.21.15.99:0/477345653 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc037070 con 0x7f2ee006f060 2024-03-30T13:10:46.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.452+0000 7f2edfe00640 1 -- 172.21.15.99:0/477345653 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc031b40 con 0x7f2ee006f060 2024-03-30T13:10:46.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.453+0000 7f2ee8400640 1 -- 172.21.15.99:0/477345653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ee006f060 msgr2=0x7f2ee006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:46.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.453+0000 7f2ee8400640 1 --2- 172.21.15.99:0/477345653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ee006f060 0x7f2ee006d930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0097a0 tx=0x7f2ecc02b820 comp rx=0 tx=0).stop 2024-03-30T13:10:46.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.453+0000 7f2ee8400640 1 -- 172.21.15.99:0/477345653 shutdown_connections 2024-03-30T13:10:46.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.453+0000 7f2ee8400640 1 --2- 172.21.15.99:0/477345653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ee006f060 0x7f2ee006d930 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.453+0000 7f2ee8400640 1 --2- 172.21.15.99:0/477345653 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ee015c670 0x7f2ee006c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.453+0000 7f2ee8400640 1 -- 172.21.15.99:0/477345653 >> 172.21.15.99:0/477345653 conn(0x7f2ee006b510 msgr2=0x7f2ee006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:46.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.453+0000 7f2ee8400640 1 -- 172.21.15.99:0/477345653 shutdown_connections 2024-03-30T13:10:46.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.453+0000 7f2ee8400640 1 -- 172.21.15.99:0/477345653 wait complete. 2024-03-30T13:10:46.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.454+0000 7f2ee8400640 1 Processor -- start 2024-03-30T13:10:46.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.455+0000 7f2ee8400640 1 -- start start 2024-03-30T13:10:46.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.455+0000 7f2ee8400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ee006f060 0x7f2ee0099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.455+0000 7f2ee8400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ee00ad230 0x7f2ee00b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.455+0000 7f2ee8400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ee015c670 0x7f2ee00b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.455+0000 7f2ee8400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee00ad6c0 con 0x7f2ee00ad230 2024-03-30T13:10:46.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.455+0000 7f2ee8400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee015ca50 con 0x7f2ee015c670 2024-03-30T13:10:46.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.455+0000 7f2ee8400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee00ad840 con 0x7f2ee006f060 2024-03-30T13:10:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.456+0000 7f2ee5000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ee00ad230 0x7f2ee00b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.456+0000 7f2ee5000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ee00ad230 0x7f2ee00b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39866/0 (socket says 172.21.15.99:39866) 2024-03-30T13:10:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.456+0000 7f2ee5000640 1 -- 172.21.15.99:0/1821086294 learned_addr learned my addr 172.21.15.99:0/1821086294 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.456+0000 7f2ee5a00640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ee006f060 0x7f2ee0099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.456+0000 7f2ee5000640 1 -- 172.21.15.99:0/1821086294 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ee006f060 msgr2=0x7f2ee0099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.456+0000 7f2ee5000640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ee006f060 0x7f2ee0099980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.456+0000 7f2ee5000640 1 -- 172.21.15.99:0/1821086294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ee015c670 msgr2=0x7f2ee00b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.456+0000 7f2ee5000640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ee015c670 0x7f2ee00b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.456+0000 7f2ee5000640 1 -- 172.21.15.99:0/1821086294 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee0099ec0 con 0x7f2ee00ad230 2024-03-30T13:10:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.456+0000 7f2ee5a00640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ee006f060 0x7f2ee0099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.456+0000 7f2ee5000640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ee00ad230 0x7f2ee00b0540 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc034040 tx=0x7f2ecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.457+0000 7f2edd600640 1 -- 172.21.15.99:0/1821086294 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc032820 con 0x7f2ee00ad230 2024-03-30T13:10:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.457+0000 7f2edd600640 1 -- 172.21.15.99:0/1821086294 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc0329e0 con 0x7f2ee00ad230 2024-03-30T13:10:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.457+0000 7f2ee8400640 1 -- 172.21.15.99:0/1821086294 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee015a950 con 0x7f2ee00ad230 2024-03-30T13:10:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.457+0000 7f2edd600640 1 -- 172.21.15.99:0/1821086294 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc032dd0 con 0x7f2ee00ad230 2024-03-30T13:10:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.457+0000 7f2ee8400640 1 -- 172.21.15.99:0/1821086294 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee015af10 con 0x7f2ee00ad230 2024-03-30T13:10:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.458+0000 7f2ee8400640 1 -- 172.21.15.99:0/1821086294 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee015b8f0 con 0x7f2ee00ad230 2024-03-30T13:10:46.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.459+0000 7f2edd600640 1 -- 172.21.15.99:0/1821086294 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2ecc04e440 con 0x7f2ee00ad230 2024-03-30T13:10:46.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.460+0000 7f2edd600640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2ec006c530 0x7f2ec006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.460+0000 7f2edd600640 1 -- 172.21.15.99:0/1821086294 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2ecc0ad5c0 con 0x7f2ee00ad230 2024-03-30T13:10:46.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.460+0000 7f2ee5a00640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2ec006c530 0x7f2ec006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:46.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.461+0000 7f2ee5a00640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2ec006c530 0x7f2ec006e9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4006fd0 tx=0x7f2ed4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.464+0000 7f2edd600640 1 -- 172.21.15.99:0/1821086294 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2ee015b8f0 con 0x7f2ee00ad230 2024-03-30T13:10:46.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.659+0000 7f2ee8400640 1 -- 172.21.15.99:0/1821086294 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ee006f570 con 0x7f2ee00ad230 2024-03-30T13:10:46.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.662+0000 7f2edd600640 1 -- 172.21.15.99:0/1821086294 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16622 (secure 0 0 0) 0x7f2ee0099ec0 con 0x7f2ee00ad230 2024-03-30T13:10:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:46.666 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":21,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:45.657350+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:10:46.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 -- 172.21.15.99:0/1821086294 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2ec006c530 msgr2=0x7f2ec006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2ec006c530 0x7f2ec006e9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4006fd0 tx=0x7f2ed4008040 comp rx=0 tx=0).stop 2024-03-30T13:10:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 -- 172.21.15.99:0/1821086294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ee00ad230 msgr2=0x7f2ee00b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ee00ad230 0x7f2ee00b0540 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc034040 tx=0x7f2ecc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 -- 172.21.15.99:0/1821086294 shutdown_connections 2024-03-30T13:10:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2ec006c530 0x7f2ec006e9f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ee015c670 0x7f2ee00b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ee00ad230 0x7f2ee00b0540 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 --2- 172.21.15.99:0/1821086294 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ee006f060 0x7f2ee0099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 -- 172.21.15.99:0/1821086294 >> 172.21.15.99:0/1821086294 conn(0x7f2ee006b510 msgr2=0x7f2ee00afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 -- 172.21.15.99:0/1821086294 shutdown_connections 2024-03-30T13:10:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.664+0000 7f2ee8400640 1 -- 172.21.15.99:0/1821086294 wait complete. 2024-03-30T13:10:46.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:10:46.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.879+0000 7f1aa5600640 1 Processor -- start 2024-03-30T13:10:46.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.879+0000 7f1aa5600640 1 -- start start 2024-03-30T13:10:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1aa5600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1aa006f3f0 0x7f1aa0072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1aa5600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1aa00730c0 0x7f1aa015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1aa5600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa0071ae0 con 0x7f1aa015b370 2024-03-30T13:10:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1aa5600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa00b39d0 con 0x7f1aa006f3f0 2024-03-30T13:10:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1aa5600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa0071dc0 con 0x7f1aa00730c0 2024-03-30T13:10:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1a9e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1aa006f3f0 0x7f1aa0072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1a9e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1aa006f3f0 0x7f1aa0072b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39882/0 (socket says 172.21.15.99:39882) 2024-03-30T13:10:46.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1a9e000640 1 -- 172.21.15.99:0/1394587566 learned_addr learned my addr 172.21.15.99:0/1394587566 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:46.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1a9f400640 1 --2- 172.21.15.99:0/1394587566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1aa00730c0 0x7f1aa015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:46.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1a9e000640 1 -- 172.21.15.99:0/1394587566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1aa00730c0 msgr2=0x7f1aa015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:46.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1a9e000640 1 --2- 172.21.15.99:0/1394587566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1aa00730c0 0x7f1aa015f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1a9e000640 1 -- 172.21.15.99:0/1394587566 >> v1:172.21.15.181:6789/0 conn(0x7f1aa015b370 legacy=0x7f1aa00b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:46.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.881+0000 7f1a9e000640 1 -- 172.21.15.99:0/1394587566 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa00720a0 con 0x7f1aa006f3f0 2024-03-30T13:10:46.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.882+0000 7f1a9e000640 1 --2- 172.21.15.99:0/1394587566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1aa006f3f0 0x7f1aa0072b80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009870 tx=0x7f1a8c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77acc037fe8209e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:46.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.883+0000 7f1a9d600640 1 -- 172.21.15.99:0/1394587566 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c035020 con 0x7f1aa006f3f0 2024-03-30T13:10:46.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.883+0000 7f1a9d600640 1 -- 172.21.15.99:0/1394587566 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c031640 con 0x7f1aa006f3f0 2024-03-30T13:10:46.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.883+0000 7f1a9d600640 1 -- 172.21.15.99:0/1394587566 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c02d040 con 0x7f1aa006f3f0 2024-03-30T13:10:46.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.883+0000 7f1aa5600640 1 -- 172.21.15.99:0/1394587566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1aa006f3f0 msgr2=0x7f1aa0072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:46.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.883+0000 7f1aa5600640 1 --2- 172.21.15.99:0/1394587566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1aa006f3f0 0x7f1aa0072b80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009870 tx=0x7f1a8c02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.884+0000 7f1aa5600640 1 -- 172.21.15.99:0/1394587566 shutdown_connections 2024-03-30T13:10:46.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.884+0000 7f1aa5600640 1 --2- 172.21.15.99:0/1394587566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1aa00730c0 0x7f1aa015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.884+0000 7f1aa5600640 1 --2- 172.21.15.99:0/1394587566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1aa006f3f0 0x7f1aa0072b80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.884+0000 7f1aa5600640 1 -- 172.21.15.99:0/1394587566 >> 172.21.15.99:0/1394587566 conn(0x7f1aa006b510 msgr2=0x7f1aa006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:46.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.884+0000 7f1aa5600640 1 -- 172.21.15.99:0/1394587566 shutdown_connections 2024-03-30T13:10:46.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.884+0000 7f1aa5600640 1 -- 172.21.15.99:0/1394587566 wait complete. 2024-03-30T13:10:46.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.885+0000 7f1aa5600640 1 Processor -- start 2024-03-30T13:10:46.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.885+0000 7f1aa5600640 1 -- start start 2024-03-30T13:10:46.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.886+0000 7f1aa5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1aa006f3f0 0x7f1aa0154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.886+0000 7f1aa5600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1aa00730c0 0x7f1aa01510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.886+0000 7f1aa5600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1aa015b370 0x7f1aa0150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.886+0000 7f1aa5600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa0073550 con 0x7f1aa006f3f0 2024-03-30T13:10:46.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.886+0000 7f1aa5600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa0072660 con 0x7f1aa00730c0 2024-03-30T13:10:46.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.886+0000 7f1aa5600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa015b750 con 0x7f1aa015b370 2024-03-30T13:10:46.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.886+0000 7f1a9ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1aa006f3f0 0x7f1aa0154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:46.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a9ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1aa006f3f0 0x7f1aa0154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39884/0 (socket says 172.21.15.99:39884) 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a9ea00640 1 -- 172.21.15.99:0/1343050284 learned_addr learned my addr 172.21.15.99:0/1343050284 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a9e000640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1aa00730c0 0x7f1aa01510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a9ea00640 1 -- 172.21.15.99:0/1343050284 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1aa015b370 msgr2=0x7f1aa0150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a9ea00640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1aa015b370 0x7f1aa0150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a9ea00640 1 -- 172.21.15.99:0/1343050284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1aa00730c0 msgr2=0x7f1aa01510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a9ea00640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1aa00730c0 0x7f1aa01510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a9ea00640 1 -- 172.21.15.99:0/1343050284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa0151660 con 0x7f1aa006f3f0 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a9ea00640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1aa006f3f0 0x7f1aa0154670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c430 tx=0x7f1a9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a96a00640 1 -- 172.21.15.99:0/1343050284 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90011790 con 0x7f1aa006f3f0 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a96a00640 1 -- 172.21.15.99:0/1343050284 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a90017070 con 0x7f1aa006f3f0 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1a96a00640 1 -- 172.21.15.99:0/1343050284 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90011bb0 con 0x7f1aa006f3f0 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.887+0000 7f1aa5600640 1 -- 172.21.15.99:0/1343050284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa0151940 con 0x7f1aa006f3f0 2024-03-30T13:10:46.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.888+0000 7f1aa5600640 1 -- 172.21.15.99:0/1343050284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa01524c0 con 0x7f1aa006f3f0 2024-03-30T13:10:46.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.889+0000 7f1aa5600640 1 -- 172.21.15.99:0/1343050284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa0068640 con 0x7f1aa006f3f0 2024-03-30T13:10:46.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.890+0000 7f1a96a00640 1 -- 172.21.15.99:0/1343050284 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1a9001c460 con 0x7f1aa006f3f0 2024-03-30T13:10:46.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.890+0000 7f1a96a00640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a8006c530 0x7f1a8006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:46.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.891+0000 7f1a96a00640 1 -- 172.21.15.99:0/1343050284 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1a9008b5d0 con 0x7f1aa006f3f0 2024-03-30T13:10:46.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.891+0000 7f1a9e000640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a8006c530 0x7f1a8006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:46.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.891+0000 7f1a9e000640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a8006c530 0x7f1a8006e9f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c036000 tx=0x7f1a8c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:46.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:46.895+0000 7f1a96a00640 1 -- 172.21.15.99:0/1343050284 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1a90059be0 con 0x7f1aa006f3f0 2024-03-30T13:10:47.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.092+0000 7f1aa5600640 1 -- 172.21.15.99:0/1343050284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1aa00ccc20 con 0x7f1aa006f3f0 2024-03-30T13:10:47.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.094+0000 7f1a96a00640 1 -- 172.21.15.99:0/1343050284 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16622 (secure 0 0 0) 0x7f1a900594e0 con 0x7f1aa006f3f0 2024-03-30T13:10:47.098 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:47.098 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":21,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:45.657350+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:10:47.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 -- 172.21.15.99:0/1343050284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a8006c530 msgr2=0x7f1a8006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:47.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a8006c530 0x7f1a8006e9f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c036000 tx=0x7f1a8c008030 comp rx=0 tx=0).stop 2024-03-30T13:10:47.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 -- 172.21.15.99:0/1343050284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1aa006f3f0 msgr2=0x7f1aa0154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1aa006f3f0 0x7f1aa0154670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c430 tx=0x7f1a9000c8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 -- 172.21.15.99:0/1343050284 shutdown_connections 2024-03-30T13:10:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a8006c530 0x7f1a8006e9f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1aa015b370 0x7f1aa0150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1aa00730c0 0x7f1aa01510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 --2- 172.21.15.99:0/1343050284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1aa006f3f0 0x7f1aa0154670 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 -- 172.21.15.99:0/1343050284 >> 172.21.15.99:0/1343050284 conn(0x7f1aa006b510 msgr2=0x7f1aa00aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 -- 172.21.15.99:0/1343050284 shutdown_connections 2024-03-30T13:10:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.096+0000 7f1aa5600640 1 -- 172.21.15.99:0/1343050284 wait complete. 2024-03-30T13:10:47.118 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-30T13:10:47.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.354+0000 7f5501c00640 1 Processor -- start 2024-03-30T13:10:47.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.354+0000 7f5501c00640 1 -- start start 2024-03-30T13:10:47.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.355+0000 7f5501c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f54fc0b6700 0x7f54fc0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:47.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.355+0000 7f5501c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54fc15ce50 con 0x7f54fc156d50 2024-03-30T13:10:47.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.356+0000 7f5501c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54fc15d130 con 0x7f54fc0cef70 2024-03-30T13:10:47.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.356+0000 7f5501c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f54fc15d410 con 0x7f54fc0b6700 2024-03-30T13:10:47.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.356+0000 7f54faa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f54fc156d50 0x7f54fc0b5ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54812/0 (socket says 172.21.15.99:54812) 2024-03-30T13:10:47.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.356+0000 7f54faa00640 1 -- 172.21.15.99:0/3048667813 learned_addr learned my addr 172.21.15.99:0/3048667813 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.356+0000 7f54fa000640 1 --2- 172.21.15.99:0/3048667813 >> v2:172.21.15.181:3300/0 conn(0x7f54fc0b6700 0x7f54fc0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.356+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2690586315 0 0) 0x7f54fc15ce50 con 0x7f54fc156d50 2024-03-30T13:10:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.356+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54e0003520 con 0x7f54fc156d50 2024-03-30T13:10:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4059302091 0 0) 0x7f54e0003520 con 0x7f54fc156d50 2024-03-30T13:10:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 >> v2:172.21.15.181:3300/0 conn(0x7f54fc0b6700 msgr2=0x7f54fc0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 --2- 172.21.15.99:0/3048667813 >> v2:172.21.15.181:3300/0 conn(0x7f54fc0b6700 0x7f54fc0cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 >> v1:172.21.15.181:6789/0 conn(0x7f54fc0cef70 legacy=0x7f54fc06e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc15cb00 con 0x7f54fc156d50 2024-03-30T13:10:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f54ec001670 con 0x7f54fc156d50 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 >> v1:172.21.15.99:6789/0 conn(0x7f54fc156d50 legacy=0x7f54fc0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54e0003a00 0x7f54e0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54e0004800 0x7f54e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54e00053c0 0x7f54e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc15d410 con 0x7f54e0004800 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f54e000c2a0 con 0x7f54e0003a00 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f54e000c4a0 con 0x7f54e00053c0 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54fa000640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54e0004800 0x7f54e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54fa000640 1 -- 172.21.15.99:0/3048667813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54e00053c0 msgr2=0x7f54e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54faa00640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54e0003a00 0x7f54e0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.357+0000 7f54fb400640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54e00053c0 0x7f54e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.358+0000 7f54fa000640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54e00053c0 0x7f54e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.358+0000 7f54fa000640 1 -- 172.21.15.99:0/3048667813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54e0003a00 msgr2=0x7f54e0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.358+0000 7f54fa000640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54e0003a00 0x7f54e0003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.358+0000 7f54fa000640 1 -- 172.21.15.99:0/3048667813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e0003520 con 0x7f54e0004800 2024-03-30T13:10:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.358+0000 7f54fb400640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54e00053c0 0x7f54e000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.358+0000 7f54fb400640 1 -- 172.21.15.99:0/3048667813 reap_dead start 2024-03-30T13:10:47.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.359+0000 7f54fa000640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54e0004800 0x7f54e0004c80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f54e800ba30 tx=0x7f54e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a5d9872e4148c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:47.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.359+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8036020 con 0x7f54e0004800 2024-03-30T13:10:47.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.359+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e8032630 con 0x7f54e0004800 2024-03-30T13:10:47.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.359+0000 7f54f9600640 1 -- 172.21.15.99:0/3048667813 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e800b600 con 0x7f54e0004800 2024-03-30T13:10:47.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.359+0000 7f5501c00640 1 -- 172.21.15.99:0/3048667813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54e0004800 msgr2=0x7f54e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:47.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.359+0000 7f5501c00640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54e0004800 0x7f54e0004c80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f54e800ba30 tx=0x7f54e0005830 comp rx=0 tx=0).stop 2024-03-30T13:10:47.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.359+0000 7f5501c00640 1 -- 172.21.15.99:0/3048667813 shutdown_connections 2024-03-30T13:10:47.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.359+0000 7f5501c00640 1 --2- 172.21.15.99:0/3048667813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54e0004800 0x7f54e0004c80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:47.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.360+0000 7f5501c00640 1 -- 172.21.15.99:0/3048667813 >> 172.21.15.99:0/3048667813 conn(0x7f54fc06b510 msgr2=0x7f54fc06b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:47.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.360+0000 7f5501c00640 1 -- 172.21.15.99:0/3048667813 shutdown_connections 2024-03-30T13:10:47.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.360+0000 7f5501c00640 1 -- 172.21.15.99:0/3048667813 wait complete. 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.361+0000 7f5501c00640 1 Processor -- start 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.361+0000 7f5501c00640 1 -- start start 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.362+0000 7f5501c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54e0004800 0x7f54fc1f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.362+0000 7f5501c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54fc1e6360 0x7f54fc157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.362+0000 7f5501c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54fc15f050 0x7f54fc15f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.362+0000 7f5501c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc0cea30 con 0x7f54fc15f050 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.362+0000 7f5501c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc0cf400 con 0x7f54fc1e6360 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.362+0000 7f5501c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f54fc0cebb0 con 0x7f54e0004800 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54fb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54fc15f050 0x7f54fc15f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54fb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54fc15f050 0x7f54fc15f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39916/0 (socket says 172.21.15.99:39916) 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54fb400640 1 -- 172.21.15.99:0/2282022929 learned_addr learned my addr 172.21.15.99:0/2282022929 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54faa00640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54e0004800 0x7f54fc1f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54fb400640 1 -- 172.21.15.99:0/2282022929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54e0004800 msgr2=0x7f54fc1f7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54fb400640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54e0004800 0x7f54fc1f7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54fb400640 1 -- 172.21.15.99:0/2282022929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54fc1e6360 msgr2=0x7f54fc157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54fa000640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54fc1e6360 0x7f54fc157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54fb400640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54fc1e6360 0x7f54fc157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54fb400640 1 -- 172.21.15.99:0/2282022929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc1588b0 con 0x7f54fc15f050 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54fb400640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54fc15f050 0x7f54fc15f4d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f54fc06f6c0 tx=0x7f54f400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54f2a00640 1 -- 172.21.15.99:0/2282022929 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4018070 con 0x7f54fc15f050 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.363+0000 7f54f2a00640 1 -- 172.21.15.99:0/2282022929 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4003b70 con 0x7f54fc15f050 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.364+0000 7f54f2a00640 1 -- 172.21.15.99:0/2282022929 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4005070 con 0x7f54fc15f050 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.364+0000 7f5501c00640 1 -- 172.21.15.99:0/2282022929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54fc158b90 con 0x7f54fc15f050 2024-03-30T13:10:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.364+0000 7f5501c00640 1 -- 172.21.15.99:0/2282022929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54fc159150 con 0x7f54fc15f050 2024-03-30T13:10:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.365+0000 7f5501c00640 1 -- 172.21.15.99:0/2282022929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54fc073a40 con 0x7f54fc15f050 2024-03-30T13:10:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.366+0000 7f54f2a00640 1 -- 172.21.15.99:0/2282022929 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f54f401b070 con 0x7f54fc15f050 2024-03-30T13:10:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.366+0000 7f54f2a00640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f54dc06c530 0x7f54dc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:47.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.367+0000 7f54f2a00640 1 -- 172.21.15.99:0/2282022929 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f54f408ae70 con 0x7f54fc15f050 2024-03-30T13:10:47.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.367+0000 7f54faa00640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f54dc06c530 0x7f54dc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:47.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.367+0000 7f54faa00640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f54dc06c530 0x7f54dc06e9f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f54ec001eb0 tx=0x7f54ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.371+0000 7f54f2a00640 1 -- 172.21.15.99:0/2282022929 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f54f40593f0 con 0x7f54fc15f050 2024-03-30T13:10:47.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:47.594+0000 7f5501c00640 1 -- 172.21.15.99:0/2282022929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f54fc04f9d0 con 0x7f54fc15f050 2024-03-30T13:10:48.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.242+0000 7f54f2a00640 1 -- 172.21.15.99:0/2282022929 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f54f4058cf0 con 0x7f54fc15f050 2024-03-30T13:10:48.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.245+0000 7f5501c00640 1 -- 172.21.15.99:0/2282022929 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f54dc06c530 msgr2=0x7f54dc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:48.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.245+0000 7f5501c00640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f54dc06c530 0x7f54dc06e9f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f54ec001eb0 tx=0x7f54ec009040 comp rx=0 tx=0).stop 2024-03-30T13:10:48.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.245+0000 7f5501c00640 1 -- 172.21.15.99:0/2282022929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54fc15f050 msgr2=0x7f54fc15f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:48.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.245+0000 7f5501c00640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54fc15f050 0x7f54fc15f4d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f54fc06f6c0 tx=0x7f54f400dc00 comp rx=0 tx=0).stop 2024-03-30T13:10:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.246+0000 7f5501c00640 1 -- 172.21.15.99:0/2282022929 shutdown_connections 2024-03-30T13:10:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.246+0000 7f5501c00640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f54dc06c530 0x7f54dc06e9f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.246+0000 7f5501c00640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54fc15f050 0x7f54fc15f4d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.246+0000 7f5501c00640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54fc1e6360 0x7f54fc157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.246+0000 7f5501c00640 1 --2- 172.21.15.99:0/2282022929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54e0004800 0x7f54fc1f7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.246+0000 7f5501c00640 1 -- 172.21.15.99:0/2282022929 >> 172.21.15.99:0/2282022929 conn(0x7f54fc06b510 msgr2=0x7f54fc06fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.246+0000 7f5501c00640 1 -- 172.21.15.99:0/2282022929 shutdown_connections 2024-03-30T13:10:48.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.246+0000 7f5501c00640 1 -- 172.21.15.99:0/2282022929 wait complete. 2024-03-30T13:10:48.271 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-30T13:10:48.271 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-30T13:10:48.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.486+0000 7fc5ed000640 1 Processor -- start 2024-03-30T13:10:48.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.486+0000 7fc5ed000640 1 -- start start 2024-03-30T13:10:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.488+0000 7fc5ed000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc5e815e920 0x7fc5e80d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.488+0000 7fc5ed000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5e80d16a0 0x7fc5e80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.488+0000 7fc5ed000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5e80d3780 con 0x7fc5e80cfde0 2024-03-30T13:10:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.488+0000 7fc5ed000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc5e815ed00 con 0x7fc5e80d16a0 2024-03-30T13:10:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.488+0000 7fc5ed000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc5e80d21e0 con 0x7fc5e815e920 2024-03-30T13:10:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.488+0000 7fc5e6800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5e80d16a0 0x7fc5e80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.488+0000 7fc5dfe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc5e80cfde0 0x7fc5e80d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54820/0 (socket says 172.21.15.99:54820) 2024-03-30T13:10:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.488+0000 7fc5dfe00640 1 -- 172.21.15.99:0/2730064808 learned_addr learned my addr 172.21.15.99:0/2730064808 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.488+0000 7fc5e5e00640 1 --2- 172.21.15.99:0/2730064808 >> v2:172.21.15.181:3300/0 conn(0x7fc5e815e920 0x7fc5e80d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.489+0000 7fc5e6800640 1 -- 172.21.15.99:0/2730064808 >> v2:172.21.15.181:3300/0 conn(0x7fc5e815e920 msgr2=0x7fc5e80d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.489+0000 7fc5e6800640 1 --2- 172.21.15.99:0/2730064808 >> v2:172.21.15.181:3300/0 conn(0x7fc5e815e920 0x7fc5e80d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.489+0000 7fc5e6800640 1 -- 172.21.15.99:0/2730064808 >> v1:172.21.15.99:6789/0 conn(0x7fc5e80cfde0 legacy=0x7fc5e80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.489+0000 7fc5e6800640 1 -- 172.21.15.99:0/2730064808 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e80d2480 con 0x7fc5e80d16a0 2024-03-30T13:10:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.490+0000 7fc5e6800640 1 --2- 172.21.15.99:0/2730064808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80d16a0 0x7fc5e80d0240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc5e808e880 tx=0x7fc5e002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e512c143d055251e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.490+0000 7fc5e5400640 1 -- 172.21.15.99:0/2730064808 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0039070 con 0x7fc5e80d16a0 2024-03-30T13:10:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.490+0000 7fc5e5400640 1 -- 172.21.15.99:0/2730064808 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e002cc70 con 0x7fc5e80d16a0 2024-03-30T13:10:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.490+0000 7fc5e5400640 1 -- 172.21.15.99:0/2730064808 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0034660 con 0x7fc5e80d16a0 2024-03-30T13:10:48.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.491+0000 7fc5ed000640 1 -- 172.21.15.99:0/2730064808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80d16a0 msgr2=0x7fc5e80d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:48.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.491+0000 7fc5ed000640 1 --2- 172.21.15.99:0/2730064808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80d16a0 0x7fc5e80d0240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc5e808e880 tx=0x7fc5e002bec0 comp rx=0 tx=0).stop 2024-03-30T13:10:48.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.491+0000 7fc5ed000640 1 -- 172.21.15.99:0/2730064808 shutdown_connections 2024-03-30T13:10:48.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.491+0000 7fc5ed000640 1 --2- 172.21.15.99:0/2730064808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80d16a0 0x7fc5e80d0240 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:48.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.491+0000 7fc5ed000640 1 --2- 172.21.15.99:0/2730064808 >> v2:172.21.15.181:3300/0 conn(0x7fc5e815e920 0x7fc5e80d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:48.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.491+0000 7fc5ed000640 1 -- 172.21.15.99:0/2730064808 >> 172.21.15.99:0/2730064808 conn(0x7fc5e808bfc0 msgr2=0x7fc5e80d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.491+0000 7fc5ed000640 1 -- 172.21.15.99:0/2730064808 shutdown_connections 2024-03-30T13:10:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.491+0000 7fc5ed000640 1 -- 172.21.15.99:0/2730064808 wait complete. 2024-03-30T13:10:48.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.493+0000 7fc5ed000640 1 Processor -- start 2024-03-30T13:10:48.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.493+0000 7fc5ed000640 1 -- start start 2024-03-30T13:10:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.494+0000 7fc5ed000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5e80cfde0 0x7fc5e80cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.494+0000 7fc5ed000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80d16a0 0x7fc5e8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.494+0000 7fc5ed000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e815e920 0x7fc5e81ea660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.494+0000 7fc5ed000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e80d2d20 con 0x7fc5e80d16a0 2024-03-30T13:10:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.494+0000 7fc5ed000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e80d2a40 con 0x7fc5e815e920 2024-03-30T13:10:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.494+0000 7fc5ed000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e80d4ef0 con 0x7fc5e80cfde0 2024-03-30T13:10:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.495+0000 7fc5dfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80d16a0 0x7fc5e8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:48.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.495+0000 7fc5dfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80d16a0 0x7fc5e8157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39926/0 (socket says 172.21.15.99:39926) 2024-03-30T13:10:48.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.495+0000 7fc5dfe00640 1 -- 172.21.15.99:0/1182196153 learned_addr learned my addr 172.21.15.99:0/1182196153 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:48.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.495+0000 7fc5e6800640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e815e920 0x7fc5e81ea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:48.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.495+0000 7fc5e5e00640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5e80cfde0 0x7fc5e80cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:48.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.495+0000 7fc5dfe00640 1 -- 172.21.15.99:0/1182196153 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5e80cfde0 msgr2=0x7fc5e80cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:48.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.495+0000 7fc5dfe00640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5e80cfde0 0x7fc5e80cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:48.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.495+0000 7fc5dfe00640 1 -- 172.21.15.99:0/1182196153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e815e920 msgr2=0x7fc5e81ea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:48.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.495+0000 7fc5dfe00640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e815e920 0x7fc5e81ea660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:48.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.495+0000 7fc5dfe00640 1 -- 172.21.15.99:0/1182196153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e80cc490 con 0x7fc5e80d16a0 2024-03-30T13:10:48.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.495+0000 7fc5dfe00640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80d16a0 0x7fc5e8157720 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000c3c0 tx=0x7fc5d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:48.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.496+0000 7fc5de000640 1 -- 172.21.15.99:0/1182196153 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0017070 con 0x7fc5e80d16a0 2024-03-30T13:10:48.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.496+0000 7fc5de000640 1 -- 172.21.15.99:0/1182196153 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5d0005ce0 con 0x7fc5e80d16a0 2024-03-30T13:10:48.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.496+0000 7fc5de000640 1 -- 172.21.15.99:0/1182196153 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d00072f0 con 0x7fc5e80d16a0 2024-03-30T13:10:48.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.496+0000 7fc5ed000640 1 -- 172.21.15.99:0/1182196153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e80cc770 con 0x7fc5e80d16a0 2024-03-30T13:10:48.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.496+0000 7fc5ed000640 1 -- 172.21.15.99:0/1182196153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e80ccd30 con 0x7fc5e80d16a0 2024-03-30T13:10:48.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.497+0000 7fc5ed000640 1 -- 172.21.15.99:0/1182196153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e80cd210 con 0x7fc5e80d16a0 2024-03-30T13:10:48.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.498+0000 7fc5de000640 1 -- 172.21.15.99:0/1182196153 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc5d001a070 con 0x7fc5e80d16a0 2024-03-30T13:10:48.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.499+0000 7fc5de000640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5c406c530 0x7fc5c406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:48.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.499+0000 7fc5de000640 1 -- 172.21.15.99:0/1182196153 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc5d008ab80 con 0x7fc5e80d16a0 2024-03-30T13:10:48.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.499+0000 7fc5e5e00640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5c406c530 0x7fc5c406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:48.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.500+0000 7fc5e5e00640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5c406c530 0x7fc5c406e9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8006fd0 tx=0x7fc5d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:48.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.507+0000 7fc5de000640 1 -- 172.21.15.99:0/1182196153 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc5e80cd210 con 0x7fc5e80d16a0 2024-03-30T13:10:48.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:48.747+0000 7fc5ed000640 1 -- 172.21.15.99:0/1182196153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc5e80a2560 con 0x7fc5e80d16a0 2024-03-30T13:10:49.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.252+0000 7fc5de000640 1 -- 172.21.15.99:0/1182196153 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fc5e80d3780 con 0x7fc5e80d16a0 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 -- 172.21.15.99:0/1182196153 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5c406c530 msgr2=0x7fc5c406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5c406c530 0x7fc5c406e9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8006fd0 tx=0x7fc5d8008040 comp rx=0 tx=0).stop 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 -- 172.21.15.99:0/1182196153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80d16a0 msgr2=0x7fc5e8157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80d16a0 0x7fc5e8157720 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000c3c0 tx=0x7fc5d000c880 comp rx=0 tx=0).stop 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 -- 172.21.15.99:0/1182196153 shutdown_connections 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5c406c530 0x7fc5c406e9f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e815e920 0x7fc5e81ea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80d16a0 0x7fc5e8157720 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 --2- 172.21.15.99:0/1182196153 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5e80cfde0 0x7fc5e80cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 -- 172.21.15.99:0/1182196153 >> 172.21.15.99:0/1182196153 conn(0x7fc5e808bfc0 msgr2=0x7fc5e80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 -- 172.21.15.99:0/1182196153 shutdown_connections 2024-03-30T13:10:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.256+0000 7fc5ed000640 1 -- 172.21.15.99:0/1182196153 wait complete. 2024-03-30T13:10:49.283 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-30T13:10:49.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:10:49.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.488+0000 7f3b05800640 1 Processor -- start 2024-03-30T13:10:49.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.488+0000 7f3b05800640 1 -- start start 2024-03-30T13:10:49.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.490+0000 7f3b05800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3b0015e930 0x7f3b000cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:49.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.490+0000 7f3b05800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b000cf670 0x7f3b000d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:49.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.490+0000 7f3b05800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b000b3c50 0x7f3b000d3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:49.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.490+0000 7f3b05800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0006c780 con 0x7f3b0015e930 2024-03-30T13:10:49.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.490+0000 7f3b05800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3b000cfb30 con 0x7f3b000cf670 2024-03-30T13:10:49.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.490+0000 7f3b05800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3b000cfe10 con 0x7f3b000b3c50 2024-03-30T13:10:49.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.490+0000 7f3afea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3b0015e930 0x7f3b000cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:49.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.490+0000 7f3afea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3b0015e930 0x7f3b000cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39936/0 (socket says 172.21.15.99:39936) 2024-03-30T13:10:49.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.490+0000 7f3afea00640 1 -- 172.21.15.99:0/2347166931 learned_addr learned my addr 172.21.15.99:0/2347166931 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:49.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.491+0000 7f3aff400640 1 --2- 172.21.15.99:0/2347166931 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b000b3c50 0x7f3b000d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:49.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.491+0000 7f3af6000640 1 --2- 172.21.15.99:0/2347166931 >> v2:172.21.15.181:3300/0 conn(0x7f3b000cf670 0x7f3b000d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.491+0000 7f3afea00640 1 -- 172.21.15.99:0/2347166931 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b000b3c50 msgr2=0x7f3b000d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.491+0000 7f3afea00640 1 --2- 172.21.15.99:0/2347166931 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b000b3c50 0x7f3b000d3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.491+0000 7f3afea00640 1 -- 172.21.15.99:0/2347166931 >> v2:172.21.15.181:3300/0 conn(0x7f3b000cf670 msgr2=0x7f3b000d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.491+0000 7f3afea00640 1 --2- 172.21.15.99:0/2347166931 >> v2:172.21.15.181:3300/0 conn(0x7f3b000cf670 0x7f3b000d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.491+0000 7f3afea00640 1 -- 172.21.15.99:0/2347166931 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b000d00f0 con 0x7f3b0015e930 2024-03-30T13:10:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.492+0000 7f3afea00640 1 --2- 172.21.15.99:0/2347166931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b0015e930 0x7f3b000cf130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b0008e610 tx=0x7f3af002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe28197dfcd0ff4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.492+0000 7f3afe000640 1 -- 172.21.15.99:0/2347166931 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af002c9e0 con 0x7f3b0015e930 2024-03-30T13:10:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.492+0000 7f3afe000640 1 -- 172.21.15.99:0/2347166931 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af002cb80 con 0x7f3b0015e930 2024-03-30T13:10:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.492+0000 7f3afe000640 1 -- 172.21.15.99:0/2347166931 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af00343f0 con 0x7f3b0015e930 2024-03-30T13:10:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.493+0000 7f3b05800640 1 -- 172.21.15.99:0/2347166931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b0015e930 msgr2=0x7f3b000cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.493+0000 7f3b05800640 1 --2- 172.21.15.99:0/2347166931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b0015e930 0x7f3b000cf130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b0008e610 tx=0x7f3af002be40 comp rx=0 tx=0).stop 2024-03-30T13:10:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.493+0000 7f3b05800640 1 -- 172.21.15.99:0/2347166931 shutdown_connections 2024-03-30T13:10:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.493+0000 7f3b05800640 1 --2- 172.21.15.99:0/2347166931 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b000b3c50 0x7f3b000d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.493+0000 7f3b05800640 1 --2- 172.21.15.99:0/2347166931 >> v2:172.21.15.181:3300/0 conn(0x7f3b000cf670 0x7f3b000d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.493+0000 7f3b05800640 1 --2- 172.21.15.99:0/2347166931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b0015e930 0x7f3b000cf130 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.493+0000 7f3b05800640 1 -- 172.21.15.99:0/2347166931 >> 172.21.15.99:0/2347166931 conn(0x7f3b0008bfc0 msgr2=0x7f3b000d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:49.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.493+0000 7f3b05800640 1 -- 172.21.15.99:0/2347166931 shutdown_connections 2024-03-30T13:10:49.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.493+0000 7f3b05800640 1 -- 172.21.15.99:0/2347166931 wait complete. 2024-03-30T13:10:49.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.495+0000 7f3b05800640 1 Processor -- start 2024-03-30T13:10:49.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.495+0000 7f3b05800640 1 -- start start 2024-03-30T13:10:49.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.496+0000 7f3b05800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b000b3c50 0x7f3b00156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:49.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.496+0000 7f3b05800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b000cf670 0x7f3b000c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:49.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.496+0000 7f3b05800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b0015e930 0x7f3b000ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:49.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.496+0000 7f3b05800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0015ee90 con 0x7f3b000cf670 2024-03-30T13:10:49.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.496+0000 7f3b05800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0015ed10 con 0x7f3b000b3c50 2024-03-30T13:10:49.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.496+0000 7f3b05800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3b000d0c50 con 0x7f3b0015e930 2024-03-30T13:10:49.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.496+0000 7f3af6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b000cf670 0x7f3b000c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:49.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.496+0000 7f3af6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b000cf670 0x7f3b000c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39948/0 (socket says 172.21.15.99:39948) 2024-03-30T13:10:49.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.496+0000 7f3af6000640 1 -- 172.21.15.99:0/3505920993 learned_addr learned my addr 172.21.15.99:0/3505920993 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3aff400640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b0015e930 0x7f3b000ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3afea00640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b000b3c50 0x7f3b00156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3af6000640 1 -- 172.21.15.99:0/3505920993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b0015e930 msgr2=0x7f3b000ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3af6000640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b0015e930 0x7f3b000ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3af6000640 1 -- 172.21.15.99:0/3505920993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b000b3c50 msgr2=0x7f3b00156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3af6000640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b000b3c50 0x7f3b00156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3af6000640 1 -- 172.21.15.99:0/3505920993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b00146870 con 0x7f3b000cf670 2024-03-30T13:10:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3af6000640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b000cf670 0x7f3b000c9d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800d800 tx=0x7f3ae800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3af7400640 1 -- 172.21.15.99:0/3505920993 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae800b6c0 con 0x7f3b000cf670 2024-03-30T13:10:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3af7400640 1 -- 172.21.15.99:0/3505920993 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae8019070 con 0x7f3b000cf670 2024-03-30T13:10:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3af7400640 1 -- 172.21.15.99:0/3505920993 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae800ba80 con 0x7f3b000cf670 2024-03-30T13:10:49.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3b05800640 1 -- 172.21.15.99:0/3505920993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b00146b50 con 0x7f3b000cf670 2024-03-30T13:10:49.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.497+0000 7f3b05800640 1 -- 172.21.15.99:0/3505920993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b00147110 con 0x7f3b000cf670 2024-03-30T13:10:49.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.498+0000 7f3b05800640 1 -- 172.21.15.99:0/3505920993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b00068640 con 0x7f3b000cf670 2024-03-30T13:10:49.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.499+0000 7f3af7400640 1 -- 172.21.15.99:0/3505920993 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3ae800bc20 con 0x7f3b000cf670 2024-03-30T13:10:49.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.501+0000 7f3af7400640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3adc06c530 0x7f3adc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:49.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.501+0000 7f3af7400640 1 -- 172.21.15.99:0/3505920993 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3ae808bbe0 con 0x7f3b000cf670 2024-03-30T13:10:49.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.501+0000 7f3afea00640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3adc06c530 0x7f3adc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:49.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.502+0000 7f3afea00640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3adc06c530 0x7f3adc06e9f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3af0035000 tx=0x7f3af0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:49.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.505+0000 7f3af7400640 1 -- 172.21.15.99:0/3505920993 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3ae805a160 con 0x7f3b000cf670 2024-03-30T13:10:49.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.744+0000 7f3b05800640 1 -- 172.21.15.99:0/3505920993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b0006d070 con 0x7f3b000cf670 2024-03-30T13:10:49.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.745+0000 7f3af7400640 1 -- 172.21.15.99:0/3505920993 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f3ae8059a60 con 0x7f3b000cf670 2024-03-30T13:10:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:49.750 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2695284429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2695284429},{"type":"v1","addr":"172.21.15.181:6835","nonce":2695284429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1658040869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1658040869},{"type":"v1","addr":"172.21.15.181:6833","nonce":1658040869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/951752489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":951752489},{"type":"v1","addr":"172.21.15.99:6835","nonce":951752489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:10:45.658137+0000","modified":"2024-03-30T13:10:48.749437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/245796495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":245796495},{"type":"v1","addr":"172.21.15.99:6837","nonce":245796495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-03-30T13:10:49.750 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.747+0000 7f3b05800640 1 -- 172.21.15.99:0/3505920993 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3adc06c530 msgr2=0x7f3adc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.747+0000 7f3b05800640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3adc06c530 0x7f3adc06e9f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3af0035000 tx=0x7f3af0030000 comp rx=0 tx=0).stop 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.747+0000 7f3b05800640 1 -- 172.21.15.99:0/3505920993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b000cf670 msgr2=0x7f3b000c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.747+0000 7f3b05800640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b000cf670 0x7f3b000c9d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800d800 tx=0x7f3ae800dcc0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.748+0000 7f3b05800640 1 -- 172.21.15.99:0/3505920993 shutdown_connections 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.748+0000 7f3b05800640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3adc06c530 0x7f3adc06e9f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.748+0000 7f3b05800640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b0015e930 0x7f3b000ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.748+0000 7f3b05800640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b000cf670 0x7f3b000c9d70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.748+0000 7f3b05800640 1 --2- 172.21.15.99:0/3505920993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b000b3c50 0x7f3b00156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.748+0000 7f3b05800640 1 -- 172.21.15.99:0/3505920993 >> 172.21.15.99:0/3505920993 conn(0x7f3b0008bfc0 msgr2=0x7f3b000b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.748+0000 7f3b05800640 1 -- 172.21.15.99:0/3505920993 shutdown_connections 2024-03-30T13:10:49.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.748+0000 7f3b05800640 1 -- 172.21.15.99:0/3505920993 wait complete. 2024-03-30T13:10:49.768 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:10:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.988+0000 7f474a400640 1 Processor -- start 2024-03-30T13:10:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.988+0000 7f474a400640 1 -- start start 2024-03-30T13:10:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.989+0000 7f474a400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47440d1150 0x7f4744162d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.989+0000 7f474a400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47440d4e20 0x7f47440d2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.989+0000 7f474a400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f47440d1530 0x7f47440d2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f474a400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f47440d06d0 con 0x7f47440d1150 2024-03-30T13:10:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f474a400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f47440d0240 con 0x7f47440d1530 2024-03-30T13:10:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f474a400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f47440cf390 con 0x7f47440d4e20 2024-03-30T13:10:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f4743400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47440d1150 0x7f4744162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f4743400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47440d1150 0x7f4744162d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39960/0 (socket says 172.21.15.99:39960) 2024-03-30T13:10:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f4743400640 1 -- 172.21.15.99:0/3716858261 learned_addr learned my addr 172.21.15.99:0/3716858261 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f4742a00640 1 --2- 172.21.15.99:0/3716858261 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47440d4e20 0x7f47440d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f4743e00640 1 --2- 172.21.15.99:0/3716858261 >> v2:172.21.15.181:3300/0 conn(0x7f47440d1530 0x7f47440d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f4743400640 1 -- 172.21.15.99:0/3716858261 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47440d4e20 msgr2=0x7f47440d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f4743400640 1 --2- 172.21.15.99:0/3716858261 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47440d4e20 0x7f47440d2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f4743400640 1 -- 172.21.15.99:0/3716858261 >> v2:172.21.15.181:3300/0 conn(0x7f47440d1530 msgr2=0x7f47440d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f4743400640 1 --2- 172.21.15.99:0/3716858261 >> v2:172.21.15.181:3300/0 conn(0x7f47440d1530 0x7f47440d2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f4743400640 1 -- 172.21.15.99:0/3716858261 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47440cf630 con 0x7f47440d1150 2024-03-30T13:10:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.990+0000 7f4743e00640 1 --2- 172.21.15.99:0/3716858261 >> v2:172.21.15.181:3300/0 conn(0x7f47440d1530 0x7f47440d2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.991+0000 7f4743400640 1 --2- 172.21.15.99:0/3716858261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47440d1150 0x7f4744162d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f474408ced0 tx=0x7f473402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dc326b9d7494d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.992+0000 7f4742000640 1 -- 172.21.15.99:0/3716858261 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734035020 con 0x7f47440d1150 2024-03-30T13:10:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.992+0000 7f4742000640 1 -- 172.21.15.99:0/3716858261 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4734031870 con 0x7f47440d1150 2024-03-30T13:10:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.992+0000 7f4742000640 1 -- 172.21.15.99:0/3716858261 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734031c40 con 0x7f47440d1150 2024-03-30T13:10:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.992+0000 7f474a400640 1 -- 172.21.15.99:0/3716858261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47440d1150 msgr2=0x7f4744162d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.992+0000 7f474a400640 1 --2- 172.21.15.99:0/3716858261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47440d1150 0x7f4744162d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f474408ced0 tx=0x7f473402b910 comp rx=0 tx=0).stop 2024-03-30T13:10:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.992+0000 7f474a400640 1 -- 172.21.15.99:0/3716858261 shutdown_connections 2024-03-30T13:10:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.992+0000 7f474a400640 1 --2- 172.21.15.99:0/3716858261 >> v2:172.21.15.181:3300/0 conn(0x7f47440d1530 0x7f47440d2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.992+0000 7f474a400640 1 --2- 172.21.15.99:0/3716858261 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47440d4e20 0x7f47440d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.992+0000 7f474a400640 1 --2- 172.21.15.99:0/3716858261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47440d1150 0x7f4744162d30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.992+0000 7f474a400640 1 -- 172.21.15.99:0/3716858261 >> 172.21.15.99:0/3716858261 conn(0x7f474408bfc0 msgr2=0x7f47440d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.993+0000 7f474a400640 1 -- 172.21.15.99:0/3716858261 shutdown_connections 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.993+0000 7f474a400640 1 -- 172.21.15.99:0/3716858261 wait complete. 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.995+0000 7f474a400640 1 Processor -- start 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.995+0000 7f474a400640 1 -- start start 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f474a400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47440d1150 0x7f47441f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f474a400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47440d1530 0x7f47441f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f474a400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47440d4e20 0x7f47440c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f474a400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f47440cfed0 con 0x7f47440d1150 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f474a400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f47440cfbf0 con 0x7f47440d1530 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f474a400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f47440d2cb0 con 0x7f47440d4e20 2024-03-30T13:10:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f4743400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47440d1150 0x7f47441f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f4743400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47440d1150 0x7f47441f4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39974/0 (socket says 172.21.15.99:39974) 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f4743400640 1 -- 172.21.15.99:0/3364975139 learned_addr learned my addr 172.21.15.99:0/3364975139 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f4743e00640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47440d4e20 0x7f47440c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f4742a00640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47440d1530 0x7f47441f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.996+0000 7f4743400640 1 -- 172.21.15.99:0/3364975139 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47440d4e20 msgr2=0x7f47440c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.997+0000 7f4743400640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47440d4e20 0x7f47440c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.997+0000 7f4743400640 1 -- 172.21.15.99:0/3364975139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47440d1530 msgr2=0x7f47441f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.997+0000 7f4743400640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47440d1530 0x7f47441f5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.997+0000 7f4743400640 1 -- 172.21.15.99:0/3364975139 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47440c83a0 con 0x7f47440d1150 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.997+0000 7f4743400640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47440d1150 0x7f47441f4710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f473402b950 tx=0x7f47340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.997+0000 7f473b400640 1 -- 172.21.15.99:0/3364975139 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734040070 con 0x7f47440d1150 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.997+0000 7f473b400640 1 -- 172.21.15.99:0/3364975139 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4734030d00 con 0x7f47440d1150 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.997+0000 7f473b400640 1 -- 172.21.15.99:0/3364975139 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734035040 con 0x7f47440d1150 2024-03-30T13:10:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.997+0000 7f474a400640 1 -- 172.21.15.99:0/3364975139 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47440c8640 con 0x7f47440d1150 2024-03-30T13:10:50.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.997+0000 7f474a400640 1 -- 172.21.15.99:0/3364975139 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47440cab50 con 0x7f47440d1150 2024-03-30T13:10:50.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.998+0000 7f474a400640 1 -- 172.21.15.99:0/3364975139 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4744068640 con 0x7f47440d1150 2024-03-30T13:10:50.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:49.999+0000 7f473b400640 1 -- 172.21.15.99:0/3364975139 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f473404b060 con 0x7f47440d1150 2024-03-30T13:10:50.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.000+0000 7f473b400640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f472406c530 0x7f472406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:50.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.000+0000 7f473b400640 1 -- 172.21.15.99:0/3364975139 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f47340ad620 con 0x7f47440d1150 2024-03-30T13:10:50.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.001+0000 7f4742a00640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f472406c530 0x7f472406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:50.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.001+0000 7f4742a00640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f472406c530 0x7f472406e9f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4730006fd0 tx=0x7f4730008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:50.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.009+0000 7f473b400640 1 -- 172.21.15.99:0/3364975139 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f473407bba0 con 0x7f47440d1150 2024-03-30T13:10:50.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.281+0000 7f474a400640 1 -- 172.21.15.99:0/3364975139 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47440d5570 con 0x7f47440d1150 2024-03-30T13:10:50.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.283+0000 7f473b400640 1 -- 172.21.15.99:0/3364975139 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16609 (secure 0 0 0) 0x7f473407b4a0 con 0x7f47440d1150 2024-03-30T13:10:50.288 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:50.288 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":22,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:47.229108+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:10:50.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 -- 172.21.15.99:0/3364975139 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f472406c530 msgr2=0x7f472406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:50.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f472406c530 0x7f472406e9f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4730006fd0 tx=0x7f4730008040 comp rx=0 tx=0).stop 2024-03-30T13:10:50.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 -- 172.21.15.99:0/3364975139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47440d1150 msgr2=0x7f47441f4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:50.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47440d1150 0x7f47441f4710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f473402b950 tx=0x7f47340046c0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 -- 172.21.15.99:0/3364975139 shutdown_connections 2024-03-30T13:10:50.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f472406c530 0x7f472406e9f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47440d4e20 0x7f47440c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47440d1530 0x7f47441f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 --2- 172.21.15.99:0/3364975139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47440d1150 0x7f47441f4710 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 -- 172.21.15.99:0/3364975139 >> 172.21.15.99:0/3364975139 conn(0x7f474408bfc0 msgr2=0x7f47440b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 -- 172.21.15.99:0/3364975139 shutdown_connections 2024-03-30T13:10:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.286+0000 7f474a400640 1 -- 172.21.15.99:0/3364975139 wait complete. 2024-03-30T13:10:50.308 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-30T13:10:50.309 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:10:50.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.507+0000 7f4560200640 1 Processor -- start 2024-03-30T13:10:50.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.507+0000 7f4560200640 1 -- start start 2024-03-30T13:10:50.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f4560200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f455815b370 0x7f45580b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:50.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f4560200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455806f3f0 0x7f4558072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:50.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f4560200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4558071ae0 con 0x7f45580730c0 2024-03-30T13:10:50.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f4560200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4558071dc0 con 0x7f455815b370 2024-03-30T13:10:50.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f4560200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f45580720a0 con 0x7f455806f3f0 2024-03-30T13:10:50.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f455d800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f455815b370 0x7f45580b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:50.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f455d800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f455815b370 0x7f45580b32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39980/0 (socket says 172.21.15.99:39980) 2024-03-30T13:10:50.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f455d800640 1 -- 172.21.15.99:0/2694880161 learned_addr learned my addr 172.21.15.99:0/2694880161 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:50.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f455d800640 1 -- 172.21.15.99:0/2694880161 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455806f3f0 msgr2=0x7f4558072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:50.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f455d800640 1 --2- 172.21.15.99:0/2694880161 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455806f3f0 0x7f4558072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f455d800640 1 -- 172.21.15.99:0/2694880161 >> v1:172.21.15.181:6789/0 conn(0x7f45580730c0 legacy=0x7f45580ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:50.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.510+0000 7f455d800640 1 -- 172.21.15.99:0/2694880161 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4558072380 con 0x7f455815b370 2024-03-30T13:10:50.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.511+0000 7f455d800640 1 --2- 172.21.15.99:0/2694880161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f455815b370 0x7f45580b32c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175dfece5a8facd0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:50.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.512+0000 7f4557e00640 1 -- 172.21.15.99:0/2694880161 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c035020 con 0x7f455815b370 2024-03-30T13:10:50.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.512+0000 7f4557e00640 1 -- 172.21.15.99:0/2694880161 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c031640 con 0x7f455815b370 2024-03-30T13:10:50.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.512+0000 7f4557e00640 1 -- 172.21.15.99:0/2694880161 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c02d040 con 0x7f455815b370 2024-03-30T13:10:50.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.513+0000 7f4560200640 1 -- 172.21.15.99:0/2694880161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f455815b370 msgr2=0x7f45580b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:50.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.513+0000 7f4560200640 1 --2- 172.21.15.99:0/2694880161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f455815b370 0x7f45580b32c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.513+0000 7f4560200640 1 -- 172.21.15.99:0/2694880161 shutdown_connections 2024-03-30T13:10:50.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.513+0000 7f4560200640 1 --2- 172.21.15.99:0/2694880161 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455806f3f0 0x7f4558072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.513+0000 7f4560200640 1 --2- 172.21.15.99:0/2694880161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f455815b370 0x7f45580b32c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.513+0000 7f4560200640 1 -- 172.21.15.99:0/2694880161 >> 172.21.15.99:0/2694880161 conn(0x7f455806b510 msgr2=0x7f455806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:50.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.513+0000 7f4560200640 1 -- 172.21.15.99:0/2694880161 shutdown_connections 2024-03-30T13:10:50.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.513+0000 7f4560200640 1 -- 172.21.15.99:0/2694880161 wait complete. 2024-03-30T13:10:50.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.515+0000 7f4560200640 1 Processor -- start 2024-03-30T13:10:50.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.515+0000 7f4560200640 1 -- start start 2024-03-30T13:10:50.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f4560200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455806f3f0 0x7f45581f8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:50.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f4560200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45580730c0 0x7f45580cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f4560200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f455815b370 0x7f455814e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f4560200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f45580b3800 con 0x7f45580730c0 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f4560200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4558073550 con 0x7f455815b370 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f4560200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f45580b3980 con 0x7f455806f3f0 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f455ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45580730c0 0x7f45580cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f455ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45580730c0 0x7f45580cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39982/0 (socket says 172.21.15.99:39982) 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f455ce00640 1 -- 172.21.15.99:0/134415418 learned_addr learned my addr 172.21.15.99:0/134415418 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f455d800640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455806f3f0 0x7f45581f8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f455e200640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f455815b370 0x7f455814e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f455ce00640 1 -- 172.21.15.99:0/134415418 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455806f3f0 msgr2=0x7f45581f8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f455ce00640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455806f3f0 0x7f45581f8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f455ce00640 1 -- 172.21.15.99:0/134415418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f455815b370 msgr2=0x7f455814e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.516+0000 7f455ce00640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f455815b370 0x7f455814e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.517+0000 7f455ce00640 1 -- 172.21.15.99:0/134415418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45580cce40 con 0x7f45580730c0 2024-03-30T13:10:50.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.517+0000 7f455ce00640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45580730c0 0x7f45580cbde0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f454400b4a0 tx=0x7f454400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:50.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.517+0000 7f4555600640 1 -- 172.21.15.99:0/134415418 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4544014070 con 0x7f45580730c0 2024-03-30T13:10:50.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.517+0000 7f4555600640 1 -- 172.21.15.99:0/134415418 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4544010610 con 0x7f45580730c0 2024-03-30T13:10:50.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.517+0000 7f4555600640 1 -- 172.21.15.99:0/134415418 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4544010a00 con 0x7f45580730c0 2024-03-30T13:10:50.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.517+0000 7f4560200640 1 -- 172.21.15.99:0/134415418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45580cd120 con 0x7f45580730c0 2024-03-30T13:10:50.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.517+0000 7f4560200640 1 -- 172.21.15.99:0/134415418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45580cd6e0 con 0x7f45580730c0 2024-03-30T13:10:50.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.518+0000 7f4560200640 1 -- 172.21.15.99:0/134415418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4558068640 con 0x7f45580730c0 2024-03-30T13:10:50.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.519+0000 7f4555600640 1 -- 172.21.15.99:0/134415418 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4544017070 con 0x7f45580730c0 2024-03-30T13:10:50.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.520+0000 7f4555600640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f453806c530 0x7f453806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:50.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.520+0000 7f4555600640 1 -- 172.21.15.99:0/134415418 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f454408b230 con 0x7f45580730c0 2024-03-30T13:10:50.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.520+0000 7f455d800640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f453806c530 0x7f453806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:50.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.521+0000 7f455d800640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f453806c530 0x7f453806e9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f454c036000 tx=0x7f454c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:50.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.525+0000 7f4555600640 1 -- 172.21.15.99:0/134415418 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f45440597b0 con 0x7f45580730c0 2024-03-30T13:10:50.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.720+0000 7f4560200640 1 -- 172.21.15.99:0/134415418 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45580d0000 con 0x7f453806c530 2024-03-30T13:10:50.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.741+0000 7f4555600640 1 -- 172.21.15.99:0/134415418 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245585 (secure 0 0 0) 0x7f45580d0000 con 0x7f453806c530 2024-03-30T13:10:50.750 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:50.751 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:10:50.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 -- 172.21.15.99:0/134415418 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f453806c530 msgr2=0x7f453806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:50.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f453806c530 0x7f453806e9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f454c036000 tx=0x7f454c03c040 comp rx=0 tx=0).stop 2024-03-30T13:10:50.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 -- 172.21.15.99:0/134415418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45580730c0 msgr2=0x7f45580cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:50.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45580730c0 0x7f45580cbde0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f454400b4a0 tx=0x7f454400b960 comp rx=0 tx=0).stop 2024-03-30T13:10:50.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 -- 172.21.15.99:0/134415418 shutdown_connections 2024-03-30T13:10:50.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f453806c530 0x7f453806e9f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f455815b370 0x7f455814e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45580730c0 0x7f45580cbde0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 --2- 172.21.15.99:0/134415418 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455806f3f0 0x7f45581f8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:50.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 -- 172.21.15.99:0/134415418 >> 172.21.15.99:0/134415418 conn(0x7f455806b510 msgr2=0x7f45580aef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:50.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 -- 172.21.15.99:0/134415418 shutdown_connections 2024-03-30T13:10:50.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:50.748+0000 7f4560200640 1 -- 172.21.15.99:0/134415418 wait complete. 2024-03-30T13:10:50.771 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-30T13:10:49.435317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":2676,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":2740224,"data_stored":1671280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.258468"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282177+0000","last_change":"2024-03-30T13:10:46.238313+0000","last_active":"2024-03-30T13:10:48.282177+0000","last_peered":"2024-03-30T13:10:48.282177+0000","last_clean":"2024-03-30T13:10:48.282177+0000","last_became_active":"2024-03-30T13:10:46.238010+0000","last_became_peered":"2024-03-30T13:10:46.238010+0000","last_unstale":"2024-03-30T13:10:48.282177+0000","last_undegraded":"2024-03-30T13:10:48.282177+0000","last_fullsized":"2024-03-30T13:10:48.282177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281389+0000","last_change":"2024-03-30T13:10:46.241744+0000","last_active":"2024-03-30T13:10:48.281389+0000","last_peered":"2024-03-30T13:10:48.281389+0000","last_clean":"2024-03-30T13:10:48.281389+0000","last_became_active":"2024-03-30T13:10:46.241480+0000","last_became_peered":"2024-03-30T13:10:46.241480+0000","last_unstale":"2024-03-30T13:10:48.281389+0000","last_undegraded":"2024-03-30T13:10:48.281389+0000","last_fullsized":"2024-03-30T13:10:48.281389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280766+0000","last_change":"2024-03-30T13:10:46.255145+0000","last_active":"2024-03-30T13:10:48.280766+0000","last_peered":"2024-03-30T13:10:48.280766+0000","last_clean":"2024-03-30T13:10:48.280766+0000","last_became_active":"2024-03-30T13:10:46.254848+0000","last_became_peered":"2024-03-30T13:10:46.254848+0000","last_unstale":"2024-03-30T13:10:48.280766+0000","last_undegraded":"2024-03-30T13:10:48.280766+0000","last_fullsized":"2024-03-30T13:10:48.280766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248585+0000","last_change":"2024-03-30T13:10:46.240158+0000","last_active":"2024-03-30T13:10:47.248585+0000","last_peered":"2024-03-30T13:10:47.248585+0000","last_clean":"2024-03-30T13:10:47.248585+0000","last_became_active":"2024-03-30T13:10:46.235455+0000","last_became_peered":"2024-03-30T13:10:46.235455+0000","last_unstale":"2024-03-30T13:10:47.248585+0000","last_undegraded":"2024-03-30T13:10:47.248585+0000","last_fullsized":"2024-03-30T13:10:47.248585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:00.666500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248107+0000","last_change":"2024-03-30T13:10:46.243687+0000","last_active":"2024-03-30T13:10:47.248107+0000","last_peered":"2024-03-30T13:10:47.248107+0000","last_clean":"2024-03-30T13:10:47.248107+0000","last_became_active":"2024-03-30T13:10:46.243389+0000","last_became_peered":"2024-03-30T13:10:46.243389+0000","last_unstale":"2024-03-30T13:10:47.248107+0000","last_undegraded":"2024-03-30T13:10:47.248107+0000","last_fullsized":"2024-03-30T13:10:47.248107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280718+0000","last_change":"2024-03-30T13:10:46.256471+0000","last_active":"2024-03-30T13:10:48.280718+0000","last_peered":"2024-03-30T13:10:48.280718+0000","last_clean":"2024-03-30T13:10:48.280718+0000","last_became_active":"2024-03-30T13:10:46.256215+0000","last_became_peered":"2024-03-30T13:10:46.256215+0000","last_unstale":"2024-03-30T13:10:48.280718+0000","last_undegraded":"2024-03-30T13:10:48.280718+0000","last_fullsized":"2024-03-30T13:10:48.280718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.258357+0000","last_change":"2024-03-30T13:10:46.253562+0000","last_active":"2024-03-30T13:10:46.258357+0000","last_peered":"2024-03-30T13:10:46.258357+0000","last_clean":"2024-03-30T13:10:46.258357+0000","last_became_active":"2024-03-30T13:10:46.253288+0000","last_became_peered":"2024-03-30T13:10:46.253288+0000","last_unstale":"2024-03-30T13:10:46.258357+0000","last_undegraded":"2024-03-30T13:10:46.258357+0000","last_fullsized":"2024-03-30T13:10:46.258357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:44:49.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250207+0000","last_change":"2024-03-30T13:10:46.243487+0000","last_active":"2024-03-30T13:10:47.250207+0000","last_peered":"2024-03-30T13:10:47.250207+0000","last_clean":"2024-03-30T13:10:47.250207+0000","last_became_active":"2024-03-30T13:10:46.243102+0000","last_became_peered":"2024-03-30T13:10:46.243102+0000","last_unstale":"2024-03-30T13:10:47.250207+0000","last_undegraded":"2024-03-30T13:10:47.250207+0000","last_fullsized":"2024-03-30T13:10:47.250207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280858+0000","last_change":"2024-03-30T13:10:46.247945+0000","last_active":"2024-03-30T13:10:48.280858+0000","last_peered":"2024-03-30T13:10:48.280858+0000","last_clean":"2024-03-30T13:10:48.280858+0000","last_became_active":"2024-03-30T13:10:46.247685+0000","last_became_peered":"2024-03-30T13:10:46.247685+0000","last_unstale":"2024-03-30T13:10:48.280858+0000","last_undegraded":"2024-03-30T13:10:48.280858+0000","last_fullsized":"2024-03-30T13:10:48.280858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282406+0000","last_change":"2024-03-30T13:10:46.249445+0000","last_active":"2024-03-30T13:10:48.282406+0000","last_peered":"2024-03-30T13:10:48.282406+0000","last_clean":"2024-03-30T13:10:48.282406+0000","last_became_active":"2024-03-30T13:10:46.249008+0000","last_became_peered":"2024-03-30T13:10:46.249008+0000","last_unstale":"2024-03-30T13:10:48.282406+0000","last_undegraded":"2024-03-30T13:10:48.282406+0000","last_fullsized":"2024-03-30T13:10:48.282406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248607+0000","last_change":"2024-03-30T13:10:46.243725+0000","last_active":"2024-03-30T13:10:47.248607+0000","last_peered":"2024-03-30T13:10:47.248607+0000","last_clean":"2024-03-30T13:10:47.248607+0000","last_became_active":"2024-03-30T13:10:46.243423+0000","last_became_peered":"2024-03-30T13:10:46.243423+0000","last_unstale":"2024-03-30T13:10:47.248607+0000","last_undegraded":"2024-03-30T13:10:47.248607+0000","last_fullsized":"2024-03-30T13:10:47.248607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248584+0000","last_change":"2024-03-30T13:10:46.254386+0000","last_active":"2024-03-30T13:10:47.248584+0000","last_peered":"2024-03-30T13:10:47.248584+0000","last_clean":"2024-03-30T13:10:47.248584+0000","last_became_active":"2024-03-30T13:10:46.254081+0000","last_became_peered":"2024-03-30T13:10:46.254081+0000","last_unstale":"2024-03-30T13:10:47.248584+0000","last_undegraded":"2024-03-30T13:10:47.248584+0000","last_fullsized":"2024-03-30T13:10:47.248584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281880+0000","last_change":"2024-03-30T13:10:46.246367+0000","last_active":"2024-03-30T13:10:48.281880+0000","last_peered":"2024-03-30T13:10:48.281880+0000","last_clean":"2024-03-30T13:10:48.281880+0000","last_became_active":"2024-03-30T13:10:46.246066+0000","last_became_peered":"2024-03-30T13:10:46.246066+0000","last_unstale":"2024-03-30T13:10:48.281880+0000","last_undegraded":"2024-03-30T13:10:48.281880+0000","last_fullsized":"2024-03-30T13:10:48.281880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.256707+0000","last_change":"2024-03-30T13:10:46.247881+0000","last_active":"2024-03-30T13:10:46.256707+0000","last_peered":"2024-03-30T13:10:46.256707+0000","last_clean":"2024-03-30T13:10:46.256707+0000","last_became_active":"2024-03-30T13:10:46.247618+0000","last_became_peered":"2024-03-30T13:10:46.247618+0000","last_unstale":"2024-03-30T13:10:46.256707+0000","last_undegraded":"2024-03-30T13:10:46.256707+0000","last_fullsized":"2024-03-30T13:10:46.256707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:32.391989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282213+0000","last_change":"2024-03-30T13:10:45.225591+0000","last_active":"2024-03-30T13:10:48.282213+0000","last_peered":"2024-03-30T13:10:48.282213+0000","last_clean":"2024-03-30T13:10:48.282213+0000","last_became_active":"2024-03-30T13:10:45.224943+0000","last_became_peered":"2024-03-30T13:10:45.224943+0000","last_unstale":"2024-03-30T13:10:48.282213+0000","last_undegraded":"2024-03-30T13:10:48.282213+0000","last_fullsized":"2024-03-30T13:10:48.282213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250237+0000","last_change":"2024-03-30T13:10:46.260952+0000","last_active":"2024-03-30T13:10:47.250237+0000","last_peered":"2024-03-30T13:10:47.250237+0000","last_clean":"2024-03-30T13:10:47.250237+0000","last_became_active":"2024-03-30T13:10:46.260001+0000","last_became_peered":"2024-03-30T13:10:46.260001+0000","last_unstale":"2024-03-30T13:10:47.250237+0000","last_undegraded":"2024-03-30T13:10:47.250237+0000","last_fullsized":"2024-03-30T13:10:47.250237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.191443+0000","last_change":"2024-03-30T13:10:44.191443+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.191443+0000","last_undegraded":"2024-03-30T13:10:44.191443+0000","last_fullsized":"2024-03-30T13:10:44.191443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247862+0000","last_change":"2024-03-30T13:10:45.211201+0000","last_active":"2024-03-30T13:10:47.247862+0000","last_peered":"2024-03-30T13:10:47.247862+0000","last_clean":"2024-03-30T13:10:47.247862+0000","last_became_active":"2024-03-30T13:10:45.210742+0000","last_became_peered":"2024-03-30T13:10:45.210742+0000","last_unstale":"2024-03-30T13:10:47.247862+0000","last_undegraded":"2024-03-30T13:10:47.247862+0000","last_fullsized":"2024-03-30T13:10:47.247862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281386+0000","last_change":"2024-03-30T13:10:46.236372+0000","last_active":"2024-03-30T13:10:48.281386+0000","last_peered":"2024-03-30T13:10:48.281386+0000","last_clean":"2024-03-30T13:10:48.281386+0000","last_became_active":"2024-03-30T13:10:46.236108+0000","last_became_peered":"2024-03-30T13:10:46.236108+0000","last_unstale":"2024-03-30T13:10:48.281386+0000","last_undegraded":"2024-03-30T13:10:48.281386+0000","last_fullsized":"2024-03-30T13:10:48.281386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.194277+0000","last_change":"2024-03-30T13:10:44.194277+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.194277+0000","last_undegraded":"2024-03-30T13:10:44.194277+0000","last_fullsized":"2024-03-30T13:10:44.194277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249908+0000","last_change":"2024-03-30T13:10:46.247867+0000","last_active":"2024-03-30T13:10:47.249908+0000","last_peered":"2024-03-30T13:10:47.249908+0000","last_clean":"2024-03-30T13:10:47.249908+0000","last_became_active":"2024-03-30T13:10:46.246955+0000","last_became_peered":"2024-03-30T13:10:46.246955+0000","last_unstale":"2024-03-30T13:10:47.249908+0000","last_undegraded":"2024-03-30T13:10:47.249908+0000","last_fullsized":"2024-03-30T13:10:47.249908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.190033+0000","last_change":"2024-03-30T13:10:44.190033+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.190033+0000","last_undegraded":"2024-03-30T13:10:44.190033+0000","last_fullsized":"2024-03-30T13:10:44.190033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.181543+0000","last_change":"2024-03-30T13:10:44.181543+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.181543+0000","last_undegraded":"2024-03-30T13:10:44.181543+0000","last_fullsized":"2024-03-30T13:10:44.181543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282464+0000","last_change":"2024-03-30T13:10:46.241152+0000","last_active":"2024-03-30T13:10:48.282464+0000","last_peered":"2024-03-30T13:10:48.282464+0000","last_clean":"2024-03-30T13:10:48.282464+0000","last_became_active":"2024-03-30T13:10:46.240813+0000","last_became_peered":"2024-03-30T13:10:46.240813+0000","last_unstale":"2024-03-30T13:10:48.282464+0000","last_undegraded":"2024-03-30T13:10:48.282464+0000","last_fullsized":"2024-03-30T13:10:48.282464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.260991+0000","last_change":"2024-03-30T13:10:45.227319+0000","last_active":"2024-03-30T13:10:46.260991+0000","last_peered":"2024-03-30T13:10:46.260991+0000","last_clean":"2024-03-30T13:10:46.260991+0000","last_became_active":"2024-03-30T13:10:45.226913+0000","last_became_peered":"2024-03-30T13:10:45.226913+0000","last_unstale":"2024-03-30T13:10:46.260991+0000","last_undegraded":"2024-03-30T13:10:46.260991+0000","last_fullsized":"2024-03-30T13:10:46.260991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:22.060387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.186805+0000","last_change":"2024-03-30T13:10:44.186805+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.186805+0000","last_undegraded":"2024-03-30T13:10:44.186805+0000","last_fullsized":"2024-03-30T13:10:44.186805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.266262+0000","last_change":"2024-03-30T13:10:45.222380+0000","last_active":"2024-03-30T13:10:46.266262+0000","last_peered":"2024-03-30T13:10:46.266262+0000","last_clean":"2024-03-30T13:10:46.266262+0000","last_became_active":"2024-03-30T13:10:45.221975+0000","last_became_peered":"2024-03-30T13:10:45.221975+0000","last_unstale":"2024-03-30T13:10:46.266262+0000","last_undegraded":"2024-03-30T13:10:46.266262+0000","last_fullsized":"2024-03-30T13:10:46.266262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:26:59.790496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248472+0000","last_change":"2024-03-30T13:10:46.232634+0000","last_active":"2024-03-30T13:10:47.248472+0000","last_peered":"2024-03-30T13:10:47.248472+0000","last_clean":"2024-03-30T13:10:47.248472+0000","last_became_active":"2024-03-30T13:10:46.232300+0000","last_became_peered":"2024-03-30T13:10:46.232300+0000","last_unstale":"2024-03-30T13:10:47.248472+0000","last_undegraded":"2024-03-30T13:10:47.248472+0000","last_fullsized":"2024-03-30T13:10:47.248472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.190665+0000","last_change":"2024-03-30T13:10:44.190665+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.190665+0000","last_undegraded":"2024-03-30T13:10:44.190665+0000","last_fullsized":"2024-03-30T13:10:44.190665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.181536+0000","last_change":"2024-03-30T13:10:44.181536+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.181536+0000","last_undegraded":"2024-03-30T13:10:44.181536+0000","last_fullsized":"2024-03-30T13:10:44.181536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249704+0000","last_change":"2024-03-30T13:10:45.221532+0000","last_active":"2024-03-30T13:10:47.249704+0000","last_peered":"2024-03-30T13:10:47.249704+0000","last_clean":"2024-03-30T13:10:47.249704+0000","last_became_active":"2024-03-30T13:10:45.220536+0000","last_became_peered":"2024-03-30T13:10:45.220536+0000","last_unstale":"2024-03-30T13:10:47.249704+0000","last_undegraded":"2024-03-30T13:10:47.249704+0000","last_fullsized":"2024-03-30T13:10:47.249704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.183319+0000","last_change":"2024-03-30T13:10:44.183319+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.183319+0000","last_undegraded":"2024-03-30T13:10:44.183319+0000","last_fullsized":"2024-03-30T13:10:44.183319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250809+0000","last_change":"2024-03-30T13:10:45.224819+0000","last_active":"2024-03-30T13:10:47.250809+0000","last_peered":"2024-03-30T13:10:47.250809+0000","last_clean":"2024-03-30T13:10:47.250809+0000","last_became_active":"2024-03-30T13:10:45.223270+0000","last_became_peered":"2024-03-30T13:10:45.223270+0000","last_unstale":"2024-03-30T13:10:47.250809+0000","last_undegraded":"2024-03-30T13:10:47.250809+0000","last_fullsized":"2024-03-30T13:10:47.250809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282278+0000","last_change":"2024-03-30T13:10:45.225766+0000","last_active":"2024-03-30T13:10:48.282278+0000","last_peered":"2024-03-30T13:10:48.282278+0000","last_clean":"2024-03-30T13:10:48.282278+0000","last_became_active":"2024-03-30T13:10:45.225096+0000","last_became_peered":"2024-03-30T13:10:45.225096+0000","last_unstale":"2024-03-30T13:10:48.282278+0000","last_undegraded":"2024-03-30T13:10:48.282278+0000","last_fullsized":"2024-03-30T13:10:48.282278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248851+0000","last_change":"2024-03-30T13:10:45.210147+0000","last_active":"2024-03-30T13:10:47.248851+0000","last_peered":"2024-03-30T13:10:47.248851+0000","last_clean":"2024-03-30T13:10:47.248851+0000","last_became_active":"2024-03-30T13:10:45.209716+0000","last_became_peered":"2024-03-30T13:10:45.209716+0000","last_unstale":"2024-03-30T13:10:47.248851+0000","last_undegraded":"2024-03-30T13:10:47.248851+0000","last_fullsized":"2024-03-30T13:10:47.248851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:10:44.189763+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:10:44.189763+0000","last_peered":"2024-03-30T13:10:44.189763+0000","last_clean":"2024-03-30T13:10:44.189763+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:10:44.189763+0000","last_undegraded":"2024-03-30T13:10:44.189763+0000","last_fullsized":"2024-03-30T13:10:44.189763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.189632+0000","last_change":"2024-03-30T13:10:44.189632+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.189632+0000","last_undegraded":"2024-03-30T13:10:44.189632+0000","last_fullsized":"2024-03-30T13:10:44.189632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249967+0000","last_change":"2024-03-30T13:10:46.243383+0000","last_active":"2024-03-30T13:10:47.249967+0000","last_peered":"2024-03-30T13:10:47.249967+0000","last_clean":"2024-03-30T13:10:47.249967+0000","last_became_active":"2024-03-30T13:10:46.243046+0000","last_became_peered":"2024-03-30T13:10:46.243046+0000","last_unstale":"2024-03-30T13:10:47.249967+0000","last_undegraded":"2024-03-30T13:10:47.249967+0000","last_fullsized":"2024-03-30T13:10:47.249967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.191926+0000","last_change":"2024-03-30T13:10:44.191926+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.191926+0000","last_undegraded":"2024-03-30T13:10:44.191926+0000","last_fullsized":"2024-03-30T13:10:44.191926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247995+0000","last_change":"2024-03-30T13:10:46.239001+0000","last_active":"2024-03-30T13:10:47.247995+0000","last_peered":"2024-03-30T13:10:47.247995+0000","last_clean":"2024-03-30T13:10:47.247995+0000","last_became_active":"2024-03-30T13:10:46.238750+0000","last_became_peered":"2024-03-30T13:10:46.238750+0000","last_unstale":"2024-03-30T13:10:47.247995+0000","last_undegraded":"2024-03-30T13:10:47.247995+0000","last_fullsized":"2024-03-30T13:10:47.247995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.235562+0000","last_change":"2024-03-30T13:10:45.223067+0000","last_active":"2024-03-30T13:10:46.235562+0000","last_peered":"2024-03-30T13:10:46.235562+0000","last_clean":"2024-03-30T13:10:46.235562+0000","last_became_active":"2024-03-30T13:10:45.222778+0000","last_became_peered":"2024-03-30T13:10:45.222778+0000","last_unstale":"2024-03-30T13:10:46.235562+0000","last_undegraded":"2024-03-30T13:10:46.235562+0000","last_fullsized":"2024-03-30T13:10:46.235562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:35:37.871387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280762+0000","last_change":"2024-03-30T13:10:46.246374+0000","last_active":"2024-03-30T13:10:48.280762+0000","last_peered":"2024-03-30T13:10:48.280762+0000","last_clean":"2024-03-30T13:10:48.280762+0000","last_became_active":"2024-03-30T13:10:46.246094+0000","last_became_peered":"2024-03-30T13:10:46.246094+0000","last_unstale":"2024-03-30T13:10:48.280762+0000","last_undegraded":"2024-03-30T13:10:48.280762+0000","last_fullsized":"2024-03-30T13:10:48.280762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.189818+0000","last_change":"2024-03-30T13:10:44.189818+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.189818+0000","last_undegraded":"2024-03-30T13:10:44.189818+0000","last_fullsized":"2024-03-30T13:10:44.189818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281281+0000","last_change":"2024-03-30T13:10:45.225647+0000","last_active":"2024-03-30T13:10:48.281281+0000","last_peered":"2024-03-30T13:10:48.281281+0000","last_clean":"2024-03-30T13:10:48.281281+0000","last_became_active":"2024-03-30T13:10:45.225066+0000","last_became_peered":"2024-03-30T13:10:45.225066+0000","last_unstale":"2024-03-30T13:10:48.281281+0000","last_undegraded":"2024-03-30T13:10:48.281281+0000","last_fullsized":"2024-03-30T13:10:48.281281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.192044+0000","last_change":"2024-03-30T13:10:44.192044+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.192044+0000","last_undegraded":"2024-03-30T13:10:44.192044+0000","last_fullsized":"2024-03-30T13:10:44.192044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248726+0000","last_change":"2024-03-30T13:10:46.234095+0000","last_active":"2024-03-30T13:10:47.248726+0000","last_peered":"2024-03-30T13:10:47.248726+0000","last_clean":"2024-03-30T13:10:47.248726+0000","last_became_active":"2024-03-30T13:10:46.233686+0000","last_became_peered":"2024-03-30T13:10:46.233686+0000","last_unstale":"2024-03-30T13:10:47.248726+0000","last_undegraded":"2024-03-30T13:10:47.248726+0000","last_fullsized":"2024-03-30T13:10:47.248726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.253768+0000","last_change":"2024-03-30T13:10:45.216838+0000","last_active":"2024-03-30T13:10:47.253768+0000","last_peered":"2024-03-30T13:10:47.253768+0000","last_clean":"2024-03-30T13:10:47.253768+0000","last_became_active":"2024-03-30T13:10:45.216528+0000","last_became_peered":"2024-03-30T13:10:45.216528+0000","last_unstale":"2024-03-30T13:10:47.253768+0000","last_undegraded":"2024-03-30T13:10:47.253768+0000","last_fullsized":"2024-03-30T13:10:47.253768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251100+0000","last_change":"2024-03-30T13:10:46.243883+0000","last_active":"2024-03-30T13:10:47.251100+0000","last_peered":"2024-03-30T13:10:47.251100+0000","last_clean":"2024-03-30T13:10:47.251100+0000","last_became_active":"2024-03-30T13:10:46.243583+0000","last_became_peered":"2024-03-30T13:10:46.243583+0000","last_unstale":"2024-03-30T13:10:47.251100+0000","last_undegraded":"2024-03-30T13:10:47.251100+0000","last_fullsized":"2024-03-30T13:10:47.251100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.189465+0000","last_change":"2024-03-30T13:10:44.189465+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.189465+0000","last_undegraded":"2024-03-30T13:10:44.189465+0000","last_fullsized":"2024-03-30T13:10:44.189465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250903+0000","last_change":"2024-03-30T13:10:46.248800+0000","last_active":"2024-03-30T13:10:47.250903+0000","last_peered":"2024-03-30T13:10:47.250903+0000","last_clean":"2024-03-30T13:10:47.250903+0000","last_became_active":"2024-03-30T13:10:46.248344+0000","last_became_peered":"2024-03-30T13:10:46.248344+0000","last_unstale":"2024-03-30T13:10:47.250903+0000","last_undegraded":"2024-03-30T13:10:47.250903+0000","last_fullsized":"2024-03-30T13:10:47.250903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.181257+0000","last_change":"2024-03-30T13:10:44.181257+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.181257+0000","last_undegraded":"2024-03-30T13:10:44.181257+0000","last_fullsized":"2024-03-30T13:10:44.181257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250156+0000","last_change":"2024-03-30T13:10:45.223756+0000","last_active":"2024-03-30T13:10:47.250156+0000","last_peered":"2024-03-30T13:10:47.250156+0000","last_clean":"2024-03-30T13:10:47.250156+0000","last_became_active":"2024-03-30T13:10:45.222236+0000","last_became_peered":"2024-03-30T13:10:45.222236+0000","last_unstale":"2024-03-30T13:10:47.250156+0000","last_undegraded":"2024-03-30T13:10:47.250156+0000","last_fullsized":"2024-03-30T13:10:47.250156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250500+0000","last_change":"2024-03-30T13:10:46.250939+0000","last_active":"2024-03-30T13:10:47.250500+0000","last_peered":"2024-03-30T13:10:47.250500+0000","last_clean":"2024-03-30T13:10:47.250500+0000","last_became_active":"2024-03-30T13:10:46.250651+0000","last_became_peered":"2024-03-30T13:10:46.250651+0000","last_unstale":"2024-03-30T13:10:47.250500+0000","last_undegraded":"2024-03-30T13:10:47.250500+0000","last_fullsized":"2024-03-30T13:10:47.250500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248428+0000","last_change":"2024-03-30T13:10:45.222799+0000","last_active":"2024-03-30T13:10:47.248428+0000","last_peered":"2024-03-30T13:10:47.248428+0000","last_clean":"2024-03-30T13:10:47.248428+0000","last_became_active":"2024-03-30T13:10:45.221899+0000","last_became_peered":"2024-03-30T13:10:45.221899+0000","last_unstale":"2024-03-30T13:10:47.248428+0000","last_undegraded":"2024-03-30T13:10:47.248428+0000","last_fullsized":"2024-03-30T13:10:47.248428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.250423+0000","last_change":"2024-03-30T13:10:46.245047+0000","last_active":"2024-03-30T13:10:46.250423+0000","last_peered":"2024-03-30T13:10:46.250423+0000","last_clean":"2024-03-30T13:10:46.250423+0000","last_became_active":"2024-03-30T13:10:46.244170+0000","last_became_peered":"2024-03-30T13:10:46.244170+0000","last_unstale":"2024-03-30T13:10:46.250423+0000","last_undegraded":"2024-03-30T13:10:46.250423+0000","last_fullsized":"2024-03-30T13:10:46.250423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:27:43.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.190357+0000","last_change":"2024-03-30T13:10:44.190357+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.190357+0000","last_undegraded":"2024-03-30T13:10:44.190357+0000","last_fullsized":"2024-03-30T13:10:44.190357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.182080+0000","last_change":"2024-03-30T13:10:44.182080+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.182080+0000","last_undegraded":"2024-03-30T13:10:44.182080+0000","last_fullsized":"2024-03-30T13:10:44.182080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.182374+0000","last_change":"2024-03-30T13:10:44.182374+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.182374+0000","last_undegraded":"2024-03-30T13:10:44.182374+0000","last_fullsized":"2024-03-30T13:10:44.182374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281962+0000","last_change":"2024-03-30T13:10:46.249303+0000","last_active":"2024-03-30T13:10:48.281962+0000","last_peered":"2024-03-30T13:10:48.281962+0000","last_clean":"2024-03-30T13:10:48.281962+0000","last_became_active":"2024-03-30T13:10:46.248971+0000","last_became_peered":"2024-03-30T13:10:46.248971+0000","last_unstale":"2024-03-30T13:10:48.281962+0000","last_undegraded":"2024-03-30T13:10:48.281962+0000","last_fullsized":"2024-03-30T13:10:48.281962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282831+0000","last_change":"2024-03-30T13:10:45.222811+0000","last_active":"2024-03-30T13:10:48.282831+0000","last_peered":"2024-03-30T13:10:48.282831+0000","last_clean":"2024-03-30T13:10:48.282831+0000","last_became_active":"2024-03-30T13:10:45.222439+0000","last_became_peered":"2024-03-30T13:10:45.222439+0000","last_unstale":"2024-03-30T13:10:48.282831+0000","last_undegraded":"2024-03-30T13:10:48.282831+0000","last_fullsized":"2024-03-30T13:10:48.282831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282474+0000","last_change":"2024-03-30T13:10:46.242067+0000","last_active":"2024-03-30T13:10:48.282474+0000","last_peered":"2024-03-30T13:10:48.282474+0000","last_clean":"2024-03-30T13:10:48.282474+0000","last_became_active":"2024-03-30T13:10:46.241783+0000","last_became_peered":"2024-03-30T13:10:46.241783+0000","last_unstale":"2024-03-30T13:10:48.282474+0000","last_undegraded":"2024-03-30T13:10:48.282474+0000","last_fullsized":"2024-03-30T13:10:48.282474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251193+0000","last_change":"2024-03-30T13:10:45.221172+0000","last_active":"2024-03-30T13:10:47.251193+0000","last_peered":"2024-03-30T13:10:47.251193+0000","last_clean":"2024-03-30T13:10:47.251193+0000","last_became_active":"2024-03-30T13:10:45.220799+0000","last_became_peered":"2024-03-30T13:10:45.220799+0000","last_unstale":"2024-03-30T13:10:47.251193+0000","last_undegraded":"2024-03-30T13:10:47.251193+0000","last_fullsized":"2024-03-30T13:10:47.251193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":4},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":49997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":49997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476740,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":761856,"data_stored":640365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":49997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":659324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":77448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":68988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:10:50.778 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:10:51.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.016+0000 7fcbb4800640 1 Processor -- start 2024-03-30T13:10:51.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.017+0000 7fcbb4800640 1 -- start start 2024-03-30T13:10:51.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.018+0000 7fcbb4800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbac15e6e0 0x7fcbac09b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.018+0000 7fcbb4800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbac0d1a10 con 0x7fcbac0d0660 2024-03-30T13:10:51.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.018+0000 7fcbb4800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbac0d0e90 con 0x7fcbac162ab0 2024-03-30T13:10:51.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.018+0000 7fcbb4800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcbac0d1170 con 0x7fcbac15e6e0 2024-03-30T13:10:51.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.018+0000 7fcbb1400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcbac0d0660 0x7fcbac1623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54832/0 (socket says 172.21.15.99:54832) 2024-03-30T13:10:51.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.018+0000 7fcbb1400640 1 -- 172.21.15.99:0/3861542474 learned_addr learned my addr 172.21.15.99:0/3861542474 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:51.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.018+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 607131653 0 0) 0x7fcbac0d1a10 con 0x7fcbac0d0660 2024-03-30T13:10:51.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.018+0000 7fcbb1e00640 1 --2- 172.21.15.99:0/3861542474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbac15e6e0 0x7fcbac09b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb94003520 con 0x7fcbac0d0660 2024-03-30T13:10:51.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3844486454 0 0) 0x7fcb94003520 con 0x7fcbac0d0660 2024-03-30T13:10:51.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbac15e6e0 msgr2=0x7fcbac09b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:51.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 --2- 172.21.15.99:0/3861542474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbac15e6e0 0x7fcbac09b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 >> v1:172.21.15.181:6789/0 conn(0x7fcbac162ab0 legacy=0x7fcbac0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbac0d1450 con 0x7fcbac0d0660 2024-03-30T13:10:51.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fcb9c001670 con 0x7fcbac0d0660 2024-03-30T13:10:51.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 >> v1:172.21.15.99:6789/0 conn(0x7fcbac0d0660 legacy=0x7fcbac1623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 --2- 172.21.15.99:0/3861542474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb940039e0 0x7fcb94003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 --2- 172.21.15.99:0/3861542474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb94004800 0x7fcb94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 --2- 172.21.15.99:0/3861542474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbac15e6e0 0x7fcb940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac0d1170 con 0x7fcb94004800 2024-03-30T13:10:51.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9400baa0 con 0x7fcb940039e0 2024-03-30T13:10:51.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9400bca0 con 0x7fcbac15e6e0 2024-03-30T13:10:51.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.019+0000 7fcbb1400640 1 --2- 172.21.15.99:0/3861542474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb94004800 0x7fcb94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.020+0000 7fcbb1400640 1 -- 172.21.15.99:0/3861542474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbac15e6e0 msgr2=0x7fcb940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:51.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.020+0000 7fcbb1400640 1 --2- 172.21.15.99:0/3861542474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbac15e6e0 0x7fcb940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.020+0000 7fcbb1400640 1 -- 172.21.15.99:0/3861542474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb940039e0 msgr2=0x7fcb94003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.020+0000 7fcbb1400640 1 --2- 172.21.15.99:0/3861542474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb940039e0 0x7fcb94003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.020+0000 7fcbb1400640 1 -- 172.21.15.99:0/3861542474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb94003520 con 0x7fcb94004800 2024-03-30T13:10:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.021+0000 7fcbb1400640 1 --2- 172.21.15.99:0/3861542474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb94004800 0x7fcb94004c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00c160 tx=0x7fcb94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c24c983b5c293be server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.021+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c007c60 con 0x7fcb94004800 2024-03-30T13:10:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.021+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c030070 con 0x7fcb94004800 2024-03-30T13:10:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.021+0000 7fcbb0a00640 1 -- 172.21.15.99:0/3861542474 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c005d50 con 0x7fcb94004800 2024-03-30T13:10:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.022+0000 7fcbb4800640 1 -- 172.21.15.99:0/3861542474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb94004800 msgr2=0x7fcb94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.022+0000 7fcbb4800640 1 --2- 172.21.15.99:0/3861542474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb94004800 0x7fcb94004c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00c160 tx=0x7fcb94005830 comp rx=0 tx=0).stop 2024-03-30T13:10:51.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.022+0000 7fcbb2800640 1 -- 172.21.15.99:0/3861542474 reap_dead start 2024-03-30T13:10:51.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.022+0000 7fcbb4800640 1 -- 172.21.15.99:0/3861542474 shutdown_connections 2024-03-30T13:10:51.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.022+0000 7fcbb4800640 1 -- 172.21.15.99:0/3861542474 >> 172.21.15.99:0/3861542474 conn(0x7fcbac0b3f10 msgr2=0x7fcbac0b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:51.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.022+0000 7fcbb4800640 1 -- 172.21.15.99:0/3861542474 shutdown_connections 2024-03-30T13:10:51.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.022+0000 7fcbb4800640 1 -- 172.21.15.99:0/3861542474 wait complete. 2024-03-30T13:10:51.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.024+0000 7fcbb4800640 1 Processor -- start 2024-03-30T13:10:51.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.024+0000 7fcbb4800640 1 -- start start 2024-03-30T13:10:51.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.025+0000 7fcbb4800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb94004800 0x7fcbac15af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.025+0000 7fcbb4800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbac15b600 0x7fcbac0b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.025+0000 7fcbb4800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbac0b5270 0x7fcbac160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.025+0000 7fcbb4800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac06d910 con 0x7fcbac0b5270 2024-03-30T13:10:51.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.025+0000 7fcbb4800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac0b1d80 con 0x7fcbac15b600 2024-03-30T13:10:51.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.025+0000 7fcbb4800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcbac0b5830 con 0x7fcb94004800 2024-03-30T13:10:51.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.025+0000 7fcbb2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbac0b5270 0x7fcbac160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.025+0000 7fcbb2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbac0b5270 0x7fcbac160560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39992/0 (socket says 172.21.15.99:39992) 2024-03-30T13:10:51.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.025+0000 7fcbb2800640 1 -- 172.21.15.99:0/315445096 learned_addr learned my addr 172.21.15.99:0/315445096 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:51.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.025+0000 7fcbb1e00640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb94004800 0x7fcbac15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcbb1400640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbac15b600 0x7fcbac0b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcbb2800640 1 -- 172.21.15.99:0/315445096 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb94004800 msgr2=0x7fcbac15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcbb2800640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb94004800 0x7fcbac15af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcbb2800640 1 -- 172.21.15.99:0/315445096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbac15b600 msgr2=0x7fcbac0b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcbb2800640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbac15b600 0x7fcbac0b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcbb2800640 1 -- 172.21.15.99:0/315445096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbac0b5b10 con 0x7fcbac0b5270 2024-03-30T13:10:51.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcbb1400640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbac15b600 0x7fcbac0b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:51.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcbb2800640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbac0b5270 0x7fcbac160560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcb940039b0 tx=0x7fcba800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:51.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcba6000640 1 -- 172.21.15.99:0/315445096 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba8017070 con 0x7fcbac0b5270 2024-03-30T13:10:51.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcba6000640 1 -- 172.21.15.99:0/315445096 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba8005d60 con 0x7fcbac0b5270 2024-03-30T13:10:51.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcba6000640 1 -- 172.21.15.99:0/315445096 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba800a7f0 con 0x7fcbac0b5270 2024-03-30T13:10:51.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcbb4800640 1 -- 172.21.15.99:0/315445096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbac0b5df0 con 0x7fcbac0b5270 2024-03-30T13:10:51.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.026+0000 7fcbb4800640 1 -- 172.21.15.99:0/315445096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbac0b63b0 con 0x7fcbac0b5270 2024-03-30T13:10:51.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.028+0000 7fcbb4800640 1 -- 172.21.15.99:0/315445096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbac068640 con 0x7fcbac0b5270 2024-03-30T13:10:51.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.029+0000 7fcba6000640 1 -- 172.21.15.99:0/315445096 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcba800a990 con 0x7fcbac0b5270 2024-03-30T13:10:51.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.029+0000 7fcba6000640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb9006c530 0x7fcb9006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.030+0000 7fcba6000640 1 -- 172.21.15.99:0/315445096 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcba808a790 con 0x7fcbac0b5270 2024-03-30T13:10:51.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.030+0000 7fcbb1e00640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb9006c530 0x7fcb9006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.030+0000 7fcbb1e00640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb9006c530 0x7fcb9006e9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcba00047b0 tx=0x7fcba0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:51.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.034+0000 7fcba6000640 1 -- 172.21.15.99:0/315445096 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcba8058db0 con 0x7fcbac0b5270 2024-03-30T13:10:51.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.378+0000 7fcbb4800640 1 -- 172.21.15.99:0/315445096 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcbac0d1e40 con 0x7fcb9006c530 2024-03-30T13:10:51.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.395+0000 7fcba6000640 1 -- 172.21.15.99:0/315445096 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245585 (secure 0 0 0) 0x7fcbac0d1e40 con 0x7fcb9006c530 2024-03-30T13:10:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:51.403 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:10:51.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.400+0000 7fcbb4800640 1 -- 172.21.15.99:0/315445096 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb9006c530 msgr2=0x7fcb9006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.400+0000 7fcbb4800640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb9006c530 0x7fcb9006e9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcba00047b0 tx=0x7fcba0008040 comp rx=0 tx=0).stop 2024-03-30T13:10:51.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.400+0000 7fcbb4800640 1 -- 172.21.15.99:0/315445096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbac0b5270 msgr2=0x7fcbac160560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.400+0000 7fcbb4800640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbac0b5270 0x7fcbac160560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcb940039b0 tx=0x7fcba800cb90 comp rx=0 tx=0).stop 2024-03-30T13:10:51.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.401+0000 7fcbb4800640 1 -- 172.21.15.99:0/315445096 shutdown_connections 2024-03-30T13:10:51.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.401+0000 7fcbb4800640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcb9006c530 0x7fcb9006e9f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.401+0000 7fcbb4800640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbac0b5270 0x7fcbac160560 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.401+0000 7fcbb4800640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbac15b600 0x7fcbac0b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.401+0000 7fcbb4800640 1 --2- 172.21.15.99:0/315445096 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb94004800 0x7fcbac15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.401+0000 7fcbb4800640 1 -- 172.21.15.99:0/315445096 >> 172.21.15.99:0/315445096 conn(0x7fcbac0b3f10 msgr2=0x7fcbac15da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:51.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.401+0000 7fcbb4800640 1 -- 172.21.15.99:0/315445096 shutdown_connections 2024-03-30T13:10:51.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.401+0000 7fcbb4800640 1 -- 172.21.15.99:0/315445096 wait complete. 2024-03-30T13:10:51.426 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-30T13:10:49.435317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":2676,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":2740224,"data_stored":1671280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.258468"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282177+0000","last_change":"2024-03-30T13:10:46.238313+0000","last_active":"2024-03-30T13:10:48.282177+0000","last_peered":"2024-03-30T13:10:48.282177+0000","last_clean":"2024-03-30T13:10:48.282177+0000","last_became_active":"2024-03-30T13:10:46.238010+0000","last_became_peered":"2024-03-30T13:10:46.238010+0000","last_unstale":"2024-03-30T13:10:48.282177+0000","last_undegraded":"2024-03-30T13:10:48.282177+0000","last_fullsized":"2024-03-30T13:10:48.282177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281389+0000","last_change":"2024-03-30T13:10:46.241744+0000","last_active":"2024-03-30T13:10:48.281389+0000","last_peered":"2024-03-30T13:10:48.281389+0000","last_clean":"2024-03-30T13:10:48.281389+0000","last_became_active":"2024-03-30T13:10:46.241480+0000","last_became_peered":"2024-03-30T13:10:46.241480+0000","last_unstale":"2024-03-30T13:10:48.281389+0000","last_undegraded":"2024-03-30T13:10:48.281389+0000","last_fullsized":"2024-03-30T13:10:48.281389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280766+0000","last_change":"2024-03-30T13:10:46.255145+0000","last_active":"2024-03-30T13:10:48.280766+0000","last_peered":"2024-03-30T13:10:48.280766+0000","last_clean":"2024-03-30T13:10:48.280766+0000","last_became_active":"2024-03-30T13:10:46.254848+0000","last_became_peered":"2024-03-30T13:10:46.254848+0000","last_unstale":"2024-03-30T13:10:48.280766+0000","last_undegraded":"2024-03-30T13:10:48.280766+0000","last_fullsized":"2024-03-30T13:10:48.280766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248585+0000","last_change":"2024-03-30T13:10:46.240158+0000","last_active":"2024-03-30T13:10:47.248585+0000","last_peered":"2024-03-30T13:10:47.248585+0000","last_clean":"2024-03-30T13:10:47.248585+0000","last_became_active":"2024-03-30T13:10:46.235455+0000","last_became_peered":"2024-03-30T13:10:46.235455+0000","last_unstale":"2024-03-30T13:10:47.248585+0000","last_undegraded":"2024-03-30T13:10:47.248585+0000","last_fullsized":"2024-03-30T13:10:47.248585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:00.666500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248107+0000","last_change":"2024-03-30T13:10:46.243687+0000","last_active":"2024-03-30T13:10:47.248107+0000","last_peered":"2024-03-30T13:10:47.248107+0000","last_clean":"2024-03-30T13:10:47.248107+0000","last_became_active":"2024-03-30T13:10:46.243389+0000","last_became_peered":"2024-03-30T13:10:46.243389+0000","last_unstale":"2024-03-30T13:10:47.248107+0000","last_undegraded":"2024-03-30T13:10:47.248107+0000","last_fullsized":"2024-03-30T13:10:47.248107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280718+0000","last_change":"2024-03-30T13:10:46.256471+0000","last_active":"2024-03-30T13:10:48.280718+0000","last_peered":"2024-03-30T13:10:48.280718+0000","last_clean":"2024-03-30T13:10:48.280718+0000","last_became_active":"2024-03-30T13:10:46.256215+0000","last_became_peered":"2024-03-30T13:10:46.256215+0000","last_unstale":"2024-03-30T13:10:48.280718+0000","last_undegraded":"2024-03-30T13:10:48.280718+0000","last_fullsized":"2024-03-30T13:10:48.280718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.258357+0000","last_change":"2024-03-30T13:10:46.253562+0000","last_active":"2024-03-30T13:10:46.258357+0000","last_peered":"2024-03-30T13:10:46.258357+0000","last_clean":"2024-03-30T13:10:46.258357+0000","last_became_active":"2024-03-30T13:10:46.253288+0000","last_became_peered":"2024-03-30T13:10:46.253288+0000","last_unstale":"2024-03-30T13:10:46.258357+0000","last_undegraded":"2024-03-30T13:10:46.258357+0000","last_fullsized":"2024-03-30T13:10:46.258357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:44:49.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250207+0000","last_change":"2024-03-30T13:10:46.243487+0000","last_active":"2024-03-30T13:10:47.250207+0000","last_peered":"2024-03-30T13:10:47.250207+0000","last_clean":"2024-03-30T13:10:47.250207+0000","last_became_active":"2024-03-30T13:10:46.243102+0000","last_became_peered":"2024-03-30T13:10:46.243102+0000","last_unstale":"2024-03-30T13:10:47.250207+0000","last_undegraded":"2024-03-30T13:10:47.250207+0000","last_fullsized":"2024-03-30T13:10:47.250207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280858+0000","last_change":"2024-03-30T13:10:46.247945+0000","last_active":"2024-03-30T13:10:48.280858+0000","last_peered":"2024-03-30T13:10:48.280858+0000","last_clean":"2024-03-30T13:10:48.280858+0000","last_became_active":"2024-03-30T13:10:46.247685+0000","last_became_peered":"2024-03-30T13:10:46.247685+0000","last_unstale":"2024-03-30T13:10:48.280858+0000","last_undegraded":"2024-03-30T13:10:48.280858+0000","last_fullsized":"2024-03-30T13:10:48.280858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282406+0000","last_change":"2024-03-30T13:10:46.249445+0000","last_active":"2024-03-30T13:10:48.282406+0000","last_peered":"2024-03-30T13:10:48.282406+0000","last_clean":"2024-03-30T13:10:48.282406+0000","last_became_active":"2024-03-30T13:10:46.249008+0000","last_became_peered":"2024-03-30T13:10:46.249008+0000","last_unstale":"2024-03-30T13:10:48.282406+0000","last_undegraded":"2024-03-30T13:10:48.282406+0000","last_fullsized":"2024-03-30T13:10:48.282406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248607+0000","last_change":"2024-03-30T13:10:46.243725+0000","last_active":"2024-03-30T13:10:47.248607+0000","last_peered":"2024-03-30T13:10:47.248607+0000","last_clean":"2024-03-30T13:10:47.248607+0000","last_became_active":"2024-03-30T13:10:46.243423+0000","last_became_peered":"2024-03-30T13:10:46.243423+0000","last_unstale":"2024-03-30T13:10:47.248607+0000","last_undegraded":"2024-03-30T13:10:47.248607+0000","last_fullsized":"2024-03-30T13:10:47.248607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248584+0000","last_change":"2024-03-30T13:10:46.254386+0000","last_active":"2024-03-30T13:10:47.248584+0000","last_peered":"2024-03-30T13:10:47.248584+0000","last_clean":"2024-03-30T13:10:47.248584+0000","last_became_active":"2024-03-30T13:10:46.254081+0000","last_became_peered":"2024-03-30T13:10:46.254081+0000","last_unstale":"2024-03-30T13:10:47.248584+0000","last_undegraded":"2024-03-30T13:10:47.248584+0000","last_fullsized":"2024-03-30T13:10:47.248584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281880+0000","last_change":"2024-03-30T13:10:46.246367+0000","last_active":"2024-03-30T13:10:48.281880+0000","last_peered":"2024-03-30T13:10:48.281880+0000","last_clean":"2024-03-30T13:10:48.281880+0000","last_became_active":"2024-03-30T13:10:46.246066+0000","last_became_peered":"2024-03-30T13:10:46.246066+0000","last_unstale":"2024-03-30T13:10:48.281880+0000","last_undegraded":"2024-03-30T13:10:48.281880+0000","last_fullsized":"2024-03-30T13:10:48.281880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.256707+0000","last_change":"2024-03-30T13:10:46.247881+0000","last_active":"2024-03-30T13:10:46.256707+0000","last_peered":"2024-03-30T13:10:46.256707+0000","last_clean":"2024-03-30T13:10:46.256707+0000","last_became_active":"2024-03-30T13:10:46.247618+0000","last_became_peered":"2024-03-30T13:10:46.247618+0000","last_unstale":"2024-03-30T13:10:46.256707+0000","last_undegraded":"2024-03-30T13:10:46.256707+0000","last_fullsized":"2024-03-30T13:10:46.256707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:32.391989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282213+0000","last_change":"2024-03-30T13:10:45.225591+0000","last_active":"2024-03-30T13:10:48.282213+0000","last_peered":"2024-03-30T13:10:48.282213+0000","last_clean":"2024-03-30T13:10:48.282213+0000","last_became_active":"2024-03-30T13:10:45.224943+0000","last_became_peered":"2024-03-30T13:10:45.224943+0000","last_unstale":"2024-03-30T13:10:48.282213+0000","last_undegraded":"2024-03-30T13:10:48.282213+0000","last_fullsized":"2024-03-30T13:10:48.282213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250237+0000","last_change":"2024-03-30T13:10:46.260952+0000","last_active":"2024-03-30T13:10:47.250237+0000","last_peered":"2024-03-30T13:10:47.250237+0000","last_clean":"2024-03-30T13:10:47.250237+0000","last_became_active":"2024-03-30T13:10:46.260001+0000","last_became_peered":"2024-03-30T13:10:46.260001+0000","last_unstale":"2024-03-30T13:10:47.250237+0000","last_undegraded":"2024-03-30T13:10:47.250237+0000","last_fullsized":"2024-03-30T13:10:47.250237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.191443+0000","last_change":"2024-03-30T13:10:44.191443+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.191443+0000","last_undegraded":"2024-03-30T13:10:44.191443+0000","last_fullsized":"2024-03-30T13:10:44.191443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247862+0000","last_change":"2024-03-30T13:10:45.211201+0000","last_active":"2024-03-30T13:10:47.247862+0000","last_peered":"2024-03-30T13:10:47.247862+0000","last_clean":"2024-03-30T13:10:47.247862+0000","last_became_active":"2024-03-30T13:10:45.210742+0000","last_became_peered":"2024-03-30T13:10:45.210742+0000","last_unstale":"2024-03-30T13:10:47.247862+0000","last_undegraded":"2024-03-30T13:10:47.247862+0000","last_fullsized":"2024-03-30T13:10:47.247862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281386+0000","last_change":"2024-03-30T13:10:46.236372+0000","last_active":"2024-03-30T13:10:48.281386+0000","last_peered":"2024-03-30T13:10:48.281386+0000","last_clean":"2024-03-30T13:10:48.281386+0000","last_became_active":"2024-03-30T13:10:46.236108+0000","last_became_peered":"2024-03-30T13:10:46.236108+0000","last_unstale":"2024-03-30T13:10:48.281386+0000","last_undegraded":"2024-03-30T13:10:48.281386+0000","last_fullsized":"2024-03-30T13:10:48.281386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.194277+0000","last_change":"2024-03-30T13:10:44.194277+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.194277+0000","last_undegraded":"2024-03-30T13:10:44.194277+0000","last_fullsized":"2024-03-30T13:10:44.194277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249908+0000","last_change":"2024-03-30T13:10:46.247867+0000","last_active":"2024-03-30T13:10:47.249908+0000","last_peered":"2024-03-30T13:10:47.249908+0000","last_clean":"2024-03-30T13:10:47.249908+0000","last_became_active":"2024-03-30T13:10:46.246955+0000","last_became_peered":"2024-03-30T13:10:46.246955+0000","last_unstale":"2024-03-30T13:10:47.249908+0000","last_undegraded":"2024-03-30T13:10:47.249908+0000","last_fullsized":"2024-03-30T13:10:47.249908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.190033+0000","last_change":"2024-03-30T13:10:44.190033+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.190033+0000","last_undegraded":"2024-03-30T13:10:44.190033+0000","last_fullsized":"2024-03-30T13:10:44.190033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.181543+0000","last_change":"2024-03-30T13:10:44.181543+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.181543+0000","last_undegraded":"2024-03-30T13:10:44.181543+0000","last_fullsized":"2024-03-30T13:10:44.181543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282464+0000","last_change":"2024-03-30T13:10:46.241152+0000","last_active":"2024-03-30T13:10:48.282464+0000","last_peered":"2024-03-30T13:10:48.282464+0000","last_clean":"2024-03-30T13:10:48.282464+0000","last_became_active":"2024-03-30T13:10:46.240813+0000","last_became_peered":"2024-03-30T13:10:46.240813+0000","last_unstale":"2024-03-30T13:10:48.282464+0000","last_undegraded":"2024-03-30T13:10:48.282464+0000","last_fullsized":"2024-03-30T13:10:48.282464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.260991+0000","last_change":"2024-03-30T13:10:45.227319+0000","last_active":"2024-03-30T13:10:46.260991+0000","last_peered":"2024-03-30T13:10:46.260991+0000","last_clean":"2024-03-30T13:10:46.260991+0000","last_became_active":"2024-03-30T13:10:45.226913+0000","last_became_peered":"2024-03-30T13:10:45.226913+0000","last_unstale":"2024-03-30T13:10:46.260991+0000","last_undegraded":"2024-03-30T13:10:46.260991+0000","last_fullsized":"2024-03-30T13:10:46.260991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:22.060387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.186805+0000","last_change":"2024-03-30T13:10:44.186805+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.186805+0000","last_undegraded":"2024-03-30T13:10:44.186805+0000","last_fullsized":"2024-03-30T13:10:44.186805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.266262+0000","last_change":"2024-03-30T13:10:45.222380+0000","last_active":"2024-03-30T13:10:46.266262+0000","last_peered":"2024-03-30T13:10:46.266262+0000","last_clean":"2024-03-30T13:10:46.266262+0000","last_became_active":"2024-03-30T13:10:45.221975+0000","last_became_peered":"2024-03-30T13:10:45.221975+0000","last_unstale":"2024-03-30T13:10:46.266262+0000","last_undegraded":"2024-03-30T13:10:46.266262+0000","last_fullsized":"2024-03-30T13:10:46.266262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:26:59.790496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248472+0000","last_change":"2024-03-30T13:10:46.232634+0000","last_active":"2024-03-30T13:10:47.248472+0000","last_peered":"2024-03-30T13:10:47.248472+0000","last_clean":"2024-03-30T13:10:47.248472+0000","last_became_active":"2024-03-30T13:10:46.232300+0000","last_became_peered":"2024-03-30T13:10:46.232300+0000","last_unstale":"2024-03-30T13:10:47.248472+0000","last_undegraded":"2024-03-30T13:10:47.248472+0000","last_fullsized":"2024-03-30T13:10:47.248472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.190665+0000","last_change":"2024-03-30T13:10:44.190665+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.190665+0000","last_undegraded":"2024-03-30T13:10:44.190665+0000","last_fullsized":"2024-03-30T13:10:44.190665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.181536+0000","last_change":"2024-03-30T13:10:44.181536+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.181536+0000","last_undegraded":"2024-03-30T13:10:44.181536+0000","last_fullsized":"2024-03-30T13:10:44.181536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249704+0000","last_change":"2024-03-30T13:10:45.221532+0000","last_active":"2024-03-30T13:10:47.249704+0000","last_peered":"2024-03-30T13:10:47.249704+0000","last_clean":"2024-03-30T13:10:47.249704+0000","last_became_active":"2024-03-30T13:10:45.220536+0000","last_became_peered":"2024-03-30T13:10:45.220536+0000","last_unstale":"2024-03-30T13:10:47.249704+0000","last_undegraded":"2024-03-30T13:10:47.249704+0000","last_fullsized":"2024-03-30T13:10:47.249704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.183319+0000","last_change":"2024-03-30T13:10:44.183319+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.183319+0000","last_undegraded":"2024-03-30T13:10:44.183319+0000","last_fullsized":"2024-03-30T13:10:44.183319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250809+0000","last_change":"2024-03-30T13:10:45.224819+0000","last_active":"2024-03-30T13:10:47.250809+0000","last_peered":"2024-03-30T13:10:47.250809+0000","last_clean":"2024-03-30T13:10:47.250809+0000","last_became_active":"2024-03-30T13:10:45.223270+0000","last_became_peered":"2024-03-30T13:10:45.223270+0000","last_unstale":"2024-03-30T13:10:47.250809+0000","last_undegraded":"2024-03-30T13:10:47.250809+0000","last_fullsized":"2024-03-30T13:10:47.250809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282278+0000","last_change":"2024-03-30T13:10:45.225766+0000","last_active":"2024-03-30T13:10:48.282278+0000","last_peered":"2024-03-30T13:10:48.282278+0000","last_clean":"2024-03-30T13:10:48.282278+0000","last_became_active":"2024-03-30T13:10:45.225096+0000","last_became_peered":"2024-03-30T13:10:45.225096+0000","last_unstale":"2024-03-30T13:10:48.282278+0000","last_undegraded":"2024-03-30T13:10:48.282278+0000","last_fullsized":"2024-03-30T13:10:48.282278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248851+0000","last_change":"2024-03-30T13:10:45.210147+0000","last_active":"2024-03-30T13:10:47.248851+0000","last_peered":"2024-03-30T13:10:47.248851+0000","last_clean":"2024-03-30T13:10:47.248851+0000","last_became_active":"2024-03-30T13:10:45.209716+0000","last_became_peered":"2024-03-30T13:10:45.209716+0000","last_unstale":"2024-03-30T13:10:47.248851+0000","last_undegraded":"2024-03-30T13:10:47.248851+0000","last_fullsized":"2024-03-30T13:10:47.248851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-30T13:10:44.189763+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:10:44.189763+0000","last_peered":"2024-03-30T13:10:44.189763+0000","last_clean":"2024-03-30T13:10:44.189763+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:10:44.189763+0000","last_undegraded":"2024-03-30T13:10:44.189763+0000","last_fullsized":"2024-03-30T13:10:44.189763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.189632+0000","last_change":"2024-03-30T13:10:44.189632+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.189632+0000","last_undegraded":"2024-03-30T13:10:44.189632+0000","last_fullsized":"2024-03-30T13:10:44.189632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249967+0000","last_change":"2024-03-30T13:10:46.243383+0000","last_active":"2024-03-30T13:10:47.249967+0000","last_peered":"2024-03-30T13:10:47.249967+0000","last_clean":"2024-03-30T13:10:47.249967+0000","last_became_active":"2024-03-30T13:10:46.243046+0000","last_became_peered":"2024-03-30T13:10:46.243046+0000","last_unstale":"2024-03-30T13:10:47.249967+0000","last_undegraded":"2024-03-30T13:10:47.249967+0000","last_fullsized":"2024-03-30T13:10:47.249967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.191926+0000","last_change":"2024-03-30T13:10:44.191926+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.191926+0000","last_undegraded":"2024-03-30T13:10:44.191926+0000","last_fullsized":"2024-03-30T13:10:44.191926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247995+0000","last_change":"2024-03-30T13:10:46.239001+0000","last_active":"2024-03-30T13:10:47.247995+0000","last_peered":"2024-03-30T13:10:47.247995+0000","last_clean":"2024-03-30T13:10:47.247995+0000","last_became_active":"2024-03-30T13:10:46.238750+0000","last_became_peered":"2024-03-30T13:10:46.238750+0000","last_unstale":"2024-03-30T13:10:47.247995+0000","last_undegraded":"2024-03-30T13:10:47.247995+0000","last_fullsized":"2024-03-30T13:10:47.247995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.235562+0000","last_change":"2024-03-30T13:10:45.223067+0000","last_active":"2024-03-30T13:10:46.235562+0000","last_peered":"2024-03-30T13:10:46.235562+0000","last_clean":"2024-03-30T13:10:46.235562+0000","last_became_active":"2024-03-30T13:10:45.222778+0000","last_became_peered":"2024-03-30T13:10:45.222778+0000","last_unstale":"2024-03-30T13:10:46.235562+0000","last_undegraded":"2024-03-30T13:10:46.235562+0000","last_fullsized":"2024-03-30T13:10:46.235562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:35:37.871387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280762+0000","last_change":"2024-03-30T13:10:46.246374+0000","last_active":"2024-03-30T13:10:48.280762+0000","last_peered":"2024-03-30T13:10:48.280762+0000","last_clean":"2024-03-30T13:10:48.280762+0000","last_became_active":"2024-03-30T13:10:46.246094+0000","last_became_peered":"2024-03-30T13:10:46.246094+0000","last_unstale":"2024-03-30T13:10:48.280762+0000","last_undegraded":"2024-03-30T13:10:48.280762+0000","last_fullsized":"2024-03-30T13:10:48.280762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.189818+0000","last_change":"2024-03-30T13:10:44.189818+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.189818+0000","last_undegraded":"2024-03-30T13:10:44.189818+0000","last_fullsized":"2024-03-30T13:10:44.189818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281281+0000","last_change":"2024-03-30T13:10:45.225647+0000","last_active":"2024-03-30T13:10:48.281281+0000","last_peered":"2024-03-30T13:10:48.281281+0000","last_clean":"2024-03-30T13:10:48.281281+0000","last_became_active":"2024-03-30T13:10:45.225066+0000","last_became_peered":"2024-03-30T13:10:45.225066+0000","last_unstale":"2024-03-30T13:10:48.281281+0000","last_undegraded":"2024-03-30T13:10:48.281281+0000","last_fullsized":"2024-03-30T13:10:48.281281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.192044+0000","last_change":"2024-03-30T13:10:44.192044+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.192044+0000","last_undegraded":"2024-03-30T13:10:44.192044+0000","last_fullsized":"2024-03-30T13:10:44.192044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248726+0000","last_change":"2024-03-30T13:10:46.234095+0000","last_active":"2024-03-30T13:10:47.248726+0000","last_peered":"2024-03-30T13:10:47.248726+0000","last_clean":"2024-03-30T13:10:47.248726+0000","last_became_active":"2024-03-30T13:10:46.233686+0000","last_became_peered":"2024-03-30T13:10:46.233686+0000","last_unstale":"2024-03-30T13:10:47.248726+0000","last_undegraded":"2024-03-30T13:10:47.248726+0000","last_fullsized":"2024-03-30T13:10:47.248726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.253768+0000","last_change":"2024-03-30T13:10:45.216838+0000","last_active":"2024-03-30T13:10:47.253768+0000","last_peered":"2024-03-30T13:10:47.253768+0000","last_clean":"2024-03-30T13:10:47.253768+0000","last_became_active":"2024-03-30T13:10:45.216528+0000","last_became_peered":"2024-03-30T13:10:45.216528+0000","last_unstale":"2024-03-30T13:10:47.253768+0000","last_undegraded":"2024-03-30T13:10:47.253768+0000","last_fullsized":"2024-03-30T13:10:47.253768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251100+0000","last_change":"2024-03-30T13:10:46.243883+0000","last_active":"2024-03-30T13:10:47.251100+0000","last_peered":"2024-03-30T13:10:47.251100+0000","last_clean":"2024-03-30T13:10:47.251100+0000","last_became_active":"2024-03-30T13:10:46.243583+0000","last_became_peered":"2024-03-30T13:10:46.243583+0000","last_unstale":"2024-03-30T13:10:47.251100+0000","last_undegraded":"2024-03-30T13:10:47.251100+0000","last_fullsized":"2024-03-30T13:10:47.251100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.189465+0000","last_change":"2024-03-30T13:10:44.189465+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.189465+0000","last_undegraded":"2024-03-30T13:10:44.189465+0000","last_fullsized":"2024-03-30T13:10:44.189465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250903+0000","last_change":"2024-03-30T13:10:46.248800+0000","last_active":"2024-03-30T13:10:47.250903+0000","last_peered":"2024-03-30T13:10:47.250903+0000","last_clean":"2024-03-30T13:10:47.250903+0000","last_became_active":"2024-03-30T13:10:46.248344+0000","last_became_peered":"2024-03-30T13:10:46.248344+0000","last_unstale":"2024-03-30T13:10:47.250903+0000","last_undegraded":"2024-03-30T13:10:47.250903+0000","last_fullsized":"2024-03-30T13:10:47.250903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.181257+0000","last_change":"2024-03-30T13:10:44.181257+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.181257+0000","last_undegraded":"2024-03-30T13:10:44.181257+0000","last_fullsized":"2024-03-30T13:10:44.181257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250156+0000","last_change":"2024-03-30T13:10:45.223756+0000","last_active":"2024-03-30T13:10:47.250156+0000","last_peered":"2024-03-30T13:10:47.250156+0000","last_clean":"2024-03-30T13:10:47.250156+0000","last_became_active":"2024-03-30T13:10:45.222236+0000","last_became_peered":"2024-03-30T13:10:45.222236+0000","last_unstale":"2024-03-30T13:10:47.250156+0000","last_undegraded":"2024-03-30T13:10:47.250156+0000","last_fullsized":"2024-03-30T13:10:47.250156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250500+0000","last_change":"2024-03-30T13:10:46.250939+0000","last_active":"2024-03-30T13:10:47.250500+0000","last_peered":"2024-03-30T13:10:47.250500+0000","last_clean":"2024-03-30T13:10:47.250500+0000","last_became_active":"2024-03-30T13:10:46.250651+0000","last_became_peered":"2024-03-30T13:10:46.250651+0000","last_unstale":"2024-03-30T13:10:47.250500+0000","last_undegraded":"2024-03-30T13:10:47.250500+0000","last_fullsized":"2024-03-30T13:10:47.250500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248428+0000","last_change":"2024-03-30T13:10:45.222799+0000","last_active":"2024-03-30T13:10:47.248428+0000","last_peered":"2024-03-30T13:10:47.248428+0000","last_clean":"2024-03-30T13:10:47.248428+0000","last_became_active":"2024-03-30T13:10:45.221899+0000","last_became_peered":"2024-03-30T13:10:45.221899+0000","last_unstale":"2024-03-30T13:10:47.248428+0000","last_undegraded":"2024-03-30T13:10:47.248428+0000","last_fullsized":"2024-03-30T13:10:47.248428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.250423+0000","last_change":"2024-03-30T13:10:46.245047+0000","last_active":"2024-03-30T13:10:46.250423+0000","last_peered":"2024-03-30T13:10:46.250423+0000","last_clean":"2024-03-30T13:10:46.250423+0000","last_became_active":"2024-03-30T13:10:46.244170+0000","last_became_peered":"2024-03-30T13:10:46.244170+0000","last_unstale":"2024-03-30T13:10:46.250423+0000","last_undegraded":"2024-03-30T13:10:46.250423+0000","last_fullsized":"2024-03-30T13:10:46.250423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:27:43.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.190357+0000","last_change":"2024-03-30T13:10:44.190357+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.190357+0000","last_undegraded":"2024-03-30T13:10:44.190357+0000","last_fullsized":"2024-03-30T13:10:44.190357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.182080+0000","last_change":"2024-03-30T13:10:44.182080+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.182080+0000","last_undegraded":"2024-03-30T13:10:44.182080+0000","last_fullsized":"2024-03-30T13:10:44.182080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:10:45.173911+0000","last_change":"2024-03-30T13:10:45.173911+0000","last_active":"2024-03-30T13:10:45.173911+0000","last_peered":"2024-03-30T13:10:45.173911+0000","last_clean":"2024-03-30T13:10:45.173911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:45.173911+0000","last_undegraded":"2024-03-30T13:10:45.173911+0000","last_fullsized":"2024-03-30T13:10:45.173911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-30T13:10:44.182374+0000","last_change":"2024-03-30T13:10:44.182374+0000","last_active":"2024-03-30T13:10:44.160907+0000","last_peered":"2024-03-30T13:10:44.160907+0000","last_clean":"2024-03-30T13:10:44.160907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:10:44.182374+0000","last_undegraded":"2024-03-30T13:10:44.182374+0000","last_fullsized":"2024-03-30T13:10:44.182374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281962+0000","last_change":"2024-03-30T13:10:46.249303+0000","last_active":"2024-03-30T13:10:48.281962+0000","last_peered":"2024-03-30T13:10:48.281962+0000","last_clean":"2024-03-30T13:10:48.281962+0000","last_became_active":"2024-03-30T13:10:46.248971+0000","last_became_peered":"2024-03-30T13:10:46.248971+0000","last_unstale":"2024-03-30T13:10:48.281962+0000","last_undegraded":"2024-03-30T13:10:48.281962+0000","last_fullsized":"2024-03-30T13:10:48.281962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282831+0000","last_change":"2024-03-30T13:10:45.222811+0000","last_active":"2024-03-30T13:10:48.282831+0000","last_peered":"2024-03-30T13:10:48.282831+0000","last_clean":"2024-03-30T13:10:48.282831+0000","last_became_active":"2024-03-30T13:10:45.222439+0000","last_became_peered":"2024-03-30T13:10:45.222439+0000","last_unstale":"2024-03-30T13:10:48.282831+0000","last_undegraded":"2024-03-30T13:10:48.282831+0000","last_fullsized":"2024-03-30T13:10:48.282831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282474+0000","last_change":"2024-03-30T13:10:46.242067+0000","last_active":"2024-03-30T13:10:48.282474+0000","last_peered":"2024-03-30T13:10:48.282474+0000","last_clean":"2024-03-30T13:10:48.282474+0000","last_became_active":"2024-03-30T13:10:46.241783+0000","last_became_peered":"2024-03-30T13:10:46.241783+0000","last_unstale":"2024-03-30T13:10:48.282474+0000","last_undegraded":"2024-03-30T13:10:48.282474+0000","last_fullsized":"2024-03-30T13:10:48.282474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251193+0000","last_change":"2024-03-30T13:10:45.221172+0000","last_active":"2024-03-30T13:10:47.251193+0000","last_peered":"2024-03-30T13:10:47.251193+0000","last_clean":"2024-03-30T13:10:47.251193+0000","last_became_active":"2024-03-30T13:10:45.220799+0000","last_became_peered":"2024-03-30T13:10:45.220799+0000","last_unstale":"2024-03-30T13:10:47.251193+0000","last_undegraded":"2024-03-30T13:10:47.251193+0000","last_fullsized":"2024-03-30T13:10:47.251193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":4},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":49997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":49997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476740,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":761856,"data_stored":640365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":49997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":659324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":77448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":68988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:10:51.430 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:10:51.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.662+0000 7fdc3b000640 1 Processor -- start 2024-03-30T13:10:51.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.663+0000 7fdc3b000640 1 -- start start 2024-03-30T13:10:51.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.665+0000 7fdc3b000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc3406c520 0x7fdc3415d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.665+0000 7fdc3b000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdc340cf880 0x7fdc340cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.665+0000 7fdc3b000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc3415cbc0 con 0x7fdc3406c900 2024-03-30T13:10:51.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.665+0000 7fdc3b000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fdc3415dbc0 con 0x7fdc340cf880 2024-03-30T13:10:51.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.665+0000 7fdc3b000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3415d1f0 con 0x7fdc3406c520 2024-03-30T13:10:51.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.666+0000 7fdc33e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc3406c520 0x7fdc3415d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.666+0000 7fdc33e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc3406c520 0x7fdc3415d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:34528/0 (socket says 172.21.15.99:34528) 2024-03-30T13:10:51.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.666+0000 7fdc33e00640 1 -- 172.21.15.99:0/3939714264 learned_addr learned my addr 172.21.15.99:0/3939714264 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:51.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.666+0000 7fdc39000640 1 --2- 172.21.15.99:0/3939714264 >> v2:172.21.15.181:3300/0 conn(0x7fdc340cf880 0x7fdc340cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.667+0000 7fdc32a00640 1 -- 172.21.15.99:0/3939714264 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807888905 0 0) 0x7fdc3415cbc0 con 0x7fdc3406c900 2024-03-30T13:10:51.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.667+0000 7fdc32a00640 1 -- 172.21.15.99:0/3939714264 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc18003520 con 0x7fdc3406c900 2024-03-30T13:10:51.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.667+0000 7fdc33e00640 1 -- 172.21.15.99:0/3939714264 >> v2:172.21.15.181:3300/0 conn(0x7fdc340cf880 msgr2=0x7fdc340cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:51.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.667+0000 7fdc33e00640 1 --2- 172.21.15.99:0/3939714264 >> v2:172.21.15.181:3300/0 conn(0x7fdc340cf880 0x7fdc340cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.667+0000 7fdc33e00640 1 -- 172.21.15.99:0/3939714264 >> v1:172.21.15.181:6789/0 conn(0x7fdc3406c900 legacy=0x7fdc340afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.667+0000 7fdc33e00640 1 -- 172.21.15.99:0/3939714264 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc34072ec0 con 0x7fdc3406c520 2024-03-30T13:10:51.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.669+0000 7fdc33e00640 1 --2- 172.21.15.99:0/3939714264 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc3406c520 0x7fdc3415d680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009870 tx=0x7fdc2402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c58883e7f51c97b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:51.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.669+0000 7fdc32a00640 1 -- 172.21.15.99:0/3939714264 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc24035020 con 0x7fdc3406c520 2024-03-30T13:10:51.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.669+0000 7fdc32a00640 1 -- 172.21.15.99:0/3939714264 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc24031640 con 0x7fdc3406c520 2024-03-30T13:10:51.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.669+0000 7fdc32a00640 1 -- 172.21.15.99:0/3939714264 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2402d040 con 0x7fdc3406c520 2024-03-30T13:10:51.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.670+0000 7fdc3b000640 1 -- 172.21.15.99:0/3939714264 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc3406c520 msgr2=0x7fdc3415d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.670+0000 7fdc3b000640 1 --2- 172.21.15.99:0/3939714264 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc3406c520 0x7fdc3415d680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009870 tx=0x7fdc2402b8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.670+0000 7fdc3b000640 1 -- 172.21.15.99:0/3939714264 shutdown_connections 2024-03-30T13:10:51.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.670+0000 7fdc3b000640 1 --2- 172.21.15.99:0/3939714264 >> v2:172.21.15.181:3300/0 conn(0x7fdc340cf880 0x7fdc340cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.670+0000 7fdc3b000640 1 --2- 172.21.15.99:0/3939714264 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc3406c520 0x7fdc3415d680 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.670+0000 7fdc3b000640 1 -- 172.21.15.99:0/3939714264 >> 172.21.15.99:0/3939714264 conn(0x7fdc34072050 msgr2=0x7fdc34072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:51.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.670+0000 7fdc3b000640 1 -- 172.21.15.99:0/3939714264 shutdown_connections 2024-03-30T13:10:51.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.670+0000 7fdc3b000640 1 -- 172.21.15.99:0/3939714264 wait complete. 2024-03-30T13:10:51.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.671+0000 7fdc3b000640 1 Processor -- start 2024-03-30T13:10:51.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.672+0000 7fdc3b000640 1 -- start start 2024-03-30T13:10:51.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.672+0000 7fdc3b000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc3406c520 0x7fdc34141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.672+0000 7fdc3b000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc3406c900 0x7fdc34153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc3b000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc340cf880 0x7fdc341e82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc3b000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3415ce80 con 0x7fdc3406c900 2024-03-30T13:10:51.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc3b000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdc340ce370 con 0x7fdc3406c520 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc3b000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdc34072b70 con 0x7fdc340cf880 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc33400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc3406c900 0x7fdc34153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc33400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc3406c900 0x7fdc34153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40000/0 (socket says 172.21.15.99:40000) 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc33400640 1 -- 172.21.15.99:0/1538463819 learned_addr learned my addr 172.21.15.99:0/1538463819 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc39000640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc340cf880 0x7fdc341e82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc33e00640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc3406c520 0x7fdc34141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc33400640 1 -- 172.21.15.99:0/1538463819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc340cf880 msgr2=0x7fdc341e82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc33400640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc340cf880 0x7fdc341e82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc33400640 1 -- 172.21.15.99:0/1538463819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc3406c520 msgr2=0x7fdc34141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc33400640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc3406c520 0x7fdc34141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc33400640 1 -- 172.21.15.99:0/1538463819 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3415a180 con 0x7fdc3406c900 2024-03-30T13:10:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.673+0000 7fdc33e00640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc3406c520 0x7fdc34141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:51.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.674+0000 7fdc33400640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc3406c900 0x7fdc34153f80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c430 tx=0x7fdc2000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:51.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.674+0000 7fdc2be00640 1 -- 172.21.15.99:0/1538463819 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20017070 con 0x7fdc3406c900 2024-03-30T13:10:51.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.674+0000 7fdc2be00640 1 -- 172.21.15.99:0/1538463819 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc200052f0 con 0x7fdc3406c900 2024-03-30T13:10:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.674+0000 7fdc3b000640 1 -- 172.21.15.99:0/1538463819 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc3415a460 con 0x7fdc3406c900 2024-03-30T13:10:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.674+0000 7fdc2be00640 1 -- 172.21.15.99:0/1538463819 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20003830 con 0x7fdc3406c900 2024-03-30T13:10:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.674+0000 7fdc3b000640 1 -- 172.21.15.99:0/1538463819 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc3415aa20 con 0x7fdc3406c900 2024-03-30T13:10:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.675+0000 7fdc3b000640 1 -- 172.21.15.99:0/1538463819 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc34068d50 con 0x7fdc3406c900 2024-03-30T13:10:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.676+0000 7fdc2be00640 1 -- 172.21.15.99:0/1538463819 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdc2001a070 con 0x7fdc3406c900 2024-03-30T13:10:51.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.677+0000 7fdc2be00640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc1406c560 0x7fdc1406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:51.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.677+0000 7fdc2be00640 1 -- 172.21.15.99:0/1538463819 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdc2008ab40 con 0x7fdc3406c900 2024-03-30T13:10:51.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.677+0000 7fdc33e00640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc1406c560 0x7fdc1406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:51.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.678+0000 7fdc33e00640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc1406c560 0x7fdc1406ea20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc24036000 tx=0x7fdc24008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:51.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.681+0000 7fdc2be00640 1 -- 172.21.15.99:0/1538463819 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fdc20059140 con 0x7fdc3406c900 2024-03-30T13:10:51.803 INFO:tasks.ceph.mds.c.smithi099.stderr:2024-03-30T13:10:51.799+0000 7f5506400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T13:10:51.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.876+0000 7fdc3b000640 1 -- 172.21.15.99:0/1538463819 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc340b5ed0 con 0x7fdc1406c560 2024-03-30T13:10:51.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.887+0000 7fdc2be00640 1 -- 172.21.15.99:0/1538463819 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251940 (secure 0 0 0) 0x7fdc340b5ed0 con 0x7fdc1406c560 2024-03-30T13:10:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:51.895 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:10:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 -- 172.21.15.99:0/1538463819 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc1406c560 msgr2=0x7fdc1406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc1406c560 0x7fdc1406ea20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc24036000 tx=0x7fdc24008030 comp rx=0 tx=0).stop 2024-03-30T13:10:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 -- 172.21.15.99:0/1538463819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc3406c900 msgr2=0x7fdc34153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc3406c900 0x7fdc34153f80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c430 tx=0x7fdc2000c8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 -- 172.21.15.99:0/1538463819 shutdown_connections 2024-03-30T13:10:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc1406c560 0x7fdc1406ea20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc340cf880 0x7fdc341e82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc3406c900 0x7fdc34153f80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 --2- 172.21.15.99:0/1538463819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc3406c520 0x7fdc34141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:51.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 -- 172.21.15.99:0/1538463819 >> 172.21.15.99:0/1538463819 conn(0x7fdc34072050 msgr2=0x7fdc340b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:51.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 -- 172.21.15.99:0/1538463819 shutdown_connections 2024-03-30T13:10:51.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:51.891+0000 7fdc3b000640 1 -- 172.21.15.99:0/1538463819 wait complete. 2024-03-30T13:10:51.914 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-30T13:10:51.435795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219076,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755644,"statfs":{"total":773094113280,"available":772869779456,"internally_reserved":0,"allocated":2965504,"data_stored":1774268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.252009"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246289+0000","last_change":"2024-03-30T13:10:46.234821+0000","last_active":"2024-03-30T13:10:47.246289+0000","last_peered":"2024-03-30T13:10:47.246289+0000","last_clean":"2024-03-30T13:10:47.246289+0000","last_became_active":"2024-03-30T13:10:46.234553+0000","last_became_peered":"2024-03-30T13:10:46.234553+0000","last_unstale":"2024-03-30T13:10:47.246289+0000","last_undegraded":"2024-03-30T13:10:47.246289+0000","last_fullsized":"2024-03-30T13:10:47.246289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:13.303492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282177+0000","last_change":"2024-03-30T13:10:46.238313+0000","last_active":"2024-03-30T13:10:48.282177+0000","last_peered":"2024-03-30T13:10:48.282177+0000","last_clean":"2024-03-30T13:10:48.282177+0000","last_became_active":"2024-03-30T13:10:46.238010+0000","last_became_peered":"2024-03-30T13:10:46.238010+0000","last_unstale":"2024-03-30T13:10:48.282177+0000","last_undegraded":"2024-03-30T13:10:48.282177+0000","last_fullsized":"2024-03-30T13:10:48.282177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281389+0000","last_change":"2024-03-30T13:10:46.241744+0000","last_active":"2024-03-30T13:10:48.281389+0000","last_peered":"2024-03-30T13:10:48.281389+0000","last_clean":"2024-03-30T13:10:48.281389+0000","last_became_active":"2024-03-30T13:10:46.241480+0000","last_became_peered":"2024-03-30T13:10:46.241480+0000","last_unstale":"2024-03-30T13:10:48.281389+0000","last_undegraded":"2024-03-30T13:10:48.281389+0000","last_fullsized":"2024-03-30T13:10:48.281389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991801+0000","last_change":"2024-03-30T13:10:46.244024+0000","last_active":"2024-03-30T13:10:47.991801+0000","last_peered":"2024-03-30T13:10:47.991801+0000","last_clean":"2024-03-30T13:10:47.991801+0000","last_became_active":"2024-03-30T13:10:46.243697+0000","last_became_peered":"2024-03-30T13:10:46.243697+0000","last_unstale":"2024-03-30T13:10:47.991801+0000","last_undegraded":"2024-03-30T13:10:47.991801+0000","last_fullsized":"2024-03-30T13:10:47.991801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:38.672797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246287+0000","last_change":"2024-03-30T13:10:46.234379+0000","last_active":"2024-03-30T13:10:47.246287+0000","last_peered":"2024-03-30T13:10:47.246287+0000","last_clean":"2024-03-30T13:10:47.246287+0000","last_became_active":"2024-03-30T13:10:46.234047+0000","last_became_peered":"2024-03-30T13:10:46.234047+0000","last_unstale":"2024-03-30T13:10:47.246287+0000","last_undegraded":"2024-03-30T13:10:47.246287+0000","last_fullsized":"2024-03-30T13:10:47.246287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991724+0000","last_change":"2024-03-30T13:10:46.243204+0000","last_active":"2024-03-30T13:10:47.991724+0000","last_peered":"2024-03-30T13:10:47.991724+0000","last_clean":"2024-03-30T13:10:47.991724+0000","last_became_active":"2024-03-30T13:10:46.242897+0000","last_became_peered":"2024-03-30T13:10:46.242897+0000","last_unstale":"2024-03-30T13:10:47.991724+0000","last_undegraded":"2024-03-30T13:10:47.991724+0000","last_fullsized":"2024-03-30T13:10:47.991724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:50.453642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245509+0000","last_change":"2024-03-30T13:10:46.244716+0000","last_active":"2024-03-30T13:10:47.245509+0000","last_peered":"2024-03-30T13:10:47.245509+0000","last_clean":"2024-03-30T13:10:47.245509+0000","last_became_active":"2024-03-30T13:10:46.244353+0000","last_became_peered":"2024-03-30T13:10:46.244353+0000","last_unstale":"2024-03-30T13:10:47.245509+0000","last_undegraded":"2024-03-30T13:10:47.245509+0000","last_fullsized":"2024-03-30T13:10:47.245509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280766+0000","last_change":"2024-03-30T13:10:46.255145+0000","last_active":"2024-03-30T13:10:48.280766+0000","last_peered":"2024-03-30T13:10:48.280766+0000","last_clean":"2024-03-30T13:10:48.280766+0000","last_became_active":"2024-03-30T13:10:46.254848+0000","last_became_peered":"2024-03-30T13:10:46.254848+0000","last_unstale":"2024-03-30T13:10:48.280766+0000","last_undegraded":"2024-03-30T13:10:48.280766+0000","last_fullsized":"2024-03-30T13:10:48.280766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243525+0000","last_change":"2024-03-30T13:10:46.249338+0000","last_active":"2024-03-30T13:10:47.243525+0000","last_peered":"2024-03-30T13:10:47.243525+0000","last_clean":"2024-03-30T13:10:47.243525+0000","last_became_active":"2024-03-30T13:10:46.248206+0000","last_became_peered":"2024-03-30T13:10:46.248206+0000","last_unstale":"2024-03-30T13:10:47.243525+0000","last_undegraded":"2024-03-30T13:10:47.243525+0000","last_fullsized":"2024-03-30T13:10:47.243525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:38.672797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245949+0000","last_change":"2024-03-30T13:10:46.236494+0000","last_active":"2024-03-30T13:10:47.245949+0000","last_peered":"2024-03-30T13:10:47.245949+0000","last_clean":"2024-03-30T13:10:47.245949+0000","last_became_active":"2024-03-30T13:10:46.236199+0000","last_became_peered":"2024-03-30T13:10:46.236199+0000","last_unstale":"2024-03-30T13:10:47.245949+0000","last_undegraded":"2024-03-30T13:10:47.245949+0000","last_fullsized":"2024-03-30T13:10:47.245949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245994+0000","last_change":"2024-03-30T13:10:46.245545+0000","last_active":"2024-03-30T13:10:47.245994+0000","last_peered":"2024-03-30T13:10:47.245994+0000","last_clean":"2024-03-30T13:10:47.245994+0000","last_became_active":"2024-03-30T13:10:46.245286+0000","last_became_peered":"2024-03-30T13:10:46.245286+0000","last_unstale":"2024-03-30T13:10:47.245994+0000","last_undegraded":"2024-03-30T13:10:47.245994+0000","last_fullsized":"2024-03-30T13:10:47.245994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245950+0000","last_change":"2024-03-30T13:10:46.256061+0000","last_active":"2024-03-30T13:10:47.245950+0000","last_peered":"2024-03-30T13:10:47.245950+0000","last_clean":"2024-03-30T13:10:47.245950+0000","last_became_active":"2024-03-30T13:10:46.252144+0000","last_became_peered":"2024-03-30T13:10:46.252144+0000","last_unstale":"2024-03-30T13:10:47.245950+0000","last_undegraded":"2024-03-30T13:10:47.245950+0000","last_fullsized":"2024-03-30T13:10:47.245950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248585+0000","last_change":"2024-03-30T13:10:46.240158+0000","last_active":"2024-03-30T13:10:47.248585+0000","last_peered":"2024-03-30T13:10:47.248585+0000","last_clean":"2024-03-30T13:10:47.248585+0000","last_became_active":"2024-03-30T13:10:46.235455+0000","last_became_peered":"2024-03-30T13:10:46.235455+0000","last_unstale":"2024-03-30T13:10:47.248585+0000","last_undegraded":"2024-03-30T13:10:47.248585+0000","last_fullsized":"2024-03-30T13:10:47.248585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:00.666500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248107+0000","last_change":"2024-03-30T13:10:46.243687+0000","last_active":"2024-03-30T13:10:47.248107+0000","last_peered":"2024-03-30T13:10:47.248107+0000","last_clean":"2024-03-30T13:10:47.248107+0000","last_became_active":"2024-03-30T13:10:46.243389+0000","last_became_peered":"2024-03-30T13:10:46.243389+0000","last_unstale":"2024-03-30T13:10:47.248107+0000","last_undegraded":"2024-03-30T13:10:47.248107+0000","last_fullsized":"2024-03-30T13:10:47.248107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280718+0000","last_change":"2024-03-30T13:10:46.256471+0000","last_active":"2024-03-30T13:10:48.280718+0000","last_peered":"2024-03-30T13:10:48.280718+0000","last_clean":"2024-03-30T13:10:48.280718+0000","last_became_active":"2024-03-30T13:10:46.256215+0000","last_became_peered":"2024-03-30T13:10:46.256215+0000","last_unstale":"2024-03-30T13:10:48.280718+0000","last_undegraded":"2024-03-30T13:10:48.280718+0000","last_fullsized":"2024-03-30T13:10:48.280718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278522+0000","last_change":"2024-03-30T13:10:46.233516+0000","last_active":"2024-03-30T13:10:48.278522+0000","last_peered":"2024-03-30T13:10:48.278522+0000","last_clean":"2024-03-30T13:10:48.278522+0000","last_became_active":"2024-03-30T13:10:46.233168+0000","last_became_peered":"2024-03-30T13:10:46.233168+0000","last_unstale":"2024-03-30T13:10:48.278522+0000","last_undegraded":"2024-03-30T13:10:48.278522+0000","last_fullsized":"2024-03-30T13:10:48.278522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:13.303492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280093+0000","last_change":"2024-03-30T13:10:46.260609+0000","last_active":"2024-03-30T13:10:48.280093+0000","last_peered":"2024-03-30T13:10:48.280093+0000","last_clean":"2024-03-30T13:10:48.280093+0000","last_became_active":"2024-03-30T13:10:46.257204+0000","last_became_peered":"2024-03-30T13:10:46.257204+0000","last_unstale":"2024-03-30T13:10:48.280093+0000","last_undegraded":"2024-03-30T13:10:48.280093+0000","last_fullsized":"2024-03-30T13:10:48.280093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:33:04.251828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.258357+0000","last_change":"2024-03-30T13:10:46.253562+0000","last_active":"2024-03-30T13:10:46.258357+0000","last_peered":"2024-03-30T13:10:46.258357+0000","last_clean":"2024-03-30T13:10:46.258357+0000","last_became_active":"2024-03-30T13:10:46.253288+0000","last_became_peered":"2024-03-30T13:10:46.253288+0000","last_unstale":"2024-03-30T13:10:46.258357+0000","last_undegraded":"2024-03-30T13:10:46.258357+0000","last_fullsized":"2024-03-30T13:10:46.258357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:44:49.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279336+0000","last_change":"2024-03-30T13:10:46.244101+0000","last_active":"2024-03-30T13:10:48.279336+0000","last_peered":"2024-03-30T13:10:48.279336+0000","last_clean":"2024-03-30T13:10:48.279336+0000","last_became_active":"2024-03-30T13:10:46.241383+0000","last_became_peered":"2024-03-30T13:10:46.241383+0000","last_unstale":"2024-03-30T13:10:48.279336+0000","last_undegraded":"2024-03-30T13:10:48.279336+0000","last_fullsized":"2024-03-30T13:10:48.279336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:09.717253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246132+0000","last_change":"2024-03-30T13:10:46.258488+0000","last_active":"2024-03-30T13:10:47.246132+0000","last_peered":"2024-03-30T13:10:47.246132+0000","last_clean":"2024-03-30T13:10:47.246132+0000","last_became_active":"2024-03-30T13:10:46.251558+0000","last_became_peered":"2024-03-30T13:10:46.251558+0000","last_unstale":"2024-03-30T13:10:47.246132+0000","last_undegraded":"2024-03-30T13:10:47.246132+0000","last_fullsized":"2024-03-30T13:10:47.246132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250207+0000","last_change":"2024-03-30T13:10:46.243487+0000","last_active":"2024-03-30T13:10:47.250207+0000","last_peered":"2024-03-30T13:10:47.250207+0000","last_clean":"2024-03-30T13:10:47.250207+0000","last_became_active":"2024-03-30T13:10:46.243102+0000","last_became_peered":"2024-03-30T13:10:46.243102+0000","last_unstale":"2024-03-30T13:10:47.250207+0000","last_undegraded":"2024-03-30T13:10:47.250207+0000","last_fullsized":"2024-03-30T13:10:47.250207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243005+0000","last_change":"2024-03-30T13:10:46.262008+0000","last_active":"2024-03-30T13:10:47.243005+0000","last_peered":"2024-03-30T13:10:47.243005+0000","last_clean":"2024-03-30T13:10:47.243005+0000","last_became_active":"2024-03-30T13:10:46.259954+0000","last_became_peered":"2024-03-30T13:10:46.259954+0000","last_unstale":"2024-03-30T13:10:47.243005+0000","last_undegraded":"2024-03-30T13:10:47.243005+0000","last_fullsized":"2024-03-30T13:10:47.243005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:50.453642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280858+0000","last_change":"2024-03-30T13:10:46.247945+0000","last_active":"2024-03-30T13:10:48.280858+0000","last_peered":"2024-03-30T13:10:48.280858+0000","last_clean":"2024-03-30T13:10:48.280858+0000","last_became_active":"2024-03-30T13:10:46.247685+0000","last_became_peered":"2024-03-30T13:10:46.247685+0000","last_unstale":"2024-03-30T13:10:48.280858+0000","last_undegraded":"2024-03-30T13:10:48.280858+0000","last_fullsized":"2024-03-30T13:10:48.280858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278783+0000","last_change":"2024-03-30T13:10:46.238738+0000","last_active":"2024-03-30T13:10:48.278783+0000","last_peered":"2024-03-30T13:10:48.278783+0000","last_clean":"2024-03-30T13:10:48.278783+0000","last_became_active":"2024-03-30T13:10:46.238383+0000","last_became_peered":"2024-03-30T13:10:46.238383+0000","last_unstale":"2024-03-30T13:10:48.278783+0000","last_undegraded":"2024-03-30T13:10:48.278783+0000","last_fullsized":"2024-03-30T13:10:48.278783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:43:03.365657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282406+0000","last_change":"2024-03-30T13:10:46.249445+0000","last_active":"2024-03-30T13:10:48.282406+0000","last_peered":"2024-03-30T13:10:48.282406+0000","last_clean":"2024-03-30T13:10:48.282406+0000","last_became_active":"2024-03-30T13:10:46.249008+0000","last_became_peered":"2024-03-30T13:10:46.249008+0000","last_unstale":"2024-03-30T13:10:48.282406+0000","last_undegraded":"2024-03-30T13:10:48.282406+0000","last_fullsized":"2024-03-30T13:10:48.282406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992191+0000","last_change":"2024-03-30T13:10:46.247610+0000","last_active":"2024-03-30T13:10:47.992191+0000","last_peered":"2024-03-30T13:10:47.992191+0000","last_clean":"2024-03-30T13:10:47.992191+0000","last_became_active":"2024-03-30T13:10:46.247333+0000","last_became_peered":"2024-03-30T13:10:46.247333+0000","last_unstale":"2024-03-30T13:10:47.992191+0000","last_undegraded":"2024-03-30T13:10:47.992191+0000","last_fullsized":"2024-03-30T13:10:47.992191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248607+0000","last_change":"2024-03-30T13:10:46.243725+0000","last_active":"2024-03-30T13:10:47.248607+0000","last_peered":"2024-03-30T13:10:47.248607+0000","last_clean":"2024-03-30T13:10:47.248607+0000","last_became_active":"2024-03-30T13:10:46.243423+0000","last_became_peered":"2024-03-30T13:10:46.243423+0000","last_unstale":"2024-03-30T13:10:47.248607+0000","last_undegraded":"2024-03-30T13:10:47.248607+0000","last_fullsized":"2024-03-30T13:10:47.248607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248584+0000","last_change":"2024-03-30T13:10:46.254386+0000","last_active":"2024-03-30T13:10:47.248584+0000","last_peered":"2024-03-30T13:10:47.248584+0000","last_clean":"2024-03-30T13:10:47.248584+0000","last_became_active":"2024-03-30T13:10:46.254081+0000","last_became_peered":"2024-03-30T13:10:46.254081+0000","last_unstale":"2024-03-30T13:10:47.248584+0000","last_undegraded":"2024-03-30T13:10:47.248584+0000","last_fullsized":"2024-03-30T13:10:47.248584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281880+0000","last_change":"2024-03-30T13:10:46.246367+0000","last_active":"2024-03-30T13:10:48.281880+0000","last_peered":"2024-03-30T13:10:48.281880+0000","last_clean":"2024-03-30T13:10:48.281880+0000","last_became_active":"2024-03-30T13:10:46.246066+0000","last_became_peered":"2024-03-30T13:10:46.246066+0000","last_unstale":"2024-03-30T13:10:48.281880+0000","last_undegraded":"2024-03-30T13:10:48.281880+0000","last_fullsized":"2024-03-30T13:10:48.281880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278521+0000","last_change":"2024-03-30T13:10:46.234128+0000","last_active":"2024-03-30T13:10:48.278521+0000","last_peered":"2024-03-30T13:10:48.278521+0000","last_clean":"2024-03-30T13:10:48.278521+0000","last_became_active":"2024-03-30T13:10:46.233731+0000","last_became_peered":"2024-03-30T13:10:46.233731+0000","last_unstale":"2024-03-30T13:10:48.278521+0000","last_undegraded":"2024-03-30T13:10:48.278521+0000","last_fullsized":"2024-03-30T13:10:48.278521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.256707+0000","last_change":"2024-03-30T13:10:46.247881+0000","last_active":"2024-03-30T13:10:46.256707+0000","last_peered":"2024-03-30T13:10:46.256707+0000","last_clean":"2024-03-30T13:10:46.256707+0000","last_became_active":"2024-03-30T13:10:46.247618+0000","last_became_peered":"2024-03-30T13:10:46.247618+0000","last_unstale":"2024-03-30T13:10:46.256707+0000","last_undegraded":"2024-03-30T13:10:46.256707+0000","last_fullsized":"2024-03-30T13:10:46.256707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:32.391989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991337+0000","last_change":"2024-03-30T13:10:46.253544+0000","last_active":"2024-03-30T13:10:47.991337+0000","last_peered":"2024-03-30T13:10:47.991337+0000","last_clean":"2024-03-30T13:10:47.991337+0000","last_became_active":"2024-03-30T13:10:46.253034+0000","last_became_peered":"2024-03-30T13:10:46.253034+0000","last_unstale":"2024-03-30T13:10:47.991337+0000","last_undegraded":"2024-03-30T13:10:47.991337+0000","last_fullsized":"2024-03-30T13:10:47.991337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:58.607723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243141+0000","last_change":"2024-03-30T13:10:46.237581+0000","last_active":"2024-03-30T13:10:47.243141+0000","last_peered":"2024-03-30T13:10:47.243141+0000","last_clean":"2024-03-30T13:10:47.243141+0000","last_became_active":"2024-03-30T13:10:46.237307+0000","last_became_peered":"2024-03-30T13:10:46.237307+0000","last_unstale":"2024-03-30T13:10:47.243141+0000","last_undegraded":"2024-03-30T13:10:47.243141+0000","last_fullsized":"2024-03-30T13:10:47.243141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:19.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282213+0000","last_change":"2024-03-30T13:10:45.225591+0000","last_active":"2024-03-30T13:10:48.282213+0000","last_peered":"2024-03-30T13:10:48.282213+0000","last_clean":"2024-03-30T13:10:48.282213+0000","last_became_active":"2024-03-30T13:10:45.224943+0000","last_became_peered":"2024-03-30T13:10:45.224943+0000","last_unstale":"2024-03-30T13:10:48.282213+0000","last_undegraded":"2024-03-30T13:10:48.282213+0000","last_fullsized":"2024-03-30T13:10:48.282213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250237+0000","last_change":"2024-03-30T13:10:46.260952+0000","last_active":"2024-03-30T13:10:47.250237+0000","last_peered":"2024-03-30T13:10:47.250237+0000","last_clean":"2024-03-30T13:10:47.250237+0000","last_became_active":"2024-03-30T13:10:46.260001+0000","last_became_peered":"2024-03-30T13:10:46.260001+0000","last_unstale":"2024-03-30T13:10:47.250237+0000","last_undegraded":"2024-03-30T13:10:47.250237+0000","last_fullsized":"2024-03-30T13:10:47.250237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278771+0000","last_change":"2024-03-30T13:10:45.220120+0000","last_active":"2024-03-30T13:10:48.278771+0000","last_peered":"2024-03-30T13:10:48.278771+0000","last_clean":"2024-03-30T13:10:48.278771+0000","last_became_active":"2024-03-30T13:10:45.218922+0000","last_became_peered":"2024-03-30T13:10:45.218922+0000","last_unstale":"2024-03-30T13:10:48.278771+0000","last_undegraded":"2024-03-30T13:10:48.278771+0000","last_fullsized":"2024-03-30T13:10:48.278771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:18.840387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247862+0000","last_change":"2024-03-30T13:10:45.211201+0000","last_active":"2024-03-30T13:10:47.247862+0000","last_peered":"2024-03-30T13:10:47.247862+0000","last_clean":"2024-03-30T13:10:47.247862+0000","last_became_active":"2024-03-30T13:10:45.210742+0000","last_became_peered":"2024-03-30T13:10:45.210742+0000","last_unstale":"2024-03-30T13:10:47.247862+0000","last_undegraded":"2024-03-30T13:10:47.247862+0000","last_fullsized":"2024-03-30T13:10:47.247862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281386+0000","last_change":"2024-03-30T13:10:46.236372+0000","last_active":"2024-03-30T13:10:48.281386+0000","last_peered":"2024-03-30T13:10:48.281386+0000","last_clean":"2024-03-30T13:10:48.281386+0000","last_became_active":"2024-03-30T13:10:46.236108+0000","last_became_peered":"2024-03-30T13:10:46.236108+0000","last_unstale":"2024-03-30T13:10:48.281386+0000","last_undegraded":"2024-03-30T13:10:48.281386+0000","last_fullsized":"2024-03-30T13:10:48.281386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278586+0000","last_change":"2024-03-30T13:10:45.217654+0000","last_active":"2024-03-30T13:10:48.278586+0000","last_peered":"2024-03-30T13:10:48.278586+0000","last_clean":"2024-03-30T13:10:48.278586+0000","last_became_active":"2024-03-30T13:10:45.217372+0000","last_became_peered":"2024-03-30T13:10:45.217372+0000","last_unstale":"2024-03-30T13:10:48.278586+0000","last_undegraded":"2024-03-30T13:10:48.278586+0000","last_fullsized":"2024-03-30T13:10:48.278586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:57.594719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249908+0000","last_change":"2024-03-30T13:10:46.247867+0000","last_active":"2024-03-30T13:10:47.249908+0000","last_peered":"2024-03-30T13:10:47.249908+0000","last_clean":"2024-03-30T13:10:47.249908+0000","last_became_active":"2024-03-30T13:10:46.246955+0000","last_became_peered":"2024-03-30T13:10:46.246955+0000","last_unstale":"2024-03-30T13:10:47.249908+0000","last_undegraded":"2024-03-30T13:10:47.249908+0000","last_fullsized":"2024-03-30T13:10:47.249908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243434+0000","last_change":"2024-03-30T13:10:45.226750+0000","last_active":"2024-03-30T13:10:47.243434+0000","last_peered":"2024-03-30T13:10:47.243434+0000","last_clean":"2024-03-30T13:10:47.243434+0000","last_became_active":"2024-03-30T13:10:45.226384+0000","last_became_peered":"2024-03-30T13:10:45.226384+0000","last_unstale":"2024-03-30T13:10:47.243434+0000","last_undegraded":"2024-03-30T13:10:47.243434+0000","last_fullsized":"2024-03-30T13:10:47.243434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:34:23.517546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992111+0000","last_change":"2024-03-30T13:10:46.246063+0000","last_active":"2024-03-30T13:10:47.992111+0000","last_peered":"2024-03-30T13:10:47.992111+0000","last_clean":"2024-03-30T13:10:47.992111+0000","last_became_active":"2024-03-30T13:10:46.245539+0000","last_became_peered":"2024-03-30T13:10:46.245539+0000","last_unstale":"2024-03-30T13:10:47.992111+0000","last_undegraded":"2024-03-30T13:10:47.992111+0000","last_fullsized":"2024-03-30T13:10:47.992111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246015+0000","last_change":"2024-03-30T13:10:45.205745+0000","last_active":"2024-03-30T13:10:47.246015+0000","last_peered":"2024-03-30T13:10:47.246015+0000","last_clean":"2024-03-30T13:10:47.246015+0000","last_became_active":"2024-03-30T13:10:45.204814+0000","last_became_peered":"2024-03-30T13:10:45.204814+0000","last_unstale":"2024-03-30T13:10:47.246015+0000","last_undegraded":"2024-03-30T13:10:47.246015+0000","last_fullsized":"2024-03-30T13:10:47.246015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282464+0000","last_change":"2024-03-30T13:10:46.241152+0000","last_active":"2024-03-30T13:10:48.282464+0000","last_peered":"2024-03-30T13:10:48.282464+0000","last_clean":"2024-03-30T13:10:48.282464+0000","last_became_active":"2024-03-30T13:10:46.240813+0000","last_became_peered":"2024-03-30T13:10:46.240813+0000","last_unstale":"2024-03-30T13:10:48.282464+0000","last_undegraded":"2024-03-30T13:10:48.282464+0000","last_fullsized":"2024-03-30T13:10:48.282464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.260991+0000","last_change":"2024-03-30T13:10:45.227319+0000","last_active":"2024-03-30T13:10:46.260991+0000","last_peered":"2024-03-30T13:10:46.260991+0000","last_clean":"2024-03-30T13:10:46.260991+0000","last_became_active":"2024-03-30T13:10:45.226913+0000","last_became_peered":"2024-03-30T13:10:45.226913+0000","last_unstale":"2024-03-30T13:10:46.260991+0000","last_undegraded":"2024-03-30T13:10:46.260991+0000","last_fullsized":"2024-03-30T13:10:46.260991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:22.060387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278632+0000","last_change":"2024-03-30T13:10:46.243390+0000","last_active":"2024-03-30T13:10:48.278632+0000","last_peered":"2024-03-30T13:10:48.278632+0000","last_clean":"2024-03-30T13:10:48.278632+0000","last_became_active":"2024-03-30T13:10:46.242925+0000","last_became_peered":"2024-03-30T13:10:46.242925+0000","last_unstale":"2024-03-30T13:10:48.278632+0000","last_undegraded":"2024-03-30T13:10:48.278632+0000","last_fullsized":"2024-03-30T13:10:48.278632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:42.999062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991874+0000","last_change":"2024-03-30T13:10:45.222454+0000","last_active":"2024-03-30T13:10:47.991874+0000","last_peered":"2024-03-30T13:10:47.991874+0000","last_clean":"2024-03-30T13:10:47.991874+0000","last_became_active":"2024-03-30T13:10:45.222143+0000","last_became_peered":"2024-03-30T13:10:45.222143+0000","last_unstale":"2024-03-30T13:10:47.991874+0000","last_undegraded":"2024-03-30T13:10:47.991874+0000","last_fullsized":"2024-03-30T13:10:47.991874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:19.786645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246001+0000","last_change":"2024-03-30T13:10:46.240683+0000","last_active":"2024-03-30T13:10:47.246001+0000","last_peered":"2024-03-30T13:10:47.246001+0000","last_clean":"2024-03-30T13:10:47.246001+0000","last_became_active":"2024-03-30T13:10:46.240375+0000","last_became_peered":"2024-03-30T13:10:46.240375+0000","last_unstale":"2024-03-30T13:10:47.246001+0000","last_undegraded":"2024-03-30T13:10:47.246001+0000","last_fullsized":"2024-03-30T13:10:47.246001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.266262+0000","last_change":"2024-03-30T13:10:45.222380+0000","last_active":"2024-03-30T13:10:46.266262+0000","last_peered":"2024-03-30T13:10:46.266262+0000","last_clean":"2024-03-30T13:10:46.266262+0000","last_became_active":"2024-03-30T13:10:45.221975+0000","last_became_peered":"2024-03-30T13:10:45.221975+0000","last_unstale":"2024-03-30T13:10:46.266262+0000","last_undegraded":"2024-03-30T13:10:46.266262+0000","last_fullsized":"2024-03-30T13:10:46.266262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:26:59.790496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248472+0000","last_change":"2024-03-30T13:10:46.232634+0000","last_active":"2024-03-30T13:10:47.248472+0000","last_peered":"2024-03-30T13:10:47.248472+0000","last_clean":"2024-03-30T13:10:47.248472+0000","last_became_active":"2024-03-30T13:10:46.232300+0000","last_became_peered":"2024-03-30T13:10:46.232300+0000","last_unstale":"2024-03-30T13:10:47.248472+0000","last_undegraded":"2024-03-30T13:10:47.248472+0000","last_fullsized":"2024-03-30T13:10:47.248472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278970+0000","last_change":"2024-03-30T13:10:45.218507+0000","last_active":"2024-03-30T13:10:48.278970+0000","last_peered":"2024-03-30T13:10:48.278970+0000","last_clean":"2024-03-30T13:10:48.278970+0000","last_became_active":"2024-03-30T13:10:45.218111+0000","last_became_peered":"2024-03-30T13:10:45.218111+0000","last_unstale":"2024-03-30T13:10:48.278970+0000","last_undegraded":"2024-03-30T13:10:48.278970+0000","last_fullsized":"2024-03-30T13:10:48.278970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:59.653496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278733+0000","last_change":"2024-03-30T13:10:46.239582+0000","last_active":"2024-03-30T13:10:48.278733+0000","last_peered":"2024-03-30T13:10:48.278733+0000","last_clean":"2024-03-30T13:10:48.278733+0000","last_became_active":"2024-03-30T13:10:46.237808+0000","last_became_peered":"2024-03-30T13:10:46.237808+0000","last_unstale":"2024-03-30T13:10:48.278733+0000","last_undegraded":"2024-03-30T13:10:48.278733+0000","last_fullsized":"2024-03-30T13:10:48.278733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:58.426124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245598+0000","last_change":"2024-03-30T13:10:45.210052+0000","last_active":"2024-03-30T13:10:47.245598+0000","last_peered":"2024-03-30T13:10:47.245598+0000","last_clean":"2024-03-30T13:10:47.245598+0000","last_became_active":"2024-03-30T13:10:45.205338+0000","last_became_peered":"2024-03-30T13:10:45.205338+0000","last_unstale":"2024-03-30T13:10:47.245598+0000","last_undegraded":"2024-03-30T13:10:47.245598+0000","last_fullsized":"2024-03-30T13:10:47.245598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:57.594719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242878+0000","last_change":"2024-03-30T13:10:46.247309+0000","last_active":"2024-03-30T13:10:47.242878+0000","last_peered":"2024-03-30T13:10:47.242878+0000","last_clean":"2024-03-30T13:10:47.242878+0000","last_became_active":"2024-03-30T13:10:46.243301+0000","last_became_peered":"2024-03-30T13:10:46.243301+0000","last_unstale":"2024-03-30T13:10:47.242878+0000","last_undegraded":"2024-03-30T13:10:47.242878+0000","last_fullsized":"2024-03-30T13:10:47.242878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:56.949656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249704+0000","last_change":"2024-03-30T13:10:45.221532+0000","last_active":"2024-03-30T13:10:47.249704+0000","last_peered":"2024-03-30T13:10:47.249704+0000","last_clean":"2024-03-30T13:10:47.249704+0000","last_became_active":"2024-03-30T13:10:45.220536+0000","last_became_peered":"2024-03-30T13:10:45.220536+0000","last_unstale":"2024-03-30T13:10:47.249704+0000","last_undegraded":"2024-03-30T13:10:47.249704+0000","last_fullsized":"2024-03-30T13:10:47.249704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279358+0000","last_change":"2024-03-30T13:10:46.242980+0000","last_active":"2024-03-30T13:10:48.279358+0000","last_peered":"2024-03-30T13:10:48.279358+0000","last_clean":"2024-03-30T13:10:48.279358+0000","last_became_active":"2024-03-30T13:10:46.242702+0000","last_became_peered":"2024-03-30T13:10:46.242702+0000","last_unstale":"2024-03-30T13:10:48.279358+0000","last_undegraded":"2024-03-30T13:10:48.279358+0000","last_fullsized":"2024-03-30T13:10:48.279358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:42:22.008993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246344+0000","last_change":"2024-03-30T13:10:45.223223+0000","last_active":"2024-03-30T13:10:47.246344+0000","last_peered":"2024-03-30T13:10:47.246344+0000","last_clean":"2024-03-30T13:10:47.246344+0000","last_became_active":"2024-03-30T13:10:45.222887+0000","last_became_peered":"2024-03-30T13:10:45.222887+0000","last_unstale":"2024-03-30T13:10:47.246344+0000","last_undegraded":"2024-03-30T13:10:47.246344+0000","last_fullsized":"2024-03-30T13:10:47.246344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992357+0000","last_change":"2024-03-30T13:10:46.254732+0000","last_active":"2024-03-30T13:10:47.992357+0000","last_peered":"2024-03-30T13:10:47.992357+0000","last_clean":"2024-03-30T13:10:47.992357+0000","last_became_active":"2024-03-30T13:10:46.254356+0000","last_became_peered":"2024-03-30T13:10:46.254356+0000","last_unstale":"2024-03-30T13:10:47.992357+0000","last_undegraded":"2024-03-30T13:10:47.992357+0000","last_fullsized":"2024-03-30T13:10:47.992357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250809+0000","last_change":"2024-03-30T13:10:45.224819+0000","last_active":"2024-03-30T13:10:47.250809+0000","last_peered":"2024-03-30T13:10:47.250809+0000","last_clean":"2024-03-30T13:10:47.250809+0000","last_became_active":"2024-03-30T13:10:45.223270+0000","last_became_peered":"2024-03-30T13:10:45.223270+0000","last_unstale":"2024-03-30T13:10:47.250809+0000","last_undegraded":"2024-03-30T13:10:47.250809+0000","last_fullsized":"2024-03-30T13:10:47.250809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246314+0000","last_change":"2024-03-30T13:10:46.254500+0000","last_active":"2024-03-30T13:10:47.246314+0000","last_peered":"2024-03-30T13:10:47.246314+0000","last_clean":"2024-03-30T13:10:47.246314+0000","last_became_active":"2024-03-30T13:10:46.254208+0000","last_became_peered":"2024-03-30T13:10:46.254208+0000","last_unstale":"2024-03-30T13:10:47.246314+0000","last_undegraded":"2024-03-30T13:10:47.246314+0000","last_fullsized":"2024-03-30T13:10:47.246314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:42.999062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282278+0000","last_change":"2024-03-30T13:10:45.225766+0000","last_active":"2024-03-30T13:10:48.282278+0000","last_peered":"2024-03-30T13:10:48.282278+0000","last_clean":"2024-03-30T13:10:48.282278+0000","last_became_active":"2024-03-30T13:10:45.225096+0000","last_became_peered":"2024-03-30T13:10:45.225096+0000","last_unstale":"2024-03-30T13:10:48.282278+0000","last_undegraded":"2024-03-30T13:10:48.282278+0000","last_fullsized":"2024-03-30T13:10:48.282278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246156+0000","last_change":"2024-03-30T13:10:46.255837+0000","last_active":"2024-03-30T13:10:47.246156+0000","last_peered":"2024-03-30T13:10:47.246156+0000","last_clean":"2024-03-30T13:10:47.246156+0000","last_became_active":"2024-03-30T13:10:46.251826+0000","last_became_peered":"2024-03-30T13:10:46.251826+0000","last_unstale":"2024-03-30T13:10:47.246156+0000","last_undegraded":"2024-03-30T13:10:47.246156+0000","last_fullsized":"2024-03-30T13:10:47.246156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248851+0000","last_change":"2024-03-30T13:10:45.210147+0000","last_active":"2024-03-30T13:10:47.248851+0000","last_peered":"2024-03-30T13:10:47.248851+0000","last_clean":"2024-03-30T13:10:47.248851+0000","last_became_active":"2024-03-30T13:10:45.209716+0000","last_became_peered":"2024-03-30T13:10:45.209716+0000","last_unstale":"2024-03-30T13:10:47.248851+0000","last_undegraded":"2024-03-30T13:10:47.248851+0000","last_fullsized":"2024-03-30T13:10:47.248851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279114+0000","last_change":"2024-03-30T13:10:46.244995+0000","last_active":"2024-03-30T13:10:48.279114+0000","last_peered":"2024-03-30T13:10:48.279114+0000","last_clean":"2024-03-30T13:10:48.279114+0000","last_became_active":"2024-03-30T13:10:46.244716+0000","last_became_peered":"2024-03-30T13:10:46.244716+0000","last_unstale":"2024-03-30T13:10:48.279114+0000","last_undegraded":"2024-03-30T13:10:48.279114+0000","last_fullsized":"2024-03-30T13:10:48.279114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:56.283461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242840+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:10:47.242840+0000","last_peered":"2024-03-30T13:10:47.242840+0000","last_clean":"2024-03-30T13:10:47.242840+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:10:47.242840+0000","last_undegraded":"2024-03-30T13:10:47.242840+0000","last_fullsized":"2024-03-30T13:10:47.242840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278834+0000","last_change":"2024-03-30T13:10:45.216758+0000","last_active":"2024-03-30T13:10:48.278834+0000","last_peered":"2024-03-30T13:10:48.278834+0000","last_clean":"2024-03-30T13:10:48.278834+0000","last_became_active":"2024-03-30T13:10:45.215040+0000","last_became_peered":"2024-03-30T13:10:45.215040+0000","last_unstale":"2024-03-30T13:10:48.278834+0000","last_undegraded":"2024-03-30T13:10:48.278834+0000","last_fullsized":"2024-03-30T13:10:48.278834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.089085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249967+0000","last_change":"2024-03-30T13:10:46.243383+0000","last_active":"2024-03-30T13:10:47.249967+0000","last_peered":"2024-03-30T13:10:47.249967+0000","last_clean":"2024-03-30T13:10:47.249967+0000","last_became_active":"2024-03-30T13:10:46.243046+0000","last_became_peered":"2024-03-30T13:10:46.243046+0000","last_unstale":"2024-03-30T13:10:47.249967+0000","last_undegraded":"2024-03-30T13:10:47.249967+0000","last_fullsized":"2024-03-30T13:10:47.249967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278692+0000","last_change":"2024-03-30T13:10:45.221144+0000","last_active":"2024-03-30T13:10:48.278692+0000","last_peered":"2024-03-30T13:10:48.278692+0000","last_clean":"2024-03-30T13:10:48.278692+0000","last_became_active":"2024-03-30T13:10:45.219684+0000","last_became_peered":"2024-03-30T13:10:45.219684+0000","last_unstale":"2024-03-30T13:10:48.278692+0000","last_undegraded":"2024-03-30T13:10:48.278692+0000","last_fullsized":"2024-03-30T13:10:48.278692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:49.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247995+0000","last_change":"2024-03-30T13:10:46.239001+0000","last_active":"2024-03-30T13:10:47.247995+0000","last_peered":"2024-03-30T13:10:47.247995+0000","last_clean":"2024-03-30T13:10:47.247995+0000","last_became_active":"2024-03-30T13:10:46.238750+0000","last_became_peered":"2024-03-30T13:10:46.238750+0000","last_unstale":"2024-03-30T13:10:47.247995+0000","last_undegraded":"2024-03-30T13:10:47.247995+0000","last_fullsized":"2024-03-30T13:10:47.247995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.235562+0000","last_change":"2024-03-30T13:10:45.223067+0000","last_active":"2024-03-30T13:10:46.235562+0000","last_peered":"2024-03-30T13:10:46.235562+0000","last_clean":"2024-03-30T13:10:46.235562+0000","last_became_active":"2024-03-30T13:10:45.222778+0000","last_became_peered":"2024-03-30T13:10:45.222778+0000","last_unstale":"2024-03-30T13:10:46.235562+0000","last_undegraded":"2024-03-30T13:10:46.235562+0000","last_fullsized":"2024-03-30T13:10:46.235562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:35:37.871387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280762+0000","last_change":"2024-03-30T13:10:46.246374+0000","last_active":"2024-03-30T13:10:48.280762+0000","last_peered":"2024-03-30T13:10:48.280762+0000","last_clean":"2024-03-30T13:10:48.280762+0000","last_became_active":"2024-03-30T13:10:46.246094+0000","last_became_peered":"2024-03-30T13:10:46.246094+0000","last_unstale":"2024-03-30T13:10:48.280762+0000","last_undegraded":"2024-03-30T13:10:48.280762+0000","last_fullsized":"2024-03-30T13:10:48.280762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279004+0000","last_change":"2024-03-30T13:10:45.220442+0000","last_active":"2024-03-30T13:10:48.279004+0000","last_peered":"2024-03-30T13:10:48.279004+0000","last_clean":"2024-03-30T13:10:48.279004+0000","last_became_active":"2024-03-30T13:10:45.219537+0000","last_became_peered":"2024-03-30T13:10:45.219537+0000","last_unstale":"2024-03-30T13:10:48.279004+0000","last_undegraded":"2024-03-30T13:10:48.279004+0000","last_fullsized":"2024-03-30T13:10:48.279004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:37.659793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246414+0000","last_change":"2024-03-30T13:10:46.249794+0000","last_active":"2024-03-30T13:10:47.246414+0000","last_peered":"2024-03-30T13:10:47.246414+0000","last_clean":"2024-03-30T13:10:47.246414+0000","last_became_active":"2024-03-30T13:10:46.249501+0000","last_became_peered":"2024-03-30T13:10:46.249501+0000","last_unstale":"2024-03-30T13:10:47.246414+0000","last_undegraded":"2024-03-30T13:10:47.246414+0000","last_fullsized":"2024-03-30T13:10:47.246414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:58.426124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281281+0000","last_change":"2024-03-30T13:10:45.225647+0000","last_active":"2024-03-30T13:10:48.281281+0000","last_peered":"2024-03-30T13:10:48.281281+0000","last_clean":"2024-03-30T13:10:48.281281+0000","last_became_active":"2024-03-30T13:10:45.225066+0000","last_became_peered":"2024-03-30T13:10:45.225066+0000","last_unstale":"2024-03-30T13:10:48.281281+0000","last_undegraded":"2024-03-30T13:10:48.281281+0000","last_fullsized":"2024-03-30T13:10:48.281281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991763+0000","last_change":"2024-03-30T13:10:46.234204+0000","last_active":"2024-03-30T13:10:47.991763+0000","last_peered":"2024-03-30T13:10:47.991763+0000","last_clean":"2024-03-30T13:10:47.991763+0000","last_became_active":"2024-03-30T13:10:46.233876+0000","last_became_peered":"2024-03-30T13:10:46.233876+0000","last_unstale":"2024-03-30T13:10:47.991763+0000","last_undegraded":"2024-03-30T13:10:47.991763+0000","last_fullsized":"2024-03-30T13:10:47.991763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:19.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279290+0000","last_change":"2024-03-30T13:10:45.219517+0000","last_active":"2024-03-30T13:10:48.279290+0000","last_peered":"2024-03-30T13:10:48.279290+0000","last_clean":"2024-03-30T13:10:48.279290+0000","last_became_active":"2024-03-30T13:10:45.219201+0000","last_became_peered":"2024-03-30T13:10:45.219201+0000","last_unstale":"2024-03-30T13:10:48.279290+0000","last_undegraded":"2024-03-30T13:10:48.279290+0000","last_fullsized":"2024-03-30T13:10:48.279290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:27.406147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248726+0000","last_change":"2024-03-30T13:10:46.234095+0000","last_active":"2024-03-30T13:10:47.248726+0000","last_peered":"2024-03-30T13:10:47.248726+0000","last_clean":"2024-03-30T13:10:47.248726+0000","last_became_active":"2024-03-30T13:10:46.233686+0000","last_became_peered":"2024-03-30T13:10:46.233686+0000","last_unstale":"2024-03-30T13:10:47.248726+0000","last_undegraded":"2024-03-30T13:10:47.248726+0000","last_fullsized":"2024-03-30T13:10:47.248726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.253768+0000","last_change":"2024-03-30T13:10:45.216838+0000","last_active":"2024-03-30T13:10:47.253768+0000","last_peered":"2024-03-30T13:10:47.253768+0000","last_clean":"2024-03-30T13:10:47.253768+0000","last_became_active":"2024-03-30T13:10:45.216528+0000","last_became_peered":"2024-03-30T13:10:45.216528+0000","last_unstale":"2024-03-30T13:10:47.253768+0000","last_undegraded":"2024-03-30T13:10:47.253768+0000","last_fullsized":"2024-03-30T13:10:47.253768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251100+0000","last_change":"2024-03-30T13:10:46.243883+0000","last_active":"2024-03-30T13:10:47.251100+0000","last_peered":"2024-03-30T13:10:47.251100+0000","last_clean":"2024-03-30T13:10:47.251100+0000","last_became_active":"2024-03-30T13:10:46.243583+0000","last_became_peered":"2024-03-30T13:10:46.243583+0000","last_unstale":"2024-03-30T13:10:47.251100+0000","last_undegraded":"2024-03-30T13:10:47.251100+0000","last_fullsized":"2024-03-30T13:10:47.251100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279909+0000","last_change":"2024-03-30T13:10:45.219656+0000","last_active":"2024-03-30T13:10:48.279909+0000","last_peered":"2024-03-30T13:10:48.279909+0000","last_clean":"2024-03-30T13:10:48.279909+0000","last_became_active":"2024-03-30T13:10:45.219347+0000","last_became_peered":"2024-03-30T13:10:45.219347+0000","last_unstale":"2024-03-30T13:10:48.279909+0000","last_undegraded":"2024-03-30T13:10:48.279909+0000","last_fullsized":"2024-03-30T13:10:48.279909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:37.075782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250903+0000","last_change":"2024-03-30T13:10:46.248800+0000","last_active":"2024-03-30T13:10:47.250903+0000","last_peered":"2024-03-30T13:10:47.250903+0000","last_clean":"2024-03-30T13:10:47.250903+0000","last_became_active":"2024-03-30T13:10:46.248344+0000","last_became_peered":"2024-03-30T13:10:46.248344+0000","last_unstale":"2024-03-30T13:10:47.250903+0000","last_undegraded":"2024-03-30T13:10:47.250903+0000","last_fullsized":"2024-03-30T13:10:47.250903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245338+0000","last_change":"2024-03-30T13:10:45.210402+0000","last_active":"2024-03-30T13:10:47.245338+0000","last_peered":"2024-03-30T13:10:47.245338+0000","last_clean":"2024-03-30T13:10:47.245338+0000","last_became_active":"2024-03-30T13:10:45.210107+0000","last_became_peered":"2024-03-30T13:10:45.210107+0000","last_unstale":"2024-03-30T13:10:47.245338+0000","last_undegraded":"2024-03-30T13:10:47.245338+0000","last_fullsized":"2024-03-30T13:10:47.245338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279223+0000","last_change":"2024-03-30T13:10:46.241705+0000","last_active":"2024-03-30T13:10:48.279223+0000","last_peered":"2024-03-30T13:10:48.279223+0000","last_clean":"2024-03-30T13:10:48.279223+0000","last_became_active":"2024-03-30T13:10:46.241327+0000","last_became_peered":"2024-03-30T13:10:46.241327+0000","last_unstale":"2024-03-30T13:10:48.279223+0000","last_undegraded":"2024-03-30T13:10:48.279223+0000","last_fullsized":"2024-03-30T13:10:48.279223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:05:58.972097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250156+0000","last_change":"2024-03-30T13:10:45.223756+0000","last_active":"2024-03-30T13:10:47.250156+0000","last_peered":"2024-03-30T13:10:47.250156+0000","last_clean":"2024-03-30T13:10:47.250156+0000","last_became_active":"2024-03-30T13:10:45.222236+0000","last_became_peered":"2024-03-30T13:10:45.222236+0000","last_unstale":"2024-03-30T13:10:47.250156+0000","last_undegraded":"2024-03-30T13:10:47.250156+0000","last_fullsized":"2024-03-30T13:10:47.250156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250500+0000","last_change":"2024-03-30T13:10:46.250939+0000","last_active":"2024-03-30T13:10:47.250500+0000","last_peered":"2024-03-30T13:10:47.250500+0000","last_clean":"2024-03-30T13:10:47.250500+0000","last_became_active":"2024-03-30T13:10:46.250651+0000","last_became_peered":"2024-03-30T13:10:46.250651+0000","last_unstale":"2024-03-30T13:10:47.250500+0000","last_undegraded":"2024-03-30T13:10:47.250500+0000","last_fullsized":"2024-03-30T13:10:47.250500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248428+0000","last_change":"2024-03-30T13:10:45.222799+0000","last_active":"2024-03-30T13:10:47.248428+0000","last_peered":"2024-03-30T13:10:47.248428+0000","last_clean":"2024-03-30T13:10:47.248428+0000","last_became_active":"2024-03-30T13:10:45.221899+0000","last_became_peered":"2024-03-30T13:10:45.221899+0000","last_unstale":"2024-03-30T13:10:47.248428+0000","last_undegraded":"2024-03-30T13:10:47.248428+0000","last_fullsized":"2024-03-30T13:10:47.248428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.250423+0000","last_change":"2024-03-30T13:10:46.245047+0000","last_active":"2024-03-30T13:10:46.250423+0000","last_peered":"2024-03-30T13:10:46.250423+0000","last_clean":"2024-03-30T13:10:46.250423+0000","last_became_active":"2024-03-30T13:10:46.244170+0000","last_became_peered":"2024-03-30T13:10:46.244170+0000","last_unstale":"2024-03-30T13:10:46.250423+0000","last_undegraded":"2024-03-30T13:10:46.250423+0000","last_fullsized":"2024-03-30T13:10:46.250423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:27:43.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278786+0000","last_change":"2024-03-30T13:10:45.215312+0000","last_active":"2024-03-30T13:10:48.278786+0000","last_peered":"2024-03-30T13:10:48.278786+0000","last_clean":"2024-03-30T13:10:48.278786+0000","last_became_active":"2024-03-30T13:10:45.214701+0000","last_became_peered":"2024-03-30T13:10:45.214701+0000","last_unstale":"2024-03-30T13:10:48.278786+0000","last_undegraded":"2024-03-30T13:10:48.278786+0000","last_fullsized":"2024-03-30T13:10:48.278786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:16.903426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278902+0000","last_change":"2024-03-30T13:10:46.245626+0000","last_active":"2024-03-30T13:10:48.278902+0000","last_peered":"2024-03-30T13:10:48.278902+0000","last_clean":"2024-03-30T13:10:48.278902+0000","last_became_active":"2024-03-30T13:10:46.245360+0000","last_became_peered":"2024-03-30T13:10:46.245360+0000","last_unstale":"2024-03-30T13:10:48.278902+0000","last_undegraded":"2024-03-30T13:10:48.278902+0000","last_fullsized":"2024-03-30T13:10:48.278902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:55:33.498408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279107+0000","last_change":"2024-03-30T13:10:46.255467+0000","last_active":"2024-03-30T13:10:48.279107+0000","last_peered":"2024-03-30T13:10:48.279107+0000","last_clean":"2024-03-30T13:10:48.279107+0000","last_became_active":"2024-03-30T13:10:46.254974+0000","last_became_peered":"2024-03-30T13:10:46.254974+0000","last_unstale":"2024-03-30T13:10:48.279107+0000","last_undegraded":"2024-03-30T13:10:48.279107+0000","last_fullsized":"2024-03-30T13:10:48.279107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:52:10.233229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246199+0000","last_change":"2024-03-30T13:10:45.203155+0000","last_active":"2024-03-30T13:10:47.246199+0000","last_peered":"2024-03-30T13:10:47.246199+0000","last_clean":"2024-03-30T13:10:47.246199+0000","last_became_active":"2024-03-30T13:10:45.202582+0000","last_became_peered":"2024-03-30T13:10:45.202582+0000","last_unstale":"2024-03-30T13:10:47.246199+0000","last_undegraded":"2024-03-30T13:10:47.246199+0000","last_fullsized":"2024-03-30T13:10:47.246199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:49.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242997+0000","last_change":"2024-03-30T13:10:46.260566+0000","last_active":"2024-03-30T13:10:47.242997+0000","last_peered":"2024-03-30T13:10:47.242997+0000","last_clean":"2024-03-30T13:10:47.242997+0000","last_became_active":"2024-03-30T13:10:46.260117+0000","last_became_peered":"2024-03-30T13:10:46.260117+0000","last_unstale":"2024-03-30T13:10:47.242997+0000","last_undegraded":"2024-03-30T13:10:47.242997+0000","last_fullsized":"2024-03-30T13:10:47.242997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:58.607723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246060+0000","last_change":"2024-03-30T13:10:45.206209+0000","last_active":"2024-03-30T13:10:47.246060+0000","last_peered":"2024-03-30T13:10:47.246060+0000","last_clean":"2024-03-30T13:10:47.246060+0000","last_became_active":"2024-03-30T13:10:45.203095+0000","last_became_peered":"2024-03-30T13:10:45.203095+0000","last_unstale":"2024-03-30T13:10:47.246060+0000","last_undegraded":"2024-03-30T13:10:47.246060+0000","last_fullsized":"2024-03-30T13:10:47.246060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281962+0000","last_change":"2024-03-30T13:10:46.249303+0000","last_active":"2024-03-30T13:10:48.281962+0000","last_peered":"2024-03-30T13:10:48.281962+0000","last_clean":"2024-03-30T13:10:48.281962+0000","last_became_active":"2024-03-30T13:10:46.248971+0000","last_became_peered":"2024-03-30T13:10:46.248971+0000","last_unstale":"2024-03-30T13:10:48.281962+0000","last_undegraded":"2024-03-30T13:10:48.281962+0000","last_fullsized":"2024-03-30T13:10:48.281962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282831+0000","last_change":"2024-03-30T13:10:45.222811+0000","last_active":"2024-03-30T13:10:48.282831+0000","last_peered":"2024-03-30T13:10:48.282831+0000","last_clean":"2024-03-30T13:10:48.282831+0000","last_became_active":"2024-03-30T13:10:45.222439+0000","last_became_peered":"2024-03-30T13:10:45.222439+0000","last_unstale":"2024-03-30T13:10:48.282831+0000","last_undegraded":"2024-03-30T13:10:48.282831+0000","last_fullsized":"2024-03-30T13:10:48.282831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282474+0000","last_change":"2024-03-30T13:10:46.242067+0000","last_active":"2024-03-30T13:10:48.282474+0000","last_peered":"2024-03-30T13:10:48.282474+0000","last_clean":"2024-03-30T13:10:48.282474+0000","last_became_active":"2024-03-30T13:10:46.241783+0000","last_became_peered":"2024-03-30T13:10:46.241783+0000","last_unstale":"2024-03-30T13:10:48.282474+0000","last_undegraded":"2024-03-30T13:10:48.282474+0000","last_fullsized":"2024-03-30T13:10:48.282474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251193+0000","last_change":"2024-03-30T13:10:45.221172+0000","last_active":"2024-03-30T13:10:47.251193+0000","last_peered":"2024-03-30T13:10:47.251193+0000","last_clean":"2024-03-30T13:10:47.251193+0000","last_became_active":"2024-03-30T13:10:45.220799+0000","last_became_peered":"2024-03-30T13:10:45.220799+0000","last_unstale":"2024-03-30T13:10:47.251193+0000","last_undegraded":"2024-03-30T13:10:47.251193+0000","last_fullsized":"2024-03-30T13:10:47.251193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476741,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476741,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":665602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476740,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":659324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":77448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":68988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:10:51.918 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-30T13:10:52.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.143+0000 7fb27ee00640 1 Processor -- start 2024-03-30T13:10:52.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.143+0000 7fb27ee00640 1 -- start start 2024-03-30T13:10:52.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.145+0000 7fb27ee00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb278161e00 0x7fb27806e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.145+0000 7fb27ee00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb27806d930 0x7fb2780718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.145+0000 7fb27ee00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb27806eee0 con 0x7fb278071e10 2024-03-30T13:10:52.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.145+0000 7fb27ee00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb2781621e0 con 0x7fb27806d930 2024-03-30T13:10:52.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.145+0000 7fb27ee00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb278072240 con 0x7fb278161e00 2024-03-30T13:10:52.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.145+0000 7fb26f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb27806d930 0x7fb2780718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:52.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.145+0000 7fb26f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb27806d930 0x7fb2780718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40016/0 (socket says 172.21.15.99:40016) 2024-03-30T13:10:52.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.145+0000 7fb26f400640 1 -- 172.21.15.99:0/3597618242 learned_addr learned my addr 172.21.15.99:0/3597618242 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:52.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.146+0000 7fb277e00640 1 --2- 172.21.15.99:0/3597618242 >> v2:172.21.15.181:3300/0 conn(0x7fb278161e00 0x7fb27806e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:52.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.146+0000 7fb26f400640 1 -- 172.21.15.99:0/3597618242 >> v2:172.21.15.181:3300/0 conn(0x7fb278161e00 msgr2=0x7fb27806e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:52.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.146+0000 7fb26f400640 1 --2- 172.21.15.99:0/3597618242 >> v2:172.21.15.181:3300/0 conn(0x7fb278161e00 0x7fb27806e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.146+0000 7fb26f400640 1 -- 172.21.15.99:0/3597618242 >> v1:172.21.15.181:6789/0 conn(0x7fb278071e10 legacy=0x7fb2780b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:52.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.146+0000 7fb26f400640 1 -- 172.21.15.99:0/3597618242 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27806f1c0 con 0x7fb27806d930 2024-03-30T13:10:52.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.147+0000 7fb26f400640 1 --2- 172.21.15.99:0/3597618242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb27806d930 0x7fb2780718d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb2780d12e0 tx=0x7fb26002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d006bd6014de439f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:52.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.148+0000 7fb277400640 1 -- 172.21.15.99:0/3597618242 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260035020 con 0x7fb27806d930 2024-03-30T13:10:52.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.148+0000 7fb277400640 1 -- 172.21.15.99:0/3597618242 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26002d040 con 0x7fb27806d930 2024-03-30T13:10:52.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.148+0000 7fb277400640 1 -- 172.21.15.99:0/3597618242 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260031a80 con 0x7fb27806d930 2024-03-30T13:10:52.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.148+0000 7fb27ee00640 1 -- 172.21.15.99:0/3597618242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb27806d930 msgr2=0x7fb2780718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:52.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.148+0000 7fb27ee00640 1 --2- 172.21.15.99:0/3597618242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb27806d930 0x7fb2780718d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb2780d12e0 tx=0x7fb26002b900 comp rx=0 tx=0).stop 2024-03-30T13:10:52.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.148+0000 7fb27ee00640 1 -- 172.21.15.99:0/3597618242 shutdown_connections 2024-03-30T13:10:52.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.148+0000 7fb27ee00640 1 --2- 172.21.15.99:0/3597618242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb27806d930 0x7fb2780718d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.148+0000 7fb27ee00640 1 --2- 172.21.15.99:0/3597618242 >> v2:172.21.15.181:3300/0 conn(0x7fb278161e00 0x7fb27806e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.148+0000 7fb27ee00640 1 -- 172.21.15.99:0/3597618242 >> 172.21.15.99:0/3597618242 conn(0x7fb27806b510 msgr2=0x7fb27806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:52.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.148+0000 7fb27ee00640 1 -- 172.21.15.99:0/3597618242 shutdown_connections 2024-03-30T13:10:52.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.148+0000 7fb27ee00640 1 -- 172.21.15.99:0/3597618242 wait complete. 2024-03-30T13:10:52.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.150+0000 7fb27ee00640 1 Processor -- start 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.150+0000 7fb27ee00640 1 -- start start 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.151+0000 7fb27ee00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb27806d930 0x7fb2781f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.151+0000 7fb27ee00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb278071e10 0x7fb278157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.151+0000 7fb27ee00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb278161e00 0x7fb278157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.151+0000 7fb27ee00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb2780b5270 con 0x7fb278071e10 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.151+0000 7fb27ee00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb2780ad690 con 0x7fb27806d930 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.151+0000 7fb27ee00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb2780aebc0 con 0x7fb278161e00 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.151+0000 7fb26f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb278071e10 0x7fb278157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.151+0000 7fb26f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb278071e10 0x7fb278157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40020/0 (socket says 172.21.15.99:40020) 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.151+0000 7fb26f400640 1 -- 172.21.15.99:0/3991565944 learned_addr learned my addr 172.21.15.99:0/3991565944 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.152+0000 7fb26f400640 1 -- 172.21.15.99:0/3991565944 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb278161e00 msgr2=0x7fb278157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.152+0000 7fb26f400640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb278161e00 0x7fb278157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.152+0000 7fb26f400640 1 -- 172.21.15.99:0/3991565944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb27806d930 msgr2=0x7fb2781f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.152+0000 7fb26f400640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb27806d930 0x7fb2781f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.152+0000 7fb26f400640 1 -- 172.21.15.99:0/3991565944 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb278159a40 con 0x7fb278071e10 2024-03-30T13:10:52.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.152+0000 7fb26f400640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb278071e10 0x7fb278157500 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb2600097f0 tx=0x7fb2600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:52.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.152+0000 7fb274c00640 1 -- 172.21.15.99:0/3991565944 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260040070 con 0x7fb278071e10 2024-03-30T13:10:52.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.152+0000 7fb274c00640 1 -- 172.21.15.99:0/3991565944 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb260039bf0 con 0x7fb278071e10 2024-03-30T13:10:52.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.152+0000 7fb274c00640 1 -- 172.21.15.99:0/3991565944 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260035040 con 0x7fb278071e10 2024-03-30T13:10:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.152+0000 7fb27ee00640 1 -- 172.21.15.99:0/3991565944 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb278159d20 con 0x7fb278071e10 2024-03-30T13:10:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.152+0000 7fb27ee00640 1 -- 172.21.15.99:0/3991565944 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27815a2e0 con 0x7fb278071e10 2024-03-30T13:10:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.153+0000 7fb27ee00640 1 -- 172.21.15.99:0/3991565944 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb278068640 con 0x7fb278071e10 2024-03-30T13:10:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.154+0000 7fb274c00640 1 -- 172.21.15.99:0/3991565944 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb26004b060 con 0x7fb278071e10 2024-03-30T13:10:52.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.155+0000 7fb274c00640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb25406c530 0x7fb25406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.155+0000 7fb274c00640 1 -- 172.21.15.99:0/3991565944 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb2600ad4d0 con 0x7fb278071e10 2024-03-30T13:10:52.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.155+0000 7fb277e00640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb25406c530 0x7fb25406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:52.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.156+0000 7fb277e00640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb25406c530 0x7fb25406e9f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb268007dc0 tx=0x7fb2680072f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:52.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.160+0000 7fb274c00640 1 -- 172.21.15.99:0/3991565944 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb26007bae0 con 0x7fb278071e10 2024-03-30T13:10:52.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.436+0000 7fb27ee00640 1 -- 172.21.15.99:0/3991565944 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb2780ae420 con 0x7fb278071e10 2024-03-30T13:10:52.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.437+0000 7fb274c00640 1 -- 172.21.15.99:0/3991565944 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1011 (secure 0 0 0) 0x7fb26007b3e0 con 0x7fb278071e10 2024-03-30T13:10:52.441 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:52.441 INFO:teuthology.orchestra.run.smithi099.stdout:{"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":32,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1711804233,"num_in_osds":8,"osd_in_since":1711804224,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224333824,"bytes_avail":772869779456,"bytes_total":773094113280,"write_bytes_sec":2293,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4284}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-03-30T13:10:20.375803+0000","services":{}},"progress_events":{}} 2024-03-30T13:10:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.440+0000 7fb27ee00640 1 -- 172.21.15.99:0/3991565944 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb25406c530 msgr2=0x7fb25406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.440+0000 7fb27ee00640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb25406c530 0x7fb25406e9f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb268007dc0 tx=0x7fb2680072f0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.440+0000 7fb27ee00640 1 -- 172.21.15.99:0/3991565944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb278071e10 msgr2=0x7fb278157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.440+0000 7fb27ee00640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb278071e10 0x7fb278157500 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb2600097f0 tx=0x7fb2600046c0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.440+0000 7fb27ee00640 1 -- 172.21.15.99:0/3991565944 shutdown_connections 2024-03-30T13:10:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.440+0000 7fb27ee00640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb25406c530 0x7fb25406e9f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.440+0000 7fb27ee00640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb278161e00 0x7fb278157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.440+0000 7fb27ee00640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb278071e10 0x7fb278157500 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.440+0000 7fb27ee00640 1 --2- 172.21.15.99:0/3991565944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb27806d930 0x7fb2781f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.440+0000 7fb27ee00640 1 -- 172.21.15.99:0/3991565944 >> 172.21.15.99:0/3991565944 conn(0x7fb27806b510 msgr2=0x7fb2781606a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.441+0000 7fb27ee00640 1 -- 172.21.15.99:0/3991565944 shutdown_connections 2024-03-30T13:10:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.441+0000 7fb27ee00640 1 -- 172.21.15.99:0/3991565944 wait complete. 2024-03-30T13:10:52.462 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-30T13:10:52.466 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:10:52.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.663+0000 7efc78400640 1 Processor -- start 2024-03-30T13:10:52.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.663+0000 7efc78400640 1 -- start start 2024-03-30T13:10:52.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.666+0000 7efc78400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efc70162cb0 0x7efc700b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.666+0000 7efc78400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efc7006bc20 0x7efc700b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.666+0000 7efc78400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc700b0280 con 0x7efc700b6320 2024-03-30T13:10:52.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.666+0000 7efc78400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7efc700b0560 con 0x7efc7006bc20 2024-03-30T13:10:52.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.666+0000 7efc78400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7efc700b0840 con 0x7efc70162cb0 2024-03-30T13:10:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.666+0000 7efc76400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efc7006bc20 0x7efc700b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.666+0000 7efc76400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efc7006bc20 0x7efc700b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40030/0 (socket says 172.21.15.99:40030) 2024-03-30T13:10:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.666+0000 7efc76400640 1 -- 172.21.15.99:0/876710215 learned_addr learned my addr 172.21.15.99:0/876710215 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.667+0000 7efc75a00640 1 --2- 172.21.15.99:0/876710215 >> v2:172.21.15.181:3300/0 conn(0x7efc70162cb0 0x7efc700b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.667+0000 7efc76400640 1 -- 172.21.15.99:0/876710215 >> v2:172.21.15.181:3300/0 conn(0x7efc70162cb0 msgr2=0x7efc700b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.667+0000 7efc76400640 1 --2- 172.21.15.99:0/876710215 >> v2:172.21.15.181:3300/0 conn(0x7efc70162cb0 0x7efc700b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.667+0000 7efc76400640 1 -- 172.21.15.99:0/876710215 >> v1:172.21.15.181:6789/0 conn(0x7efc700b6320 legacy=0x7efc7006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.667+0000 7efc76400640 1 -- 172.21.15.99:0/876710215 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc700b0b20 con 0x7efc7006bc20 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.667+0000 7efc75a00640 1 --2- 172.21.15.99:0/876710215 >> v2:172.21.15.181:3300/0 conn(0x7efc70162cb0 0x7efc700b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.668+0000 7efc76400640 1 --2- 172.21.15.99:0/876710215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7006bc20 0x7efc700b1320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efc700b6730 tx=0x7efc6802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281ffcde77a5a046 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.668+0000 7efc6fe00640 1 -- 172.21.15.99:0/876710215 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6802c9f0 con 0x7efc7006bc20 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.669+0000 7efc6fe00640 1 -- 172.21.15.99:0/876710215 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6802cb90 con 0x7efc7006bc20 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.669+0000 7efc6fe00640 1 -- 172.21.15.99:0/876710215 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc680343f0 con 0x7efc7006bc20 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.669+0000 7efc78400640 1 -- 172.21.15.99:0/876710215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7006bc20 msgr2=0x7efc700b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:52.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.669+0000 7efc78400640 1 --2- 172.21.15.99:0/876710215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7006bc20 0x7efc700b1320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efc700b6730 tx=0x7efc6802be50 comp rx=0 tx=0).stop 2024-03-30T13:10:52.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.669+0000 7efc78400640 1 -- 172.21.15.99:0/876710215 shutdown_connections 2024-03-30T13:10:52.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.669+0000 7efc78400640 1 --2- 172.21.15.99:0/876710215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7006bc20 0x7efc700b1320 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.669+0000 7efc78400640 1 --2- 172.21.15.99:0/876710215 >> v2:172.21.15.181:3300/0 conn(0x7efc70162cb0 0x7efc700b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.669+0000 7efc78400640 1 -- 172.21.15.99:0/876710215 >> 172.21.15.99:0/876710215 conn(0x7efc700b6780 msgr2=0x7efc700b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:52.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.670+0000 7efc78400640 1 -- 172.21.15.99:0/876710215 shutdown_connections 2024-03-30T13:10:52.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.670+0000 7efc78400640 1 -- 172.21.15.99:0/876710215 wait complete. 2024-03-30T13:10:52.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.672+0000 7efc78400640 1 Processor -- start 2024-03-30T13:10:52.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.673+0000 7efc78400640 1 -- start start 2024-03-30T13:10:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.674+0000 7efc78400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7006bc20 0x7efc70150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.674+0000 7efc78400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700b6320 0x7efc7009c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.674+0000 7efc78400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70162cb0 0x7efc7015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.674+0000 7efc78400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7efc70163210 con 0x7efc7006bc20 2024-03-30T13:10:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.674+0000 7efc78400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efc70163090 con 0x7efc700b6320 2024-03-30T13:10:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.674+0000 7efc78400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7efc700b43f0 con 0x7efc70162cb0 2024-03-30T13:10:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.674+0000 7efc75a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7006bc20 0x7efc70150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.674+0000 7efc75a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7006bc20 0x7efc70150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40038/0 (socket says 172.21.15.99:40038) 2024-03-30T13:10:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.674+0000 7efc75a00640 1 -- 172.21.15.99:0/3647984679 learned_addr learned my addr 172.21.15.99:0/3647984679 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.675+0000 7efc76400640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70162cb0 0x7efc7015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.675+0000 7efc75a00640 1 -- 172.21.15.99:0/3647984679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70162cb0 msgr2=0x7efc7015ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.675+0000 7efc75a00640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70162cb0 0x7efc7015ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.675+0000 7efc75a00640 1 -- 172.21.15.99:0/3647984679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700b6320 msgr2=0x7efc7009c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.675+0000 7efc75000640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700b6320 0x7efc7009c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.675+0000 7efc75a00640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700b6320 0x7efc7009c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.675+0000 7efc75a00640 1 -- 172.21.15.99:0/3647984679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc70150f40 con 0x7efc7006bc20 2024-03-30T13:10:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.675+0000 7efc75000640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700b6320 0x7efc7009c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.675+0000 7efc75a00640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7006bc20 0x7efc70150a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c7f0 tx=0x7efc6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.675+0000 7efc6d600640 1 -- 172.21.15.99:0/3647984679 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64015070 con 0x7efc7006bc20 2024-03-30T13:10:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.676+0000 7efc6d600640 1 -- 172.21.15.99:0/3647984679 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc64007a30 con 0x7efc7006bc20 2024-03-30T13:10:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.676+0000 7efc78400640 1 -- 172.21.15.99:0/3647984679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7014df60 con 0x7efc7006bc20 2024-03-30T13:10:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.676+0000 7efc6d600640 1 -- 172.21.15.99:0/3647984679 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64007e00 con 0x7efc7006bc20 2024-03-30T13:10:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.676+0000 7efc78400640 1 -- 172.21.15.99:0/3647984679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc7014e4e0 con 0x7efc7006bc20 2024-03-30T13:10:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.677+0000 7efc78400640 1 -- 172.21.15.99:0/3647984679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc70068d50 con 0x7efc7006bc20 2024-03-30T13:10:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.678+0000 7efc6d600640 1 -- 172.21.15.99:0/3647984679 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efc64018070 con 0x7efc7006bc20 2024-03-30T13:10:52.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.679+0000 7efc6d600640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc5006c530 0x7efc5006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:52.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.679+0000 7efc6d600640 1 -- 172.21.15.99:0/3647984679 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efc6408b6c0 con 0x7efc7006bc20 2024-03-30T13:10:52.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.679+0000 7efc75000640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc5006c530 0x7efc5006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:52.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.680+0000 7efc75000640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc5006c530 0x7efc5006e9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc700afd00 tx=0x7efc5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:52.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:52.683+0000 7efc6d600640 1 -- 172.21.15.99:0/3647984679 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7efc70150f40 con 0x7efc7006bc20 2024-03-30T13:10:53.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.003+0000 7efc78400640 1 -- 172.21.15.99:0/3647984679 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc7014eec0 con 0x7efc5006c530 2024-03-30T13:10:53.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.017+0000 7efc6d600640 1 -- 172.21.15.99:0/3647984679 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251940 (secure 0 0 0) 0x7efc7014eec0 con 0x7efc5006c530 2024-03-30T13:10:53.023 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:53.034 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:10:53.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 -- 172.21.15.99:0/3647984679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc5006c530 msgr2=0x7efc5006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:53.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc5006c530 0x7efc5006e9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc700afd00 tx=0x7efc5c009040 comp rx=0 tx=0).stop 2024-03-30T13:10:53.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 -- 172.21.15.99:0/3647984679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7006bc20 msgr2=0x7efc70150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:53.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7006bc20 0x7efc70150a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c7f0 tx=0x7efc6400cbf0 comp rx=0 tx=0).stop 2024-03-30T13:10:53.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 -- 172.21.15.99:0/3647984679 shutdown_connections 2024-03-30T13:10:53.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc5006c530 0x7efc5006e9f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:53.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70162cb0 0x7efc7015ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:53.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700b6320 0x7efc7009c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:53.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 --2- 172.21.15.99:0/3647984679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7006bc20 0x7efc70150a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:53.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 -- 172.21.15.99:0/3647984679 >> 172.21.15.99:0/3647984679 conn(0x7efc700b6780 msgr2=0x7efc7006ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:53.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 -- 172.21.15.99:0/3647984679 shutdown_connections 2024-03-30T13:10:53.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:53.022+0000 7efc78400640 1 -- 172.21.15.99:0/3647984679 wait complete. 2024-03-30T13:10:53.042 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-30T13:10:51.435795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219076,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755644,"statfs":{"total":773094113280,"available":772869779456,"internally_reserved":0,"allocated":2965504,"data_stored":1774268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.252009"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246289+0000","last_change":"2024-03-30T13:10:46.234821+0000","last_active":"2024-03-30T13:10:47.246289+0000","last_peered":"2024-03-30T13:10:47.246289+0000","last_clean":"2024-03-30T13:10:47.246289+0000","last_became_active":"2024-03-30T13:10:46.234553+0000","last_became_peered":"2024-03-30T13:10:46.234553+0000","last_unstale":"2024-03-30T13:10:47.246289+0000","last_undegraded":"2024-03-30T13:10:47.246289+0000","last_fullsized":"2024-03-30T13:10:47.246289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:13.303492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282177+0000","last_change":"2024-03-30T13:10:46.238313+0000","last_active":"2024-03-30T13:10:48.282177+0000","last_peered":"2024-03-30T13:10:48.282177+0000","last_clean":"2024-03-30T13:10:48.282177+0000","last_became_active":"2024-03-30T13:10:46.238010+0000","last_became_peered":"2024-03-30T13:10:46.238010+0000","last_unstale":"2024-03-30T13:10:48.282177+0000","last_undegraded":"2024-03-30T13:10:48.282177+0000","last_fullsized":"2024-03-30T13:10:48.282177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281389+0000","last_change":"2024-03-30T13:10:46.241744+0000","last_active":"2024-03-30T13:10:48.281389+0000","last_peered":"2024-03-30T13:10:48.281389+0000","last_clean":"2024-03-30T13:10:48.281389+0000","last_became_active":"2024-03-30T13:10:46.241480+0000","last_became_peered":"2024-03-30T13:10:46.241480+0000","last_unstale":"2024-03-30T13:10:48.281389+0000","last_undegraded":"2024-03-30T13:10:48.281389+0000","last_fullsized":"2024-03-30T13:10:48.281389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991801+0000","last_change":"2024-03-30T13:10:46.244024+0000","last_active":"2024-03-30T13:10:47.991801+0000","last_peered":"2024-03-30T13:10:47.991801+0000","last_clean":"2024-03-30T13:10:47.991801+0000","last_became_active":"2024-03-30T13:10:46.243697+0000","last_became_peered":"2024-03-30T13:10:46.243697+0000","last_unstale":"2024-03-30T13:10:47.991801+0000","last_undegraded":"2024-03-30T13:10:47.991801+0000","last_fullsized":"2024-03-30T13:10:47.991801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:38.672797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246287+0000","last_change":"2024-03-30T13:10:46.234379+0000","last_active":"2024-03-30T13:10:47.246287+0000","last_peered":"2024-03-30T13:10:47.246287+0000","last_clean":"2024-03-30T13:10:47.246287+0000","last_became_active":"2024-03-30T13:10:46.234047+0000","last_became_peered":"2024-03-30T13:10:46.234047+0000","last_unstale":"2024-03-30T13:10:47.246287+0000","last_undegraded":"2024-03-30T13:10:47.246287+0000","last_fullsized":"2024-03-30T13:10:47.246287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991724+0000","last_change":"2024-03-30T13:10:46.243204+0000","last_active":"2024-03-30T13:10:47.991724+0000","last_peered":"2024-03-30T13:10:47.991724+0000","last_clean":"2024-03-30T13:10:47.991724+0000","last_became_active":"2024-03-30T13:10:46.242897+0000","last_became_peered":"2024-03-30T13:10:46.242897+0000","last_unstale":"2024-03-30T13:10:47.991724+0000","last_undegraded":"2024-03-30T13:10:47.991724+0000","last_fullsized":"2024-03-30T13:10:47.991724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:50.453642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245509+0000","last_change":"2024-03-30T13:10:46.244716+0000","last_active":"2024-03-30T13:10:47.245509+0000","last_peered":"2024-03-30T13:10:47.245509+0000","last_clean":"2024-03-30T13:10:47.245509+0000","last_became_active":"2024-03-30T13:10:46.244353+0000","last_became_peered":"2024-03-30T13:10:46.244353+0000","last_unstale":"2024-03-30T13:10:47.245509+0000","last_undegraded":"2024-03-30T13:10:47.245509+0000","last_fullsized":"2024-03-30T13:10:47.245509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280766+0000","last_change":"2024-03-30T13:10:46.255145+0000","last_active":"2024-03-30T13:10:48.280766+0000","last_peered":"2024-03-30T13:10:48.280766+0000","last_clean":"2024-03-30T13:10:48.280766+0000","last_became_active":"2024-03-30T13:10:46.254848+0000","last_became_peered":"2024-03-30T13:10:46.254848+0000","last_unstale":"2024-03-30T13:10:48.280766+0000","last_undegraded":"2024-03-30T13:10:48.280766+0000","last_fullsized":"2024-03-30T13:10:48.280766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243525+0000","last_change":"2024-03-30T13:10:46.249338+0000","last_active":"2024-03-30T13:10:47.243525+0000","last_peered":"2024-03-30T13:10:47.243525+0000","last_clean":"2024-03-30T13:10:47.243525+0000","last_became_active":"2024-03-30T13:10:46.248206+0000","last_became_peered":"2024-03-30T13:10:46.248206+0000","last_unstale":"2024-03-30T13:10:47.243525+0000","last_undegraded":"2024-03-30T13:10:47.243525+0000","last_fullsized":"2024-03-30T13:10:47.243525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:38.672797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245949+0000","last_change":"2024-03-30T13:10:46.236494+0000","last_active":"2024-03-30T13:10:47.245949+0000","last_peered":"2024-03-30T13:10:47.245949+0000","last_clean":"2024-03-30T13:10:47.245949+0000","last_became_active":"2024-03-30T13:10:46.236199+0000","last_became_peered":"2024-03-30T13:10:46.236199+0000","last_unstale":"2024-03-30T13:10:47.245949+0000","last_undegraded":"2024-03-30T13:10:47.245949+0000","last_fullsized":"2024-03-30T13:10:47.245949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245994+0000","last_change":"2024-03-30T13:10:46.245545+0000","last_active":"2024-03-30T13:10:47.245994+0000","last_peered":"2024-03-30T13:10:47.245994+0000","last_clean":"2024-03-30T13:10:47.245994+0000","last_became_active":"2024-03-30T13:10:46.245286+0000","last_became_peered":"2024-03-30T13:10:46.245286+0000","last_unstale":"2024-03-30T13:10:47.245994+0000","last_undegraded":"2024-03-30T13:10:47.245994+0000","last_fullsized":"2024-03-30T13:10:47.245994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245950+0000","last_change":"2024-03-30T13:10:46.256061+0000","last_active":"2024-03-30T13:10:47.245950+0000","last_peered":"2024-03-30T13:10:47.245950+0000","last_clean":"2024-03-30T13:10:47.245950+0000","last_became_active":"2024-03-30T13:10:46.252144+0000","last_became_peered":"2024-03-30T13:10:46.252144+0000","last_unstale":"2024-03-30T13:10:47.245950+0000","last_undegraded":"2024-03-30T13:10:47.245950+0000","last_fullsized":"2024-03-30T13:10:47.245950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248585+0000","last_change":"2024-03-30T13:10:46.240158+0000","last_active":"2024-03-30T13:10:47.248585+0000","last_peered":"2024-03-30T13:10:47.248585+0000","last_clean":"2024-03-30T13:10:47.248585+0000","last_became_active":"2024-03-30T13:10:46.235455+0000","last_became_peered":"2024-03-30T13:10:46.235455+0000","last_unstale":"2024-03-30T13:10:47.248585+0000","last_undegraded":"2024-03-30T13:10:47.248585+0000","last_fullsized":"2024-03-30T13:10:47.248585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:00.666500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248107+0000","last_change":"2024-03-30T13:10:46.243687+0000","last_active":"2024-03-30T13:10:47.248107+0000","last_peered":"2024-03-30T13:10:47.248107+0000","last_clean":"2024-03-30T13:10:47.248107+0000","last_became_active":"2024-03-30T13:10:46.243389+0000","last_became_peered":"2024-03-30T13:10:46.243389+0000","last_unstale":"2024-03-30T13:10:47.248107+0000","last_undegraded":"2024-03-30T13:10:47.248107+0000","last_fullsized":"2024-03-30T13:10:47.248107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280718+0000","last_change":"2024-03-30T13:10:46.256471+0000","last_active":"2024-03-30T13:10:48.280718+0000","last_peered":"2024-03-30T13:10:48.280718+0000","last_clean":"2024-03-30T13:10:48.280718+0000","last_became_active":"2024-03-30T13:10:46.256215+0000","last_became_peered":"2024-03-30T13:10:46.256215+0000","last_unstale":"2024-03-30T13:10:48.280718+0000","last_undegraded":"2024-03-30T13:10:48.280718+0000","last_fullsized":"2024-03-30T13:10:48.280718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278522+0000","last_change":"2024-03-30T13:10:46.233516+0000","last_active":"2024-03-30T13:10:48.278522+0000","last_peered":"2024-03-30T13:10:48.278522+0000","last_clean":"2024-03-30T13:10:48.278522+0000","last_became_active":"2024-03-30T13:10:46.233168+0000","last_became_peered":"2024-03-30T13:10:46.233168+0000","last_unstale":"2024-03-30T13:10:48.278522+0000","last_undegraded":"2024-03-30T13:10:48.278522+0000","last_fullsized":"2024-03-30T13:10:48.278522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:13.303492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280093+0000","last_change":"2024-03-30T13:10:46.260609+0000","last_active":"2024-03-30T13:10:48.280093+0000","last_peered":"2024-03-30T13:10:48.280093+0000","last_clean":"2024-03-30T13:10:48.280093+0000","last_became_active":"2024-03-30T13:10:46.257204+0000","last_became_peered":"2024-03-30T13:10:46.257204+0000","last_unstale":"2024-03-30T13:10:48.280093+0000","last_undegraded":"2024-03-30T13:10:48.280093+0000","last_fullsized":"2024-03-30T13:10:48.280093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:33:04.251828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.258357+0000","last_change":"2024-03-30T13:10:46.253562+0000","last_active":"2024-03-30T13:10:46.258357+0000","last_peered":"2024-03-30T13:10:46.258357+0000","last_clean":"2024-03-30T13:10:46.258357+0000","last_became_active":"2024-03-30T13:10:46.253288+0000","last_became_peered":"2024-03-30T13:10:46.253288+0000","last_unstale":"2024-03-30T13:10:46.258357+0000","last_undegraded":"2024-03-30T13:10:46.258357+0000","last_fullsized":"2024-03-30T13:10:46.258357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:44:49.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279336+0000","last_change":"2024-03-30T13:10:46.244101+0000","last_active":"2024-03-30T13:10:48.279336+0000","last_peered":"2024-03-30T13:10:48.279336+0000","last_clean":"2024-03-30T13:10:48.279336+0000","last_became_active":"2024-03-30T13:10:46.241383+0000","last_became_peered":"2024-03-30T13:10:46.241383+0000","last_unstale":"2024-03-30T13:10:48.279336+0000","last_undegraded":"2024-03-30T13:10:48.279336+0000","last_fullsized":"2024-03-30T13:10:48.279336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:09.717253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246132+0000","last_change":"2024-03-30T13:10:46.258488+0000","last_active":"2024-03-30T13:10:47.246132+0000","last_peered":"2024-03-30T13:10:47.246132+0000","last_clean":"2024-03-30T13:10:47.246132+0000","last_became_active":"2024-03-30T13:10:46.251558+0000","last_became_peered":"2024-03-30T13:10:46.251558+0000","last_unstale":"2024-03-30T13:10:47.246132+0000","last_undegraded":"2024-03-30T13:10:47.246132+0000","last_fullsized":"2024-03-30T13:10:47.246132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250207+0000","last_change":"2024-03-30T13:10:46.243487+0000","last_active":"2024-03-30T13:10:47.250207+0000","last_peered":"2024-03-30T13:10:47.250207+0000","last_clean":"2024-03-30T13:10:47.250207+0000","last_became_active":"2024-03-30T13:10:46.243102+0000","last_became_peered":"2024-03-30T13:10:46.243102+0000","last_unstale":"2024-03-30T13:10:47.250207+0000","last_undegraded":"2024-03-30T13:10:47.250207+0000","last_fullsized":"2024-03-30T13:10:47.250207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243005+0000","last_change":"2024-03-30T13:10:46.262008+0000","last_active":"2024-03-30T13:10:47.243005+0000","last_peered":"2024-03-30T13:10:47.243005+0000","last_clean":"2024-03-30T13:10:47.243005+0000","last_became_active":"2024-03-30T13:10:46.259954+0000","last_became_peered":"2024-03-30T13:10:46.259954+0000","last_unstale":"2024-03-30T13:10:47.243005+0000","last_undegraded":"2024-03-30T13:10:47.243005+0000","last_fullsized":"2024-03-30T13:10:47.243005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:50.453642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280858+0000","last_change":"2024-03-30T13:10:46.247945+0000","last_active":"2024-03-30T13:10:48.280858+0000","last_peered":"2024-03-30T13:10:48.280858+0000","last_clean":"2024-03-30T13:10:48.280858+0000","last_became_active":"2024-03-30T13:10:46.247685+0000","last_became_peered":"2024-03-30T13:10:46.247685+0000","last_unstale":"2024-03-30T13:10:48.280858+0000","last_undegraded":"2024-03-30T13:10:48.280858+0000","last_fullsized":"2024-03-30T13:10:48.280858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278783+0000","last_change":"2024-03-30T13:10:46.238738+0000","last_active":"2024-03-30T13:10:48.278783+0000","last_peered":"2024-03-30T13:10:48.278783+0000","last_clean":"2024-03-30T13:10:48.278783+0000","last_became_active":"2024-03-30T13:10:46.238383+0000","last_became_peered":"2024-03-30T13:10:46.238383+0000","last_unstale":"2024-03-30T13:10:48.278783+0000","last_undegraded":"2024-03-30T13:10:48.278783+0000","last_fullsized":"2024-03-30T13:10:48.278783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:43:03.365657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282406+0000","last_change":"2024-03-30T13:10:46.249445+0000","last_active":"2024-03-30T13:10:48.282406+0000","last_peered":"2024-03-30T13:10:48.282406+0000","last_clean":"2024-03-30T13:10:48.282406+0000","last_became_active":"2024-03-30T13:10:46.249008+0000","last_became_peered":"2024-03-30T13:10:46.249008+0000","last_unstale":"2024-03-30T13:10:48.282406+0000","last_undegraded":"2024-03-30T13:10:48.282406+0000","last_fullsized":"2024-03-30T13:10:48.282406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992191+0000","last_change":"2024-03-30T13:10:46.247610+0000","last_active":"2024-03-30T13:10:47.992191+0000","last_peered":"2024-03-30T13:10:47.992191+0000","last_clean":"2024-03-30T13:10:47.992191+0000","last_became_active":"2024-03-30T13:10:46.247333+0000","last_became_peered":"2024-03-30T13:10:46.247333+0000","last_unstale":"2024-03-30T13:10:47.992191+0000","last_undegraded":"2024-03-30T13:10:47.992191+0000","last_fullsized":"2024-03-30T13:10:47.992191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248607+0000","last_change":"2024-03-30T13:10:46.243725+0000","last_active":"2024-03-30T13:10:47.248607+0000","last_peered":"2024-03-30T13:10:47.248607+0000","last_clean":"2024-03-30T13:10:47.248607+0000","last_became_active":"2024-03-30T13:10:46.243423+0000","last_became_peered":"2024-03-30T13:10:46.243423+0000","last_unstale":"2024-03-30T13:10:47.248607+0000","last_undegraded":"2024-03-30T13:10:47.248607+0000","last_fullsized":"2024-03-30T13:10:47.248607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248584+0000","last_change":"2024-03-30T13:10:46.254386+0000","last_active":"2024-03-30T13:10:47.248584+0000","last_peered":"2024-03-30T13:10:47.248584+0000","last_clean":"2024-03-30T13:10:47.248584+0000","last_became_active":"2024-03-30T13:10:46.254081+0000","last_became_peered":"2024-03-30T13:10:46.254081+0000","last_unstale":"2024-03-30T13:10:47.248584+0000","last_undegraded":"2024-03-30T13:10:47.248584+0000","last_fullsized":"2024-03-30T13:10:47.248584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281880+0000","last_change":"2024-03-30T13:10:46.246367+0000","last_active":"2024-03-30T13:10:48.281880+0000","last_peered":"2024-03-30T13:10:48.281880+0000","last_clean":"2024-03-30T13:10:48.281880+0000","last_became_active":"2024-03-30T13:10:46.246066+0000","last_became_peered":"2024-03-30T13:10:46.246066+0000","last_unstale":"2024-03-30T13:10:48.281880+0000","last_undegraded":"2024-03-30T13:10:48.281880+0000","last_fullsized":"2024-03-30T13:10:48.281880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278521+0000","last_change":"2024-03-30T13:10:46.234128+0000","last_active":"2024-03-30T13:10:48.278521+0000","last_peered":"2024-03-30T13:10:48.278521+0000","last_clean":"2024-03-30T13:10:48.278521+0000","last_became_active":"2024-03-30T13:10:46.233731+0000","last_became_peered":"2024-03-30T13:10:46.233731+0000","last_unstale":"2024-03-30T13:10:48.278521+0000","last_undegraded":"2024-03-30T13:10:48.278521+0000","last_fullsized":"2024-03-30T13:10:48.278521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.256707+0000","last_change":"2024-03-30T13:10:46.247881+0000","last_active":"2024-03-30T13:10:46.256707+0000","last_peered":"2024-03-30T13:10:46.256707+0000","last_clean":"2024-03-30T13:10:46.256707+0000","last_became_active":"2024-03-30T13:10:46.247618+0000","last_became_peered":"2024-03-30T13:10:46.247618+0000","last_unstale":"2024-03-30T13:10:46.256707+0000","last_undegraded":"2024-03-30T13:10:46.256707+0000","last_fullsized":"2024-03-30T13:10:46.256707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:32.391989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991337+0000","last_change":"2024-03-30T13:10:46.253544+0000","last_active":"2024-03-30T13:10:47.991337+0000","last_peered":"2024-03-30T13:10:47.991337+0000","last_clean":"2024-03-30T13:10:47.991337+0000","last_became_active":"2024-03-30T13:10:46.253034+0000","last_became_peered":"2024-03-30T13:10:46.253034+0000","last_unstale":"2024-03-30T13:10:47.991337+0000","last_undegraded":"2024-03-30T13:10:47.991337+0000","last_fullsized":"2024-03-30T13:10:47.991337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:58.607723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243141+0000","last_change":"2024-03-30T13:10:46.237581+0000","last_active":"2024-03-30T13:10:47.243141+0000","last_peered":"2024-03-30T13:10:47.243141+0000","last_clean":"2024-03-30T13:10:47.243141+0000","last_became_active":"2024-03-30T13:10:46.237307+0000","last_became_peered":"2024-03-30T13:10:46.237307+0000","last_unstale":"2024-03-30T13:10:47.243141+0000","last_undegraded":"2024-03-30T13:10:47.243141+0000","last_fullsized":"2024-03-30T13:10:47.243141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:19.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282213+0000","last_change":"2024-03-30T13:10:45.225591+0000","last_active":"2024-03-30T13:10:48.282213+0000","last_peered":"2024-03-30T13:10:48.282213+0000","last_clean":"2024-03-30T13:10:48.282213+0000","last_became_active":"2024-03-30T13:10:45.224943+0000","last_became_peered":"2024-03-30T13:10:45.224943+0000","last_unstale":"2024-03-30T13:10:48.282213+0000","last_undegraded":"2024-03-30T13:10:48.282213+0000","last_fullsized":"2024-03-30T13:10:48.282213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250237+0000","last_change":"2024-03-30T13:10:46.260952+0000","last_active":"2024-03-30T13:10:47.250237+0000","last_peered":"2024-03-30T13:10:47.250237+0000","last_clean":"2024-03-30T13:10:47.250237+0000","last_became_active":"2024-03-30T13:10:46.260001+0000","last_became_peered":"2024-03-30T13:10:46.260001+0000","last_unstale":"2024-03-30T13:10:47.250237+0000","last_undegraded":"2024-03-30T13:10:47.250237+0000","last_fullsized":"2024-03-30T13:10:47.250237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278771+0000","last_change":"2024-03-30T13:10:45.220120+0000","last_active":"2024-03-30T13:10:48.278771+0000","last_peered":"2024-03-30T13:10:48.278771+0000","last_clean":"2024-03-30T13:10:48.278771+0000","last_became_active":"2024-03-30T13:10:45.218922+0000","last_became_peered":"2024-03-30T13:10:45.218922+0000","last_unstale":"2024-03-30T13:10:48.278771+0000","last_undegraded":"2024-03-30T13:10:48.278771+0000","last_fullsized":"2024-03-30T13:10:48.278771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:18.840387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247862+0000","last_change":"2024-03-30T13:10:45.211201+0000","last_active":"2024-03-30T13:10:47.247862+0000","last_peered":"2024-03-30T13:10:47.247862+0000","last_clean":"2024-03-30T13:10:47.247862+0000","last_became_active":"2024-03-30T13:10:45.210742+0000","last_became_peered":"2024-03-30T13:10:45.210742+0000","last_unstale":"2024-03-30T13:10:47.247862+0000","last_undegraded":"2024-03-30T13:10:47.247862+0000","last_fullsized":"2024-03-30T13:10:47.247862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281386+0000","last_change":"2024-03-30T13:10:46.236372+0000","last_active":"2024-03-30T13:10:48.281386+0000","last_peered":"2024-03-30T13:10:48.281386+0000","last_clean":"2024-03-30T13:10:48.281386+0000","last_became_active":"2024-03-30T13:10:46.236108+0000","last_became_peered":"2024-03-30T13:10:46.236108+0000","last_unstale":"2024-03-30T13:10:48.281386+0000","last_undegraded":"2024-03-30T13:10:48.281386+0000","last_fullsized":"2024-03-30T13:10:48.281386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278586+0000","last_change":"2024-03-30T13:10:45.217654+0000","last_active":"2024-03-30T13:10:48.278586+0000","last_peered":"2024-03-30T13:10:48.278586+0000","last_clean":"2024-03-30T13:10:48.278586+0000","last_became_active":"2024-03-30T13:10:45.217372+0000","last_became_peered":"2024-03-30T13:10:45.217372+0000","last_unstale":"2024-03-30T13:10:48.278586+0000","last_undegraded":"2024-03-30T13:10:48.278586+0000","last_fullsized":"2024-03-30T13:10:48.278586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:57.594719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249908+0000","last_change":"2024-03-30T13:10:46.247867+0000","last_active":"2024-03-30T13:10:47.249908+0000","last_peered":"2024-03-30T13:10:47.249908+0000","last_clean":"2024-03-30T13:10:47.249908+0000","last_became_active":"2024-03-30T13:10:46.246955+0000","last_became_peered":"2024-03-30T13:10:46.246955+0000","last_unstale":"2024-03-30T13:10:47.249908+0000","last_undegraded":"2024-03-30T13:10:47.249908+0000","last_fullsized":"2024-03-30T13:10:47.249908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243434+0000","last_change":"2024-03-30T13:10:45.226750+0000","last_active":"2024-03-30T13:10:47.243434+0000","last_peered":"2024-03-30T13:10:47.243434+0000","last_clean":"2024-03-30T13:10:47.243434+0000","last_became_active":"2024-03-30T13:10:45.226384+0000","last_became_peered":"2024-03-30T13:10:45.226384+0000","last_unstale":"2024-03-30T13:10:47.243434+0000","last_undegraded":"2024-03-30T13:10:47.243434+0000","last_fullsized":"2024-03-30T13:10:47.243434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:34:23.517546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992111+0000","last_change":"2024-03-30T13:10:46.246063+0000","last_active":"2024-03-30T13:10:47.992111+0000","last_peered":"2024-03-30T13:10:47.992111+0000","last_clean":"2024-03-30T13:10:47.992111+0000","last_became_active":"2024-03-30T13:10:46.245539+0000","last_became_peered":"2024-03-30T13:10:46.245539+0000","last_unstale":"2024-03-30T13:10:47.992111+0000","last_undegraded":"2024-03-30T13:10:47.992111+0000","last_fullsized":"2024-03-30T13:10:47.992111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246015+0000","last_change":"2024-03-30T13:10:45.205745+0000","last_active":"2024-03-30T13:10:47.246015+0000","last_peered":"2024-03-30T13:10:47.246015+0000","last_clean":"2024-03-30T13:10:47.246015+0000","last_became_active":"2024-03-30T13:10:45.204814+0000","last_became_peered":"2024-03-30T13:10:45.204814+0000","last_unstale":"2024-03-30T13:10:47.246015+0000","last_undegraded":"2024-03-30T13:10:47.246015+0000","last_fullsized":"2024-03-30T13:10:47.246015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282464+0000","last_change":"2024-03-30T13:10:46.241152+0000","last_active":"2024-03-30T13:10:48.282464+0000","last_peered":"2024-03-30T13:10:48.282464+0000","last_clean":"2024-03-30T13:10:48.282464+0000","last_became_active":"2024-03-30T13:10:46.240813+0000","last_became_peered":"2024-03-30T13:10:46.240813+0000","last_unstale":"2024-03-30T13:10:48.282464+0000","last_undegraded":"2024-03-30T13:10:48.282464+0000","last_fullsized":"2024-03-30T13:10:48.282464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.260991+0000","last_change":"2024-03-30T13:10:45.227319+0000","last_active":"2024-03-30T13:10:46.260991+0000","last_peered":"2024-03-30T13:10:46.260991+0000","last_clean":"2024-03-30T13:10:46.260991+0000","last_became_active":"2024-03-30T13:10:45.226913+0000","last_became_peered":"2024-03-30T13:10:45.226913+0000","last_unstale":"2024-03-30T13:10:46.260991+0000","last_undegraded":"2024-03-30T13:10:46.260991+0000","last_fullsized":"2024-03-30T13:10:46.260991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:22.060387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278632+0000","last_change":"2024-03-30T13:10:46.243390+0000","last_active":"2024-03-30T13:10:48.278632+0000","last_peered":"2024-03-30T13:10:48.278632+0000","last_clean":"2024-03-30T13:10:48.278632+0000","last_became_active":"2024-03-30T13:10:46.242925+0000","last_became_peered":"2024-03-30T13:10:46.242925+0000","last_unstale":"2024-03-30T13:10:48.278632+0000","last_undegraded":"2024-03-30T13:10:48.278632+0000","last_fullsized":"2024-03-30T13:10:48.278632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:42.999062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991874+0000","last_change":"2024-03-30T13:10:45.222454+0000","last_active":"2024-03-30T13:10:47.991874+0000","last_peered":"2024-03-30T13:10:47.991874+0000","last_clean":"2024-03-30T13:10:47.991874+0000","last_became_active":"2024-03-30T13:10:45.222143+0000","last_became_peered":"2024-03-30T13:10:45.222143+0000","last_unstale":"2024-03-30T13:10:47.991874+0000","last_undegraded":"2024-03-30T13:10:47.991874+0000","last_fullsized":"2024-03-30T13:10:47.991874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:19.786645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246001+0000","last_change":"2024-03-30T13:10:46.240683+0000","last_active":"2024-03-30T13:10:47.246001+0000","last_peered":"2024-03-30T13:10:47.246001+0000","last_clean":"2024-03-30T13:10:47.246001+0000","last_became_active":"2024-03-30T13:10:46.240375+0000","last_became_peered":"2024-03-30T13:10:46.240375+0000","last_unstale":"2024-03-30T13:10:47.246001+0000","last_undegraded":"2024-03-30T13:10:47.246001+0000","last_fullsized":"2024-03-30T13:10:47.246001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.266262+0000","last_change":"2024-03-30T13:10:45.222380+0000","last_active":"2024-03-30T13:10:46.266262+0000","last_peered":"2024-03-30T13:10:46.266262+0000","last_clean":"2024-03-30T13:10:46.266262+0000","last_became_active":"2024-03-30T13:10:45.221975+0000","last_became_peered":"2024-03-30T13:10:45.221975+0000","last_unstale":"2024-03-30T13:10:46.266262+0000","last_undegraded":"2024-03-30T13:10:46.266262+0000","last_fullsized":"2024-03-30T13:10:46.266262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:26:59.790496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248472+0000","last_change":"2024-03-30T13:10:46.232634+0000","last_active":"2024-03-30T13:10:47.248472+0000","last_peered":"2024-03-30T13:10:47.248472+0000","last_clean":"2024-03-30T13:10:47.248472+0000","last_became_active":"2024-03-30T13:10:46.232300+0000","last_became_peered":"2024-03-30T13:10:46.232300+0000","last_unstale":"2024-03-30T13:10:47.248472+0000","last_undegraded":"2024-03-30T13:10:47.248472+0000","last_fullsized":"2024-03-30T13:10:47.248472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278970+0000","last_change":"2024-03-30T13:10:45.218507+0000","last_active":"2024-03-30T13:10:48.278970+0000","last_peered":"2024-03-30T13:10:48.278970+0000","last_clean":"2024-03-30T13:10:48.278970+0000","last_became_active":"2024-03-30T13:10:45.218111+0000","last_became_peered":"2024-03-30T13:10:45.218111+0000","last_unstale":"2024-03-30T13:10:48.278970+0000","last_undegraded":"2024-03-30T13:10:48.278970+0000","last_fullsized":"2024-03-30T13:10:48.278970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:59.653496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278733+0000","last_change":"2024-03-30T13:10:46.239582+0000","last_active":"2024-03-30T13:10:48.278733+0000","last_peered":"2024-03-30T13:10:48.278733+0000","last_clean":"2024-03-30T13:10:48.278733+0000","last_became_active":"2024-03-30T13:10:46.237808+0000","last_became_peered":"2024-03-30T13:10:46.237808+0000","last_unstale":"2024-03-30T13:10:48.278733+0000","last_undegraded":"2024-03-30T13:10:48.278733+0000","last_fullsized":"2024-03-30T13:10:48.278733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:58.426124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245598+0000","last_change":"2024-03-30T13:10:45.210052+0000","last_active":"2024-03-30T13:10:47.245598+0000","last_peered":"2024-03-30T13:10:47.245598+0000","last_clean":"2024-03-30T13:10:47.245598+0000","last_became_active":"2024-03-30T13:10:45.205338+0000","last_became_peered":"2024-03-30T13:10:45.205338+0000","last_unstale":"2024-03-30T13:10:47.245598+0000","last_undegraded":"2024-03-30T13:10:47.245598+0000","last_fullsized":"2024-03-30T13:10:47.245598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:57.594719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242878+0000","last_change":"2024-03-30T13:10:46.247309+0000","last_active":"2024-03-30T13:10:47.242878+0000","last_peered":"2024-03-30T13:10:47.242878+0000","last_clean":"2024-03-30T13:10:47.242878+0000","last_became_active":"2024-03-30T13:10:46.243301+0000","last_became_peered":"2024-03-30T13:10:46.243301+0000","last_unstale":"2024-03-30T13:10:47.242878+0000","last_undegraded":"2024-03-30T13:10:47.242878+0000","last_fullsized":"2024-03-30T13:10:47.242878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:56.949656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249704+0000","last_change":"2024-03-30T13:10:45.221532+0000","last_active":"2024-03-30T13:10:47.249704+0000","last_peered":"2024-03-30T13:10:47.249704+0000","last_clean":"2024-03-30T13:10:47.249704+0000","last_became_active":"2024-03-30T13:10:45.220536+0000","last_became_peered":"2024-03-30T13:10:45.220536+0000","last_unstale":"2024-03-30T13:10:47.249704+0000","last_undegraded":"2024-03-30T13:10:47.249704+0000","last_fullsized":"2024-03-30T13:10:47.249704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279358+0000","last_change":"2024-03-30T13:10:46.242980+0000","last_active":"2024-03-30T13:10:48.279358+0000","last_peered":"2024-03-30T13:10:48.279358+0000","last_clean":"2024-03-30T13:10:48.279358+0000","last_became_active":"2024-03-30T13:10:46.242702+0000","last_became_peered":"2024-03-30T13:10:46.242702+0000","last_unstale":"2024-03-30T13:10:48.279358+0000","last_undegraded":"2024-03-30T13:10:48.279358+0000","last_fullsized":"2024-03-30T13:10:48.279358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:42:22.008993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246344+0000","last_change":"2024-03-30T13:10:45.223223+0000","last_active":"2024-03-30T13:10:47.246344+0000","last_peered":"2024-03-30T13:10:47.246344+0000","last_clean":"2024-03-30T13:10:47.246344+0000","last_became_active":"2024-03-30T13:10:45.222887+0000","last_became_peered":"2024-03-30T13:10:45.222887+0000","last_unstale":"2024-03-30T13:10:47.246344+0000","last_undegraded":"2024-03-30T13:10:47.246344+0000","last_fullsized":"2024-03-30T13:10:47.246344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992357+0000","last_change":"2024-03-30T13:10:46.254732+0000","last_active":"2024-03-30T13:10:47.992357+0000","last_peered":"2024-03-30T13:10:47.992357+0000","last_clean":"2024-03-30T13:10:47.992357+0000","last_became_active":"2024-03-30T13:10:46.254356+0000","last_became_peered":"2024-03-30T13:10:46.254356+0000","last_unstale":"2024-03-30T13:10:47.992357+0000","last_undegraded":"2024-03-30T13:10:47.992357+0000","last_fullsized":"2024-03-30T13:10:47.992357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250809+0000","last_change":"2024-03-30T13:10:45.224819+0000","last_active":"2024-03-30T13:10:47.250809+0000","last_peered":"2024-03-30T13:10:47.250809+0000","last_clean":"2024-03-30T13:10:47.250809+0000","last_became_active":"2024-03-30T13:10:45.223270+0000","last_became_peered":"2024-03-30T13:10:45.223270+0000","last_unstale":"2024-03-30T13:10:47.250809+0000","last_undegraded":"2024-03-30T13:10:47.250809+0000","last_fullsized":"2024-03-30T13:10:47.250809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246314+0000","last_change":"2024-03-30T13:10:46.254500+0000","last_active":"2024-03-30T13:10:47.246314+0000","last_peered":"2024-03-30T13:10:47.246314+0000","last_clean":"2024-03-30T13:10:47.246314+0000","last_became_active":"2024-03-30T13:10:46.254208+0000","last_became_peered":"2024-03-30T13:10:46.254208+0000","last_unstale":"2024-03-30T13:10:47.246314+0000","last_undegraded":"2024-03-30T13:10:47.246314+0000","last_fullsized":"2024-03-30T13:10:47.246314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:42.999062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282278+0000","last_change":"2024-03-30T13:10:45.225766+0000","last_active":"2024-03-30T13:10:48.282278+0000","last_peered":"2024-03-30T13:10:48.282278+0000","last_clean":"2024-03-30T13:10:48.282278+0000","last_became_active":"2024-03-30T13:10:45.225096+0000","last_became_peered":"2024-03-30T13:10:45.225096+0000","last_unstale":"2024-03-30T13:10:48.282278+0000","last_undegraded":"2024-03-30T13:10:48.282278+0000","last_fullsized":"2024-03-30T13:10:48.282278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246156+0000","last_change":"2024-03-30T13:10:46.255837+0000","last_active":"2024-03-30T13:10:47.246156+0000","last_peered":"2024-03-30T13:10:47.246156+0000","last_clean":"2024-03-30T13:10:47.246156+0000","last_became_active":"2024-03-30T13:10:46.251826+0000","last_became_peered":"2024-03-30T13:10:46.251826+0000","last_unstale":"2024-03-30T13:10:47.246156+0000","last_undegraded":"2024-03-30T13:10:47.246156+0000","last_fullsized":"2024-03-30T13:10:47.246156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248851+0000","last_change":"2024-03-30T13:10:45.210147+0000","last_active":"2024-03-30T13:10:47.248851+0000","last_peered":"2024-03-30T13:10:47.248851+0000","last_clean":"2024-03-30T13:10:47.248851+0000","last_became_active":"2024-03-30T13:10:45.209716+0000","last_became_peered":"2024-03-30T13:10:45.209716+0000","last_unstale":"2024-03-30T13:10:47.248851+0000","last_undegraded":"2024-03-30T13:10:47.248851+0000","last_fullsized":"2024-03-30T13:10:47.248851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279114+0000","last_change":"2024-03-30T13:10:46.244995+0000","last_active":"2024-03-30T13:10:48.279114+0000","last_peered":"2024-03-30T13:10:48.279114+0000","last_clean":"2024-03-30T13:10:48.279114+0000","last_became_active":"2024-03-30T13:10:46.244716+0000","last_became_peered":"2024-03-30T13:10:46.244716+0000","last_unstale":"2024-03-30T13:10:48.279114+0000","last_undegraded":"2024-03-30T13:10:48.279114+0000","last_fullsized":"2024-03-30T13:10:48.279114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:56.283461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242840+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:10:47.242840+0000","last_peered":"2024-03-30T13:10:47.242840+0000","last_clean":"2024-03-30T13:10:47.242840+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:10:47.242840+0000","last_undegraded":"2024-03-30T13:10:47.242840+0000","last_fullsized":"2024-03-30T13:10:47.242840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278834+0000","last_change":"2024-03-30T13:10:45.216758+0000","last_active":"2024-03-30T13:10:48.278834+0000","last_peered":"2024-03-30T13:10:48.278834+0000","last_clean":"2024-03-30T13:10:48.278834+0000","last_became_active":"2024-03-30T13:10:45.215040+0000","last_became_peered":"2024-03-30T13:10:45.215040+0000","last_unstale":"2024-03-30T13:10:48.278834+0000","last_undegraded":"2024-03-30T13:10:48.278834+0000","last_fullsized":"2024-03-30T13:10:48.278834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.089085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249967+0000","last_change":"2024-03-30T13:10:46.243383+0000","last_active":"2024-03-30T13:10:47.249967+0000","last_peered":"2024-03-30T13:10:47.249967+0000","last_clean":"2024-03-30T13:10:47.249967+0000","last_became_active":"2024-03-30T13:10:46.243046+0000","last_became_peered":"2024-03-30T13:10:46.243046+0000","last_unstale":"2024-03-30T13:10:47.249967+0000","last_undegraded":"2024-03-30T13:10:47.249967+0000","last_fullsized":"2024-03-30T13:10:47.249967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278692+0000","last_change":"2024-03-30T13:10:45.221144+0000","last_active":"2024-03-30T13:10:48.278692+0000","last_peered":"2024-03-30T13:10:48.278692+0000","last_clean":"2024-03-30T13:10:48.278692+0000","last_became_active":"2024-03-30T13:10:45.219684+0000","last_became_peered":"2024-03-30T13:10:45.219684+0000","last_unstale":"2024-03-30T13:10:48.278692+0000","last_undegraded":"2024-03-30T13:10:48.278692+0000","last_fullsized":"2024-03-30T13:10:48.278692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:49.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247995+0000","last_change":"2024-03-30T13:10:46.239001+0000","last_active":"2024-03-30T13:10:47.247995+0000","last_peered":"2024-03-30T13:10:47.247995+0000","last_clean":"2024-03-30T13:10:47.247995+0000","last_became_active":"2024-03-30T13:10:46.238750+0000","last_became_peered":"2024-03-30T13:10:46.238750+0000","last_unstale":"2024-03-30T13:10:47.247995+0000","last_undegraded":"2024-03-30T13:10:47.247995+0000","last_fullsized":"2024-03-30T13:10:47.247995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.235562+0000","last_change":"2024-03-30T13:10:45.223067+0000","last_active":"2024-03-30T13:10:46.235562+0000","last_peered":"2024-03-30T13:10:46.235562+0000","last_clean":"2024-03-30T13:10:46.235562+0000","last_became_active":"2024-03-30T13:10:45.222778+0000","last_became_peered":"2024-03-30T13:10:45.222778+0000","last_unstale":"2024-03-30T13:10:46.235562+0000","last_undegraded":"2024-03-30T13:10:46.235562+0000","last_fullsized":"2024-03-30T13:10:46.235562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:35:37.871387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280762+0000","last_change":"2024-03-30T13:10:46.246374+0000","last_active":"2024-03-30T13:10:48.280762+0000","last_peered":"2024-03-30T13:10:48.280762+0000","last_clean":"2024-03-30T13:10:48.280762+0000","last_became_active":"2024-03-30T13:10:46.246094+0000","last_became_peered":"2024-03-30T13:10:46.246094+0000","last_unstale":"2024-03-30T13:10:48.280762+0000","last_undegraded":"2024-03-30T13:10:48.280762+0000","last_fullsized":"2024-03-30T13:10:48.280762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279004+0000","last_change":"2024-03-30T13:10:45.220442+0000","last_active":"2024-03-30T13:10:48.279004+0000","last_peered":"2024-03-30T13:10:48.279004+0000","last_clean":"2024-03-30T13:10:48.279004+0000","last_became_active":"2024-03-30T13:10:45.219537+0000","last_became_peered":"2024-03-30T13:10:45.219537+0000","last_unstale":"2024-03-30T13:10:48.279004+0000","last_undegraded":"2024-03-30T13:10:48.279004+0000","last_fullsized":"2024-03-30T13:10:48.279004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:37.659793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246414+0000","last_change":"2024-03-30T13:10:46.249794+0000","last_active":"2024-03-30T13:10:47.246414+0000","last_peered":"2024-03-30T13:10:47.246414+0000","last_clean":"2024-03-30T13:10:47.246414+0000","last_became_active":"2024-03-30T13:10:46.249501+0000","last_became_peered":"2024-03-30T13:10:46.249501+0000","last_unstale":"2024-03-30T13:10:47.246414+0000","last_undegraded":"2024-03-30T13:10:47.246414+0000","last_fullsized":"2024-03-30T13:10:47.246414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:58.426124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281281+0000","last_change":"2024-03-30T13:10:45.225647+0000","last_active":"2024-03-30T13:10:48.281281+0000","last_peered":"2024-03-30T13:10:48.281281+0000","last_clean":"2024-03-30T13:10:48.281281+0000","last_became_active":"2024-03-30T13:10:45.225066+0000","last_became_peered":"2024-03-30T13:10:45.225066+0000","last_unstale":"2024-03-30T13:10:48.281281+0000","last_undegraded":"2024-03-30T13:10:48.281281+0000","last_fullsized":"2024-03-30T13:10:48.281281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991763+0000","last_change":"2024-03-30T13:10:46.234204+0000","last_active":"2024-03-30T13:10:47.991763+0000","last_peered":"2024-03-30T13:10:47.991763+0000","last_clean":"2024-03-30T13:10:47.991763+0000","last_became_active":"2024-03-30T13:10:46.233876+0000","last_became_peered":"2024-03-30T13:10:46.233876+0000","last_unstale":"2024-03-30T13:10:47.991763+0000","last_undegraded":"2024-03-30T13:10:47.991763+0000","last_fullsized":"2024-03-30T13:10:47.991763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:19.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279290+0000","last_change":"2024-03-30T13:10:45.219517+0000","last_active":"2024-03-30T13:10:48.279290+0000","last_peered":"2024-03-30T13:10:48.279290+0000","last_clean":"2024-03-30T13:10:48.279290+0000","last_became_active":"2024-03-30T13:10:45.219201+0000","last_became_peered":"2024-03-30T13:10:45.219201+0000","last_unstale":"2024-03-30T13:10:48.279290+0000","last_undegraded":"2024-03-30T13:10:48.279290+0000","last_fullsized":"2024-03-30T13:10:48.279290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:27.406147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248726+0000","last_change":"2024-03-30T13:10:46.234095+0000","last_active":"2024-03-30T13:10:47.248726+0000","last_peered":"2024-03-30T13:10:47.248726+0000","last_clean":"2024-03-30T13:10:47.248726+0000","last_became_active":"2024-03-30T13:10:46.233686+0000","last_became_peered":"2024-03-30T13:10:46.233686+0000","last_unstale":"2024-03-30T13:10:47.248726+0000","last_undegraded":"2024-03-30T13:10:47.248726+0000","last_fullsized":"2024-03-30T13:10:47.248726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.253768+0000","last_change":"2024-03-30T13:10:45.216838+0000","last_active":"2024-03-30T13:10:47.253768+0000","last_peered":"2024-03-30T13:10:47.253768+0000","last_clean":"2024-03-30T13:10:47.253768+0000","last_became_active":"2024-03-30T13:10:45.216528+0000","last_became_peered":"2024-03-30T13:10:45.216528+0000","last_unstale":"2024-03-30T13:10:47.253768+0000","last_undegraded":"2024-03-30T13:10:47.253768+0000","last_fullsized":"2024-03-30T13:10:47.253768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251100+0000","last_change":"2024-03-30T13:10:46.243883+0000","last_active":"2024-03-30T13:10:47.251100+0000","last_peered":"2024-03-30T13:10:47.251100+0000","last_clean":"2024-03-30T13:10:47.251100+0000","last_became_active":"2024-03-30T13:10:46.243583+0000","last_became_peered":"2024-03-30T13:10:46.243583+0000","last_unstale":"2024-03-30T13:10:47.251100+0000","last_undegraded":"2024-03-30T13:10:47.251100+0000","last_fullsized":"2024-03-30T13:10:47.251100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279909+0000","last_change":"2024-03-30T13:10:45.219656+0000","last_active":"2024-03-30T13:10:48.279909+0000","last_peered":"2024-03-30T13:10:48.279909+0000","last_clean":"2024-03-30T13:10:48.279909+0000","last_became_active":"2024-03-30T13:10:45.219347+0000","last_became_peered":"2024-03-30T13:10:45.219347+0000","last_unstale":"2024-03-30T13:10:48.279909+0000","last_undegraded":"2024-03-30T13:10:48.279909+0000","last_fullsized":"2024-03-30T13:10:48.279909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:37.075782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250903+0000","last_change":"2024-03-30T13:10:46.248800+0000","last_active":"2024-03-30T13:10:47.250903+0000","last_peered":"2024-03-30T13:10:47.250903+0000","last_clean":"2024-03-30T13:10:47.250903+0000","last_became_active":"2024-03-30T13:10:46.248344+0000","last_became_peered":"2024-03-30T13:10:46.248344+0000","last_unstale":"2024-03-30T13:10:47.250903+0000","last_undegraded":"2024-03-30T13:10:47.250903+0000","last_fullsized":"2024-03-30T13:10:47.250903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245338+0000","last_change":"2024-03-30T13:10:45.210402+0000","last_active":"2024-03-30T13:10:47.245338+0000","last_peered":"2024-03-30T13:10:47.245338+0000","last_clean":"2024-03-30T13:10:47.245338+0000","last_became_active":"2024-03-30T13:10:45.210107+0000","last_became_peered":"2024-03-30T13:10:45.210107+0000","last_unstale":"2024-03-30T13:10:47.245338+0000","last_undegraded":"2024-03-30T13:10:47.245338+0000","last_fullsized":"2024-03-30T13:10:47.245338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279223+0000","last_change":"2024-03-30T13:10:46.241705+0000","last_active":"2024-03-30T13:10:48.279223+0000","last_peered":"2024-03-30T13:10:48.279223+0000","last_clean":"2024-03-30T13:10:48.279223+0000","last_became_active":"2024-03-30T13:10:46.241327+0000","last_became_peered":"2024-03-30T13:10:46.241327+0000","last_unstale":"2024-03-30T13:10:48.279223+0000","last_undegraded":"2024-03-30T13:10:48.279223+0000","last_fullsized":"2024-03-30T13:10:48.279223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:05:58.972097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250156+0000","last_change":"2024-03-30T13:10:45.223756+0000","last_active":"2024-03-30T13:10:47.250156+0000","last_peered":"2024-03-30T13:10:47.250156+0000","last_clean":"2024-03-30T13:10:47.250156+0000","last_became_active":"2024-03-30T13:10:45.222236+0000","last_became_peered":"2024-03-30T13:10:45.222236+0000","last_unstale":"2024-03-30T13:10:47.250156+0000","last_undegraded":"2024-03-30T13:10:47.250156+0000","last_fullsized":"2024-03-30T13:10:47.250156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250500+0000","last_change":"2024-03-30T13:10:46.250939+0000","last_active":"2024-03-30T13:10:47.250500+0000","last_peered":"2024-03-30T13:10:47.250500+0000","last_clean":"2024-03-30T13:10:47.250500+0000","last_became_active":"2024-03-30T13:10:46.250651+0000","last_became_peered":"2024-03-30T13:10:46.250651+0000","last_unstale":"2024-03-30T13:10:47.250500+0000","last_undegraded":"2024-03-30T13:10:47.250500+0000","last_fullsized":"2024-03-30T13:10:47.250500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248428+0000","last_change":"2024-03-30T13:10:45.222799+0000","last_active":"2024-03-30T13:10:47.248428+0000","last_peered":"2024-03-30T13:10:47.248428+0000","last_clean":"2024-03-30T13:10:47.248428+0000","last_became_active":"2024-03-30T13:10:45.221899+0000","last_became_peered":"2024-03-30T13:10:45.221899+0000","last_unstale":"2024-03-30T13:10:47.248428+0000","last_undegraded":"2024-03-30T13:10:47.248428+0000","last_fullsized":"2024-03-30T13:10:47.248428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-30T13:10:46.250423+0000","last_change":"2024-03-30T13:10:46.245047+0000","last_active":"2024-03-30T13:10:46.250423+0000","last_peered":"2024-03-30T13:10:46.250423+0000","last_clean":"2024-03-30T13:10:46.250423+0000","last_became_active":"2024-03-30T13:10:46.244170+0000","last_became_peered":"2024-03-30T13:10:46.244170+0000","last_unstale":"2024-03-30T13:10:46.250423+0000","last_undegraded":"2024-03-30T13:10:46.250423+0000","last_fullsized":"2024-03-30T13:10:46.250423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:27:43.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278786+0000","last_change":"2024-03-30T13:10:45.215312+0000","last_active":"2024-03-30T13:10:48.278786+0000","last_peered":"2024-03-30T13:10:48.278786+0000","last_clean":"2024-03-30T13:10:48.278786+0000","last_became_active":"2024-03-30T13:10:45.214701+0000","last_became_peered":"2024-03-30T13:10:45.214701+0000","last_unstale":"2024-03-30T13:10:48.278786+0000","last_undegraded":"2024-03-30T13:10:48.278786+0000","last_fullsized":"2024-03-30T13:10:48.278786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:16.903426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278902+0000","last_change":"2024-03-30T13:10:46.245626+0000","last_active":"2024-03-30T13:10:48.278902+0000","last_peered":"2024-03-30T13:10:48.278902+0000","last_clean":"2024-03-30T13:10:48.278902+0000","last_became_active":"2024-03-30T13:10:46.245360+0000","last_became_peered":"2024-03-30T13:10:46.245360+0000","last_unstale":"2024-03-30T13:10:48.278902+0000","last_undegraded":"2024-03-30T13:10:48.278902+0000","last_fullsized":"2024-03-30T13:10:48.278902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:55:33.498408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279107+0000","last_change":"2024-03-30T13:10:46.255467+0000","last_active":"2024-03-30T13:10:48.279107+0000","last_peered":"2024-03-30T13:10:48.279107+0000","last_clean":"2024-03-30T13:10:48.279107+0000","last_became_active":"2024-03-30T13:10:46.254974+0000","last_became_peered":"2024-03-30T13:10:46.254974+0000","last_unstale":"2024-03-30T13:10:48.279107+0000","last_undegraded":"2024-03-30T13:10:48.279107+0000","last_fullsized":"2024-03-30T13:10:48.279107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:52:10.233229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246199+0000","last_change":"2024-03-30T13:10:45.203155+0000","last_active":"2024-03-30T13:10:47.246199+0000","last_peered":"2024-03-30T13:10:47.246199+0000","last_clean":"2024-03-30T13:10:47.246199+0000","last_became_active":"2024-03-30T13:10:45.202582+0000","last_became_peered":"2024-03-30T13:10:45.202582+0000","last_unstale":"2024-03-30T13:10:47.246199+0000","last_undegraded":"2024-03-30T13:10:47.246199+0000","last_fullsized":"2024-03-30T13:10:47.246199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:49.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242997+0000","last_change":"2024-03-30T13:10:46.260566+0000","last_active":"2024-03-30T13:10:47.242997+0000","last_peered":"2024-03-30T13:10:47.242997+0000","last_clean":"2024-03-30T13:10:47.242997+0000","last_became_active":"2024-03-30T13:10:46.260117+0000","last_became_peered":"2024-03-30T13:10:46.260117+0000","last_unstale":"2024-03-30T13:10:47.242997+0000","last_undegraded":"2024-03-30T13:10:47.242997+0000","last_fullsized":"2024-03-30T13:10:47.242997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:58.607723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246060+0000","last_change":"2024-03-30T13:10:45.206209+0000","last_active":"2024-03-30T13:10:47.246060+0000","last_peered":"2024-03-30T13:10:47.246060+0000","last_clean":"2024-03-30T13:10:47.246060+0000","last_became_active":"2024-03-30T13:10:45.203095+0000","last_became_peered":"2024-03-30T13:10:45.203095+0000","last_unstale":"2024-03-30T13:10:47.246060+0000","last_undegraded":"2024-03-30T13:10:47.246060+0000","last_fullsized":"2024-03-30T13:10:47.246060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281962+0000","last_change":"2024-03-30T13:10:46.249303+0000","last_active":"2024-03-30T13:10:48.281962+0000","last_peered":"2024-03-30T13:10:48.281962+0000","last_clean":"2024-03-30T13:10:48.281962+0000","last_became_active":"2024-03-30T13:10:46.248971+0000","last_became_peered":"2024-03-30T13:10:46.248971+0000","last_unstale":"2024-03-30T13:10:48.281962+0000","last_undegraded":"2024-03-30T13:10:48.281962+0000","last_fullsized":"2024-03-30T13:10:48.281962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282831+0000","last_change":"2024-03-30T13:10:45.222811+0000","last_active":"2024-03-30T13:10:48.282831+0000","last_peered":"2024-03-30T13:10:48.282831+0000","last_clean":"2024-03-30T13:10:48.282831+0000","last_became_active":"2024-03-30T13:10:45.222439+0000","last_became_peered":"2024-03-30T13:10:45.222439+0000","last_unstale":"2024-03-30T13:10:48.282831+0000","last_undegraded":"2024-03-30T13:10:48.282831+0000","last_fullsized":"2024-03-30T13:10:48.282831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282474+0000","last_change":"2024-03-30T13:10:46.242067+0000","last_active":"2024-03-30T13:10:48.282474+0000","last_peered":"2024-03-30T13:10:48.282474+0000","last_clean":"2024-03-30T13:10:48.282474+0000","last_became_active":"2024-03-30T13:10:46.241783+0000","last_became_peered":"2024-03-30T13:10:46.241783+0000","last_unstale":"2024-03-30T13:10:48.282474+0000","last_undegraded":"2024-03-30T13:10:48.282474+0000","last_fullsized":"2024-03-30T13:10:48.282474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251193+0000","last_change":"2024-03-30T13:10:45.221172+0000","last_active":"2024-03-30T13:10:47.251193+0000","last_peered":"2024-03-30T13:10:47.251193+0000","last_clean":"2024-03-30T13:10:47.251193+0000","last_became_active":"2024-03-30T13:10:45.220799+0000","last_became_peered":"2024-03-30T13:10:45.220799+0000","last_unstale":"2024-03-30T13:10:47.251193+0000","last_undegraded":"2024-03-30T13:10:47.251193+0000","last_fullsized":"2024-03-30T13:10:47.251193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476741,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476741,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":665602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476740,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":659324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":77448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":68988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:10:56.048 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:10:56.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.256+0000 7f9805e00640 1 Processor -- start 2024-03-30T13:10:56.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.256+0000 7f9805e00640 1 -- start start 2024-03-30T13:10:56.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.258+0000 7f9805e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980015c670 0x7f980006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.258+0000 7f9805e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9800146230 con 0x7f98000ad940 2024-03-30T13:10:56.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.258+0000 7f9805e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f980006dfc0 con 0x7f980006f060 2024-03-30T13:10:56.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.258+0000 7f9805e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f980006e2a0 con 0x7f980015c670 2024-03-30T13:10:56.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.258+0000 7f97ff400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f98000ad940 0x7f98000b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56630/0 (socket says 172.21.15.99:56630) 2024-03-30T13:10:56.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.258+0000 7f97ff400640 1 -- 172.21.15.99:0/1695631355 learned_addr learned my addr 172.21.15.99:0/1695631355 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:56.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.258+0000 7f97fea00640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980015c670 0x7f980006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4201827126 0 0) 0x7f97f8001110 con 0x7f98000ad940 2024-03-30T13:10:56.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97e4003520 con 0x7f98000ad940 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 958417995 0 0) 0x7f97e4003520 con 0x7f98000ad940 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980015c670 msgr2=0x7f980006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980015c670 0x7f980006c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 >> v1:172.21.15.181:6789/0 conn(0x7f980006f060 legacy=0x7f98000ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980006e580 con 0x7f98000ad940 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f97f8001840 con 0x7f98000ad940 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 >> v1:172.21.15.99:6789/0 conn(0x7f98000ad940 legacy=0x7f98000b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97e40039e0 0x7f97e4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97e4004800 0x7f97e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980015c670 0x7f97e4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f980006e2a0 con 0x7f97e4004800 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f97e400baf0 con 0x7f97e40039e0 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f97e400bcf0 con 0x7f980015c670 2024-03-30T13:10:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.259+0000 7f97fe000640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97e4004800 0x7f97e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.260+0000 7f97ff400640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980015c670 0x7f97e4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.260+0000 7f97fea00640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97e40039e0 0x7f97e4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.260+0000 7f97fe000640 1 -- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980015c670 msgr2=0x7f97e4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:56.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.260+0000 7f97fe000640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980015c670 0x7f97e4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.260+0000 7f97fe000640 1 -- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97e40039e0 msgr2=0x7f97e4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:56.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.260+0000 7f97fe000640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97e40039e0 0x7f97e4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.260+0000 7f97fe000640 1 -- 172.21.15.99:0/1695631355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e4003520 con 0x7f97e4004800 2024-03-30T13:10:56.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.260+0000 7f97fea00640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97e40039e0 0x7f97e4003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:56.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.262+0000 7f97fe000640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97e4004800 0x7f97e4004c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f97f0001e50 tx=0x7f97e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8484854c1ff741 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:56.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.262+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0001a70 con 0x7f97e4004800 2024-03-30T13:10:56.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.262+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f0003b70 con 0x7f97e4004800 2024-03-30T13:10:56.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.262+0000 7f97fd600640 1 -- 172.21.15.99:0/1695631355 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f00050d0 con 0x7f97e4004800 2024-03-30T13:10:56.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.262+0000 7f9805e00640 1 -- 172.21.15.99:0/1695631355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97e4004800 msgr2=0x7f97e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:56.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.262+0000 7f9805e00640 1 --2- 172.21.15.99:0/1695631355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97e4004800 0x7f97e4004c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f97f0001e50 tx=0x7f97e4005830 comp rx=0 tx=0).stop 2024-03-30T13:10:56.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.262+0000 7f97ff400640 1 -- 172.21.15.99:0/1695631355 reap_dead start 2024-03-30T13:10:56.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.263+0000 7f9805e00640 1 -- 172.21.15.99:0/1695631355 shutdown_connections 2024-03-30T13:10:56.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.263+0000 7f9805e00640 1 -- 172.21.15.99:0/1695631355 >> 172.21.15.99:0/1695631355 conn(0x7f980006b510 msgr2=0x7f980006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:56.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.263+0000 7f9805e00640 1 -- 172.21.15.99:0/1695631355 shutdown_connections 2024-03-30T13:10:56.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.263+0000 7f9805e00640 1 -- 172.21.15.99:0/1695631355 wait complete. 2024-03-30T13:10:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.265+0000 7f9805e00640 1 Processor -- start 2024-03-30T13:10:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.266+0000 7f9805e00640 1 -- start start 2024-03-30T13:10:56.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.267+0000 7f9805e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97e4004800 0x7f98000cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.267+0000 7f9805e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9800099c10 0x7f98000ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.267+0000 7f9805e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98001447f0 0x7f98000cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.267+0000 7f9805e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f980006c030 con 0x7f9800099c10 2024-03-30T13:10:56.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.267+0000 7f9805e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f980015ca50 con 0x7f98001447f0 2024-03-30T13:10:56.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.267+0000 7f9805e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f980006c1b0 con 0x7f97e4004800 2024-03-30T13:10:56.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.267+0000 7f97fe000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9800099c10 0x7f98000ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.267+0000 7f97fe000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9800099c10 0x7f98000ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38108/0 (socket says 172.21.15.99:38108) 2024-03-30T13:10:56.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.267+0000 7f97fe000640 1 -- 172.21.15.99:0/3881716545 learned_addr learned my addr 172.21.15.99:0/3881716545 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:56.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.268+0000 7f97fea00640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97e4004800 0x7f98000cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.268+0000 7f97fe000640 1 -- 172.21.15.99:0/3881716545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97e4004800 msgr2=0x7f98000cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:56.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.268+0000 7f97fe000640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97e4004800 0x7f98000cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.268+0000 7f97fe000640 1 -- 172.21.15.99:0/3881716545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98001447f0 msgr2=0x7f98000cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:56.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.268+0000 7f97fe000640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98001447f0 0x7f98000cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.268+0000 7f97fe000640 1 -- 172.21.15.99:0/3881716545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98001453e0 con 0x7f9800099c10 2024-03-30T13:10:56.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.268+0000 7f97fe000640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9800099c10 0x7f98000ccc20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97f0001f70 tx=0x7f97f00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:56.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.268+0000 7f97f7400640 1 -- 172.21.15.99:0/3881716545 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0003970 con 0x7f9800099c10 2024-03-30T13:10:56.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.268+0000 7f97f7400640 1 -- 172.21.15.99:0/3881716545 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f0006b50 con 0x7f9800099c10 2024-03-30T13:10:56.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.268+0000 7f97f7400640 1 -- 172.21.15.99:0/3881716545 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0007030 con 0x7f9800099c10 2024-03-30T13:10:56.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.268+0000 7f9805e00640 1 -- 172.21.15.99:0/3881716545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98000cece0 con 0x7f9800099c10 2024-03-30T13:10:56.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.269+0000 7f9805e00640 1 -- 172.21.15.99:0/3881716545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f980015cf50 con 0x7f9800099c10 2024-03-30T13:10:56.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.270+0000 7f9805e00640 1 -- 172.21.15.99:0/3881716545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9800068640 con 0x7f9800099c10 2024-03-30T13:10:56.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.271+0000 7f97f7400640 1 -- 172.21.15.99:0/3881716545 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f97f00071d0 con 0x7f9800099c10 2024-03-30T13:10:56.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.272+0000 7f97f7400640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f97dc06c560 0x7f97dc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.272+0000 7f97f7400640 1 -- 172.21.15.99:0/3881716545 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f97f00ad390 con 0x7f9800099c10 2024-03-30T13:10:56.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.272+0000 7f97fea00640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f97dc06c560 0x7f97dc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.273+0000 7f97fea00640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f97dc06c560 0x7f97dc06ea20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f980015f6f0 tx=0x7f97e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:56.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.276+0000 7f97f7400640 1 -- 172.21.15.99:0/3881716545 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f97f0033020 con 0x7f9800099c10 2024-03-30T13:10:56.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.490+0000 7f9805e00640 1 -- 172.21.15.99:0/3881716545 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f980006f570 con 0x7f97dc06c560 2024-03-30T13:10:56.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.501+0000 7f97f7400640 1 -- 172.21.15.99:0/3881716545 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251856 (secure 0 0 0) 0x7f980006f570 con 0x7f97dc06c560 2024-03-30T13:10:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:56.511 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:10:56.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 -- 172.21.15.99:0/3881716545 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f97dc06c560 msgr2=0x7f97dc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:56.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f97dc06c560 0x7f97dc06ea20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f980015f6f0 tx=0x7f97e8008040 comp rx=0 tx=0).stop 2024-03-30T13:10:56.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 -- 172.21.15.99:0/3881716545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9800099c10 msgr2=0x7f98000ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:56.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9800099c10 0x7f98000ccc20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97f0001f70 tx=0x7f97f00014a0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 -- 172.21.15.99:0/3881716545 shutdown_connections 2024-03-30T13:10:56.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f97dc06c560 0x7f97dc06ea20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98001447f0 0x7f98000cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9800099c10 0x7f98000ccc20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 --2- 172.21.15.99:0/3881716545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97e4004800 0x7f98000cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 -- 172.21.15.99:0/3881716545 >> 172.21.15.99:0/3881716545 conn(0x7f980006b510 msgr2=0x7f980015a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:56.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 -- 172.21.15.99:0/3881716545 shutdown_connections 2024-03-30T13:10:56.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.507+0000 7f9805e00640 1 -- 172.21.15.99:0/3881716545 wait complete. 2024-03-30T13:10:56.531 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-03-30T13:10:55.436974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2990080,"data_stored":1786868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.228339"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246289+0000","last_change":"2024-03-30T13:10:46.234821+0000","last_active":"2024-03-30T13:10:47.246289+0000","last_peered":"2024-03-30T13:10:47.246289+0000","last_clean":"2024-03-30T13:10:47.246289+0000","last_became_active":"2024-03-30T13:10:46.234553+0000","last_became_peered":"2024-03-30T13:10:46.234553+0000","last_unstale":"2024-03-30T13:10:47.246289+0000","last_undegraded":"2024-03-30T13:10:47.246289+0000","last_fullsized":"2024-03-30T13:10:47.246289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:13.303492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282177+0000","last_change":"2024-03-30T13:10:46.238313+0000","last_active":"2024-03-30T13:10:48.282177+0000","last_peered":"2024-03-30T13:10:48.282177+0000","last_clean":"2024-03-30T13:10:48.282177+0000","last_became_active":"2024-03-30T13:10:46.238010+0000","last_became_peered":"2024-03-30T13:10:46.238010+0000","last_unstale":"2024-03-30T13:10:48.282177+0000","last_undegraded":"2024-03-30T13:10:48.282177+0000","last_fullsized":"2024-03-30T13:10:48.282177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281389+0000","last_change":"2024-03-30T13:10:46.241744+0000","last_active":"2024-03-30T13:10:48.281389+0000","last_peered":"2024-03-30T13:10:48.281389+0000","last_clean":"2024-03-30T13:10:48.281389+0000","last_became_active":"2024-03-30T13:10:46.241480+0000","last_became_peered":"2024-03-30T13:10:46.241480+0000","last_unstale":"2024-03-30T13:10:48.281389+0000","last_undegraded":"2024-03-30T13:10:48.281389+0000","last_fullsized":"2024-03-30T13:10:48.281389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991801+0000","last_change":"2024-03-30T13:10:46.244024+0000","last_active":"2024-03-30T13:10:47.991801+0000","last_peered":"2024-03-30T13:10:47.991801+0000","last_clean":"2024-03-30T13:10:47.991801+0000","last_became_active":"2024-03-30T13:10:46.243697+0000","last_became_peered":"2024-03-30T13:10:46.243697+0000","last_unstale":"2024-03-30T13:10:47.991801+0000","last_undegraded":"2024-03-30T13:10:47.991801+0000","last_fullsized":"2024-03-30T13:10:47.991801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:38.672797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246287+0000","last_change":"2024-03-30T13:10:46.234379+0000","last_active":"2024-03-30T13:10:47.246287+0000","last_peered":"2024-03-30T13:10:47.246287+0000","last_clean":"2024-03-30T13:10:47.246287+0000","last_became_active":"2024-03-30T13:10:46.234047+0000","last_became_peered":"2024-03-30T13:10:46.234047+0000","last_unstale":"2024-03-30T13:10:47.246287+0000","last_undegraded":"2024-03-30T13:10:47.246287+0000","last_fullsized":"2024-03-30T13:10:47.246287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991724+0000","last_change":"2024-03-30T13:10:46.243204+0000","last_active":"2024-03-30T13:10:47.991724+0000","last_peered":"2024-03-30T13:10:47.991724+0000","last_clean":"2024-03-30T13:10:47.991724+0000","last_became_active":"2024-03-30T13:10:46.242897+0000","last_became_peered":"2024-03-30T13:10:46.242897+0000","last_unstale":"2024-03-30T13:10:47.991724+0000","last_undegraded":"2024-03-30T13:10:47.991724+0000","last_fullsized":"2024-03-30T13:10:47.991724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:50.453642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245509+0000","last_change":"2024-03-30T13:10:46.244716+0000","last_active":"2024-03-30T13:10:47.245509+0000","last_peered":"2024-03-30T13:10:47.245509+0000","last_clean":"2024-03-30T13:10:47.245509+0000","last_became_active":"2024-03-30T13:10:46.244353+0000","last_became_peered":"2024-03-30T13:10:46.244353+0000","last_unstale":"2024-03-30T13:10:47.245509+0000","last_undegraded":"2024-03-30T13:10:47.245509+0000","last_fullsized":"2024-03-30T13:10:47.245509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280766+0000","last_change":"2024-03-30T13:10:46.255145+0000","last_active":"2024-03-30T13:10:48.280766+0000","last_peered":"2024-03-30T13:10:48.280766+0000","last_clean":"2024-03-30T13:10:48.280766+0000","last_became_active":"2024-03-30T13:10:46.254848+0000","last_became_peered":"2024-03-30T13:10:46.254848+0000","last_unstale":"2024-03-30T13:10:48.280766+0000","last_undegraded":"2024-03-30T13:10:48.280766+0000","last_fullsized":"2024-03-30T13:10:48.280766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243525+0000","last_change":"2024-03-30T13:10:46.249338+0000","last_active":"2024-03-30T13:10:47.243525+0000","last_peered":"2024-03-30T13:10:47.243525+0000","last_clean":"2024-03-30T13:10:47.243525+0000","last_became_active":"2024-03-30T13:10:46.248206+0000","last_became_peered":"2024-03-30T13:10:46.248206+0000","last_unstale":"2024-03-30T13:10:47.243525+0000","last_undegraded":"2024-03-30T13:10:47.243525+0000","last_fullsized":"2024-03-30T13:10:47.243525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:38.672797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245949+0000","last_change":"2024-03-30T13:10:46.236494+0000","last_active":"2024-03-30T13:10:47.245949+0000","last_peered":"2024-03-30T13:10:47.245949+0000","last_clean":"2024-03-30T13:10:47.245949+0000","last_became_active":"2024-03-30T13:10:46.236199+0000","last_became_peered":"2024-03-30T13:10:46.236199+0000","last_unstale":"2024-03-30T13:10:47.245949+0000","last_undegraded":"2024-03-30T13:10:47.245949+0000","last_fullsized":"2024-03-30T13:10:47.245949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245994+0000","last_change":"2024-03-30T13:10:46.245545+0000","last_active":"2024-03-30T13:10:47.245994+0000","last_peered":"2024-03-30T13:10:47.245994+0000","last_clean":"2024-03-30T13:10:47.245994+0000","last_became_active":"2024-03-30T13:10:46.245286+0000","last_became_peered":"2024-03-30T13:10:46.245286+0000","last_unstale":"2024-03-30T13:10:47.245994+0000","last_undegraded":"2024-03-30T13:10:47.245994+0000","last_fullsized":"2024-03-30T13:10:47.245994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245950+0000","last_change":"2024-03-30T13:10:46.256061+0000","last_active":"2024-03-30T13:10:47.245950+0000","last_peered":"2024-03-30T13:10:47.245950+0000","last_clean":"2024-03-30T13:10:47.245950+0000","last_became_active":"2024-03-30T13:10:46.252144+0000","last_became_peered":"2024-03-30T13:10:46.252144+0000","last_unstale":"2024-03-30T13:10:47.245950+0000","last_undegraded":"2024-03-30T13:10:47.245950+0000","last_fullsized":"2024-03-30T13:10:47.245950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248585+0000","last_change":"2024-03-30T13:10:46.240158+0000","last_active":"2024-03-30T13:10:47.248585+0000","last_peered":"2024-03-30T13:10:47.248585+0000","last_clean":"2024-03-30T13:10:47.248585+0000","last_became_active":"2024-03-30T13:10:46.235455+0000","last_became_peered":"2024-03-30T13:10:46.235455+0000","last_unstale":"2024-03-30T13:10:47.248585+0000","last_undegraded":"2024-03-30T13:10:47.248585+0000","last_fullsized":"2024-03-30T13:10:47.248585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:00.666500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248107+0000","last_change":"2024-03-30T13:10:46.243687+0000","last_active":"2024-03-30T13:10:47.248107+0000","last_peered":"2024-03-30T13:10:47.248107+0000","last_clean":"2024-03-30T13:10:47.248107+0000","last_became_active":"2024-03-30T13:10:46.243389+0000","last_became_peered":"2024-03-30T13:10:46.243389+0000","last_unstale":"2024-03-30T13:10:47.248107+0000","last_undegraded":"2024-03-30T13:10:47.248107+0000","last_fullsized":"2024-03-30T13:10:47.248107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280718+0000","last_change":"2024-03-30T13:10:46.256471+0000","last_active":"2024-03-30T13:10:48.280718+0000","last_peered":"2024-03-30T13:10:48.280718+0000","last_clean":"2024-03-30T13:10:48.280718+0000","last_became_active":"2024-03-30T13:10:46.256215+0000","last_became_peered":"2024-03-30T13:10:46.256215+0000","last_unstale":"2024-03-30T13:10:48.280718+0000","last_undegraded":"2024-03-30T13:10:48.280718+0000","last_fullsized":"2024-03-30T13:10:48.280718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278522+0000","last_change":"2024-03-30T13:10:46.233516+0000","last_active":"2024-03-30T13:10:48.278522+0000","last_peered":"2024-03-30T13:10:48.278522+0000","last_clean":"2024-03-30T13:10:48.278522+0000","last_became_active":"2024-03-30T13:10:46.233168+0000","last_became_peered":"2024-03-30T13:10:46.233168+0000","last_unstale":"2024-03-30T13:10:48.278522+0000","last_undegraded":"2024-03-30T13:10:48.278522+0000","last_fullsized":"2024-03-30T13:10:48.278522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:13.303492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280093+0000","last_change":"2024-03-30T13:10:46.260609+0000","last_active":"2024-03-30T13:10:48.280093+0000","last_peered":"2024-03-30T13:10:48.280093+0000","last_clean":"2024-03-30T13:10:48.280093+0000","last_became_active":"2024-03-30T13:10:46.257204+0000","last_became_peered":"2024-03-30T13:10:46.257204+0000","last_unstale":"2024-03-30T13:10:48.280093+0000","last_undegraded":"2024-03-30T13:10:48.280093+0000","last_fullsized":"2024-03-30T13:10:48.280093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:33:04.251828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281932+0000","last_change":"2024-03-30T13:10:46.253562+0000","last_active":"2024-03-30T13:10:48.281932+0000","last_peered":"2024-03-30T13:10:48.281932+0000","last_clean":"2024-03-30T13:10:48.281932+0000","last_became_active":"2024-03-30T13:10:46.253288+0000","last_became_peered":"2024-03-30T13:10:46.253288+0000","last_unstale":"2024-03-30T13:10:48.281932+0000","last_undegraded":"2024-03-30T13:10:48.281932+0000","last_fullsized":"2024-03-30T13:10:48.281932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:12:43.810698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279336+0000","last_change":"2024-03-30T13:10:46.244101+0000","last_active":"2024-03-30T13:10:48.279336+0000","last_peered":"2024-03-30T13:10:48.279336+0000","last_clean":"2024-03-30T13:10:48.279336+0000","last_became_active":"2024-03-30T13:10:46.241383+0000","last_became_peered":"2024-03-30T13:10:46.241383+0000","last_unstale":"2024-03-30T13:10:48.279336+0000","last_undegraded":"2024-03-30T13:10:48.279336+0000","last_fullsized":"2024-03-30T13:10:48.279336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:09.717253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246132+0000","last_change":"2024-03-30T13:10:46.258488+0000","last_active":"2024-03-30T13:10:47.246132+0000","last_peered":"2024-03-30T13:10:47.246132+0000","last_clean":"2024-03-30T13:10:47.246132+0000","last_became_active":"2024-03-30T13:10:46.251558+0000","last_became_peered":"2024-03-30T13:10:46.251558+0000","last_unstale":"2024-03-30T13:10:47.246132+0000","last_undegraded":"2024-03-30T13:10:47.246132+0000","last_fullsized":"2024-03-30T13:10:47.246132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250207+0000","last_change":"2024-03-30T13:10:46.243487+0000","last_active":"2024-03-30T13:10:47.250207+0000","last_peered":"2024-03-30T13:10:47.250207+0000","last_clean":"2024-03-30T13:10:47.250207+0000","last_became_active":"2024-03-30T13:10:46.243102+0000","last_became_peered":"2024-03-30T13:10:46.243102+0000","last_unstale":"2024-03-30T13:10:47.250207+0000","last_undegraded":"2024-03-30T13:10:47.250207+0000","last_fullsized":"2024-03-30T13:10:47.250207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243005+0000","last_change":"2024-03-30T13:10:46.262008+0000","last_active":"2024-03-30T13:10:47.243005+0000","last_peered":"2024-03-30T13:10:47.243005+0000","last_clean":"2024-03-30T13:10:47.243005+0000","last_became_active":"2024-03-30T13:10:46.259954+0000","last_became_peered":"2024-03-30T13:10:46.259954+0000","last_unstale":"2024-03-30T13:10:47.243005+0000","last_undegraded":"2024-03-30T13:10:47.243005+0000","last_fullsized":"2024-03-30T13:10:47.243005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:50.453642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280858+0000","last_change":"2024-03-30T13:10:46.247945+0000","last_active":"2024-03-30T13:10:48.280858+0000","last_peered":"2024-03-30T13:10:48.280858+0000","last_clean":"2024-03-30T13:10:48.280858+0000","last_became_active":"2024-03-30T13:10:46.247685+0000","last_became_peered":"2024-03-30T13:10:46.247685+0000","last_unstale":"2024-03-30T13:10:48.280858+0000","last_undegraded":"2024-03-30T13:10:48.280858+0000","last_fullsized":"2024-03-30T13:10:48.280858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278783+0000","last_change":"2024-03-30T13:10:46.238738+0000","last_active":"2024-03-30T13:10:48.278783+0000","last_peered":"2024-03-30T13:10:48.278783+0000","last_clean":"2024-03-30T13:10:48.278783+0000","last_became_active":"2024-03-30T13:10:46.238383+0000","last_became_peered":"2024-03-30T13:10:46.238383+0000","last_unstale":"2024-03-30T13:10:48.278783+0000","last_undegraded":"2024-03-30T13:10:48.278783+0000","last_fullsized":"2024-03-30T13:10:48.278783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:43:03.365657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282406+0000","last_change":"2024-03-30T13:10:46.249445+0000","last_active":"2024-03-30T13:10:48.282406+0000","last_peered":"2024-03-30T13:10:48.282406+0000","last_clean":"2024-03-30T13:10:48.282406+0000","last_became_active":"2024-03-30T13:10:46.249008+0000","last_became_peered":"2024-03-30T13:10:46.249008+0000","last_unstale":"2024-03-30T13:10:48.282406+0000","last_undegraded":"2024-03-30T13:10:48.282406+0000","last_fullsized":"2024-03-30T13:10:48.282406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992191+0000","last_change":"2024-03-30T13:10:46.247610+0000","last_active":"2024-03-30T13:10:47.992191+0000","last_peered":"2024-03-30T13:10:47.992191+0000","last_clean":"2024-03-30T13:10:47.992191+0000","last_became_active":"2024-03-30T13:10:46.247333+0000","last_became_peered":"2024-03-30T13:10:46.247333+0000","last_unstale":"2024-03-30T13:10:47.992191+0000","last_undegraded":"2024-03-30T13:10:47.992191+0000","last_fullsized":"2024-03-30T13:10:47.992191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248607+0000","last_change":"2024-03-30T13:10:46.243725+0000","last_active":"2024-03-30T13:10:47.248607+0000","last_peered":"2024-03-30T13:10:47.248607+0000","last_clean":"2024-03-30T13:10:47.248607+0000","last_became_active":"2024-03-30T13:10:46.243423+0000","last_became_peered":"2024-03-30T13:10:46.243423+0000","last_unstale":"2024-03-30T13:10:47.248607+0000","last_undegraded":"2024-03-30T13:10:47.248607+0000","last_fullsized":"2024-03-30T13:10:47.248607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248584+0000","last_change":"2024-03-30T13:10:46.254386+0000","last_active":"2024-03-30T13:10:47.248584+0000","last_peered":"2024-03-30T13:10:47.248584+0000","last_clean":"2024-03-30T13:10:47.248584+0000","last_became_active":"2024-03-30T13:10:46.254081+0000","last_became_peered":"2024-03-30T13:10:46.254081+0000","last_unstale":"2024-03-30T13:10:47.248584+0000","last_undegraded":"2024-03-30T13:10:47.248584+0000","last_fullsized":"2024-03-30T13:10:47.248584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281880+0000","last_change":"2024-03-30T13:10:46.246367+0000","last_active":"2024-03-30T13:10:48.281880+0000","last_peered":"2024-03-30T13:10:48.281880+0000","last_clean":"2024-03-30T13:10:48.281880+0000","last_became_active":"2024-03-30T13:10:46.246066+0000","last_became_peered":"2024-03-30T13:10:46.246066+0000","last_unstale":"2024-03-30T13:10:48.281880+0000","last_undegraded":"2024-03-30T13:10:48.281880+0000","last_fullsized":"2024-03-30T13:10:48.281880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278521+0000","last_change":"2024-03-30T13:10:46.234128+0000","last_active":"2024-03-30T13:10:48.278521+0000","last_peered":"2024-03-30T13:10:48.278521+0000","last_clean":"2024-03-30T13:10:48.278521+0000","last_became_active":"2024-03-30T13:10:46.233731+0000","last_became_peered":"2024-03-30T13:10:46.233731+0000","last_unstale":"2024-03-30T13:10:48.278521+0000","last_undegraded":"2024-03-30T13:10:48.278521+0000","last_fullsized":"2024-03-30T13:10:48.278521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281367+0000","last_change":"2024-03-30T13:10:46.247881+0000","last_active":"2024-03-30T13:10:48.281367+0000","last_peered":"2024-03-30T13:10:48.281367+0000","last_clean":"2024-03-30T13:10:48.281367+0000","last_became_active":"2024-03-30T13:10:46.247618+0000","last_became_peered":"2024-03-30T13:10:46.247618+0000","last_unstale":"2024-03-30T13:10:48.281367+0000","last_undegraded":"2024-03-30T13:10:48.281367+0000","last_fullsized":"2024-03-30T13:10:48.281367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:40:00.406615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991337+0000","last_change":"2024-03-30T13:10:46.253544+0000","last_active":"2024-03-30T13:10:47.991337+0000","last_peered":"2024-03-30T13:10:47.991337+0000","last_clean":"2024-03-30T13:10:47.991337+0000","last_became_active":"2024-03-30T13:10:46.253034+0000","last_became_peered":"2024-03-30T13:10:46.253034+0000","last_unstale":"2024-03-30T13:10:47.991337+0000","last_undegraded":"2024-03-30T13:10:47.991337+0000","last_fullsized":"2024-03-30T13:10:47.991337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:58.607723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243141+0000","last_change":"2024-03-30T13:10:46.237581+0000","last_active":"2024-03-30T13:10:47.243141+0000","last_peered":"2024-03-30T13:10:47.243141+0000","last_clean":"2024-03-30T13:10:47.243141+0000","last_became_active":"2024-03-30T13:10:46.237307+0000","last_became_peered":"2024-03-30T13:10:46.237307+0000","last_unstale":"2024-03-30T13:10:47.243141+0000","last_undegraded":"2024-03-30T13:10:47.243141+0000","last_fullsized":"2024-03-30T13:10:47.243141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:19.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282213+0000","last_change":"2024-03-30T13:10:45.225591+0000","last_active":"2024-03-30T13:10:48.282213+0000","last_peered":"2024-03-30T13:10:48.282213+0000","last_clean":"2024-03-30T13:10:48.282213+0000","last_became_active":"2024-03-30T13:10:45.224943+0000","last_became_peered":"2024-03-30T13:10:45.224943+0000","last_unstale":"2024-03-30T13:10:48.282213+0000","last_undegraded":"2024-03-30T13:10:48.282213+0000","last_fullsized":"2024-03-30T13:10:48.282213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250237+0000","last_change":"2024-03-30T13:10:46.260952+0000","last_active":"2024-03-30T13:10:47.250237+0000","last_peered":"2024-03-30T13:10:47.250237+0000","last_clean":"2024-03-30T13:10:47.250237+0000","last_became_active":"2024-03-30T13:10:46.260001+0000","last_became_peered":"2024-03-30T13:10:46.260001+0000","last_unstale":"2024-03-30T13:10:47.250237+0000","last_undegraded":"2024-03-30T13:10:47.250237+0000","last_fullsized":"2024-03-30T13:10:47.250237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278771+0000","last_change":"2024-03-30T13:10:45.220120+0000","last_active":"2024-03-30T13:10:48.278771+0000","last_peered":"2024-03-30T13:10:48.278771+0000","last_clean":"2024-03-30T13:10:48.278771+0000","last_became_active":"2024-03-30T13:10:45.218922+0000","last_became_peered":"2024-03-30T13:10:45.218922+0000","last_unstale":"2024-03-30T13:10:48.278771+0000","last_undegraded":"2024-03-30T13:10:48.278771+0000","last_fullsized":"2024-03-30T13:10:48.278771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:18.840387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247862+0000","last_change":"2024-03-30T13:10:45.211201+0000","last_active":"2024-03-30T13:10:47.247862+0000","last_peered":"2024-03-30T13:10:47.247862+0000","last_clean":"2024-03-30T13:10:47.247862+0000","last_became_active":"2024-03-30T13:10:45.210742+0000","last_became_peered":"2024-03-30T13:10:45.210742+0000","last_unstale":"2024-03-30T13:10:47.247862+0000","last_undegraded":"2024-03-30T13:10:47.247862+0000","last_fullsized":"2024-03-30T13:10:47.247862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281386+0000","last_change":"2024-03-30T13:10:46.236372+0000","last_active":"2024-03-30T13:10:48.281386+0000","last_peered":"2024-03-30T13:10:48.281386+0000","last_clean":"2024-03-30T13:10:48.281386+0000","last_became_active":"2024-03-30T13:10:46.236108+0000","last_became_peered":"2024-03-30T13:10:46.236108+0000","last_unstale":"2024-03-30T13:10:48.281386+0000","last_undegraded":"2024-03-30T13:10:48.281386+0000","last_fullsized":"2024-03-30T13:10:48.281386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278586+0000","last_change":"2024-03-30T13:10:45.217654+0000","last_active":"2024-03-30T13:10:48.278586+0000","last_peered":"2024-03-30T13:10:48.278586+0000","last_clean":"2024-03-30T13:10:48.278586+0000","last_became_active":"2024-03-30T13:10:45.217372+0000","last_became_peered":"2024-03-30T13:10:45.217372+0000","last_unstale":"2024-03-30T13:10:48.278586+0000","last_undegraded":"2024-03-30T13:10:48.278586+0000","last_fullsized":"2024-03-30T13:10:48.278586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:57.594719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249908+0000","last_change":"2024-03-30T13:10:46.247867+0000","last_active":"2024-03-30T13:10:47.249908+0000","last_peered":"2024-03-30T13:10:47.249908+0000","last_clean":"2024-03-30T13:10:47.249908+0000","last_became_active":"2024-03-30T13:10:46.246955+0000","last_became_peered":"2024-03-30T13:10:46.246955+0000","last_unstale":"2024-03-30T13:10:47.249908+0000","last_undegraded":"2024-03-30T13:10:47.249908+0000","last_fullsized":"2024-03-30T13:10:47.249908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243434+0000","last_change":"2024-03-30T13:10:45.226750+0000","last_active":"2024-03-30T13:10:47.243434+0000","last_peered":"2024-03-30T13:10:47.243434+0000","last_clean":"2024-03-30T13:10:47.243434+0000","last_became_active":"2024-03-30T13:10:45.226384+0000","last_became_peered":"2024-03-30T13:10:45.226384+0000","last_unstale":"2024-03-30T13:10:47.243434+0000","last_undegraded":"2024-03-30T13:10:47.243434+0000","last_fullsized":"2024-03-30T13:10:47.243434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:34:23.517546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992111+0000","last_change":"2024-03-30T13:10:46.246063+0000","last_active":"2024-03-30T13:10:47.992111+0000","last_peered":"2024-03-30T13:10:47.992111+0000","last_clean":"2024-03-30T13:10:47.992111+0000","last_became_active":"2024-03-30T13:10:46.245539+0000","last_became_peered":"2024-03-30T13:10:46.245539+0000","last_unstale":"2024-03-30T13:10:47.992111+0000","last_undegraded":"2024-03-30T13:10:47.992111+0000","last_fullsized":"2024-03-30T13:10:47.992111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246015+0000","last_change":"2024-03-30T13:10:45.205745+0000","last_active":"2024-03-30T13:10:47.246015+0000","last_peered":"2024-03-30T13:10:47.246015+0000","last_clean":"2024-03-30T13:10:47.246015+0000","last_became_active":"2024-03-30T13:10:45.204814+0000","last_became_peered":"2024-03-30T13:10:45.204814+0000","last_unstale":"2024-03-30T13:10:47.246015+0000","last_undegraded":"2024-03-30T13:10:47.246015+0000","last_fullsized":"2024-03-30T13:10:47.246015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282464+0000","last_change":"2024-03-30T13:10:46.241152+0000","last_active":"2024-03-30T13:10:48.282464+0000","last_peered":"2024-03-30T13:10:48.282464+0000","last_clean":"2024-03-30T13:10:48.282464+0000","last_became_active":"2024-03-30T13:10:46.240813+0000","last_became_peered":"2024-03-30T13:10:46.240813+0000","last_unstale":"2024-03-30T13:10:48.282464+0000","last_undegraded":"2024-03-30T13:10:48.282464+0000","last_fullsized":"2024-03-30T13:10:48.282464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281737+0000","last_change":"2024-03-30T13:10:45.227319+0000","last_active":"2024-03-30T13:10:48.281737+0000","last_peered":"2024-03-30T13:10:48.281737+0000","last_clean":"2024-03-30T13:10:48.281737+0000","last_became_active":"2024-03-30T13:10:45.226913+0000","last_became_peered":"2024-03-30T13:10:45.226913+0000","last_unstale":"2024-03-30T13:10:48.281737+0000","last_undegraded":"2024-03-30T13:10:48.281737+0000","last_fullsized":"2024-03-30T13:10:48.281737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:22.060387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278632+0000","last_change":"2024-03-30T13:10:46.243390+0000","last_active":"2024-03-30T13:10:48.278632+0000","last_peered":"2024-03-30T13:10:48.278632+0000","last_clean":"2024-03-30T13:10:48.278632+0000","last_became_active":"2024-03-30T13:10:46.242925+0000","last_became_peered":"2024-03-30T13:10:46.242925+0000","last_unstale":"2024-03-30T13:10:48.278632+0000","last_undegraded":"2024-03-30T13:10:48.278632+0000","last_fullsized":"2024-03-30T13:10:48.278632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:42.999062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991874+0000","last_change":"2024-03-30T13:10:45.222454+0000","last_active":"2024-03-30T13:10:47.991874+0000","last_peered":"2024-03-30T13:10:47.991874+0000","last_clean":"2024-03-30T13:10:47.991874+0000","last_became_active":"2024-03-30T13:10:45.222143+0000","last_became_peered":"2024-03-30T13:10:45.222143+0000","last_unstale":"2024-03-30T13:10:47.991874+0000","last_undegraded":"2024-03-30T13:10:47.991874+0000","last_fullsized":"2024-03-30T13:10:47.991874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:19.786645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246001+0000","last_change":"2024-03-30T13:10:46.240683+0000","last_active":"2024-03-30T13:10:47.246001+0000","last_peered":"2024-03-30T13:10:47.246001+0000","last_clean":"2024-03-30T13:10:47.246001+0000","last_became_active":"2024-03-30T13:10:46.240375+0000","last_became_peered":"2024-03-30T13:10:46.240375+0000","last_unstale":"2024-03-30T13:10:47.246001+0000","last_undegraded":"2024-03-30T13:10:47.246001+0000","last_fullsized":"2024-03-30T13:10:47.246001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282527+0000","last_change":"2024-03-30T13:10:45.222380+0000","last_active":"2024-03-30T13:10:48.282527+0000","last_peered":"2024-03-30T13:10:48.282527+0000","last_clean":"2024-03-30T13:10:48.282527+0000","last_became_active":"2024-03-30T13:10:45.221975+0000","last_became_peered":"2024-03-30T13:10:45.221975+0000","last_unstale":"2024-03-30T13:10:48.282527+0000","last_undegraded":"2024-03-30T13:10:48.282527+0000","last_fullsized":"2024-03-30T13:10:48.282527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:26:59.790496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248472+0000","last_change":"2024-03-30T13:10:46.232634+0000","last_active":"2024-03-30T13:10:47.248472+0000","last_peered":"2024-03-30T13:10:47.248472+0000","last_clean":"2024-03-30T13:10:47.248472+0000","last_became_active":"2024-03-30T13:10:46.232300+0000","last_became_peered":"2024-03-30T13:10:46.232300+0000","last_unstale":"2024-03-30T13:10:47.248472+0000","last_undegraded":"2024-03-30T13:10:47.248472+0000","last_fullsized":"2024-03-30T13:10:47.248472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278970+0000","last_change":"2024-03-30T13:10:45.218507+0000","last_active":"2024-03-30T13:10:48.278970+0000","last_peered":"2024-03-30T13:10:48.278970+0000","last_clean":"2024-03-30T13:10:48.278970+0000","last_became_active":"2024-03-30T13:10:45.218111+0000","last_became_peered":"2024-03-30T13:10:45.218111+0000","last_unstale":"2024-03-30T13:10:48.278970+0000","last_undegraded":"2024-03-30T13:10:48.278970+0000","last_fullsized":"2024-03-30T13:10:48.278970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:59.653496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278733+0000","last_change":"2024-03-30T13:10:46.239582+0000","last_active":"2024-03-30T13:10:48.278733+0000","last_peered":"2024-03-30T13:10:48.278733+0000","last_clean":"2024-03-30T13:10:48.278733+0000","last_became_active":"2024-03-30T13:10:46.237808+0000","last_became_peered":"2024-03-30T13:10:46.237808+0000","last_unstale":"2024-03-30T13:10:48.278733+0000","last_undegraded":"2024-03-30T13:10:48.278733+0000","last_fullsized":"2024-03-30T13:10:48.278733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:58.426124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245598+0000","last_change":"2024-03-30T13:10:45.210052+0000","last_active":"2024-03-30T13:10:47.245598+0000","last_peered":"2024-03-30T13:10:47.245598+0000","last_clean":"2024-03-30T13:10:47.245598+0000","last_became_active":"2024-03-30T13:10:45.205338+0000","last_became_peered":"2024-03-30T13:10:45.205338+0000","last_unstale":"2024-03-30T13:10:47.245598+0000","last_undegraded":"2024-03-30T13:10:47.245598+0000","last_fullsized":"2024-03-30T13:10:47.245598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:57.594719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242878+0000","last_change":"2024-03-30T13:10:46.247309+0000","last_active":"2024-03-30T13:10:47.242878+0000","last_peered":"2024-03-30T13:10:47.242878+0000","last_clean":"2024-03-30T13:10:47.242878+0000","last_became_active":"2024-03-30T13:10:46.243301+0000","last_became_peered":"2024-03-30T13:10:46.243301+0000","last_unstale":"2024-03-30T13:10:47.242878+0000","last_undegraded":"2024-03-30T13:10:47.242878+0000","last_fullsized":"2024-03-30T13:10:47.242878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:56.949656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249704+0000","last_change":"2024-03-30T13:10:45.221532+0000","last_active":"2024-03-30T13:10:47.249704+0000","last_peered":"2024-03-30T13:10:47.249704+0000","last_clean":"2024-03-30T13:10:47.249704+0000","last_became_active":"2024-03-30T13:10:45.220536+0000","last_became_peered":"2024-03-30T13:10:45.220536+0000","last_unstale":"2024-03-30T13:10:47.249704+0000","last_undegraded":"2024-03-30T13:10:47.249704+0000","last_fullsized":"2024-03-30T13:10:47.249704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279358+0000","last_change":"2024-03-30T13:10:46.242980+0000","last_active":"2024-03-30T13:10:48.279358+0000","last_peered":"2024-03-30T13:10:48.279358+0000","last_clean":"2024-03-30T13:10:48.279358+0000","last_became_active":"2024-03-30T13:10:46.242702+0000","last_became_peered":"2024-03-30T13:10:46.242702+0000","last_unstale":"2024-03-30T13:10:48.279358+0000","last_undegraded":"2024-03-30T13:10:48.279358+0000","last_fullsized":"2024-03-30T13:10:48.279358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:42:22.008993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246344+0000","last_change":"2024-03-30T13:10:45.223223+0000","last_active":"2024-03-30T13:10:47.246344+0000","last_peered":"2024-03-30T13:10:47.246344+0000","last_clean":"2024-03-30T13:10:47.246344+0000","last_became_active":"2024-03-30T13:10:45.222887+0000","last_became_peered":"2024-03-30T13:10:45.222887+0000","last_unstale":"2024-03-30T13:10:47.246344+0000","last_undegraded":"2024-03-30T13:10:47.246344+0000","last_fullsized":"2024-03-30T13:10:47.246344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992357+0000","last_change":"2024-03-30T13:10:46.254732+0000","last_active":"2024-03-30T13:10:47.992357+0000","last_peered":"2024-03-30T13:10:47.992357+0000","last_clean":"2024-03-30T13:10:47.992357+0000","last_became_active":"2024-03-30T13:10:46.254356+0000","last_became_peered":"2024-03-30T13:10:46.254356+0000","last_unstale":"2024-03-30T13:10:47.992357+0000","last_undegraded":"2024-03-30T13:10:47.992357+0000","last_fullsized":"2024-03-30T13:10:47.992357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250809+0000","last_change":"2024-03-30T13:10:45.224819+0000","last_active":"2024-03-30T13:10:47.250809+0000","last_peered":"2024-03-30T13:10:47.250809+0000","last_clean":"2024-03-30T13:10:47.250809+0000","last_became_active":"2024-03-30T13:10:45.223270+0000","last_became_peered":"2024-03-30T13:10:45.223270+0000","last_unstale":"2024-03-30T13:10:47.250809+0000","last_undegraded":"2024-03-30T13:10:47.250809+0000","last_fullsized":"2024-03-30T13:10:47.250809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246314+0000","last_change":"2024-03-30T13:10:46.254500+0000","last_active":"2024-03-30T13:10:47.246314+0000","last_peered":"2024-03-30T13:10:47.246314+0000","last_clean":"2024-03-30T13:10:47.246314+0000","last_became_active":"2024-03-30T13:10:46.254208+0000","last_became_peered":"2024-03-30T13:10:46.254208+0000","last_unstale":"2024-03-30T13:10:47.246314+0000","last_undegraded":"2024-03-30T13:10:47.246314+0000","last_fullsized":"2024-03-30T13:10:47.246314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:42.999062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282278+0000","last_change":"2024-03-30T13:10:45.225766+0000","last_active":"2024-03-30T13:10:48.282278+0000","last_peered":"2024-03-30T13:10:48.282278+0000","last_clean":"2024-03-30T13:10:48.282278+0000","last_became_active":"2024-03-30T13:10:45.225096+0000","last_became_peered":"2024-03-30T13:10:45.225096+0000","last_unstale":"2024-03-30T13:10:48.282278+0000","last_undegraded":"2024-03-30T13:10:48.282278+0000","last_fullsized":"2024-03-30T13:10:48.282278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246156+0000","last_change":"2024-03-30T13:10:46.255837+0000","last_active":"2024-03-30T13:10:47.246156+0000","last_peered":"2024-03-30T13:10:47.246156+0000","last_clean":"2024-03-30T13:10:47.246156+0000","last_became_active":"2024-03-30T13:10:46.251826+0000","last_became_peered":"2024-03-30T13:10:46.251826+0000","last_unstale":"2024-03-30T13:10:47.246156+0000","last_undegraded":"2024-03-30T13:10:47.246156+0000","last_fullsized":"2024-03-30T13:10:47.246156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248851+0000","last_change":"2024-03-30T13:10:45.210147+0000","last_active":"2024-03-30T13:10:47.248851+0000","last_peered":"2024-03-30T13:10:47.248851+0000","last_clean":"2024-03-30T13:10:47.248851+0000","last_became_active":"2024-03-30T13:10:45.209716+0000","last_became_peered":"2024-03-30T13:10:45.209716+0000","last_unstale":"2024-03-30T13:10:47.248851+0000","last_undegraded":"2024-03-30T13:10:47.248851+0000","last_fullsized":"2024-03-30T13:10:47.248851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279114+0000","last_change":"2024-03-30T13:10:46.244995+0000","last_active":"2024-03-30T13:10:48.279114+0000","last_peered":"2024-03-30T13:10:48.279114+0000","last_clean":"2024-03-30T13:10:48.279114+0000","last_became_active":"2024-03-30T13:10:46.244716+0000","last_became_peered":"2024-03-30T13:10:46.244716+0000","last_unstale":"2024-03-30T13:10:48.279114+0000","last_undegraded":"2024-03-30T13:10:48.279114+0000","last_fullsized":"2024-03-30T13:10:48.279114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:56.283461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242840+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:10:47.242840+0000","last_peered":"2024-03-30T13:10:47.242840+0000","last_clean":"2024-03-30T13:10:47.242840+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:10:47.242840+0000","last_undegraded":"2024-03-30T13:10:47.242840+0000","last_fullsized":"2024-03-30T13:10:47.242840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278834+0000","last_change":"2024-03-30T13:10:45.216758+0000","last_active":"2024-03-30T13:10:48.278834+0000","last_peered":"2024-03-30T13:10:48.278834+0000","last_clean":"2024-03-30T13:10:48.278834+0000","last_became_active":"2024-03-30T13:10:45.215040+0000","last_became_peered":"2024-03-30T13:10:45.215040+0000","last_unstale":"2024-03-30T13:10:48.278834+0000","last_undegraded":"2024-03-30T13:10:48.278834+0000","last_fullsized":"2024-03-30T13:10:48.278834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.089085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249967+0000","last_change":"2024-03-30T13:10:46.243383+0000","last_active":"2024-03-30T13:10:47.249967+0000","last_peered":"2024-03-30T13:10:47.249967+0000","last_clean":"2024-03-30T13:10:47.249967+0000","last_became_active":"2024-03-30T13:10:46.243046+0000","last_became_peered":"2024-03-30T13:10:46.243046+0000","last_unstale":"2024-03-30T13:10:47.249967+0000","last_undegraded":"2024-03-30T13:10:47.249967+0000","last_fullsized":"2024-03-30T13:10:47.249967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278692+0000","last_change":"2024-03-30T13:10:45.221144+0000","last_active":"2024-03-30T13:10:48.278692+0000","last_peered":"2024-03-30T13:10:48.278692+0000","last_clean":"2024-03-30T13:10:48.278692+0000","last_became_active":"2024-03-30T13:10:45.219684+0000","last_became_peered":"2024-03-30T13:10:45.219684+0000","last_unstale":"2024-03-30T13:10:48.278692+0000","last_undegraded":"2024-03-30T13:10:48.278692+0000","last_fullsized":"2024-03-30T13:10:48.278692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:49.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247995+0000","last_change":"2024-03-30T13:10:46.239001+0000","last_active":"2024-03-30T13:10:47.247995+0000","last_peered":"2024-03-30T13:10:47.247995+0000","last_clean":"2024-03-30T13:10:47.247995+0000","last_became_active":"2024-03-30T13:10:46.238750+0000","last_became_peered":"2024-03-30T13:10:46.238750+0000","last_unstale":"2024-03-30T13:10:47.247995+0000","last_undegraded":"2024-03-30T13:10:47.247995+0000","last_fullsized":"2024-03-30T13:10:47.247995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281626+0000","last_change":"2024-03-30T13:10:45.223067+0000","last_active":"2024-03-30T13:10:48.281626+0000","last_peered":"2024-03-30T13:10:48.281626+0000","last_clean":"2024-03-30T13:10:48.281626+0000","last_became_active":"2024-03-30T13:10:45.222778+0000","last_became_peered":"2024-03-30T13:10:45.222778+0000","last_unstale":"2024-03-30T13:10:48.281626+0000","last_undegraded":"2024-03-30T13:10:48.281626+0000","last_fullsized":"2024-03-30T13:10:48.281626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:35:37.871387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280762+0000","last_change":"2024-03-30T13:10:46.246374+0000","last_active":"2024-03-30T13:10:48.280762+0000","last_peered":"2024-03-30T13:10:48.280762+0000","last_clean":"2024-03-30T13:10:48.280762+0000","last_became_active":"2024-03-30T13:10:46.246094+0000","last_became_peered":"2024-03-30T13:10:46.246094+0000","last_unstale":"2024-03-30T13:10:48.280762+0000","last_undegraded":"2024-03-30T13:10:48.280762+0000","last_fullsized":"2024-03-30T13:10:48.280762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279004+0000","last_change":"2024-03-30T13:10:45.220442+0000","last_active":"2024-03-30T13:10:48.279004+0000","last_peered":"2024-03-30T13:10:48.279004+0000","last_clean":"2024-03-30T13:10:48.279004+0000","last_became_active":"2024-03-30T13:10:45.219537+0000","last_became_peered":"2024-03-30T13:10:45.219537+0000","last_unstale":"2024-03-30T13:10:48.279004+0000","last_undegraded":"2024-03-30T13:10:48.279004+0000","last_fullsized":"2024-03-30T13:10:48.279004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:37.659793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246414+0000","last_change":"2024-03-30T13:10:46.249794+0000","last_active":"2024-03-30T13:10:47.246414+0000","last_peered":"2024-03-30T13:10:47.246414+0000","last_clean":"2024-03-30T13:10:47.246414+0000","last_became_active":"2024-03-30T13:10:46.249501+0000","last_became_peered":"2024-03-30T13:10:46.249501+0000","last_unstale":"2024-03-30T13:10:47.246414+0000","last_undegraded":"2024-03-30T13:10:47.246414+0000","last_fullsized":"2024-03-30T13:10:47.246414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:58.426124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281281+0000","last_change":"2024-03-30T13:10:45.225647+0000","last_active":"2024-03-30T13:10:48.281281+0000","last_peered":"2024-03-30T13:10:48.281281+0000","last_clean":"2024-03-30T13:10:48.281281+0000","last_became_active":"2024-03-30T13:10:45.225066+0000","last_became_peered":"2024-03-30T13:10:45.225066+0000","last_unstale":"2024-03-30T13:10:48.281281+0000","last_undegraded":"2024-03-30T13:10:48.281281+0000","last_fullsized":"2024-03-30T13:10:48.281281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991763+0000","last_change":"2024-03-30T13:10:46.234204+0000","last_active":"2024-03-30T13:10:47.991763+0000","last_peered":"2024-03-30T13:10:47.991763+0000","last_clean":"2024-03-30T13:10:47.991763+0000","last_became_active":"2024-03-30T13:10:46.233876+0000","last_became_peered":"2024-03-30T13:10:46.233876+0000","last_unstale":"2024-03-30T13:10:47.991763+0000","last_undegraded":"2024-03-30T13:10:47.991763+0000","last_fullsized":"2024-03-30T13:10:47.991763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:19.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279290+0000","last_change":"2024-03-30T13:10:45.219517+0000","last_active":"2024-03-30T13:10:48.279290+0000","last_peered":"2024-03-30T13:10:48.279290+0000","last_clean":"2024-03-30T13:10:48.279290+0000","last_became_active":"2024-03-30T13:10:45.219201+0000","last_became_peered":"2024-03-30T13:10:45.219201+0000","last_unstale":"2024-03-30T13:10:48.279290+0000","last_undegraded":"2024-03-30T13:10:48.279290+0000","last_fullsized":"2024-03-30T13:10:48.279290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:27.406147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248726+0000","last_change":"2024-03-30T13:10:46.234095+0000","last_active":"2024-03-30T13:10:47.248726+0000","last_peered":"2024-03-30T13:10:47.248726+0000","last_clean":"2024-03-30T13:10:47.248726+0000","last_became_active":"2024-03-30T13:10:46.233686+0000","last_became_peered":"2024-03-30T13:10:46.233686+0000","last_unstale":"2024-03-30T13:10:47.248726+0000","last_undegraded":"2024-03-30T13:10:47.248726+0000","last_fullsized":"2024-03-30T13:10:47.248726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.253768+0000","last_change":"2024-03-30T13:10:45.216838+0000","last_active":"2024-03-30T13:10:47.253768+0000","last_peered":"2024-03-30T13:10:47.253768+0000","last_clean":"2024-03-30T13:10:47.253768+0000","last_became_active":"2024-03-30T13:10:45.216528+0000","last_became_peered":"2024-03-30T13:10:45.216528+0000","last_unstale":"2024-03-30T13:10:47.253768+0000","last_undegraded":"2024-03-30T13:10:47.253768+0000","last_fullsized":"2024-03-30T13:10:47.253768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251100+0000","last_change":"2024-03-30T13:10:46.243883+0000","last_active":"2024-03-30T13:10:47.251100+0000","last_peered":"2024-03-30T13:10:47.251100+0000","last_clean":"2024-03-30T13:10:47.251100+0000","last_became_active":"2024-03-30T13:10:46.243583+0000","last_became_peered":"2024-03-30T13:10:46.243583+0000","last_unstale":"2024-03-30T13:10:47.251100+0000","last_undegraded":"2024-03-30T13:10:47.251100+0000","last_fullsized":"2024-03-30T13:10:47.251100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279909+0000","last_change":"2024-03-30T13:10:45.219656+0000","last_active":"2024-03-30T13:10:48.279909+0000","last_peered":"2024-03-30T13:10:48.279909+0000","last_clean":"2024-03-30T13:10:48.279909+0000","last_became_active":"2024-03-30T13:10:45.219347+0000","last_became_peered":"2024-03-30T13:10:45.219347+0000","last_unstale":"2024-03-30T13:10:48.279909+0000","last_undegraded":"2024-03-30T13:10:48.279909+0000","last_fullsized":"2024-03-30T13:10:48.279909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:37.075782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250903+0000","last_change":"2024-03-30T13:10:46.248800+0000","last_active":"2024-03-30T13:10:47.250903+0000","last_peered":"2024-03-30T13:10:47.250903+0000","last_clean":"2024-03-30T13:10:47.250903+0000","last_became_active":"2024-03-30T13:10:46.248344+0000","last_became_peered":"2024-03-30T13:10:46.248344+0000","last_unstale":"2024-03-30T13:10:47.250903+0000","last_undegraded":"2024-03-30T13:10:47.250903+0000","last_fullsized":"2024-03-30T13:10:47.250903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245338+0000","last_change":"2024-03-30T13:10:45.210402+0000","last_active":"2024-03-30T13:10:47.245338+0000","last_peered":"2024-03-30T13:10:47.245338+0000","last_clean":"2024-03-30T13:10:47.245338+0000","last_became_active":"2024-03-30T13:10:45.210107+0000","last_became_peered":"2024-03-30T13:10:45.210107+0000","last_unstale":"2024-03-30T13:10:47.245338+0000","last_undegraded":"2024-03-30T13:10:47.245338+0000","last_fullsized":"2024-03-30T13:10:47.245338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279223+0000","last_change":"2024-03-30T13:10:46.241705+0000","last_active":"2024-03-30T13:10:48.279223+0000","last_peered":"2024-03-30T13:10:48.279223+0000","last_clean":"2024-03-30T13:10:48.279223+0000","last_became_active":"2024-03-30T13:10:46.241327+0000","last_became_peered":"2024-03-30T13:10:46.241327+0000","last_unstale":"2024-03-30T13:10:48.279223+0000","last_undegraded":"2024-03-30T13:10:48.279223+0000","last_fullsized":"2024-03-30T13:10:48.279223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:05:58.972097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250156+0000","last_change":"2024-03-30T13:10:45.223756+0000","last_active":"2024-03-30T13:10:47.250156+0000","last_peered":"2024-03-30T13:10:47.250156+0000","last_clean":"2024-03-30T13:10:47.250156+0000","last_became_active":"2024-03-30T13:10:45.222236+0000","last_became_peered":"2024-03-30T13:10:45.222236+0000","last_unstale":"2024-03-30T13:10:47.250156+0000","last_undegraded":"2024-03-30T13:10:47.250156+0000","last_fullsized":"2024-03-30T13:10:47.250156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250500+0000","last_change":"2024-03-30T13:10:46.250939+0000","last_active":"2024-03-30T13:10:47.250500+0000","last_peered":"2024-03-30T13:10:47.250500+0000","last_clean":"2024-03-30T13:10:47.250500+0000","last_became_active":"2024-03-30T13:10:46.250651+0000","last_became_peered":"2024-03-30T13:10:46.250651+0000","last_unstale":"2024-03-30T13:10:47.250500+0000","last_undegraded":"2024-03-30T13:10:47.250500+0000","last_fullsized":"2024-03-30T13:10:47.250500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248428+0000","last_change":"2024-03-30T13:10:45.222799+0000","last_active":"2024-03-30T13:10:47.248428+0000","last_peered":"2024-03-30T13:10:47.248428+0000","last_clean":"2024-03-30T13:10:47.248428+0000","last_became_active":"2024-03-30T13:10:45.221899+0000","last_became_peered":"2024-03-30T13:10:45.221899+0000","last_unstale":"2024-03-30T13:10:47.248428+0000","last_undegraded":"2024-03-30T13:10:47.248428+0000","last_fullsized":"2024-03-30T13:10:47.248428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282295+0000","last_change":"2024-03-30T13:10:46.245047+0000","last_active":"2024-03-30T13:10:48.282295+0000","last_peered":"2024-03-30T13:10:48.282295+0000","last_clean":"2024-03-30T13:10:48.282295+0000","last_became_active":"2024-03-30T13:10:46.244170+0000","last_became_peered":"2024-03-30T13:10:46.244170+0000","last_unstale":"2024-03-30T13:10:48.282295+0000","last_undegraded":"2024-03-30T13:10:48.282295+0000","last_fullsized":"2024-03-30T13:10:48.282295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:53:32.633100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278786+0000","last_change":"2024-03-30T13:10:45.215312+0000","last_active":"2024-03-30T13:10:48.278786+0000","last_peered":"2024-03-30T13:10:48.278786+0000","last_clean":"2024-03-30T13:10:48.278786+0000","last_became_active":"2024-03-30T13:10:45.214701+0000","last_became_peered":"2024-03-30T13:10:45.214701+0000","last_unstale":"2024-03-30T13:10:48.278786+0000","last_undegraded":"2024-03-30T13:10:48.278786+0000","last_fullsized":"2024-03-30T13:10:48.278786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:16.903426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278902+0000","last_change":"2024-03-30T13:10:46.245626+0000","last_active":"2024-03-30T13:10:48.278902+0000","last_peered":"2024-03-30T13:10:48.278902+0000","last_clean":"2024-03-30T13:10:48.278902+0000","last_became_active":"2024-03-30T13:10:46.245360+0000","last_became_peered":"2024-03-30T13:10:46.245360+0000","last_unstale":"2024-03-30T13:10:48.278902+0000","last_undegraded":"2024-03-30T13:10:48.278902+0000","last_fullsized":"2024-03-30T13:10:48.278902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:55:33.498408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279107+0000","last_change":"2024-03-30T13:10:46.255467+0000","last_active":"2024-03-30T13:10:48.279107+0000","last_peered":"2024-03-30T13:10:48.279107+0000","last_clean":"2024-03-30T13:10:48.279107+0000","last_became_active":"2024-03-30T13:10:46.254974+0000","last_became_peered":"2024-03-30T13:10:46.254974+0000","last_unstale":"2024-03-30T13:10:48.279107+0000","last_undegraded":"2024-03-30T13:10:48.279107+0000","last_fullsized":"2024-03-30T13:10:48.279107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:52:10.233229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246199+0000","last_change":"2024-03-30T13:10:45.203155+0000","last_active":"2024-03-30T13:10:47.246199+0000","last_peered":"2024-03-30T13:10:47.246199+0000","last_clean":"2024-03-30T13:10:47.246199+0000","last_became_active":"2024-03-30T13:10:45.202582+0000","last_became_peered":"2024-03-30T13:10:45.202582+0000","last_unstale":"2024-03-30T13:10:47.246199+0000","last_undegraded":"2024-03-30T13:10:47.246199+0000","last_fullsized":"2024-03-30T13:10:47.246199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:49.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242997+0000","last_change":"2024-03-30T13:10:46.260566+0000","last_active":"2024-03-30T13:10:47.242997+0000","last_peered":"2024-03-30T13:10:47.242997+0000","last_clean":"2024-03-30T13:10:47.242997+0000","last_became_active":"2024-03-30T13:10:46.260117+0000","last_became_peered":"2024-03-30T13:10:46.260117+0000","last_unstale":"2024-03-30T13:10:47.242997+0000","last_undegraded":"2024-03-30T13:10:47.242997+0000","last_fullsized":"2024-03-30T13:10:47.242997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:58.607723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246060+0000","last_change":"2024-03-30T13:10:45.206209+0000","last_active":"2024-03-30T13:10:47.246060+0000","last_peered":"2024-03-30T13:10:47.246060+0000","last_clean":"2024-03-30T13:10:47.246060+0000","last_became_active":"2024-03-30T13:10:45.203095+0000","last_became_peered":"2024-03-30T13:10:45.203095+0000","last_unstale":"2024-03-30T13:10:47.246060+0000","last_undegraded":"2024-03-30T13:10:47.246060+0000","last_fullsized":"2024-03-30T13:10:47.246060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281962+0000","last_change":"2024-03-30T13:10:46.249303+0000","last_active":"2024-03-30T13:10:48.281962+0000","last_peered":"2024-03-30T13:10:48.281962+0000","last_clean":"2024-03-30T13:10:48.281962+0000","last_became_active":"2024-03-30T13:10:46.248971+0000","last_became_peered":"2024-03-30T13:10:46.248971+0000","last_unstale":"2024-03-30T13:10:48.281962+0000","last_undegraded":"2024-03-30T13:10:48.281962+0000","last_fullsized":"2024-03-30T13:10:48.281962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282831+0000","last_change":"2024-03-30T13:10:45.222811+0000","last_active":"2024-03-30T13:10:48.282831+0000","last_peered":"2024-03-30T13:10:48.282831+0000","last_clean":"2024-03-30T13:10:48.282831+0000","last_became_active":"2024-03-30T13:10:45.222439+0000","last_became_peered":"2024-03-30T13:10:45.222439+0000","last_unstale":"2024-03-30T13:10:48.282831+0000","last_undegraded":"2024-03-30T13:10:48.282831+0000","last_fullsized":"2024-03-30T13:10:48.282831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282474+0000","last_change":"2024-03-30T13:10:46.242067+0000","last_active":"2024-03-30T13:10:48.282474+0000","last_peered":"2024-03-30T13:10:48.282474+0000","last_clean":"2024-03-30T13:10:48.282474+0000","last_became_active":"2024-03-30T13:10:46.241783+0000","last_became_peered":"2024-03-30T13:10:46.241783+0000","last_unstale":"2024-03-30T13:10:48.282474+0000","last_undegraded":"2024-03-30T13:10:48.282474+0000","last_fullsized":"2024-03-30T13:10:48.282474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251193+0000","last_change":"2024-03-30T13:10:45.221172+0000","last_active":"2024-03-30T13:10:47.251193+0000","last_peered":"2024-03-30T13:10:47.251193+0000","last_clean":"2024-03-30T13:10:47.251193+0000","last_became_active":"2024-03-30T13:10:45.220799+0000","last_became_peered":"2024-03-30T13:10:45.220799+0000","last_unstale":"2024-03-30T13:10:47.251193+0000","last_undegraded":"2024-03-30T13:10:47.251193+0000","last_fullsized":"2024-03-30T13:10:47.251193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476742,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":665602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476741,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":77448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:10:56.535 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-30T13:10:56.535 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-30T13:10:56.535 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-30T13:10:56.535 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-30T13:10:56.536 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-30T13:10:56.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.767+0000 7fef72e00640 1 Processor -- start 2024-03-30T13:10:56.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.767+0000 7fef72e00640 1 -- start start 2024-03-30T13:10:56.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.769+0000 7fef72e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef6c09aa30 0x7fef6c09ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.769+0000 7fef72e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fef6c09b780 0x7fef6c1624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.769+0000 7fef72e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fef6c06c830 0x7fef6c1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.769+0000 7fef72e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fef6c09b350 con 0x7fef6c09b780 2024-03-30T13:10:56.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.769+0000 7fef72e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fef6c0b1780 con 0x7fef6c06c830 2024-03-30T13:10:56.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.769+0000 7fef72e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fef6c0b14a0 con 0x7fef6c09aa30 2024-03-30T13:10:56.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.769+0000 7fef6b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fef6c09b780 0x7fef6c1624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.769+0000 7fef6b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fef6c09b780 0x7fef6c1624b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38118/0 (socket says 172.21.15.99:38118) 2024-03-30T13:10:56.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.769+0000 7fef6b400640 1 -- 172.21.15.99:0/4203518034 learned_addr learned my addr 172.21.15.99:0/4203518034 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:56.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.769+0000 7fef6be00640 1 --2- 172.21.15.99:0/4203518034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef6c09aa30 0x7fef6c09ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.769+0000 7fef70e00640 1 --2- 172.21.15.99:0/4203518034 >> v2:172.21.15.181:3300/0 conn(0x7fef6c06c830 0x7fef6c1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.770+0000 7fef6b400640 1 -- 172.21.15.99:0/4203518034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef6c09aa30 msgr2=0x7fef6c09ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:56.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.770+0000 7fef6b400640 1 --2- 172.21.15.99:0/4203518034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef6c09aa30 0x7fef6c09ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.770+0000 7fef6b400640 1 -- 172.21.15.99:0/4203518034 >> v2:172.21.15.181:3300/0 conn(0x7fef6c06c830 msgr2=0x7fef6c1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:56.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.770+0000 7fef6b400640 1 --2- 172.21.15.99:0/4203518034 >> v2:172.21.15.181:3300/0 conn(0x7fef6c06c830 0x7fef6c1629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.770+0000 7fef6b400640 1 -- 172.21.15.99:0/4203518034 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6c15f050 con 0x7fef6c09b780 2024-03-30T13:10:56.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.771+0000 7fef6b400640 1 --2- 172.21.15.99:0/4203518034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef6c09b780 0x7fef6c1624b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fef6c073090 tx=0x7fef5802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eceba1630fcb5da server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:56.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.771+0000 7fef6aa00640 1 -- 172.21.15.99:0/4203518034 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58034070 con 0x7fef6c09b780 2024-03-30T13:10:56.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.771+0000 7fef6aa00640 1 -- 172.21.15.99:0/4203518034 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef58030860 con 0x7fef6c09b780 2024-03-30T13:10:56.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.771+0000 7fef6aa00640 1 -- 172.21.15.99:0/4203518034 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58030c30 con 0x7fef6c09b780 2024-03-30T13:10:56.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.772+0000 7fef72e00640 1 -- 172.21.15.99:0/4203518034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef6c09b780 msgr2=0x7fef6c1624b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:56.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.772+0000 7fef72e00640 1 --2- 172.21.15.99:0/4203518034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef6c09b780 0x7fef6c1624b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fef6c073090 tx=0x7fef5802b9a0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.772+0000 7fef72e00640 1 -- 172.21.15.99:0/4203518034 shutdown_connections 2024-03-30T13:10:56.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.772+0000 7fef72e00640 1 --2- 172.21.15.99:0/4203518034 >> v2:172.21.15.181:3300/0 conn(0x7fef6c06c830 0x7fef6c1629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.772+0000 7fef72e00640 1 --2- 172.21.15.99:0/4203518034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef6c09b780 0x7fef6c1624b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.772+0000 7fef72e00640 1 --2- 172.21.15.99:0/4203518034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef6c09aa30 0x7fef6c09ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.772+0000 7fef72e00640 1 -- 172.21.15.99:0/4203518034 >> 172.21.15.99:0/4203518034 conn(0x7fef6c0b3f50 msgr2=0x7fef6c0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:56.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.772+0000 7fef72e00640 1 -- 172.21.15.99:0/4203518034 shutdown_connections 2024-03-30T13:10:56.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.772+0000 7fef72e00640 1 -- 172.21.15.99:0/4203518034 wait complete. 2024-03-30T13:10:56.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.774+0000 7fef72e00640 1 Processor -- start 2024-03-30T13:10:56.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.774+0000 7fef72e00640 1 -- start start 2024-03-30T13:10:56.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.775+0000 7fef72e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef6c06c830 0x7fef6c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.775+0000 7fef72e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef6c09aa30 0x7fef6c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.775+0000 7fef72e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef6c09b780 0x7fef6c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.775+0000 7fef72e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c15f8f0 con 0x7fef6c09aa30 2024-03-30T13:10:56.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.775+0000 7fef72e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c15f610 con 0x7fef6c06c830 2024-03-30T13:10:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.775+0000 7fef72e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fef6c15fe10 con 0x7fef6c09b780 2024-03-30T13:10:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.775+0000 7fef6b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef6c09aa30 0x7fef6c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.775+0000 7fef6b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef6c09aa30 0x7fef6c0cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38122/0 (socket says 172.21.15.99:38122) 2024-03-30T13:10:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.775+0000 7fef6b400640 1 -- 172.21.15.99:0/2414361992 learned_addr learned my addr 172.21.15.99:0/2414361992 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef70e00640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef6c09b780 0x7fef6c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef6b400640 1 -- 172.21.15.99:0/2414361992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef6c09b780 msgr2=0x7fef6c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef6b400640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef6c09b780 0x7fef6c0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef6b400640 1 -- 172.21.15.99:0/2414361992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef6c06c830 msgr2=0x7fef6c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef6b400640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef6c06c830 0x7fef6c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef6b400640 1 -- 172.21.15.99:0/2414361992 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6c0cc050 con 0x7fef6c09aa30 2024-03-30T13:10:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef70e00640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef6c09b780 0x7fef6c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef6b400640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef6c09aa30 0x7fef6c0cdc10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fef58000c00 tx=0x7fef58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef63e00640 1 -- 172.21.15.99:0/2414361992 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58048070 con 0x7fef6c09aa30 2024-03-30T13:10:56.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef63e00640 1 -- 172.21.15.99:0/2414361992 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef58030660 con 0x7fef6c09aa30 2024-03-30T13:10:56.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef63e00640 1 -- 172.21.15.99:0/2414361992 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58034040 con 0x7fef6c09aa30 2024-03-30T13:10:56.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.776+0000 7fef72e00640 1 -- 172.21.15.99:0/2414361992 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6c15df90 con 0x7fef6c09aa30 2024-03-30T13:10:56.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.777+0000 7fef72e00640 1 -- 172.21.15.99:0/2414361992 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef6c0b5750 con 0x7fef6c09aa30 2024-03-30T13:10:56.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.778+0000 7fef72e00640 1 -- 172.21.15.99:0/2414361992 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef6c068d50 con 0x7fef6c09aa30 2024-03-30T13:10:56.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.779+0000 7fef63e00640 1 -- 172.21.15.99:0/2414361992 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fef5804b070 con 0x7fef6c09aa30 2024-03-30T13:10:56.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.780+0000 7fef63e00640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fef4c06c530 0x7fef4c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:56.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.780+0000 7fef63e00640 1 -- 172.21.15.99:0/2414361992 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fef580ad6f0 con 0x7fef6c09aa30 2024-03-30T13:10:56.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.780+0000 7fef6be00640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fef4c06c530 0x7fef4c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:56.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.780+0000 7fef6be00640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fef4c06c530 0x7fef4c06e9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0b3a70 tx=0x7fef5c009450 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:56.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:56.784+0000 7fef63e00640 1 -- 172.21.15.99:0/2414361992 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fef5807bd80 con 0x7fef6c09aa30 2024-03-30T13:10:57.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.033+0000 7fef72e00640 1 -- 172.21.15.99:0/2414361992 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fef6c09b560 con 0x7fef6c09aa30 2024-03-30T13:10:57.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.038+0000 7fef63e00640 1 -- 172.21.15.99:0/2414361992 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173729 (secure 0 0 0) 0x7fef5807b680 con 0x7fef6c09aa30 2024-03-30T13:10:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:57.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.042+0000 7fef72e00640 1 -- 172.21.15.99:0/2414361992 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fef4c06c530 msgr2=0x7fef4c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.042+0000 7fef72e00640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fef4c06c530 0x7fef4c06e9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0b3a70 tx=0x7fef5c009450 comp rx=0 tx=0).stop 2024-03-30T13:10:57.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.042+0000 7fef72e00640 1 -- 172.21.15.99:0/2414361992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef6c09aa30 msgr2=0x7fef6c0cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.042+0000 7fef72e00640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef6c09aa30 0x7fef6c0cdc10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fef58000c00 tx=0x7fef58004730 comp rx=0 tx=0).stop 2024-03-30T13:10:57.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.042+0000 7fef72e00640 1 -- 172.21.15.99:0/2414361992 shutdown_connections 2024-03-30T13:10:57.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.042+0000 7fef72e00640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fef4c06c530 0x7fef4c06e9f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.042+0000 7fef72e00640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef6c09b780 0x7fef6c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.042+0000 7fef72e00640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef6c09aa30 0x7fef6c0cdc10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.042+0000 7fef72e00640 1 --2- 172.21.15.99:0/2414361992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef6c06c830 0x7fef6c0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.042+0000 7fef72e00640 1 -- 172.21.15.99:0/2414361992 >> 172.21.15.99:0/2414361992 conn(0x7fef6c0b3f50 msgr2=0x7fef6c0d1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:57.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.042+0000 7fef72e00640 1 -- 172.21.15.99:0/2414361992 shutdown_connections 2024-03-30T13:10:57.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.043+0000 7fef72e00640 1 -- 172.21.15.99:0/2414361992 wait complete. 2024-03-30T13:10:57.063 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":310744192},{"type":"v1","addr":"172.21.15.99:6801","nonce":310744192}]},"active_addr":"172.21.15.99:6801/310744192","active_change":"2024-03-30T13:10:25.416019+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":591723389}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":796869506}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":145129436}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":2476877701}]}]} 2024-03-30T13:10:57.066 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-30T13:10:57.066 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-30T13:10:57.066 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:10:57.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.263+0000 7f15f8600640 1 Processor -- start 2024-03-30T13:10:57.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.263+0000 7f15f8600640 1 -- start start 2024-03-30T13:10:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.264+0000 7f15f8600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f15f015ea60 0x7f15f00d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f8600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15f00cfcd0 0x7f15f00d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f8600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f00d2470 con 0x7f15f00d0f20 2024-03-30T13:10:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f8600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f15f00d2220 con 0x7f15f015ea60 2024-03-30T13:10:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f8600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f15f00d2750 con 0x7f15f00cfcd0 2024-03-30T13:10:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f5c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f15f015ea60 0x7f15f00d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f5c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f15f015ea60 0x7f15f00d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38132/0 (socket says 172.21.15.99:38132) 2024-03-30T13:10:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f5c00640 1 -- 172.21.15.99:0/2223700831 learned_addr learned my addr 172.21.15.99:0/2223700831 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:57.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f5200640 1 --2- 172.21.15.99:0/2223700831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15f00cfcd0 0x7f15f00d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f5c00640 1 -- 172.21.15.99:0/2223700831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15f00cfcd0 msgr2=0x7f15f00d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:57.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f5c00640 1 --2- 172.21.15.99:0/2223700831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15f00cfcd0 0x7f15f00d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f5c00640 1 -- 172.21.15.99:0/2223700831 >> v1:172.21.15.181:6789/0 conn(0x7f15f00d0f20 legacy=0x7f15f006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:57.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.265+0000 7f15f5c00640 1 -- 172.21.15.99:0/2223700831 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f00d2a30 con 0x7f15f015ea60 2024-03-30T13:10:57.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.266+0000 7f15f5c00640 1 --2- 172.21.15.99:0/2223700831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15f015ea60 0x7f15f00d3230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009870 tx=0x7f15e402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5750b188882d8b1e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.267+0000 7f15efe00640 1 -- 172.21.15.99:0/2223700831 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e4035020 con 0x7f15f015ea60 2024-03-30T13:10:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.267+0000 7f15efe00640 1 -- 172.21.15.99:0/2223700831 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e4031640 con 0x7f15f015ea60 2024-03-30T13:10:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.267+0000 7f15efe00640 1 -- 172.21.15.99:0/2223700831 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e402d040 con 0x7f15f015ea60 2024-03-30T13:10:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.267+0000 7f15f8600640 1 -- 172.21.15.99:0/2223700831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15f015ea60 msgr2=0x7f15f00d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.267+0000 7f15f8600640 1 --2- 172.21.15.99:0/2223700831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15f015ea60 0x7f15f00d3230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009870 tx=0x7f15e402b8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.267+0000 7f15f8600640 1 -- 172.21.15.99:0/2223700831 shutdown_connections 2024-03-30T13:10:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.267+0000 7f15f8600640 1 --2- 172.21.15.99:0/2223700831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15f00cfcd0 0x7f15f00d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.267+0000 7f15f8600640 1 --2- 172.21.15.99:0/2223700831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15f015ea60 0x7f15f00d3230 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.268+0000 7f15f8600640 1 -- 172.21.15.99:0/2223700831 >> 172.21.15.99:0/2223700831 conn(0x7f15f008bfc0 msgr2=0x7f15f00d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.268+0000 7f15f8600640 1 -- 172.21.15.99:0/2223700831 shutdown_connections 2024-03-30T13:10:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.268+0000 7f15f8600640 1 -- 172.21.15.99:0/2223700831 wait complete. 2024-03-30T13:10:57.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.269+0000 7f15f8600640 1 Processor -- start 2024-03-30T13:10:57.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.269+0000 7f15f8600640 1 -- start start 2024-03-30T13:10:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.270+0000 7f15f8600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15f00cfcd0 0x7f15f00ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.270+0000 7f15f8600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15f00d0f20 0x7f15f01ea220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.270+0000 7f15f8600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15f015ea60 0x7f15f01e8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.270+0000 7f15f8600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f15f00d55b0 con 0x7f15f015ea60 2024-03-30T13:10:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.270+0000 7f15f8600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f15f00d5430 con 0x7f15f00cfcd0 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.270+0000 7f15f8600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f15f00d13b0 con 0x7f15f00d0f20 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.271+0000 7f15f6600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15f015ea60 0x7f15f01e8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.271+0000 7f15f6600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15f015ea60 0x7f15f01e8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38142/0 (socket says 172.21.15.99:38142) 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.271+0000 7f15f6600640 1 -- 172.21.15.99:0/632742367 learned_addr learned my addr 172.21.15.99:0/632742367 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.271+0000 7f15f5c00640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15f00cfcd0 0x7f15f00ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.271+0000 7f15f5200640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15f00d0f20 0x7f15f01ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.271+0000 7f15f6600640 1 -- 172.21.15.99:0/632742367 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15f00d0f20 msgr2=0x7f15f01ea220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.271+0000 7f15f6600640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15f00d0f20 0x7f15f01ea220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.271+0000 7f15f6600640 1 -- 172.21.15.99:0/632742367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15f00cfcd0 msgr2=0x7f15f00ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.271+0000 7f15f6600640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15f00cfcd0 0x7f15f00ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.271+0000 7f15f6600640 1 -- 172.21.15.99:0/632742367 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f01e8a60 con 0x7f15f015ea60 2024-03-30T13:10:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.271+0000 7f15f6600640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15f015ea60 0x7f15f01e8230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f15e800c7b0 tx=0x7f15e800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:57.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.272+0000 7f15ed600640 1 -- 172.21.15.99:0/632742367 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e8004b60 con 0x7f15f015ea60 2024-03-30T13:10:57.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.272+0000 7f15ed600640 1 -- 172.21.15.99:0/632742367 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e8004d00 con 0x7f15f015ea60 2024-03-30T13:10:57.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.272+0000 7f15f8600640 1 -- 172.21.15.99:0/632742367 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f01e8d40 con 0x7f15f015ea60 2024-03-30T13:10:57.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.272+0000 7f15ed600640 1 -- 172.21.15.99:0/632742367 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e800aa90 con 0x7f15f015ea60 2024-03-30T13:10:57.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.272+0000 7f15f8600640 1 -- 172.21.15.99:0/632742367 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f01e9300 con 0x7f15f015ea60 2024-03-30T13:10:57.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.273+0000 7f15f8600640 1 -- 172.21.15.99:0/632742367 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f0068d50 con 0x7f15f015ea60 2024-03-30T13:10:57.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.275+0000 7f15ed600640 1 -- 172.21.15.99:0/632742367 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f15e800ac30 con 0x7f15f015ea60 2024-03-30T13:10:57.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.276+0000 7f15ed600640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f15d006c530 0x7f15d006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.276+0000 7f15ed600640 1 -- 172.21.15.99:0/632742367 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f15e808b9e0 con 0x7f15f015ea60 2024-03-30T13:10:57.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.276+0000 7f15f5c00640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f15d006c530 0x7f15d006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.277+0000 7f15f5c00640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f15d006c530 0x7f15d006e9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f15e4036000 tx=0x7f15e403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:57.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.281+0000 7f15ed600640 1 -- 172.21.15.99:0/632742367 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f15e8020070 con 0x7f15f015ea60 2024-03-30T13:10:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.589+0000 7f15f8600640 1 -- 172.21.15.99:0/632742367 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15f00b7b10 con 0x7f15f015ea60 2024-03-30T13:10:57.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.592+0000 7f15ed600640 1 -- 172.21.15.99:0/632742367 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16609 (secure 0 0 0) 0x7f15e8059ff0 con 0x7f15f015ea60 2024-03-30T13:10:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:57.597 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":22,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:47.229108+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:10:57.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 -- 172.21.15.99:0/632742367 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f15d006c530 msgr2=0x7f15d006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f15d006c530 0x7f15d006e9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f15e4036000 tx=0x7f15e403c040 comp rx=0 tx=0).stop 2024-03-30T13:10:57.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 -- 172.21.15.99:0/632742367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15f015ea60 msgr2=0x7f15f01e8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15f015ea60 0x7f15f01e8230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f15e800c7b0 tx=0x7f15e800cc70 comp rx=0 tx=0).stop 2024-03-30T13:10:57.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 -- 172.21.15.99:0/632742367 shutdown_connections 2024-03-30T13:10:57.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f15d006c530 0x7f15d006e9f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15f015ea60 0x7f15f01e8230 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15f00d0f20 0x7f15f01ea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 --2- 172.21.15.99:0/632742367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15f00cfcd0 0x7f15f00ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 -- 172.21.15.99:0/632742367 >> 172.21.15.99:0/632742367 conn(0x7f15f008bfc0 msgr2=0x7f15f00b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:57.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 -- 172.21.15.99:0/632742367 shutdown_connections 2024-03-30T13:10:57.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.595+0000 7f15f8600640 1 -- 172.21.15.99:0/632742367 wait complete. 2024-03-30T13:10:57.617 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-30T13:10:57.617 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:10:57.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.810+0000 7faeb4c00640 1 Processor -- start 2024-03-30T13:10:57.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.810+0000 7faeb4c00640 1 -- start start 2024-03-30T13:10:57.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.812+0000 7faeb4c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7faeb00b3960 0x7faeb00cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.812+0000 7faeb4c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb00cfc80 con 0x7faeb00cf670 2024-03-30T13:10:57.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.812+0000 7faeb4c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb00cff60 con 0x7faeb00d1600 2024-03-30T13:10:57.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.812+0000 7faeb4c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7faeb00d0240 con 0x7faeb00b3960 2024-03-30T13:10:57.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.812+0000 7faea5400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7faeb00cf670 0x7faeb00d0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56632/0 (socket says 172.21.15.99:56632) 2024-03-30T13:10:57.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.812+0000 7faea5400640 1 -- 172.21.15.99:0/3084194806 learned_addr learned my addr 172.21.15.99:0/3084194806 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:57.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001239259 0 0) 0x7faeb00cfc80 con 0x7faeb00cf670 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae94003520 con 0x7faeb00cf670 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faeade00640 1 --2- 172.21.15.99:0/3084194806 >> v2:172.21.15.181:3300/0 conn(0x7faeb00b3960 0x7faeb00cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2825723141 0 0) 0x7fae94003520 con 0x7faeb00cf670 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 >> v2:172.21.15.181:3300/0 conn(0x7faeb00b3960 msgr2=0x7faeb00cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 --2- 172.21.15.99:0/3084194806 >> v2:172.21.15.181:3300/0 conn(0x7faeb00b3960 0x7faeb00cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 >> v1:172.21.15.181:6789/0 conn(0x7faeb00d1600 legacy=0x7faeb006cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb00d0520 con 0x7faeb00cf670 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fae98001670 con 0x7faeb00cf670 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 >> v1:172.21.15.99:6789/0 conn(0x7faeb00cf670 legacy=0x7faeb00d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 --2- 172.21.15.99:0/3084194806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae940039b0 0x7fae94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 --2- 172.21.15.99:0/3084194806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae94004800 0x7fae94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 --2- 172.21.15.99:0/3084194806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae940051c0 0x7fae9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faeb00d0240 con 0x7fae940051c0 2024-03-30T13:10:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fae9400c110 con 0x7fae94004800 2024-03-30T13:10:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.813+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fae9400c310 con 0x7fae940039b0 2024-03-30T13:10:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.814+0000 7faeae800640 1 --2- 172.21.15.99:0/3084194806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae940051c0 0x7fae9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.814+0000 7faeade00640 1 --2- 172.21.15.99:0/3084194806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae940039b0 0x7fae94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.814+0000 7faea5400640 1 --2- 172.21.15.99:0/3084194806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae94004800 0x7fae94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.814+0000 7faeae800640 1 -- 172.21.15.99:0/3084194806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae940039b0 msgr2=0x7fae94003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.814+0000 7faeae800640 1 --2- 172.21.15.99:0/3084194806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae940039b0 0x7fae94003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.814+0000 7faeae800640 1 -- 172.21.15.99:0/3084194806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae94004800 msgr2=0x7fae94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.814+0000 7faeae800640 1 --2- 172.21.15.99:0/3084194806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae94004800 0x7fae94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.814+0000 7faeae800640 1 -- 172.21.15.99:0/3084194806 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae94003520 con 0x7fae940051c0 2024-03-30T13:10:57.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.816+0000 7faeae800640 1 -- 172.21.15.99:0/3084194806 reap_dead start 2024-03-30T13:10:57.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.816+0000 7faeae800640 1 --2- 172.21.15.99:0/3084194806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae940051c0 0x7fae9400b9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faea8001e20 tx=0x7fae94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d123c059bfd7fbe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:57.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.816+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8001a70 con 0x7fae940051c0 2024-03-30T13:10:57.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.816+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea8003b70 con 0x7fae940051c0 2024-03-30T13:10:57.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.816+0000 7faead400640 1 -- 172.21.15.99:0/3084194806 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea80050d0 con 0x7fae940051c0 2024-03-30T13:10:57.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.816+0000 7faeb4c00640 1 -- 172.21.15.99:0/3084194806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae940051c0 msgr2=0x7fae9400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.816+0000 7faeb4c00640 1 --2- 172.21.15.99:0/3084194806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae940051c0 0x7fae9400b9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faea8001e20 tx=0x7fae94005830 comp rx=0 tx=0).stop 2024-03-30T13:10:57.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.817+0000 7faeb4c00640 1 -- 172.21.15.99:0/3084194806 shutdown_connections 2024-03-30T13:10:57.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.817+0000 7faeb4c00640 1 --2- 172.21.15.99:0/3084194806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae940051c0 0x7fae9400b9c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.817+0000 7faeb4c00640 1 -- 172.21.15.99:0/3084194806 >> 172.21.15.99:0/3084194806 conn(0x7faeb008bfc0 msgr2=0x7faeb00d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:57.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.817+0000 7faeb4c00640 1 -- 172.21.15.99:0/3084194806 shutdown_connections 2024-03-30T13:10:57.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.817+0000 7faeb4c00640 1 -- 172.21.15.99:0/3084194806 wait complete. 2024-03-30T13:10:57.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.818+0000 7faeb4c00640 1 Processor -- start 2024-03-30T13:10:57.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.819+0000 7faeb4c00640 1 -- start start 2024-03-30T13:10:57.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.819+0000 7faeb4c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae940051c0 0x7faeb014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.819+0000 7faeb4c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faeb00cc740 0x7faeb00ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.819+0000 7faeb4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb015c8c0 0x7faeb015cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.819+0000 7faeb4c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faeb00c7dd0 con 0x7faeb015c8c0 2024-03-30T13:10:57.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.819+0000 7faeb4c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faeb00c7c50 con 0x7fae940051c0 2024-03-30T13:10:57.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.819+0000 7faeb4c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7faeb00cf130 con 0x7faeb00cc740 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faeae800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb015c8c0 0x7faeb015cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faeae800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb015c8c0 0x7faeb015cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38160/0 (socket says 172.21.15.99:38160) 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faeae800640 1 -- 172.21.15.99:0/3888321389 learned_addr learned my addr 172.21.15.99:0/3888321389 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faea5400640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faeb00cc740 0x7faeb00ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faeade00640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae940051c0 0x7faeb014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faeae800640 1 -- 172.21.15.99:0/3888321389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faeb00cc740 msgr2=0x7faeb00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faeae800640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faeb00cc740 0x7faeb00ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faeae800640 1 -- 172.21.15.99:0/3888321389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae940051c0 msgr2=0x7faeb014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faeae800640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae940051c0 0x7faeb014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faeae800640 1 -- 172.21.15.99:0/3888321389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb00cd2b0 con 0x7faeb015c8c0 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faeade00640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae940051c0 0x7faeb014f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.820+0000 7faea5400640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faeb00cc740 0x7faeb00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.821+0000 7faeae800640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb015c8c0 0x7faeb015cd40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faea8001f40 tx=0x7faea80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.821+0000 7faea6a00640 1 -- 172.21.15.99:0/3888321389 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8006b50 con 0x7faeb015c8c0 2024-03-30T13:10:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.821+0000 7faea6a00640 1 -- 172.21.15.99:0/3888321389 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea803d030 con 0x7faeb015c8c0 2024-03-30T13:10:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.821+0000 7faeb4c00640 1 -- 172.21.15.99:0/3888321389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb00cd590 con 0x7faeb015c8c0 2024-03-30T13:10:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.821+0000 7faea6a00640 1 -- 172.21.15.99:0/3888321389 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8039660 con 0x7faeb015c8c0 2024-03-30T13:10:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.821+0000 7faeb4c00640 1 -- 172.21.15.99:0/3888321389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb00cdb50 con 0x7faeb015c8c0 2024-03-30T13:10:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.822+0000 7faeb4c00640 1 -- 172.21.15.99:0/3888321389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb0068640 con 0x7faeb015c8c0 2024-03-30T13:10:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.824+0000 7faea6a00640 1 -- 172.21.15.99:0/3888321389 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faea8039800 con 0x7faeb015c8c0 2024-03-30T13:10:57.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.825+0000 7faea6a00640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fae8c06c530 0x7fae8c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:57.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.825+0000 7faea6a00640 1 -- 172.21.15.99:0/3888321389 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7faea80ad770 con 0x7faeb015c8c0 2024-03-30T13:10:57.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.825+0000 7faeade00640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fae8c06c530 0x7fae8c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:57.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.826+0000 7faeade00640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fae8c06c530 0x7fae8c06e9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faea0006fd0 tx=0x7faea0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:57.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:57.830+0000 7faea6a00640 1 -- 172.21.15.99:0/3888321389 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7faea8033030 con 0x7faeb015c8c0 2024-03-30T13:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.028+0000 7faeb4c00640 1 -- 172.21.15.99:0/3888321389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faeb00b2ca0 con 0x7faeb015c8c0 2024-03-30T13:10:58.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.030+0000 7faea6a00640 1 -- 172.21.15.99:0/3888321389 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16609 (secure 0 0 0) 0x7faea807bd90 con 0x7faeb015c8c0 2024-03-30T13:10:58.034 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:10:58.034 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":22,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:47.229108+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:10:58.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 -- 172.21.15.99:0/3888321389 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fae8c06c530 msgr2=0x7fae8c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fae8c06c530 0x7fae8c06e9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faea0006fd0 tx=0x7faea0008040 comp rx=0 tx=0).stop 2024-03-30T13:10:58.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 -- 172.21.15.99:0/3888321389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb015c8c0 msgr2=0x7faeb015cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb015c8c0 0x7faeb015cd40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faea8001f40 tx=0x7faea80014a0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 -- 172.21.15.99:0/3888321389 shutdown_connections 2024-03-30T13:10:58.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fae8c06c530 0x7fae8c06e9f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb015c8c0 0x7faeb015cd40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faeb00cc740 0x7faeb00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 --2- 172.21.15.99:0/3888321389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae940051c0 0x7faeb014f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 -- 172.21.15.99:0/3888321389 >> 172.21.15.99:0/3888321389 conn(0x7faeb008bfc0 msgr2=0x7faeb00b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 -- 172.21.15.99:0/3888321389 shutdown_connections 2024-03-30T13:10:58.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.032+0000 7faeb4c00640 1 -- 172.21.15.99:0/3888321389 wait complete. 2024-03-30T13:10:58.054 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-30T13:10:58.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-30T13:10:58.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-30T13:10:58.056 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-30T13:10:58.056 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-30T13:10:58.056 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-30T13:10:58.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-30T13:10:58.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-30T13:10:58.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.360+0000 7fed95200640 1 Processor -- start 2024-03-30T13:10:58.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.361+0000 7fed95200640 1 -- start start 2024-03-30T13:10:58.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.364+0000 7fed95200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fed900cd280 0x7fed900b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.364+0000 7fed95200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed900c5020 0x7fed900c5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.364+0000 7fed95200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed901609c0 con 0x7fed901605e0 2024-03-30T13:10:58.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.364+0000 7fed95200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fed900add40 con 0x7fed900cd280 2024-03-30T13:10:58.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.364+0000 7fed95200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fed900ad130 con 0x7fed900c5020 2024-03-30T13:10:58.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.365+0000 7fed8e800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed900c5020 0x7fed900c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.365+0000 7fed8e800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed900c5020 0x7fed900c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38284/0 (socket says 172.21.15.99:38284) 2024-03-30T13:10:58.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.365+0000 7fed8e800640 1 -- 172.21.15.99:0/1821912743 learned_addr learned my addr 172.21.15.99:0/1821912743 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.365+0000 7fed8d400640 1 --2- 172.21.15.99:0/1821912743 >> v2:172.21.15.181:3300/0 conn(0x7fed900cd280 0x7fed900b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.366+0000 7fed8e800640 1 -- 172.21.15.99:0/1821912743 >> v2:172.21.15.181:3300/0 conn(0x7fed900cd280 msgr2=0x7fed900b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.366+0000 7fed8e800640 1 --2- 172.21.15.99:0/1821912743 >> v2:172.21.15.181:3300/0 conn(0x7fed900cd280 0x7fed900b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.366+0000 7fed8e800640 1 -- 172.21.15.99:0/1821912743 >> v1:172.21.15.181:6789/0 conn(0x7fed901605e0 legacy=0x7fed900ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.366+0000 7fed8e800640 1 -- 172.21.15.99:0/1821912743 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed900ad410 con 0x7fed900c5020 2024-03-30T13:10:58.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.369+0000 7fed8e800640 1 --2- 172.21.15.99:0/1821912743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed900c5020 0x7fed900c5450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009870 tx=0x7fed7c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8adf89808830246 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.372+0000 7fed8ca00640 1 -- 172.21.15.99:0/1821912743 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c035020 con 0x7fed900c5020 2024-03-30T13:10:58.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.372+0000 7fed8ca00640 1 -- 172.21.15.99:0/1821912743 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed7c031640 con 0x7fed900c5020 2024-03-30T13:10:58.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.372+0000 7fed8ca00640 1 -- 172.21.15.99:0/1821912743 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c02d040 con 0x7fed900c5020 2024-03-30T13:10:58.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.374+0000 7fed95200640 1 -- 172.21.15.99:0/1821912743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed900c5020 msgr2=0x7fed900c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.374+0000 7fed95200640 1 --2- 172.21.15.99:0/1821912743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed900c5020 0x7fed900c5450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009870 tx=0x7fed7c02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.377+0000 7f81f0200640 1 Processor -- start 2024-03-30T13:10:58.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.378+0000 7f81f0200640 1 -- start start 2024-03-30T13:10:58.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.378+0000 7fed95200640 1 -- 172.21.15.99:0/1821912743 shutdown_connections 2024-03-30T13:10:58.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.378+0000 7fed95200640 1 --2- 172.21.15.99:0/1821912743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed900c5020 0x7fed900c5450 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.378+0000 7fed95200640 1 --2- 172.21.15.99:0/1821912743 >> v2:172.21.15.181:3300/0 conn(0x7fed900cd280 0x7fed900b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.378+0000 7fed95200640 1 -- 172.21.15.99:0/1821912743 >> 172.21.15.99:0/1821912743 conn(0x7fed9006b510 msgr2=0x7fed9006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.379+0000 7f81f0200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81e80ba000 0x7f81e80d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.379+0000 7f81f0200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e80cf9e0 con 0x7f81e815e780 2024-03-30T13:10:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.379+0000 7f81f0200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e80cfe70 con 0x7f81e815eb60 2024-03-30T13:10:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.379+0000 7f81f0200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f81e80b7f50 con 0x7f81e80ba000 2024-03-30T13:10:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.379+0000 7fed95200640 1 -- 172.21.15.99:0/1821912743 shutdown_connections 2024-03-30T13:10:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.380+0000 7fed95200640 1 -- 172.21.15.99:0/1821912743 wait complete. 2024-03-30T13:10:58.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.380+0000 7f81ee200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81e80ba000 0x7f81e80d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.383+0000 7fed95200640 1 Processor -- start 2024-03-30T13:10:58.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.383+0000 7fed95200640 1 -- start start 2024-03-30T13:10:58.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.380+0000 7f81ee200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81e80ba000 0x7f81e80d3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38300/0 (socket says 172.21.15.99:38300) 2024-03-30T13:10:58.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.383+0000 7f81ee200640 1 -- 172.21.15.99:0/2485546082 learned_addr learned my addr 172.21.15.99:0/2485546082 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.381+0000 7f81ed800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f81e815e780 0x7f81e80cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56644/0 (socket says 172.21.15.99:56644) 2024-03-30T13:10:58.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.382+0000 7f81ece00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f81e815eb60 0x7f81e80cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:34798/0 (socket says 172.21.15.99:34798) 2024-03-30T13:10:58.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.384+0000 7fed95200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed900c5020 0x7fed9008e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.384+0000 7fed95200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed900cd280 0x7fed9008f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.387+0000 7fab24600640 1 Processor -- start 2024-03-30T13:10:58.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.385+0000 7f81ee200640 1 -- 172.21.15.99:0/2485546082 >> v1:172.21.15.181:6789/0 conn(0x7f81e815eb60 legacy=0x7f81e80cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.385+0000 7f81ee200640 1 -- 172.21.15.99:0/2485546082 >> v1:172.21.15.99:6789/0 conn(0x7f81e815e780 legacy=0x7f81e80cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.384+0000 7fed95200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed901605e0 0x7fed90072b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.384+0000 7fed95200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fed900c5990 con 0x7fed901605e0 2024-03-30T13:10:58.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.384+0000 7fed95200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fed900ad9d0 con 0x7fed900cd280 2024-03-30T13:10:58.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.384+0000 7fed95200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fed900c5b10 con 0x7fed900c5020 2024-03-30T13:10:58.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.385+0000 7fed8e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed901605e0 0x7fed90072b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.385+0000 7fed8e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed901605e0 0x7fed90072b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38176/0 (socket says 172.21.15.99:38176) 2024-03-30T13:10:58.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.385+0000 7fed8e800640 1 -- 172.21.15.99:0/4024584554 learned_addr learned my addr 172.21.15.99:0/4024584554 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.385+0000 7fed8d400640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed900cd280 0x7fed9008f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.386+0000 7fed8d400640 1 -- 172.21.15.99:0/4024584554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed900c5020 msgr2=0x7fed9008e300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-30T13:10:58.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.386+0000 7fed8d400640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed900c5020 0x7fed9008e300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.386+0000 7fed8d400640 1 -- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed901605e0 msgr2=0x7fed90072b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.386+0000 7fed8d400640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed901605e0 0x7fed90072b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.386+0000 7fed8d400640 1 -- 172.21.15.99:0/4024584554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9008e900 con 0x7fed900cd280 2024-03-30T13:10:58.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.387+0000 7fed8d400640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed900cd280 0x7fed9008f9a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed8000d620 tx=0x7fed8000dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.388+0000 7fed86000640 1 -- 172.21.15.99:0/4024584554 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8000b620 con 0x7fed900cd280 2024-03-30T13:10:58.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.388+0000 7fed86000640 1 -- 172.21.15.99:0/4024584554 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed80019070 con 0x7fed900cd280 2024-03-30T13:10:58.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.388+0000 7fed86000640 1 -- 172.21.15.99:0/4024584554 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8000b9e0 con 0x7fed900cd280 2024-03-30T13:10:58.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.388+0000 7fed95200640 1 -- 172.21.15.99:0/4024584554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9008ebe0 con 0x7fed900cd280 2024-03-30T13:10:58.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.388+0000 7f81ee200640 1 -- 172.21.15.99:0/2485546082 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e80b8230 con 0x7f81e80ba000 2024-03-30T13:10:58.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.388+0000 7fab24600640 1 -- start start 2024-03-30T13:10:58.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.390+0000 7fab24600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab1c15e780 0x7fab1c0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.390+0000 7fab24600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fab1c0ba000 0x7fab1c0d2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.390+0000 7fab24600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab1c0cfe70 con 0x7fab1c15eb60 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.390+0000 7fab24600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fab1c0b7f50 con 0x7fab1c15e780 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.390+0000 7fab24600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fab1c0b8230 con 0x7fab1c0ba000 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.391+0000 7fab22600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fab1c0ba000 0x7fab1c0d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.391+0000 7fab21200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fab1c15eb60 0x7fab1c0cf100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56658/0 (socket says 172.21.15.99:56658) 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.391+0000 7fab22600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fab1c0ba000 0x7fab1c0d2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49356/0 (socket says 172.21.15.99:49356) 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.391+0000 7fab22600640 1 -- 172.21.15.99:0/365740048 learned_addr learned my addr 172.21.15.99:0/365740048 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.391+0000 7fab21c00640 1 --2- 172.21.15.99:0/365740048 >> v2:172.21.15.99:3300/0 conn(0x7fab1c15e780 0x7fab1c0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.392+0000 7fab21c00640 1 -- 172.21.15.99:0/365740048 >> v2:172.21.15.181:3300/0 conn(0x7fab1c0ba000 msgr2=0x7fab1c0d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.392+0000 7fab1be00640 1 -- 172.21.15.99:0/365740048 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 218676531 0 0) 0x7fab1c0cfe70 con 0x7fab1c15eb60 2024-03-30T13:10:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.392+0000 7fab21c00640 1 --2- 172.21.15.99:0/365740048 >> v2:172.21.15.181:3300/0 conn(0x7fab1c0ba000 0x7fab1c0d2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.388+0000 7fed95200640 1 -- 172.21.15.99:0/4024584554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9008f1a0 con 0x7fed900cd280 2024-03-30T13:10:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.389+0000 7fed95200640 1 -- 172.21.15.99:0/4024584554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed90068640 con 0x7fed900cd280 2024-03-30T13:10:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.390+0000 7f81ee200640 1 --2- 172.21.15.99:0/2485546082 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81e80ba000 0x7f81e80d3580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009e80 tx=0x7f81e002bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71e619962b9ce46f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.391+0000 7f81e7e00640 1 -- 172.21.15.99:0/2485546082 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e002cb70 con 0x7f81e80ba000 2024-03-30T13:10:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.391+0000 7f81e7e00640 1 -- 172.21.15.99:0/2485546082 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e002cd10 con 0x7f81e80ba000 2024-03-30T13:10:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.391+0000 7f81e7e00640 1 -- 172.21.15.99:0/2485546082 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e002cb70 con 0x7f81e80ba000 2024-03-30T13:10:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.392+0000 7f81f0200640 1 -- 172.21.15.99:0/2485546082 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81e80ba000 msgr2=0x7f81e80d3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.392+0000 7f81f0200640 1 --2- 172.21.15.99:0/2485546082 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81e80ba000 0x7f81e80d3580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009e80 tx=0x7f81e002bfd0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.390+0000 7fcca6a00640 1 Processor -- start 2024-03-30T13:10:58.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.391+0000 7fb123e00640 1 Processor -- start 2024-03-30T13:10:58.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.391+0000 7fb123e00640 1 -- start start 2024-03-30T13:10:58.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.393+0000 7fb123e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb1240ce5f0 0x7fb1240acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.393+0000 7fb123e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb1240ccfe0 0x7fb1240cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.393+0000 7fb123e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb12415e9a0 con 0x7fb12415a550 2024-03-30T13:10:58.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.393+0000 7fb123e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb1240cd990 con 0x7fb1240ce5f0 2024-03-30T13:10:58.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.393+0000 7fb123e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb12406d540 con 0x7fb1240ccfe0 2024-03-30T13:10:58.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.392+0000 7fab21c00640 1 -- 172.21.15.99:0/365740048 >> v1:172.21.15.99:6789/0 conn(0x7fab1c15eb60 legacy=0x7fab1c0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.392+0000 7fab21c00640 1 -- 172.21.15.99:0/365740048 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1c0b8510 con 0x7fab1c15e780 2024-03-30T13:10:58.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.394+0000 7f81f0200640 1 -- 172.21.15.99:0/2485546082 shutdown_connections 2024-03-30T13:10:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.390+0000 7fcca6a00640 1 -- start start 2024-03-30T13:10:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.394+0000 7fcca6a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcc98006070 0x7fcc98006f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.394+0000 7fcca6a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc980e7ba0 con 0x7fcc98048390 2024-03-30T13:10:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.394+0000 7fcca6a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc98007690 con 0x7fcc9804fc10 2024-03-30T13:10:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.394+0000 7fcca6a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fcc98054ae0 con 0x7fcc98006070 2024-03-30T13:10:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.394+0000 7f81f0200640 1 --2- 172.21.15.99:0/2485546082 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81e80ba000 0x7f81e80d3580 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.394+0000 7f81f0200640 1 -- 172.21.15.99:0/2485546082 >> 172.21.15.99:0/2485546082 conn(0x7f81e808bfc0 msgr2=0x7f81e80d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.394+0000 7f81f0200640 1 -- 172.21.15.99:0/2485546082 shutdown_connections 2024-03-30T13:10:58.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.394+0000 7fab21c00640 1 --2- 172.21.15.99:0/365740048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab1c15e780 0x7fab1c0cebc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fab1c06c3a0 tx=0x7fab1402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af67c1eccc3d169f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7fcc9fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcc98048390 0x7fcc9804f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56682/0 (socket says 172.21.15.99:56682) 2024-03-30T13:10:58.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7fcc9fe00640 1 -- 172.21.15.99:0/3608283522 learned_addr learned my addr 172.21.15.99:0/3608283522 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:58.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.394+0000 7fb122a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb12415a550 0x7fb12415e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56670/0 (socket says 172.21.15.99:56670) 2024-03-30T13:10:58.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.394+0000 7fb122a00640 1 -- 172.21.15.99:0/1791042210 learned_addr learned my addr 172.21.15.99:0/1791042210 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:58.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7fb122000640 1 --2- 172.21.15.99:0/1791042210 >> v2:172.21.15.99:3300/0 conn(0x7fb1240ce5f0 0x7fb1240acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7fcca5400640 1 --2- 172.21.15.99:0/3608283522 >> v2:172.21.15.181:3300/0 conn(0x7fcc98006070 0x7fcc98006f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7fb123400640 1 --2- 172.21.15.99:0/1791042210 >> v2:172.21.15.181:3300/0 conn(0x7fb1240ccfe0 0x7fb1240cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7fb121600640 1 -- 172.21.15.99:0/1791042210 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353207267 0 0) 0x7fb12415e9a0 con 0x7fb12415a550 2024-03-30T13:10:58.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7fb121600640 1 -- 172.21.15.99:0/1791042210 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb108003520 con 0x7fb12415a550 2024-03-30T13:10:58.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7fb122000640 1 -- 172.21.15.99:0/1791042210 >> v2:172.21.15.181:3300/0 conn(0x7fb1240ccfe0 msgr2=0x7fb1240cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7fb122000640 1 --2- 172.21.15.99:0/1791042210 >> v2:172.21.15.181:3300/0 conn(0x7fb1240ccfe0 0x7fb1240cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.396+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374995568 0 0) 0x7fcc980e7ba0 con 0x7fcc98048390 2024-03-30T13:10:58.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.396+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc88003520 con 0x7fcc98048390 2024-03-30T13:10:58.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.396+0000 7fab1be00640 1 -- 172.21.15.99:0/365740048 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab14039070 con 0x7fab1c15e780 2024-03-30T13:10:58.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.396+0000 7fab1be00640 1 -- 172.21.15.99:0/365740048 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1402cc70 con 0x7fab1c15e780 2024-03-30T13:10:58.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.396+0000 7fab1be00640 1 -- 172.21.15.99:0/365740048 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab14034660 con 0x7fab1c15e780 2024-03-30T13:10:58.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1003651273 0 0) 0x7fcc88003520 con 0x7fcc98048390 2024-03-30T13:10:58.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7fb122000640 1 -- 172.21.15.99:0/1791042210 >> v1:172.21.15.99:6789/0 conn(0x7fb12415a550 legacy=0x7fb12415e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7fb122000640 1 -- 172.21.15.99:0/1791042210 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12415ec80 con 0x7fb1240ce5f0 2024-03-30T13:10:58.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 >> v2:172.21.15.181:3300/0 conn(0x7fcc98006070 msgr2=0x7fcc98006f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 --2- 172.21.15.99:0/3608283522 >> v2:172.21.15.181:3300/0 conn(0x7fcc98006070 0x7fcc98006f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 >> v1:172.21.15.181:6789/0 conn(0x7fcc9804fc10 legacy=0x7fcc980389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcca5400640 1 --2- 172.21.15.99:0/3608283522 >> v2:172.21.15.181:3300/0 conn(0x7fcc98006070 0x7fcc98006f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:58.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc98007970 con 0x7fcc98048390 2024-03-30T13:10:58.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fcca004f8f0 con 0x7fcc98048390 2024-03-30T13:10:58.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 >> v1:172.21.15.99:6789/0 conn(0x7fcc98048390 legacy=0x7fcc9804f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 --2- 172.21.15.99:0/3608283522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc880039b0 0x7fcc88003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fab24600640 1 -- 172.21.15.99:0/365740048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab1c15e780 msgr2=0x7fab1c0cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fab24600640 1 --2- 172.21.15.99:0/365740048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab1c15e780 0x7fab1c0cebc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fab1c06c3a0 tx=0x7fab1402bec0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fab24600640 1 -- 172.21.15.99:0/365740048 shutdown_connections 2024-03-30T13:10:58.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fab24600640 1 --2- 172.21.15.99:0/365740048 >> v2:172.21.15.181:3300/0 conn(0x7fab1c0ba000 0x7fab1c0d2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fab24600640 1 --2- 172.21.15.99:0/365740048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab1c15e780 0x7fab1c0cebc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fab24600640 1 -- 172.21.15.99:0/365740048 >> 172.21.15.99:0/365740048 conn(0x7fab1c08bfc0 msgr2=0x7fab1c0d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.396+0000 7fed86000640 1 -- 172.21.15.99:0/4024584554 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fed8000bb80 con 0x7fed900cd280 2024-03-30T13:10:58.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fed86000640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed7006c600 0x7fed7006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 --2- 172.21.15.99:0/3608283522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc88004330 0x7fcc88004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 --2- 172.21.15.99:0/3608283522 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc88004fb0 0x7fcc8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8800bf00 con 0x7fcc88004330 2024-03-30T13:10:58.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8800c080 con 0x7fcc880039b0 2024-03-30T13:10:58.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.397+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcc8800c280 con 0x7fcc88004fb0 2024-03-30T13:10:58.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fed86000640 1 -- 172.21.15.99:0/4024584554 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fed8008c480 con 0x7fed900cd280 2024-03-30T13:10:58.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fed86000640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] conn(0x7fed70074880 0x7fed70076ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fed86000640 1 -- 172.21.15.99:0/4024584554 --> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed80001d30 con 0x7fed70074880 2024-03-30T13:10:58.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fed86000640 1 -- 172.21.15.99:0/4024584554 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fed8008c870 con 0x7fed900cd280 2024-03-30T13:10:58.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fcc9f400640 1 --2- 172.21.15.99:0/3608283522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc88004330 0x7fcc88004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fed8de00640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed7006c600 0x7fed7006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.395+0000 7f81f0200640 1 -- 172.21.15.99:0/2485546082 wait complete. 2024-03-30T13:10:58.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fab24600640 1 -- 172.21.15.99:0/365740048 shutdown_connections 2024-03-30T13:10:58.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fcc9f400640 1 -- 172.21.15.99:0/3608283522 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc88004fb0 msgr2=0x7fcc8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.398+0000 7fcc9f400640 1 --2- 172.21.15.99:0/3608283522 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc88004fb0 0x7fcc8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.399+0000 7fcc9f400640 1 -- 172.21.15.99:0/3608283522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc880039b0 msgr2=0x7fcc88003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.399+0000 7fcc9f400640 1 --2- 172.21.15.99:0/3608283522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc880039b0 0x7fcc88003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.399+0000 7fcc9f400640 1 -- 172.21.15.99:0/3608283522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc98007970 con 0x7fcc88004330 2024-03-30T13:10:58.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.399+0000 7f81f0200640 1 Processor -- start 2024-03-30T13:10:58.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.399+0000 7fed8e800640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] conn(0x7fed70074880 0x7fed70076ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.399+0000 7fcca5400640 1 -- 172.21.15.99:0/3608283522 reap_dead start 2024-03-30T13:10:58.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.399+0000 7f81f0200640 1 -- start start 2024-03-30T13:10:58.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.400+0000 7fed8e800640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] conn(0x7fed70074880 0x7fed70076ca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.400+0000 7f9702000640 1 Processor -- start 2024-03-30T13:10:58.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.400+0000 7f9702000640 1 -- start start 2024-03-30T13:10:58.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.400+0000 7fed8de00640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed7006c600 0x7fed7006eac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fed90098f40 tx=0x7fed88007cd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.401+0000 7fcc9f400640 1 --2- 172.21.15.99:0/3608283522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc88004330 0x7fcc88004800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcc94003dd0 tx=0x7fcc88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b33588323233e11 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.399+0000 7fab24600640 1 -- 172.21.15.99:0/365740048 wait complete. 2024-03-30T13:10:58.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.401+0000 7fab24600640 1 Processor -- start 2024-03-30T13:10:58.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.401+0000 7fab24600640 1 -- start start 2024-03-30T13:10:58.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.401+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94037070 con 0x7fcc88004330 2024-03-30T13:10:58.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.401+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc9402be50 con 0x7fcc88004330 2024-03-30T13:10:58.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f81f0200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e80ba000 0x7f81e814f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f81f0200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e815e780 0x7f81e81573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f81f0200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81e8159e60 0x7f81e82006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f81f0200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f81e80b8ad0 con 0x7f81e815e780 2024-03-30T13:10:58.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f81f0200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f81e80b87f0 con 0x7f81e80ba000 2024-03-30T13:10:58.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f81f0200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f81e8169490 con 0x7f81e8159e60 2024-03-30T13:10:58.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f9702000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f96fc15e950 0x7f96fc0d2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7fed86000640 1 -- 172.21.15.99:0/4024584554 <== osd.1 v2:172.21.15.99:6818/3090465725 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed80001d30 con 0x7fed70074880 2024-03-30T13:10:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f81ed800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e80ba000 0x7f81e814f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f81ece00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e815e780 0x7f81e81573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f81ed800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e80ba000 0x7f81e814f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49398/0 (socket says 172.21.15.99:49398) 2024-03-30T13:10:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f81ed800640 1 -- 172.21.15.99:0/3947956208 learned_addr learned my addr 172.21.15.99:0/3947956208 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7fcca6a00640 1 -- 172.21.15.99:0/3608283522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc88004330 msgr2=0x7fcc88004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7f81ee200640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81e8159e60 0x7f81e82006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f9702000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96fc0cee90 0x7f96fc0d42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f9702000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96fc0d3230 con 0x7f96fc0d2d90 2024-03-30T13:10:58.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f9702000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f96fc0d3510 con 0x7f96fc15e950 2024-03-30T13:10:58.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7fcc9ea00640 1 -- 172.21.15.99:0/3608283522 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94037070 con 0x7fcc88004330 2024-03-30T13:10:58.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7fcca6a00640 1 --2- 172.21.15.99:0/3608283522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc88004330 0x7fcc88004800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcc94003dd0 tx=0x7fcc88005830 comp rx=0 tx=0).stop 2024-03-30T13:10:58.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7fcca6a00640 1 -- 172.21.15.99:0/3608283522 shutdown_connections 2024-03-30T13:10:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7fcca6a00640 1 --2- 172.21.15.99:0/3608283522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc88004330 0x7fcc88004800 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7fcca6a00640 1 -- 172.21.15.99:0/3608283522 >> 172.21.15.99:0/3608283522 conn(0x7fcc98054ca0 msgr2=0x7fcc980550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7fb122000640 1 --2- 172.21.15.99:0/1791042210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240ce5f0 0x7fb1240acf20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb12406f530 tx=0x7fb11402df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b3511f8a5be9cf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.402+0000 7f9702000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f96fc0d37f0 con 0x7f96fc0cee90 2024-03-30T13:10:58.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7f96fbe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96fc0cee90 0x7f96fc0d42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7f81ed800640 1 -- 172.21.15.99:0/3947956208 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81e8159e60 msgr2=0x7f81e82006e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7f81ed800640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81e8159e60 0x7f81e82006e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7f81ed800640 1 -- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e815e780 msgr2=0x7f81e81573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7f81ed800640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e815e780 0x7f81e81573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7f81ed800640 1 -- 172.21.15.99:0/3947956208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e8157900 con 0x7f81e80ba000 2024-03-30T13:10:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7fcca6a00640 1 -- 172.21.15.99:0/3608283522 shutdown_connections 2024-03-30T13:10:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7fcca6a00640 1 -- 172.21.15.99:0/3608283522 wait complete. 2024-03-30T13:10:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7f9701600640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f96fc0d2d90 0x7f96fc0b5eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:34828/0 (socket says 172.21.15.99:34828) 2024-03-30T13:10:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.403+0000 7f9701600640 1 -- 172.21.15.99:0/1172789436 learned_addr learned my addr 172.21.15.99:0/1172789436 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.404+0000 7f9700c00640 1 --2- 172.21.15.99:0/1172789436 >> v2:172.21.15.99:3300/0 conn(0x7f96fc15e950 0x7f96fc0d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.405+0000 7f81ed800640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e80ba000 0x7f81e814f800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c400 tx=0x7f81dc00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.405+0000 7fab24600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab1c0ba000 0x7fab1c15f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.405+0000 7fab24600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab1c15e780 0x7fab1c0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.406+0000 7fb121600640 1 -- 172.21.15.99:0/1791042210 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11403b070 con 0x7fb1240ce5f0 2024-03-30T13:10:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.406+0000 7fb121600640 1 -- 172.21.15.99:0/1791042210 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb110004f50 con 0x7fb1240ce5f0 2024-03-30T13:10:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.406+0000 7fb121600640 1 -- 172.21.15.99:0/1791042210 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11400b040 con 0x7fb1240ce5f0 2024-03-30T13:10:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.405+0000 7fab24600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab1c161ac0 0x7fab1c1566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.405+0000 7f9700c00640 1 -- 172.21.15.99:0/1172789436 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96fc0cee90 msgr2=0x7f96fc0d42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.405+0000 7f9700c00640 1 --2- 172.21.15.99:0/1172789436 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96fc0cee90 0x7f96fc0d42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.405+0000 7f9700c00640 1 -- 172.21.15.99:0/1172789436 >> v1:172.21.15.181:6789/0 conn(0x7f96fc0d2d90 legacy=0x7f96fc0b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.405+0000 7f9700c00640 1 -- 172.21.15.99:0/1172789436 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96fc0d3ad0 con 0x7f96fc15e950 2024-03-30T13:10:58.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.405+0000 7fee96c00640 1 Processor -- start 2024-03-30T13:10:58.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.406+0000 7f81e5600640 1 -- 172.21.15.99:0/3947956208 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc0074e0 con 0x7f81e80ba000 2024-03-30T13:10:58.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.406+0000 7f81e5600640 1 -- 172.21.15.99:0/3947956208 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc007680 con 0x7f81e80ba000 2024-03-30T13:10:58.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.406+0000 7f81e5600640 1 -- 172.21.15.99:0/3947956208 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc004a20 con 0x7f81e80ba000 2024-03-30T13:10:58.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.406+0000 7f81f0200640 1 -- 172.21.15.99:0/3947956208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e8157be0 con 0x7f81e80ba000 2024-03-30T13:10:58.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.406+0000 7f81f0200640 1 -- 172.21.15.99:0/3947956208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e8158420 con 0x7f81e80ba000 2024-03-30T13:10:58.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.406+0000 7f9700c00640 1 --2- 172.21.15.99:0/1172789436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96fc15e950 0x7f96fc0d2850 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009d90 tx=0x7f96f402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671273173c3bbb9e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.406+0000 7fee96c00640 1 -- start start 2024-03-30T13:10:58.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.407+0000 7fab21c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab1c0ba000 0x7fab1c15f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.407+0000 7fab21c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab1c0ba000 0x7fab1c15f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38246/0 (socket says 172.21.15.99:38246) 2024-03-30T13:10:58.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.407+0000 7fab21c00640 1 -- 172.21.15.99:0/1115466717 learned_addr learned my addr 172.21.15.99:0/1115466717 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.407+0000 7fab24600640 1 -- 172.21.15.99:0/1115466717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c0cf810 con 0x7fab1c0ba000 2024-03-30T13:10:58.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.407+0000 7fab22600640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab1c161ac0 0x7fab1c1566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.407+0000 7f96fb400640 1 -- 172.21.15.99:0/1172789436 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4039070 con 0x7f96fc15e950 2024-03-30T13:10:58.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.407+0000 7fab24600640 1 -- 172.21.15.99:0/1115466717 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c0b8ad0 con 0x7fab1c15e780 2024-03-30T13:10:58.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.407+0000 7fab21200640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab1c15e780 0x7fab1c0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.407+0000 7f96fb400640 1 -- 172.21.15.99:0/1172789436 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f402cbc0 con 0x7f96fc15e950 2024-03-30T13:10:58.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.407+0000 7f96fb400640 1 -- 172.21.15.99:0/1172789436 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4034440 con 0x7f96fc15e950 2024-03-30T13:10:58.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.408+0000 7fab24600640 1 -- 172.21.15.99:0/1115466717 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fab1c0cf990 con 0x7fab1c161ac0 2024-03-30T13:10:58.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.408+0000 7fcca6a00640 1 Processor -- start 2024-03-30T13:10:58.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.408+0000 7fcca6a00640 1 -- start start 2024-03-30T13:10:58.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.408+0000 7fb123e00640 1 -- 172.21.15.99:0/1791042210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240ce5f0 msgr2=0x7fb1240acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.408+0000 7fb123e00640 1 --2- 172.21.15.99:0/1791042210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240ce5f0 0x7fb1240acf20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb12406f530 tx=0x7fb11402df00 comp rx=0 tx=0).stop 2024-03-30T13:10:58.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.408+0000 7fb123e00640 1 -- 172.21.15.99:0/1791042210 shutdown_connections 2024-03-30T13:10:58.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7fb123e00640 1 --2- 172.21.15.99:0/1791042210 >> v2:172.21.15.181:3300/0 conn(0x7fb1240ccfe0 0x7fb1240cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7f9702000640 1 -- 172.21.15.99:0/1172789436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96fc15e950 msgr2=0x7f96fc0d2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7f9702000640 1 --2- 172.21.15.99:0/1172789436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96fc15e950 0x7f96fc0d2850 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009d90 tx=0x7f96f402be10 comp rx=0 tx=0).stop 2024-03-30T13:10:58.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7fb123e00640 1 --2- 172.21.15.99:0/1791042210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240ce5f0 0x7fb1240acf20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7fb123e00640 1 -- 172.21.15.99:0/1791042210 >> 172.21.15.99:0/1791042210 conn(0x7fb1240b1c40 msgr2=0x7fb1240b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.408+0000 7fee96c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fee900b69e0 0x7fee900d2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7f81f0200640 1 -- 172.21.15.99:0/3947956208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f81c4001030 con 0x7f81e80ba000 2024-03-30T13:10:58.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7f9702000640 1 -- 172.21.15.99:0/1172789436 shutdown_connections 2024-03-30T13:10:58.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.408+0000 7fee96c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee900b8910 0x7fee900b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7f9702000640 1 --2- 172.21.15.99:0/1172789436 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96fc0cee90 0x7f96fc0d42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.408+0000 7fee96c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee900c7c70 con 0x7fee900d2ab0 2024-03-30T13:10:58.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.408+0000 7fee96c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fee900b7e70 con 0x7fee900b69e0 2024-03-30T13:10:58.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.408+0000 7fee96c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fee900d50b0 con 0x7fee900b8910 2024-03-30T13:10:58.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7f9702000640 1 --2- 172.21.15.99:0/1172789436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96fc15e950 0x7f96fc0d2850 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.410+0000 7f9702000640 1 -- 172.21.15.99:0/1172789436 >> 172.21.15.99:0/1172789436 conn(0x7f96fc073060 msgr2=0x7f96fc073470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7fee8fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fee900b69e0 0x7fee900d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7fee8fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fee900b69e0 0x7fee900d2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38250/0 (socket says 172.21.15.99:38250) 2024-03-30T13:10:58.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7fee8fe00640 1 -- 172.21.15.99:0/3781578319 learned_addr learned my addr 172.21.15.99:0/3781578319 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.410+0000 7fee94c00640 1 --2- 172.21.15.99:0/3781578319 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee900b8910 0x7fee900b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7fab22600640 1 -- 172.21.15.99:0/1115466717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab1c15e780 msgr2=0x7fab1c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7fab22600640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab1c15e780 0x7fab1c0ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7fab22600640 1 -- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab1c0ba000 msgr2=0x7fab1c15f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7fab22600640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab1c0ba000 0x7fab1c15f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.409+0000 7fab22600640 1 -- 172.21.15.99:0/1115466717 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1c160a20 con 0x7fab1c161ac0 2024-03-30T13:10:58.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.410+0000 7fab22600640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab1c161ac0 0x7fab1c1566d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fab0800e560 tx=0x7fab0800ea20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.410+0000 7fee8fe00640 1 -- 172.21.15.99:0/3781578319 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee900b8910 msgr2=0x7fee900b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.410+0000 7fee8fe00640 1 --2- 172.21.15.99:0/3781578319 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee900b8910 0x7fee900b8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.410+0000 7fee8fe00640 1 -- 172.21.15.99:0/3781578319 >> v1:172.21.15.181:6789/0 conn(0x7fee900d2ab0 legacy=0x7fee900d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.410+0000 7fab21c00640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab1c0ba000 0x7fab1c15f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:58.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.411+0000 7fcca6a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc88004330 0x7fcc980e3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.410+0000 7f9702000640 1 -- 172.21.15.99:0/1172789436 shutdown_connections 2024-03-30T13:10:58.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.411+0000 7fab19600640 1 -- 172.21.15.99:0/1115466717 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08017070 con 0x7fab1c161ac0 2024-03-30T13:10:58.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.411+0000 7fab19600640 1 -- 172.21.15.99:0/1115466717 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab08004260 con 0x7fab1c161ac0 2024-03-30T13:10:58.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.411+0000 7fab19600640 1 -- 172.21.15.99:0/1115466717 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0800f040 con 0x7fab1c161ac0 2024-03-30T13:10:58.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.411+0000 7fab21200640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab1c15e780 0x7fab1c0ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.411+0000 7fab24600640 1 -- 172.21.15.99:0/1115466717 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab1c160d00 con 0x7fab1c161ac0 2024-03-30T13:10:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.412+0000 7fab24600640 1 -- 172.21.15.99:0/1115466717 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fab1c1612c0 con 0x7fab1c161ac0 2024-03-30T13:10:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.411+0000 7fcca6a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc9804c4b0 0x7fcc980d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.411+0000 7fcca6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc980d0cb0 0x7fcc980d37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.412+0000 7fcc9f400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc9804c4b0 0x7fcc980d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.412+0000 7fcc9f400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc9804c4b0 0x7fcc980d32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38350/0 (socket says 172.21.15.99:38350) 2024-03-30T13:10:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.412+0000 7fcc9f400640 1 -- 172.21.15.99:0/2029422092 learned_addr learned my addr 172.21.15.99:0/2029422092 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.412+0000 7fcca5400640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc980d0cb0 0x7fcc980d37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.412+0000 7fcca6a00640 1 -- 172.21.15.99:0/2029422092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcc980381b0 con 0x7fcc980d0cb0 2024-03-30T13:10:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.412+0000 7fcca6a00640 1 -- 172.21.15.99:0/2029422092 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcc98038520 con 0x7fcc88004330 2024-03-30T13:10:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.412+0000 7fcca6a00640 1 -- 172.21.15.99:0/2029422092 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcc98006f60 con 0x7fcc9804c4b0 2024-03-30T13:10:58.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.411+0000 7f9702000640 1 -- 172.21.15.99:0/1172789436 wait complete. 2024-03-30T13:10:58.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.411+0000 7fb123e00640 1 -- 172.21.15.99:0/1791042210 shutdown_connections 2024-03-30T13:10:58.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.413+0000 7fcc9f400640 1 -- 172.21.15.99:0/2029422092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc88004330 msgr2=0x7fcc980e3080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-30T13:10:58.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.413+0000 7fcc9f400640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc88004330 0x7fcc980e3080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.413+0000 7fcc9f400640 1 -- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc980d0cb0 msgr2=0x7fcc980d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.413+0000 7fcc9f400640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc980d0cb0 0x7fcc980d37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.413+0000 7fcc9f400640 1 -- 172.21.15.99:0/2029422092 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc980e25e0 con 0x7fcc9804c4b0 2024-03-30T13:10:58.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.411+0000 7fee8fe00640 1 -- 172.21.15.99:0/3781578319 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee900b8110 con 0x7fee900b69e0 2024-03-30T13:10:58.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.414+0000 7fcca5400640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc980d0cb0 0x7fcc980d37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:10:58.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.412+0000 7fb123e00640 1 -- 172.21.15.99:0/1791042210 wait complete. 2024-03-30T13:10:58.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.414+0000 7fb123e00640 1 Processor -- start 2024-03-30T13:10:58.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.415+0000 7fab24600640 1 -- 172.21.15.99:0/1115466717 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faaf8001030 con 0x7fab1c161ac0 2024-03-30T13:10:58.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.414+0000 7fcc9f400640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc9804c4b0 0x7fcc980d32b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcc94035040 tx=0x7fcc940036f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.415+0000 7fcc93e00640 1 -- 172.21.15.99:0/2029422092 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94037040 con 0x7fcc9804c4b0 2024-03-30T13:10:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.415+0000 7fcc93e00640 1 -- 172.21.15.99:0/2029422092 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc94007230 con 0x7fcc9804c4b0 2024-03-30T13:10:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.415+0000 7fcc93e00640 1 -- 172.21.15.99:0/2029422092 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc940039a0 con 0x7fcc9804c4b0 2024-03-30T13:10:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.415+0000 7fcca6a00640 1 -- 172.21.15.99:0/2029422092 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc98048a20 con 0x7fcc9804c4b0 2024-03-30T13:10:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.415+0000 7fcca6a00640 1 -- 172.21.15.99:0/2029422092 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc980e2880 con 0x7fcc9804c4b0 2024-03-30T13:10:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.414+0000 7fee8fe00640 1 --2- 172.21.15.99:0/3781578319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee900b69e0 0x7fee900d2570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee88009e50 tx=0x7fee8802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a96262dc517ca0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.414+0000 7fb123e00640 1 -- start start 2024-03-30T13:10:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.413+0000 7f9702000640 1 Processor -- start 2024-03-30T13:10:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.414+0000 7f9702000640 1 -- start start 2024-03-30T13:10:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.416+0000 7fb123e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240ccfe0 0x7fb1241542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.416+0000 7fee8ea00640 1 -- 172.21.15.99:0/3781578319 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8802cb00 con 0x7fee900b69e0 2024-03-30T13:10:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.417+0000 7fee8ea00640 1 -- 172.21.15.99:0/3781578319 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee8802cca0 con 0x7fee900b69e0 2024-03-30T13:10:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.417+0000 7fee8ea00640 1 -- 172.21.15.99:0/3781578319 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88034610 con 0x7fee900b69e0 2024-03-30T13:10:58.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.414+0000 7f81e5600640 1 -- 172.21.15.99:0/3947956208 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f81dc01a020 con 0x7f81e80ba000 2024-03-30T13:10:58.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.417+0000 7fab19600640 1 -- 172.21.15.99:0/1115466717 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fab08003610 con 0x7fab1c161ac0 2024-03-30T13:10:58.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.417+0000 7fb123e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1240ce5f0 0x7fb124157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.417+0000 7f81e5600640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f81c806c630 0x7f81c806eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.417+0000 7f81e5600640 1 -- 172.21.15.99:0/3947956208 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f81dc08b890 con 0x7f81e80ba000 2024-03-30T13:10:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.417+0000 7fb123e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12415a550 0x7fb1240cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.417+0000 7fb123e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb12406d790 con 0x7fb1240ccfe0 2024-03-30T13:10:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7fb122a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240ccfe0 0x7fb1241542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7fb123e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb1240ce9f0 con 0x7fb12415a550 2024-03-30T13:10:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7fb123e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb1240ad460 con 0x7fb1240ce5f0 2024-03-30T13:10:58.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.417+0000 7f9702000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96fc0cee90 0x7f96fc0ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7f81e5600640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] conn(0x7f81c80748b0 0x7f81c8076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7f81e5600640 1 -- 172.21.15.99:0/3947956208 --> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81dc010ec0 con 0x7f81c80748b0 2024-03-30T13:10:58.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7f81e5600640 1 -- 172.21.15.99:0/3947956208 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f81dc08bc80 con 0x7f81e80ba000 2024-03-30T13:10:58.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7fcc91600640 1 -- 172.21.15.99:0/2029422092 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc74001030 con 0x7fcc9804c4b0 2024-03-30T13:10:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7fb122a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240ccfe0 0x7fb1241542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38268/0 (socket says 172.21.15.99:38268) 2024-03-30T13:10:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7fb122a00640 1 -- 172.21.15.99:0/1756372180 learned_addr learned my addr 172.21.15.99:0/1756372180 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7fb123400640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12415a550 0x7fb1240cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7f81ee200640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] conn(0x7f81c80748b0 0x7f81c8076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7f81ece00640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f81c806c630 0x7f81c806eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7fee96c00640 1 -- 172.21.15.99:0/3781578319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee900b69e0 msgr2=0x7fee900d2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7fee96c00640 1 --2- 172.21.15.99:0/3781578319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee900b69e0 0x7fee900d2570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee88009e50 tx=0x7fee8802bf60 comp rx=0 tx=0).stop 2024-03-30T13:10:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.418+0000 7f9702000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96fc0d2d90 0x7f96fc15f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7f9702000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96fc15e950 0x7f96fc1fb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7f9702000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc0d47e0 con 0x7f96fc0cee90 2024-03-30T13:10:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7fee96c00640 1 -- 172.21.15.99:0/3781578319 shutdown_connections 2024-03-30T13:10:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7f9702000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc0b9220 con 0x7f96fc15e950 2024-03-30T13:10:58.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7f9702000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f96fc0d4960 con 0x7f96fc0d2d90 2024-03-30T13:10:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7fee96c00640 1 --2- 172.21.15.99:0/3781578319 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee900b8910 0x7fee900b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7fee96c00640 1 --2- 172.21.15.99:0/3781578319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee900b69e0 0x7fee900d2570 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7fee96c00640 1 -- 172.21.15.99:0/3781578319 >> 172.21.15.99:0/3781578319 conn(0x7fee9008bfc0 msgr2=0x7fee900d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7f9701600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96fc15e950 0x7f96fc1fb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7f9701600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96fc15e950 0x7f96fc1fb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49424/0 (socket says 172.21.15.99:49424) 2024-03-30T13:10:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7f9701600640 1 -- 172.21.15.99:0/310312806 learned_addr learned my addr 172.21.15.99:0/310312806 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7f81ee200640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] conn(0x7f81c80748b0 0x7f81c8076cd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.420+0000 7f81ece00640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f81c806c630 0x7f81c806eaf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81e815db70 tx=0x7f81d4007c80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.420+0000 7f9701600640 1 -- 172.21.15.99:0/310312806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96fc0d2d90 msgr2=0x7f96fc15f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.420+0000 7f9701600640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96fc0d2d90 0x7f96fc15f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.420+0000 7f9701600640 1 -- 172.21.15.99:0/310312806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96fc0cee90 msgr2=0x7f96fc0ca9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T13:10:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.420+0000 7f9701600640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96fc0cee90 0x7f96fc0ca9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.420+0000 7f9701600640 1 -- 172.21.15.99:0/310312806 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96fc15fc50 con 0x7f96fc15e950 2024-03-30T13:10:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.420+0000 7fee96c00640 1 -- 172.21.15.99:0/3781578319 shutdown_connections 2024-03-30T13:10:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.420+0000 7fee96c00640 1 -- 172.21.15.99:0/3781578319 wait complete. 2024-03-30T13:10:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.421+0000 7f9701600640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96fc15e950 0x7f96fc1fb4f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c3c0 tx=0x7f96e400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.421+0000 7f81e5600640 1 -- 172.21.15.99:0/3947956208 <== osd.2 v2:172.21.15.99:6806/1541384038 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f81dc010ec0 con 0x7f81c80748b0 2024-03-30T13:10:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.421+0000 7f96f8c00640 1 -- 172.21.15.99:0/310312806 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4017070 con 0x7f96fc15e950 2024-03-30T13:10:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.421+0000 7f96f8c00640 1 -- 172.21.15.99:0/310312806 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e4005ce0 con 0x7f96fc15e950 2024-03-30T13:10:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.419+0000 7fb122000640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1240ce5f0 0x7fb124157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.422+0000 7fb123400640 1 -- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1240ce5f0 msgr2=0x7fb124157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.422+0000 7fb123400640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1240ce5f0 0x7fb124157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.422+0000 7fb122000640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1240ce5f0 0x7fb124157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.422+0000 7fb123400640 1 -- 172.21.15.99:0/1756372180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240ccfe0 msgr2=0x7fb1241542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.422+0000 7fb123400640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240ccfe0 0x7fb1241542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.422+0000 7fb123400640 1 -- 172.21.15.99:0/1756372180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb124154830 con 0x7fb12415a550 2024-03-30T13:10:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.422+0000 7fb122a00640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240ccfe0 0x7fb1241542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:10:58.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.422+0000 7fee96c00640 1 Processor -- start 2024-03-30T13:10:58.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.422+0000 7fee96c00640 1 -- start start 2024-03-30T13:10:58.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.423+0000 7f96f8c00640 1 -- 172.21.15.99:0/310312806 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e40072d0 con 0x7f96fc15e950 2024-03-30T13:10:58.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.423+0000 7f9702000640 1 -- 172.21.15.99:0/310312806 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96fc15ff20 con 0x7f96fc15e950 2024-03-30T13:10:58.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.424+0000 7fee96c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee900b69e0 0x7fee901589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.424+0000 7fee96c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee900b8910 0x7fee900ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.424+0000 7fee96c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee900d2ab0 0x7fee900caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.424+0000 7fee96c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fee900cfe70 con 0x7fee900b8910 2024-03-30T13:10:58.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.424+0000 7fee96c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fee900d5390 con 0x7fee900b69e0 2024-03-30T13:10:58.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.424+0000 7fee96c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fee900cfff0 con 0x7fee900d2ab0 2024-03-30T13:10:58.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.424+0000 7f9702000640 1 -- 172.21.15.99:0/310312806 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96fc0c8050 con 0x7f96fc15e950 2024-03-30T13:10:58.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.424+0000 7fab19600640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7faafc06c600 0x7faafc06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.424+0000 7fee8f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee900b8910 0x7fee900ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.425+0000 7fb123400640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12415a550 0x7fb1240cb690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb11c007cf0 tx=0x7fb11c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.425+0000 7fab19600640 1 -- 172.21.15.99:0/1115466717 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fab0808b1a0 con 0x7fab1c161ac0 2024-03-30T13:10:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.423+0000 7fcc93e00640 1 -- 172.21.15.99:0/2029422092 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcc9403a070 con 0x7fcc9804c4b0 2024-03-30T13:10:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.425+0000 7fee8f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee900b8910 0x7fee900ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38282/0 (socket says 172.21.15.99:38282) 2024-03-30T13:10:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.425+0000 7fee8f400640 1 -- 172.21.15.99:0/2290255396 learned_addr learned my addr 172.21.15.99:0/2290255396 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.425+0000 7fab19600640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] conn(0x7faafc074820 0x7faafc076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.425+0000 7fcc93e00640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcc8006c600 0x7fcc8006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.425+0000 7fab19600640 1 -- 172.21.15.99:0/1115466717 --> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab0800dfc0 con 0x7faafc074820 2024-03-30T13:10:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.425+0000 7fab19600640 1 -- 172.21.15.99:0/1115466717 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fab08092050 con 0x7fab1c161ac0 2024-03-30T13:10:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.425+0000 7f9702000640 1 -- 172.21.15.99:0/310312806 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96fc04f8f0 con 0x7f96fc15e950 2024-03-30T13:10:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fb11aa00640 1 -- 172.21.15.99:0/1756372180 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c00edd0 con 0x7fb12415a550 2024-03-30T13:10:58.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fab21200640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] conn(0x7faafc074820 0x7faafc076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.425+0000 7fee94c00640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee900d2ab0 0x7fee900caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.425+0000 7fee8fe00640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee900b69e0 0x7fee901589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fcc93e00640 1 -- 172.21.15.99:0/2029422092 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcc940adc60 con 0x7fcc9804c4b0 2024-03-30T13:10:58.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fee8f400640 1 -- 172.21.15.99:0/2290255396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee900d2ab0 msgr2=0x7fee900caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fee8f400640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee900d2ab0 0x7fee900caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fee8f400640 1 -- 172.21.15.99:0/2290255396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee900b69e0 msgr2=0x7fee901589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fee8f400640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee900b69e0 0x7fee901589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fcc93e00640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] conn(0x7fcc80074820 0x7fcc80076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fee8f400640 1 -- 172.21.15.99:0/2290255396 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee900c6800 con 0x7fee900b8910 2024-03-30T13:10:58.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fb123e00640 1 -- 172.21.15.99:0/1756372180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb124157d40 con 0x7fb12415a550 2024-03-30T13:10:58.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fb123e00640 1 -- 172.21.15.99:0/1756372180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1241fc2c0 con 0x7fb12415a550 2024-03-30T13:10:58.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fcc93e00640 1 -- 172.21.15.99:0/2029422092 --> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc9402be50 con 0x7fcc80074820 2024-03-30T13:10:58.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fcc93e00640 1 -- 172.21.15.99:0/2029422092 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fcc940ae050 con 0x7fcc9804c4b0 2024-03-30T13:10:58.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fb11aa00640 1 -- 172.21.15.99:0/1756372180 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11c003990 con 0x7fb12415a550 2024-03-30T13:10:58.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fb11aa00640 1 -- 172.21.15.99:0/1756372180 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c003d80 con 0x7fb12415a550 2024-03-30T13:10:58.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.426+0000 7fee8f400640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee900b8910 0x7fee900ca4d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00c450 tx=0x7fee7c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.427+0000 7fcc9fe00640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcc8006c600 0x7fcc8006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.427+0000 7fee87e00640 1 -- 172.21.15.99:0/2290255396 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0052d0 con 0x7fee900b8910 2024-03-30T13:10:58.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.427+0000 7fee87e00640 1 -- 172.21.15.99:0/2290255396 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7c005470 con 0x7fee900b8910 2024-03-30T13:10:58.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.427+0000 7fee87e00640 1 -- 172.21.15.99:0/2290255396 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c012870 con 0x7fee900b8910 2024-03-30T13:10:58.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.427+0000 7fab21c00640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7faafc06c600 0x7faafc06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.428+0000 7fab21200640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] conn(0x7faafc074820 0x7faafc076c40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.428+0000 7fee96c00640 1 -- 172.21.15.99:0/2290255396 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee900c6ae0 con 0x7fee900b8910 2024-03-30T13:10:58.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.428+0000 7fee96c00640 1 -- 172.21.15.99:0/2290255396 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee90070fc0 con 0x7fee900b8910 2024-03-30T13:10:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.429+0000 7fcc9fe00640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcc8006c600 0x7fcc8006eac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000b60 tx=0x7fcca0074060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.429+0000 7fab21c00640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7faafc06c600 0x7faafc06eac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab14009bd0 tx=0x7fab14030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.430+0000 7fb123e00640 1 -- 172.21.15.99:0/1756372180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0fc001030 con 0x7fb12415a550 2024-03-30T13:10:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.430+0000 7fab19600640 1 -- 172.21.15.99:0/1115466717 <== osd.0 v2:172.21.15.99:6820/4232364975 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab0800dfc0 con 0x7faafc074820 2024-03-30T13:10:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.431+0000 7f96f8c00640 1 -- 172.21.15.99:0/310312806 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f96e401a070 con 0x7f96fc15e950 2024-03-30T13:10:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.432+0000 7fed95200640 1 -- 172.21.15.99:0/4024584554 --> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed900d0f50 con 0x7fed70074880 2024-03-30T13:10:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.429+0000 7fcca5400640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] conn(0x7fcc80074820 0x7fcc80076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.433+0000 7fcca5400640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] conn(0x7fcc80074820 0x7fcc80076c40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.431+0000 7fb11aa00640 1 -- 172.21.15.99:0/1756372180 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb11c01b020 con 0x7fb12415a550 2024-03-30T13:10:58.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.432+0000 7fb11aa00640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb10406c530 0x7fb10406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.432+0000 7fb11aa00640 1 -- 172.21.15.99:0/1756372180 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb11c08b730 con 0x7fb12415a550 2024-03-30T13:10:58.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.433+0000 7fee96c00640 1 -- 172.21.15.99:0/2290255396 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fee90070db0 con 0x7fee900b8910 2024-03-30T13:10:58.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.433+0000 7fed86000640 1 -- 172.21.15.99:0/4024584554 <== osd.1 v2:172.21.15.99:6818/3090465725 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fed900d0f50 con 0x7fed70074880 2024-03-30T13:10:58.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.433+0000 7fb122a00640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb10406c530 0x7fb10406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.433+0000 7fb11aa00640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] conn(0x7fb104074750 0x7fb104076b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.434+0000 7fb11aa00640 1 -- 172.21.15.99:0/1756372180 --> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb11c012e50 con 0x7fb104074750 2024-03-30T13:10:58.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.434+0000 7fb11aa00640 1 -- 172.21.15.99:0/1756372180 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb11c092050 con 0x7fb12415a550 2024-03-30T13:10:58.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.434+0000 7fed95200640 1 -- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] conn(0x7fed70074880 msgr2=0x7fed70076ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.434+0000 7fed95200640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] conn(0x7fed70074880 0x7fed70076ca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.435+0000 7fb122000640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] conn(0x7fb104074750 0x7fb104076b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.435+0000 7fed95200640 1 -- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed7006c600 msgr2=0x7fed7006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.435+0000 7fed95200640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed7006c600 0x7fed7006eac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fed90098f40 tx=0x7fed88007cd0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.435+0000 7fed95200640 1 -- 172.21.15.99:0/4024584554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed900cd280 msgr2=0x7fed9008f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.435+0000 7fed95200640 1 --2- 172.21.15.99:0/4024584554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed900cd280 0x7fed9008f9a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed8000d620 tx=0x7fed8000dae0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.435+0000 7fcc93e00640 1 -- 172.21.15.99:0/2029422092 <== osd.3 v2:172.21.15.99:6802/1545943262 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc9402be50 con 0x7fcc80074820 2024-03-30T13:10:58.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.435+0000 7fed8e800640 1 -- 172.21.15.99:0/4024584554 reap_dead start 2024-03-30T13:10:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.434+0000 7f96f8c00640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f96d806c5b0 0x7f96d806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.434+0000 7f96f8c00640 1 -- 172.21.15.99:0/310312806 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f96e408b1b0 con 0x7f96fc15e950 2024-03-30T13:10:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.434+0000 7f96f8c00640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] conn(0x7f96d8074830 0x7f96d8076c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.434+0000 7f9700c00640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f96d806c5b0 0x7f96d806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.435+0000 7fed95200640 1 -- 172.21.15.99:0/4024584554 shutdown_connections 2024-03-30T13:10:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.435+0000 7fed95200640 1 -- 172.21.15.99:0/4024584554 >> 172.21.15.99:0/4024584554 conn(0x7fed9006b510 msgr2=0x7fed900b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.435+0000 7f96f8c00640 1 -- 172.21.15.99:0/310312806 --> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96e400ee50 con 0x7f96d8074830 2024-03-30T13:10:58.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.435+0000 7f96f8c00640 1 -- 172.21.15.99:0/310312806 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f96e408b5a0 con 0x7f96fc15e950 2024-03-30T13:10:58.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.436+0000 7f96fbe00640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] conn(0x7f96d8074830 0x7f96d8076c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.436+0000 7fb122a00640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb10406c530 0x7fb10406e9f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb110004f20 tx=0x7fb110001450 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.436+0000 7fed95200640 1 -- 172.21.15.99:0/4024584554 shutdown_connections 2024-03-30T13:10:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.436+0000 7f9700c00640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f96d806c5b0 0x7f96d806ea70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96f4036000 tx=0x7f96f4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.436+0000 7fb122000640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] conn(0x7fb104074750 0x7fb104076b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.436+0000 7fed95200640 1 -- 172.21.15.99:0/4024584554 wait complete. 2024-03-30T13:10:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.437+0000 7f96fbe00640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] conn(0x7f96d8074830 0x7f96d8076c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.437+0000 7fee87e00640 1 -- 172.21.15.99:0/2290255396 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fee7c012a10 con 0x7fee900b8910 2024-03-30T13:10:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.439+0000 7fb11aa00640 1 -- 172.21.15.99:0/1756372180 <== osd.5 v2:172.21.15.181:6816/3756128771 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb11c012e50 con 0x7fb104074750 2024-03-30T13:10:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.439+0000 7fee87e00640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fee7006c600 0x7fee7006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.439+0000 7fee87e00640 1 -- 172.21.15.99:0/2290255396 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fee7c08b280 con 0x7fee900b8910 2024-03-30T13:10:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.439+0000 7fee87e00640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] conn(0x7fee70074880 0x7fee70076ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.440+0000 7fee87e00640 1 -- 172.21.15.99:0/2290255396 --> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee7c00ae50 con 0x7fee70074880 2024-03-30T13:10:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.440+0000 7fee87e00640 1 -- 172.21.15.99:0/2290255396 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fee7c092050 con 0x7fee900b8910 2024-03-30T13:10:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.440+0000 7fee8fe00640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fee7006c600 0x7fee7006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.440+0000 7f96f8c00640 1 -- 172.21.15.99:0/310312806 <== osd.4 v2:172.21.15.181:6800/599260275 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96e400ee50 con 0x7f96d8074830 2024-03-30T13:10:58.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.440+0000 7fee94c00640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] conn(0x7fee70074880 0x7fee70076ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.441+0000 7fee8fe00640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fee7006c600 0x7fee7006eac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee88035000 tx=0x7fee88030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.442+0000 7fee94c00640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] conn(0x7fee70074880 0x7fee70076ca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.445+0000 7fee87e00640 1 -- 172.21.15.99:0/2290255396 <== osd.6 v2:172.21.15.181:6808/2603803749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee7c00ae50 con 0x7fee70074880 2024-03-30T13:10:58.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.448+0000 7fdae5000640 1 Processor -- start 2024-03-30T13:10:58.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.453+0000 7f81f0200640 1 -- 172.21.15.99:0/3947956208 --> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f81c4002dd0 con 0x7f81c80748b0 2024-03-30T13:10:58.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.452+0000 7fdae5000640 1 -- start start 2024-03-30T13:10:58.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.454+0000 7fdae5000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdae015eb60 0x7fdae00cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.454+0000 7fdae5000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdae00ba000 0x7fdae00d2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.454+0000 7fdae5000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdae00cfe70 con 0x7fdae015e780 2024-03-30T13:10:58.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.454+0000 7fdae5000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fdae00b7f50 con 0x7fdae00ba000 2024-03-30T13:10:58.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.454+0000 7fdae5000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdae00b8230 con 0x7fdae015eb60 2024-03-30T13:10:58.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.454+0000 7fdad7e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdae015eb60 0x7fdae00cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.455+0000 7fdad7e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdae015eb60 0x7fdae00cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38386/0 (socket says 172.21.15.99:38386) 2024-03-30T13:10:58.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.455+0000 7fdad7e00640 1 -- 172.21.15.99:0/1318906363 learned_addr learned my addr 172.21.15.99:0/1318906363 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.455+0000 7f81e5600640 1 -- 172.21.15.99:0/3947956208 <== osd.2 v2:172.21.15.99:6806/1541384038 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f81c4002dd0 con 0x7f81c80748b0 2024-03-30T13:10:58.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.455+0000 7fdade800640 1 --2- 172.21.15.99:0/1318906363 >> v2:172.21.15.181:3300/0 conn(0x7fdae00ba000 0x7fdae00d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.455+0000 7fdad7e00640 1 -- 172.21.15.99:0/1318906363 >> v2:172.21.15.181:3300/0 conn(0x7fdae00ba000 msgr2=0x7fdae00d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.455+0000 7fdad7e00640 1 --2- 172.21.15.99:0/1318906363 >> v2:172.21.15.181:3300/0 conn(0x7fdae00ba000 0x7fdae00d2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.455+0000 7fdad7e00640 1 -- 172.21.15.99:0/1318906363 >> v1:172.21.15.181:6789/0 conn(0x7fdae015e780 legacy=0x7fdae00cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.458+0000 7f81f0200640 1 -- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] conn(0x7f81c80748b0 msgr2=0x7f81c8076cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.458+0000 7f81f0200640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] conn(0x7f81c80748b0 0x7f81c8076cd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.459+0000 7f81f0200640 1 -- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f81c806c630 msgr2=0x7f81c806eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.459+0000 7f81f0200640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f81c806c630 0x7f81c806eaf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81e815db70 tx=0x7f81d4007c80 comp rx=0 tx=0).stop 2024-03-30T13:10:58.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.459+0000 7f81f0200640 1 -- 172.21.15.99:0/3947956208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e80ba000 msgr2=0x7f81e814f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.459+0000 7f81f0200640 1 --2- 172.21.15.99:0/3947956208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e80ba000 0x7f81e814f800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c400 tx=0x7f81dc00c8c0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.459+0000 7f81ee200640 1 -- 172.21.15.99:0/3947956208 reap_dead start 2024-03-30T13:10:58.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.459+0000 7fcc91600640 1 -- 172.21.15.99:0/2029422092 --> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc74002dd0 con 0x7fcc80074820 2024-03-30T13:10:58.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.460+0000 7fcc93e00640 1 -- 172.21.15.99:0/2029422092 <== osd.3 v2:172.21.15.99:6802/1545943262 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcc74002dd0 con 0x7fcc80074820 2024-03-30T13:10:58.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.457+0000 7fdad7e00640 1 -- 172.21.15.99:0/1318906363 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae00b8510 con 0x7fdae015eb60 2024-03-30T13:10:58.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.458+0000 7fdade800640 1 --2- 172.21.15.99:0/1318906363 >> v2:172.21.15.181:3300/0 conn(0x7fdae00ba000 0x7fdae00d2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:58.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.458+0000 7fdad7e00640 1 --2- 172.21.15.99:0/1318906363 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdae015eb60 0x7fdae00cf2d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009870 tx=0x7fdac802b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f7c6db1261ba6e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.459+0000 7fdadd400640 1 -- 172.21.15.99:0/1318906363 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8034070 con 0x7fdae015eb60 2024-03-30T13:10:58.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.459+0000 7fdadd400640 1 -- 172.21.15.99:0/1318906363 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac8030860 con 0x7fdae015eb60 2024-03-30T13:10:58.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.459+0000 7fdadd400640 1 -- 172.21.15.99:0/1318906363 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8034070 con 0x7fdae015eb60 2024-03-30T13:10:58.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.460+0000 7fdae5000640 1 -- 172.21.15.99:0/1318906363 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdae015eb60 msgr2=0x7fdae00cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.460+0000 7fdae5000640 1 --2- 172.21.15.99:0/1318906363 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdae015eb60 0x7fdae00cf2d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009870 tx=0x7fdac802b9a0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.459+0000 7f81f0200640 1 -- 172.21.15.99:0/3947956208 shutdown_connections 2024-03-30T13:10:58.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.459+0000 7f81f0200640 1 -- 172.21.15.99:0/3947956208 >> 172.21.15.99:0/3947956208 conn(0x7f81e808bfc0 msgr2=0x7f81e806c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.460+0000 7f81f0200640 1 -- 172.21.15.99:0/3947956208 shutdown_connections 2024-03-30T13:10:58.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.460+0000 7f81f0200640 1 -- 172.21.15.99:0/3947956208 wait complete. 2024-03-30T13:10:58.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.461+0000 7fdae5000640 1 -- 172.21.15.99:0/1318906363 shutdown_connections 2024-03-30T13:10:58.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.461+0000 7fdae5000640 1 --2- 172.21.15.99:0/1318906363 >> v2:172.21.15.181:3300/0 conn(0x7fdae00ba000 0x7fdae00d2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.461+0000 7fdae5000640 1 --2- 172.21.15.99:0/1318906363 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdae015eb60 0x7fdae00cf2d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.461+0000 7fdae5000640 1 -- 172.21.15.99:0/1318906363 >> 172.21.15.99:0/1318906363 conn(0x7fdae008bfc0 msgr2=0x7fdae00d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.461+0000 7fab24600640 1 -- 172.21.15.99:0/1115466717 --> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faaf8002dd0 con 0x7faafc074820 2024-03-30T13:10:58.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.461+0000 7fdae5000640 1 -- 172.21.15.99:0/1318906363 shutdown_connections 2024-03-30T13:10:58.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.461+0000 7fdae5000640 1 -- 172.21.15.99:0/1318906363 wait complete. 2024-03-30T13:10:58.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.462+0000 7fab19600640 1 -- 172.21.15.99:0/1115466717 <== osd.0 v2:172.21.15.99:6820/4232364975 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faaf8002dd0 con 0x7faafc074820 2024-03-30T13:10:58.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.462+0000 7fcc91600640 1 -- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] conn(0x7fcc80074820 msgr2=0x7fcc80076c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.462+0000 7fcc91600640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] conn(0x7fcc80074820 0x7fcc80076c40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.463+0000 7fab0ea00640 1 -- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] conn(0x7faafc074820 msgr2=0x7faafc076c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.463+0000 7fab0ea00640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] conn(0x7faafc074820 0x7faafc076c40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.463+0000 7fcc91600640 1 -- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcc8006c600 msgr2=0x7fcc8006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.463+0000 7fcc91600640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcc8006c600 0x7fcc8006eac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000b60 tx=0x7fcca0074060 comp rx=0 tx=0).stop 2024-03-30T13:10:58.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.463+0000 7fcc91600640 1 -- 172.21.15.99:0/2029422092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc9804c4b0 msgr2=0x7fcc980d32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.463+0000 7fcc91600640 1 --2- 172.21.15.99:0/2029422092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc9804c4b0 0x7fcc980d32b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcc94035040 tx=0x7fcc940036f0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.463+0000 7fcca5400640 1 -- 172.21.15.99:0/2029422092 reap_dead start 2024-03-30T13:10:58.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.463+0000 7fcc91600640 1 -- 172.21.15.99:0/2029422092 shutdown_connections 2024-03-30T13:10:58.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.463+0000 7fcc91600640 1 -- 172.21.15.99:0/2029422092 >> 172.21.15.99:0/2029422092 conn(0x7fcc98054ca0 msgr2=0x7fcc980e8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.463+0000 7fcc91600640 1 -- 172.21.15.99:0/2029422092 shutdown_connections 2024-03-30T13:10:58.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fcc91600640 1 -- 172.21.15.99:0/2029422092 wait complete. 2024-03-30T13:10:58.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fab0ea00640 1 -- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7faafc06c600 msgr2=0x7faafc06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fab0ea00640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7faafc06c600 0x7faafc06eac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab14009bd0 tx=0x7fab14030000 comp rx=0 tx=0).stop 2024-03-30T13:10:58.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fab0ea00640 1 -- 172.21.15.99:0/1115466717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab1c161ac0 msgr2=0x7fab1c1566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fab0ea00640 1 --2- 172.21.15.99:0/1115466717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab1c161ac0 0x7fab1c1566d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fab0800e560 tx=0x7fab0800ea20 comp rx=0 tx=0).stop 2024-03-30T13:10:58.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fab22600640 1 -- 172.21.15.99:0/1115466717 reap_dead start 2024-03-30T13:10:58.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fdae5000640 1 Processor -- start 2024-03-30T13:10:58.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fab0ea00640 1 -- 172.21.15.99:0/1115466717 shutdown_connections 2024-03-30T13:10:58.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fab0ea00640 1 -- 172.21.15.99:0/1115466717 >> 172.21.15.99:0/1115466717 conn(0x7fab1c08bfc0 msgr2=0x7fab1c06ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fdae5000640 1 -- start start 2024-03-30T13:10:58.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fab0ea00640 1 -- 172.21.15.99:0/1115466717 shutdown_connections 2024-03-30T13:10:58.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.464+0000 7fab0ea00640 1 -- 172.21.15.99:0/1115466717 wait complete. 2024-03-30T13:10:58.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.465+0000 7fdae5000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae00ba000 0x7fdae009ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.466+0000 7fdae5000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdae015e780 0x7fdae015c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.466+0000 7fdae5000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae01f3f00 0x7fdae01f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.466+0000 7fdae5000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdae00cf810 con 0x7fdae01f3f00 2024-03-30T13:10:58.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.466+0000 7fdae5000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdae00b8ad0 con 0x7fdae00ba000 2024-03-30T13:10:58.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.466+0000 7fdae5000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdae00cf990 con 0x7fdae015e780 2024-03-30T13:10:58.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.466+0000 7fdade800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae01f3f00 0x7fdae01f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.466+0000 7fdade800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae01f3f00 0x7fdae01f4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38298/0 (socket says 172.21.15.99:38298) 2024-03-30T13:10:58.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.466+0000 7fdad7e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdae015e780 0x7fdae015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.466+0000 7fdadde00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae00ba000 0x7fdae009ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.466+0000 7fdade800640 1 -- 172.21.15.99:0/2346938682 learned_addr learned my addr 172.21.15.99:0/2346938682 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.467+0000 7fdade800640 1 -- 172.21.15.99:0/2346938682 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdae015e780 msgr2=0x7fdae015c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.467+0000 7fdade800640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdae015e780 0x7fdae015c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.467+0000 7fdade800640 1 -- 172.21.15.99:0/2346938682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae00ba000 msgr2=0x7fdae009ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.467+0000 7fdade800640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae00ba000 0x7fdae009ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.467+0000 7fdade800640 1 -- 172.21.15.99:0/2346938682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae01f48d0 con 0x7fdae01f3f00 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.467+0000 7fdadde00640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae00ba000 0x7fdae009ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.468+0000 7fdade800640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae01f3f00 0x7fdae01f4390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdad800cd50 tx=0x7fdad800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.469+0000 7fdad6000640 1 -- 172.21.15.99:0/2346938682 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad800f680 con 0x7fdae01f3f00 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.469+0000 7fdad6000640 1 -- 172.21.15.99:0/2346938682 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad800f840 con 0x7fdae01f3f00 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.469+0000 7fdad6000640 1 -- 172.21.15.99:0/2346938682 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad800fc30 con 0x7fdae01f3f00 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.469+0000 7fdae5000640 1 -- 172.21.15.99:0/2346938682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae00a0490 con 0x7fdae01f3f00 2024-03-30T13:10:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.469+0000 7fdae5000640 1 -- 172.21.15.99:0/2346938682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae009f6d0 con 0x7fdae01f3f00 2024-03-30T13:10:58.493 INFO:teuthology.orchestra.run.smithi099.stdout:68719476743 2024-03-30T13:10:58.493 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-30T13:10:58.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.471+0000 7fdae5000640 1 -- 172.21.15.99:0/2346938682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdae0068640 con 0x7fdae01f3f00 2024-03-30T13:10:58.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.474+0000 7fb123e00640 1 -- 172.21.15.99:0/1756372180 --> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb0fc002dd0 con 0x7fb104074750 2024-03-30T13:10:58.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.475+0000 7fdad6000640 1 -- 172.21.15.99:0/2346938682 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdad80213f0 con 0x7fdae01f3f00 2024-03-30T13:10:58.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.475+0000 7fb11aa00640 1 -- 172.21.15.99:0/1756372180 <== osd.5 v2:172.21.15.181:6816/3756128771 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb0fc002dd0 con 0x7fb104074750 2024-03-30T13:10:58.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.476+0000 7fb123e00640 1 -- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] conn(0x7fb104074750 msgr2=0x7fb104076b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.476+0000 7fb123e00640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] conn(0x7fb104074750 0x7fb104076b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fdad6000640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdabc06c630 0x7fdabc06eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fb123e00640 1 -- 172.21.15.99:0/1756372180 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb10406c530 msgr2=0x7fb10406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fb123e00640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb10406c530 0x7fb10406e9f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb110004f20 tx=0x7fb110001450 comp rx=0 tx=0).stop 2024-03-30T13:10:58.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fb123e00640 1 -- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12415a550 msgr2=0x7fb1240cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fb123e00640 1 --2- 172.21.15.99:0/1756372180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12415a550 0x7fb1240cb690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb11c007cf0 tx=0x7fb11c00e4b0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fdad6000640 1 -- 172.21.15.99:0/2346938682 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdad808c790 con 0x7fdae01f3f00 2024-03-30T13:10:58.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fb123400640 1 -- 172.21.15.99:0/1756372180 reap_dead start 2024-03-30T13:10:58.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fdad6000640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] conn(0x7fdabc0748b0 0x7fdabc076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fb123e00640 1 -- 172.21.15.99:0/1756372180 shutdown_connections 2024-03-30T13:10:58.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fb123e00640 1 -- 172.21.15.99:0/1756372180 >> 172.21.15.99:0/1756372180 conn(0x7fb1240b1c40 msgr2=0x7fb1240d06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fdad6000640 1 -- 172.21.15.99:0/2346938682 --> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdad801ee80 con 0x7fdabc0748b0 2024-03-30T13:10:58.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.477+0000 7fdad6000640 1 -- 172.21.15.99:0/2346938682 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fdad808cb80 con 0x7fdae01f3f00 2024-03-30T13:10:58.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.478+0000 7fb123e00640 1 -- 172.21.15.99:0/1756372180 shutdown_connections 2024-03-30T13:10:58.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.478+0000 7fdad7e00640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] conn(0x7fdabc0748b0 0x7fdabc076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.478+0000 7fb123e00640 1 -- 172.21.15.99:0/1756372180 wait complete. 2024-03-30T13:10:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.479+0000 7fdad7e00640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] conn(0x7fdabc0748b0 0x7fdabc076cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.479+0000 7fdadde00640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdabc06c630 0x7fdabc06eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.481+0000 7fdad6000640 1 -- 172.21.15.99:0/2346938682 <== osd.7 v2:172.21.15.181:6817/2806450372 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdad801ee80 con 0x7fdabc0748b0 2024-03-30T13:10:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.482+0000 7fdadde00640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdabc06c630 0x7fdabc06eaf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdad0000f60 tx=0x7fdad0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.485+0000 7fee96c00640 1 -- 172.21.15.99:0/2290255396 --> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fee90068640 con 0x7fee70074880 2024-03-30T13:10:58.500 INFO:teuthology.orchestra.run.smithi099.stdout:68719476743 2024-03-30T13:10:58.500 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-30T13:10:58.501 INFO:teuthology.orchestra.run.smithi099.stdout:68719476742 2024-03-30T13:10:58.502 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-30T13:10:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.487+0000 7fee87e00640 1 -- 172.21.15.99:0/2290255396 <== osd.6 v2:172.21.15.181:6808/2603803749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fee90068640 con 0x7fee70074880 2024-03-30T13:10:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.488+0000 7f9702000640 1 -- 172.21.15.99:0/310312806 --> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f96fc0d4340 con 0x7f96d8074830 2024-03-30T13:10:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.488+0000 7fee96c00640 1 -- 172.21.15.99:0/2290255396 >> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] conn(0x7fee70074880 msgr2=0x7fee70076ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.488+0000 7fee96c00640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] conn(0x7fee70074880 0x7fee70076ca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.488+0000 7fee96c00640 1 -- 172.21.15.99:0/2290255396 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fee7006c600 msgr2=0x7fee7006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.488+0000 7fee96c00640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fee7006c600 0x7fee7006eac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee88035000 tx=0x7fee88030000 comp rx=0 tx=0).stop 2024-03-30T13:10:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.488+0000 7fee96c00640 1 -- 172.21.15.99:0/2290255396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee900b8910 msgr2=0x7fee900ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.488+0000 7fee96c00640 1 --2- 172.21.15.99:0/2290255396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee900b8910 0x7fee900ca4d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00c450 tx=0x7fee7c00c910 comp rx=0 tx=0).stop 2024-03-30T13:10:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.488+0000 7fee94c00640 1 -- 172.21.15.99:0/2290255396 reap_dead start 2024-03-30T13:10:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.488+0000 7fee96c00640 1 -- 172.21.15.99:0/2290255396 shutdown_connections 2024-03-30T13:10:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.488+0000 7fee96c00640 1 -- 172.21.15.99:0/2290255396 >> 172.21.15.99:0/2290255396 conn(0x7fee9008bfc0 msgr2=0x7fee9006dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.489+0000 7f96f8c00640 1 -- 172.21.15.99:0/310312806 <== osd.4 v2:172.21.15.181:6800/599260275 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f96fc0d4340 con 0x7f96d8074830 2024-03-30T13:10:58.504 INFO:teuthology.orchestra.run.smithi099.stdout:68719476742 2024-03-30T13:10:58.505 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-30T13:10:58.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.489+0000 7f9702000640 1 -- 172.21.15.99:0/310312806 >> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] conn(0x7f96d8074830 msgr2=0x7f96d8076c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.489+0000 7f9702000640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] conn(0x7f96d8074830 0x7f96d8076c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.490+0000 7f9702000640 1 -- 172.21.15.99:0/310312806 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f96d806c5b0 msgr2=0x7f96d806ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.490+0000 7f9702000640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f96d806c5b0 0x7f96d806ea70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96f4036000 tx=0x7f96f4030000 comp rx=0 tx=0).stop 2024-03-30T13:10:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.490+0000 7f9702000640 1 -- 172.21.15.99:0/310312806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96fc15e950 msgr2=0x7f96fc1fb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.490+0000 7f9702000640 1 --2- 172.21.15.99:0/310312806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96fc15e950 0x7f96fc1fb4f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c3c0 tx=0x7f96e400c880 comp rx=0 tx=0).stop 2024-03-30T13:10:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.490+0000 7f9701600640 1 -- 172.21.15.99:0/310312806 reap_dead start 2024-03-30T13:10:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.490+0000 7f9702000640 1 -- 172.21.15.99:0/310312806 shutdown_connections 2024-03-30T13:10:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.490+0000 7f9702000640 1 -- 172.21.15.99:0/310312806 >> 172.21.15.99:0/310312806 conn(0x7f96fc073060 msgr2=0x7f96fc0cf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.489+0000 7fee96c00640 1 -- 172.21.15.99:0/2290255396 shutdown_connections 2024-03-30T13:10:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.490+0000 7fee96c00640 1 -- 172.21.15.99:0/2290255396 wait complete. 2024-03-30T13:10:58.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.490+0000 7f9702000640 1 -- 172.21.15.99:0/310312806 shutdown_connections 2024-03-30T13:10:58.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.490+0000 7f9702000640 1 -- 172.21.15.99:0/310312806 wait complete. 2024-03-30T13:10:58.508 INFO:teuthology.orchestra.run.smithi099.stdout:64424509448 2024-03-30T13:10:58.508 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-30T13:10:58.512 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-03-30T13:10:58.512 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-30T13:10:58.524 INFO:teuthology.orchestra.run.smithi099.stdout:64424509447 2024-03-30T13:10:58.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.511+0000 7fdae5000640 1 -- 172.21.15.99:0/2346938682 --> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdae00b6990 con 0x7fdabc0748b0 2024-03-30T13:10:58.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.512+0000 7fdad6000640 1 -- 172.21.15.99:0/2346938682 <== osd.7 v2:172.21.15.181:6817/2806450372 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdae00b6990 con 0x7fdabc0748b0 2024-03-30T13:10:58.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.512+0000 7fdae5000640 1 -- 172.21.15.99:0/2346938682 >> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] conn(0x7fdabc0748b0 msgr2=0x7fdabc076cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.512+0000 7fdae5000640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] conn(0x7fdabc0748b0 0x7fdabc076cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.512+0000 7fdae5000640 1 -- 172.21.15.99:0/2346938682 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdabc06c630 msgr2=0x7fdabc06eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.512+0000 7fdae5000640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdabc06c630 0x7fdabc06eaf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdad0000f60 tx=0x7fdad0009040 comp rx=0 tx=0).stop 2024-03-30T13:10:58.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.512+0000 7fdae5000640 1 -- 172.21.15.99:0/2346938682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae01f3f00 msgr2=0x7fdae01f4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.512+0000 7fdae5000640 1 --2- 172.21.15.99:0/2346938682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae01f3f00 0x7fdae01f4390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdad800cd50 tx=0x7fdad800a650 comp rx=0 tx=0).stop 2024-03-30T13:10:58.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.512+0000 7fdade800640 1 -- 172.21.15.99:0/2346938682 reap_dead start 2024-03-30T13:10:58.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.513+0000 7fdae5000640 1 -- 172.21.15.99:0/2346938682 shutdown_connections 2024-03-30T13:10:58.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.513+0000 7fdae5000640 1 -- 172.21.15.99:0/2346938682 >> 172.21.15.99:0/2346938682 conn(0x7fdae008bfc0 msgr2=0x7fdae0161890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.513+0000 7fdae5000640 1 -- 172.21.15.99:0/2346938682 shutdown_connections 2024-03-30T13:10:58.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.513+0000 7fdae5000640 1 -- 172.21.15.99:0/2346938682 wait complete. 2024-03-30T13:10:58.526 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-30T13:10:58.537 INFO:teuthology.orchestra.run.smithi099.stdout:60129542152 2024-03-30T13:10:58.537 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-30T13:10:58.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.815+0000 7fe47be00640 1 Processor -- start 2024-03-30T13:10:58.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.815+0000 7fe47be00640 1 -- start start 2024-03-30T13:10:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.817+0000 7fe47be00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe4740e7a50 0x7fe474049b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.817+0000 7fe47be00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe47404a0a0 0x7fe4740548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.817+0000 7fe47be00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4740e7e30 con 0x7fe474054de0 2024-03-30T13:10:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.817+0000 7fe47be00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe47403b5a0 con 0x7fe4740e7a50 2024-03-30T13:10:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.817+0000 7fe47be00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe47403b880 con 0x7fe47404a0a0 2024-03-30T13:10:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.819+0000 7fe47aa00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe4740e7a50 0x7fe474049b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.819+0000 7fe47aa00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe4740e7a50 0x7fe474049b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49456/0 (socket says 172.21.15.99:49456) 2024-03-30T13:10:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.819+0000 7fe47aa00640 1 -- 172.21.15.99:0/2994149252 learned_addr learned my addr 172.21.15.99:0/2994149252 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.820+0000 7fe47aa00640 1 -- 172.21.15.99:0/2994149252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe47404a0a0 msgr2=0x7fe4740548a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:10:58.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.820+0000 7fe47aa00640 1 --2- 172.21.15.99:0/2994149252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe47404a0a0 0x7fe4740548a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.820+0000 7fe47aa00640 1 -- 172.21.15.99:0/2994149252 >> v1:172.21.15.99:6789/0 conn(0x7fe474054de0 legacy=0x7fe47403c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.821+0000 7fe47aa00640 1 -- 172.21.15.99:0/2994149252 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47403bb60 con 0x7fe4740e7a50 2024-03-30T13:10:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.821+0000 7f8425e00640 1 Processor -- start 2024-03-30T13:10:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.821+0000 7f8425e00640 1 -- start start 2024-03-30T13:10:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.823+0000 7fe47aa00640 1 --2- 172.21.15.99:0/2994149252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4740e7a50 0x7fe474049b60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4680098a0 tx=0x7fe46802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=118297b563620e94 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.823+0000 7f8425e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f84200c5780 0x7f84200ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.823+0000 7f8425e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f842006e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.823+0000 7f8425e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8420099410 con 0x7f84200ccb40 2024-03-30T13:10:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.823+0000 7f8425e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8420163200 con 0x7f84200c5780 2024-03-30T13:10:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.823+0000 7f8425e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f842006e3a0 con 0x7f8420098be0 2024-03-30T13:10:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.824+0000 7f5d0dc00640 1 Processor -- start 2024-03-30T13:10:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.824+0000 7fe479600640 1 -- 172.21.15.99:0/2994149252 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe468035020 con 0x7fe4740e7a50 2024-03-30T13:10:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.824+0000 7f841f400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f842006e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.824+0000 7f841f400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f842006e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38402/0 (socket says 172.21.15.99:38402) 2024-03-30T13:10:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.824+0000 7f841f400640 1 -- 172.21.15.99:0/501407827 learned_addr learned my addr 172.21.15.99:0/501407827 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.824+0000 7f5d0dc00640 1 -- start start 2024-03-30T13:10:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.824+0000 7fe479600640 1 -- 172.21.15.99:0/2994149252 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe468031870 con 0x7fe4740e7a50 2024-03-30T13:10:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.824+0000 7fe479600640 1 -- 172.21.15.99:0/2994149252 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe468031c40 con 0x7fe4740e7a50 2024-03-30T13:10:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.825+0000 7f841f400640 1 -- 172.21.15.99:0/501407827 >> v2:172.21.15.99:3300/0 conn(0x7f84200c5780 msgr2=0x7f84200ca7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:10:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.825+0000 7f841f400640 1 --2- 172.21.15.99:0/501407827 >> v2:172.21.15.99:3300/0 conn(0x7f84200c5780 0x7f84200ca7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.825+0000 7f841f400640 1 -- 172.21.15.99:0/501407827 >> v1:172.21.15.181:6789/0 conn(0x7f84200ccb40 legacy=0x7f84200ccf20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:10:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.825+0000 7f841f400640 1 -- 172.21.15.99:0/501407827 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84200996f0 con 0x7f8420098be0 2024-03-30T13:10:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.826+0000 7fe47be00640 1 -- 172.21.15.99:0/2994149252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4740e7a50 msgr2=0x7fe474049b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.826+0000 7fe47be00640 1 --2- 172.21.15.99:0/2994149252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4740e7a50 0x7fe474049b60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4680098a0 tx=0x7fe46802b910 comp rx=0 tx=0).stop 2024-03-30T13:10:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.826+0000 7f5d0dc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5d081605e0 0x7f5d080b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.826+0000 7f5d0dc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5d080c5020 0x7f5d080c5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.826+0000 7f5d0dc00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d081609c0 con 0x7f5d080ccb70 2024-03-30T13:10:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.826+0000 7f5d0dc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f5d080add40 con 0x7f5d080c5020 2024-03-30T13:10:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.826+0000 7f5d0dc00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5d080ad130 con 0x7f5d081605e0 2024-03-30T13:10:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.827+0000 7fe47be00640 1 -- 172.21.15.99:0/2994149252 shutdown_connections 2024-03-30T13:10:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.827+0000 7f5d06000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5d080ccb70 0x7f5d080ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:34858/0 (socket says 172.21.15.99:34858) 2024-03-30T13:10:58.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.827+0000 7f5d06000640 1 -- 172.21.15.99:0/1984691142 learned_addr learned my addr 172.21.15.99:0/1984691142 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:58.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.827+0000 7f5d07400640 1 --2- 172.21.15.99:0/1984691142 >> v2:172.21.15.99:3300/0 conn(0x7f5d080c5020 0x7f5d080c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.827+0000 7fe47be00640 1 --2- 172.21.15.99:0/2994149252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe47404a0a0 0x7fe4740548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.827+0000 7fe47be00640 1 --2- 172.21.15.99:0/2994149252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4740e7a50 0x7fe474049b60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.827+0000 7fe47be00640 1 -- 172.21.15.99:0/2994149252 >> 172.21.15.99:0/2994149252 conn(0x7fe474056cd0 msgr2=0x7fe4740570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.827+0000 7fe47be00640 1 -- 172.21.15.99:0/2994149252 shutdown_connections 2024-03-30T13:10:58.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.828+0000 7f841f400640 1 --2- 172.21.15.99:0/501407827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f842006e830 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8410009870 tx=0x7f841002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39f77f3a67c998 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.828+0000 7fe47be00640 1 -- 172.21.15.99:0/2994149252 wait complete. 2024-03-30T13:10:58.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.828+0000 7f5d05600640 1 -- 172.21.15.99:0/1984691142 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878682210 0 0) 0x7f5d081609c0 con 0x7f5d080ccb70 2024-03-30T13:10:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.828+0000 7f5d07400640 1 -- 172.21.15.99:0/1984691142 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5d081605e0 msgr2=0x7f5d080b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.828+0000 7f5d07400640 1 --2- 172.21.15.99:0/1984691142 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5d081605e0 0x7f5d080b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.828+0000 7f5d07400640 1 -- 172.21.15.99:0/1984691142 >> v1:172.21.15.181:6789/0 conn(0x7f5d080ccb70 legacy=0x7f5d080ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.828+0000 7f5d07400640 1 -- 172.21.15.99:0/1984691142 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d080ad410 con 0x7f5d080c5020 2024-03-30T13:10:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.829+0000 7f841d600640 1 -- 172.21.15.99:0/501407827 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410035020 con 0x7f8420098be0 2024-03-30T13:10:58.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.830+0000 7f841d600640 1 -- 172.21.15.99:0/501407827 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8410031870 con 0x7f8420098be0 2024-03-30T13:10:58.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.830+0000 7f841d600640 1 -- 172.21.15.99:0/501407827 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410031c40 con 0x7f8420098be0 2024-03-30T13:10:58.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.830+0000 7f5d07400640 1 --2- 172.21.15.99:0/1984691142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d080c5020 0x7f5d080c5470 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000b050 tx=0x7f5d0002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3e29be0554f98d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.831+0000 7f5d05600640 1 -- 172.21.15.99:0/1984691142 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d00039070 con 0x7f5d080c5020 2024-03-30T13:10:58.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.831+0000 7f8425e00640 1 -- 172.21.15.99:0/501407827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 msgr2=0x7f842006e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.831+0000 7f8425e00640 1 --2- 172.21.15.99:0/501407827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f842006e830 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8410009870 tx=0x7f841002b910 comp rx=0 tx=0).stop 2024-03-30T13:10:58.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.831+0000 7fa585200640 1 Processor -- start 2024-03-30T13:10:58.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.831+0000 7f5d05600640 1 -- 172.21.15.99:0/1984691142 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d0002cc10 con 0x7f5d080c5020 2024-03-30T13:10:58.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.831+0000 7f5d05600640 1 -- 172.21.15.99:0/1984691142 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d00034440 con 0x7f5d080c5020 2024-03-30T13:10:58.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.832+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1984691142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d080c5020 msgr2=0x7f5d080c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.832+0000 7f5d0dc00640 1 --2- 172.21.15.99:0/1984691142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d080c5020 0x7f5d080c5470 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000b050 tx=0x7f5d0002c070 comp rx=0 tx=0).stop 2024-03-30T13:10:58.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.832+0000 7f8425e00640 1 -- 172.21.15.99:0/501407827 shutdown_connections 2024-03-30T13:10:58.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.832+0000 7f8425e00640 1 --2- 172.21.15.99:0/501407827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f842006e830 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.832+0000 7f8425e00640 1 --2- 172.21.15.99:0/501407827 >> v2:172.21.15.99:3300/0 conn(0x7f84200c5780 0x7f84200ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.832+0000 7f8425e00640 1 -- 172.21.15.99:0/501407827 >> 172.21.15.99:0/501407827 conn(0x7f8420072ba0 msgr2=0x7f8420072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.832+0000 7fe47be00640 1 Processor -- start 2024-03-30T13:10:58.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.832+0000 7fe47be00640 1 -- start start 2024-03-30T13:10:58.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.833+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1984691142 shutdown_connections 2024-03-30T13:10:58.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.833+0000 7f5d0dc00640 1 --2- 172.21.15.99:0/1984691142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d080c5020 0x7f5d080c5470 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.833+0000 7f5d0dc00640 1 --2- 172.21.15.99:0/1984691142 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5d081605e0 0x7f5d080b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.833+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1984691142 >> 172.21.15.99:0/1984691142 conn(0x7f5d0806b510 msgr2=0x7f5d0806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.831+0000 7fa585200640 1 -- start start 2024-03-30T13:10:58.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.833+0000 7fa585200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5800b30b0 0x7fa5800c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.834+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1984691142 shutdown_connections 2024-03-30T13:10:58.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.833+0000 7fa585200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5801609c0 con 0x7fa5800cd280 2024-03-30T13:10:58.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.833+0000 7fa585200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5800ad130 con 0x7fa5801605e0 2024-03-30T13:10:58.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.833+0000 7fa585200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa5800add40 con 0x7fa5800b30b0 2024-03-30T13:10:58.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.834+0000 7fa57d400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa5800cd280 0x7fa5800c5020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56688/0 (socket says 172.21.15.99:56688) 2024-03-30T13:10:58.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.834+0000 7fa57d400640 1 -- 172.21.15.99:0/3000690798 learned_addr learned my addr 172.21.15.99:0/3000690798 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:58.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.834+0000 7f8425e00640 1 -- 172.21.15.99:0/501407827 shutdown_connections 2024-03-30T13:10:58.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.834+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3591459957 0 0) 0x7fa5801609c0 con 0x7fa5800cd280 2024-03-30T13:10:58.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.834+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa564003520 con 0x7fa5800cd280 2024-03-30T13:10:58.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.834+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1984691142 wait complete. 2024-03-30T13:10:58.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.834+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2247178581 0 0) 0x7fa5800ad130 con 0x7fa5801605e0 2024-03-30T13:10:58.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.834+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5801609c0 con 0x7fa5801605e0 2024-03-30T13:10:58.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.834+0000 7fa57e800640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5800b30b0 0x7fa5800c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.835+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3858835731 0 0) 0x7fa5801609c0 con 0x7fa5801605e0 2024-03-30T13:10:58.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.835+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5800b30b0 msgr2=0x7fa5800c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.835+0000 7fa57ca00640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5800b30b0 0x7fa5800c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.835+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 >> v1:172.21.15.99:6789/0 conn(0x7fa5800cd280 legacy=0x7fa5800c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.834+0000 7f8425e00640 1 -- 172.21.15.99:0/501407827 wait complete. 2024-03-30T13:10:58.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fe47be00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe47404a0a0 0x7fe47404e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fe47be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe474054de0 0x7fe4740cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fe47be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4740e7a50 0x7fe4740d6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fe47be00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe474039cb0 con 0x7fe474054de0 2024-03-30T13:10:58.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fe47be00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe47404a5b0 con 0x7fe4740e7a50 2024-03-30T13:10:58.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fe47be00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe474039e30 con 0x7fe47404a0a0 2024-03-30T13:10:58.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.835+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5800ad410 con 0x7fa5801605e0 2024-03-30T13:10:58.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fa570001670 con 0x7fa5801605e0 2024-03-30T13:10:58.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 >> v1:172.21.15.181:6789/0 conn(0x7fa5801605e0 legacy=0x7fa5800ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fa57ca00640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 0x7fa564004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fa57ca00640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5800b30b0 0x7fa5640037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fa57ca00640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa564003ce0 0x7fa564004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa5800add40 con 0x7fa564004bd0 2024-03-30T13:10:58.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa56400bb50 con 0x7fa564003ce0 2024-03-30T13:10:58.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa56400bd50 con 0x7fa5800b30b0 2024-03-30T13:10:58.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.836+0000 7f8425e00640 1 Processor -- start 2024-03-30T13:10:58.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.837+0000 7fa57de00640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 0x7fa564004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.837+0000 7fe47a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe474054de0 0x7fe4740cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.837+0000 7fe47a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe474054de0 0x7fe4740cb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38306/0 (socket says 172.21.15.99:38306) 2024-03-30T13:10:58.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.837+0000 7fe47a000640 1 -- 172.21.15.99:0/1554447030 learned_addr learned my addr 172.21.15.99:0/1554447030 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.837+0000 7fa57de00640 1 -- 172.21.15.99:0/3000690798 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5800b30b0 msgr2=0x7fa5640037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.837+0000 7fa57de00640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5800b30b0 0x7fa5640037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.837+0000 7fa57de00640 1 -- 172.21.15.99:0/3000690798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa564003ce0 msgr2=0x7fa564004160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.837+0000 7fa57e800640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa564003ce0 0x7fa564004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.837+0000 7f8425e00640 1 -- start start 2024-03-30T13:10:58.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7fa57de00640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa564003ce0 0x7fa564004160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.837+0000 7fe47aa00640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe47404a0a0 0x7fe47404e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.837+0000 7f5d0dc00640 1 Processor -- start 2024-03-30T13:10:58.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7f5d0dc00640 1 -- start start 2024-03-30T13:10:58.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7fa57de00640 1 -- 172.21.15.99:0/3000690798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5800ad410 con 0x7fa564004bd0 2024-03-30T13:10:58.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7f8425e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f8420152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7f8425e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84200c5780 0x7f8420150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7f8425e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84200ccb40 0x7f84200c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7f8425e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8420099070 con 0x7f84200ccb40 2024-03-30T13:10:58.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7f8425e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8420099cb0 con 0x7f84200c5780 2024-03-30T13:10:58.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7f8425e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f84200991f0 con 0x7f8420098be0 2024-03-30T13:10:58.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7fe47b400640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4740e7a50 0x7fe4740d6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7fe47a000640 1 -- 172.21.15.99:0/1554447030 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe47404a0a0 msgr2=0x7fe47404e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7fe47a000640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe47404a0a0 0x7fe47404e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7fe47a000640 1 -- 172.21.15.99:0/1554447030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4740e7a50 msgr2=0x7fe4740d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7fe47a000640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4740e7a50 0x7fe4740d6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.838+0000 7fe47a000640 1 -- 172.21.15.99:0/1554447030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4740d4f70 con 0x7fe474054de0 2024-03-30T13:10:58.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.839+0000 7fe47a000640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe474054de0 0x7fe4740cb4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00b410 tx=0x7fe46c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.839+0000 7f841e000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84200c5780 0x7f8420150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.839+0000 7f7cad600640 1 Processor -- start 2024-03-30T13:10:58.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.839+0000 7fa57e800640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa564003ce0 0x7fa564004160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:58.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.839+0000 7f841ea00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f8420152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.839+0000 7f841ea00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f8420152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38440/0 (socket says 172.21.15.99:38440) 2024-03-30T13:10:58.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.839+0000 7f841ea00640 1 -- 172.21.15.99:0/3741119233 learned_addr learned my addr 172.21.15.99:0/3741119233 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.839+0000 7f841f400640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84200ccb40 0x7f84200c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f5d0dc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d080c5020 0x7f5d080cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f5d0dc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5d080ccb70 0x7f5d081fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f7cad600640 1 -- start start 2024-03-30T13:10:58.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f841ea00640 1 -- 172.21.15.99:0/3741119233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84200c5780 msgr2=0x7f8420150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7fcefdc00640 1 Processor -- start 2024-03-30T13:10:58.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f841ea00640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84200c5780 0x7f8420150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7fcefdc00640 1 -- start start 2024-03-30T13:10:58.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f841ea00640 1 -- 172.21.15.99:0/3741119233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84200ccb40 msgr2=0x7f84200c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f841ea00640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84200ccb40 0x7f84200c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f841ea00640 1 -- 172.21.15.99:0/3741119233 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84200b0ed0 con 0x7f8420098be0 2024-03-30T13:10:58.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f841f400640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84200ccb40 0x7f84200c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:58.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f5d0dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d081605e0 0x7f5d081512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f5d0dc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080c59b0 con 0x7f5d081605e0 2024-03-30T13:10:58.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f5d0dc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080ad9d0 con 0x7f5d080c5020 2024-03-30T13:10:58.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.840+0000 7f5d0dc00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5d080c5b30 con 0x7f5d080ccb70 2024-03-30T13:10:58.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7f5d06a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d080c5020 0x7f5d080cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7f5d06000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5d080ccb70 0x7f5d081fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7f5d06a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d080c5020 0x7f5d080cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49478/0 (socket says 172.21.15.99:49478) 2024-03-30T13:10:58.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7f5d06a00640 1 -- 172.21.15.99:0/1163340171 learned_addr learned my addr 172.21.15.99:0/1163340171 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7fa57de00640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 0x7fa564004fb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa57000c190 tx=0x7fa564005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342669353af182c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7fe472a00640 1 -- 172.21.15.99:0/1554447030 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c015020 con 0x7fe474054de0 2024-03-30T13:10:58.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7fe472a00640 1 -- 172.21.15.99:0/1554447030 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46c011830 con 0x7fe474054de0 2024-03-30T13:10:58.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7f7cad600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7ca00ead00 0x7f7ca004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7fe472a00640 1 -- 172.21.15.99:0/1554447030 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c015020 con 0x7fe474054de0 2024-03-30T13:10:58.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7f7cad600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7ca0006ea0 0x7f7ca0007310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570039070 con 0x7fa564004bd0 2024-03-30T13:10:58.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa57002c9e0 con 0x7fa564004bd0 2024-03-30T13:10:58.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7fa57ca00640 1 -- 172.21.15.99:0/3000690798 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570007c40 con 0x7fa564004bd0 2024-03-30T13:10:58.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7f7cad600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca0053720 con 0x7f7ca004ffd0 2024-03-30T13:10:58.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7f7cad600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7ca0007850 con 0x7f7ca0006ea0 2024-03-30T13:10:58.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.841+0000 7f7cad600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7ca0054330 con 0x7f7ca00ead00 2024-03-30T13:10:58.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7f7ca7400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7ca004ffd0 0x7f7ca0037bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:34878/0 (socket says 172.21.15.99:34878) 2024-03-30T13:10:58.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7f7ca7400640 1 -- 172.21.15.99:0/408661398 learned_addr learned my addr 172.21.15.99:0/408661398 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:58.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7fcefdc00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcef81621c0 0x7fcef806bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7fcefdc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcef80b3a20 0x7fcef81625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7fcefdc00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcef8162ae0 con 0x7fcef80ce340 2024-03-30T13:10:58.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7fcefdc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fcef806c460 con 0x7fcef80b3a20 2024-03-30T13:10:58.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7fcefdc00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fcef80c7a40 con 0x7fcef81621c0 2024-03-30T13:10:58.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.843+0000 7fe47be00640 1 -- 172.21.15.99:0/1554447030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4740d5250 con 0x7fe474054de0 2024-03-30T13:10:58.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7f5d06a00640 1 -- 172.21.15.99:0/1163340171 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5d080ccb70 msgr2=0x7f5d081fbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7f5d06a00640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5d080ccb70 0x7f5d081fbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7f5d06a00640 1 -- 172.21.15.99:0/1163340171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d081605e0 msgr2=0x7f5d081512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7f5d06a00640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d081605e0 0x7f5d081512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.842+0000 7f5d06a00640 1 -- 172.21.15.99:0/1163340171 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0806d860 con 0x7f5d080c5020 2024-03-30T13:10:58.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.843+0000 7f7cacc00640 1 --2- 172.21.15.99:0/408661398 >> v2:172.21.15.99:3300/0 conn(0x7f7ca0006ea0 0x7f7ca0007310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.843+0000 7fa585200640 1 -- 172.21.15.99:0/3000690798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 msgr2=0x7fa564004fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.843+0000 7fa585200640 1 --2- 172.21.15.99:0/3000690798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 0x7fa564004fb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa57000c190 tx=0x7fa564005830 comp rx=0 tx=0).stop 2024-03-30T13:10:58.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.843+0000 7fa57e800640 1 -- 172.21.15.99:0/3000690798 reap_dead start 2024-03-30T13:10:58.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.843+0000 7fa585200640 1 -- 172.21.15.99:0/3000690798 shutdown_connections 2024-03-30T13:10:58.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.843+0000 7fa585200640 1 -- 172.21.15.99:0/3000690798 >> 172.21.15.99:0/3000690798 conn(0x7fa58006b510 msgr2=0x7fa58006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.843+0000 7f7ca6a00640 1 -- 172.21.15.99:0/408661398 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292651549 0 0) 0x7f7ca0053720 con 0x7f7ca004ffd0 2024-03-30T13:10:58.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.843+0000 7f7ca6a00640 1 -- 172.21.15.99:0/408661398 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c90003520 con 0x7f7ca004ffd0 2024-03-30T13:10:58.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.843+0000 7f7ca7e00640 1 --2- 172.21.15.99:0/408661398 >> v2:172.21.15.181:3300/0 conn(0x7f7ca00ead00 0x7f7ca004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7fa585200640 1 -- 172.21.15.99:0/3000690798 shutdown_connections 2024-03-30T13:10:58.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7fe47be00640 1 -- 172.21.15.99:0/1554447030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4740d5810 con 0x7fe474054de0 2024-03-30T13:10:58.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7fcef7400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcef80b3a20 0x7fcef81625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7fcef7400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcef80b3a20 0x7fcef81625a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38350/0 (socket says 172.21.15.99:38350) 2024-03-30T13:10:58.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7fcef7400640 1 -- 172.21.15.99:0/1613032858 learned_addr learned my addr 172.21.15.99:0/1613032858 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.843+0000 7f841ea00640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f8420152a00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f840c00b3e0 tx=0x7f840c00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.845+0000 7fcef7e00640 1 --2- 172.21.15.99:0/1613032858 >> v2:172.21.15.181:3300/0 conn(0x7fcef81621c0 0x7fcef806bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.845+0000 7f8417400640 1 -- 172.21.15.99:0/3741119233 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c015020 con 0x7f8420098be0 2024-03-30T13:10:58.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.845+0000 7f8417400640 1 -- 172.21.15.99:0/3741119233 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c011850 con 0x7f8420098be0 2024-03-30T13:10:58.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.845+0000 7f8425e00640 1 -- 172.21.15.99:0/3741119233 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84200b11b0 con 0x7f8420098be0 2024-03-30T13:10:58.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.845+0000 7fe47be00640 1 -- 172.21.15.99:0/1554447030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4740057e0 con 0x7fe474054de0 2024-03-30T13:10:58.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7f5d06a00640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d080c5020 0x7f5d080cdce0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800b4a0 tx=0x7f5cf800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7f7cacc00640 1 -- 172.21.15.99:0/408661398 >> v2:172.21.15.181:3300/0 conn(0x7f7ca00ead00 msgr2=0x7f7ca004fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7f7cacc00640 1 --2- 172.21.15.99:0/408661398 >> v2:172.21.15.181:3300/0 conn(0x7f7ca00ead00 0x7f7ca004fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7f7cacc00640 1 -- 172.21.15.99:0/408661398 >> v1:172.21.15.181:6789/0 conn(0x7f7ca004ffd0 legacy=0x7f7ca0037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7f7cacc00640 1 -- 172.21.15.99:0/408661398 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca0053a00 con 0x7f7ca0006ea0 2024-03-30T13:10:58.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7f7ca7e00640 1 --2- 172.21.15.99:0/408661398 >> v2:172.21.15.181:3300/0 conn(0x7f7ca00ead00 0x7f7ca004fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:58.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.846+0000 7f5cfea00640 1 -- 172.21.15.99:0/1163340171 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8014070 con 0x7f5d080c5020 2024-03-30T13:10:58.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.846+0000 7f5cfea00640 1 -- 172.21.15.99:0/1163340171 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf8010610 con 0x7f5d080c5020 2024-03-30T13:10:58.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.846+0000 7f5cfea00640 1 -- 172.21.15.99:0/1163340171 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf80109e0 con 0x7f5d080c5020 2024-03-30T13:10:58.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.846+0000 7f7cacc00640 1 --2- 172.21.15.99:0/408661398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ca0006ea0 0x7f7ca0007310 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0007a60 tx=0x7f7c9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfc24490774898b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.846+0000 7fcef6a00640 1 -- 172.21.15.99:0/1613032858 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195010434 0 0) 0x7fcef8162ae0 con 0x7fcef80ce340 2024-03-30T13:10:58.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.846+0000 7fcef6a00640 1 -- 172.21.15.99:0/1613032858 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcedc003520 con 0x7fcef80ce340 2024-03-30T13:10:58.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.846+0000 7fcef7400640 1 -- 172.21.15.99:0/1613032858 >> v2:172.21.15.181:3300/0 conn(0x7fcef81621c0 msgr2=0x7fcef806bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.846+0000 7fcef7400640 1 --2- 172.21.15.99:0/1613032858 >> v2:172.21.15.181:3300/0 conn(0x7fcef81621c0 0x7fcef806bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.846+0000 7fcef7400640 1 -- 172.21.15.99:0/1613032858 >> v1:172.21.15.181:6789/0 conn(0x7fcef80ce340 legacy=0x7fcef80cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.846+0000 7fcef7400640 1 -- 172.21.15.99:0/1613032858 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef80c7d20 con 0x7fcef80b3a20 2024-03-30T13:10:58.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.847+0000 7f8425e00640 1 -- 172.21.15.99:0/3741119233 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84200b1770 con 0x7f8420098be0 2024-03-30T13:10:58.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.847+0000 7f7ca6a00640 1 -- 172.21.15.99:0/408661398 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94035020 con 0x7f7ca0006ea0 2024-03-30T13:10:58.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.847+0000 7f7ca6a00640 1 -- 172.21.15.99:0/408661398 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c94031830 con 0x7f7ca0006ea0 2024-03-30T13:10:58.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.844+0000 7fa585200640 1 -- 172.21.15.99:0/3000690798 wait complete. 2024-03-30T13:10:58.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.847+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1163340171 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d080d0490 con 0x7f5d080c5020 2024-03-30T13:10:58.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.847+0000 7fa585200640 1 Processor -- start 2024-03-30T13:10:58.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.848+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1163340171 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d080d0a50 con 0x7f5d080c5020 2024-03-30T13:10:58.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.847+0000 7fa585200640 1 -- start start 2024-03-30T13:10:58.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.847+0000 7f7ca6a00640 1 -- 172.21.15.99:0/408661398 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94035020 con 0x7f7ca0006ea0 2024-03-30T13:10:58.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.848+0000 7f7cad600640 1 -- 172.21.15.99:0/408661398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ca0006ea0 msgr2=0x7f7ca0007310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.848+0000 7f7cad600640 1 --2- 172.21.15.99:0/408661398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ca0006ea0 0x7f7ca0007310 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0007a60 tx=0x7f7c9402b8d0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.849+0000 7f7cad600640 1 -- 172.21.15.99:0/408661398 shutdown_connections 2024-03-30T13:10:58.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.849+0000 7f7cad600640 1 --2- 172.21.15.99:0/408661398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ca0006ea0 0x7f7ca0007310 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.849+0000 7f7cad600640 1 --2- 172.21.15.99:0/408661398 >> v2:172.21.15.181:3300/0 conn(0x7f7ca00ead00 0x7f7ca004fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.849+0000 7fa585200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 0x7fa58014e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.849+0000 7f7cad600640 1 -- 172.21.15.99:0/408661398 >> 172.21.15.99:0/408661398 conn(0x7f7ca0009fb0 msgr2=0x7f7ca000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.848+0000 7fcef7400640 1 --2- 172.21.15.99:0/1613032858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b3a20 0x7fcef81625a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcef8072b60 tx=0x7fcee4034090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f70c38e6aac2d3f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.848+0000 7fcef6a00640 1 -- 172.21.15.99:0/1613032858 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4041070 con 0x7fcef80b3a20 2024-03-30T13:10:58.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.848+0000 7fcef6a00640 1 -- 172.21.15.99:0/1613032858 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee4034e40 con 0x7fcef80b3a20 2024-03-30T13:10:58.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.848+0000 7fcef6a00640 1 -- 172.21.15.99:0/1613032858 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4041070 con 0x7fcef80b3a20 2024-03-30T13:10:58.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.849+0000 7fcefdc00640 1 -- 172.21.15.99:0/1613032858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b3a20 msgr2=0x7fcef81625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.849+0000 7fcefdc00640 1 --2- 172.21.15.99:0/1613032858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b3a20 0x7fcef81625a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcef8072b60 tx=0x7fcee4034090 comp rx=0 tx=0).stop 2024-03-30T13:10:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.850+0000 7f8417400640 1 -- 172.21.15.99:0/3741119233 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c011c00 con 0x7f8420098be0 2024-03-30T13:10:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.850+0000 7f8414c00640 1 -- 172.21.15.99:0/3741119233 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8420162cd0 con 0x7f8420098be0 2024-03-30T13:10:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.850+0000 7fa585200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa580162b10 0x7fa580162f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.850+0000 7f7cad600640 1 -- 172.21.15.99:0/408661398 shutdown_connections 2024-03-30T13:10:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.850+0000 7f7cad600640 1 -- 172.21.15.99:0/408661398 wait complete. 2024-03-30T13:10:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.850+0000 7fa585200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa580160bd0 0x7fa580161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.852+0000 7f5cfea00640 1 -- 172.21.15.99:0/1163340171 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5cf8017070 con 0x7f5d080c5020 2024-03-30T13:10:58.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.852+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1163340171 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d080d0df0 con 0x7f5d080c5020 2024-03-30T13:10:58.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.854+0000 7f5cfea00640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5ce406c530 0x7f5ce406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.850+0000 7fa585200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa5800c5730 con 0x7fa564004bd0 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fa57de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 0x7fa58014e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fa57de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 0x7fa58014e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38364/0 (socket says 172.21.15.99:38364) 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fa57de00640 1 -- 172.21.15.99:0/1544579178 learned_addr learned my addr 172.21.15.99:0/1544579178 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa5800ad9d0 con 0x7fa580162b10 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa5800c58b0 con 0x7fa580160bd0 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fa57d400640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa580162b10 0x7fa580162f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fa57e800640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa580160bd0 0x7fa580161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fa57de00640 1 -- 172.21.15.99:0/1544579178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa580160bd0 msgr2=0x7fa580161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fa57de00640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa580160bd0 0x7fa580161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fa57de00640 1 -- 172.21.15.99:0/1544579178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa580162b10 msgr2=0x7fa580162f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.852+0000 7fa57de00640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa580162b10 0x7fa580162f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.852+0000 7fa57de00640 1 -- 172.21.15.99:0/1544579178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58014f140 con 0x7fa564004bd0 2024-03-30T13:10:58.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.852+0000 7fa57de00640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 0x7fa58014e820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa57002c450 tx=0x7fa57002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.852+0000 7fcefdc00640 1 -- 172.21.15.99:0/1613032858 shutdown_connections 2024-03-30T13:10:58.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.852+0000 7fcefdc00640 1 --2- 172.21.15.99:0/1613032858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b3a20 0x7fcef81625a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.852+0000 7fcefdc00640 1 --2- 172.21.15.99:0/1613032858 >> v2:172.21.15.181:3300/0 conn(0x7fcef81621c0 0x7fcef806bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.852+0000 7fcefdc00640 1 -- 172.21.15.99:0/1613032858 >> 172.21.15.99:0/1613032858 conn(0x7fcef809aa30 msgr2=0x7fcef80b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.852+0000 7fcefdc00640 1 -- 172.21.15.99:0/1613032858 shutdown_connections 2024-03-30T13:10:58.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.853+0000 7fcefdc00640 1 -- 172.21.15.99:0/1613032858 wait complete. 2024-03-30T13:10:58.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.853+0000 7f7cad600640 1 Processor -- start 2024-03-30T13:10:58.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.853+0000 7f7cad600640 1 -- start start 2024-03-30T13:10:58.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.850+0000 7fe472a00640 1 -- 172.21.15.99:0/1554447030 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe46c018020 con 0x7fe474054de0 2024-03-30T13:10:58.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.855+0000 7f8417400640 1 -- 172.21.15.99:0/3741119233 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f840c018020 con 0x7f8420098be0 2024-03-30T13:10:58.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fe472a00640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe45c06c730 0x7fe45c06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.851+0000 7fe472a00640 1 -- 172.21.15.99:0/1554447030 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe46c08b250 con 0x7fe474054de0 2024-03-30T13:10:58.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.853+0000 7fe47aa00640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe45c06c730 0x7fe45c06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.854+0000 7fe47aa00640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe45c06c730 0x7fe45c06ebf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe468036000 tx=0x7fe46803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.855+0000 7f7cad600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7ca0006ea0 0x7f7ca00dde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.855+0000 7f7cad600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ca004ffd0 0x7f7ca0044110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.856+0000 7f7cad600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ca00ead00 0x7f7ca0044650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.856+0000 7f7cad600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca00547c0 con 0x7f7ca00ead00 2024-03-30T13:10:58.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.856+0000 7f8417400640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f840006c530 0x7f840006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.856+0000 7f7cad600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca0053fc0 con 0x7f7ca004ffd0 2024-03-30T13:10:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.856+0000 7f7cad600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca0054940 con 0x7f7ca0006ea0 2024-03-30T13:10:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.856+0000 7f7ca7e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7ca0006ea0 0x7f7ca00dde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.856+0000 7f7cacc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ca00ead00 0x7f7ca0044650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.857+0000 7f7cacc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ca00ead00 0x7f7ca0044650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38380/0 (socket says 172.21.15.99:38380) 2024-03-30T13:10:58.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.857+0000 7f5cfea00640 1 -- 172.21.15.99:0/1163340171 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5cf808b020 con 0x7f5d080c5020 2024-03-30T13:10:58.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.857+0000 7f5d06000640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5ce406c530 0x7f5ce406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.857+0000 7f7cacc00640 1 -- 172.21.15.99:0/3277996566 learned_addr learned my addr 172.21.15.99:0/3277996566 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.857+0000 7f7ca7400640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ca004ffd0 0x7f7ca0044110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.856+0000 7fcefdc00640 1 Processor -- start 2024-03-30T13:10:58.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.857+0000 7f7cacc00640 1 -- 172.21.15.99:0/3277996566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7ca0006ea0 msgr2=0x7f7ca00dde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.857+0000 7f7cacc00640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7ca0006ea0 0x7f7ca00dde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.857+0000 7f7cacc00640 1 -- 172.21.15.99:0/3277996566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ca004ffd0 msgr2=0x7f7ca0044110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.857+0000 7f7cacc00640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ca004ffd0 0x7f7ca0044110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.857+0000 7f7cacc00640 1 -- 172.21.15.99:0/3277996566 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca0046ee0 con 0x7f7ca00ead00 2024-03-30T13:10:58.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.857+0000 7f7ca7e00640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7ca0006ea0 0x7f7ca00dde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:58.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.858+0000 7f5d06000640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5ce406c530 0x7f5ce406e9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0007f70 tx=0x7f5cf0007f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.858+0000 7fcefdc00640 1 -- start start 2024-03-30T13:10:58.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.858+0000 7f7cacc00640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ca00ead00 0x7f7ca0044650 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009890 tx=0x7f7c940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.856+0000 7f8417400640 1 -- 172.21.15.99:0/3741119233 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f840c08bba0 con 0x7f8420098be0 2024-03-30T13:10:58.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.858+0000 7f841e000640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f840006c530 0x7f840006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.859+0000 7f1a11c00640 1 Processor -- start 2024-03-30T13:10:58.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.859+0000 7f1a11c00640 1 -- start start 2024-03-30T13:10:58.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.859+0000 7f841e000640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f840006c530 0x7f840006e9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8420162ca0 tx=0x7f841800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.859+0000 7fcefdc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b3a20 0x7fcef80cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.859+0000 7fcefdc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcef80ce340 0x7fcef8152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7fcefdc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcef81621c0 0x7fcef8152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7fcef7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b3a20 0x7fcef80cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7f7c9be00640 1 -- 172.21.15.99:0/3277996566 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94035040 con 0x7f7ca00ead00 2024-03-30T13:10:58.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7f7c9be00640 1 -- 172.21.15.99:0/3277996566 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c940044d0 con 0x7f7ca00ead00 2024-03-30T13:10:58.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7f7c9be00640 1 -- 172.21.15.99:0/3277996566 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94035040 con 0x7f7ca00ead00 2024-03-30T13:10:58.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7f7cad600640 1 -- 172.21.15.99:0/3277996566 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca00471c0 con 0x7f7ca00ead00 2024-03-30T13:10:58.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7fe472a00640 1 -- 172.21.15.99:0/1554447030 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe46c01f020 con 0x7fe474054de0 2024-03-30T13:10:58.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.861+0000 7f7cad600640 1 -- 172.21.15.99:0/3277996566 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca0047780 con 0x7f7ca00ead00 2024-03-30T13:10:58.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7fcefdc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcef80c7680 con 0x7fcef80b3a20 2024-03-30T13:10:58.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7fcefdc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcef80cde20 con 0x7fcef80ce340 2024-03-30T13:10:58.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7fcefdc00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcef80c7800 con 0x7fcef81621c0 2024-03-30T13:10:58.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7fcef7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b3a20 0x7fcef80cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38396/0 (socket says 172.21.15.99:38396) 2024-03-30T13:10:58.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7fcef7e00640 1 -- 172.21.15.99:0/3869316220 learned_addr learned my addr 172.21.15.99:0/3869316220 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7fcef7400640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcef80ce340 0x7fcef8152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7fcefd200640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcef81621c0 0x7fcef8152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.860+0000 7fa576000640 1 -- 172.21.15.99:0/1544579178 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570039040 con 0x7fa564004bd0 2024-03-30T13:10:58.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.861+0000 7fcef7400640 1 -- 172.21.15.99:0/3869316220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcef81621c0 msgr2=0x7fcef8152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.861+0000 7fcef7400640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcef81621c0 0x7fcef8152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.861+0000 7fcef7400640 1 -- 172.21.15.99:0/3869316220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b3a20 msgr2=0x7fcef80cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.861+0000 7fcef7400640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b3a20 0x7fcef80cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.861+0000 7fcef7400640 1 -- 172.21.15.99:0/3869316220 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef8141b40 con 0x7fcef80ce340 2024-03-30T13:10:58.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.861+0000 7fcef7e00640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b3a20 0x7fcef80cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:58.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.861+0000 7fcef7400640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcef80ce340 0x7fcef8152570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcee403b000 tx=0x7fcee40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.862+0000 7f1a11c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1a0c06da60 0x7f1a0c0c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.862+0000 7f1a11c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1a0c15abf0 0x7f1a0c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.862+0000 7f1a11c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a0c15b2f0 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.862+0000 7f1a11c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f1a0c15b0a0 con 0x7f1a0c06da60 2024-03-30T13:10:58.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.862+0000 7f1a11c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1a0c15b5d0 con 0x7f1a0c15abf0 2024-03-30T13:10:58.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.861+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5801635f0 con 0x7fa564004bd0 2024-03-30T13:10:58.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.861+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa580163bb0 con 0x7fa564004bd0 2024-03-30T13:10:58.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.863+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa580068640 con 0x7fa564004bd0 2024-03-30T13:10:58.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.862+0000 7f7cad600640 1 -- 172.21.15.99:0/3277996566 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca0005390 con 0x7f7ca00ead00 2024-03-30T13:10:58.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.864+0000 7f1a0b400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1a0c15abf0 0x7f1a0c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.864+0000 7fa576000640 1 -- 172.21.15.99:0/1544579178 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa570043070 con 0x7fa564004bd0 2024-03-30T13:10:58.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.864+0000 7fa576000640 1 -- 172.21.15.99:0/1544579178 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570007c40 con 0x7fa564004bd0 2024-03-30T13:10:58.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.864+0000 7f1a0b400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1a0c15abf0 0x7f1a0c0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49522/0 (socket says 172.21.15.99:49522) 2024-03-30T13:10:58.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.864+0000 7f1a0b400640 1 -- 172.21.15.99:0/3471334566 learned_addr learned my addr 172.21.15.99:0/3471334566 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.865+0000 7f1a0b400640 1 -- 172.21.15.99:0/3471334566 >> v2:172.21.15.99:3300/0 conn(0x7f1a0c06da60 msgr2=0x7f1a0c0c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.865+0000 7f1a0b400640 1 --2- 172.21.15.99:0/3471334566 >> v2:172.21.15.99:3300/0 conn(0x7f1a0c06da60 0x7f1a0c0c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.865+0000 7f1a0b400640 1 -- 172.21.15.99:0/3471334566 >> v1:172.21.15.99:6789/0 conn(0x7f1a0c0c66d0 legacy=0x7f1a0c06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.865+0000 7f1a0b400640 1 -- 172.21.15.99:0/3471334566 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c15b8b0 con 0x7f1a0c15abf0 2024-03-30T13:10:58.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.866+0000 7f7c9be00640 1 -- 172.21.15.99:0/3277996566 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7c94038020 con 0x7f7ca00ead00 2024-03-30T13:10:58.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.866+0000 7f1a0b400640 1 --2- 172.21.15.99:0/3471334566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a0c15abf0 0x7f1a0c0ce2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c072760 tx=0x7f1a0402caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7949166775993512 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.866+0000 7fa576000640 1 -- 172.21.15.99:0/1544579178 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa570005290 con 0x7fa564004bd0 2024-03-30T13:10:58.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.867+0000 7f7c9be00640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7c8806c930 0x7f7c8806edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.867+0000 7f7c9be00640 1 -- 172.21.15.99:0/3277996566 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7c940042d0 con 0x7f7ca00ead00 2024-03-30T13:10:58.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.867+0000 7f7ca7e00640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7c8806c930 0x7f7c8806edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.868+0000 7fa576000640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa56006c600 0x7fa56006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.868+0000 7fa576000640 1 -- 172.21.15.99:0/1544579178 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa5700ad380 con 0x7fa564004bd0 2024-03-30T13:10:58.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.868+0000 7fa57d400640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa56006c600 0x7fa56006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.869+0000 7fa57d400640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa56006c600 0x7fa56006eac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa56c000f60 tx=0x7fa56c001790 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.869+0000 7f7ca7e00640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7c8806c930 0x7f7c8806edf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8065080 tx=0x7f7ca8074620 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.869+0000 7f8417400640 1 -- 172.21.15.99:0/3741119233 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8420162cd0 con 0x7f8420098be0 2024-03-30T13:10:58.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.871+0000 7fceefe00640 1 -- 172.21.15.99:0/3869316220 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee404b020 con 0x7fcef80ce340 2024-03-30T13:10:58.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.871+0000 7fceefe00640 1 -- 172.21.15.99:0/3869316220 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee4003d20 con 0x7fcef80ce340 2024-03-30T13:10:58.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.872+0000 7fcefdc00640 1 -- 172.21.15.99:0/3869316220 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef8140d80 con 0x7fcef80ce340 2024-03-30T13:10:58.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.872+0000 7fceefe00640 1 -- 172.21.15.99:0/3869316220 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4041040 con 0x7fcef80ce340 2024-03-30T13:10:58.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.872+0000 7f1a09600640 1 -- 172.21.15.99:0/3471334566 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04034070 con 0x7f1a0c15abf0 2024-03-30T13:10:58.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.872+0000 7f1a09600640 1 -- 172.21.15.99:0/3471334566 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0402e650 con 0x7f1a0c15abf0 2024-03-30T13:10:58.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.872+0000 7f1a09600640 1 -- 172.21.15.99:0/3471334566 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0402ea40 con 0x7f1a0c15abf0 2024-03-30T13:10:58.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.872+0000 7f5cfea00640 1 -- 172.21.15.99:0/1163340171 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5cf8058ff0 con 0x7f5d080c5020 2024-03-30T13:10:58.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.873+0000 7f1a11c00640 1 -- 172.21.15.99:0/3471334566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a0c15abf0 msgr2=0x7f1a0c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.873+0000 7f1a11c00640 1 --2- 172.21.15.99:0/3471334566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a0c15abf0 0x7f1a0c0ce2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c072760 tx=0x7f1a0402caa0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.873+0000 7f1a11c00640 1 -- 172.21.15.99:0/3471334566 shutdown_connections 2024-03-30T13:10:58.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.873+0000 7fa576000640 1 -- 172.21.15.99:0/1544579178 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa57004c020 con 0x7fa564004bd0 2024-03-30T13:10:58.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.873+0000 7f1a11c00640 1 --2- 172.21.15.99:0/3471334566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a0c15abf0 0x7f1a0c0ce2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.873+0000 7f1a11c00640 1 --2- 172.21.15.99:0/3471334566 >> v2:172.21.15.99:3300/0 conn(0x7f1a0c06da60 0x7f1a0c0c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.873+0000 7f1a11c00640 1 -- 172.21.15.99:0/3471334566 >> 172.21.15.99:0/3471334566 conn(0x7f1a0c072ba0 msgr2=0x7f1a0c072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.874+0000 7f1a11c00640 1 -- 172.21.15.99:0/3471334566 shutdown_connections 2024-03-30T13:10:58.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.874+0000 7f1a11c00640 1 -- 172.21.15.99:0/3471334566 wait complete. 2024-03-30T13:10:58.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.877+0000 7f1a11c00640 1 Processor -- start 2024-03-30T13:10:58.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.877+0000 7f1a11c00640 1 -- start start 2024-03-30T13:10:58.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.879+0000 7f1a11c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a0c06da60 0x7f1a0c1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.879+0000 7f1a11c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a0c0c66d0 0x7f1a0c0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.879+0000 7f1a11c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a0c15abf0 0x7f1a0c0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.879+0000 7f1a11c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c0c5020 con 0x7f1a0c06da60 2024-03-30T13:10:58.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.879+0000 7f1a11c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c15be70 con 0x7f1a0c15abf0 2024-03-30T13:10:58.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.879+0000 7f1a11c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0c0c51a0 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.872+0000 7fcefdc00640 1 -- 172.21.15.99:0/3869316220 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef8141340 con 0x7fcef80ce340 2024-03-30T13:10:58.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.874+0000 7fcefdc00640 1 -- 172.21.15.99:0/3869316220 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef804f8f0 con 0x7fcef80ce340 2024-03-30T13:10:58.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.876+0000 7fceefe00640 1 -- 172.21.15.99:0/3869316220 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcee404e020 con 0x7fcef80ce340 2024-03-30T13:10:58.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.877+0000 7fceefe00640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fced806c530 0x7fced806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.877+0000 7fceefe00640 1 -- 172.21.15.99:0/3869316220 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcee40b5c60 con 0x7fcef80ce340 2024-03-30T13:10:58.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.880+0000 7f1a0a000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a0c0c66d0 0x7f1a0c0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.880+0000 7f1a0a000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a0c0c66d0 0x7f1a0c0caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38494/0 (socket says 172.21.15.99:38494) 2024-03-30T13:10:58.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.880+0000 7f1a0a000640 1 -- 172.21.15.99:0/576418792 learned_addr learned my addr 172.21.15.99:0/576418792 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.880+0000 7f1a0a000640 1 -- 172.21.15.99:0/576418792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a0c15abf0 msgr2=0x7f1a0c0cb490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-30T13:10:58.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.881+0000 7f1a0b400640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a0c15abf0 0x7f1a0c0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.881+0000 7f1a0a000640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a0c15abf0 0x7f1a0c0cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.881+0000 7f1a0a000640 1 -- 172.21.15.99:0/576418792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a0c06da60 msgr2=0x7f1a0c1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.881+0000 7f1a0a000640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a0c06da60 0x7f1a0c1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.881+0000 7f1a0a000640 1 -- 172.21.15.99:0/576418792 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c0cbad0 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.881+0000 7f1a0a000640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a0c0c66d0 0x7f1a0c0caf50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f19f800c400 tx=0x7f19f800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.881+0000 7fcef7e00640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fced806c530 0x7fced806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.882+0000 7f1a02a00640 1 -- 172.21.15.99:0/576418792 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8011790 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.882+0000 7f1a02a00640 1 -- 172.21.15.99:0/576418792 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f8017070 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.882+0000 7f1a02a00640 1 -- 172.21.15.99:0/576418792 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8011bb0 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.882+0000 7f7c9be00640 1 -- 172.21.15.99:0/3277996566 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7c94030380 con 0x7f7ca00ead00 2024-03-30T13:10:58.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.882+0000 7f1a11c00640 1 -- 172.21.15.99:0/576418792 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0c0cbdb0 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.883+0000 7f1a11c00640 1 -- 172.21.15.99:0/576418792 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0c0c7360 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.883+0000 7fcef7e00640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fced806c530 0x7fced806e9f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcee8006fd0 tx=0x7fcee8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.887+0000 7f1a11c00640 1 -- 172.21.15.99:0/576418792 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0c0c7560 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.887+0000 7f1a02a00640 1 -- 172.21.15.99:0/576418792 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f19f801c460 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.889+0000 7f1a02a00640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f19ec06c600 0x7f19ec06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.889+0000 7f1a02a00640 1 -- 172.21.15.99:0/576418792 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f19f808b4c0 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.890+0000 7f1a0aa00640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f19ec06c600 0x7f19ec06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.892+0000 7f1a0aa00640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f19ec06c600 0x7f19ec06eac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009670 tx=0x7f19fc006bf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.893+0000 7fceefe00640 1 -- 172.21.15.99:0/3869316220 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcee4055070 con 0x7fcef80ce340 2024-03-30T13:10:58.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.904+0000 7f1a02a00640 1 -- 172.21.15.99:0/576418792 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1a0c0c7560 con 0x7f1a0c0c66d0 2024-03-30T13:10:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.953+0000 7fe661200640 1 Processor -- start 2024-03-30T13:10:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.953+0000 7fe661200640 1 -- start start 2024-03-30T13:10:58.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.955+0000 7fe661200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe65c0c5020 0x7fe65c15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.955+0000 7fe661200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe65c06d850 0x7fe65c06dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.955+0000 7fe661200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe65c160800 con 0x7fe65c15e900 2024-03-30T13:10:58.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.955+0000 7fe661200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe65c0c5520 con 0x7fe65c0c5020 2024-03-30T13:10:58.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.955+0000 7fe661200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c0c5800 con 0x7fe65c06d850 2024-03-30T13:10:58.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.956+0000 7fe659e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe65c15e900 0x7fe65c1600f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56702/0 (socket says 172.21.15.99:56702) 2024-03-30T13:10:58.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.956+0000 7fe659e00640 1 -- 172.21.15.99:0/4022943372 learned_addr learned my addr 172.21.15.99:0/4022943372 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:10:58.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.956+0000 7fe659400640 1 --2- 172.21.15.99:0/4022943372 >> v2:172.21.15.99:3300/0 conn(0x7fe65c0c5020 0x7fe65c15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.956+0000 7fe65a800640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe65c06d850 0x7fe65c06dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.956+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1210932798 0 0) 0x7fe65c160800 con 0x7fe65c15e900 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.956+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe640003520 con 0x7fe65c15e900 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2884975893 0 0) 0x7fe640003520 con 0x7fe65c15e900 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe65c06d850 msgr2=0x7fe65c06dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe65c06d850 0x7fe65c06dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 >> v2:172.21.15.99:3300/0 conn(0x7fe65c0c5020 msgr2=0x7fe65c15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 --2- 172.21.15.99:0/4022943372 >> v2:172.21.15.99:3300/0 conn(0x7fe65c0c5020 0x7fe65c15ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c0c5ae0 con 0x7fe65c15e900 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fe648001670 con 0x7fe65c15e900 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 >> v1:172.21.15.99:6789/0 conn(0x7fe65c15e900 legacy=0x7fe65c1600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6400039b0 0x7fe640003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe640004800 0x7fe640004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6400051c0 0x7fe6400141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c0c5520 con 0x7fe6400051c0 2024-03-30T13:10:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c0c5800 con 0x7fe6400039b0 2024-03-30T13:10:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe640005a70 con 0x7fe640004800 2024-03-30T13:10:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.958+0000 7fe65a800640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe65c06d850 0x7fe65c06dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:10:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.959+0000 7fe659400640 1 --2- 172.21.15.99:0/4022943372 >> v2:172.21.15.99:3300/0 conn(0x7fe65c0c5020 0x7fe65c15ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:10:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.959+0000 7fe65a800640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6400051c0 0x7fe6400141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.960+0000 7fe659400640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe640004800 0x7fe640004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.962+0000 7fe65a800640 1 -- 172.21.15.99:0/4022943372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe640004800 msgr2=0x7fe640004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.962+0000 7fe65a800640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe640004800 0x7fe640004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.962+0000 7fe65a800640 1 -- 172.21.15.99:0/4022943372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6400039b0 msgr2=0x7fe640003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:10:58.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.962+0000 7fe65a800640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6400039b0 0x7fe640003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.962+0000 7fe65a800640 1 -- 172.21.15.99:0/4022943372 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe640003520 con 0x7fe6400051c0 2024-03-30T13:10:58.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.964+0000 7fe65a800640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6400051c0 0x7fe6400141d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe65c06dc30 tx=0x7fe640005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5acef7c82a8691 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.968+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654007a70 con 0x7fe6400051c0 2024-03-30T13:10:58.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.968+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65402ce50 con 0x7fe6400051c0 2024-03-30T13:10:58.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.968+0000 7fe658a00640 1 -- 172.21.15.99:0/4022943372 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654033860 con 0x7fe6400051c0 2024-03-30T13:10:58.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.969+0000 7fe661200640 1 -- 172.21.15.99:0/4022943372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6400051c0 msgr2=0x7fe6400141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.969+0000 7fe661200640 1 --2- 172.21.15.99:0/4022943372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6400051c0 0x7fe6400141d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe65c06dc30 tx=0x7fe640005830 comp rx=0 tx=0).stop 2024-03-30T13:10:58.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.969+0000 7fe65a800640 1 -- 172.21.15.99:0/4022943372 reap_dead start 2024-03-30T13:10:58.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.969+0000 7fe661200640 1 -- 172.21.15.99:0/4022943372 shutdown_connections 2024-03-30T13:10:58.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.969+0000 7fe661200640 1 -- 172.21.15.99:0/4022943372 >> 172.21.15.99:0/4022943372 conn(0x7fe65c072ba0 msgr2=0x7fe65c072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:58.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.969+0000 7fe661200640 1 -- 172.21.15.99:0/4022943372 shutdown_connections 2024-03-30T13:10:58.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.969+0000 7fe661200640 1 -- 172.21.15.99:0/4022943372 wait complete. 2024-03-30T13:10:58.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.976+0000 7fe661200640 1 Processor -- start 2024-03-30T13:10:58.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.976+0000 7fe661200640 1 -- start start 2024-03-30T13:10:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.984+0000 7fe661200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6400051c0 0x7fe65c152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.985+0000 7fe661200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe65c152570 0x7fe65c154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.985+0000 7fe661200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe65c14c420 0x7fe65c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.985+0000 7fe661200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c099d30 con 0x7fe65c152570 2024-03-30T13:10:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.985+0000 7fe661200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c0c60a0 con 0x7fe65c14c420 2024-03-30T13:10:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.985+0000 7fe659e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6400051c0 0x7fe65c152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.985+0000 7fe661200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c099eb0 con 0x7fe6400051c0 2024-03-30T13:10:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.986+0000 7fe659400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe65c152570 0x7fe65c154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.986+0000 7fe659400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe65c152570 0x7fe65c154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38458/0 (socket says 172.21.15.99:38458) 2024-03-30T13:10:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.986+0000 7fe659400640 1 -- 172.21.15.99:0/3758122429 learned_addr learned my addr 172.21.15.99:0/3758122429 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:10:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.986+0000 7fe65a800640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe65c14c420 0x7fe65c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.988+0000 7fe659400640 1 -- 172.21.15.99:0/3758122429 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6400051c0 msgr2=0x7fe65c152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.988+0000 7fe659400640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6400051c0 0x7fe65c152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.992+0000 7fe659400640 1 -- 172.21.15.99:0/3758122429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe65c14c420 msgr2=0x7fe65c1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:58.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.992+0000 7fe659400640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe65c14c420 0x7fe65c1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:58.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.992+0000 7fe659400640 1 -- 172.21.15.99:0/3758122429 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c0ae6b0 con 0x7fe65c152570 2024-03-30T13:10:58.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.992+0000 7fe659e00640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6400051c0 0x7fe65c152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:58.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.992+0000 7fe65a800640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe65c14c420 0x7fe65c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:10:58.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.993+0000 7fe659400640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe65c152570 0x7fe65c154bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0119d0 tx=0x7fe64c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:58.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.993+0000 7fe652000640 1 -- 172.21.15.99:0/3758122429 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c004220 con 0x7fe65c152570 2024-03-30T13:10:58.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.993+0000 7fe652000640 1 -- 172.21.15.99:0/3758122429 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64c0043c0 con 0x7fe65c152570 2024-03-30T13:10:58.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.993+0000 7fe652000640 1 -- 172.21.15.99:0/3758122429 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c00fae0 con 0x7fe65c152570 2024-03-30T13:10:58.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.993+0000 7fe661200640 1 -- 172.21.15.99:0/3758122429 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65c0ae990 con 0x7fe65c152570 2024-03-30T13:10:58.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:58.994+0000 7fe661200640 1 -- 172.21.15.99:0/3758122429 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65c0aef50 con 0x7fe65c152570 2024-03-30T13:10:59.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.001+0000 7fe652000640 1 -- 172.21.15.99:0/3758122429 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe64c00fc80 con 0x7fe65c152570 2024-03-30T13:10:59.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.002+0000 7fe647400640 1 -- 172.21.15.99:0/3758122429 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c068640 con 0x7fe65c152570 2024-03-30T13:10:59.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.004+0000 7fe652000640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe63c06c560 0x7fe63c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:10:59.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.004+0000 7fe652000640 1 -- 172.21.15.99:0/3758122429 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe64c08bfc0 con 0x7fe65c152570 2024-03-30T13:10:59.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.007+0000 7fe659e00640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe63c06c560 0x7fe63c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:10:59.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.009+0000 7fe659e00640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe63c06c560 0x7fe63c06ea20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6480017e0 tx=0x7fe648001690 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:10:59.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.016+0000 7fe652000640 1 -- 172.21.15.99:0/3758122429 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe64c019030 con 0x7fe65c152570 2024-03-30T13:10:59.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.287+0000 7fe47be00640 1 -- 172.21.15.99:0/1554447030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe4740578f0 con 0x7fe474054de0 2024-03-30T13:10:59.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.288+0000 7fe472a00640 1 -- 172.21.15.99:0/1554447030 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe46c0597d0 con 0x7fe474054de0 2024-03-30T13:10:59.292 INFO:teuthology.orchestra.run.smithi099.stdout:68719476741 2024-03-30T13:10:59.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.291+0000 7fe47be00640 1 -- 172.21.15.99:0/1554447030 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe45c06c730 msgr2=0x7fe45c06ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.291+0000 7fe47be00640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe45c06c730 0x7fe45c06ebf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe468036000 tx=0x7fe46803c040 comp rx=0 tx=0).stop 2024-03-30T13:10:59.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.292+0000 7fe47be00640 1 -- 172.21.15.99:0/1554447030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe474054de0 msgr2=0x7fe4740cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.292+0000 7fe47be00640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe474054de0 0x7fe4740cb4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00b410 tx=0x7fe46c00b8d0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.294+0000 7fe47be00640 1 -- 172.21.15.99:0/1554447030 shutdown_connections 2024-03-30T13:10:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.294+0000 7fe47be00640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe45c06c730 0x7fe45c06ebf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.294+0000 7fe47be00640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4740e7a50 0x7fe4740d6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.294+0000 7fe47be00640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe474054de0 0x7fe4740cb4d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.294+0000 7fe47be00640 1 --2- 172.21.15.99:0/1554447030 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe47404a0a0 0x7fe47404e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.294+0000 7fe47be00640 1 -- 172.21.15.99:0/1554447030 >> 172.21.15.99:0/1554447030 conn(0x7fe474056cd0 msgr2=0x7fe474009380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:59.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.294+0000 7fe47be00640 1 -- 172.21.15.99:0/1554447030 shutdown_connections 2024-03-30T13:10:59.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.295+0000 7fe47be00640 1 -- 172.21.15.99:0/1554447030 wait complete. 2024-03-30T13:10:59.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.309+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1163340171 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5d08068640 con 0x7f5d080c5020 2024-03-30T13:10:59.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.310+0000 7f5cfea00640 1 -- 172.21.15.99:0/1163340171 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5cf805d2f0 con 0x7f5d080c5020 2024-03-30T13:10:59.315 INFO:teuthology.orchestra.run.smithi099.stdout:68719476741 2024-03-30T13:10:59.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.316+0000 7f8414c00640 1 -- 172.21.15.99:0/3741119233 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8420068640 con 0x7f8420098be0 2024-03-30T13:10:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.317+0000 7f8417400640 1 -- 172.21.15.99:0/3741119233 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f840c01f020 con 0x7f8420098be0 2024-03-30T13:10:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.317+0000 7f7cad600640 1 -- 172.21.15.99:0/3277996566 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7ca0004f90 con 0x7f7ca00ead00 2024-03-30T13:10:59.321 INFO:teuthology.orchestra.run.smithi099.stdout:68719476742 2024-03-30T13:10:59.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.318+0000 7f7c9be00640 1 -- 172.21.15.99:0/3277996566 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7c9407b1f0 con 0x7f7ca00ead00 2024-03-30T13:10:59.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.320+0000 7f8414c00640 1 -- 172.21.15.99:0/3741119233 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f840006c530 msgr2=0x7f840006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.320+0000 7f8414c00640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f840006c530 0x7f840006e9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8420162ca0 tx=0x7f841800d040 comp rx=0 tx=0).stop 2024-03-30T13:10:59.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.320+0000 7f8414c00640 1 -- 172.21.15.99:0/3741119233 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 msgr2=0x7f8420152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.320+0000 7f8414c00640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f8420152a00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f840c00b3e0 tx=0x7f840c00b8a0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.325 INFO:teuthology.orchestra.run.smithi099.stdout:60129542150 2024-03-30T13:10:59.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1163340171 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5ce406c530 msgr2=0x7f5ce406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f5d0dc00640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5ce406c530 0x7f5ce406e9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0007f70 tx=0x7f5cf0007f00 comp rx=0 tx=0).stop 2024-03-30T13:10:59.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1163340171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d080c5020 msgr2=0x7f5d080cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f5d0dc00640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d080c5020 0x7f5d080cdce0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800b4a0 tx=0x7f5cf800b960 comp rx=0 tx=0).stop 2024-03-30T13:10:59.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f8414c00640 1 -- 172.21.15.99:0/3741119233 shutdown_connections 2024-03-30T13:10:59.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f8414c00640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f840006c530 0x7f840006e9f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f8414c00640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84200ccb40 0x7f84200c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f8414c00640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84200c5780 0x7f8420150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f8414c00640 1 --2- 172.21.15.99:0/3741119233 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8420098be0 0x7f8420152a00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f8414c00640 1 -- 172.21.15.99:0/3741119233 >> 172.21.15.99:0/3741119233 conn(0x7f8420072ba0 msgr2=0x7f84200ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:59.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1163340171 shutdown_connections 2024-03-30T13:10:59.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f5d0dc00640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5ce406c530 0x7f5ce406e9f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f5d0dc00640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d081605e0 0x7f5d081512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f5d0dc00640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5d080ccb70 0x7f5d081fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f5d0dc00640 1 --2- 172.21.15.99:0/1163340171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d080c5020 0x7f5d080cdce0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1163340171 >> 172.21.15.99:0/1163340171 conn(0x7f5d0806b510 msgr2=0x7f5d08164970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:59.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.321+0000 7f8414c00640 1 -- 172.21.15.99:0/3741119233 shutdown_connections 2024-03-30T13:10:59.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.322+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1163340171 shutdown_connections 2024-03-30T13:10:59.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.322+0000 7f8414c00640 1 -- 172.21.15.99:0/3741119233 wait complete. 2024-03-30T13:10:59.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.322+0000 7f5d0dc00640 1 -- 172.21.15.99:0/1163340171 wait complete. 2024-03-30T13:10:59.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.0 2024-03-30T13:10:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.324+0000 7f7cad600640 1 -- 172.21.15.99:0/3277996566 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7c8806c930 msgr2=0x7f7c8806edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.324+0000 7f7cad600640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7c8806c930 0x7f7c8806edf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8065080 tx=0x7f7ca8074620 comp rx=0 tx=0).stop 2024-03-30T13:10:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.324+0000 7f7cad600640 1 -- 172.21.15.99:0/3277996566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ca00ead00 msgr2=0x7f7ca0044650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.324+0000 7f7cad600640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ca00ead00 0x7f7ca0044650 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009890 tx=0x7f7c940046c0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.324+0000 7f7cad600640 1 -- 172.21.15.99:0/3277996566 shutdown_connections 2024-03-30T13:10:59.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.324+0000 7f7cad600640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7c8806c930 0x7f7c8806edf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.324+0000 7f7cad600640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ca00ead00 0x7f7ca0044650 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.324+0000 7f7cad600640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ca004ffd0 0x7f7ca0044110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.324+0000 7f7cad600640 1 --2- 172.21.15.99:0/3277996566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7ca0006ea0 0x7f7ca00dde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.324+0000 7f7cad600640 1 -- 172.21.15.99:0/3277996566 >> 172.21.15.99:0/3277996566 conn(0x7f7ca0009fb0 msgr2=0x7f7ca0052c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:59.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.325+0000 7f7cad600640 1 -- 172.21.15.99:0/3277996566 shutdown_connections 2024-03-30T13:10:59.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.325+0000 7f7cad600640 1 -- 172.21.15.99:0/3277996566 wait complete. 2024-03-30T13:10:59.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.335+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa580071fa0 con 0x7fa564004bd0 2024-03-30T13:10:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.337+0000 7fa576000640 1 -- 172.21.15.99:0/1544579178 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa57007b450 con 0x7fa564004bd0 2024-03-30T13:10:59.342 INFO:teuthology.orchestra.run.smithi099.stdout:68719476742 2024-03-30T13:10:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.341+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa56006c600 msgr2=0x7fa56006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.341+0000 7fa585200640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa56006c600 0x7fa56006eac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa56c000f60 tx=0x7fa56c001790 comp rx=0 tx=0).stop 2024-03-30T13:10:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.341+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 msgr2=0x7fa58014e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.341+0000 7fa585200640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 0x7fa58014e820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa57002c450 tx=0x7fa57002e070 comp rx=0 tx=0).stop 2024-03-30T13:10:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.342+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 shutdown_connections 2024-03-30T13:10:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.342+0000 7fa585200640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa56006c600 0x7fa56006eac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.342+0000 7fa585200640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa580160bd0 0x7fa580161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.342+0000 7fa585200640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa580162b10 0x7fa580162f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.342+0000 7fa585200640 1 --2- 172.21.15.99:0/1544579178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004bd0 0x7fa58014e820 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.342+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 >> 172.21.15.99:0/1544579178 conn(0x7fa58006b510 msgr2=0x7fa58006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:59.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.342+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 shutdown_connections 2024-03-30T13:10:59.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.342+0000 7fa585200640 1 -- 172.21.15.99:0/1544579178 wait complete. 2024-03-30T13:10:59.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.344+0000 7fcefdc00640 1 -- 172.21.15.99:0/3869316220 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcef80732a0 con 0x7fcef80ce340 2024-03-30T13:10:59.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.345+0000 7fceefe00640 1 -- 172.21.15.99:0/3869316220 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcee4084410 con 0x7fcef80ce340 2024-03-30T13:10:59.350 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-03-30T13:10:59.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 -- 172.21.15.99:0/3869316220 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fced806c530 msgr2=0x7fced806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fced806c530 0x7fced806e9f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcee8006fd0 tx=0x7fcee8008040 comp rx=0 tx=0).stop 2024-03-30T13:10:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 -- 172.21.15.99:0/3869316220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcef80ce340 msgr2=0x7fcef8152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcef80ce340 0x7fcef8152570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcee403b000 tx=0x7fcee40046c0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 -- 172.21.15.99:0/3869316220 shutdown_connections 2024-03-30T13:10:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fced806c530 0x7fced806e9f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcef81621c0 0x7fcef8152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcef80ce340 0x7fcef8152570 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 --2- 172.21.15.99:0/3869316220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b3a20 0x7fcef80cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 -- 172.21.15.99:0/3869316220 >> 172.21.15.99:0/3869316220 conn(0x7fcef809aa30 msgr2=0x7fcef8160f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 -- 172.21.15.99:0/3869316220 shutdown_connections 2024-03-30T13:10:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.350+0000 7fcefdc00640 1 -- 172.21.15.99:0/3869316220 wait complete. 2024-03-30T13:10:59.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.351+0000 7f1a11c00640 1 -- 172.21.15.99:0/576418792 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1a0c0d0ef0 con 0x7f1a0c0c66d0 2024-03-30T13:10:59.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.7 2024-03-30T13:10:59.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.3 2024-03-30T13:10:59.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.355+0000 7f1a02a00640 1 -- 172.21.15.99:0/576418792 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f19f8059b50 con 0x7f1a0c0c66d0 2024-03-30T13:10:59.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.2 2024-03-30T13:10:59.360 INFO:teuthology.orchestra.run.smithi099.stdout:64424509445 2024-03-30T13:10:59.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 -- 172.21.15.99:0/576418792 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f19ec06c600 msgr2=0x7f19ec06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f19ec06c600 0x7f19ec06eac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009670 tx=0x7f19fc006bf0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 -- 172.21.15.99:0/576418792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a0c0c66d0 msgr2=0x7f1a0c0caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a0c0c66d0 0x7f1a0c0caf50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f19f800c400 tx=0x7f19f800c8c0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 -- 172.21.15.99:0/576418792 shutdown_connections 2024-03-30T13:10:59.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f19ec06c600 0x7f19ec06eac0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a0c15abf0 0x7f1a0c0cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a0c0c66d0 0x7f1a0c0caf50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 --2- 172.21.15.99:0/576418792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a0c06da60 0x7f1a0c1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 -- 172.21.15.99:0/576418792 >> 172.21.15.99:0/576418792 conn(0x7f1a0c072ba0 msgr2=0x7f1a0c1581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:59.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 -- 172.21.15.99:0/576418792 shutdown_connections 2024-03-30T13:10:59.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.357+0000 7f1a11c00640 1 -- 172.21.15.99:0/576418792 wait complete. 2024-03-30T13:10:59.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.1 2024-03-30T13:10:59.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-03-30T13:10:59.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-03-30T13:10:59.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.479+0000 7fe647400640 1 -- 172.21.15.99:0/3758122429 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe65c15d9e0 con 0x7fe65c152570 2024-03-30T13:10:59.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.480+0000 7fe652000640 1 -- 172.21.15.99:0/3758122429 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe64c05a5d0 con 0x7fe65c152570 2024-03-30T13:10:59.484 INFO:teuthology.orchestra.run.smithi099.stdout:64424509447 2024-03-30T13:10:59.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.482+0000 7fe647400640 1 -- 172.21.15.99:0/3758122429 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe63c06c560 msgr2=0x7fe63c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.482+0000 7fe647400640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe63c06c560 0x7fe63c06ea20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6480017e0 tx=0x7fe648001690 comp rx=0 tx=0).stop 2024-03-30T13:10:59.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.482+0000 7fe647400640 1 -- 172.21.15.99:0/3758122429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe65c152570 msgr2=0x7fe65c154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:10:59.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.482+0000 7fe647400640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe65c152570 0x7fe65c154bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0119d0 tx=0x7fe64c011e90 comp rx=0 tx=0).stop 2024-03-30T13:10:59.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.483+0000 7fe647400640 1 -- 172.21.15.99:0/3758122429 shutdown_connections 2024-03-30T13:10:59.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.483+0000 7fe647400640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe63c06c560 0x7fe63c06ea20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.483+0000 7fe647400640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe65c14c420 0x7fe65c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.483+0000 7fe647400640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe65c152570 0x7fe65c154bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.483+0000 7fe647400640 1 --2- 172.21.15.99:0/3758122429 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6400051c0 0x7fe65c152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:10:59.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.483+0000 7fe647400640 1 -- 172.21.15.99:0/3758122429 >> 172.21.15.99:0/3758122429 conn(0x7fe65c072ba0 msgr2=0x7fe65c15cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:10:59.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.483+0000 7fe647400640 1 -- 172.21.15.99:0/3758122429 shutdown_connections 2024-03-30T13:10:59.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:10:59.483+0000 7fe647400640 1 -- 172.21.15.99:0/3758122429 wait complete. 2024-03-30T13:10:59.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.5 2024-03-30T13:11:00.335 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-30T13:11:00.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-30T13:11:00.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-30T13:11:00.360 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-30T13:11:00.371 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-30T13:11:00.374 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:00.381 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-30T13:11:00.381 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-30T13:11:00.416 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:00.511 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-30T13:11:00.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.633+0000 7f3674a00640 1 Processor -- start 2024-03-30T13:11:00.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.634+0000 7f3674a00640 1 -- start start 2024-03-30T13:11:00.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.637+0000 7f3674a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f367015f4a0 0x7f3670169470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.637+0000 7f3674a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36700cb670 con 0x7f36700cc1b0 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.637+0000 7f3674a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367015faa0 con 0x7f36700cd5c0 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.637+0000 7f3674a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f367006d670 con 0x7f367015f4a0 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.637+0000 7f366de00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f36700cd5c0 0x7f367015ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:34896/0 (socket says 172.21.15.99:34896) 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.637+0000 7f366de00640 1 -- 172.21.15.99:0/1330086383 learned_addr learned my addr 172.21.15.99:0/1330086383 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.639+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3513855302 0 0) 0x7f367015faa0 con 0x7f36700cd5c0 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.639+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3654003520 con 0x7f36700cd5c0 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.640+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380877972 0 0) 0x7f365c001110 con 0x7f36700cc1b0 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.640+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f367015faa0 con 0x7f36700cc1b0 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.640+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 426773827 0 0) 0x7f3654003520 con 0x7f36700cd5c0 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.640+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 >> v2:172.21.15.181:3300/0 conn(0x7f367015f4a0 msgr2=0x7f3670169470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.640+0000 7f366d400640 1 --2- 172.21.15.99:0/1330086383 >> v2:172.21.15.181:3300/0 conn(0x7f367015f4a0 0x7f3670169470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.640+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 >> v1:172.21.15.99:6789/0 conn(0x7f36700cc1b0 legacy=0x7f36700cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.640+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367006d950 con 0x7f36700cd5c0 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.640+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f3660001670 con 0x7f36700cd5c0 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.640+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 >> v1:172.21.15.181:6789/0 conn(0x7f36700cd5c0 legacy=0x7f367015ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.640+0000 7f366d400640 1 --2- 172.21.15.99:0/1330086383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3654003b40 0x7f3654003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.641+0000 7f366d400640 1 --2- 172.21.15.99:0/1330086383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3654004800 0x7f3654004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.641+0000 7f366d400640 1 --2- 172.21.15.99:0/1330086383 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36540053c0 0x7f365400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.641+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f367006d670 con 0x7f3654003b40 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.641+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f365400c250 con 0x7f3654004800 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.641+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f365400c450 con 0x7f36540053c0 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.641+0000 7f366de00640 1 --2- 172.21.15.99:0/1330086383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3654004800 0x7f3654004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.642+0000 7f366de00640 1 -- 172.21.15.99:0/1330086383 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36540053c0 msgr2=0x7f365400b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.642+0000 7f366de00640 1 --2- 172.21.15.99:0/1330086383 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36540053c0 0x7f365400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.642+0000 7f366de00640 1 -- 172.21.15.99:0/1330086383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3654003b40 msgr2=0x7f3654003f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:11:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.642+0000 7f366de00640 1 --2- 172.21.15.99:0/1330086383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3654003b40 0x7f3654003f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.642+0000 7f366de00640 1 -- 172.21.15.99:0/1330086383 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3654003520 con 0x7f3654004800 2024-03-30T13:11:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.649+0000 7f366f200640 1 -- 172.21.15.99:0/1330086383 reap_dead start 2024-03-30T13:11:00.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.657+0000 7f366de00640 1 --2- 172.21.15.99:0/1330086383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3654004800 0x7f3654004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f366000c0e0 tx=0x7f3654005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e09f2f39e331cba9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.657+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660007c00 con 0x7f3654004800 2024-03-30T13:11:00.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.657+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3660052070 con 0x7f3654004800 2024-03-30T13:11:00.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.657+0000 7f366d400640 1 -- 172.21.15.99:0/1330086383 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660005d30 con 0x7f3654004800 2024-03-30T13:11:00.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.658+0000 7f3674a00640 1 -- 172.21.15.99:0/1330086383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3654004800 msgr2=0x7f3654004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.658+0000 7f3674a00640 1 --2- 172.21.15.99:0/1330086383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3654004800 0x7f3654004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f366000c0e0 tx=0x7f3654005830 comp rx=0 tx=0).stop 2024-03-30T13:11:00.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.664+0000 7f3674a00640 1 -- 172.21.15.99:0/1330086383 shutdown_connections 2024-03-30T13:11:00.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.664+0000 7f3674a00640 1 --2- 172.21.15.99:0/1330086383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3654004800 0x7f3654004c80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.664+0000 7f3674a00640 1 -- 172.21.15.99:0/1330086383 >> 172.21.15.99:0/1330086383 conn(0x7f36700b1c40 msgr2=0x7f36700b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:00.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.665+0000 7f3674a00640 1 -- 172.21.15.99:0/1330086383 shutdown_connections 2024-03-30T13:11:00.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.665+0000 7f3674a00640 1 -- 172.21.15.99:0/1330086383 wait complete. 2024-03-30T13:11:00.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.668+0000 7f3674a00640 1 Processor -- start 2024-03-30T13:11:00.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.675+0000 7f3674a00640 1 -- start start 2024-03-30T13:11:00.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.676+0000 7f3674a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3654004800 0x7f367015db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.676+0000 7f3674a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367014ad30 0x7f36701613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.676+0000 7f3674a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36701618f0 0x7f3670071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.677+0000 7f366e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3654004800 0x7f367015db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.677+0000 7f366e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3654004800 0x7f367015db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38462/0 (socket says 172.21.15.99:38462) 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.677+0000 7f366e800640 1 -- 172.21.15.99:0/3521575829 learned_addr learned my addr 172.21.15.99:0/3521575829 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.677+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f367006e430 con 0x7f3654004800 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.677+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f367006df10 con 0x7f36701618f0 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.677+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f36700cceb0 con 0x7f367014ad30 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.678+0000 7f366de00640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367014ad30 0x7f36701613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.678+0000 7f366f200640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36701618f0 0x7f3670071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.678+0000 7f366e800640 1 -- 172.21.15.99:0/3521575829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367014ad30 msgr2=0x7f36701613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.678+0000 7f366e800640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367014ad30 0x7f36701613b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.678+0000 7f366e800640 1 -- 172.21.15.99:0/3521575829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36701618f0 msgr2=0x7f3670071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.678+0000 7f366e800640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36701618f0 0x7f3670071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.678+0000 7f366e800640 1 -- 172.21.15.99:0/3521575829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3670160330 con 0x7f3654004800 2024-03-30T13:11:00.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.679+0000 7f366e800640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3654004800 0x7f367015db00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c7b0 tx=0x7f365c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.679+0000 7f3666a00640 1 -- 172.21.15.99:0/3521575829 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c017070 con 0x7f3654004800 2024-03-30T13:11:00.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.679+0000 7f3666a00640 1 -- 172.21.15.99:0/3521575829 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c005290 con 0x7f3654004800 2024-03-30T13:11:00.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.680+0000 7f3666a00640 1 -- 172.21.15.99:0/3521575829 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c00a880 con 0x7f3654004800 2024-03-30T13:11:00.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.681+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3670160610 con 0x7f3654004800 2024-03-30T13:11:00.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.681+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3670160bd0 con 0x7f3654004800 2024-03-30T13:11:00.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.695+0000 7f651be00640 1 Processor -- start 2024-03-30T13:11:00.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.695+0000 7f651be00640 1 -- start start 2024-03-30T13:11:00.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.697+0000 7f651be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f65140ead00 0x7f651404fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.697+0000 7f651be00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f651404ffd0 0x7f6514037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.697+0000 7f651be00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6514053720 con 0x7f6514038110 2024-03-30T13:11:00.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.697+0000 7f651be00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6514054330 con 0x7f65140ead00 2024-03-30T13:11:00.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.697+0000 7f651be00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6514053a00 con 0x7f651404ffd0 2024-03-30T13:11:00.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.686+0000 7f3666a00640 1 -- 172.21.15.99:0/3521575829 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f365c01a070 con 0x7f3654004800 2024-03-30T13:11:00.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.688+0000 7f3666a00640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f36500b0540 0x7f36500b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.688+0000 7f3666a00640 1 -- 172.21.15.99:0/3521575829 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f365c08ad80 con 0x7f3654004800 2024-03-30T13:11:00.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.698+0000 7f651a000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f651404ffd0 0x7f6514037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.698+0000 7f651b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6514038110 0x7f6514038580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56720/0 (socket says 172.21.15.99:56720) 2024-03-30T13:11:00.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.698+0000 7f651b400640 1 -- 172.21.15.99:0/1344109044 learned_addr learned my addr 172.21.15.99:0/1344109044 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:00.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.689+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367004f8f0 con 0x7f3654004800 2024-03-30T13:11:00.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.690+0000 7f366de00640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f36500b0540 0x7f36500b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.693+0000 7f366de00640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f36500b0540 0x7f36500b2a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3660056000 tx=0x7f3660009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.699+0000 7f651aa00640 1 --2- 172.21.15.99:0/1344109044 >> v2:172.21.15.99:3300/0 conn(0x7f65140ead00 0x7f651404fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.700+0000 7f5741e00640 1 Processor -- start 2024-03-30T13:11:00.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.701+0000 7f5741e00640 1 -- start start 2024-03-30T13:11:00.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.700+0000 7f651aa00640 1 -- 172.21.15.99:0/1344109044 >> v2:172.21.15.181:3300/0 conn(0x7f651404ffd0 msgr2=0x7f6514037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:00.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.700+0000 7f651aa00640 1 --2- 172.21.15.99:0/1344109044 >> v2:172.21.15.181:3300/0 conn(0x7f651404ffd0 0x7f6514037bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.700+0000 7f651aa00640 1 -- 172.21.15.99:0/1344109044 >> v1:172.21.15.99:6789/0 conn(0x7f6514038110 legacy=0x7f6514038580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.700+0000 7f651aa00640 1 -- 172.21.15.99:0/1344109044 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6514053ce0 con 0x7f65140ead00 2024-03-30T13:11:00.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.701+0000 7f3666a00640 1 -- 172.21.15.99:0/3521575829 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f36700cb670 con 0x7f3654004800 2024-03-30T13:11:00.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.702+0000 7fdd02400640 1 Processor -- start 2024-03-30T13:11:00.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.702+0000 7fdd02400640 1 -- start start 2024-03-30T13:11:00.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.702+0000 7f651aa00640 1 --2- 172.21.15.99:0/1344109044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65140ead00 0x7f651404fa90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6514036560 tx=0x7f650c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef9eb9517ce6acd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.703+0000 7f5741e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f573c06da60 0x7f573c0c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.703+0000 7f5741e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c15abf0 0x7f573c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.703+0000 7f5741e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f573c15b2f0 con 0x7f573c0c66d0 2024-03-30T13:11:00.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.703+0000 7f5741e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f573c15b0a0 con 0x7f573c06da60 2024-03-30T13:11:00.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.703+0000 7f5741e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f573c15b5d0 con 0x7f573c15abf0 2024-03-30T13:11:00.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.703+0000 7f6519600640 1 -- 172.21.15.99:0/1344109044 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c035020 con 0x7f65140ead00 2024-03-30T13:11:00.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.703+0000 7f6519600640 1 -- 172.21.15.99:0/1344109044 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650c031640 con 0x7f65140ead00 2024-03-30T13:11:00.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.703+0000 7f6519600640 1 -- 172.21.15.99:0/1344109044 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c02d040 con 0x7f65140ead00 2024-03-30T13:11:00.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.704+0000 7f573aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f573c06da60 0x7f573c0c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.704+0000 7f573a000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f573c0c66d0 0x7f573c06de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:34910/0 (socket says 172.21.15.99:34910) 2024-03-30T13:11:00.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.704+0000 7f573b400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c15abf0 0x7f573c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.704+0000 7fdd02400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdcfc15fc90 0x7fdcfc0b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.704+0000 7fdd02400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdcfc1603c0 0x7fdcfc0d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.704+0000 7fdd02400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc0d32f0 con 0x7fdcfc0b5ea0 2024-03-30T13:11:00.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.704+0000 7fdd02400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fdcfc0d3590 con 0x7fdcfc15fc90 2024-03-30T13:11:00.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.704+0000 7fdd02400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdcfc0d3870 con 0x7fdcfc1603c0 2024-03-30T13:11:00.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.705+0000 7fdcfb400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdcfc15fc90 0x7fdcfc0b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.704+0000 7f573b400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c15abf0 0x7f573c0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38536/0 (socket says 172.21.15.99:38536) 2024-03-30T13:11:00.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.704+0000 7f573b400640 1 -- 172.21.15.99:0/3163765460 learned_addr learned my addr 172.21.15.99:0/3163765460 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.705+0000 7fdcfaa00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdcfc1603c0 0x7fdcfc0d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.705+0000 7f651be00640 1 -- 172.21.15.99:0/1344109044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65140ead00 msgr2=0x7f651404fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.705+0000 7f651be00640 1 --2- 172.21.15.99:0/1344109044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65140ead00 0x7f651404fa90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6514036560 tx=0x7f650c02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.705+0000 7fdcfb400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdcfc15fc90 0x7fdcfc0b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38494/0 (socket says 172.21.15.99:38494) 2024-03-30T13:11:00.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.705+0000 7fdcfb400640 1 -- 172.21.15.99:0/664919379 learned_addr learned my addr 172.21.15.99:0/664919379 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.706+0000 7fdcfaa00640 1 -- 172.21.15.99:0/664919379 >> v2:172.21.15.99:3300/0 conn(0x7fdcfc15fc90 msgr2=0x7fdcfc0b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:00.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.706+0000 7fdcfaa00640 1 --2- 172.21.15.99:0/664919379 >> v2:172.21.15.99:3300/0 conn(0x7fdcfc15fc90 0x7fdcfc0b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.706+0000 7fdcfaa00640 1 -- 172.21.15.99:0/664919379 >> v1:172.21.15.181:6789/0 conn(0x7fdcfc0b5ea0 legacy=0x7fdcfc1624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.706+0000 7fdcfaa00640 1 -- 172.21.15.99:0/664919379 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc0cecc0 con 0x7fdcfc1603c0 2024-03-30T13:11:00.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.706+0000 7f6e60600640 1 Processor -- start 2024-03-30T13:11:00.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.707+0000 7f6e60600640 1 -- start start 2024-03-30T13:11:00.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.706+0000 7f573b400640 1 -- 172.21.15.99:0/3163765460 >> v2:172.21.15.99:3300/0 conn(0x7f573c06da60 msgr2=0x7f573c0c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:00.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.707+0000 7f651be00640 1 -- 172.21.15.99:0/1344109044 shutdown_connections 2024-03-30T13:11:00.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.707+0000 7f651be00640 1 --2- 172.21.15.99:0/1344109044 >> v2:172.21.15.181:3300/0 conn(0x7f651404ffd0 0x7f6514037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.707+0000 7f651be00640 1 --2- 172.21.15.99:0/1344109044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65140ead00 0x7f651404fa90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.708+0000 7f651be00640 1 -- 172.21.15.99:0/1344109044 >> 172.21.15.99:0/1344109044 conn(0x7f6514009fb0 msgr2=0x7f651400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:00.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.706+0000 7f573b400640 1 --2- 172.21.15.99:0/3163765460 >> v2:172.21.15.99:3300/0 conn(0x7f573c06da60 0x7f573c0c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.706+0000 7f573b400640 1 -- 172.21.15.99:0/3163765460 >> v1:172.21.15.181:6789/0 conn(0x7f573c0c66d0 legacy=0x7f573c06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.706+0000 7f573b400640 1 -- 172.21.15.99:0/3163765460 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573c15b8b0 con 0x7f573c15abf0 2024-03-30T13:11:00.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.706+0000 7f5739600640 1 -- 172.21.15.99:0/3163765460 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2905408541 0 0) 0x7f573c15b2f0 con 0x7f573c0c66d0 2024-03-30T13:11:00.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.708+0000 7fdcfaa00640 1 --2- 172.21.15.99:0/664919379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdcfc1603c0 0x7fdcfc0d4e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0097a0 tx=0x7fdcec02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24dfa3441931a6c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.708+0000 7f651be00640 1 -- 172.21.15.99:0/1344109044 shutdown_connections 2024-03-30T13:11:00.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.708+0000 7f573aa00640 1 --2- 172.21.15.99:0/3163765460 >> v2:172.21.15.99:3300/0 conn(0x7f573c06da60 0x7f573c0c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:00.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.708+0000 7fdcfa000640 1 -- 172.21.15.99:0/664919379 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0317c0 con 0x7fdcfc1603c0 2024-03-30T13:11:00.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.708+0000 7fdcfa000640 1 -- 172.21.15.99:0/664919379 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec037070 con 0x7fdcfc1603c0 2024-03-30T13:11:00.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.708+0000 7fdcfa000640 1 -- 172.21.15.99:0/664919379 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec031bc0 con 0x7fdcfc1603c0 2024-03-30T13:11:00.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.708+0000 7f651be00640 1 -- 172.21.15.99:0/1344109044 wait complete. 2024-03-30T13:11:00.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.709+0000 7f573b400640 1 --2- 172.21.15.99:0/3163765460 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c15abf0 0x7f573c0ce2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f573400d370 tx=0x7f573402e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28a6c67717c4f065 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.709+0000 7f5739600640 1 -- 172.21.15.99:0/3163765460 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734034070 con 0x7f573c15abf0 2024-03-30T13:11:00.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.709+0000 7fdd02400640 1 -- 172.21.15.99:0/664919379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdcfc1603c0 msgr2=0x7fdcfc0d4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.709+0000 7fdd02400640 1 --2- 172.21.15.99:0/664919379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdcfc1603c0 0x7fdcfc0d4e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0097a0 tx=0x7fdcec02b860 comp rx=0 tx=0).stop 2024-03-30T13:11:00.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.710+0000 7fdd02400640 1 -- 172.21.15.99:0/664919379 shutdown_connections 2024-03-30T13:11:00.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.710+0000 7fdd02400640 1 --2- 172.21.15.99:0/664919379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdcfc1603c0 0x7fdcfc0d4e60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.710+0000 7fdd02400640 1 --2- 172.21.15.99:0/664919379 >> v2:172.21.15.99:3300/0 conn(0x7fdcfc15fc90 0x7fdcfc0b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.710+0000 7fdd02400640 1 -- 172.21.15.99:0/664919379 >> 172.21.15.99:0/664919379 conn(0x7fdcfc08bfc0 msgr2=0x7fdcfc0d4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:00.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.710+0000 7f5739600640 1 -- 172.21.15.99:0/3163765460 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5734003b90 con 0x7f573c15abf0 2024-03-30T13:11:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.710+0000 7f5739600640 1 -- 172.21.15.99:0/3163765460 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573400be60 con 0x7f573c15abf0 2024-03-30T13:11:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.710+0000 7fdd02400640 1 -- 172.21.15.99:0/664919379 shutdown_connections 2024-03-30T13:11:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.711+0000 7f5741e00640 1 -- 172.21.15.99:0/3163765460 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c15abf0 msgr2=0x7f573c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.711+0000 7f5741e00640 1 --2- 172.21.15.99:0/3163765460 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c15abf0 0x7f573c0ce2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f573400d370 tx=0x7f573402e350 comp rx=0 tx=0).stop 2024-03-30T13:11:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.711+0000 7f5741e00640 1 -- 172.21.15.99:0/3163765460 shutdown_connections 2024-03-30T13:11:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.711+0000 7f5741e00640 1 --2- 172.21.15.99:0/3163765460 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c15abf0 0x7f573c0ce2f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.711+0000 7f5741e00640 1 --2- 172.21.15.99:0/3163765460 >> v2:172.21.15.99:3300/0 conn(0x7f573c06da60 0x7f573c0c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.711+0000 7f5741e00640 1 -- 172.21.15.99:0/3163765460 >> 172.21.15.99:0/3163765460 conn(0x7f573c072ba0 msgr2=0x7f573c072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:00.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.710+0000 7f651be00640 1 Processor -- start 2024-03-30T13:11:00.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.711+0000 7f651be00640 1 -- start start 2024-03-30T13:11:00.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.710+0000 7fdd02400640 1 -- 172.21.15.99:0/664919379 wait complete. 2024-03-30T13:11:00.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.712+0000 7f5741e00640 1 -- 172.21.15.99:0/3163765460 shutdown_connections 2024-03-30T13:11:00.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.712+0000 7f5741e00640 1 -- 172.21.15.99:0/3163765460 wait complete. 2024-03-30T13:11:00.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.712+0000 7f651be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6514038110 0x7f6514046620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.713+0000 7f651be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651404ffd0 0x7f65140d9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.713+0000 7fdd02400640 1 Processor -- start 2024-03-30T13:11:00.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.713+0000 7f651aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6514038110 0x7f6514046620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.713+0000 7f651be00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65140ead00 0x7f65140da150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.713+0000 7f651be00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f65140547c0 con 0x7f6514038110 2024-03-30T13:11:00.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.713+0000 7f651be00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6514038c90 con 0x7f651404ffd0 2024-03-30T13:11:00.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.713+0000 7f651be00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6514054940 con 0x7f65140ead00 2024-03-30T13:11:00.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.713+0000 7f651aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6514038110 0x7f6514046620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38506/0 (socket says 172.21.15.99:38506) 2024-03-30T13:11:00.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.714+0000 7fdd02400640 1 -- start start 2024-03-30T13:11:00.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.714+0000 7f651aa00640 1 -- 172.21.15.99:0/2029843538 learned_addr learned my addr 172.21.15.99:0/2029843538 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.714+0000 7f651a000640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651404ffd0 0x7f65140d9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.714+0000 7f651b400640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65140ead00 0x7f65140da150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.715+0000 7f5741e00640 1 Processor -- start 2024-03-30T13:11:00.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.715+0000 7f5741e00640 1 -- start start 2024-03-30T13:11:00.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.715+0000 7fdd02400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdcfc0b5ea0 0x7fdcfc0b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.715+0000 7f651b400640 1 -- 172.21.15.99:0/2029843538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651404ffd0 msgr2=0x7f65140d9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.715+0000 7f651b400640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651404ffd0 0x7f65140d9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.715+0000 7f651b400640 1 -- 172.21.15.99:0/2029843538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6514038110 msgr2=0x7f6514046620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.716+0000 7f651b400640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6514038110 0x7f6514046620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.716+0000 7fdd02400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcfc15fc90 0x7fdcfc0ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.716+0000 7fdd02400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdcfc1603c0 0x7fdcfc0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.716+0000 7f651b400640 1 -- 172.21.15.99:0/2029843538 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65140da900 con 0x7f65140ead00 2024-03-30T13:11:00.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.716+0000 7f651aa00640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6514038110 0x7f6514046620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:00.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.716+0000 7fdd02400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc0b64b0 con 0x7fdcfc15fc90 2024-03-30T13:11:00.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.716+0000 7fdd02400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc0b6330 con 0x7fdcfc0b5ea0 2024-03-30T13:11:00.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.716+0000 7fdd02400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdcfc0b6630 con 0x7fdcfc1603c0 2024-03-30T13:11:00.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.716+0000 7fdcfb400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdcfc0b5ea0 0x7fdcfc0b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.716+0000 7f5741e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c06da60 0x7f573c152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f5741e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0c66d0 0x7f573c151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f5741e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c15abf0 0x7f573c09ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f5741e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f573c0c5020 con 0x7f573c0c66d0 2024-03-30T13:11:00.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f5741e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f573c15be70 con 0x7f573c15abf0 2024-03-30T13:11:00.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f5741e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f573c0c51a0 con 0x7f573c06da60 2024-03-30T13:11:00.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f573aa00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c06da60 0x7f573c152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f573aa00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c06da60 0x7f573c152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38572/0 (socket says 172.21.15.99:38572) 2024-03-30T13:11:00.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f573aa00640 1 -- 172.21.15.99:0/2570031739 learned_addr learned my addr 172.21.15.99:0/2570031739 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f573a000640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0c66d0 0x7f573c151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7fdcfaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcfc15fc90 0x7fdcfc0ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f573b400640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c15abf0 0x7f573c09ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f6e60600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e58073690 0x7f6e580c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f6e60600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e580c66d0 0x7f6e5815a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f6e60600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6e5806da60 0x7f6e5806def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f6e60600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6e58161820 con 0x7f6e580c66d0 2024-03-30T13:11:00.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f6e60600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6e5815b5d0 con 0x7f6e5806da60 2024-03-30T13:11:00.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7f6e60600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5815b8b0 con 0x7f6e58073690 2024-03-30T13:11:00.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7fdcfaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcfc15fc90 0x7fdcfc0ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38514/0 (socket says 172.21.15.99:38514) 2024-03-30T13:11:00.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7fdcfaa00640 1 -- 172.21.15.99:0/1258663043 learned_addr learned my addr 172.21.15.99:0/1258663043 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.717+0000 7fdcfbe00640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdcfc1603c0 0x7fdcfc0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.718+0000 7f6e5dc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e58073690 0x7f6e580c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.718+0000 7f6e5dc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e58073690 0x7f6e580c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38590/0 (socket says 172.21.15.99:38590) 2024-03-30T13:11:00.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.718+0000 7f6e5dc00640 1 -- 172.21.15.99:0/1046175393 learned_addr learned my addr 172.21.15.99:0/1046175393 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.718+0000 7f6e5d200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e580c66d0 0x7f6e5815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.718+0000 7f6e5d200640 1 -- 172.21.15.99:0/1046175393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e58073690 msgr2=0x7f6e580c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:00.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.718+0000 7f6e5d200640 1 --2- 172.21.15.99:0/1046175393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e58073690 0x7f6e580c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.718+0000 7f6e5d200640 1 -- 172.21.15.99:0/1046175393 >> v2:172.21.15.181:3300/0 conn(0x7f6e5806da60 msgr2=0x7f6e5806def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:00.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.718+0000 7f573a000640 1 -- 172.21.15.99:0/2570031739 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c06da60 msgr2=0x7f573c152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7fdcfaa00640 1 -- 172.21.15.99:0/1258663043 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdcfc1603c0 msgr2=0x7fdcfc0ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7fdcfaa00640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdcfc1603c0 0x7fdcfc0ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7fdcfaa00640 1 -- 172.21.15.99:0/1258663043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdcfc0b5ea0 msgr2=0x7fdcfc0b82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7fdcfaa00640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdcfc0b5ea0 0x7fdcfc0b82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7fdcfaa00640 1 -- 172.21.15.99:0/1258663043 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc0b88d0 con 0x7fdcfc15fc90 2024-03-30T13:11:00.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7f573a000640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c06da60 0x7f573c152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7f573a000640 1 -- 172.21.15.99:0/2570031739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c15abf0 msgr2=0x7f573c09ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7f573a000640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c15abf0 0x7f573c09ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7f573a000640 1 -- 172.21.15.99:0/2570031739 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573c1538e0 con 0x7f573c0c66d0 2024-03-30T13:11:00.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.718+0000 7f6e5e600640 1 --2- 172.21.15.99:0/1046175393 >> v2:172.21.15.181:3300/0 conn(0x7f6e5806da60 0x7f6e5806def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.720+0000 7f573aa00640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c06da60 0x7f573c152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:00.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.720+0000 7f573b400640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c15abf0 0x7f573c09ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:00.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7f6e5d200640 1 --2- 172.21.15.99:0/1046175393 >> v2:172.21.15.181:3300/0 conn(0x7f6e5806da60 0x7f6e5806def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7f6e5d200640 1 -- 172.21.15.99:0/1046175393 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5815bb90 con 0x7f6e580c66d0 2024-03-30T13:11:00.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.720+0000 7f573a000640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0c66d0 0x7f573c151810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f573c0c7160 tx=0x7f572800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7f651b400640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65140ead00 0x7f65140da150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f651c063150 tx=0x7f651c06d900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7f6512a00640 1 -- 172.21.15.99:0/2029843538 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c06d310 con 0x7f65140ead00 2024-03-30T13:11:00.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.719+0000 7f651be00640 1 -- 172.21.15.99:0/2029843538 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65140dab70 con 0x7f65140ead00 2024-03-30T13:11:00.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.720+0000 7f651be00640 1 -- 172.21.15.99:0/2029843538 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65140db130 con 0x7f65140ead00 2024-03-30T13:11:00.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.720+0000 7f6512a00640 1 -- 172.21.15.99:0/2029843538 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c06b510 con 0x7f65140ead00 2024-03-30T13:11:00.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.720+0000 7f6512a00640 1 -- 172.21.15.99:0/2029843538 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c06b980 con 0x7f65140ead00 2024-03-30T13:11:00.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.721+0000 7f5733400640 1 -- 172.21.15.99:0/2570031739 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57280074e0 con 0x7f573c0c66d0 2024-03-30T13:11:00.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.721+0000 7f5733400640 1 -- 172.21.15.99:0/2570031739 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5728007680 con 0x7f573c0c66d0 2024-03-30T13:11:00.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.721+0000 7f6e5d200640 1 --2- 172.21.15.99:0/1046175393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e580c66d0 0x7f6e5815a980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6e580752a0 tx=0x7f6e4402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5914aa5353a5e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.720+0000 7fdcfaa00640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcfc15fc90 0x7fdcfc0ca180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdcec034040 tx=0x7fdcec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.721+0000 7fdcf3400640 1 -- 172.21.15.99:0/1258663043 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec032650 con 0x7fdcfc15fc90 2024-03-30T13:11:00.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.721+0000 7fdcf3400640 1 -- 172.21.15.99:0/1258663043 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec0327f0 con 0x7fdcfc15fc90 2024-03-30T13:11:00.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.722+0000 7fdcf3400640 1 -- 172.21.15.99:0/1258663043 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec032be0 con 0x7fdcfc15fc90 2024-03-30T13:11:00.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.721+0000 7f5733400640 1 -- 172.21.15.99:0/2570031739 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728004a00 con 0x7f573c0c66d0 2024-03-30T13:11:00.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.722+0000 7f5741e00640 1 -- 172.21.15.99:0/2570031739 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573c153bc0 con 0x7f573c0c66d0 2024-03-30T13:11:00.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.722+0000 7f6e57e00640 1 -- 172.21.15.99:0/1046175393 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e44035020 con 0x7f6e580c66d0 2024-03-30T13:11:00.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.722+0000 7f14d1000640 1 Processor -- start 2024-03-30T13:11:00.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.722+0000 7f14d1000640 1 -- start start 2024-03-30T13:11:00.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.722+0000 7fdd02400640 1 -- 172.21.15.99:0/1258663043 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcfc0b8bb0 con 0x7fdcfc15fc90 2024-03-30T13:11:00.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.722+0000 7f5741e00640 1 -- 172.21.15.99:0/2570031739 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f573c154180 con 0x7f573c0c66d0 2024-03-30T13:11:00.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.722+0000 7fdd02400640 1 -- 172.21.15.99:0/1258663043 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcfc15d3b0 con 0x7fdcfc15fc90 2024-03-30T13:11:00.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.722+0000 7f6e57e00640 1 -- 172.21.15.99:0/1046175393 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e44031810 con 0x7f6e580c66d0 2024-03-30T13:11:00.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.723+0000 7f6e57e00640 1 -- 172.21.15.99:0/1046175393 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e44035020 con 0x7f6e580c66d0 2024-03-30T13:11:00.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.723+0000 7f6e60600640 1 -- 172.21.15.99:0/1046175393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e580c66d0 msgr2=0x7f6e5815a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.723+0000 7f6e60600640 1 --2- 172.21.15.99:0/1046175393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e580c66d0 0x7f6e5815a980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6e580752a0 tx=0x7f6e4402b8b0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f6e60600640 1 -- 172.21.15.99:0/1046175393 shutdown_connections 2024-03-30T13:11:00.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7fdd02400640 1 -- 172.21.15.99:0/1258663043 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcfc15d5b0 con 0x7fdcfc15fc90 2024-03-30T13:11:00.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f6e60600640 1 --2- 172.21.15.99:0/1046175393 >> v2:172.21.15.181:3300/0 conn(0x7f6e5806da60 0x7f6e5806def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f6e60600640 1 --2- 172.21.15.99:0/1046175393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e580c66d0 0x7f6e5815a980 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f6e60600640 1 --2- 172.21.15.99:0/1046175393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e58073690 0x7f6e580c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f6e60600640 1 -- 172.21.15.99:0/1046175393 >> 172.21.15.99:0/1046175393 conn(0x7f6e58072ba0 msgr2=0x7f6e58072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:00.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f14d1000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f14cc0ccb40 0x7f14cc0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f14d1000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f14cc0c5780 0x7f14cc0ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f6e60600640 1 -- 172.21.15.99:0/1046175393 shutdown_connections 2024-03-30T13:11:00.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f6e60600640 1 -- 172.21.15.99:0/1046175393 wait complete. 2024-03-30T13:11:00.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f14d1000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f14cc098be0 0x7f14cc06e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f14d1000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f14cc163200 con 0x7f14cc098be0 2024-03-30T13:11:00.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f14d1000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f14cc06e3a0 con 0x7f14cc0ccb40 2024-03-30T13:11:00.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f14d1000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f14cc0cd460 con 0x7f14cc0c5780 2024-03-30T13:11:00.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.724+0000 7f651be00640 1 -- 172.21.15.99:0/2029843538 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f4005290 con 0x7f65140ead00 2024-03-30T13:11:00.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.725+0000 7f14c9e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f14cc0ccb40 0x7f14cc0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.725+0000 7f14c9e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f14cc0ccb40 0x7f14cc0ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49594/0 (socket says 172.21.15.99:49594) 2024-03-30T13:11:00.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.725+0000 7f14c9e00640 1 -- 172.21.15.99:0/3970004386 learned_addr learned my addr 172.21.15.99:0/3970004386 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.725+0000 7f14c9400640 1 --2- 172.21.15.99:0/3970004386 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f14cc0c5780 0x7f14cc0ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.726+0000 7fdf30c00640 1 Processor -- start 2024-03-30T13:11:00.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.726+0000 7f14c9e00640 1 -- 172.21.15.99:0/3970004386 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f14cc0c5780 msgr2=0x7f14cc0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:00.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.726+0000 7f14c9e00640 1 --2- 172.21.15.99:0/3970004386 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f14cc0c5780 0x7f14cc0ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.726+0000 7f14c9e00640 1 -- 172.21.15.99:0/3970004386 >> v2:172.21.15.99:3300/0 conn(0x7f14cc098be0 msgr2=0x7f14cc06e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:00.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.726+0000 7f14c9e00640 1 --2- 172.21.15.99:0/3970004386 >> v2:172.21.15.99:3300/0 conn(0x7f14cc098be0 0x7f14cc06e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.727+0000 7f6e60600640 1 Processor -- start 2024-03-30T13:11:00.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.726+0000 7f14c9e00640 1 -- 172.21.15.99:0/3970004386 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc099410 con 0x7f14cc0ccb40 2024-03-30T13:11:00.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.726+0000 7f5741e00640 1 -- 172.21.15.99:0/2570031739 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573c068640 con 0x7f573c0c66d0 2024-03-30T13:11:00.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.728+0000 7f14c9e00640 1 --2- 172.21.15.99:0/3970004386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14cc0ccb40 0x7f14cc0ca7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14cc06c4f0 tx=0x7f14bc02b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b996d95dd6fca19 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.728+0000 7f6e60600640 1 -- start start 2024-03-30T13:11:00.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.729+0000 7f6e60600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e5806da60 0x7f6e581f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.729+0000 7f6e60600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e58073690 0x7f6e5814bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.729+0000 7f6e60600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e580c66d0 0x7f6e581f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.729+0000 7f6e60600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6e580c51a0 con 0x7f6e5806da60 2024-03-30T13:11:00.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.729+0000 7f6e60600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6e580c5020 con 0x7f6e58073690 2024-03-30T13:11:00.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.729+0000 7f6e60600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5815aec0 con 0x7f6e580c66d0 2024-03-30T13:11:00.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.727+0000 7fdf30c00640 1 -- start start 2024-03-30T13:11:00.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.728+0000 7f5733400640 1 -- 172.21.15.99:0/2570031739 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5728011070 con 0x7f573c0c66d0 2024-03-30T13:11:00.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.729+0000 7f5733400640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f571c06c530 0x7f571c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.729+0000 7f5733400640 1 -- 172.21.15.99:0/2570031739 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f572808b230 con 0x7f573c0c66d0 2024-03-30T13:11:00.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.730+0000 7f6e5e600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e580c66d0 0x7f6e581f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.730+0000 7f6e5e600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e580c66d0 0x7f6e581f8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38610/0 (socket says 172.21.15.99:38610) 2024-03-30T13:11:00.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.730+0000 7f6e5e600640 1 -- 172.21.15.99:0/3459689057 learned_addr learned my addr 172.21.15.99:0/3459689057 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.730+0000 7f6e5d200640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e58073690 0x7f6e5814bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.730+0000 7fdf30c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdf2c06da60 0x7fdf2c0c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.730+0000 7fdf30c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdf2c15abf0 0x7fdf2c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.730+0000 7fdf30c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf2c15b2f0 con 0x7fdf2c0c66d0 2024-03-30T13:11:00.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.730+0000 7fdf30c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fdf2c15b0a0 con 0x7fdf2c06da60 2024-03-30T13:11:00.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.730+0000 7fdf30c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fdf2c15b5d0 con 0x7fdf2c15abf0 2024-03-30T13:11:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7f6e5dc00640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e5806da60 0x7f6e581f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7f6e5e600640 1 -- 172.21.15.99:0/3459689057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e58073690 msgr2=0x7f6e5814bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7f6e5e600640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e58073690 0x7f6e5814bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7f6e5e600640 1 -- 172.21.15.99:0/3459689057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e5806da60 msgr2=0x7f6e581f7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7f6e5e600640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e5806da60 0x7f6e581f7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7f6e5e600640 1 -- 172.21.15.99:0/3459689057 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e581f79e0 con 0x7f6e580c66d0 2024-03-30T13:11:00.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7f6e5dc00640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e5806da60 0x7f6e581f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:00.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7fdf29400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fdf2c0c66d0 0x7fdf2c06de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:34926/0 (socket says 172.21.15.99:34926) 2024-03-30T13:11:00.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7fdf29400640 1 -- 172.21.15.99:0/929279863 learned_addr learned my addr 172.21.15.99:0/929279863 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:00.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.730+0000 7fdcf3400640 1 -- 172.21.15.99:0/1258663043 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdcec04e430 con 0x7fdcfc15fc90 2024-03-30T13:11:00.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7fdcf3400640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdcdc06c600 0x7fdcdc06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7fdcf3400640 1 -- 172.21.15.99:0/1258663043 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdcec0ad820 con 0x7fdcfc15fc90 2024-03-30T13:11:00.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7fdcfb400640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdcdc06c600 0x7fdcdc06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.732+0000 7f6e5e600640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e580c66d0 0x7f6e581f8a80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000cd20 tx=0x7f6e5000a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.732+0000 7f14c8a00640 1 -- 172.21.15.99:0/3970004386 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc035020 con 0x7f14cc0ccb40 2024-03-30T13:11:00.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.732+0000 7f14c8a00640 1 -- 172.21.15.99:0/3970004386 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14bc031890 con 0x7f14cc0ccb40 2024-03-30T13:11:00.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.732+0000 7f14c8a00640 1 -- 172.21.15.99:0/3970004386 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc031ca0 con 0x7f14cc0ccb40 2024-03-30T13:11:00.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.732+0000 7f573aa00640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f571c06c530 0x7f571c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.732+0000 7fdcfb400640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdcdc06c600 0x7fdcdc06eac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc15ef70 tx=0x7fdcf40091b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.733+0000 7f14d1000640 1 -- 172.21.15.99:0/3970004386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14cc0ccb40 msgr2=0x7f14cc0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.733+0000 7f14d1000640 1 --2- 172.21.15.99:0/3970004386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14cc0ccb40 0x7f14cc0ca7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14cc06c4f0 tx=0x7f14bc02b930 comp rx=0 tx=0).stop 2024-03-30T13:11:00.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.733+0000 7f573aa00640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f571c06c530 0x7f571c06e9f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f572c009e70 tx=0x7f572c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.733+0000 7fdf28a00640 1 -- 172.21.15.99:0/929279863 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1848153413 0 0) 0x7fdf2c15b2f0 con 0x7fdf2c0c66d0 2024-03-30T13:11:00.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.733+0000 7fdf28a00640 1 -- 172.21.15.99:0/929279863 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf10003520 con 0x7fdf2c0c66d0 2024-03-30T13:11:00.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.733+0000 7fdf2a800640 1 --2- 172.21.15.99:0/929279863 >> v2:172.21.15.181:3300/0 conn(0x7fdf2c15abf0 0x7fdf2c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.731+0000 7f6512a00640 1 -- 172.21.15.99:0/2029843538 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f651c06bb20 con 0x7f65140ead00 2024-03-30T13:11:00.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.734+0000 7f6512a00640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f64fc06c530 0x7f64fc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.734+0000 7f6512a00640 1 -- 172.21.15.99:0/2029843538 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f651c106640 con 0x7f65140ead00 2024-03-30T13:11:00.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.734+0000 7f651aa00640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f64fc06c530 0x7f64fc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.735+0000 7fdf29e00640 1 --2- 172.21.15.99:0/929279863 >> v2:172.21.15.99:3300/0 conn(0x7fdf2c06da60 0x7fdf2c0c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.735+0000 7f651aa00640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f64fc06c530 0x7f64fc06e9f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f650c02b930 tx=0x7f650c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.735+0000 7f14d1000640 1 -- 172.21.15.99:0/3970004386 shutdown_connections 2024-03-30T13:11:00.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.735+0000 7f14d1000640 1 --2- 172.21.15.99:0/3970004386 >> v2:172.21.15.99:3300/0 conn(0x7f14cc098be0 0x7f14cc06e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.735+0000 7f14d1000640 1 --2- 172.21.15.99:0/3970004386 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f14cc0c5780 0x7f14cc0ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.735+0000 7f14d1000640 1 --2- 172.21.15.99:0/3970004386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14cc0ccb40 0x7f14cc0ca7b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.735+0000 7f14d1000640 1 -- 172.21.15.99:0/3970004386 >> 172.21.15.99:0/3970004386 conn(0x7f14cc072ba0 msgr2=0x7f14cc072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:00.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.735+0000 7f14d1000640 1 -- 172.21.15.99:0/3970004386 shutdown_connections 2024-03-30T13:11:00.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.735+0000 7f14d1000640 1 -- 172.21.15.99:0/3970004386 wait complete. 2024-03-30T13:11:00.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.737+0000 7f14d1000640 1 Processor -- start 2024-03-30T13:11:00.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.736+0000 7fdf2a800640 1 -- 172.21.15.99:0/929279863 >> v2:172.21.15.99:3300/0 conn(0x7fdf2c06da60 msgr2=0x7fdf2c0c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:00.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.736+0000 7fdf2a800640 1 --2- 172.21.15.99:0/929279863 >> v2:172.21.15.99:3300/0 conn(0x7fdf2c06da60 0x7fdf2c0c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.736+0000 7fdf2a800640 1 -- 172.21.15.99:0/929279863 >> v1:172.21.15.181:6789/0 conn(0x7fdf2c0c66d0 legacy=0x7fdf2c06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.736+0000 7fdf2a800640 1 -- 172.21.15.99:0/929279863 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c15b8b0 con 0x7fdf2c15abf0 2024-03-30T13:11:00.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.737+0000 7f14d1000640 1 -- start start 2024-03-30T13:11:00.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.738+0000 7fdf2a800640 1 --2- 172.21.15.99:0/929279863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf2c15abf0 0x7fdf2c0ce2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c072760 tx=0x7fdf2402bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=609218d7acf32018 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.738+0000 7f14d1000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f14cc098be0 0x7f14cc1594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.738+0000 7f14d1000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14cc0c5780 0x7f14cc0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.738+0000 7fdf28a00640 1 -- 172.21.15.99:0/929279863 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24039070 con 0x7fdf2c15abf0 2024-03-30T13:11:00.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.738+0000 7fdf28a00640 1 -- 172.21.15.99:0/929279863 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2402ccb0 con 0x7fdf2c15abf0 2024-03-30T13:11:00.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.738+0000 7fdf28a00640 1 -- 172.21.15.99:0/929279863 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24034640 con 0x7fdf2c15abf0 2024-03-30T13:11:00.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.738+0000 7f14d1000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14cc0ccb40 0x7f14cc0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.738+0000 7f14d1000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc099cb0 con 0x7f14cc0ccb40 2024-03-30T13:11:00.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.738+0000 7f14d1000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc0999d0 con 0x7f14cc0c5780 2024-03-30T13:11:00.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.738+0000 7f14d1000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f14cc099070 con 0x7f14cc098be0 2024-03-30T13:11:00.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.739+0000 7f14ca800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14cc0ccb40 0x7f14cc0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.739+0000 7f14ca800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14cc0ccb40 0x7f14cc0c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38562/0 (socket says 172.21.15.99:38562) 2024-03-30T13:11:00.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.739+0000 7f14ca800640 1 -- 172.21.15.99:0/1381201018 learned_addr learned my addr 172.21.15.99:0/1381201018 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.739+0000 7f14c9e00640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f14cc098be0 0x7f14cc1594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.739+0000 7f14ca800640 1 -- 172.21.15.99:0/1381201018 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f14cc098be0 msgr2=0x7f14cc1594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.739+0000 7f14ca800640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f14cc098be0 0x7f14cc1594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.739+0000 7f14ca800640 1 -- 172.21.15.99:0/1381201018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14cc0c5780 msgr2=0x7f14cc0c9a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T13:11:00.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.739+0000 7f14ca800640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14cc0c5780 0x7f14cc0c9a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.740+0000 7f14ca800640 1 -- 172.21.15.99:0/1381201018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc0c89a0 con 0x7f14cc0ccb40 2024-03-30T13:11:00.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.739+0000 7fdf30c00640 1 -- 172.21.15.99:0/929279863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf2c15abf0 msgr2=0x7fdf2c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.739+0000 7fdf30c00640 1 --2- 172.21.15.99:0/929279863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf2c15abf0 0x7fdf2c0ce2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c072760 tx=0x7fdf2402bf00 comp rx=0 tx=0).stop 2024-03-30T13:11:00.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.740+0000 7f5733400640 1 -- 172.21.15.99:0/2570031739 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5728059180 con 0x7f573c0c66d0 2024-03-30T13:11:00.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.740+0000 7fdf30c00640 1 -- 172.21.15.99:0/929279863 shutdown_connections 2024-03-30T13:11:00.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.740+0000 7fdf30c00640 1 --2- 172.21.15.99:0/929279863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf2c15abf0 0x7fdf2c0ce2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.740+0000 7fdf30c00640 1 --2- 172.21.15.99:0/929279863 >> v2:172.21.15.99:3300/0 conn(0x7fdf2c06da60 0x7fdf2c0c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.740+0000 7f14ca800640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14cc0ccb40 0x7f14cc0c7ee0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f14c400b9a0 tx=0x7f14c400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.740+0000 7fdf30c00640 1 -- 172.21.15.99:0/929279863 >> 172.21.15.99:0/929279863 conn(0x7fdf2c072ba0 msgr2=0x7fdf2c072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:00.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.740+0000 7fdf30c00640 1 -- 172.21.15.99:0/929279863 shutdown_connections 2024-03-30T13:11:00.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.742+0000 7fdf30c00640 1 -- 172.21.15.99:0/929279863 wait complete. 2024-03-30T13:11:00.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.743+0000 7fdf30c00640 1 Processor -- start 2024-03-30T13:11:00.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.743+0000 7fdf30c00640 1 -- start start 2024-03-30T13:11:00.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.744+0000 7f14c2000640 1 -- 172.21.15.99:0/1381201018 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4019070 con 0x7f14cc0ccb40 2024-03-30T13:11:00.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.744+0000 7f14c2000640 1 -- 172.21.15.99:0/1381201018 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c400cbc0 con 0x7f14cc0ccb40 2024-03-30T13:11:00.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.744+0000 7fdf30c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf2c06da60 0x7fdf2c099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.744+0000 7fdf30c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf2c0c66d0 0x7fdf2c09a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.744+0000 7f14c2000640 1 -- 172.21.15.99:0/1381201018 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4014440 con 0x7f14cc0ccb40 2024-03-30T13:11:00.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.744+0000 7fdf30c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf2c15abf0 0x7fdf2c0ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.744+0000 7fdf30c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c0c5020 con 0x7fdf2c15abf0 2024-03-30T13:11:00.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.744+0000 7fdf30c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c15be70 con 0x7fdf2c06da60 2024-03-30T13:11:00.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.744+0000 7fdf30c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdf2c0c51a0 con 0x7fdf2c0c66d0 2024-03-30T13:11:00.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.745+0000 7fdf2a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf2c15abf0 0x7fdf2c0ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.745+0000 7fdcf3400640 1 -- 172.21.15.99:0/1258663043 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fdcfc15d5b0 con 0x7fdcfc15fc90 2024-03-30T13:11:00.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.744+0000 7f14d1000640 1 -- 172.21.15.99:0/1381201018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14cc0c8c80 con 0x7f14cc0ccb40 2024-03-30T13:11:00.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.745+0000 7fdf2a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf2c15abf0 0x7fdf2c0ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38568/0 (socket says 172.21.15.99:38568) 2024-03-30T13:11:00.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.745+0000 7fdf2a800640 1 -- 172.21.15.99:0/1144242592 learned_addr learned my addr 172.21.15.99:0/1144242592 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.745+0000 7fdf29e00640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf2c06da60 0x7fdf2c099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7fdf29400640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf2c0c66d0 0x7fdf2c09a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7f6e55600640 1 -- 172.21.15.99:0/3459689057 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e50003b90 con 0x7f6e580c66d0 2024-03-30T13:11:00.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7f6e55600640 1 -- 172.21.15.99:0/3459689057 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e50003d30 con 0x7f6e580c66d0 2024-03-30T13:11:00.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7f6e55600640 1 -- 172.21.15.99:0/3459689057 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e50004240 con 0x7f6e580c66d0 2024-03-30T13:11:00.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7fdf29e00640 1 -- 172.21.15.99:0/1144242592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf2c0c66d0 msgr2=0x7fdf2c09a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7f14d1000640 1 -- 172.21.15.99:0/1381201018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14cc0c9240 con 0x7f14cc0ccb40 2024-03-30T13:11:00.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7f6e60600640 1 -- 172.21.15.99:0/3459689057 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e581f7cc0 con 0x7f6e580c66d0 2024-03-30T13:11:00.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7f6e60600640 1 -- 172.21.15.99:0/3459689057 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e581f8280 con 0x7f6e580c66d0 2024-03-30T13:11:00.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.747+0000 7f14c2000640 1 -- 172.21.15.99:0/1381201018 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f14c401c070 con 0x7f14cc0ccb40 2024-03-30T13:11:00.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7fdf29e00640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf2c0c66d0 0x7fdf2c09a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7fdf29e00640 1 -- 172.21.15.99:0/1144242592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf2c15abf0 msgr2=0x7fdf2c0ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7fdf29e00640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf2c15abf0 0x7fdf2c0ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.746+0000 7fdf29e00640 1 -- 172.21.15.99:0/1144242592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c099ec0 con 0x7fdf2c06da60 2024-03-30T13:11:00.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.748+0000 7f14d1000640 1 -- 172.21.15.99:0/1381201018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14cc068640 con 0x7f14cc0ccb40 2024-03-30T13:11:00.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.748+0000 7f6e60600640 1 -- 172.21.15.99:0/3459689057 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e34005290 con 0x7f6e580c66d0 2024-03-30T13:11:00.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.747+0000 7fdf29400640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf2c0c66d0 0x7fdf2c09a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:00.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.749+0000 7f14c2000640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f14ac06c580 0x7f14ac06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.749+0000 7f14c2000640 1 -- 172.21.15.99:0/1381201018 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f14c408b030 con 0x7f14cc0ccb40 2024-03-30T13:11:00.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.749+0000 7fdf2a800640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf2c15abf0 0x7fdf2c0ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:00.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.749+0000 7fdf29e00640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf2c06da60 0x7fdf2c099980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400e870 tx=0x7fdf1400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.749+0000 7f6512a00640 1 -- 172.21.15.99:0/2029843538 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f651c0d4570 con 0x7f65140ead00 2024-03-30T13:11:00.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.750+0000 7fdf22000640 1 -- 172.21.15.99:0/1144242592 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14017070 con 0x7fdf2c06da60 2024-03-30T13:11:00.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.750+0000 7fdf22000640 1 -- 172.21.15.99:0/1144242592 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf1400ee60 con 0x7fdf2c06da60 2024-03-30T13:11:00.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.750+0000 7f6e55600640 1 -- 172.21.15.99:0/3459689057 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6e500043e0 con 0x7f6e580c66d0 2024-03-30T13:11:00.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.751+0000 7f14c9e00640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f14ac06c580 0x7f14ac06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.750+0000 7fdf30c00640 1 -- 172.21.15.99:0/1144242592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2c09c6e0 con 0x7fdf2c06da60 2024-03-30T13:11:00.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.750+0000 7fdf30c00640 1 -- 172.21.15.99:0/1144242592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf2c09cca0 con 0x7fdf2c06da60 2024-03-30T13:11:00.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.751+0000 7fdf22000640 1 -- 172.21.15.99:0/1144242592 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1400cb60 con 0x7fdf2c06da60 2024-03-30T13:11:00.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.753+0000 7f6e55600640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6e3806c530 0x7f6e3806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.753+0000 7f6e55600640 1 -- 172.21.15.99:0/3459689057 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6e5008c4d0 con 0x7f6e580c66d0 2024-03-30T13:11:00.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.754+0000 7f6e5dc00640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6e3806c530 0x7f6e3806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.755+0000 7f6e5dc00640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6e3806c530 0x7f6e3806e9f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009c20 tx=0x7f6e4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.753+0000 7fdf30c00640 1 -- 172.21.15.99:0/1144242592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf04005290 con 0x7fdf2c06da60 2024-03-30T13:11:00.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.756+0000 7f14c9e00640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f14ac06c580 0x7f14ac06ea40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14bc036000 tx=0x7f14bc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.758+0000 7fdf22000640 1 -- 172.21.15.99:0/1144242592 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdf1401a070 con 0x7fdf2c06da60 2024-03-30T13:11:00.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.759+0000 7fdf22000640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf0806c530 0x7fdf0806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.759+0000 7fdf22000640 1 -- 172.21.15.99:0/1144242592 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdf1408b980 con 0x7fdf2c06da60 2024-03-30T13:11:00.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.760+0000 7fdf29400640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf0806c530 0x7fdf0806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.762+0000 7fdf29400640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf0806c530 0x7fdf0806e9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0ad230 tx=0x7fdf1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.762+0000 7f14c2000640 1 -- 172.21.15.99:0/1381201018 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f14c40597e0 con 0x7f14cc0ccb40 2024-03-30T13:11:00.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.762+0000 7f6e55600640 1 -- 172.21.15.99:0/3459689057 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6e5005ab60 con 0x7f6e580c66d0 2024-03-30T13:11:00.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.772+0000 7fdf22000640 1 -- 172.21.15.99:0/1144242592 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fdf2c099ec0 con 0x7fdf2c06da60 2024-03-30T13:11:00.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.870+0000 7fcaa4e00640 1 Processor -- start 2024-03-30T13:11:00.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.870+0000 7fcaa4e00640 1 -- start start 2024-03-30T13:11:00.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.872+0000 7fcaa4e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcaa006f840 0x7fcaa015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.872+0000 7fcaa4e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 0x7fcaa00d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.872+0000 7fcaa4e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa015e430 con 0x7fcaa00c64f0 2024-03-30T13:11:00.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.872+0000 7fcaa4e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa00d0aa0 con 0x7fcaa006f840 2024-03-30T13:11:00.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.872+0000 7fcaa4e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa015abf0 con 0x7fcaa00d00f0 2024-03-30T13:11:00.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.873+0000 7fca9d400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 0x7fcaa00d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.873+0000 7fca9de00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcaa006f840 0x7fcaa015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.873+0000 7fca9d400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 0x7fcaa00d0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38630/0 (socket says 172.21.15.99:38630) 2024-03-30T13:11:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.873+0000 7fca9d400640 1 -- 172.21.15.99:0/541009275 learned_addr learned my addr 172.21.15.99:0/541009275 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.874+0000 7fca9d400640 1 -- 172.21.15.99:0/541009275 >> v2:172.21.15.181:3300/0 conn(0x7fcaa006f840 msgr2=0x7fcaa015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:00.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.877+0000 7fca9d400640 1 --2- 172.21.15.99:0/541009275 >> v2:172.21.15.181:3300/0 conn(0x7fcaa006f840 0x7fcaa015a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.877+0000 7fca9d400640 1 -- 172.21.15.99:0/541009275 >> v1:172.21.15.99:6789/0 conn(0x7fcaa00c64f0 legacy=0x7fcaa00c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:00.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.877+0000 7fca9d400640 1 -- 172.21.15.99:0/541009275 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa015e710 con 0x7fcaa00d00f0 2024-03-30T13:11:00.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.882+0000 7fca9de00640 1 --2- 172.21.15.99:0/541009275 >> v2:172.21.15.181:3300/0 conn(0x7fcaa006f840 0x7fcaa015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:00.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.882+0000 7fca9d400640 1 --2- 172.21.15.99:0/541009275 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 0x7fcaa00d0560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca9000b920 tx=0x7fca9002be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=577cf750bcaf50c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.883+0000 7fca9ca00640 1 -- 172.21.15.99:0/541009275 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90039070 con 0x7fcaa00d00f0 2024-03-30T13:11:00.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.886+0000 7fca9ca00640 1 -- 172.21.15.99:0/541009275 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9002cbf0 con 0x7fcaa00d00f0 2024-03-30T13:11:00.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.886+0000 7fca9ca00640 1 -- 172.21.15.99:0/541009275 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90034440 con 0x7fcaa00d00f0 2024-03-30T13:11:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.888+0000 7fcaa4e00640 1 -- 172.21.15.99:0/541009275 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 msgr2=0x7fcaa00d0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.888+0000 7fcaa4e00640 1 --2- 172.21.15.99:0/541009275 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 0x7fcaa00d0560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca9000b920 tx=0x7fca9002be40 comp rx=0 tx=0).stop 2024-03-30T13:11:00.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.892+0000 7fcaa4e00640 1 -- 172.21.15.99:0/541009275 shutdown_connections 2024-03-30T13:11:00.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.892+0000 7fcaa4e00640 1 --2- 172.21.15.99:0/541009275 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 0x7fcaa00d0560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.892+0000 7fcaa4e00640 1 --2- 172.21.15.99:0/541009275 >> v2:172.21.15.181:3300/0 conn(0x7fcaa006f840 0x7fcaa015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.892+0000 7fcaa4e00640 1 -- 172.21.15.99:0/541009275 >> 172.21.15.99:0/541009275 conn(0x7fcaa006b510 msgr2=0x7fcaa006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:00.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.896+0000 7fcaa4e00640 1 -- 172.21.15.99:0/541009275 shutdown_connections 2024-03-30T13:11:00.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.896+0000 7fcaa4e00640 1 -- 172.21.15.99:0/541009275 wait complete. 2024-03-30T13:11:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.899+0000 7fcaa4e00640 1 Processor -- start 2024-03-30T13:11:00.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.907+0000 7fcaa4e00640 1 -- start start 2024-03-30T13:11:00.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.908+0000 7fcaa4e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa006f840 0x7fcaa00adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.908+0000 7fcaa4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa00c64f0 0x7fcaa01f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.912+0000 7fcaa4e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 0x7fcaa01f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.912+0000 7fcaa4e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa00cdd30 con 0x7fcaa00c64f0 2024-03-30T13:11:00.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.912+0000 7fcaa4e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa015ecd0 con 0x7fcaa006f840 2024-03-30T13:11:00.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.912+0000 7fcaa4e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa00cdeb0 con 0x7fcaa00d00f0 2024-03-30T13:11:00.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.912+0000 7fca9e800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 0x7fcaa01f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.912+0000 7fca9de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa006f840 0x7fcaa00adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.912+0000 7fca9e800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 0x7fcaa01f3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38640/0 (socket says 172.21.15.99:38640) 2024-03-30T13:11:00.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.912+0000 7fca9e800640 1 -- 172.21.15.99:0/1554793520 learned_addr learned my addr 172.21.15.99:0/1554793520 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:00.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.913+0000 7fca9d400640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa00c64f0 0x7fcaa01f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.913+0000 7fca9de00640 1 -- 172.21.15.99:0/1554793520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 msgr2=0x7fcaa01f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.913+0000 7fca9de00640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 0x7fcaa01f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.913+0000 7fca9de00640 1 -- 172.21.15.99:0/1554793520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa00c64f0 msgr2=0x7fcaa01f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:00.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.913+0000 7fca9de00640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa00c64f0 0x7fcaa01f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:00.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.913+0000 7fca9de00640 1 -- 172.21.15.99:0/1554793520 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa009bfb0 con 0x7fcaa006f840 2024-03-30T13:11:00.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.914+0000 7fca9de00640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa006f840 0x7fcaa00adaa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca8c012bb0 tx=0x7fca8c010490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.914+0000 7fca96000640 1 -- 172.21.15.99:0/1554793520 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c00d2d0 con 0x7fcaa006f840 2024-03-30T13:11:00.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.914+0000 7fcaa4e00640 1 -- 172.21.15.99:0/1554793520 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa00ae410 con 0x7fcaa006f840 2024-03-30T13:11:00.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.915+0000 7fcaa4e00640 1 -- 172.21.15.99:0/1554793520 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa009c220 con 0x7fcaa006f840 2024-03-30T13:11:00.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.916+0000 7fca96000640 1 -- 172.21.15.99:0/1554793520 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8c01d070 con 0x7fcaa006f840 2024-03-30T13:11:00.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.916+0000 7fca96000640 1 -- 172.21.15.99:0/1554793520 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c010b40 con 0x7fcaa006f840 2024-03-30T13:11:00.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.918+0000 7fcaa4e00640 1 -- 172.21.15.99:0/1554793520 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa0068640 con 0x7fcaa006f840 2024-03-30T13:11:00.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.925+0000 7fca96000640 1 -- 172.21.15.99:0/1554793520 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fca8c016050 con 0x7fcaa006f840 2024-03-30T13:11:00.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.927+0000 7fca96000640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fca80074d40 0x7fca80077200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:00.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.927+0000 7fca96000640 1 -- 172.21.15.99:0/1554793520 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fca8c08ae60 con 0x7fcaa006f840 2024-03-30T13:11:00.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.930+0000 7fca9d400640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fca80074d40 0x7fca80077200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:00.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.934+0000 7fca9d400640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fca80074d40 0x7fca80077200 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca90036000 tx=0x7fca90030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:00.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:00.939+0000 7fca96000640 1 -- 172.21.15.99:0/1554793520 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fca8c014040 con 0x7fcaa006f840 2024-03-30T13:11:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.126+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3670162c20 con 0x7f3654004800 2024-03-30T13:11:01.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.129+0000 7f3666a00640 1 -- 172.21.15.99:0/3521575829 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f365c059270 con 0x7f3654004800 2024-03-30T13:11:01.132 INFO:teuthology.orchestra.run.smithi099.stdout:68719476742 2024-03-30T13:11:01.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.132+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f36500b0540 msgr2=0x7f36500b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.132+0000 7f3674a00640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f36500b0540 0x7f36500b2a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3660056000 tx=0x7f3660009030 comp rx=0 tx=0).stop 2024-03-30T13:11:01.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.132+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3654004800 msgr2=0x7f367015db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.132+0000 7f3674a00640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3654004800 0x7f367015db00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c7b0 tx=0x7f365c00cc70 comp rx=0 tx=0).stop 2024-03-30T13:11:01.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.133+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 shutdown_connections 2024-03-30T13:11:01.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.133+0000 7f3674a00640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f36500b0540 0x7f36500b2a00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.133+0000 7f3674a00640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36701618f0 0x7f3670071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.133+0000 7f3674a00640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367014ad30 0x7f36701613b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.133+0000 7f3674a00640 1 --2- 172.21.15.99:0/3521575829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3654004800 0x7f367015db00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.133+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 >> 172.21.15.99:0/3521575829 conn(0x7f36700b1c40 msgr2=0x7f3670161ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:01.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.136+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 shutdown_connections 2024-03-30T13:11:01.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.136+0000 7f3674a00640 1 -- 172.21.15.99:0/3521575829 wait complete. 2024-03-30T13:11:01.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.180+0000 7f651be00640 1 -- 172.21.15.99:0/2029843538 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f64f4005580 con 0x7f65140ead00 2024-03-30T13:11:01.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.0 2024-03-30T13:11:01.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.181+0000 7fdd02400640 1 -- 172.21.15.99:0/1258663043 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fdcfc068640 con 0x7fdcfc15fc90 2024-03-30T13:11:01.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.181+0000 7fdcf3400640 1 -- 172.21.15.99:0/1258663043 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdcec040070 con 0x7fdcfc15fc90 2024-03-30T13:11:01.185 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:01.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.181+0000 7f6512a00640 1 -- 172.21.15.99:0/2029843538 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f651c0d8870 con 0x7f65140ead00 2024-03-30T13:11:01.186 INFO:teuthology.orchestra.run.smithi099.stdout:60129542152 2024-03-30T13:11:01.186 INFO:teuthology.orchestra.run.smithi099.stdout:68719476743 2024-03-30T13:11:01.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.185+0000 7fdd02400640 1 -- 172.21.15.99:0/1258663043 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdcdc06c600 msgr2=0x7fdcdc06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.185+0000 7fdd02400640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdcdc06c600 0x7fdcdc06eac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc15ef70 tx=0x7fdcf40091b0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.185+0000 7fdd02400640 1 -- 172.21.15.99:0/1258663043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcfc15fc90 msgr2=0x7fdcfc0ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.185+0000 7fdd02400640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcfc15fc90 0x7fdcfc0ca180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdcec034040 tx=0x7fdcec0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7f651be00640 1 -- 172.21.15.99:0/2029843538 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f64fc06c530 msgr2=0x7f64fc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7fdd02400640 1 -- 172.21.15.99:0/1258663043 shutdown_connections 2024-03-30T13:11:01.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7fdd02400640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdcdc06c600 0x7fdcdc06eac0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7fdd02400640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdcfc1603c0 0x7fdcfc0ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7fdd02400640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcfc15fc90 0x7fdcfc0ca180 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7fdd02400640 1 --2- 172.21.15.99:0/1258663043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdcfc0b5ea0 0x7fdcfc0b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7fdd02400640 1 -- 172.21.15.99:0/1258663043 >> 172.21.15.99:0/1258663043 conn(0x7fdcfc08bfc0 msgr2=0x7fdcfc0d4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:01.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7f651be00640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f64fc06c530 0x7f64fc06e9f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f650c02b930 tx=0x7f650c03c040 comp rx=0 tx=0).stop 2024-03-30T13:11:01.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7f651be00640 1 -- 172.21.15.99:0/2029843538 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65140ead00 msgr2=0x7f65140da150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7f651be00640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65140ead00 0x7f65140da150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f651c063150 tx=0x7f651c06d900 comp rx=0 tx=0).stop 2024-03-30T13:11:01.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7fdd02400640 1 -- 172.21.15.99:0/1258663043 shutdown_connections 2024-03-30T13:11:01.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7f651be00640 1 -- 172.21.15.99:0/2029843538 shutdown_connections 2024-03-30T13:11:01.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7f651be00640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f64fc06c530 0x7f64fc06e9f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7fdd02400640 1 -- 172.21.15.99:0/1258663043 wait complete. 2024-03-30T13:11:01.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7f651be00640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65140ead00 0x7f65140da150 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7f651be00640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651404ffd0 0x7f65140d9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.186+0000 7f651be00640 1 --2- 172.21.15.99:0/2029843538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6514038110 0x7f6514046620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.187+0000 7f651be00640 1 -- 172.21.15.99:0/2029843538 >> 172.21.15.99:0/2029843538 conn(0x7f6514009fb0 msgr2=0x7f6514048e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:01.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.187+0000 7f651be00640 1 -- 172.21.15.99:0/2029843538 shutdown_connections 2024-03-30T13:11:01.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.187+0000 7f651be00640 1 -- 172.21.15.99:0/2029843538 wait complete. 2024-03-30T13:11:01.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.196+0000 7f14d1000640 1 -- 172.21.15.99:0/1381201018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f14cc0cda70 con 0x7f14cc0ccb40 2024-03-30T13:11:01.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.197+0000 7f14c2000640 1 -- 172.21.15.99:0/1381201018 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f14c40590e0 con 0x7f14cc0ccb40 2024-03-30T13:11:01.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.197+0000 7f5741e00640 1 -- 172.21.15.99:0/2570031739 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f573c0cda70 con 0x7f573c0c66d0 2024-03-30T13:11:01.201 INFO:teuthology.orchestra.run.smithi099.stdout:64424509448 2024-03-30T13:11:01.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.199+0000 7f5733400640 1 -- 172.21.15.99:0/2570031739 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f572805d480 con 0x7f573c0c66d0 2024-03-30T13:11:01.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.199+0000 7f6e60600640 1 -- 172.21.15.99:0/3459689057 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6e34005850 con 0x7f6e580c66d0 2024-03-30T13:11:01.203 INFO:teuthology.orchestra.run.smithi099.stdout:68719476742 2024-03-30T13:11:01.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.200+0000 7f14d1000640 1 -- 172.21.15.99:0/1381201018 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f14ac06c580 msgr2=0x7f14ac06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.200+0000 7f14d1000640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f14ac06c580 0x7f14ac06ea40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14bc036000 tx=0x7f14bc03c040 comp rx=0 tx=0).stop 2024-03-30T13:11:01.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.201+0000 7f14d1000640 1 -- 172.21.15.99:0/1381201018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14cc0ccb40 msgr2=0x7f14cc0c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.201+0000 7f14d1000640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14cc0ccb40 0x7f14cc0c7ee0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f14c400b9a0 tx=0x7f14c400be60 comp rx=0 tx=0).stop 2024-03-30T13:11:01.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.201+0000 7f6e55600640 1 -- 172.21.15.99:0/3459689057 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6e5005a460 con 0x7f6e580c66d0 2024-03-30T13:11:01.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.201+0000 7f14d1000640 1 -- 172.21.15.99:0/1381201018 shutdown_connections 2024-03-30T13:11:01.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.201+0000 7f14d1000640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f14ac06c580 0x7f14ac06ea40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.201+0000 7f14d1000640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14cc0ccb40 0x7f14cc0c7ee0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.201+0000 7f14d1000640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14cc0c5780 0x7f14cc0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.201+0000 7f14d1000640 1 --2- 172.21.15.99:0/1381201018 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f14cc098be0 0x7f14cc1594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.201+0000 7f14d1000640 1 -- 172.21.15.99:0/1381201018 >> 172.21.15.99:0/1381201018 conn(0x7f14cc072ba0 msgr2=0x7f14cc0ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:01.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.201+0000 7f14d1000640 1 -- 172.21.15.99:0/1381201018 shutdown_connections 2024-03-30T13:11:01.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.201+0000 7f14d1000640 1 -- 172.21.15.99:0/1381201018 wait complete. 2024-03-30T13:11:01.206 INFO:teuthology.orchestra.run.smithi099.stdout:68719476743 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.203+0000 7f5741e00640 1 -- 172.21.15.99:0/2570031739 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f571c06c530 msgr2=0x7f571c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.203+0000 7f5741e00640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f571c06c530 0x7f571c06e9f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f572c009e70 tx=0x7f572c008040 comp rx=0 tx=0).stop 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.203+0000 7f5741e00640 1 -- 172.21.15.99:0/2570031739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0c66d0 msgr2=0x7f573c151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.203+0000 7f5741e00640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0c66d0 0x7f573c151810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f573c0c7160 tx=0x7f572800c870 comp rx=0 tx=0).stop 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.203+0000 7f5741e00640 1 -- 172.21.15.99:0/2570031739 shutdown_connections 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.203+0000 7f5741e00640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f571c06c530 0x7f571c06e9f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.203+0000 7f5741e00640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c15abf0 0x7f573c09ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.203+0000 7f5741e00640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0c66d0 0x7f573c151810 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.203+0000 7f5741e00640 1 --2- 172.21.15.99:0/2570031739 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f573c06da60 0x7f573c152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.203+0000 7f5741e00640 1 -- 172.21.15.99:0/2570031739 >> 172.21.15.99:0/2570031739 conn(0x7f573c072ba0 msgr2=0x7f573c154f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.204+0000 7f5741e00640 1 -- 172.21.15.99:0/2570031739 shutdown_connections 2024-03-30T13:11:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.204+0000 7f5741e00640 1 -- 172.21.15.99:0/2570031739 wait complete. 2024-03-30T13:11:01.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.207+0000 7f6e60600640 1 -- 172.21.15.99:0/3459689057 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6e3806c530 msgr2=0x7f6e3806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.207+0000 7f6e60600640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6e3806c530 0x7f6e3806e9f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009c20 tx=0x7f6e4c008040 comp rx=0 tx=0).stop 2024-03-30T13:11:01.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.207+0000 7f6e60600640 1 -- 172.21.15.99:0/3459689057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e580c66d0 msgr2=0x7f6e581f8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.207+0000 7f6e60600640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e580c66d0 0x7f6e581f8a80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000cd20 tx=0x7f6e5000a660 comp rx=0 tx=0).stop 2024-03-30T13:11:01.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.210+0000 7f6e60600640 1 -- 172.21.15.99:0/3459689057 shutdown_connections 2024-03-30T13:11:01.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.210+0000 7f6e60600640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6e3806c530 0x7f6e3806e9f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.210+0000 7f6e60600640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e580c66d0 0x7f6e581f8a80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.210+0000 7f6e60600640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e58073690 0x7f6e5814bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.210+0000 7f6e60600640 1 --2- 172.21.15.99:0/3459689057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e5806da60 0x7f6e581f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.210+0000 7f6e60600640 1 -- 172.21.15.99:0/3459689057 >> 172.21.15.99:0/3459689057 conn(0x7f6e58072ba0 msgr2=0x7f6e580ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:01.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.210+0000 7f6e60600640 1 -- 172.21.15.99:0/3459689057 shutdown_connections 2024-03-30T13:11:01.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.210+0000 7f6e60600640 1 -- 172.21.15.99:0/3459689057 wait complete. 2024-03-30T13:11:01.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2024-03-30T13:11:01.218 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:01.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.2 2024-03-30T13:11:01.221 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:01.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.6 2024-03-30T13:11:01.230 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:01.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.3 2024-03-30T13:11:01.235 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:01.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.1 2024-03-30T13:11:01.238 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:01.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.270+0000 7fdf30c00640 1 -- 172.21.15.99:0/1144242592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdf04005850 con 0x7fdf2c06da60 2024-03-30T13:11:01.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.271+0000 7fdf22000640 1 -- 172.21.15.99:0/1144242592 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf14059930 con 0x7fdf2c06da60 2024-03-30T13:11:01.274 INFO:teuthology.orchestra.run.smithi099.stdout:64424509447 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.273+0000 7fdf30c00640 1 -- 172.21.15.99:0/1144242592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf0806c530 msgr2=0x7fdf0806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.274+0000 7fdf30c00640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf0806c530 0x7fdf0806e9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0ad230 tx=0x7fdf1c009040 comp rx=0 tx=0).stop 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.274+0000 7fdf30c00640 1 -- 172.21.15.99:0/1144242592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf2c06da60 msgr2=0x7fdf2c099980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.274+0000 7fdf30c00640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf2c06da60 0x7fdf2c099980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400e870 tx=0x7fdf1400ed30 comp rx=0 tx=0).stop 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.274+0000 7fdf30c00640 1 -- 172.21.15.99:0/1144242592 shutdown_connections 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.274+0000 7fdf30c00640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf0806c530 0x7fdf0806e9f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.274+0000 7fdf30c00640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf2c15abf0 0x7fdf2c0ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.274+0000 7fdf30c00640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf2c0c66d0 0x7fdf2c09a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.274+0000 7fdf30c00640 1 --2- 172.21.15.99:0/1144242592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf2c06da60 0x7fdf2c099980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.274+0000 7fdf30c00640 1 -- 172.21.15.99:0/1144242592 >> 172.21.15.99:0/1144242592 conn(0x7fdf2c072ba0 msgr2=0x7fdf2c0b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.274+0000 7fdf30c00640 1 -- 172.21.15.99:0/1144242592 shutdown_connections 2024-03-30T13:11:01.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.274+0000 7fdf30c00640 1 -- 172.21.15.99:0/1144242592 wait complete. 2024-03-30T13:11:01.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.4 2024-03-30T13:11:01.295 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:01.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.354+0000 7fcaa4e00640 1 -- 172.21.15.99:0/1554793520 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcaa00c5c00 con 0x7fcaa006f840 2024-03-30T13:11:01.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.355+0000 7fca96000640 1 -- 172.21.15.99:0/1554793520 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca8c0593e0 con 0x7fcaa006f840 2024-03-30T13:11:01.358 INFO:teuthology.orchestra.run.smithi099.stdout:64424509449 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.357+0000 7fcaa4e00640 1 -- 172.21.15.99:0/1554793520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fca80074d40 msgr2=0x7fca80077200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.357+0000 7fcaa4e00640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fca80074d40 0x7fca80077200 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca90036000 tx=0x7fca90030000 comp rx=0 tx=0).stop 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.357+0000 7fcaa4e00640 1 -- 172.21.15.99:0/1554793520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa006f840 msgr2=0x7fcaa00adaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.357+0000 7fcaa4e00640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa006f840 0x7fcaa00adaa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca8c012bb0 tx=0x7fca8c010490 comp rx=0 tx=0).stop 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.357+0000 7fcaa4e00640 1 -- 172.21.15.99:0/1554793520 shutdown_connections 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.357+0000 7fcaa4e00640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fca80074d40 0x7fca80077200 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.357+0000 7fcaa4e00640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcaa00d00f0 0x7fcaa01f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.357+0000 7fcaa4e00640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa00c64f0 0x7fcaa01f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.357+0000 7fcaa4e00640 1 --2- 172.21.15.99:0/1554793520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa006f840 0x7fcaa00adaa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.358+0000 7fcaa4e00640 1 -- 172.21.15.99:0/1554793520 >> 172.21.15.99:0/1554793520 conn(0x7fcaa006b510 msgr2=0x7fcaa00b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.358+0000 7fcaa4e00640 1 -- 172.21.15.99:0/1554793520 shutdown_connections 2024-03-30T13:11:01.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.358+0000 7fcaa4e00640 1 -- 172.21.15.99:0/1554793520 wait complete. 2024-03-30T13:11:01.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.5 2024-03-30T13:11:01.378 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:01.378 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-30T13:11:01.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:11:01.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.563+0000 7f1478a00640 1 Processor -- start 2024-03-30T13:11:01.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.563+0000 7f1478a00640 1 -- start start 2024-03-30T13:11:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.565+0000 7f1478a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1474160660 0x7f147406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.565+0000 7f1478a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14740ce6d0 con 0x7f14740ce130 2024-03-30T13:11:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.565+0000 7f1478a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14740ce9b0 con 0x7f1474153280 2024-03-30T13:11:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.565+0000 7f1478a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f14740cf2e0 con 0x7f1474160660 2024-03-30T13:11:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.565+0000 7f1472a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f14740ce130 0x7f147415ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56734/0 (socket says 172.21.15.99:56734) 2024-03-30T13:11:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.565+0000 7f1472a00640 1 -- 172.21.15.99:0/1203243729 learned_addr learned my addr 172.21.15.99:0/1203243729 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.565+0000 7f1473e00640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1474160660 0x7f147406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.565+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968794038 0 0) 0x7f14740ce6d0 con 0x7f14740ce130 2024-03-30T13:11:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.565+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1458003520 con 0x7f14740ce130 2024-03-30T13:11:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 654432094 0 0) 0x7f1458003520 con 0x7f14740ce130 2024-03-30T13:11:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1474160660 msgr2=0x7f147406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1474160660 0x7f147406d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 >> v1:172.21.15.181:6789/0 conn(0x7f1474153280 legacy=0x7f14740b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14740cec90 con 0x7f14740ce130 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f1460001670 con 0x7f14740ce130 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 >> v1:172.21.15.99:6789/0 conn(0x7f14740ce130 legacy=0x7f147415ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14580039e0 0x7f1458003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1474160660 0x7f1458004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1458004d40 0x7f14580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f14740cf2e0 con 0x7f14580039e0 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f145800bb50 con 0x7f1458004d40 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f145800bd50 con 0x7f1474160660 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1473400640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14580039e0 0x7f1458003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.566+0000 7f1472a00640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1474160660 0x7f1458004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.567+0000 7f1473e00640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1458004d40 0x7f14580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:01.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.567+0000 7f1473400640 1 -- 172.21.15.99:0/1203243729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1474160660 msgr2=0x7f1458004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:01.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.567+0000 7f1473400640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1474160660 0x7f1458004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.567+0000 7f1473400640 1 -- 172.21.15.99:0/1203243729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1458004d40 msgr2=0x7f14580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:01.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.567+0000 7f1473400640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1458004d40 0x7f14580051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.567+0000 7f1473400640 1 -- 172.21.15.99:0/1203243729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1458003520 con 0x7f14580039e0 2024-03-30T13:11:01.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.568+0000 7f1473400640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14580039e0 0x7f1458003e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1464001750 tx=0x7f1458005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c5d5307b49c855 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:01.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.568+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464001370 con 0x7f14580039e0 2024-03-30T13:11:01.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.568+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14640052d0 con 0x7f14580039e0 2024-03-30T13:11:01.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.568+0000 7f1472000640 1 -- 172.21.15.99:0/1203243729 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464003830 con 0x7f14580039e0 2024-03-30T13:11:01.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.568+0000 7f1478a00640 1 -- 172.21.15.99:0/1203243729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14580039e0 msgr2=0x7f1458003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.568+0000 7f1478a00640 1 --2- 172.21.15.99:0/1203243729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14580039e0 0x7f1458003e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1464001750 tx=0x7f1458005830 comp rx=0 tx=0).stop 2024-03-30T13:11:01.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.568+0000 7f1473e00640 1 -- 172.21.15.99:0/1203243729 reap_dead start 2024-03-30T13:11:01.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.569+0000 7f1478a00640 1 -- 172.21.15.99:0/1203243729 shutdown_connections 2024-03-30T13:11:01.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.569+0000 7f1478a00640 1 -- 172.21.15.99:0/1203243729 >> 172.21.15.99:0/1203243729 conn(0x7f147406bb40 msgr2=0x7f14740b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:01.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.569+0000 7f1478a00640 1 -- 172.21.15.99:0/1203243729 shutdown_connections 2024-03-30T13:11:01.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.569+0000 7f1478a00640 1 -- 172.21.15.99:0/1203243729 wait complete. 2024-03-30T13:11:01.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.570+0000 7f1478a00640 1 Processor -- start 2024-03-30T13:11:01.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.570+0000 7f1478a00640 1 -- start start 2024-03-30T13:11:01.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.571+0000 7f1478a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14580039e0 0x7f1474147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:01.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.571+0000 7f1478a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f147409cb40 0x7f147409cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:01.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.571+0000 7f1478a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14740d0430 0x7f14740d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:01.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.571+0000 7f1478a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f14741537e0 con 0x7f14740d0430 2024-03-30T13:11:01.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.571+0000 7f1478a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1474153660 con 0x7f14580039e0 2024-03-30T13:11:01.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.571+0000 7f1478a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f14740cf770 con 0x7f147409cb40 2024-03-30T13:11:01.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.571+0000 7f1473e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14740d0430 0x7f14740d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:01.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.571+0000 7f1473e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14740d0430 0x7f14740d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38600/0 (socket says 172.21.15.99:38600) 2024-03-30T13:11:01.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.571+0000 7f1473e00640 1 -- 172.21.15.99:0/1932906162 learned_addr learned my addr 172.21.15.99:0/1932906162 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:01.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f1473400640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14580039e0 0x7f1474147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:01.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f1472a00640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f147409cb40 0x7f147409cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:01.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f1473e00640 1 -- 172.21.15.99:0/1932906162 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f147409cb40 msgr2=0x7f147409cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f1473e00640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f147409cb40 0x7f147409cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f1473e00640 1 -- 172.21.15.99:0/1932906162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14580039e0 msgr2=0x7f1474147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f1473e00640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14580039e0 0x7f1474147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f1473e00640 1 -- 172.21.15.99:0/1932906162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147409d700 con 0x7f14740d0430 2024-03-30T13:11:01.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f1473e00640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14740d0430 0x7f14740d08c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1474073aa0 tx=0x7f146c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:01.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f146b400640 1 -- 172.21.15.99:0/1932906162 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c01c070 con 0x7f14740d0430 2024-03-30T13:11:01.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f146b400640 1 -- 172.21.15.99:0/1932906162 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c017400 con 0x7f14740d0430 2024-03-30T13:11:01.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f146b400640 1 -- 172.21.15.99:0/1932906162 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c0177f0 con 0x7f14740d0430 2024-03-30T13:11:01.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.572+0000 7f1478a00640 1 -- 172.21.15.99:0/1932906162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14740715f0 con 0x7f14740d0430 2024-03-30T13:11:01.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.573+0000 7f1478a00640 1 -- 172.21.15.99:0/1932906162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1474071bb0 con 0x7f14740d0430 2024-03-30T13:11:01.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.574+0000 7f1478a00640 1 -- 172.21.15.99:0/1932906162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147404f8f0 con 0x7f14740d0430 2024-03-30T13:11:01.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.574+0000 7f146b400640 1 -- 172.21.15.99:0/1932906162 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f146c01f070 con 0x7f14740d0430 2024-03-30T13:11:01.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.575+0000 7f146b400640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f145406c530 0x7f145406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:01.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.575+0000 7f146b400640 1 -- 172.21.15.99:0/1932906162 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f146c08b680 con 0x7f14740d0430 2024-03-30T13:11:01.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.576+0000 7f1473400640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f145406c530 0x7f145406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:01.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.576+0000 7f1473400640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f145406c530 0x7f145406e9f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1464033000 tx=0x7f1464009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:01.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.580+0000 7f146b400640 1 -- 172.21.15.99:0/1932906162 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f146c012070 con 0x7f14740d0430 2024-03-30T13:11:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.763+0000 7f1478a00640 1 -- 172.21.15.99:0/1932906162 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f147415d660 con 0x7f145406c530 2024-03-30T13:11:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.772+0000 7f146b400640 1 -- 172.21.15.99:0/1932906162 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251829 (secure 0 0 0) 0x7f147415d660 con 0x7f145406c530 2024-03-30T13:11:01.779 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:11:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.777+0000 7f1478a00640 1 -- 172.21.15.99:0/1932906162 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f145406c530 msgr2=0x7f145406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.778+0000 7f1478a00640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f145406c530 0x7f145406e9f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1464033000 tx=0x7f1464009030 comp rx=0 tx=0).stop 2024-03-30T13:11:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.778+0000 7f1478a00640 1 -- 172.21.15.99:0/1932906162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14740d0430 msgr2=0x7f14740d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.778+0000 7f1478a00640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14740d0430 0x7f14740d08c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1474073aa0 tx=0x7f146c00f4a0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.778+0000 7f1478a00640 1 -- 172.21.15.99:0/1932906162 shutdown_connections 2024-03-30T13:11:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.778+0000 7f1478a00640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f145406c530 0x7f145406e9f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.778+0000 7f1478a00640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14740d0430 0x7f14740d08c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.778+0000 7f1478a00640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f147409cb40 0x7f147409cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.778+0000 7f1478a00640 1 --2- 172.21.15.99:0/1932906162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14580039e0 0x7f1474147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.778+0000 7f1478a00640 1 -- 172.21.15.99:0/1932906162 >> 172.21.15.99:0/1932906162 conn(0x7f147406bb40 msgr2=0x7f147406e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.778+0000 7f1478a00640 1 -- 172.21.15.99:0/1932906162 shutdown_connections 2024-03-30T13:11:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:01.778+0000 7f1478a00640 1 -- 172.21.15.99:0/1932906162 wait complete. 2024-03-30T13:11:01.797 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-03-30T13:11:01.439181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2990080,"data_stored":1786868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003863"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246289+0000","last_change":"2024-03-30T13:10:46.234821+0000","last_active":"2024-03-30T13:10:47.246289+0000","last_peered":"2024-03-30T13:10:47.246289+0000","last_clean":"2024-03-30T13:10:47.246289+0000","last_became_active":"2024-03-30T13:10:46.234553+0000","last_became_peered":"2024-03-30T13:10:46.234553+0000","last_unstale":"2024-03-30T13:10:47.246289+0000","last_undegraded":"2024-03-30T13:10:47.246289+0000","last_fullsized":"2024-03-30T13:10:47.246289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:13.303492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282177+0000","last_change":"2024-03-30T13:10:46.238313+0000","last_active":"2024-03-30T13:10:48.282177+0000","last_peered":"2024-03-30T13:10:48.282177+0000","last_clean":"2024-03-30T13:10:48.282177+0000","last_became_active":"2024-03-30T13:10:46.238010+0000","last_became_peered":"2024-03-30T13:10:46.238010+0000","last_unstale":"2024-03-30T13:10:48.282177+0000","last_undegraded":"2024-03-30T13:10:48.282177+0000","last_fullsized":"2024-03-30T13:10:48.282177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281389+0000","last_change":"2024-03-30T13:10:46.241744+0000","last_active":"2024-03-30T13:10:48.281389+0000","last_peered":"2024-03-30T13:10:48.281389+0000","last_clean":"2024-03-30T13:10:48.281389+0000","last_became_active":"2024-03-30T13:10:46.241480+0000","last_became_peered":"2024-03-30T13:10:46.241480+0000","last_unstale":"2024-03-30T13:10:48.281389+0000","last_undegraded":"2024-03-30T13:10:48.281389+0000","last_fullsized":"2024-03-30T13:10:48.281389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991801+0000","last_change":"2024-03-30T13:10:46.244024+0000","last_active":"2024-03-30T13:10:47.991801+0000","last_peered":"2024-03-30T13:10:47.991801+0000","last_clean":"2024-03-30T13:10:47.991801+0000","last_became_active":"2024-03-30T13:10:46.243697+0000","last_became_peered":"2024-03-30T13:10:46.243697+0000","last_unstale":"2024-03-30T13:10:47.991801+0000","last_undegraded":"2024-03-30T13:10:47.991801+0000","last_fullsized":"2024-03-30T13:10:47.991801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:38.672797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246287+0000","last_change":"2024-03-30T13:10:46.234379+0000","last_active":"2024-03-30T13:10:47.246287+0000","last_peered":"2024-03-30T13:10:47.246287+0000","last_clean":"2024-03-30T13:10:47.246287+0000","last_became_active":"2024-03-30T13:10:46.234047+0000","last_became_peered":"2024-03-30T13:10:46.234047+0000","last_unstale":"2024-03-30T13:10:47.246287+0000","last_undegraded":"2024-03-30T13:10:47.246287+0000","last_fullsized":"2024-03-30T13:10:47.246287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991724+0000","last_change":"2024-03-30T13:10:46.243204+0000","last_active":"2024-03-30T13:10:47.991724+0000","last_peered":"2024-03-30T13:10:47.991724+0000","last_clean":"2024-03-30T13:10:47.991724+0000","last_became_active":"2024-03-30T13:10:46.242897+0000","last_became_peered":"2024-03-30T13:10:46.242897+0000","last_unstale":"2024-03-30T13:10:47.991724+0000","last_undegraded":"2024-03-30T13:10:47.991724+0000","last_fullsized":"2024-03-30T13:10:47.991724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:50.453642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245509+0000","last_change":"2024-03-30T13:10:46.244716+0000","last_active":"2024-03-30T13:10:47.245509+0000","last_peered":"2024-03-30T13:10:47.245509+0000","last_clean":"2024-03-30T13:10:47.245509+0000","last_became_active":"2024-03-30T13:10:46.244353+0000","last_became_peered":"2024-03-30T13:10:46.244353+0000","last_unstale":"2024-03-30T13:10:47.245509+0000","last_undegraded":"2024-03-30T13:10:47.245509+0000","last_fullsized":"2024-03-30T13:10:47.245509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280766+0000","last_change":"2024-03-30T13:10:46.255145+0000","last_active":"2024-03-30T13:10:48.280766+0000","last_peered":"2024-03-30T13:10:48.280766+0000","last_clean":"2024-03-30T13:10:48.280766+0000","last_became_active":"2024-03-30T13:10:46.254848+0000","last_became_peered":"2024-03-30T13:10:46.254848+0000","last_unstale":"2024-03-30T13:10:48.280766+0000","last_undegraded":"2024-03-30T13:10:48.280766+0000","last_fullsized":"2024-03-30T13:10:48.280766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243525+0000","last_change":"2024-03-30T13:10:46.249338+0000","last_active":"2024-03-30T13:10:47.243525+0000","last_peered":"2024-03-30T13:10:47.243525+0000","last_clean":"2024-03-30T13:10:47.243525+0000","last_became_active":"2024-03-30T13:10:46.248206+0000","last_became_peered":"2024-03-30T13:10:46.248206+0000","last_unstale":"2024-03-30T13:10:47.243525+0000","last_undegraded":"2024-03-30T13:10:47.243525+0000","last_fullsized":"2024-03-30T13:10:47.243525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:38.672797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245949+0000","last_change":"2024-03-30T13:10:46.236494+0000","last_active":"2024-03-30T13:10:47.245949+0000","last_peered":"2024-03-30T13:10:47.245949+0000","last_clean":"2024-03-30T13:10:47.245949+0000","last_became_active":"2024-03-30T13:10:46.236199+0000","last_became_peered":"2024-03-30T13:10:46.236199+0000","last_unstale":"2024-03-30T13:10:47.245949+0000","last_undegraded":"2024-03-30T13:10:47.245949+0000","last_fullsized":"2024-03-30T13:10:47.245949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245994+0000","last_change":"2024-03-30T13:10:46.245545+0000","last_active":"2024-03-30T13:10:47.245994+0000","last_peered":"2024-03-30T13:10:47.245994+0000","last_clean":"2024-03-30T13:10:47.245994+0000","last_became_active":"2024-03-30T13:10:46.245286+0000","last_became_peered":"2024-03-30T13:10:46.245286+0000","last_unstale":"2024-03-30T13:10:47.245994+0000","last_undegraded":"2024-03-30T13:10:47.245994+0000","last_fullsized":"2024-03-30T13:10:47.245994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245950+0000","last_change":"2024-03-30T13:10:46.256061+0000","last_active":"2024-03-30T13:10:47.245950+0000","last_peered":"2024-03-30T13:10:47.245950+0000","last_clean":"2024-03-30T13:10:47.245950+0000","last_became_active":"2024-03-30T13:10:46.252144+0000","last_became_peered":"2024-03-30T13:10:46.252144+0000","last_unstale":"2024-03-30T13:10:47.245950+0000","last_undegraded":"2024-03-30T13:10:47.245950+0000","last_fullsized":"2024-03-30T13:10:47.245950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248585+0000","last_change":"2024-03-30T13:10:46.240158+0000","last_active":"2024-03-30T13:10:47.248585+0000","last_peered":"2024-03-30T13:10:47.248585+0000","last_clean":"2024-03-30T13:10:47.248585+0000","last_became_active":"2024-03-30T13:10:46.235455+0000","last_became_peered":"2024-03-30T13:10:46.235455+0000","last_unstale":"2024-03-30T13:10:47.248585+0000","last_undegraded":"2024-03-30T13:10:47.248585+0000","last_fullsized":"2024-03-30T13:10:47.248585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:00.666500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248107+0000","last_change":"2024-03-30T13:10:46.243687+0000","last_active":"2024-03-30T13:10:47.248107+0000","last_peered":"2024-03-30T13:10:47.248107+0000","last_clean":"2024-03-30T13:10:47.248107+0000","last_became_active":"2024-03-30T13:10:46.243389+0000","last_became_peered":"2024-03-30T13:10:46.243389+0000","last_unstale":"2024-03-30T13:10:47.248107+0000","last_undegraded":"2024-03-30T13:10:47.248107+0000","last_fullsized":"2024-03-30T13:10:47.248107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280718+0000","last_change":"2024-03-30T13:10:46.256471+0000","last_active":"2024-03-30T13:10:48.280718+0000","last_peered":"2024-03-30T13:10:48.280718+0000","last_clean":"2024-03-30T13:10:48.280718+0000","last_became_active":"2024-03-30T13:10:46.256215+0000","last_became_peered":"2024-03-30T13:10:46.256215+0000","last_unstale":"2024-03-30T13:10:48.280718+0000","last_undegraded":"2024-03-30T13:10:48.280718+0000","last_fullsized":"2024-03-30T13:10:48.280718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278522+0000","last_change":"2024-03-30T13:10:46.233516+0000","last_active":"2024-03-30T13:10:48.278522+0000","last_peered":"2024-03-30T13:10:48.278522+0000","last_clean":"2024-03-30T13:10:48.278522+0000","last_became_active":"2024-03-30T13:10:46.233168+0000","last_became_peered":"2024-03-30T13:10:46.233168+0000","last_unstale":"2024-03-30T13:10:48.278522+0000","last_undegraded":"2024-03-30T13:10:48.278522+0000","last_fullsized":"2024-03-30T13:10:48.278522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:13.303492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280093+0000","last_change":"2024-03-30T13:10:46.260609+0000","last_active":"2024-03-30T13:10:48.280093+0000","last_peered":"2024-03-30T13:10:48.280093+0000","last_clean":"2024-03-30T13:10:48.280093+0000","last_became_active":"2024-03-30T13:10:46.257204+0000","last_became_peered":"2024-03-30T13:10:46.257204+0000","last_unstale":"2024-03-30T13:10:48.280093+0000","last_undegraded":"2024-03-30T13:10:48.280093+0000","last_fullsized":"2024-03-30T13:10:48.280093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:33:04.251828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281932+0000","last_change":"2024-03-30T13:10:46.253562+0000","last_active":"2024-03-30T13:10:48.281932+0000","last_peered":"2024-03-30T13:10:48.281932+0000","last_clean":"2024-03-30T13:10:48.281932+0000","last_became_active":"2024-03-30T13:10:46.253288+0000","last_became_peered":"2024-03-30T13:10:46.253288+0000","last_unstale":"2024-03-30T13:10:48.281932+0000","last_undegraded":"2024-03-30T13:10:48.281932+0000","last_fullsized":"2024-03-30T13:10:48.281932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:12:43.810698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279336+0000","last_change":"2024-03-30T13:10:46.244101+0000","last_active":"2024-03-30T13:10:48.279336+0000","last_peered":"2024-03-30T13:10:48.279336+0000","last_clean":"2024-03-30T13:10:48.279336+0000","last_became_active":"2024-03-30T13:10:46.241383+0000","last_became_peered":"2024-03-30T13:10:46.241383+0000","last_unstale":"2024-03-30T13:10:48.279336+0000","last_undegraded":"2024-03-30T13:10:48.279336+0000","last_fullsized":"2024-03-30T13:10:48.279336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:09.717253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246132+0000","last_change":"2024-03-30T13:10:46.258488+0000","last_active":"2024-03-30T13:10:47.246132+0000","last_peered":"2024-03-30T13:10:47.246132+0000","last_clean":"2024-03-30T13:10:47.246132+0000","last_became_active":"2024-03-30T13:10:46.251558+0000","last_became_peered":"2024-03-30T13:10:46.251558+0000","last_unstale":"2024-03-30T13:10:47.246132+0000","last_undegraded":"2024-03-30T13:10:47.246132+0000","last_fullsized":"2024-03-30T13:10:47.246132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250207+0000","last_change":"2024-03-30T13:10:46.243487+0000","last_active":"2024-03-30T13:10:47.250207+0000","last_peered":"2024-03-30T13:10:47.250207+0000","last_clean":"2024-03-30T13:10:47.250207+0000","last_became_active":"2024-03-30T13:10:46.243102+0000","last_became_peered":"2024-03-30T13:10:46.243102+0000","last_unstale":"2024-03-30T13:10:47.250207+0000","last_undegraded":"2024-03-30T13:10:47.250207+0000","last_fullsized":"2024-03-30T13:10:47.250207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243005+0000","last_change":"2024-03-30T13:10:46.262008+0000","last_active":"2024-03-30T13:10:47.243005+0000","last_peered":"2024-03-30T13:10:47.243005+0000","last_clean":"2024-03-30T13:10:47.243005+0000","last_became_active":"2024-03-30T13:10:46.259954+0000","last_became_peered":"2024-03-30T13:10:46.259954+0000","last_unstale":"2024-03-30T13:10:47.243005+0000","last_undegraded":"2024-03-30T13:10:47.243005+0000","last_fullsized":"2024-03-30T13:10:47.243005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:50.453642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280858+0000","last_change":"2024-03-30T13:10:46.247945+0000","last_active":"2024-03-30T13:10:48.280858+0000","last_peered":"2024-03-30T13:10:48.280858+0000","last_clean":"2024-03-30T13:10:48.280858+0000","last_became_active":"2024-03-30T13:10:46.247685+0000","last_became_peered":"2024-03-30T13:10:46.247685+0000","last_unstale":"2024-03-30T13:10:48.280858+0000","last_undegraded":"2024-03-30T13:10:48.280858+0000","last_fullsized":"2024-03-30T13:10:48.280858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278783+0000","last_change":"2024-03-30T13:10:46.238738+0000","last_active":"2024-03-30T13:10:48.278783+0000","last_peered":"2024-03-30T13:10:48.278783+0000","last_clean":"2024-03-30T13:10:48.278783+0000","last_became_active":"2024-03-30T13:10:46.238383+0000","last_became_peered":"2024-03-30T13:10:46.238383+0000","last_unstale":"2024-03-30T13:10:48.278783+0000","last_undegraded":"2024-03-30T13:10:48.278783+0000","last_fullsized":"2024-03-30T13:10:48.278783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:43:03.365657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282406+0000","last_change":"2024-03-30T13:10:46.249445+0000","last_active":"2024-03-30T13:10:48.282406+0000","last_peered":"2024-03-30T13:10:48.282406+0000","last_clean":"2024-03-30T13:10:48.282406+0000","last_became_active":"2024-03-30T13:10:46.249008+0000","last_became_peered":"2024-03-30T13:10:46.249008+0000","last_unstale":"2024-03-30T13:10:48.282406+0000","last_undegraded":"2024-03-30T13:10:48.282406+0000","last_fullsized":"2024-03-30T13:10:48.282406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992191+0000","last_change":"2024-03-30T13:10:46.247610+0000","last_active":"2024-03-30T13:10:47.992191+0000","last_peered":"2024-03-30T13:10:47.992191+0000","last_clean":"2024-03-30T13:10:47.992191+0000","last_became_active":"2024-03-30T13:10:46.247333+0000","last_became_peered":"2024-03-30T13:10:46.247333+0000","last_unstale":"2024-03-30T13:10:47.992191+0000","last_undegraded":"2024-03-30T13:10:47.992191+0000","last_fullsized":"2024-03-30T13:10:47.992191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248607+0000","last_change":"2024-03-30T13:10:46.243725+0000","last_active":"2024-03-30T13:10:47.248607+0000","last_peered":"2024-03-30T13:10:47.248607+0000","last_clean":"2024-03-30T13:10:47.248607+0000","last_became_active":"2024-03-30T13:10:46.243423+0000","last_became_peered":"2024-03-30T13:10:46.243423+0000","last_unstale":"2024-03-30T13:10:47.248607+0000","last_undegraded":"2024-03-30T13:10:47.248607+0000","last_fullsized":"2024-03-30T13:10:47.248607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248584+0000","last_change":"2024-03-30T13:10:46.254386+0000","last_active":"2024-03-30T13:10:47.248584+0000","last_peered":"2024-03-30T13:10:47.248584+0000","last_clean":"2024-03-30T13:10:47.248584+0000","last_became_active":"2024-03-30T13:10:46.254081+0000","last_became_peered":"2024-03-30T13:10:46.254081+0000","last_unstale":"2024-03-30T13:10:47.248584+0000","last_undegraded":"2024-03-30T13:10:47.248584+0000","last_fullsized":"2024-03-30T13:10:47.248584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281880+0000","last_change":"2024-03-30T13:10:46.246367+0000","last_active":"2024-03-30T13:10:48.281880+0000","last_peered":"2024-03-30T13:10:48.281880+0000","last_clean":"2024-03-30T13:10:48.281880+0000","last_became_active":"2024-03-30T13:10:46.246066+0000","last_became_peered":"2024-03-30T13:10:46.246066+0000","last_unstale":"2024-03-30T13:10:48.281880+0000","last_undegraded":"2024-03-30T13:10:48.281880+0000","last_fullsized":"2024-03-30T13:10:48.281880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278521+0000","last_change":"2024-03-30T13:10:46.234128+0000","last_active":"2024-03-30T13:10:48.278521+0000","last_peered":"2024-03-30T13:10:48.278521+0000","last_clean":"2024-03-30T13:10:48.278521+0000","last_became_active":"2024-03-30T13:10:46.233731+0000","last_became_peered":"2024-03-30T13:10:46.233731+0000","last_unstale":"2024-03-30T13:10:48.278521+0000","last_undegraded":"2024-03-30T13:10:48.278521+0000","last_fullsized":"2024-03-30T13:10:48.278521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281367+0000","last_change":"2024-03-30T13:10:46.247881+0000","last_active":"2024-03-30T13:10:48.281367+0000","last_peered":"2024-03-30T13:10:48.281367+0000","last_clean":"2024-03-30T13:10:48.281367+0000","last_became_active":"2024-03-30T13:10:46.247618+0000","last_became_peered":"2024-03-30T13:10:46.247618+0000","last_unstale":"2024-03-30T13:10:48.281367+0000","last_undegraded":"2024-03-30T13:10:48.281367+0000","last_fullsized":"2024-03-30T13:10:48.281367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:40:00.406615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991337+0000","last_change":"2024-03-30T13:10:46.253544+0000","last_active":"2024-03-30T13:10:47.991337+0000","last_peered":"2024-03-30T13:10:47.991337+0000","last_clean":"2024-03-30T13:10:47.991337+0000","last_became_active":"2024-03-30T13:10:46.253034+0000","last_became_peered":"2024-03-30T13:10:46.253034+0000","last_unstale":"2024-03-30T13:10:47.991337+0000","last_undegraded":"2024-03-30T13:10:47.991337+0000","last_fullsized":"2024-03-30T13:10:47.991337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:58.607723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243141+0000","last_change":"2024-03-30T13:10:46.237581+0000","last_active":"2024-03-30T13:10:47.243141+0000","last_peered":"2024-03-30T13:10:47.243141+0000","last_clean":"2024-03-30T13:10:47.243141+0000","last_became_active":"2024-03-30T13:10:46.237307+0000","last_became_peered":"2024-03-30T13:10:46.237307+0000","last_unstale":"2024-03-30T13:10:47.243141+0000","last_undegraded":"2024-03-30T13:10:47.243141+0000","last_fullsized":"2024-03-30T13:10:47.243141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:19.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282213+0000","last_change":"2024-03-30T13:10:45.225591+0000","last_active":"2024-03-30T13:10:48.282213+0000","last_peered":"2024-03-30T13:10:48.282213+0000","last_clean":"2024-03-30T13:10:48.282213+0000","last_became_active":"2024-03-30T13:10:45.224943+0000","last_became_peered":"2024-03-30T13:10:45.224943+0000","last_unstale":"2024-03-30T13:10:48.282213+0000","last_undegraded":"2024-03-30T13:10:48.282213+0000","last_fullsized":"2024-03-30T13:10:48.282213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250237+0000","last_change":"2024-03-30T13:10:46.260952+0000","last_active":"2024-03-30T13:10:47.250237+0000","last_peered":"2024-03-30T13:10:47.250237+0000","last_clean":"2024-03-30T13:10:47.250237+0000","last_became_active":"2024-03-30T13:10:46.260001+0000","last_became_peered":"2024-03-30T13:10:46.260001+0000","last_unstale":"2024-03-30T13:10:47.250237+0000","last_undegraded":"2024-03-30T13:10:47.250237+0000","last_fullsized":"2024-03-30T13:10:47.250237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278771+0000","last_change":"2024-03-30T13:10:45.220120+0000","last_active":"2024-03-30T13:10:48.278771+0000","last_peered":"2024-03-30T13:10:48.278771+0000","last_clean":"2024-03-30T13:10:48.278771+0000","last_became_active":"2024-03-30T13:10:45.218922+0000","last_became_peered":"2024-03-30T13:10:45.218922+0000","last_unstale":"2024-03-30T13:10:48.278771+0000","last_undegraded":"2024-03-30T13:10:48.278771+0000","last_fullsized":"2024-03-30T13:10:48.278771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:18.840387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247862+0000","last_change":"2024-03-30T13:10:45.211201+0000","last_active":"2024-03-30T13:10:47.247862+0000","last_peered":"2024-03-30T13:10:47.247862+0000","last_clean":"2024-03-30T13:10:47.247862+0000","last_became_active":"2024-03-30T13:10:45.210742+0000","last_became_peered":"2024-03-30T13:10:45.210742+0000","last_unstale":"2024-03-30T13:10:47.247862+0000","last_undegraded":"2024-03-30T13:10:47.247862+0000","last_fullsized":"2024-03-30T13:10:47.247862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281386+0000","last_change":"2024-03-30T13:10:46.236372+0000","last_active":"2024-03-30T13:10:48.281386+0000","last_peered":"2024-03-30T13:10:48.281386+0000","last_clean":"2024-03-30T13:10:48.281386+0000","last_became_active":"2024-03-30T13:10:46.236108+0000","last_became_peered":"2024-03-30T13:10:46.236108+0000","last_unstale":"2024-03-30T13:10:48.281386+0000","last_undegraded":"2024-03-30T13:10:48.281386+0000","last_fullsized":"2024-03-30T13:10:48.281386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278586+0000","last_change":"2024-03-30T13:10:45.217654+0000","last_active":"2024-03-30T13:10:48.278586+0000","last_peered":"2024-03-30T13:10:48.278586+0000","last_clean":"2024-03-30T13:10:48.278586+0000","last_became_active":"2024-03-30T13:10:45.217372+0000","last_became_peered":"2024-03-30T13:10:45.217372+0000","last_unstale":"2024-03-30T13:10:48.278586+0000","last_undegraded":"2024-03-30T13:10:48.278586+0000","last_fullsized":"2024-03-30T13:10:48.278586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:57.594719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249908+0000","last_change":"2024-03-30T13:10:46.247867+0000","last_active":"2024-03-30T13:10:47.249908+0000","last_peered":"2024-03-30T13:10:47.249908+0000","last_clean":"2024-03-30T13:10:47.249908+0000","last_became_active":"2024-03-30T13:10:46.246955+0000","last_became_peered":"2024-03-30T13:10:46.246955+0000","last_unstale":"2024-03-30T13:10:47.249908+0000","last_undegraded":"2024-03-30T13:10:47.249908+0000","last_fullsized":"2024-03-30T13:10:47.249908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243434+0000","last_change":"2024-03-30T13:10:45.226750+0000","last_active":"2024-03-30T13:10:47.243434+0000","last_peered":"2024-03-30T13:10:47.243434+0000","last_clean":"2024-03-30T13:10:47.243434+0000","last_became_active":"2024-03-30T13:10:45.226384+0000","last_became_peered":"2024-03-30T13:10:45.226384+0000","last_unstale":"2024-03-30T13:10:47.243434+0000","last_undegraded":"2024-03-30T13:10:47.243434+0000","last_fullsized":"2024-03-30T13:10:47.243434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:34:23.517546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992111+0000","last_change":"2024-03-30T13:10:46.246063+0000","last_active":"2024-03-30T13:10:47.992111+0000","last_peered":"2024-03-30T13:10:47.992111+0000","last_clean":"2024-03-30T13:10:47.992111+0000","last_became_active":"2024-03-30T13:10:46.245539+0000","last_became_peered":"2024-03-30T13:10:46.245539+0000","last_unstale":"2024-03-30T13:10:47.992111+0000","last_undegraded":"2024-03-30T13:10:47.992111+0000","last_fullsized":"2024-03-30T13:10:47.992111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246015+0000","last_change":"2024-03-30T13:10:45.205745+0000","last_active":"2024-03-30T13:10:47.246015+0000","last_peered":"2024-03-30T13:10:47.246015+0000","last_clean":"2024-03-30T13:10:47.246015+0000","last_became_active":"2024-03-30T13:10:45.204814+0000","last_became_peered":"2024-03-30T13:10:45.204814+0000","last_unstale":"2024-03-30T13:10:47.246015+0000","last_undegraded":"2024-03-30T13:10:47.246015+0000","last_fullsized":"2024-03-30T13:10:47.246015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282464+0000","last_change":"2024-03-30T13:10:46.241152+0000","last_active":"2024-03-30T13:10:48.282464+0000","last_peered":"2024-03-30T13:10:48.282464+0000","last_clean":"2024-03-30T13:10:48.282464+0000","last_became_active":"2024-03-30T13:10:46.240813+0000","last_became_peered":"2024-03-30T13:10:46.240813+0000","last_unstale":"2024-03-30T13:10:48.282464+0000","last_undegraded":"2024-03-30T13:10:48.282464+0000","last_fullsized":"2024-03-30T13:10:48.282464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281737+0000","last_change":"2024-03-30T13:10:45.227319+0000","last_active":"2024-03-30T13:10:48.281737+0000","last_peered":"2024-03-30T13:10:48.281737+0000","last_clean":"2024-03-30T13:10:48.281737+0000","last_became_active":"2024-03-30T13:10:45.226913+0000","last_became_peered":"2024-03-30T13:10:45.226913+0000","last_unstale":"2024-03-30T13:10:48.281737+0000","last_undegraded":"2024-03-30T13:10:48.281737+0000","last_fullsized":"2024-03-30T13:10:48.281737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:22.060387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278632+0000","last_change":"2024-03-30T13:10:46.243390+0000","last_active":"2024-03-30T13:10:48.278632+0000","last_peered":"2024-03-30T13:10:48.278632+0000","last_clean":"2024-03-30T13:10:48.278632+0000","last_became_active":"2024-03-30T13:10:46.242925+0000","last_became_peered":"2024-03-30T13:10:46.242925+0000","last_unstale":"2024-03-30T13:10:48.278632+0000","last_undegraded":"2024-03-30T13:10:48.278632+0000","last_fullsized":"2024-03-30T13:10:48.278632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:42.999062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991874+0000","last_change":"2024-03-30T13:10:45.222454+0000","last_active":"2024-03-30T13:10:47.991874+0000","last_peered":"2024-03-30T13:10:47.991874+0000","last_clean":"2024-03-30T13:10:47.991874+0000","last_became_active":"2024-03-30T13:10:45.222143+0000","last_became_peered":"2024-03-30T13:10:45.222143+0000","last_unstale":"2024-03-30T13:10:47.991874+0000","last_undegraded":"2024-03-30T13:10:47.991874+0000","last_fullsized":"2024-03-30T13:10:47.991874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:19.786645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246001+0000","last_change":"2024-03-30T13:10:46.240683+0000","last_active":"2024-03-30T13:10:47.246001+0000","last_peered":"2024-03-30T13:10:47.246001+0000","last_clean":"2024-03-30T13:10:47.246001+0000","last_became_active":"2024-03-30T13:10:46.240375+0000","last_became_peered":"2024-03-30T13:10:46.240375+0000","last_unstale":"2024-03-30T13:10:47.246001+0000","last_undegraded":"2024-03-30T13:10:47.246001+0000","last_fullsized":"2024-03-30T13:10:47.246001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282527+0000","last_change":"2024-03-30T13:10:45.222380+0000","last_active":"2024-03-30T13:10:48.282527+0000","last_peered":"2024-03-30T13:10:48.282527+0000","last_clean":"2024-03-30T13:10:48.282527+0000","last_became_active":"2024-03-30T13:10:45.221975+0000","last_became_peered":"2024-03-30T13:10:45.221975+0000","last_unstale":"2024-03-30T13:10:48.282527+0000","last_undegraded":"2024-03-30T13:10:48.282527+0000","last_fullsized":"2024-03-30T13:10:48.282527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:26:59.790496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248472+0000","last_change":"2024-03-30T13:10:46.232634+0000","last_active":"2024-03-30T13:10:47.248472+0000","last_peered":"2024-03-30T13:10:47.248472+0000","last_clean":"2024-03-30T13:10:47.248472+0000","last_became_active":"2024-03-30T13:10:46.232300+0000","last_became_peered":"2024-03-30T13:10:46.232300+0000","last_unstale":"2024-03-30T13:10:47.248472+0000","last_undegraded":"2024-03-30T13:10:47.248472+0000","last_fullsized":"2024-03-30T13:10:47.248472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278970+0000","last_change":"2024-03-30T13:10:45.218507+0000","last_active":"2024-03-30T13:10:48.278970+0000","last_peered":"2024-03-30T13:10:48.278970+0000","last_clean":"2024-03-30T13:10:48.278970+0000","last_became_active":"2024-03-30T13:10:45.218111+0000","last_became_peered":"2024-03-30T13:10:45.218111+0000","last_unstale":"2024-03-30T13:10:48.278970+0000","last_undegraded":"2024-03-30T13:10:48.278970+0000","last_fullsized":"2024-03-30T13:10:48.278970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:59.653496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278733+0000","last_change":"2024-03-30T13:10:46.239582+0000","last_active":"2024-03-30T13:10:48.278733+0000","last_peered":"2024-03-30T13:10:48.278733+0000","last_clean":"2024-03-30T13:10:48.278733+0000","last_became_active":"2024-03-30T13:10:46.237808+0000","last_became_peered":"2024-03-30T13:10:46.237808+0000","last_unstale":"2024-03-30T13:10:48.278733+0000","last_undegraded":"2024-03-30T13:10:48.278733+0000","last_fullsized":"2024-03-30T13:10:48.278733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:58.426124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245598+0000","last_change":"2024-03-30T13:10:45.210052+0000","last_active":"2024-03-30T13:10:47.245598+0000","last_peered":"2024-03-30T13:10:47.245598+0000","last_clean":"2024-03-30T13:10:47.245598+0000","last_became_active":"2024-03-30T13:10:45.205338+0000","last_became_peered":"2024-03-30T13:10:45.205338+0000","last_unstale":"2024-03-30T13:10:47.245598+0000","last_undegraded":"2024-03-30T13:10:47.245598+0000","last_fullsized":"2024-03-30T13:10:47.245598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:57.594719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242878+0000","last_change":"2024-03-30T13:10:46.247309+0000","last_active":"2024-03-30T13:10:47.242878+0000","last_peered":"2024-03-30T13:10:47.242878+0000","last_clean":"2024-03-30T13:10:47.242878+0000","last_became_active":"2024-03-30T13:10:46.243301+0000","last_became_peered":"2024-03-30T13:10:46.243301+0000","last_unstale":"2024-03-30T13:10:47.242878+0000","last_undegraded":"2024-03-30T13:10:47.242878+0000","last_fullsized":"2024-03-30T13:10:47.242878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:56.949656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249704+0000","last_change":"2024-03-30T13:10:45.221532+0000","last_active":"2024-03-30T13:10:47.249704+0000","last_peered":"2024-03-30T13:10:47.249704+0000","last_clean":"2024-03-30T13:10:47.249704+0000","last_became_active":"2024-03-30T13:10:45.220536+0000","last_became_peered":"2024-03-30T13:10:45.220536+0000","last_unstale":"2024-03-30T13:10:47.249704+0000","last_undegraded":"2024-03-30T13:10:47.249704+0000","last_fullsized":"2024-03-30T13:10:47.249704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279358+0000","last_change":"2024-03-30T13:10:46.242980+0000","last_active":"2024-03-30T13:10:48.279358+0000","last_peered":"2024-03-30T13:10:48.279358+0000","last_clean":"2024-03-30T13:10:48.279358+0000","last_became_active":"2024-03-30T13:10:46.242702+0000","last_became_peered":"2024-03-30T13:10:46.242702+0000","last_unstale":"2024-03-30T13:10:48.279358+0000","last_undegraded":"2024-03-30T13:10:48.279358+0000","last_fullsized":"2024-03-30T13:10:48.279358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:42:22.008993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246344+0000","last_change":"2024-03-30T13:10:45.223223+0000","last_active":"2024-03-30T13:10:47.246344+0000","last_peered":"2024-03-30T13:10:47.246344+0000","last_clean":"2024-03-30T13:10:47.246344+0000","last_became_active":"2024-03-30T13:10:45.222887+0000","last_became_peered":"2024-03-30T13:10:45.222887+0000","last_unstale":"2024-03-30T13:10:47.246344+0000","last_undegraded":"2024-03-30T13:10:47.246344+0000","last_fullsized":"2024-03-30T13:10:47.246344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992357+0000","last_change":"2024-03-30T13:10:46.254732+0000","last_active":"2024-03-30T13:10:47.992357+0000","last_peered":"2024-03-30T13:10:47.992357+0000","last_clean":"2024-03-30T13:10:47.992357+0000","last_became_active":"2024-03-30T13:10:46.254356+0000","last_became_peered":"2024-03-30T13:10:46.254356+0000","last_unstale":"2024-03-30T13:10:47.992357+0000","last_undegraded":"2024-03-30T13:10:47.992357+0000","last_fullsized":"2024-03-30T13:10:47.992357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250809+0000","last_change":"2024-03-30T13:10:45.224819+0000","last_active":"2024-03-30T13:10:47.250809+0000","last_peered":"2024-03-30T13:10:47.250809+0000","last_clean":"2024-03-30T13:10:47.250809+0000","last_became_active":"2024-03-30T13:10:45.223270+0000","last_became_peered":"2024-03-30T13:10:45.223270+0000","last_unstale":"2024-03-30T13:10:47.250809+0000","last_undegraded":"2024-03-30T13:10:47.250809+0000","last_fullsized":"2024-03-30T13:10:47.250809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246314+0000","last_change":"2024-03-30T13:10:46.254500+0000","last_active":"2024-03-30T13:10:47.246314+0000","last_peered":"2024-03-30T13:10:47.246314+0000","last_clean":"2024-03-30T13:10:47.246314+0000","last_became_active":"2024-03-30T13:10:46.254208+0000","last_became_peered":"2024-03-30T13:10:46.254208+0000","last_unstale":"2024-03-30T13:10:47.246314+0000","last_undegraded":"2024-03-30T13:10:47.246314+0000","last_fullsized":"2024-03-30T13:10:47.246314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:42.999062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282278+0000","last_change":"2024-03-30T13:10:45.225766+0000","last_active":"2024-03-30T13:10:48.282278+0000","last_peered":"2024-03-30T13:10:48.282278+0000","last_clean":"2024-03-30T13:10:48.282278+0000","last_became_active":"2024-03-30T13:10:45.225096+0000","last_became_peered":"2024-03-30T13:10:45.225096+0000","last_unstale":"2024-03-30T13:10:48.282278+0000","last_undegraded":"2024-03-30T13:10:48.282278+0000","last_fullsized":"2024-03-30T13:10:48.282278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246156+0000","last_change":"2024-03-30T13:10:46.255837+0000","last_active":"2024-03-30T13:10:47.246156+0000","last_peered":"2024-03-30T13:10:47.246156+0000","last_clean":"2024-03-30T13:10:47.246156+0000","last_became_active":"2024-03-30T13:10:46.251826+0000","last_became_peered":"2024-03-30T13:10:46.251826+0000","last_unstale":"2024-03-30T13:10:47.246156+0000","last_undegraded":"2024-03-30T13:10:47.246156+0000","last_fullsized":"2024-03-30T13:10:47.246156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248851+0000","last_change":"2024-03-30T13:10:45.210147+0000","last_active":"2024-03-30T13:10:47.248851+0000","last_peered":"2024-03-30T13:10:47.248851+0000","last_clean":"2024-03-30T13:10:47.248851+0000","last_became_active":"2024-03-30T13:10:45.209716+0000","last_became_peered":"2024-03-30T13:10:45.209716+0000","last_unstale":"2024-03-30T13:10:47.248851+0000","last_undegraded":"2024-03-30T13:10:47.248851+0000","last_fullsized":"2024-03-30T13:10:47.248851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279114+0000","last_change":"2024-03-30T13:10:46.244995+0000","last_active":"2024-03-30T13:10:48.279114+0000","last_peered":"2024-03-30T13:10:48.279114+0000","last_clean":"2024-03-30T13:10:48.279114+0000","last_became_active":"2024-03-30T13:10:46.244716+0000","last_became_peered":"2024-03-30T13:10:46.244716+0000","last_unstale":"2024-03-30T13:10:48.279114+0000","last_undegraded":"2024-03-30T13:10:48.279114+0000","last_fullsized":"2024-03-30T13:10:48.279114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:56.283461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242840+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:10:47.242840+0000","last_peered":"2024-03-30T13:10:47.242840+0000","last_clean":"2024-03-30T13:10:47.242840+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:10:47.242840+0000","last_undegraded":"2024-03-30T13:10:47.242840+0000","last_fullsized":"2024-03-30T13:10:47.242840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278834+0000","last_change":"2024-03-30T13:10:45.216758+0000","last_active":"2024-03-30T13:10:48.278834+0000","last_peered":"2024-03-30T13:10:48.278834+0000","last_clean":"2024-03-30T13:10:48.278834+0000","last_became_active":"2024-03-30T13:10:45.215040+0000","last_became_peered":"2024-03-30T13:10:45.215040+0000","last_unstale":"2024-03-30T13:10:48.278834+0000","last_undegraded":"2024-03-30T13:10:48.278834+0000","last_fullsized":"2024-03-30T13:10:48.278834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.089085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249967+0000","last_change":"2024-03-30T13:10:46.243383+0000","last_active":"2024-03-30T13:10:47.249967+0000","last_peered":"2024-03-30T13:10:47.249967+0000","last_clean":"2024-03-30T13:10:47.249967+0000","last_became_active":"2024-03-30T13:10:46.243046+0000","last_became_peered":"2024-03-30T13:10:46.243046+0000","last_unstale":"2024-03-30T13:10:47.249967+0000","last_undegraded":"2024-03-30T13:10:47.249967+0000","last_fullsized":"2024-03-30T13:10:47.249967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278692+0000","last_change":"2024-03-30T13:10:45.221144+0000","last_active":"2024-03-30T13:10:48.278692+0000","last_peered":"2024-03-30T13:10:48.278692+0000","last_clean":"2024-03-30T13:10:48.278692+0000","last_became_active":"2024-03-30T13:10:45.219684+0000","last_became_peered":"2024-03-30T13:10:45.219684+0000","last_unstale":"2024-03-30T13:10:48.278692+0000","last_undegraded":"2024-03-30T13:10:48.278692+0000","last_fullsized":"2024-03-30T13:10:48.278692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:49.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247995+0000","last_change":"2024-03-30T13:10:46.239001+0000","last_active":"2024-03-30T13:10:47.247995+0000","last_peered":"2024-03-30T13:10:47.247995+0000","last_clean":"2024-03-30T13:10:47.247995+0000","last_became_active":"2024-03-30T13:10:46.238750+0000","last_became_peered":"2024-03-30T13:10:46.238750+0000","last_unstale":"2024-03-30T13:10:47.247995+0000","last_undegraded":"2024-03-30T13:10:47.247995+0000","last_fullsized":"2024-03-30T13:10:47.247995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281626+0000","last_change":"2024-03-30T13:10:45.223067+0000","last_active":"2024-03-30T13:10:48.281626+0000","last_peered":"2024-03-30T13:10:48.281626+0000","last_clean":"2024-03-30T13:10:48.281626+0000","last_became_active":"2024-03-30T13:10:45.222778+0000","last_became_peered":"2024-03-30T13:10:45.222778+0000","last_unstale":"2024-03-30T13:10:48.281626+0000","last_undegraded":"2024-03-30T13:10:48.281626+0000","last_fullsized":"2024-03-30T13:10:48.281626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:35:37.871387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280762+0000","last_change":"2024-03-30T13:10:46.246374+0000","last_active":"2024-03-30T13:10:48.280762+0000","last_peered":"2024-03-30T13:10:48.280762+0000","last_clean":"2024-03-30T13:10:48.280762+0000","last_became_active":"2024-03-30T13:10:46.246094+0000","last_became_peered":"2024-03-30T13:10:46.246094+0000","last_unstale":"2024-03-30T13:10:48.280762+0000","last_undegraded":"2024-03-30T13:10:48.280762+0000","last_fullsized":"2024-03-30T13:10:48.280762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279004+0000","last_change":"2024-03-30T13:10:45.220442+0000","last_active":"2024-03-30T13:10:48.279004+0000","last_peered":"2024-03-30T13:10:48.279004+0000","last_clean":"2024-03-30T13:10:48.279004+0000","last_became_active":"2024-03-30T13:10:45.219537+0000","last_became_peered":"2024-03-30T13:10:45.219537+0000","last_unstale":"2024-03-30T13:10:48.279004+0000","last_undegraded":"2024-03-30T13:10:48.279004+0000","last_fullsized":"2024-03-30T13:10:48.279004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:37.659793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246414+0000","last_change":"2024-03-30T13:10:46.249794+0000","last_active":"2024-03-30T13:10:47.246414+0000","last_peered":"2024-03-30T13:10:47.246414+0000","last_clean":"2024-03-30T13:10:47.246414+0000","last_became_active":"2024-03-30T13:10:46.249501+0000","last_became_peered":"2024-03-30T13:10:46.249501+0000","last_unstale":"2024-03-30T13:10:47.246414+0000","last_undegraded":"2024-03-30T13:10:47.246414+0000","last_fullsized":"2024-03-30T13:10:47.246414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:58.426124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281281+0000","last_change":"2024-03-30T13:10:45.225647+0000","last_active":"2024-03-30T13:10:48.281281+0000","last_peered":"2024-03-30T13:10:48.281281+0000","last_clean":"2024-03-30T13:10:48.281281+0000","last_became_active":"2024-03-30T13:10:45.225066+0000","last_became_peered":"2024-03-30T13:10:45.225066+0000","last_unstale":"2024-03-30T13:10:48.281281+0000","last_undegraded":"2024-03-30T13:10:48.281281+0000","last_fullsized":"2024-03-30T13:10:48.281281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991763+0000","last_change":"2024-03-30T13:10:46.234204+0000","last_active":"2024-03-30T13:10:47.991763+0000","last_peered":"2024-03-30T13:10:47.991763+0000","last_clean":"2024-03-30T13:10:47.991763+0000","last_became_active":"2024-03-30T13:10:46.233876+0000","last_became_peered":"2024-03-30T13:10:46.233876+0000","last_unstale":"2024-03-30T13:10:47.991763+0000","last_undegraded":"2024-03-30T13:10:47.991763+0000","last_fullsized":"2024-03-30T13:10:47.991763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:19.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279290+0000","last_change":"2024-03-30T13:10:45.219517+0000","last_active":"2024-03-30T13:10:48.279290+0000","last_peered":"2024-03-30T13:10:48.279290+0000","last_clean":"2024-03-30T13:10:48.279290+0000","last_became_active":"2024-03-30T13:10:45.219201+0000","last_became_peered":"2024-03-30T13:10:45.219201+0000","last_unstale":"2024-03-30T13:10:48.279290+0000","last_undegraded":"2024-03-30T13:10:48.279290+0000","last_fullsized":"2024-03-30T13:10:48.279290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:27.406147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248726+0000","last_change":"2024-03-30T13:10:46.234095+0000","last_active":"2024-03-30T13:10:47.248726+0000","last_peered":"2024-03-30T13:10:47.248726+0000","last_clean":"2024-03-30T13:10:47.248726+0000","last_became_active":"2024-03-30T13:10:46.233686+0000","last_became_peered":"2024-03-30T13:10:46.233686+0000","last_unstale":"2024-03-30T13:10:47.248726+0000","last_undegraded":"2024-03-30T13:10:47.248726+0000","last_fullsized":"2024-03-30T13:10:47.248726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.253768+0000","last_change":"2024-03-30T13:10:45.216838+0000","last_active":"2024-03-30T13:10:47.253768+0000","last_peered":"2024-03-30T13:10:47.253768+0000","last_clean":"2024-03-30T13:10:47.253768+0000","last_became_active":"2024-03-30T13:10:45.216528+0000","last_became_peered":"2024-03-30T13:10:45.216528+0000","last_unstale":"2024-03-30T13:10:47.253768+0000","last_undegraded":"2024-03-30T13:10:47.253768+0000","last_fullsized":"2024-03-30T13:10:47.253768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251100+0000","last_change":"2024-03-30T13:10:46.243883+0000","last_active":"2024-03-30T13:10:47.251100+0000","last_peered":"2024-03-30T13:10:47.251100+0000","last_clean":"2024-03-30T13:10:47.251100+0000","last_became_active":"2024-03-30T13:10:46.243583+0000","last_became_peered":"2024-03-30T13:10:46.243583+0000","last_unstale":"2024-03-30T13:10:47.251100+0000","last_undegraded":"2024-03-30T13:10:47.251100+0000","last_fullsized":"2024-03-30T13:10:47.251100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279909+0000","last_change":"2024-03-30T13:10:45.219656+0000","last_active":"2024-03-30T13:10:48.279909+0000","last_peered":"2024-03-30T13:10:48.279909+0000","last_clean":"2024-03-30T13:10:48.279909+0000","last_became_active":"2024-03-30T13:10:45.219347+0000","last_became_peered":"2024-03-30T13:10:45.219347+0000","last_unstale":"2024-03-30T13:10:48.279909+0000","last_undegraded":"2024-03-30T13:10:48.279909+0000","last_fullsized":"2024-03-30T13:10:48.279909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:37.075782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250903+0000","last_change":"2024-03-30T13:10:46.248800+0000","last_active":"2024-03-30T13:10:47.250903+0000","last_peered":"2024-03-30T13:10:47.250903+0000","last_clean":"2024-03-30T13:10:47.250903+0000","last_became_active":"2024-03-30T13:10:46.248344+0000","last_became_peered":"2024-03-30T13:10:46.248344+0000","last_unstale":"2024-03-30T13:10:47.250903+0000","last_undegraded":"2024-03-30T13:10:47.250903+0000","last_fullsized":"2024-03-30T13:10:47.250903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245338+0000","last_change":"2024-03-30T13:10:45.210402+0000","last_active":"2024-03-30T13:10:47.245338+0000","last_peered":"2024-03-30T13:10:47.245338+0000","last_clean":"2024-03-30T13:10:47.245338+0000","last_became_active":"2024-03-30T13:10:45.210107+0000","last_became_peered":"2024-03-30T13:10:45.210107+0000","last_unstale":"2024-03-30T13:10:47.245338+0000","last_undegraded":"2024-03-30T13:10:47.245338+0000","last_fullsized":"2024-03-30T13:10:47.245338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279223+0000","last_change":"2024-03-30T13:10:46.241705+0000","last_active":"2024-03-30T13:10:48.279223+0000","last_peered":"2024-03-30T13:10:48.279223+0000","last_clean":"2024-03-30T13:10:48.279223+0000","last_became_active":"2024-03-30T13:10:46.241327+0000","last_became_peered":"2024-03-30T13:10:46.241327+0000","last_unstale":"2024-03-30T13:10:48.279223+0000","last_undegraded":"2024-03-30T13:10:48.279223+0000","last_fullsized":"2024-03-30T13:10:48.279223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:05:58.972097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250156+0000","last_change":"2024-03-30T13:10:45.223756+0000","last_active":"2024-03-30T13:10:47.250156+0000","last_peered":"2024-03-30T13:10:47.250156+0000","last_clean":"2024-03-30T13:10:47.250156+0000","last_became_active":"2024-03-30T13:10:45.222236+0000","last_became_peered":"2024-03-30T13:10:45.222236+0000","last_unstale":"2024-03-30T13:10:47.250156+0000","last_undegraded":"2024-03-30T13:10:47.250156+0000","last_fullsized":"2024-03-30T13:10:47.250156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250500+0000","last_change":"2024-03-30T13:10:46.250939+0000","last_active":"2024-03-30T13:10:47.250500+0000","last_peered":"2024-03-30T13:10:47.250500+0000","last_clean":"2024-03-30T13:10:47.250500+0000","last_became_active":"2024-03-30T13:10:46.250651+0000","last_became_peered":"2024-03-30T13:10:46.250651+0000","last_unstale":"2024-03-30T13:10:47.250500+0000","last_undegraded":"2024-03-30T13:10:47.250500+0000","last_fullsized":"2024-03-30T13:10:47.250500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248428+0000","last_change":"2024-03-30T13:10:45.222799+0000","last_active":"2024-03-30T13:10:47.248428+0000","last_peered":"2024-03-30T13:10:47.248428+0000","last_clean":"2024-03-30T13:10:47.248428+0000","last_became_active":"2024-03-30T13:10:45.221899+0000","last_became_peered":"2024-03-30T13:10:45.221899+0000","last_unstale":"2024-03-30T13:10:47.248428+0000","last_undegraded":"2024-03-30T13:10:47.248428+0000","last_fullsized":"2024-03-30T13:10:47.248428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282295+0000","last_change":"2024-03-30T13:10:46.245047+0000","last_active":"2024-03-30T13:10:48.282295+0000","last_peered":"2024-03-30T13:10:48.282295+0000","last_clean":"2024-03-30T13:10:48.282295+0000","last_became_active":"2024-03-30T13:10:46.244170+0000","last_became_peered":"2024-03-30T13:10:46.244170+0000","last_unstale":"2024-03-30T13:10:48.282295+0000","last_undegraded":"2024-03-30T13:10:48.282295+0000","last_fullsized":"2024-03-30T13:10:48.282295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:53:32.633100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278786+0000","last_change":"2024-03-30T13:10:45.215312+0000","last_active":"2024-03-30T13:10:48.278786+0000","last_peered":"2024-03-30T13:10:48.278786+0000","last_clean":"2024-03-30T13:10:48.278786+0000","last_became_active":"2024-03-30T13:10:45.214701+0000","last_became_peered":"2024-03-30T13:10:45.214701+0000","last_unstale":"2024-03-30T13:10:48.278786+0000","last_undegraded":"2024-03-30T13:10:48.278786+0000","last_fullsized":"2024-03-30T13:10:48.278786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:16.903426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278902+0000","last_change":"2024-03-30T13:10:46.245626+0000","last_active":"2024-03-30T13:10:48.278902+0000","last_peered":"2024-03-30T13:10:48.278902+0000","last_clean":"2024-03-30T13:10:48.278902+0000","last_became_active":"2024-03-30T13:10:46.245360+0000","last_became_peered":"2024-03-30T13:10:46.245360+0000","last_unstale":"2024-03-30T13:10:48.278902+0000","last_undegraded":"2024-03-30T13:10:48.278902+0000","last_fullsized":"2024-03-30T13:10:48.278902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:55:33.498408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279107+0000","last_change":"2024-03-30T13:10:46.255467+0000","last_active":"2024-03-30T13:10:48.279107+0000","last_peered":"2024-03-30T13:10:48.279107+0000","last_clean":"2024-03-30T13:10:48.279107+0000","last_became_active":"2024-03-30T13:10:46.254974+0000","last_became_peered":"2024-03-30T13:10:46.254974+0000","last_unstale":"2024-03-30T13:10:48.279107+0000","last_undegraded":"2024-03-30T13:10:48.279107+0000","last_fullsized":"2024-03-30T13:10:48.279107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:52:10.233229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246199+0000","last_change":"2024-03-30T13:10:45.203155+0000","last_active":"2024-03-30T13:10:47.246199+0000","last_peered":"2024-03-30T13:10:47.246199+0000","last_clean":"2024-03-30T13:10:47.246199+0000","last_became_active":"2024-03-30T13:10:45.202582+0000","last_became_peered":"2024-03-30T13:10:45.202582+0000","last_unstale":"2024-03-30T13:10:47.246199+0000","last_undegraded":"2024-03-30T13:10:47.246199+0000","last_fullsized":"2024-03-30T13:10:47.246199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:49.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242997+0000","last_change":"2024-03-30T13:10:46.260566+0000","last_active":"2024-03-30T13:10:47.242997+0000","last_peered":"2024-03-30T13:10:47.242997+0000","last_clean":"2024-03-30T13:10:47.242997+0000","last_became_active":"2024-03-30T13:10:46.260117+0000","last_became_peered":"2024-03-30T13:10:46.260117+0000","last_unstale":"2024-03-30T13:10:47.242997+0000","last_undegraded":"2024-03-30T13:10:47.242997+0000","last_fullsized":"2024-03-30T13:10:47.242997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:58.607723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246060+0000","last_change":"2024-03-30T13:10:45.206209+0000","last_active":"2024-03-30T13:10:47.246060+0000","last_peered":"2024-03-30T13:10:47.246060+0000","last_clean":"2024-03-30T13:10:47.246060+0000","last_became_active":"2024-03-30T13:10:45.203095+0000","last_became_peered":"2024-03-30T13:10:45.203095+0000","last_unstale":"2024-03-30T13:10:47.246060+0000","last_undegraded":"2024-03-30T13:10:47.246060+0000","last_fullsized":"2024-03-30T13:10:47.246060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281962+0000","last_change":"2024-03-30T13:10:46.249303+0000","last_active":"2024-03-30T13:10:48.281962+0000","last_peered":"2024-03-30T13:10:48.281962+0000","last_clean":"2024-03-30T13:10:48.281962+0000","last_became_active":"2024-03-30T13:10:46.248971+0000","last_became_peered":"2024-03-30T13:10:46.248971+0000","last_unstale":"2024-03-30T13:10:48.281962+0000","last_undegraded":"2024-03-30T13:10:48.281962+0000","last_fullsized":"2024-03-30T13:10:48.281962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282831+0000","last_change":"2024-03-30T13:10:45.222811+0000","last_active":"2024-03-30T13:10:48.282831+0000","last_peered":"2024-03-30T13:10:48.282831+0000","last_clean":"2024-03-30T13:10:48.282831+0000","last_became_active":"2024-03-30T13:10:45.222439+0000","last_became_peered":"2024-03-30T13:10:45.222439+0000","last_unstale":"2024-03-30T13:10:48.282831+0000","last_undegraded":"2024-03-30T13:10:48.282831+0000","last_fullsized":"2024-03-30T13:10:48.282831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282474+0000","last_change":"2024-03-30T13:10:46.242067+0000","last_active":"2024-03-30T13:10:48.282474+0000","last_peered":"2024-03-30T13:10:48.282474+0000","last_clean":"2024-03-30T13:10:48.282474+0000","last_became_active":"2024-03-30T13:10:46.241783+0000","last_became_peered":"2024-03-30T13:10:46.241783+0000","last_unstale":"2024-03-30T13:10:48.282474+0000","last_undegraded":"2024-03-30T13:10:48.282474+0000","last_fullsized":"2024-03-30T13:10:48.282474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251193+0000","last_change":"2024-03-30T13:10:45.221172+0000","last_active":"2024-03-30T13:10:47.251193+0000","last_peered":"2024-03-30T13:10:47.251193+0000","last_clean":"2024-03-30T13:10:47.251193+0000","last_became_active":"2024-03-30T13:10:45.220799+0000","last_became_peered":"2024-03-30T13:10:45.220799+0000","last_unstale":"2024-03-30T13:10:47.251193+0000","last_undegraded":"2024-03-30T13:10:47.251193+0000","last_fullsized":"2024-03-30T13:10:47.251193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476744,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":665602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":77448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:11:01.801 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:11:02.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.024+0000 7f9fe3e00640 1 Processor -- start 2024-03-30T13:11:02.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.024+0000 7f9fe3e00640 1 -- start start 2024-03-30T13:11:02.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.025+0000 7f9fe3e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9fdc15c670 0x7f9fdc06c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.025+0000 7f9fe3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fdc0ad940 0x7f9fdc06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.025+0000 7f9fe3e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fdc146230 con 0x7f9fdc06f060 2024-03-30T13:11:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.025+0000 7f9fe3e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9fdc06dfc0 con 0x7f9fdc0ad940 2024-03-30T13:11:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.025+0000 7f9fe3e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f9fdc06e2a0 con 0x7f9fdc15c670 2024-03-30T13:11:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.025+0000 7f9fe1e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fdc0ad940 0x7f9fdc06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.026+0000 7f9fe1e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fdc0ad940 0x7f9fdc06d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38610/0 (socket says 172.21.15.99:38610) 2024-03-30T13:11:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.026+0000 7f9fe1e00640 1 -- 172.21.15.99:0/3513687925 learned_addr learned my addr 172.21.15.99:0/3513687925 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.026+0000 7f9fe1e00640 1 -- 172.21.15.99:0/3513687925 >> v2:172.21.15.181:3300/0 conn(0x7f9fdc15c670 msgr2=0x7f9fdc06c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:02.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.026+0000 7f9fe1e00640 1 --2- 172.21.15.99:0/3513687925 >> v2:172.21.15.181:3300/0 conn(0x7f9fdc15c670 0x7f9fdc06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.026+0000 7f9fe1e00640 1 -- 172.21.15.99:0/3513687925 >> v1:172.21.15.181:6789/0 conn(0x7f9fdc06f060 legacy=0x7f9fdc0ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:02.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.026+0000 7f9fe1e00640 1 -- 172.21.15.99:0/3513687925 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc06e580 con 0x7f9fdc0ad940 2024-03-30T13:11:02.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.027+0000 7f9fe1e00640 1 --2- 172.21.15.99:0/3513687925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fdc0ad940 0x7f9fdc06d930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc06f960 tx=0x7f9fd402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8dce4e51902d22 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:02.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.027+0000 7f9fdbe00640 1 -- 172.21.15.99:0/3513687925 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd402c9f0 con 0x7f9fdc0ad940 2024-03-30T13:11:02.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.027+0000 7f9fdbe00640 1 -- 172.21.15.99:0/3513687925 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd402cb90 con 0x7f9fdc0ad940 2024-03-30T13:11:02.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.027+0000 7f9fdbe00640 1 -- 172.21.15.99:0/3513687925 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40343f0 con 0x7f9fdc0ad940 2024-03-30T13:11:02.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.028+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3513687925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fdc0ad940 msgr2=0x7f9fdc06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:02.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.028+0000 7f9fe3e00640 1 --2- 172.21.15.99:0/3513687925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fdc0ad940 0x7f9fdc06d930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc06f960 tx=0x7f9fd402be50 comp rx=0 tx=0).stop 2024-03-30T13:11:02.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.028+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3513687925 shutdown_connections 2024-03-30T13:11:02.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.028+0000 7f9fe3e00640 1 --2- 172.21.15.99:0/3513687925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fdc0ad940 0x7f9fdc06d930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.028+0000 7f9fe3e00640 1 --2- 172.21.15.99:0/3513687925 >> v2:172.21.15.181:3300/0 conn(0x7f9fdc15c670 0x7f9fdc06c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.028+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3513687925 >> 172.21.15.99:0/3513687925 conn(0x7f9fdc06b510 msgr2=0x7f9fdc06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:02.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.028+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3513687925 shutdown_connections 2024-03-30T13:11:02.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.028+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3513687925 wait complete. 2024-03-30T13:11:02.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.031+0000 7f9fe3e00640 1 Processor -- start 2024-03-30T13:11:02.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.031+0000 7f9fe3e00640 1 -- start start 2024-03-30T13:11:02.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.032+0000 7f9fe3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fdc06f060 0x7f9fdc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.032+0000 7f9fe3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fdc0ad940 0x7f9fdc14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.032+0000 7f9fe3e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fdc15c670 0x7f9fdc073170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.032+0000 7f9fe3e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc0b32c0 con 0x7f9fdc06f060 2024-03-30T13:11:02.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.032+0000 7f9fe3e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc15ca50 con 0x7f9fdc0ad940 2024-03-30T13:11:02.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.032+0000 7f9fe3e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f9fdc0b3440 con 0x7f9fdc15c670 2024-03-30T13:11:02.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.032+0000 7f9fe1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fdc06f060 0x7f9fdc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:02.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.033+0000 7f9fe1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fdc06f060 0x7f9fdc071910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38624/0 (socket says 172.21.15.99:38624) 2024-03-30T13:11:02.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.033+0000 7f9fe1400640 1 -- 172.21.15.99:0/3521876324 learned_addr learned my addr 172.21.15.99:0/3521876324 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:02.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.033+0000 7f9fe1e00640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fdc15c670 0x7f9fdc073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:02.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.033+0000 7f9fe1400640 1 -- 172.21.15.99:0/3521876324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fdc15c670 msgr2=0x7f9fdc073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:02.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.033+0000 7f9fe0a00640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fdc0ad940 0x7f9fdc14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:02.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.033+0000 7f9fe1400640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fdc15c670 0x7f9fdc073170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.033+0000 7f9fe1400640 1 -- 172.21.15.99:0/3521876324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fdc0ad940 msgr2=0x7f9fdc14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:02.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.033+0000 7f9fe1400640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fdc0ad940 0x7f9fdc14fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.033+0000 7f9fe1400640 1 -- 172.21.15.99:0/3521876324 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc071e50 con 0x7f9fdc06f060 2024-03-30T13:11:02.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.033+0000 7f9fe1400640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fdc06f060 0x7f9fdc071910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000b410 tx=0x7f9fd000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:02.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.034+0000 7f9fd9600640 1 -- 172.21.15.99:0/3521876324 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0015020 con 0x7f9fdc06f060 2024-03-30T13:11:02.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.034+0000 7f9fd9600640 1 -- 172.21.15.99:0/3521876324 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd0011850 con 0x7f9fdc06f060 2024-03-30T13:11:02.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.034+0000 7f9fd9600640 1 -- 172.21.15.99:0/3521876324 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0011c40 con 0x7f9fdc06f060 2024-03-30T13:11:02.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.034+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3521876324 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fdc0720d0 con 0x7f9fdc06f060 2024-03-30T13:11:02.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.034+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3521876324 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fdc072690 con 0x7f9fdc06f060 2024-03-30T13:11:02.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.035+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3521876324 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fdc068640 con 0x7f9fdc06f060 2024-03-30T13:11:02.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.036+0000 7f9fd9600640 1 -- 172.21.15.99:0/3521876324 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9fd0018020 con 0x7f9fdc06f060 2024-03-30T13:11:02.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.036+0000 7f9fd9600640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fbc06c530 0x7f9fbc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.036+0000 7f9fd9600640 1 -- 172.21.15.99:0/3521876324 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9fd008b5f0 con 0x7f9fdc06f060 2024-03-30T13:11:02.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.037+0000 7f9fe0a00640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fbc06c530 0x7f9fbc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:02.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.037+0000 7f9fe0a00640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fbc06c530 0x7f9fbc06e9f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc15f980 tx=0x7f9fc8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:02.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.041+0000 7f9fd9600640 1 -- 172.21.15.99:0/3521876324 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9fd001f020 con 0x7f9fdc06f060 2024-03-30T13:11:02.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.251+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3521876324 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9fdc06f570 con 0x7f9fbc06c530 2024-03-30T13:11:02.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.262+0000 7f9fd9600640 1 -- 172.21.15.99:0/3521876324 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251829 (secure 0 0 0) 0x7f9fdc06f570 con 0x7f9fbc06c530 2024-03-30T13:11:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:02.269 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.266+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3521876324 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fbc06c530 msgr2=0x7f9fbc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.266+0000 7f9fe3e00640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fbc06c530 0x7f9fbc06e9f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc15f980 tx=0x7f9fc8009040 comp rx=0 tx=0).stop 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.266+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3521876324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fdc06f060 msgr2=0x7f9fdc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.266+0000 7f9fe3e00640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fdc06f060 0x7f9fdc071910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000b410 tx=0x7f9fd000b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.267+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3521876324 shutdown_connections 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.267+0000 7f9fe3e00640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fbc06c530 0x7f9fbc06e9f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.267+0000 7f9fe3e00640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fdc15c670 0x7f9fdc073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.267+0000 7f9fe3e00640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fdc0ad940 0x7f9fdc14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.267+0000 7f9fe3e00640 1 --2- 172.21.15.99:0/3521876324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fdc06f060 0x7f9fdc071910 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.267+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3521876324 >> 172.21.15.99:0/3521876324 conn(0x7f9fdc06b510 msgr2=0x7f9fdc0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.267+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3521876324 shutdown_connections 2024-03-30T13:11:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.267+0000 7f9fe3e00640 1 -- 172.21.15.99:0/3521876324 wait complete. 2024-03-30T13:11:02.286 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-03-30T13:11:01.439181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2990080,"data_stored":1786868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003863"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246289+0000","last_change":"2024-03-30T13:10:46.234821+0000","last_active":"2024-03-30T13:10:47.246289+0000","last_peered":"2024-03-30T13:10:47.246289+0000","last_clean":"2024-03-30T13:10:47.246289+0000","last_became_active":"2024-03-30T13:10:46.234553+0000","last_became_peered":"2024-03-30T13:10:46.234553+0000","last_unstale":"2024-03-30T13:10:47.246289+0000","last_undegraded":"2024-03-30T13:10:47.246289+0000","last_fullsized":"2024-03-30T13:10:47.246289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:13.303492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282177+0000","last_change":"2024-03-30T13:10:46.238313+0000","last_active":"2024-03-30T13:10:48.282177+0000","last_peered":"2024-03-30T13:10:48.282177+0000","last_clean":"2024-03-30T13:10:48.282177+0000","last_became_active":"2024-03-30T13:10:46.238010+0000","last_became_peered":"2024-03-30T13:10:46.238010+0000","last_unstale":"2024-03-30T13:10:48.282177+0000","last_undegraded":"2024-03-30T13:10:48.282177+0000","last_fullsized":"2024-03-30T13:10:48.282177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281389+0000","last_change":"2024-03-30T13:10:46.241744+0000","last_active":"2024-03-30T13:10:48.281389+0000","last_peered":"2024-03-30T13:10:48.281389+0000","last_clean":"2024-03-30T13:10:48.281389+0000","last_became_active":"2024-03-30T13:10:46.241480+0000","last_became_peered":"2024-03-30T13:10:46.241480+0000","last_unstale":"2024-03-30T13:10:48.281389+0000","last_undegraded":"2024-03-30T13:10:48.281389+0000","last_fullsized":"2024-03-30T13:10:48.281389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991801+0000","last_change":"2024-03-30T13:10:46.244024+0000","last_active":"2024-03-30T13:10:47.991801+0000","last_peered":"2024-03-30T13:10:47.991801+0000","last_clean":"2024-03-30T13:10:47.991801+0000","last_became_active":"2024-03-30T13:10:46.243697+0000","last_became_peered":"2024-03-30T13:10:46.243697+0000","last_unstale":"2024-03-30T13:10:47.991801+0000","last_undegraded":"2024-03-30T13:10:47.991801+0000","last_fullsized":"2024-03-30T13:10:47.991801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:38.672797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246287+0000","last_change":"2024-03-30T13:10:46.234379+0000","last_active":"2024-03-30T13:10:47.246287+0000","last_peered":"2024-03-30T13:10:47.246287+0000","last_clean":"2024-03-30T13:10:47.246287+0000","last_became_active":"2024-03-30T13:10:46.234047+0000","last_became_peered":"2024-03-30T13:10:46.234047+0000","last_unstale":"2024-03-30T13:10:47.246287+0000","last_undegraded":"2024-03-30T13:10:47.246287+0000","last_fullsized":"2024-03-30T13:10:47.246287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991724+0000","last_change":"2024-03-30T13:10:46.243204+0000","last_active":"2024-03-30T13:10:47.991724+0000","last_peered":"2024-03-30T13:10:47.991724+0000","last_clean":"2024-03-30T13:10:47.991724+0000","last_became_active":"2024-03-30T13:10:46.242897+0000","last_became_peered":"2024-03-30T13:10:46.242897+0000","last_unstale":"2024-03-30T13:10:47.991724+0000","last_undegraded":"2024-03-30T13:10:47.991724+0000","last_fullsized":"2024-03-30T13:10:47.991724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:50.453642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245509+0000","last_change":"2024-03-30T13:10:46.244716+0000","last_active":"2024-03-30T13:10:47.245509+0000","last_peered":"2024-03-30T13:10:47.245509+0000","last_clean":"2024-03-30T13:10:47.245509+0000","last_became_active":"2024-03-30T13:10:46.244353+0000","last_became_peered":"2024-03-30T13:10:46.244353+0000","last_unstale":"2024-03-30T13:10:47.245509+0000","last_undegraded":"2024-03-30T13:10:47.245509+0000","last_fullsized":"2024-03-30T13:10:47.245509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280766+0000","last_change":"2024-03-30T13:10:46.255145+0000","last_active":"2024-03-30T13:10:48.280766+0000","last_peered":"2024-03-30T13:10:48.280766+0000","last_clean":"2024-03-30T13:10:48.280766+0000","last_became_active":"2024-03-30T13:10:46.254848+0000","last_became_peered":"2024-03-30T13:10:46.254848+0000","last_unstale":"2024-03-30T13:10:48.280766+0000","last_undegraded":"2024-03-30T13:10:48.280766+0000","last_fullsized":"2024-03-30T13:10:48.280766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243525+0000","last_change":"2024-03-30T13:10:46.249338+0000","last_active":"2024-03-30T13:10:47.243525+0000","last_peered":"2024-03-30T13:10:47.243525+0000","last_clean":"2024-03-30T13:10:47.243525+0000","last_became_active":"2024-03-30T13:10:46.248206+0000","last_became_peered":"2024-03-30T13:10:46.248206+0000","last_unstale":"2024-03-30T13:10:47.243525+0000","last_undegraded":"2024-03-30T13:10:47.243525+0000","last_fullsized":"2024-03-30T13:10:47.243525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:38.672797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245949+0000","last_change":"2024-03-30T13:10:46.236494+0000","last_active":"2024-03-30T13:10:47.245949+0000","last_peered":"2024-03-30T13:10:47.245949+0000","last_clean":"2024-03-30T13:10:47.245949+0000","last_became_active":"2024-03-30T13:10:46.236199+0000","last_became_peered":"2024-03-30T13:10:46.236199+0000","last_unstale":"2024-03-30T13:10:47.245949+0000","last_undegraded":"2024-03-30T13:10:47.245949+0000","last_fullsized":"2024-03-30T13:10:47.245949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245994+0000","last_change":"2024-03-30T13:10:46.245545+0000","last_active":"2024-03-30T13:10:47.245994+0000","last_peered":"2024-03-30T13:10:47.245994+0000","last_clean":"2024-03-30T13:10:47.245994+0000","last_became_active":"2024-03-30T13:10:46.245286+0000","last_became_peered":"2024-03-30T13:10:46.245286+0000","last_unstale":"2024-03-30T13:10:47.245994+0000","last_undegraded":"2024-03-30T13:10:47.245994+0000","last_fullsized":"2024-03-30T13:10:47.245994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245950+0000","last_change":"2024-03-30T13:10:46.256061+0000","last_active":"2024-03-30T13:10:47.245950+0000","last_peered":"2024-03-30T13:10:47.245950+0000","last_clean":"2024-03-30T13:10:47.245950+0000","last_became_active":"2024-03-30T13:10:46.252144+0000","last_became_peered":"2024-03-30T13:10:46.252144+0000","last_unstale":"2024-03-30T13:10:47.245950+0000","last_undegraded":"2024-03-30T13:10:47.245950+0000","last_fullsized":"2024-03-30T13:10:47.245950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248585+0000","last_change":"2024-03-30T13:10:46.240158+0000","last_active":"2024-03-30T13:10:47.248585+0000","last_peered":"2024-03-30T13:10:47.248585+0000","last_clean":"2024-03-30T13:10:47.248585+0000","last_became_active":"2024-03-30T13:10:46.235455+0000","last_became_peered":"2024-03-30T13:10:46.235455+0000","last_unstale":"2024-03-30T13:10:47.248585+0000","last_undegraded":"2024-03-30T13:10:47.248585+0000","last_fullsized":"2024-03-30T13:10:47.248585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:00.666500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248107+0000","last_change":"2024-03-30T13:10:46.243687+0000","last_active":"2024-03-30T13:10:47.248107+0000","last_peered":"2024-03-30T13:10:47.248107+0000","last_clean":"2024-03-30T13:10:47.248107+0000","last_became_active":"2024-03-30T13:10:46.243389+0000","last_became_peered":"2024-03-30T13:10:46.243389+0000","last_unstale":"2024-03-30T13:10:47.248107+0000","last_undegraded":"2024-03-30T13:10:47.248107+0000","last_fullsized":"2024-03-30T13:10:47.248107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280718+0000","last_change":"2024-03-30T13:10:46.256471+0000","last_active":"2024-03-30T13:10:48.280718+0000","last_peered":"2024-03-30T13:10:48.280718+0000","last_clean":"2024-03-30T13:10:48.280718+0000","last_became_active":"2024-03-30T13:10:46.256215+0000","last_became_peered":"2024-03-30T13:10:46.256215+0000","last_unstale":"2024-03-30T13:10:48.280718+0000","last_undegraded":"2024-03-30T13:10:48.280718+0000","last_fullsized":"2024-03-30T13:10:48.280718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278522+0000","last_change":"2024-03-30T13:10:46.233516+0000","last_active":"2024-03-30T13:10:48.278522+0000","last_peered":"2024-03-30T13:10:48.278522+0000","last_clean":"2024-03-30T13:10:48.278522+0000","last_became_active":"2024-03-30T13:10:46.233168+0000","last_became_peered":"2024-03-30T13:10:46.233168+0000","last_unstale":"2024-03-30T13:10:48.278522+0000","last_undegraded":"2024-03-30T13:10:48.278522+0000","last_fullsized":"2024-03-30T13:10:48.278522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:13.303492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280093+0000","last_change":"2024-03-30T13:10:46.260609+0000","last_active":"2024-03-30T13:10:48.280093+0000","last_peered":"2024-03-30T13:10:48.280093+0000","last_clean":"2024-03-30T13:10:48.280093+0000","last_became_active":"2024-03-30T13:10:46.257204+0000","last_became_peered":"2024-03-30T13:10:46.257204+0000","last_unstale":"2024-03-30T13:10:48.280093+0000","last_undegraded":"2024-03-30T13:10:48.280093+0000","last_fullsized":"2024-03-30T13:10:48.280093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:33:04.251828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281932+0000","last_change":"2024-03-30T13:10:46.253562+0000","last_active":"2024-03-30T13:10:48.281932+0000","last_peered":"2024-03-30T13:10:48.281932+0000","last_clean":"2024-03-30T13:10:48.281932+0000","last_became_active":"2024-03-30T13:10:46.253288+0000","last_became_peered":"2024-03-30T13:10:46.253288+0000","last_unstale":"2024-03-30T13:10:48.281932+0000","last_undegraded":"2024-03-30T13:10:48.281932+0000","last_fullsized":"2024-03-30T13:10:48.281932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:12:43.810698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279336+0000","last_change":"2024-03-30T13:10:46.244101+0000","last_active":"2024-03-30T13:10:48.279336+0000","last_peered":"2024-03-30T13:10:48.279336+0000","last_clean":"2024-03-30T13:10:48.279336+0000","last_became_active":"2024-03-30T13:10:46.241383+0000","last_became_peered":"2024-03-30T13:10:46.241383+0000","last_unstale":"2024-03-30T13:10:48.279336+0000","last_undegraded":"2024-03-30T13:10:48.279336+0000","last_fullsized":"2024-03-30T13:10:48.279336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:09.717253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246132+0000","last_change":"2024-03-30T13:10:46.258488+0000","last_active":"2024-03-30T13:10:47.246132+0000","last_peered":"2024-03-30T13:10:47.246132+0000","last_clean":"2024-03-30T13:10:47.246132+0000","last_became_active":"2024-03-30T13:10:46.251558+0000","last_became_peered":"2024-03-30T13:10:46.251558+0000","last_unstale":"2024-03-30T13:10:47.246132+0000","last_undegraded":"2024-03-30T13:10:47.246132+0000","last_fullsized":"2024-03-30T13:10:47.246132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250207+0000","last_change":"2024-03-30T13:10:46.243487+0000","last_active":"2024-03-30T13:10:47.250207+0000","last_peered":"2024-03-30T13:10:47.250207+0000","last_clean":"2024-03-30T13:10:47.250207+0000","last_became_active":"2024-03-30T13:10:46.243102+0000","last_became_peered":"2024-03-30T13:10:46.243102+0000","last_unstale":"2024-03-30T13:10:47.250207+0000","last_undegraded":"2024-03-30T13:10:47.250207+0000","last_fullsized":"2024-03-30T13:10:47.250207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243005+0000","last_change":"2024-03-30T13:10:46.262008+0000","last_active":"2024-03-30T13:10:47.243005+0000","last_peered":"2024-03-30T13:10:47.243005+0000","last_clean":"2024-03-30T13:10:47.243005+0000","last_became_active":"2024-03-30T13:10:46.259954+0000","last_became_peered":"2024-03-30T13:10:46.259954+0000","last_unstale":"2024-03-30T13:10:47.243005+0000","last_undegraded":"2024-03-30T13:10:47.243005+0000","last_fullsized":"2024-03-30T13:10:47.243005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:50.453642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280858+0000","last_change":"2024-03-30T13:10:46.247945+0000","last_active":"2024-03-30T13:10:48.280858+0000","last_peered":"2024-03-30T13:10:48.280858+0000","last_clean":"2024-03-30T13:10:48.280858+0000","last_became_active":"2024-03-30T13:10:46.247685+0000","last_became_peered":"2024-03-30T13:10:46.247685+0000","last_unstale":"2024-03-30T13:10:48.280858+0000","last_undegraded":"2024-03-30T13:10:48.280858+0000","last_fullsized":"2024-03-30T13:10:48.280858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278783+0000","last_change":"2024-03-30T13:10:46.238738+0000","last_active":"2024-03-30T13:10:48.278783+0000","last_peered":"2024-03-30T13:10:48.278783+0000","last_clean":"2024-03-30T13:10:48.278783+0000","last_became_active":"2024-03-30T13:10:46.238383+0000","last_became_peered":"2024-03-30T13:10:46.238383+0000","last_unstale":"2024-03-30T13:10:48.278783+0000","last_undegraded":"2024-03-30T13:10:48.278783+0000","last_fullsized":"2024-03-30T13:10:48.278783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:43:03.365657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282406+0000","last_change":"2024-03-30T13:10:46.249445+0000","last_active":"2024-03-30T13:10:48.282406+0000","last_peered":"2024-03-30T13:10:48.282406+0000","last_clean":"2024-03-30T13:10:48.282406+0000","last_became_active":"2024-03-30T13:10:46.249008+0000","last_became_peered":"2024-03-30T13:10:46.249008+0000","last_unstale":"2024-03-30T13:10:48.282406+0000","last_undegraded":"2024-03-30T13:10:48.282406+0000","last_fullsized":"2024-03-30T13:10:48.282406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:49:55.924541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992191+0000","last_change":"2024-03-30T13:10:46.247610+0000","last_active":"2024-03-30T13:10:47.992191+0000","last_peered":"2024-03-30T13:10:47.992191+0000","last_clean":"2024-03-30T13:10:47.992191+0000","last_became_active":"2024-03-30T13:10:46.247333+0000","last_became_peered":"2024-03-30T13:10:46.247333+0000","last_unstale":"2024-03-30T13:10:47.992191+0000","last_undegraded":"2024-03-30T13:10:47.992191+0000","last_fullsized":"2024-03-30T13:10:47.992191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:38.088786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248607+0000","last_change":"2024-03-30T13:10:46.243725+0000","last_active":"2024-03-30T13:10:47.248607+0000","last_peered":"2024-03-30T13:10:47.248607+0000","last_clean":"2024-03-30T13:10:47.248607+0000","last_became_active":"2024-03-30T13:10:46.243423+0000","last_became_peered":"2024-03-30T13:10:46.243423+0000","last_unstale":"2024-03-30T13:10:47.248607+0000","last_undegraded":"2024-03-30T13:10:47.248607+0000","last_fullsized":"2024-03-30T13:10:47.248607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248584+0000","last_change":"2024-03-30T13:10:46.254386+0000","last_active":"2024-03-30T13:10:47.248584+0000","last_peered":"2024-03-30T13:10:47.248584+0000","last_clean":"2024-03-30T13:10:47.248584+0000","last_became_active":"2024-03-30T13:10:46.254081+0000","last_became_peered":"2024-03-30T13:10:46.254081+0000","last_unstale":"2024-03-30T13:10:47.248584+0000","last_undegraded":"2024-03-30T13:10:47.248584+0000","last_fullsized":"2024-03-30T13:10:47.248584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281880+0000","last_change":"2024-03-30T13:10:46.246367+0000","last_active":"2024-03-30T13:10:48.281880+0000","last_peered":"2024-03-30T13:10:48.281880+0000","last_clean":"2024-03-30T13:10:48.281880+0000","last_became_active":"2024-03-30T13:10:46.246066+0000","last_became_peered":"2024-03-30T13:10:46.246066+0000","last_unstale":"2024-03-30T13:10:48.281880+0000","last_undegraded":"2024-03-30T13:10:48.281880+0000","last_fullsized":"2024-03-30T13:10:48.281880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:55:33.869741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278521+0000","last_change":"2024-03-30T13:10:46.234128+0000","last_active":"2024-03-30T13:10:48.278521+0000","last_peered":"2024-03-30T13:10:48.278521+0000","last_clean":"2024-03-30T13:10:48.278521+0000","last_became_active":"2024-03-30T13:10:46.233731+0000","last_became_peered":"2024-03-30T13:10:46.233731+0000","last_unstale":"2024-03-30T13:10:48.278521+0000","last_undegraded":"2024-03-30T13:10:48.278521+0000","last_fullsized":"2024-03-30T13:10:48.278521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281367+0000","last_change":"2024-03-30T13:10:46.247881+0000","last_active":"2024-03-30T13:10:48.281367+0000","last_peered":"2024-03-30T13:10:48.281367+0000","last_clean":"2024-03-30T13:10:48.281367+0000","last_became_active":"2024-03-30T13:10:46.247618+0000","last_became_peered":"2024-03-30T13:10:46.247618+0000","last_unstale":"2024-03-30T13:10:48.281367+0000","last_undegraded":"2024-03-30T13:10:48.281367+0000","last_fullsized":"2024-03-30T13:10:48.281367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:40:00.406615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991337+0000","last_change":"2024-03-30T13:10:46.253544+0000","last_active":"2024-03-30T13:10:47.991337+0000","last_peered":"2024-03-30T13:10:47.991337+0000","last_clean":"2024-03-30T13:10:47.991337+0000","last_became_active":"2024-03-30T13:10:46.253034+0000","last_became_peered":"2024-03-30T13:10:46.253034+0000","last_unstale":"2024-03-30T13:10:47.991337+0000","last_undegraded":"2024-03-30T13:10:47.991337+0000","last_fullsized":"2024-03-30T13:10:47.991337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:58.607723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243141+0000","last_change":"2024-03-30T13:10:46.237581+0000","last_active":"2024-03-30T13:10:47.243141+0000","last_peered":"2024-03-30T13:10:47.243141+0000","last_clean":"2024-03-30T13:10:47.243141+0000","last_became_active":"2024-03-30T13:10:46.237307+0000","last_became_peered":"2024-03-30T13:10:46.237307+0000","last_unstale":"2024-03-30T13:10:47.243141+0000","last_undegraded":"2024-03-30T13:10:47.243141+0000","last_fullsized":"2024-03-30T13:10:47.243141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:19.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282213+0000","last_change":"2024-03-30T13:10:45.225591+0000","last_active":"2024-03-30T13:10:48.282213+0000","last_peered":"2024-03-30T13:10:48.282213+0000","last_clean":"2024-03-30T13:10:48.282213+0000","last_became_active":"2024-03-30T13:10:45.224943+0000","last_became_peered":"2024-03-30T13:10:45.224943+0000","last_unstale":"2024-03-30T13:10:48.282213+0000","last_undegraded":"2024-03-30T13:10:48.282213+0000","last_fullsized":"2024-03-30T13:10:48.282213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250237+0000","last_change":"2024-03-30T13:10:46.260952+0000","last_active":"2024-03-30T13:10:47.250237+0000","last_peered":"2024-03-30T13:10:47.250237+0000","last_clean":"2024-03-30T13:10:47.250237+0000","last_became_active":"2024-03-30T13:10:46.260001+0000","last_became_peered":"2024-03-30T13:10:46.260001+0000","last_unstale":"2024-03-30T13:10:47.250237+0000","last_undegraded":"2024-03-30T13:10:47.250237+0000","last_fullsized":"2024-03-30T13:10:47.250237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278771+0000","last_change":"2024-03-30T13:10:45.220120+0000","last_active":"2024-03-30T13:10:48.278771+0000","last_peered":"2024-03-30T13:10:48.278771+0000","last_clean":"2024-03-30T13:10:48.278771+0000","last_became_active":"2024-03-30T13:10:45.218922+0000","last_became_peered":"2024-03-30T13:10:45.218922+0000","last_unstale":"2024-03-30T13:10:48.278771+0000","last_undegraded":"2024-03-30T13:10:48.278771+0000","last_fullsized":"2024-03-30T13:10:48.278771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:18.840387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247862+0000","last_change":"2024-03-30T13:10:45.211201+0000","last_active":"2024-03-30T13:10:47.247862+0000","last_peered":"2024-03-30T13:10:47.247862+0000","last_clean":"2024-03-30T13:10:47.247862+0000","last_became_active":"2024-03-30T13:10:45.210742+0000","last_became_peered":"2024-03-30T13:10:45.210742+0000","last_unstale":"2024-03-30T13:10:47.247862+0000","last_undegraded":"2024-03-30T13:10:47.247862+0000","last_fullsized":"2024-03-30T13:10:47.247862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:34.223073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281386+0000","last_change":"2024-03-30T13:10:46.236372+0000","last_active":"2024-03-30T13:10:48.281386+0000","last_peered":"2024-03-30T13:10:48.281386+0000","last_clean":"2024-03-30T13:10:48.281386+0000","last_became_active":"2024-03-30T13:10:46.236108+0000","last_became_peered":"2024-03-30T13:10:46.236108+0000","last_unstale":"2024-03-30T13:10:48.281386+0000","last_undegraded":"2024-03-30T13:10:48.281386+0000","last_fullsized":"2024-03-30T13:10:48.281386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:44:56.450922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278586+0000","last_change":"2024-03-30T13:10:45.217654+0000","last_active":"2024-03-30T13:10:48.278586+0000","last_peered":"2024-03-30T13:10:48.278586+0000","last_clean":"2024-03-30T13:10:48.278586+0000","last_became_active":"2024-03-30T13:10:45.217372+0000","last_became_peered":"2024-03-30T13:10:45.217372+0000","last_unstale":"2024-03-30T13:10:48.278586+0000","last_undegraded":"2024-03-30T13:10:48.278586+0000","last_fullsized":"2024-03-30T13:10:48.278586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:57.594719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249908+0000","last_change":"2024-03-30T13:10:46.247867+0000","last_active":"2024-03-30T13:10:47.249908+0000","last_peered":"2024-03-30T13:10:47.249908+0000","last_clean":"2024-03-30T13:10:47.249908+0000","last_became_active":"2024-03-30T13:10:46.246955+0000","last_became_peered":"2024-03-30T13:10:46.246955+0000","last_unstale":"2024-03-30T13:10:47.249908+0000","last_undegraded":"2024-03-30T13:10:47.249908+0000","last_fullsized":"2024-03-30T13:10:47.249908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:28.419151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.243434+0000","last_change":"2024-03-30T13:10:45.226750+0000","last_active":"2024-03-30T13:10:47.243434+0000","last_peered":"2024-03-30T13:10:47.243434+0000","last_clean":"2024-03-30T13:10:47.243434+0000","last_became_active":"2024-03-30T13:10:45.226384+0000","last_became_peered":"2024-03-30T13:10:45.226384+0000","last_unstale":"2024-03-30T13:10:47.243434+0000","last_undegraded":"2024-03-30T13:10:47.243434+0000","last_fullsized":"2024-03-30T13:10:47.243434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:34:23.517546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992111+0000","last_change":"2024-03-30T13:10:46.246063+0000","last_active":"2024-03-30T13:10:47.992111+0000","last_peered":"2024-03-30T13:10:47.992111+0000","last_clean":"2024-03-30T13:10:47.992111+0000","last_became_active":"2024-03-30T13:10:46.245539+0000","last_became_peered":"2024-03-30T13:10:46.245539+0000","last_unstale":"2024-03-30T13:10:47.992111+0000","last_undegraded":"2024-03-30T13:10:47.992111+0000","last_fullsized":"2024-03-30T13:10:47.992111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246015+0000","last_change":"2024-03-30T13:10:45.205745+0000","last_active":"2024-03-30T13:10:47.246015+0000","last_peered":"2024-03-30T13:10:47.246015+0000","last_clean":"2024-03-30T13:10:47.246015+0000","last_became_active":"2024-03-30T13:10:45.204814+0000","last_became_peered":"2024-03-30T13:10:45.204814+0000","last_unstale":"2024-03-30T13:10:47.246015+0000","last_undegraded":"2024-03-30T13:10:47.246015+0000","last_fullsized":"2024-03-30T13:10:47.246015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282464+0000","last_change":"2024-03-30T13:10:46.241152+0000","last_active":"2024-03-30T13:10:48.282464+0000","last_peered":"2024-03-30T13:10:48.282464+0000","last_clean":"2024-03-30T13:10:48.282464+0000","last_became_active":"2024-03-30T13:10:46.240813+0000","last_became_peered":"2024-03-30T13:10:46.240813+0000","last_unstale":"2024-03-30T13:10:48.282464+0000","last_undegraded":"2024-03-30T13:10:48.282464+0000","last_fullsized":"2024-03-30T13:10:48.282464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281737+0000","last_change":"2024-03-30T13:10:45.227319+0000","last_active":"2024-03-30T13:10:48.281737+0000","last_peered":"2024-03-30T13:10:48.281737+0000","last_clean":"2024-03-30T13:10:48.281737+0000","last_became_active":"2024-03-30T13:10:45.226913+0000","last_became_peered":"2024-03-30T13:10:45.226913+0000","last_unstale":"2024-03-30T13:10:48.281737+0000","last_undegraded":"2024-03-30T13:10:48.281737+0000","last_fullsized":"2024-03-30T13:10:48.281737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:22.060387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278632+0000","last_change":"2024-03-30T13:10:46.243390+0000","last_active":"2024-03-30T13:10:48.278632+0000","last_peered":"2024-03-30T13:10:48.278632+0000","last_clean":"2024-03-30T13:10:48.278632+0000","last_became_active":"2024-03-30T13:10:46.242925+0000","last_became_peered":"2024-03-30T13:10:46.242925+0000","last_unstale":"2024-03-30T13:10:48.278632+0000","last_undegraded":"2024-03-30T13:10:48.278632+0000","last_fullsized":"2024-03-30T13:10:48.278632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:42.999062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991874+0000","last_change":"2024-03-30T13:10:45.222454+0000","last_active":"2024-03-30T13:10:47.991874+0000","last_peered":"2024-03-30T13:10:47.991874+0000","last_clean":"2024-03-30T13:10:47.991874+0000","last_became_active":"2024-03-30T13:10:45.222143+0000","last_became_peered":"2024-03-30T13:10:45.222143+0000","last_unstale":"2024-03-30T13:10:47.991874+0000","last_undegraded":"2024-03-30T13:10:47.991874+0000","last_fullsized":"2024-03-30T13:10:47.991874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:19.786645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246001+0000","last_change":"2024-03-30T13:10:46.240683+0000","last_active":"2024-03-30T13:10:47.246001+0000","last_peered":"2024-03-30T13:10:47.246001+0000","last_clean":"2024-03-30T13:10:47.246001+0000","last_became_active":"2024-03-30T13:10:46.240375+0000","last_became_peered":"2024-03-30T13:10:46.240375+0000","last_unstale":"2024-03-30T13:10:47.246001+0000","last_undegraded":"2024-03-30T13:10:47.246001+0000","last_fullsized":"2024-03-30T13:10:47.246001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:14:03.060639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282527+0000","last_change":"2024-03-30T13:10:45.222380+0000","last_active":"2024-03-30T13:10:48.282527+0000","last_peered":"2024-03-30T13:10:48.282527+0000","last_clean":"2024-03-30T13:10:48.282527+0000","last_became_active":"2024-03-30T13:10:45.221975+0000","last_became_peered":"2024-03-30T13:10:45.221975+0000","last_unstale":"2024-03-30T13:10:48.282527+0000","last_undegraded":"2024-03-30T13:10:48.282527+0000","last_fullsized":"2024-03-30T13:10:48.282527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:26:59.790496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248472+0000","last_change":"2024-03-30T13:10:46.232634+0000","last_active":"2024-03-30T13:10:47.248472+0000","last_peered":"2024-03-30T13:10:47.248472+0000","last_clean":"2024-03-30T13:10:47.248472+0000","last_became_active":"2024-03-30T13:10:46.232300+0000","last_became_peered":"2024-03-30T13:10:46.232300+0000","last_unstale":"2024-03-30T13:10:47.248472+0000","last_undegraded":"2024-03-30T13:10:47.248472+0000","last_fullsized":"2024-03-30T13:10:47.248472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278970+0000","last_change":"2024-03-30T13:10:45.218507+0000","last_active":"2024-03-30T13:10:48.278970+0000","last_peered":"2024-03-30T13:10:48.278970+0000","last_clean":"2024-03-30T13:10:48.278970+0000","last_became_active":"2024-03-30T13:10:45.218111+0000","last_became_peered":"2024-03-30T13:10:45.218111+0000","last_unstale":"2024-03-30T13:10:48.278970+0000","last_undegraded":"2024-03-30T13:10:48.278970+0000","last_fullsized":"2024-03-30T13:10:48.278970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:49:59.653496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278733+0000","last_change":"2024-03-30T13:10:46.239582+0000","last_active":"2024-03-30T13:10:48.278733+0000","last_peered":"2024-03-30T13:10:48.278733+0000","last_clean":"2024-03-30T13:10:48.278733+0000","last_became_active":"2024-03-30T13:10:46.237808+0000","last_became_peered":"2024-03-30T13:10:46.237808+0000","last_unstale":"2024-03-30T13:10:48.278733+0000","last_undegraded":"2024-03-30T13:10:48.278733+0000","last_fullsized":"2024-03-30T13:10:48.278733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:58.426124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245598+0000","last_change":"2024-03-30T13:10:45.210052+0000","last_active":"2024-03-30T13:10:47.245598+0000","last_peered":"2024-03-30T13:10:47.245598+0000","last_clean":"2024-03-30T13:10:47.245598+0000","last_became_active":"2024-03-30T13:10:45.205338+0000","last_became_peered":"2024-03-30T13:10:45.205338+0000","last_unstale":"2024-03-30T13:10:47.245598+0000","last_undegraded":"2024-03-30T13:10:47.245598+0000","last_fullsized":"2024-03-30T13:10:47.245598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:57.594719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242878+0000","last_change":"2024-03-30T13:10:46.247309+0000","last_active":"2024-03-30T13:10:47.242878+0000","last_peered":"2024-03-30T13:10:47.242878+0000","last_clean":"2024-03-30T13:10:47.242878+0000","last_became_active":"2024-03-30T13:10:46.243301+0000","last_became_peered":"2024-03-30T13:10:46.243301+0000","last_unstale":"2024-03-30T13:10:47.242878+0000","last_undegraded":"2024-03-30T13:10:47.242878+0000","last_fullsized":"2024-03-30T13:10:47.242878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:56.949656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249704+0000","last_change":"2024-03-30T13:10:45.221532+0000","last_active":"2024-03-30T13:10:47.249704+0000","last_peered":"2024-03-30T13:10:47.249704+0000","last_clean":"2024-03-30T13:10:47.249704+0000","last_became_active":"2024-03-30T13:10:45.220536+0000","last_became_peered":"2024-03-30T13:10:45.220536+0000","last_unstale":"2024-03-30T13:10:47.249704+0000","last_undegraded":"2024-03-30T13:10:47.249704+0000","last_fullsized":"2024-03-30T13:10:47.249704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279358+0000","last_change":"2024-03-30T13:10:46.242980+0000","last_active":"2024-03-30T13:10:48.279358+0000","last_peered":"2024-03-30T13:10:48.279358+0000","last_clean":"2024-03-30T13:10:48.279358+0000","last_became_active":"2024-03-30T13:10:46.242702+0000","last_became_peered":"2024-03-30T13:10:46.242702+0000","last_unstale":"2024-03-30T13:10:48.279358+0000","last_undegraded":"2024-03-30T13:10:48.279358+0000","last_fullsized":"2024-03-30T13:10:48.279358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:42:22.008993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246344+0000","last_change":"2024-03-30T13:10:45.223223+0000","last_active":"2024-03-30T13:10:47.246344+0000","last_peered":"2024-03-30T13:10:47.246344+0000","last_clean":"2024-03-30T13:10:47.246344+0000","last_became_active":"2024-03-30T13:10:45.222887+0000","last_became_peered":"2024-03-30T13:10:45.222887+0000","last_unstale":"2024-03-30T13:10:47.246344+0000","last_undegraded":"2024-03-30T13:10:47.246344+0000","last_fullsized":"2024-03-30T13:10:47.246344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.992357+0000","last_change":"2024-03-30T13:10:46.254732+0000","last_active":"2024-03-30T13:10:47.992357+0000","last_peered":"2024-03-30T13:10:47.992357+0000","last_clean":"2024-03-30T13:10:47.992357+0000","last_became_active":"2024-03-30T13:10:46.254356+0000","last_became_peered":"2024-03-30T13:10:46.254356+0000","last_unstale":"2024-03-30T13:10:47.992357+0000","last_undegraded":"2024-03-30T13:10:47.992357+0000","last_fullsized":"2024-03-30T13:10:47.992357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:17.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250809+0000","last_change":"2024-03-30T13:10:45.224819+0000","last_active":"2024-03-30T13:10:47.250809+0000","last_peered":"2024-03-30T13:10:47.250809+0000","last_clean":"2024-03-30T13:10:47.250809+0000","last_became_active":"2024-03-30T13:10:45.223270+0000","last_became_peered":"2024-03-30T13:10:45.223270+0000","last_unstale":"2024-03-30T13:10:47.250809+0000","last_undegraded":"2024-03-30T13:10:47.250809+0000","last_fullsized":"2024-03-30T13:10:47.250809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:55.936652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246314+0000","last_change":"2024-03-30T13:10:46.254500+0000","last_active":"2024-03-30T13:10:47.246314+0000","last_peered":"2024-03-30T13:10:47.246314+0000","last_clean":"2024-03-30T13:10:47.246314+0000","last_became_active":"2024-03-30T13:10:46.254208+0000","last_became_peered":"2024-03-30T13:10:46.254208+0000","last_unstale":"2024-03-30T13:10:47.246314+0000","last_undegraded":"2024-03-30T13:10:47.246314+0000","last_fullsized":"2024-03-30T13:10:47.246314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:42.999062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282278+0000","last_change":"2024-03-30T13:10:45.225766+0000","last_active":"2024-03-30T13:10:48.282278+0000","last_peered":"2024-03-30T13:10:48.282278+0000","last_clean":"2024-03-30T13:10:48.282278+0000","last_became_active":"2024-03-30T13:10:45.225096+0000","last_became_peered":"2024-03-30T13:10:45.225096+0000","last_unstale":"2024-03-30T13:10:48.282278+0000","last_undegraded":"2024-03-30T13:10:48.282278+0000","last_fullsized":"2024-03-30T13:10:48.282278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246156+0000","last_change":"2024-03-30T13:10:46.255837+0000","last_active":"2024-03-30T13:10:47.246156+0000","last_peered":"2024-03-30T13:10:47.246156+0000","last_clean":"2024-03-30T13:10:47.246156+0000","last_became_active":"2024-03-30T13:10:46.251826+0000","last_became_peered":"2024-03-30T13:10:46.251826+0000","last_unstale":"2024-03-30T13:10:47.246156+0000","last_undegraded":"2024-03-30T13:10:47.246156+0000","last_fullsized":"2024-03-30T13:10:47.246156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:35:07.373323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248851+0000","last_change":"2024-03-30T13:10:45.210147+0000","last_active":"2024-03-30T13:10:47.248851+0000","last_peered":"2024-03-30T13:10:47.248851+0000","last_clean":"2024-03-30T13:10:47.248851+0000","last_became_active":"2024-03-30T13:10:45.209716+0000","last_became_peered":"2024-03-30T13:10:45.209716+0000","last_unstale":"2024-03-30T13:10:47.248851+0000","last_undegraded":"2024-03-30T13:10:47.248851+0000","last_fullsized":"2024-03-30T13:10:47.248851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:34.660273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279114+0000","last_change":"2024-03-30T13:10:46.244995+0000","last_active":"2024-03-30T13:10:48.279114+0000","last_peered":"2024-03-30T13:10:48.279114+0000","last_clean":"2024-03-30T13:10:48.279114+0000","last_became_active":"2024-03-30T13:10:46.244716+0000","last_became_peered":"2024-03-30T13:10:46.244716+0000","last_unstale":"2024-03-30T13:10:48.279114+0000","last_undegraded":"2024-03-30T13:10:48.279114+0000","last_fullsized":"2024-03-30T13:10:48.279114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:56.283461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242840+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:10:47.242840+0000","last_peered":"2024-03-30T13:10:47.242840+0000","last_clean":"2024-03-30T13:10:47.242840+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:10:47.242840+0000","last_undegraded":"2024-03-30T13:10:47.242840+0000","last_fullsized":"2024-03-30T13:10:47.242840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278834+0000","last_change":"2024-03-30T13:10:45.216758+0000","last_active":"2024-03-30T13:10:48.278834+0000","last_peered":"2024-03-30T13:10:48.278834+0000","last_clean":"2024-03-30T13:10:48.278834+0000","last_became_active":"2024-03-30T13:10:45.215040+0000","last_became_peered":"2024-03-30T13:10:45.215040+0000","last_unstale":"2024-03-30T13:10:48.278834+0000","last_undegraded":"2024-03-30T13:10:48.278834+0000","last_fullsized":"2024-03-30T13:10:48.278834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.089085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.249967+0000","last_change":"2024-03-30T13:10:46.243383+0000","last_active":"2024-03-30T13:10:47.249967+0000","last_peered":"2024-03-30T13:10:47.249967+0000","last_clean":"2024-03-30T13:10:47.249967+0000","last_became_active":"2024-03-30T13:10:46.243046+0000","last_became_peered":"2024-03-30T13:10:46.243046+0000","last_unstale":"2024-03-30T13:10:47.249967+0000","last_undegraded":"2024-03-30T13:10:47.249967+0000","last_fullsized":"2024-03-30T13:10:47.249967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:12:21.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278692+0000","last_change":"2024-03-30T13:10:45.221144+0000","last_active":"2024-03-30T13:10:48.278692+0000","last_peered":"2024-03-30T13:10:48.278692+0000","last_clean":"2024-03-30T13:10:48.278692+0000","last_became_active":"2024-03-30T13:10:45.219684+0000","last_became_peered":"2024-03-30T13:10:45.219684+0000","last_unstale":"2024-03-30T13:10:48.278692+0000","last_undegraded":"2024-03-30T13:10:48.278692+0000","last_fullsized":"2024-03-30T13:10:48.278692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:49.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.247995+0000","last_change":"2024-03-30T13:10:46.239001+0000","last_active":"2024-03-30T13:10:47.247995+0000","last_peered":"2024-03-30T13:10:47.247995+0000","last_clean":"2024-03-30T13:10:47.247995+0000","last_became_active":"2024-03-30T13:10:46.238750+0000","last_became_peered":"2024-03-30T13:10:46.238750+0000","last_unstale":"2024-03-30T13:10:47.247995+0000","last_undegraded":"2024-03-30T13:10:47.247995+0000","last_fullsized":"2024-03-30T13:10:47.247995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:10.102089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281626+0000","last_change":"2024-03-30T13:10:45.223067+0000","last_active":"2024-03-30T13:10:48.281626+0000","last_peered":"2024-03-30T13:10:48.281626+0000","last_clean":"2024-03-30T13:10:48.281626+0000","last_became_active":"2024-03-30T13:10:45.222778+0000","last_became_peered":"2024-03-30T13:10:45.222778+0000","last_unstale":"2024-03-30T13:10:48.281626+0000","last_undegraded":"2024-03-30T13:10:48.281626+0000","last_fullsized":"2024-03-30T13:10:48.281626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:35:37.871387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.280762+0000","last_change":"2024-03-30T13:10:46.246374+0000","last_active":"2024-03-30T13:10:48.280762+0000","last_peered":"2024-03-30T13:10:48.280762+0000","last_clean":"2024-03-30T13:10:48.280762+0000","last_became_active":"2024-03-30T13:10:46.246094+0000","last_became_peered":"2024-03-30T13:10:46.246094+0000","last_unstale":"2024-03-30T13:10:48.280762+0000","last_undegraded":"2024-03-30T13:10:48.280762+0000","last_fullsized":"2024-03-30T13:10:48.280762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:51:48.493992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279004+0000","last_change":"2024-03-30T13:10:45.220442+0000","last_active":"2024-03-30T13:10:48.279004+0000","last_peered":"2024-03-30T13:10:48.279004+0000","last_clean":"2024-03-30T13:10:48.279004+0000","last_became_active":"2024-03-30T13:10:45.219537+0000","last_became_peered":"2024-03-30T13:10:45.219537+0000","last_unstale":"2024-03-30T13:10:48.279004+0000","last_undegraded":"2024-03-30T13:10:48.279004+0000","last_fullsized":"2024-03-30T13:10:48.279004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:37.659793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246414+0000","last_change":"2024-03-30T13:10:46.249794+0000","last_active":"2024-03-30T13:10:47.246414+0000","last_peered":"2024-03-30T13:10:47.246414+0000","last_clean":"2024-03-30T13:10:47.246414+0000","last_became_active":"2024-03-30T13:10:46.249501+0000","last_became_peered":"2024-03-30T13:10:46.249501+0000","last_unstale":"2024-03-30T13:10:47.246414+0000","last_undegraded":"2024-03-30T13:10:47.246414+0000","last_fullsized":"2024-03-30T13:10:47.246414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:11:58.426124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281281+0000","last_change":"2024-03-30T13:10:45.225647+0000","last_active":"2024-03-30T13:10:48.281281+0000","last_peered":"2024-03-30T13:10:48.281281+0000","last_clean":"2024-03-30T13:10:48.281281+0000","last_became_active":"2024-03-30T13:10:45.225066+0000","last_became_peered":"2024-03-30T13:10:45.225066+0000","last_unstale":"2024-03-30T13:10:48.281281+0000","last_undegraded":"2024-03-30T13:10:48.281281+0000","last_fullsized":"2024-03-30T13:10:48.281281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.991763+0000","last_change":"2024-03-30T13:10:46.234204+0000","last_active":"2024-03-30T13:10:47.991763+0000","last_peered":"2024-03-30T13:10:47.991763+0000","last_clean":"2024-03-30T13:10:47.991763+0000","last_became_active":"2024-03-30T13:10:46.233876+0000","last_became_peered":"2024-03-30T13:10:46.233876+0000","last_unstale":"2024-03-30T13:10:47.991763+0000","last_undegraded":"2024-03-30T13:10:47.991763+0000","last_fullsized":"2024-03-30T13:10:47.991763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:19.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279290+0000","last_change":"2024-03-30T13:10:45.219517+0000","last_active":"2024-03-30T13:10:48.279290+0000","last_peered":"2024-03-30T13:10:48.279290+0000","last_clean":"2024-03-30T13:10:48.279290+0000","last_became_active":"2024-03-30T13:10:45.219201+0000","last_became_peered":"2024-03-30T13:10:45.219201+0000","last_unstale":"2024-03-30T13:10:48.279290+0000","last_undegraded":"2024-03-30T13:10:48.279290+0000","last_fullsized":"2024-03-30T13:10:48.279290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:27.406147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248726+0000","last_change":"2024-03-30T13:10:46.234095+0000","last_active":"2024-03-30T13:10:47.248726+0000","last_peered":"2024-03-30T13:10:47.248726+0000","last_clean":"2024-03-30T13:10:47.248726+0000","last_became_active":"2024-03-30T13:10:46.233686+0000","last_became_peered":"2024-03-30T13:10:46.233686+0000","last_unstale":"2024-03-30T13:10:47.248726+0000","last_undegraded":"2024-03-30T13:10:47.248726+0000","last_fullsized":"2024-03-30T13:10:47.248726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:43.599604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.253768+0000","last_change":"2024-03-30T13:10:45.216838+0000","last_active":"2024-03-30T13:10:47.253768+0000","last_peered":"2024-03-30T13:10:47.253768+0000","last_clean":"2024-03-30T13:10:47.253768+0000","last_became_active":"2024-03-30T13:10:45.216528+0000","last_became_peered":"2024-03-30T13:10:45.216528+0000","last_unstale":"2024-03-30T13:10:47.253768+0000","last_undegraded":"2024-03-30T13:10:47.253768+0000","last_fullsized":"2024-03-30T13:10:47.253768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251100+0000","last_change":"2024-03-30T13:10:46.243883+0000","last_active":"2024-03-30T13:10:47.251100+0000","last_peered":"2024-03-30T13:10:47.251100+0000","last_clean":"2024-03-30T13:10:47.251100+0000","last_became_active":"2024-03-30T13:10:46.243583+0000","last_became_peered":"2024-03-30T13:10:46.243583+0000","last_unstale":"2024-03-30T13:10:47.251100+0000","last_undegraded":"2024-03-30T13:10:47.251100+0000","last_fullsized":"2024-03-30T13:10:47.251100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:30.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279909+0000","last_change":"2024-03-30T13:10:45.219656+0000","last_active":"2024-03-30T13:10:48.279909+0000","last_peered":"2024-03-30T13:10:48.279909+0000","last_clean":"2024-03-30T13:10:48.279909+0000","last_became_active":"2024-03-30T13:10:45.219347+0000","last_became_peered":"2024-03-30T13:10:45.219347+0000","last_unstale":"2024-03-30T13:10:48.279909+0000","last_undegraded":"2024-03-30T13:10:48.279909+0000","last_fullsized":"2024-03-30T13:10:48.279909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:41:37.075782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250903+0000","last_change":"2024-03-30T13:10:46.248800+0000","last_active":"2024-03-30T13:10:47.250903+0000","last_peered":"2024-03-30T13:10:47.250903+0000","last_clean":"2024-03-30T13:10:47.250903+0000","last_became_active":"2024-03-30T13:10:46.248344+0000","last_became_peered":"2024-03-30T13:10:46.248344+0000","last_unstale":"2024-03-30T13:10:47.250903+0000","last_undegraded":"2024-03-30T13:10:47.250903+0000","last_fullsized":"2024-03-30T13:10:47.250903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:15.009575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.245338+0000","last_change":"2024-03-30T13:10:45.210402+0000","last_active":"2024-03-30T13:10:47.245338+0000","last_peered":"2024-03-30T13:10:47.245338+0000","last_clean":"2024-03-30T13:10:47.245338+0000","last_became_active":"2024-03-30T13:10:45.210107+0000","last_became_peered":"2024-03-30T13:10:45.210107+0000","last_unstale":"2024-03-30T13:10:47.245338+0000","last_undegraded":"2024-03-30T13:10:47.245338+0000","last_fullsized":"2024-03-30T13:10:47.245338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:21:09.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279223+0000","last_change":"2024-03-30T13:10:46.241705+0000","last_active":"2024-03-30T13:10:48.279223+0000","last_peered":"2024-03-30T13:10:48.279223+0000","last_clean":"2024-03-30T13:10:48.279223+0000","last_became_active":"2024-03-30T13:10:46.241327+0000","last_became_peered":"2024-03-30T13:10:46.241327+0000","last_unstale":"2024-03-30T13:10:48.279223+0000","last_undegraded":"2024-03-30T13:10:48.279223+0000","last_fullsized":"2024-03-30T13:10:48.279223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:05:58.972097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250156+0000","last_change":"2024-03-30T13:10:45.223756+0000","last_active":"2024-03-30T13:10:47.250156+0000","last_peered":"2024-03-30T13:10:47.250156+0000","last_clean":"2024-03-30T13:10:47.250156+0000","last_became_active":"2024-03-30T13:10:45.222236+0000","last_became_peered":"2024-03-30T13:10:45.222236+0000","last_unstale":"2024-03-30T13:10:47.250156+0000","last_undegraded":"2024-03-30T13:10:47.250156+0000","last_fullsized":"2024-03-30T13:10:47.250156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.250500+0000","last_change":"2024-03-30T13:10:46.250939+0000","last_active":"2024-03-30T13:10:47.250500+0000","last_peered":"2024-03-30T13:10:47.250500+0000","last_clean":"2024-03-30T13:10:47.250500+0000","last_became_active":"2024-03-30T13:10:46.250651+0000","last_became_peered":"2024-03-30T13:10:46.250651+0000","last_unstale":"2024-03-30T13:10:47.250500+0000","last_undegraded":"2024-03-30T13:10:47.250500+0000","last_fullsized":"2024-03-30T13:10:47.250500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:47:22.461322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.248428+0000","last_change":"2024-03-30T13:10:45.222799+0000","last_active":"2024-03-30T13:10:47.248428+0000","last_peered":"2024-03-30T13:10:47.248428+0000","last_clean":"2024-03-30T13:10:47.248428+0000","last_became_active":"2024-03-30T13:10:45.221899+0000","last_became_peered":"2024-03-30T13:10:45.221899+0000","last_unstale":"2024-03-30T13:10:47.248428+0000","last_undegraded":"2024-03-30T13:10:47.248428+0000","last_fullsized":"2024-03-30T13:10:47.248428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282295+0000","last_change":"2024-03-30T13:10:46.245047+0000","last_active":"2024-03-30T13:10:48.282295+0000","last_peered":"2024-03-30T13:10:48.282295+0000","last_clean":"2024-03-30T13:10:48.282295+0000","last_became_active":"2024-03-30T13:10:46.244170+0000","last_became_peered":"2024-03-30T13:10:46.244170+0000","last_unstale":"2024-03-30T13:10:48.282295+0000","last_undegraded":"2024-03-30T13:10:48.282295+0000","last_fullsized":"2024-03-30T13:10:48.282295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:53:32.633100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278786+0000","last_change":"2024-03-30T13:10:45.215312+0000","last_active":"2024-03-30T13:10:48.278786+0000","last_peered":"2024-03-30T13:10:48.278786+0000","last_clean":"2024-03-30T13:10:48.278786+0000","last_became_active":"2024-03-30T13:10:45.214701+0000","last_became_peered":"2024-03-30T13:10:45.214701+0000","last_unstale":"2024-03-30T13:10:48.278786+0000","last_undegraded":"2024-03-30T13:10:48.278786+0000","last_fullsized":"2024-03-30T13:10:48.278786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:16.903426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.278902+0000","last_change":"2024-03-30T13:10:46.245626+0000","last_active":"2024-03-30T13:10:48.278902+0000","last_peered":"2024-03-30T13:10:48.278902+0000","last_clean":"2024-03-30T13:10:48.278902+0000","last_became_active":"2024-03-30T13:10:46.245360+0000","last_became_peered":"2024-03-30T13:10:46.245360+0000","last_unstale":"2024-03-30T13:10:48.278902+0000","last_undegraded":"2024-03-30T13:10:48.278902+0000","last_fullsized":"2024-03-30T13:10:48.278902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:55:33.498408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.279107+0000","last_change":"2024-03-30T13:10:46.255467+0000","last_active":"2024-03-30T13:10:48.279107+0000","last_peered":"2024-03-30T13:10:48.279107+0000","last_clean":"2024-03-30T13:10:48.279107+0000","last_became_active":"2024-03-30T13:10:46.254974+0000","last_became_peered":"2024-03-30T13:10:46.254974+0000","last_unstale":"2024-03-30T13:10:48.279107+0000","last_undegraded":"2024-03-30T13:10:48.279107+0000","last_fullsized":"2024-03-30T13:10:48.279107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:52:10.233229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246199+0000","last_change":"2024-03-30T13:10:45.203155+0000","last_active":"2024-03-30T13:10:47.246199+0000","last_peered":"2024-03-30T13:10:47.246199+0000","last_clean":"2024-03-30T13:10:47.246199+0000","last_became_active":"2024-03-30T13:10:45.202582+0000","last_became_peered":"2024-03-30T13:10:45.202582+0000","last_unstale":"2024-03-30T13:10:47.246199+0000","last_undegraded":"2024-03-30T13:10:47.246199+0000","last_fullsized":"2024-03-30T13:10:47.246199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:49.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.242997+0000","last_change":"2024-03-30T13:10:46.260566+0000","last_active":"2024-03-30T13:10:47.242997+0000","last_peered":"2024-03-30T13:10:47.242997+0000","last_clean":"2024-03-30T13:10:47.242997+0000","last_became_active":"2024-03-30T13:10:46.260117+0000","last_became_peered":"2024-03-30T13:10:46.260117+0000","last_unstale":"2024-03-30T13:10:47.242997+0000","last_undegraded":"2024-03-30T13:10:47.242997+0000","last_fullsized":"2024-03-30T13:10:47.242997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:45:58.607723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.246060+0000","last_change":"2024-03-30T13:10:45.206209+0000","last_active":"2024-03-30T13:10:47.246060+0000","last_peered":"2024-03-30T13:10:47.246060+0000","last_clean":"2024-03-30T13:10:47.246060+0000","last_became_active":"2024-03-30T13:10:45.203095+0000","last_became_peered":"2024-03-30T13:10:45.203095+0000","last_unstale":"2024-03-30T13:10:47.246060+0000","last_undegraded":"2024-03-30T13:10:47.246060+0000","last_fullsized":"2024-03-30T13:10:47.246060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:55.968012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.281962+0000","last_change":"2024-03-30T13:10:46.249303+0000","last_active":"2024-03-30T13:10:48.281962+0000","last_peered":"2024-03-30T13:10:48.281962+0000","last_clean":"2024-03-30T13:10:48.281962+0000","last_became_active":"2024-03-30T13:10:46.248971+0000","last_became_peered":"2024-03-30T13:10:46.248971+0000","last_unstale":"2024-03-30T13:10:48.281962+0000","last_undegraded":"2024-03-30T13:10:48.281962+0000","last_fullsized":"2024-03-30T13:10:48.281962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:06:44.453747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282831+0000","last_change":"2024-03-30T13:10:45.222811+0000","last_active":"2024-03-30T13:10:48.282831+0000","last_peered":"2024-03-30T13:10:48.282831+0000","last_clean":"2024-03-30T13:10:48.282831+0000","last_became_active":"2024-03-30T13:10:45.222439+0000","last_became_peered":"2024-03-30T13:10:45.222439+0000","last_unstale":"2024-03-30T13:10:48.282831+0000","last_undegraded":"2024-03-30T13:10:48.282831+0000","last_fullsized":"2024-03-30T13:10:48.282831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:48.282474+0000","last_change":"2024-03-30T13:10:46.242067+0000","last_active":"2024-03-30T13:10:48.282474+0000","last_peered":"2024-03-30T13:10:48.282474+0000","last_clean":"2024-03-30T13:10:48.282474+0000","last_became_active":"2024-03-30T13:10:46.241783+0000","last_became_peered":"2024-03-30T13:10:46.241783+0000","last_unstale":"2024-03-30T13:10:48.282474+0000","last_undegraded":"2024-03-30T13:10:48.282474+0000","last_fullsized":"2024-03-30T13:10:48.282474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:45.173911+0000","last_clean_scrub_stamp":"2024-03-30T13:10:45.173911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:48:19.069506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-30T13:10:47.251193+0000","last_change":"2024-03-30T13:10:45.221172+0000","last_active":"2024-03-30T13:10:47.251193+0000","last_peered":"2024-03-30T13:10:47.251193+0000","last_clean":"2024-03-30T13:10:47.251193+0000","last_became_active":"2024-03-30T13:10:45.220799+0000","last_became_peered":"2024-03-30T13:10:45.220799+0000","last_unstale":"2024-03-30T13:10:47.251193+0000","last_undegraded":"2024-03-30T13:10:47.251193+0000","last_fullsized":"2024-03-30T13:10:47.251193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:44.160907+0000","last_clean_scrub_stamp":"2024-03-30T13:10:44.160907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:05:37.078711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476744,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":665602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":77448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:11:02.290 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-30T13:11:02.290 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-30T13:11:02.290 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-30T13:11:02.290 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-30T13:11:02.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.522+0000 7ff6e0400640 1 Processor -- start 2024-03-30T13:11:02.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.522+0000 7ff6e0400640 1 -- start start 2024-03-30T13:11:02.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.523+0000 7ff6e0400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6d815e860 0x7ff6d80d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.523+0000 7ff6e0400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff6d80cca80 0x7ff6d80ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.523+0000 7ff6e0400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d815ec40 con 0x7ff6d80d10d0 2024-03-30T13:11:02.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.523+0000 7ff6e0400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d8070140 con 0x7ff6d815e860 2024-03-30T13:11:02.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.523+0000 7ff6e0400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d80d15d0 con 0x7ff6d80cca80 2024-03-30T13:11:02.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.523+0000 7ff6dda00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6d815e860 0x7ff6d80d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:02.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.523+0000 7ff6dda00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6d815e860 0x7ff6d80d2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38634/0 (socket says 172.21.15.99:38634) 2024-03-30T13:11:02.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.523+0000 7ff6dda00640 1 -- 172.21.15.99:0/3699600747 learned_addr learned my addr 172.21.15.99:0/3699600747 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:02.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.524+0000 7ff6dda00640 1 -- 172.21.15.99:0/3699600747 >> v2:172.21.15.181:3300/0 conn(0x7ff6d80cca80 msgr2=0x7ff6d80ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:02.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.524+0000 7ff6dda00640 1 --2- 172.21.15.99:0/3699600747 >> v2:172.21.15.181:3300/0 conn(0x7ff6d80cca80 0x7ff6d80ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.524+0000 7ff6dda00640 1 -- 172.21.15.99:0/3699600747 >> v1:172.21.15.99:6789/0 conn(0x7ff6d80d10d0 legacy=0x7ff6d80705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:02.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.524+0000 7ff6dda00640 1 -- 172.21.15.99:0/3699600747 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d80d18b0 con 0x7ff6d815e860 2024-03-30T13:11:02.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.524+0000 7ff6d7e00640 1 -- 172.21.15.99:0/3699600747 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335217106 0 0) 0x7ff6d815ec40 con 0x7ff6d80d10d0 2024-03-30T13:11:02.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.525+0000 7ff6dda00640 1 --2- 172.21.15.99:0/3699600747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d815e860 0x7ff6d80d2f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80735e0 tx=0x7ff6cc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a2d014478c00d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:02.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.525+0000 7ff6d7e00640 1 -- 172.21.15.99:0/3699600747 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc02cb20 con 0x7ff6d815e860 2024-03-30T13:11:02.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.525+0000 7ff6d7e00640 1 -- 172.21.15.99:0/3699600747 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc02ccc0 con 0x7ff6d815e860 2024-03-30T13:11:02.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.525+0000 7ff6d7e00640 1 -- 172.21.15.99:0/3699600747 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc034610 con 0x7ff6d815e860 2024-03-30T13:11:02.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.526+0000 7ff6e0400640 1 -- 172.21.15.99:0/3699600747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d815e860 msgr2=0x7ff6d80d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:02.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.526+0000 7ff6e0400640 1 --2- 172.21.15.99:0/3699600747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d815e860 0x7ff6d80d2f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80735e0 tx=0x7ff6cc02bf80 comp rx=0 tx=0).stop 2024-03-30T13:11:02.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.526+0000 7ff6e0400640 1 -- 172.21.15.99:0/3699600747 shutdown_connections 2024-03-30T13:11:02.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.526+0000 7ff6e0400640 1 --2- 172.21.15.99:0/3699600747 >> v2:172.21.15.181:3300/0 conn(0x7ff6d80cca80 0x7ff6d80ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.526+0000 7ff6e0400640 1 --2- 172.21.15.99:0/3699600747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d815e860 0x7ff6d80d2f50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.526+0000 7ff6e0400640 1 -- 172.21.15.99:0/3699600747 >> 172.21.15.99:0/3699600747 conn(0x7ff6d80d2430 msgr2=0x7ff6d80d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:02.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.526+0000 7ff6e0400640 1 -- 172.21.15.99:0/3699600747 shutdown_connections 2024-03-30T13:11:02.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.526+0000 7ff6e0400640 1 -- 172.21.15.99:0/3699600747 wait complete. 2024-03-30T13:11:02.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.529+0000 7ff6e0400640 1 Processor -- start 2024-03-30T13:11:02.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.529+0000 7ff6e0400640 1 -- start start 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.530+0000 7ff6e0400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d80cca80 0x7ff6d80b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.530+0000 7ff6e0400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6d80d10d0 0x7ff6d8157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.530+0000 7ff6e0400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6d815e860 0x7ff6d80c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.530+0000 7ff6e0400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8163090 con 0x7ff6d80cca80 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.530+0000 7ff6e0400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d806fdd0 con 0x7ff6d815e860 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.530+0000 7ff6e0400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d8070ce0 con 0x7ff6d80d10d0 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.530+0000 7ff6dda00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d80cca80 0x7ff6d80b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.531+0000 7ff6dda00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d80cca80 0x7ff6d80b4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38642/0 (socket says 172.21.15.99:38642) 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.531+0000 7ff6dda00640 1 -- 172.21.15.99:0/2497748202 learned_addr learned my addr 172.21.15.99:0/2497748202 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.531+0000 7ff6dd000640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6d80d10d0 0x7ff6d8157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.531+0000 7ff6dda00640 1 -- 172.21.15.99:0/2497748202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6d80d10d0 msgr2=0x7ff6d8157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.531+0000 7ff6de400640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6d815e860 0x7ff6d80c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:02.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.531+0000 7ff6dda00640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6d80d10d0 0x7ff6d8157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.531+0000 7ff6dda00640 1 -- 172.21.15.99:0/2497748202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6d815e860 msgr2=0x7ff6d80c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:02.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.531+0000 7ff6dda00640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6d815e860 0x7ff6d80c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.531+0000 7ff6dda00640 1 -- 172.21.15.99:0/2497748202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d81e8120 con 0x7ff6d80cca80 2024-03-30T13:11:02.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.531+0000 7ff6dda00640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d80cca80 0x7ff6d80b4ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000f80 tx=0x7ff6cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:02.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.532+0000 7ff6d5600640 1 -- 172.21.15.99:0/2497748202 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc043020 con 0x7ff6d80cca80 2024-03-30T13:11:02.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.532+0000 7ff6d5600640 1 -- 172.21.15.99:0/2497748202 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc03e450 con 0x7ff6d80cca80 2024-03-30T13:11:02.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.532+0000 7ff6d5600640 1 -- 172.21.15.99:0/2497748202 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc009510 con 0x7ff6d80cca80 2024-03-30T13:11:02.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.532+0000 7ff6e0400640 1 -- 172.21.15.99:0/2497748202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d81e8400 con 0x7ff6d80cca80 2024-03-30T13:11:02.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.532+0000 7ff6e0400640 1 -- 172.21.15.99:0/2497748202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d81e89c0 con 0x7ff6d80cca80 2024-03-30T13:11:02.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.533+0000 7ff6e0400640 1 -- 172.21.15.99:0/2497748202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d8068640 con 0x7ff6d80cca80 2024-03-30T13:11:02.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.534+0000 7ff6d5600640 1 -- 172.21.15.99:0/2497748202 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff6cc046020 con 0x7ff6d80cca80 2024-03-30T13:11:02.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.535+0000 7ff6d5600640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff6b806c530 0x7ff6b806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:02.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.535+0000 7ff6d5600640 1 -- 172.21.15.99:0/2497748202 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff6cc0ae0c0 con 0x7ff6d80cca80 2024-03-30T13:11:02.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.535+0000 7ff6dd000640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff6b806c530 0x7ff6b806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:02.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.536+0000 7ff6dd000640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff6b806c530 0x7ff6b806e9f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80b7f30 tx=0x7ff6c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:02.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.539+0000 7ff6d5600640 1 -- 172.21.15.99:0/2497748202 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff6cc04d030 con 0x7ff6d80cca80 2024-03-30T13:11:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.778+0000 7ff6e0400640 1 -- 172.21.15.99:0/2497748202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff6d81e8b90 con 0x7ff6d80cca80 2024-03-30T13:11:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.779+0000 7ff6d5600640 1 -- 172.21.15.99:0/2497748202 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff6cc07c6d0 con 0x7ff6d80cca80 2024-03-30T13:11:02.782 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:02.783 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-30T13:11:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.781+0000 7ff6e0400640 1 -- 172.21.15.99:0/2497748202 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff6b806c530 msgr2=0x7ff6b806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.781+0000 7ff6e0400640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff6b806c530 0x7ff6b806e9f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80b7f30 tx=0x7ff6c4009040 comp rx=0 tx=0).stop 2024-03-30T13:11:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.781+0000 7ff6e0400640 1 -- 172.21.15.99:0/2497748202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d80cca80 msgr2=0x7ff6d80b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.781+0000 7ff6e0400640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d80cca80 0x7ff6d80b4ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000f80 tx=0x7ff6cc004a40 comp rx=0 tx=0).stop 2024-03-30T13:11:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.781+0000 7ff6e0400640 1 -- 172.21.15.99:0/2497748202 shutdown_connections 2024-03-30T13:11:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.781+0000 7ff6e0400640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff6b806c530 0x7ff6b806e9f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.781+0000 7ff6e0400640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6d815e860 0x7ff6d80c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.781+0000 7ff6e0400640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6d80d10d0 0x7ff6d8157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.781+0000 7ff6e0400640 1 --2- 172.21.15.99:0/2497748202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d80cca80 0x7ff6d80b4ea0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.781+0000 7ff6e0400640 1 -- 172.21.15.99:0/2497748202 >> 172.21.15.99:0/2497748202 conn(0x7ff6d80d2430 msgr2=0x7ff6d80b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.782+0000 7ff6e0400640 1 -- 172.21.15.99:0/2497748202 shutdown_connections 2024-03-30T13:11:02.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:02.782+0000 7ff6e0400640 1 -- 172.21.15.99:0/2497748202 wait complete. 2024-03-30T13:11:02.802 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-30T13:11:02.802 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:03.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.029+0000 7f6f75400640 1 Processor -- start 2024-03-30T13:11:03.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.030+0000 7f6f75400640 1 -- start start 2024-03-30T13:11:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.031+0000 7f6f75400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f7006f060 0x7f6f7006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.031+0000 7f6f75400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f70146230 con 0x7f6f700ad940 2024-03-30T13:11:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.031+0000 7f6f75400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7006dfc0 con 0x7f6f7015c670 2024-03-30T13:11:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.031+0000 7f6f75400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6f7006e2a0 con 0x7f6f7006f060 2024-03-30T13:11:03.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.031+0000 7f6f6de00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6f700ad940 0x7f6f700b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56748/0 (socket says 172.21.15.99:56748) 2024-03-30T13:11:03.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.031+0000 7f6f6de00640 1 -- 172.21.15.99:0/2403832553 learned_addr learned my addr 172.21.15.99:0/2403832553 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404383180 0 0) 0x7f6f58001490 con 0x7f6f700ad940 2024-03-30T13:11:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6f200640 1 --2- 172.21.15.99:0/2403832553 >> v2:172.21.15.181:3300/0 conn(0x7f6f7006f060 0x7f6f7006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f50003520 con 0x7f6f700ad940 2024-03-30T13:11:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 769631615 0 0) 0x7f6f50003520 con 0x7f6f700ad940 2024-03-30T13:11:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 >> v2:172.21.15.181:3300/0 conn(0x7f6f7006f060 msgr2=0x7f6f7006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 --2- 172.21.15.99:0/2403832553 >> v2:172.21.15.181:3300/0 conn(0x7f6f7006f060 0x7f6f7006c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 >> v1:172.21.15.181:6789/0 conn(0x7f6f7015c670 legacy=0x7f6f700ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7006e580 con 0x7f6f700ad940 2024-03-30T13:11:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f6f58001bc0 con 0x7f6f700ad940 2024-03-30T13:11:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 >> v1:172.21.15.99:6789/0 conn(0x7f6f700ad940 legacy=0x7f6f700b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f500039b0 0x7f6f50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 0x7f6f50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f500052e0 0x7f6f5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7006e2a0 con 0x7f6f50004800 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5000c1b0 con 0x7f6f500052e0 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.032+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5000c3b0 con 0x7f6f500039b0 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.033+0000 7f6f6de00640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 0x7f6f50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.033+0000 7f6f6f200640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f500052e0 0x7f6f5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.033+0000 7f6f6e800640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f500039b0 0x7f6f50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.033+0000 7f6f6de00640 1 -- 172.21.15.99:0/2403832553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f500039b0 msgr2=0x7f6f50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.033+0000 7f6f6de00640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f500039b0 0x7f6f50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.033+0000 7f6f6de00640 1 -- 172.21.15.99:0/2403832553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f500052e0 msgr2=0x7f6f5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.033+0000 7f6f6de00640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f500052e0 0x7f6f5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.033+0000 7f6f6de00640 1 -- 172.21.15.99:0/2403832553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f50003520 con 0x7f6f50004800 2024-03-30T13:11:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.033+0000 7f6f6f200640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f500052e0 0x7f6f5000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.033+0000 7f6f6f200640 1 -- 172.21.15.99:0/2403832553 reap_dead start 2024-03-30T13:11:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.033+0000 7f6f6e800640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f500039b0 0x7f6f50003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.034+0000 7f6f6de00640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 0x7f6f50004c80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800aa20 tx=0x7f6f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b687f2bbd48526c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:03.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.034+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58038070 con 0x7f6f50004800 2024-03-30T13:11:03.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.034+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f58033620 con 0x7f6f50004800 2024-03-30T13:11:03.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.034+0000 7f6f6d400640 1 -- 172.21.15.99:0/2403832553 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5800a670 con 0x7f6f50004800 2024-03-30T13:11:03.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.035+0000 7f6f75400640 1 -- 172.21.15.99:0/2403832553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 msgr2=0x7f6f50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.035+0000 7f6f75400640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 0x7f6f50004c80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800aa20 tx=0x7f6f50005830 comp rx=0 tx=0).stop 2024-03-30T13:11:03.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.035+0000 7f6f75400640 1 -- 172.21.15.99:0/2403832553 shutdown_connections 2024-03-30T13:11:03.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.035+0000 7f6f75400640 1 --2- 172.21.15.99:0/2403832553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 0x7f6f50004c80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.035+0000 7f6f75400640 1 -- 172.21.15.99:0/2403832553 >> 172.21.15.99:0/2403832553 conn(0x7f6f7006b510 msgr2=0x7f6f7006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:03.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.035+0000 7f6f75400640 1 -- 172.21.15.99:0/2403832553 shutdown_connections 2024-03-30T13:11:03.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.035+0000 7f6f75400640 1 -- 172.21.15.99:0/2403832553 wait complete. 2024-03-30T13:11:03.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.037+0000 7f6f75400640 1 Processor -- start 2024-03-30T13:11:03.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.037+0000 7f6f75400640 1 -- start start 2024-03-30T13:11:03.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f75400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 0x7f6f700ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f75400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f701f4310 0x7f6f700718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f75400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f70071e10 0x7f6f70072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f75400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7006c030 con 0x7f6f50004800 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f75400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7015ca50 con 0x7f6f701f4310 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f75400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7006c1b0 con 0x7f6f70071e10 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f6e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 0x7f6f700ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f6e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 0x7f6f700ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38664/0 (socket says 172.21.15.99:38664) 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f6e800640 1 -- 172.21.15.99:0/3056378262 learned_addr learned my addr 172.21.15.99:0/3056378262 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f6e800640 1 -- 172.21.15.99:0/3056378262 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f70071e10 msgr2=0x7f6f70072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f6e800640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f70071e10 0x7f6f70072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f6e800640 1 -- 172.21.15.99:0/3056378262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f701f4310 msgr2=0x7f6f700718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f6e800640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f701f4310 0x7f6f700718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.038+0000 7f6f6e800640 1 -- 172.21.15.99:0/3056378262 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f700cbe50 con 0x7f6f50004800 2024-03-30T13:11:03.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.039+0000 7f6f6e800640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 0x7f6f700ca010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000d4b0 tx=0x7f6f6000d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.039+0000 7f6f66a00640 1 -- 172.21.15.99:0/3056378262 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60005480 con 0x7f6f50004800 2024-03-30T13:11:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.039+0000 7f6f66a00640 1 -- 172.21.15.99:0/3056378262 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f60017070 con 0x7f6f50004800 2024-03-30T13:11:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.039+0000 7f6f66a00640 1 -- 172.21.15.99:0/3056378262 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60003830 con 0x7f6f50004800 2024-03-30T13:11:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.039+0000 7f6f75400640 1 -- 172.21.15.99:0/3056378262 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f700cc130 con 0x7f6f50004800 2024-03-30T13:11:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.039+0000 7f6f75400640 1 -- 172.21.15.99:0/3056378262 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f700cbb20 con 0x7f6f50004800 2024-03-30T13:11:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.041+0000 7f6f75400640 1 -- 172.21.15.99:0/3056378262 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f70068640 con 0x7f6f50004800 2024-03-30T13:11:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.041+0000 7f6f66a00640 1 -- 172.21.15.99:0/3056378262 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6f600039d0 con 0x7f6f50004800 2024-03-30T13:11:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.042+0000 7f6f66a00640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f4c06c530 0x7f6f4c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.042+0000 7f6f66a00640 1 -- 172.21.15.99:0/3056378262 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6f6008b580 con 0x7f6f50004800 2024-03-30T13:11:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.042+0000 7f6f6de00640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f4c06c530 0x7f6f4c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.043+0000 7f6f6de00640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f4c06c530 0x7f6f4c06e9f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f50004780 tx=0x7f6f58009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.046+0000 7f6f66a00640 1 -- 172.21.15.99:0/3056378262 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6f60059bc0 con 0x7f6f50004800 2024-03-30T13:11:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.351+0000 7f6f75400640 1 -- 172.21.15.99:0/3056378262 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f700cf700 con 0x7f6f50004800 2024-03-30T13:11:03.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.354+0000 7f6f66a00640 1 -- 172.21.15.99:0/3056378262 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16609 (secure 0 0 0) 0x7f6f600594c0 con 0x7f6f50004800 2024-03-30T13:11:03.358 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:03.359 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":22,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:47.229108+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:03.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 -- 172.21.15.99:0/3056378262 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f4c06c530 msgr2=0x7f6f4c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f4c06c530 0x7f6f4c06e9f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f50004780 tx=0x7f6f58009030 comp rx=0 tx=0).stop 2024-03-30T13:11:03.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 -- 172.21.15.99:0/3056378262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 msgr2=0x7f6f700ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 0x7f6f700ca010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000d4b0 tx=0x7f6f6000d970 comp rx=0 tx=0).stop 2024-03-30T13:11:03.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 -- 172.21.15.99:0/3056378262 shutdown_connections 2024-03-30T13:11:03.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f4c06c530 0x7f6f4c06e9f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f70071e10 0x7f6f70072290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f701f4310 0x7f6f700718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 --2- 172.21.15.99:0/3056378262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50004800 0x7f6f700ca010 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 -- 172.21.15.99:0/3056378262 >> 172.21.15.99:0/3056378262 conn(0x7f6f7006b510 msgr2=0x7f6f700b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:03.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 -- 172.21.15.99:0/3056378262 shutdown_connections 2024-03-30T13:11:03.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.357+0000 7f6f75400640 1 -- 172.21.15.99:0/3056378262 wait complete. 2024-03-30T13:11:03.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:03.381 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.573+0000 7f8f6ba00640 1 Processor -- start 2024-03-30T13:11:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.573+0000 7f8f6ba00640 1 -- start start 2024-03-30T13:11:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f6ba00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8f64156cf0 0x7f8f640ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f6ba00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f6406cc30 0x7f8f641602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f6ba00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f64073080 con 0x7f8f64072b30 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f6ba00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8f6415d500 con 0x7f8f64156cf0 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f6ba00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8f6415ceb0 con 0x7f8f6406cc30 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f69000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8f64156cf0 0x7f8f640ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f69000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8f64156cf0 0x7f8f640ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38676/0 (socket says 172.21.15.99:38676) 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f69000640 1 -- 172.21.15.99:0/4199923579 learned_addr learned my addr 172.21.15.99:0/4199923579 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f63e00640 1 --1- 172.21.15.99:0/4199923579 >> v1:172.21.15.99:6789/0 conn(0x7f8f64072b30 0x7f8f6406c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56756/0 (socket says 172.21.15.99:56756) 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f69000640 1 -- 172.21.15.99:0/4199923579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f6406cc30 msgr2=0x7f8f641602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f69000640 1 --2- 172.21.15.99:0/4199923579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f6406cc30 0x7f8f641602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f69000640 1 -- 172.21.15.99:0/4199923579 >> v1:172.21.15.99:6789/0 conn(0x7f8f64072b30 legacy=0x7f8f6406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.576+0000 7f8f63400640 1 -- 172.21.15.99:0/4199923579 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462233168 0 0) 0x7f8f64073080 con 0x7f8f64072b30 2024-03-30T13:11:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.577+0000 7f8f69000640 1 -- 172.21.15.99:0/4199923579 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6415d190 con 0x7f8f64156cf0 2024-03-30T13:11:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.578+0000 7f8f69000640 1 --2- 172.21.15.99:0/4199923579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f64156cf0 0x7f8f640ce1e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009870 tx=0x7f8f5802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde19450921dc680 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.578+0000 7f8f63400640 1 -- 172.21.15.99:0/4199923579 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58034070 con 0x7f8f64156cf0 2024-03-30T13:11:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.578+0000 7f8f63400640 1 -- 172.21.15.99:0/4199923579 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f58030840 con 0x7f8f64156cf0 2024-03-30T13:11:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.578+0000 7f8f63400640 1 -- 172.21.15.99:0/4199923579 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58030c10 con 0x7f8f64156cf0 2024-03-30T13:11:03.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.579+0000 7f8f6ba00640 1 -- 172.21.15.99:0/4199923579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f64156cf0 msgr2=0x7f8f640ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.579+0000 7f8f6ba00640 1 --2- 172.21.15.99:0/4199923579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f64156cf0 0x7f8f640ce1e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009870 tx=0x7f8f5802b980 comp rx=0 tx=0).stop 2024-03-30T13:11:03.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.579+0000 7f8f6ba00640 1 -- 172.21.15.99:0/4199923579 shutdown_connections 2024-03-30T13:11:03.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.579+0000 7f8f6ba00640 1 --2- 172.21.15.99:0/4199923579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f6406cc30 0x7f8f641602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.579+0000 7f8f6ba00640 1 --2- 172.21.15.99:0/4199923579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f64156cf0 0x7f8f640ce1e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.579+0000 7f8f6ba00640 1 -- 172.21.15.99:0/4199923579 >> 172.21.15.99:0/4199923579 conn(0x7f8f64072010 msgr2=0x7f8f64072420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.579+0000 7f8f6ba00640 1 -- 172.21.15.99:0/4199923579 shutdown_connections 2024-03-30T13:11:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.579+0000 7f8f6ba00640 1 -- 172.21.15.99:0/4199923579 wait complete. 2024-03-30T13:11:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.580+0000 7f8f6ba00640 1 Processor -- start 2024-03-30T13:11:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.581+0000 7f8f6ba00640 1 -- start start 2024-03-30T13:11:03.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.581+0000 7f8f6ba00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f6406cc30 0x7f8f6415b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.581+0000 7f8f6ba00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f64072b30 0x7f8f64155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.581+0000 7f8f6ba00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f64156cf0 0x7f8f64155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f6ba00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8f64067590 con 0x7f8f64072b30 2024-03-30T13:11:03.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f6ba00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8f64067410 con 0x7f8f6406cc30 2024-03-30T13:11:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f6ba00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8f6415d990 con 0x7f8f64156cf0 2024-03-30T13:11:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f63e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f64072b30 0x7f8f64155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f63e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f64072b30 0x7f8f64155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38686/0 (socket says 172.21.15.99:38686) 2024-03-30T13:11:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f63e00640 1 -- 172.21.15.99:0/2179968498 learned_addr learned my addr 172.21.15.99:0/2179968498 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f69000640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f6406cc30 0x7f8f6415b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f69a00640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f64156cf0 0x7f8f64155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f63e00640 1 -- 172.21.15.99:0/2179968498 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f64156cf0 msgr2=0x7f8f64155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f63e00640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f64156cf0 0x7f8f64155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f63e00640 1 -- 172.21.15.99:0/2179968498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f6406cc30 msgr2=0x7f8f6415b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f63e00640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f6406cc30 0x7f8f6415b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f63e00640 1 -- 172.21.15.99:0/2179968498 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f64158580 con 0x7f8f64072b30 2024-03-30T13:11:03.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.582+0000 7f8f63e00640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f64072b30 0x7f8f64155030 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000c4e0 tx=0x7f8f5000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:03.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.583+0000 7f8f60c00640 1 -- 172.21.15.99:0/2179968498 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f50018070 con 0x7f8f64072b30 2024-03-30T13:11:03.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.583+0000 7f8f60c00640 1 -- 172.21.15.99:0/2179968498 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f50007500 con 0x7f8f64072b30 2024-03-30T13:11:03.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.583+0000 7f8f60c00640 1 -- 172.21.15.99:0/2179968498 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f50004a20 con 0x7f8f64072b30 2024-03-30T13:11:03.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.583+0000 7f8f6ba00640 1 -- 172.21.15.99:0/2179968498 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f64158860 con 0x7f8f64072b30 2024-03-30T13:11:03.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.583+0000 7f8f6ba00640 1 -- 172.21.15.99:0/2179968498 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f64158e20 con 0x7f8f64072b30 2024-03-30T13:11:03.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.584+0000 7f8f6ba00640 1 -- 172.21.15.99:0/2179968498 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f6404f9d0 con 0x7f8f64072b30 2024-03-30T13:11:03.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.585+0000 7f8f60c00640 1 -- 172.21.15.99:0/2179968498 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8f50004bc0 con 0x7f8f64072b30 2024-03-30T13:11:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.586+0000 7f8f60c00640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8f4406c530 0x7f8f4406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.586+0000 7f8f60c00640 1 -- 172.21.15.99:0/2179968498 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8f5008aab0 con 0x7f8f64072b30 2024-03-30T13:11:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.586+0000 7f8f69000640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8f4406c530 0x7f8f4406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.587+0000 7f8f69000640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8f4406c530 0x7f8f4406e9f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8f58036000 tx=0x7f8f5803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:03.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.595+0000 7f8f60c00640 1 -- 172.21.15.99:0/2179968498 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8f50059190 con 0x7f8f64072b30 2024-03-30T13:11:03.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.794+0000 7f8f6ba00640 1 -- 172.21.15.99:0/2179968498 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8f6415eec0 con 0x7f8f64072b30 2024-03-30T13:11:03.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.795+0000 7f8f60c00640 1 -- 172.21.15.99:0/2179968498 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f8f50058a90 con 0x7f8f64072b30 2024-03-30T13:11:03.798 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.797+0000 7f8f6ba00640 1 -- 172.21.15.99:0/2179968498 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8f4406c530 msgr2=0x7f8f4406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.797+0000 7f8f6ba00640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8f4406c530 0x7f8f4406e9f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8f58036000 tx=0x7f8f5803b040 comp rx=0 tx=0).stop 2024-03-30T13:11:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.797+0000 7f8f6ba00640 1 -- 172.21.15.99:0/2179968498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f64072b30 msgr2=0x7f8f64155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.797+0000 7f8f6ba00640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f64072b30 0x7f8f64155030 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000c4e0 tx=0x7f8f5000c9a0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.797+0000 7f8f6ba00640 1 -- 172.21.15.99:0/2179968498 shutdown_connections 2024-03-30T13:11:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.797+0000 7f8f6ba00640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8f4406c530 0x7f8f4406e9f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.797+0000 7f8f6ba00640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f64156cf0 0x7f8f64155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.797+0000 7f8f6ba00640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f64072b30 0x7f8f64155030 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.797+0000 7f8f6ba00640 1 --2- 172.21.15.99:0/2179968498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f6406cc30 0x7f8f6415b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.797+0000 7f8f6ba00640 1 -- 172.21.15.99:0/2179968498 >> 172.21.15.99:0/2179968498 conn(0x7f8f64072010 msgr2=0x7f8f640b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.798+0000 7f8f6ba00640 1 -- 172.21.15.99:0/2179968498 shutdown_connections 2024-03-30T13:11:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:03.798+0000 7f8f6ba00640 1 -- 172.21.15.99:0/2179968498 wait complete. 2024-03-30T13:11:03.819 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.007+0000 7fc670000640 1 Processor -- start 2024-03-30T13:11:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.007+0000 7fc670000640 1 -- start start 2024-03-30T13:11:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.008+0000 7fc670000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6680ca950 0x7fc6680b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.008+0000 7fc670000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc6680b26f0 0x7fc66815be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.008+0000 7fc670000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6680cadb0 con 0x7fc66815b3d0 2024-03-30T13:11:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.008+0000 7fc670000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc6680c6240 con 0x7fc6680b26f0 2024-03-30T13:11:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.008+0000 7fc670000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc6680c7080 con 0x7fc6680ca950 2024-03-30T13:11:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.009+0000 7fc66e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc6680b26f0 0x7fc66815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.009+0000 7fc66e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc6680b26f0 0x7fc66815be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38696/0 (socket says 172.21.15.99:38696) 2024-03-30T13:11:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.009+0000 7fc66e000640 1 -- 172.21.15.99:0/4239866102 learned_addr learned my addr 172.21.15.99:0/4239866102 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.009+0000 7fc66cc00640 1 --2- 172.21.15.99:0/4239866102 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6680ca950 0x7fc6680b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.009+0000 7fc66e000640 1 -- 172.21.15.99:0/4239866102 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6680ca950 msgr2=0x7fc6680b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.009+0000 7fc66e000640 1 --2- 172.21.15.99:0/4239866102 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6680ca950 0x7fc6680b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.009+0000 7fc66e000640 1 -- 172.21.15.99:0/4239866102 >> v1:172.21.15.181:6789/0 conn(0x7fc66815b3d0 legacy=0x7fc6680b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.009+0000 7fc66e000640 1 -- 172.21.15.99:0/4239866102 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6680c6470 con 0x7fc6680b26f0 2024-03-30T13:11:04.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.010+0000 7fc66e000640 1 --2- 172.21.15.99:0/4239866102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6680b26f0 0x7fc66815be50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc660009e50 tx=0x7fc66002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5235643115b56416 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:04.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.010+0000 7fc667e00640 1 -- 172.21.15.99:0/4239866102 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66002cb00 con 0x7fc6680b26f0 2024-03-30T13:11:04.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.010+0000 7fc667e00640 1 -- 172.21.15.99:0/4239866102 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc66002cca0 con 0x7fc6680b26f0 2024-03-30T13:11:04.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.010+0000 7fc667e00640 1 -- 172.21.15.99:0/4239866102 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660034610 con 0x7fc6680b26f0 2024-03-30T13:11:04.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.011+0000 7fc670000640 1 -- 172.21.15.99:0/4239866102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6680b26f0 msgr2=0x7fc66815be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.011+0000 7fc670000640 1 --2- 172.21.15.99:0/4239866102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6680b26f0 0x7fc66815be50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc660009e50 tx=0x7fc66002bf60 comp rx=0 tx=0).stop 2024-03-30T13:11:04.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.011+0000 7fc670000640 1 -- 172.21.15.99:0/4239866102 shutdown_connections 2024-03-30T13:11:04.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.011+0000 7fc670000640 1 --2- 172.21.15.99:0/4239866102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6680b26f0 0x7fc66815be50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.011+0000 7fc670000640 1 --2- 172.21.15.99:0/4239866102 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6680ca950 0x7fc6680b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.011+0000 7fc670000640 1 -- 172.21.15.99:0/4239866102 >> 172.21.15.99:0/4239866102 conn(0x7fc6680d0450 msgr2=0x7fc6680d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:04.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.011+0000 7fc670000640 1 -- 172.21.15.99:0/4239866102 shutdown_connections 2024-03-30T13:11:04.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.012+0000 7fc670000640 1 -- 172.21.15.99:0/4239866102 wait complete. 2024-03-30T13:11:04.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.013+0000 7fc670000640 1 Processor -- start 2024-03-30T13:11:04.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.013+0000 7fc670000640 1 -- start start 2024-03-30T13:11:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.014+0000 7fc670000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6680b26f0 0x7fc668072220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.014+0000 7fc670000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6680ca950 0x7fc668159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.014+0000 7fc670000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66815b3d0 0x7fc66814b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.014+0000 7fc670000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc6680c6a30 con 0x7fc66815b3d0 2024-03-30T13:11:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.014+0000 7fc670000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc6680b2b30 con 0x7fc6680b26f0 2024-03-30T13:11:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.014+0000 7fc670000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc6680c6d10 con 0x7fc6680ca950 2024-03-30T13:11:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.014+0000 7fc66e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66815b3d0 0x7fc66814b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.014+0000 7fc66e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66815b3d0 0x7fc66814b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38704/0 (socket says 172.21.15.99:38704) 2024-03-30T13:11:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.014+0000 7fc66e000640 1 -- 172.21.15.99:0/924860691 learned_addr learned my addr 172.21.15.99:0/924860691 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc66e000640 1 -- 172.21.15.99:0/924860691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6680ca950 msgr2=0x7fc668159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc66cc00640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6680ca950 0x7fc668159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc66d600640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6680b26f0 0x7fc668072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc66e000640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6680ca950 0x7fc668159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc66e000640 1 -- 172.21.15.99:0/924860691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6680b26f0 msgr2=0x7fc668072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc66e000640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6680b26f0 0x7fc668072220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc66e000640 1 -- 172.21.15.99:0/924860691 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc668073330 con 0x7fc66815b3d0 2024-03-30T13:11:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc66e000640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66815b3d0 0x7fc66814b1d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc660036040 tx=0x7fc660004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc665600640 1 -- 172.21.15.99:0/924860691 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660043020 con 0x7fc66815b3d0 2024-03-30T13:11:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc665600640 1 -- 172.21.15.99:0/924860691 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc66002ce50 con 0x7fc66815b3d0 2024-03-30T13:11:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc665600640 1 -- 172.21.15.99:0/924860691 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660009510 con 0x7fc66815b3d0 2024-03-30T13:11:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.015+0000 7fc670000640 1 -- 172.21.15.99:0/924860691 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc668073610 con 0x7fc66815b3d0 2024-03-30T13:11:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.016+0000 7fc670000640 1 -- 172.21.15.99:0/924860691 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc668071d00 con 0x7fc66815b3d0 2024-03-30T13:11:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.016+0000 7fc670000640 1 -- 172.21.15.99:0/924860691 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc66815b7b0 con 0x7fc66815b3d0 2024-03-30T13:11:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.017+0000 7fc665600640 1 -- 172.21.15.99:0/924860691 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc660046020 con 0x7fc66815b3d0 2024-03-30T13:11:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.019+0000 7fc665600640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc64806c530 0x7fc64806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.019+0000 7fc665600640 1 -- 172.21.15.99:0/924860691 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc6600adcd0 con 0x7fc66815b3d0 2024-03-30T13:11:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.019+0000 7fc66d600640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc64806c530 0x7fc64806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.019+0000 7fc66d600640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc64806c530 0x7fc64806e9f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc65c000f60 tx=0x7fc65c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.023+0000 7fc665600640 1 -- 172.21.15.99:0/924860691 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc66815b7b0 con 0x7fc66815b3d0 2024-03-30T13:11:04.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.216+0000 7fc670000640 1 -- 172.21.15.99:0/924860691 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc66809e520 con 0x7fc66815b3d0 2024-03-30T13:11:04.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.217+0000 7fc665600640 1 -- 172.21.15.99:0/924860691 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fc66004d030 con 0x7fc66815b3d0 2024-03-30T13:11:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:04.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.220+0000 7fc670000640 1 -- 172.21.15.99:0/924860691 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc64806c530 msgr2=0x7fc64806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.220+0000 7fc670000640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc64806c530 0x7fc64806e9f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc65c000f60 tx=0x7fc65c009040 comp rx=0 tx=0).stop 2024-03-30T13:11:04.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.220+0000 7fc670000640 1 -- 172.21.15.99:0/924860691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66815b3d0 msgr2=0x7fc66814b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.220+0000 7fc670000640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66815b3d0 0x7fc66814b1d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc660036040 tx=0x7fc660004a40 comp rx=0 tx=0).stop 2024-03-30T13:11:04.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.221+0000 7fc670000640 1 -- 172.21.15.99:0/924860691 shutdown_connections 2024-03-30T13:11:04.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.221+0000 7fc670000640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc64806c530 0x7fc64806e9f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.221+0000 7fc670000640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66815b3d0 0x7fc66814b1d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.221+0000 7fc670000640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6680ca950 0x7fc668159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.221+0000 7fc670000640 1 --2- 172.21.15.99:0/924860691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6680b26f0 0x7fc668072220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.221+0000 7fc670000640 1 -- 172.21.15.99:0/924860691 >> 172.21.15.99:0/924860691 conn(0x7fc6680d0450 msgr2=0x7fc6680af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:04.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.221+0000 7fc670000640 1 -- 172.21.15.99:0/924860691 shutdown_connections 2024-03-30T13:11:04.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.221+0000 7fc670000640 1 -- 172.21.15.99:0/924860691 wait complete. 2024-03-30T13:11:04.249 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:04.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.441+0000 7fe83ca00640 1 Processor -- start 2024-03-30T13:11:04.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.441+0000 7fe83ca00640 1 -- start start 2024-03-30T13:11:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.443+0000 7fe83ca00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe83806ec00 0x7fe8380cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.443+0000 7fe83ca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe838072f80 con 0x7fe8380b3f20 2024-03-30T13:11:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.443+0000 7fe83ca00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe838073260 con 0x7fe8381517a0 2024-03-30T13:11:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.443+0000 7fe83ca00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe838073540 con 0x7fe83806ec00 2024-03-30T13:11:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.443+0000 7fe82ea00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe8380b3f20 0x7fe838072300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56770/0 (socket says 172.21.15.99:56770) 2024-03-30T13:11:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.443+0000 7fe82ea00640 1 -- 172.21.15.99:0/1118929011 learned_addr learned my addr 172.21.15.99:0/1118929011 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:04.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1994875244 0 0) 0x7fe838072f80 con 0x7fe8380b3f20 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe81c003520 con 0x7fe8380b3f20 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe837e00640 1 --2- 172.21.15.99:0/1118929011 >> v2:172.21.15.181:3300/0 conn(0x7fe83806ec00 0x7fe8380cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2515506087 0 0) 0x7fe81c003520 con 0x7fe8380b3f20 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 >> v2:172.21.15.181:3300/0 conn(0x7fe83806ec00 msgr2=0x7fe8380cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 --2- 172.21.15.99:0/1118929011 >> v2:172.21.15.181:3300/0 conn(0x7fe83806ec00 0x7fe8380cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 >> v1:172.21.15.181:6789/0 conn(0x7fe8381517a0 legacy=0x7fe8380b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe838073820 con 0x7fe8380b3f20 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fe820001670 con 0x7fe8380b3f20 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe837e00640 1 --2- 172.21.15.99:0/1118929011 >> v2:172.21.15.181:3300/0 conn(0x7fe83806ec00 0x7fe8380cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 >> v1:172.21.15.99:6789/0 conn(0x7fe8380b3f20 legacy=0x7fe838072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 --2- 172.21.15.99:0/1118929011 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe81c0039b0 0x7fe81c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 --2- 172.21.15.99:0/1118929011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe81c004800 0x7fe81c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 --2- 172.21.15.99:0/1118929011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe81c0052e0 0x7fe81c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe838073540 con 0x7fe81c004800 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe81c00e3f0 con 0x7fe81c0052e0 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe81c00e5f0 con 0x7fe81c0039b0 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.444+0000 7fe82ea00640 1 --2- 172.21.15.99:0/1118929011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe81c004800 0x7fe81c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.445+0000 7fe82ea00640 1 -- 172.21.15.99:0/1118929011 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe81c0039b0 msgr2=0x7fe81c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.445+0000 7fe837400640 1 --2- 172.21.15.99:0/1118929011 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe81c0039b0 0x7fe81c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.445+0000 7fe837e00640 1 --2- 172.21.15.99:0/1118929011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe81c0052e0 0x7fe81c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.445+0000 7fe82ea00640 1 --2- 172.21.15.99:0/1118929011 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe81c0039b0 0x7fe81c003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.445+0000 7fe82ea00640 1 -- 172.21.15.99:0/1118929011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe81c0052e0 msgr2=0x7fe81c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.445+0000 7fe82ea00640 1 --2- 172.21.15.99:0/1118929011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe81c0052e0 0x7fe81c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.445+0000 7fe82ea00640 1 -- 172.21.15.99:0/1118929011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81c003520 con 0x7fe81c004800 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.445+0000 7fe837e00640 1 -- 172.21.15.99:0/1118929011 reap_dead start 2024-03-30T13:11:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.446+0000 7fe82ea00640 1 --2- 172.21.15.99:0/1118929011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe81c004800 0x7fe81c004c80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe82000c210 tx=0x7fe81c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab2c2f77171c18d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:04.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.446+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820007d10 con 0x7fe81c004800 2024-03-30T13:11:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.446+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe820030070 con 0x7fe81c004800 2024-03-30T13:11:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.446+0000 7fe836a00640 1 -- 172.21.15.99:0/1118929011 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820005d70 con 0x7fe81c004800 2024-03-30T13:11:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.447+0000 7fe83ca00640 1 -- 172.21.15.99:0/1118929011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe81c004800 msgr2=0x7fe81c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.447+0000 7fe83ca00640 1 --2- 172.21.15.99:0/1118929011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe81c004800 0x7fe81c004c80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe82000c210 tx=0x7fe81c005830 comp rx=0 tx=0).stop 2024-03-30T13:11:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.447+0000 7fe83ca00640 1 -- 172.21.15.99:0/1118929011 shutdown_connections 2024-03-30T13:11:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.447+0000 7fe83ca00640 1 --2- 172.21.15.99:0/1118929011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe81c004800 0x7fe81c004c80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.447+0000 7fe83ca00640 1 -- 172.21.15.99:0/1118929011 >> 172.21.15.99:0/1118929011 conn(0x7fe83806bb40 msgr2=0x7fe8380b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.447+0000 7fe83ca00640 1 -- 172.21.15.99:0/1118929011 shutdown_connections 2024-03-30T13:11:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.447+0000 7fe83ca00640 1 -- 172.21.15.99:0/1118929011 wait complete. 2024-03-30T13:11:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.449+0000 7fe83ca00640 1 Processor -- start 2024-03-30T13:11:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.449+0000 7fe83ca00640 1 -- start start 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.450+0000 7fe83ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe81c004800 0x7fe8381e8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.450+0000 7fe83ca00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe838149690 0x7fe8381573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.450+0000 7fe83ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8380aea90 0x7fe8380aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.450+0000 7fe83ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe838151d00 con 0x7fe8380aea90 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.450+0000 7fe83ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe838151b80 con 0x7fe81c004800 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.450+0000 7fe83ca00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe8380b3810 con 0x7fe838149690 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.450+0000 7fe837e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8380aea90 0x7fe8380aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.450+0000 7fe837e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8380aea90 0x7fe8380aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38720/0 (socket says 172.21.15.99:38720) 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.450+0000 7fe837e00640 1 -- 172.21.15.99:0/3298416870 learned_addr learned my addr 172.21.15.99:0/3298416870 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.451+0000 7fe837400640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe81c004800 0x7fe8381e8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.451+0000 7fe82ea00640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe838149690 0x7fe8381573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.451+0000 7fe837e00640 1 -- 172.21.15.99:0/3298416870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe838149690 msgr2=0x7fe8381573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.451+0000 7fe837e00640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe838149690 0x7fe8381573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.451+0000 7fe837e00640 1 -- 172.21.15.99:0/3298416870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe81c004800 msgr2=0x7fe8381e8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.451+0000 7fe837e00640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe81c004800 0x7fe8381e8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.451+0000 7fe837e00640 1 -- 172.21.15.99:0/3298416870 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8380afc50 con 0x7fe8380aea90 2024-03-30T13:11:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.451+0000 7fe837e00640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8380aea90 0x7fe8380aef10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe83815ae90 tx=0x7fe83000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.451+0000 7fe82fe00640 1 -- 172.21.15.99:0/3298416870 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe830004020 con 0x7fe8380aea90 2024-03-30T13:11:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.452+0000 7fe82fe00640 1 -- 172.21.15.99:0/3298416870 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8300041c0 con 0x7fe8380aea90 2024-03-30T13:11:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.452+0000 7fe82fe00640 1 -- 172.21.15.99:0/3298416870 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe830012690 con 0x7fe8380aea90 2024-03-30T13:11:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.452+0000 7fe83ca00640 1 -- 172.21.15.99:0/3298416870 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8380aff30 con 0x7fe8380aea90 2024-03-30T13:11:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.452+0000 7fe83ca00640 1 -- 172.21.15.99:0/3298416870 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8380b04f0 con 0x7fe8380aea90 2024-03-30T13:11:04.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.453+0000 7fe83ca00640 1 -- 172.21.15.99:0/3298416870 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8380af450 con 0x7fe8380aea90 2024-03-30T13:11:04.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.454+0000 7fe82fe00640 1 -- 172.21.15.99:0/3298416870 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe83001a020 con 0x7fe8380aea90 2024-03-30T13:11:04.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.455+0000 7fe82fe00640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe81406c560 0x7fe81406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.455+0000 7fe82fe00640 1 -- 172.21.15.99:0/3298416870 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe83008b000 con 0x7fe8380aea90 2024-03-30T13:11:04.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.455+0000 7fe837400640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe81406c560 0x7fe81406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.456+0000 7fe837400640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe81406c560 0x7fe81406ea20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe828007fd0 tx=0x7fe828009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:04.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.463+0000 7fe82fe00640 1 -- 172.21.15.99:0/3298416870 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe83000d050 con 0x7fe8380aea90 2024-03-30T13:11:04.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.662+0000 7fe83ca00640 1 -- 172.21.15.99:0/3298416870 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe8380b3ba0 con 0x7fe8380aea90 2024-03-30T13:11:04.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.663+0000 7fe82fe00640 1 -- 172.21.15.99:0/3298416870 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fe8380b3ba0 con 0x7fe8380aea90 2024-03-30T13:11:04.666 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.665+0000 7fe83ca00640 1 -- 172.21.15.99:0/3298416870 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe81406c560 msgr2=0x7fe81406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.665+0000 7fe83ca00640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe81406c560 0x7fe81406ea20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe828007fd0 tx=0x7fe828009040 comp rx=0 tx=0).stop 2024-03-30T13:11:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.665+0000 7fe83ca00640 1 -- 172.21.15.99:0/3298416870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8380aea90 msgr2=0x7fe8380aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.665+0000 7fe83ca00640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8380aea90 0x7fe8380aef10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe83815ae90 tx=0x7fe83000b880 comp rx=0 tx=0).stop 2024-03-30T13:11:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.665+0000 7fe83ca00640 1 -- 172.21.15.99:0/3298416870 shutdown_connections 2024-03-30T13:11:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.665+0000 7fe83ca00640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe81406c560 0x7fe81406ea20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.666+0000 7fe83ca00640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8380aea90 0x7fe8380aef10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.666+0000 7fe83ca00640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe838149690 0x7fe8381573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.666+0000 7fe83ca00640 1 --2- 172.21.15.99:0/3298416870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe81c004800 0x7fe8381e8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.666+0000 7fe83ca00640 1 -- 172.21.15.99:0/3298416870 >> 172.21.15.99:0/3298416870 conn(0x7fe83806bb40 msgr2=0x7fe838158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.666+0000 7fe83ca00640 1 -- 172.21.15.99:0/3298416870 shutdown_connections 2024-03-30T13:11:04.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.666+0000 7fe83ca00640 1 -- 172.21.15.99:0/3298416870 wait complete. 2024-03-30T13:11:04.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:04.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.876+0000 7f7e06600640 1 Processor -- start 2024-03-30T13:11:04.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.876+0000 7f7e06600640 1 -- start start 2024-03-30T13:11:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.877+0000 7f7e06600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7e0015b370 0x7f7e000b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7e06600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7e00073290 0x7f7e0015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7e06600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e00071ae0 con 0x7f7e0006f3f0 2024-03-30T13:11:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7e06600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7e00071dc0 con 0x7f7e00073290 2024-03-30T13:11:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7e06600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7e000720a0 con 0x7f7e0015b370 2024-03-30T13:11:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7dfea00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7e0006f3f0 0x7f7e00072b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35896/0 (socket says 172.21.15.99:35896) 2024-03-30T13:11:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7dfea00640 1 -- 172.21.15.99:0/2794020405 learned_addr learned my addr 172.21.15.99:0/2794020405 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7dffe00640 1 --2- 172.21.15.99:0/2794020405 >> v2:172.21.15.99:3300/0 conn(0x7f7e00073290 0x7f7e0015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7dff400640 1 --2- 172.21.15.99:0/2794020405 >> v2:172.21.15.181:3300/0 conn(0x7f7e0015b370 0x7f7e000b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7dfe000640 1 -- 172.21.15.99:0/2794020405 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387510453 0 0) 0x7f7e00071ae0 con 0x7f7e0006f3f0 2024-03-30T13:11:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7dffe00640 1 -- 172.21.15.99:0/2794020405 >> v2:172.21.15.181:3300/0 conn(0x7f7e0015b370 msgr2=0x7f7e000b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7dffe00640 1 --2- 172.21.15.99:0/2794020405 >> v2:172.21.15.181:3300/0 conn(0x7f7e0015b370 0x7f7e000b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7dffe00640 1 -- 172.21.15.99:0/2794020405 >> v1:172.21.15.99:6789/0 conn(0x7f7e0006f3f0 legacy=0x7f7e00072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.878+0000 7f7dffe00640 1 -- 172.21.15.99:0/2794020405 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e00072380 con 0x7f7e00073290 2024-03-30T13:11:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.879+0000 7f7dffe00640 1 --2- 172.21.15.99:0/2794020405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e00073290 0x7f7e0015f0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7e000d12e0 tx=0x7f7df802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10151d7d746f9c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.880+0000 7f7dfe000640 1 -- 172.21.15.99:0/2794020405 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8039070 con 0x7f7e00073290 2024-03-30T13:11:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.880+0000 7f7dfe000640 1 -- 172.21.15.99:0/2794020405 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df802cc80 con 0x7f7e00073290 2024-03-30T13:11:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.880+0000 7f7dfe000640 1 -- 172.21.15.99:0/2794020405 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8034660 con 0x7f7e00073290 2024-03-30T13:11:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.880+0000 7f7e06600640 1 -- 172.21.15.99:0/2794020405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e00073290 msgr2=0x7f7e0015f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.880+0000 7f7e06600640 1 --2- 172.21.15.99:0/2794020405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e00073290 0x7f7e0015f0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7e000d12e0 tx=0x7f7df802bed0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.881+0000 7f7e06600640 1 -- 172.21.15.99:0/2794020405 shutdown_connections 2024-03-30T13:11:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.881+0000 7f7e06600640 1 --2- 172.21.15.99:0/2794020405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e00073290 0x7f7e0015f0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.881+0000 7f7e06600640 1 --2- 172.21.15.99:0/2794020405 >> v2:172.21.15.181:3300/0 conn(0x7f7e0015b370 0x7f7e000b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.881+0000 7f7e06600640 1 -- 172.21.15.99:0/2794020405 >> 172.21.15.99:0/2794020405 conn(0x7f7e0006b510 msgr2=0x7f7e0006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:04.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.881+0000 7f7e06600640 1 -- 172.21.15.99:0/2794020405 shutdown_connections 2024-03-30T13:11:04.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.881+0000 7f7e06600640 1 -- 172.21.15.99:0/2794020405 wait complete. 2024-03-30T13:11:04.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.883+0000 7f7e06600640 1 Processor -- start 2024-03-30T13:11:04.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.883+0000 7f7e06600640 1 -- start start 2024-03-30T13:11:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.884+0000 7f7e06600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0006f3f0 0x7f7e001544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.884+0000 7f7e06600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e00073290 0x7f7e0015df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.884+0000 7f7e06600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7e0015b370 0x7f7e0015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7e06600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7e000b3980 con 0x7f7e0006f3f0 2024-03-30T13:11:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7e06600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7e000b3800 con 0x7f7e00073290 2024-03-30T13:11:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7e06600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0015b750 con 0x7f7e0015b370 2024-03-30T13:11:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7dff400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0006f3f0 0x7f7e001544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7dff400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0006f3f0 0x7f7e001544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49874/0 (socket says 172.21.15.99:49874) 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7dff400640 1 -- 172.21.15.99:0/680969083 learned_addr learned my addr 172.21.15.99:0/680969083 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7dfea00640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e00073290 0x7f7e0015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7dffe00640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7e0015b370 0x7f7e0015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7dff400640 1 -- 172.21.15.99:0/680969083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7e0015b370 msgr2=0x7f7e0015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7dff400640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7e0015b370 0x7f7e0015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7dff400640 1 -- 172.21.15.99:0/680969083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e00073290 msgr2=0x7f7e0015df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7dff400640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e00073290 0x7f7e0015df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7dff400640 1 -- 172.21.15.99:0/680969083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0015e5a0 con 0x7f7e0006f3f0 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.885+0000 7f7dff400640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0006f3f0 0x7f7e001544b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7df000d5f0 tx=0x7f7df000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.886+0000 7f7df7400640 1 -- 172.21.15.99:0/680969083 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df00125f0 con 0x7f7e0006f3f0 2024-03-30T13:11:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.886+0000 7f7df7400640 1 -- 172.21.15.99:0/680969083 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df0019070 con 0x7f7e0006f3f0 2024-03-30T13:11:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.886+0000 7f7e06600640 1 -- 172.21.15.99:0/680969083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e000ce6b0 con 0x7f7e0006f3f0 2024-03-30T13:11:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.886+0000 7f7df7400640 1 -- 172.21.15.99:0/680969083 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df00129d0 con 0x7f7e0006f3f0 2024-03-30T13:11:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.886+0000 7f7e06600640 1 -- 172.21.15.99:0/680969083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e000ce950 con 0x7f7e0006f3f0 2024-03-30T13:11:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.887+0000 7f7e06600640 1 -- 172.21.15.99:0/680969083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e00068640 con 0x7f7e0006f3f0 2024-03-30T13:11:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.888+0000 7f7df7400640 1 -- 172.21.15.99:0/680969083 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7df0012b70 con 0x7f7e0006f3f0 2024-03-30T13:11:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.889+0000 7f7df7400640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7de006c560 0x7f7de006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.889+0000 7f7df7400640 1 -- 172.21.15.99:0/680969083 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7df008ba40 con 0x7f7e0006f3f0 2024-03-30T13:11:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.889+0000 7f7dfea00640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7de006c560 0x7f7de006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.890+0000 7f7dfea00640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7de006c560 0x7f7de006ea20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7dec007fd0 tx=0x7f7dec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:04.893+0000 7f7df7400640 1 -- 172.21.15.99:0/680969083 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7df005a0f0 con 0x7f7e0006f3f0 2024-03-30T13:11:05.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.123+0000 7f7e06600640 1 -- 172.21.15.99:0/680969083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e00158720 con 0x7f7e0006f3f0 2024-03-30T13:11:05.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.123+0000 7f7df7400640 1 -- 172.21.15.99:0/680969083 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f7df00599f0 con 0x7f7e0006f3f0 2024-03-30T13:11:05.127 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:05.127 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2695284429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2695284429},{"type":"v1","addr":"172.21.15.181:6835","nonce":2695284429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1658040869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1658040869},{"type":"v1","addr":"172.21.15.181:6833","nonce":1658040869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/951752489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":951752489},{"type":"v1","addr":"172.21.15.99:6835","nonce":951752489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:10:45.658137+0000","modified":"2024-03-30T13:10:48.749437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/245796495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":245796495},{"type":"v1","addr":"172.21.15.99:6837","nonce":245796495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-03-30T13:11:05.128 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-03-30T13:11:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.126+0000 7f7e06600640 1 -- 172.21.15.99:0/680969083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7de006c560 msgr2=0x7f7de006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.126+0000 7f7e06600640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7de006c560 0x7f7de006ea20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7dec007fd0 tx=0x7f7dec009040 comp rx=0 tx=0).stop 2024-03-30T13:11:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.126+0000 7f7e06600640 1 -- 172.21.15.99:0/680969083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0006f3f0 msgr2=0x7f7e001544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.126+0000 7f7e06600640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0006f3f0 0x7f7e001544b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7df000d5f0 tx=0x7f7df000dab0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.126+0000 7f7e06600640 1 -- 172.21.15.99:0/680969083 shutdown_connections 2024-03-30T13:11:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.126+0000 7f7e06600640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7de006c560 0x7f7de006ea20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.126+0000 7f7e06600640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7e0015b370 0x7f7e0015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.126+0000 7f7e06600640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e00073290 0x7f7e0015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.126+0000 7f7e06600640 1 --2- 172.21.15.99:0/680969083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0006f3f0 0x7f7e001544b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.126+0000 7f7e06600640 1 -- 172.21.15.99:0/680969083 >> 172.21.15.99:0/680969083 conn(0x7f7e0006b510 msgr2=0x7f7e000b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.126+0000 7f7e06600640 1 -- 172.21.15.99:0/680969083 shutdown_connections 2024-03-30T13:11:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.127+0000 7f7e06600640 1 -- 172.21.15.99:0/680969083 wait complete. 2024-03-30T13:11:05.147 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:05.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.338+0000 7f4743800640 1 Processor -- start 2024-03-30T13:11:05.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.339+0000 7f4743800640 1 -- start start 2024-03-30T13:11:05.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.340+0000 7f4743800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f473c06bc20 0x7f473c15cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.340+0000 7f4743800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473c146260 con 0x7f473c0ae320 2024-03-30T13:11:05.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.340+0000 7f4743800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473c0b0fb0 con 0x7f473c145e80 2024-03-30T13:11:05.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.340+0000 7f4743800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f473c15d170 con 0x7f473c06bc20 2024-03-30T13:11:05.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.340+0000 7f473be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f473c0ae320 0x7f473c06b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35904/0 (socket says 172.21.15.99:35904) 2024-03-30T13:11:05.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.340+0000 7f473be00640 1 -- 172.21.15.99:0/1718954574 learned_addr learned my addr 172.21.15.99:0/1718954574 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:05.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.340+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 120154709 0 0) 0x7f473c146260 con 0x7f473c0ae320 2024-03-30T13:11:05.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.340+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4724003520 con 0x7f473c0ae320 2024-03-30T13:11:05.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f4741800640 1 --2- 172.21.15.99:0/1718954574 >> v2:172.21.15.181:3300/0 conn(0x7f473c06bc20 0x7f473c15cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1158181461 0 0) 0x7f4724003520 con 0x7f473c0ae320 2024-03-30T13:11:05.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 >> v2:172.21.15.181:3300/0 conn(0x7f473c06bc20 msgr2=0x7f473c15cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:05.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 --2- 172.21.15.99:0/1718954574 >> v2:172.21.15.181:3300/0 conn(0x7f473c06bc20 0x7f473c15cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 >> v1:172.21.15.181:6789/0 conn(0x7f473c145e80 legacy=0x7f473c0b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c0b1290 con 0x7f473c0ae320 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f4728001670 con 0x7f473c0ae320 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 >> v1:172.21.15.99:6789/0 conn(0x7f473c0ae320 legacy=0x7f473c06b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 --2- 172.21.15.99:0/1718954574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4724003a00 0x7f4724003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 --2- 172.21.15.99:0/1718954574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4724004800 0x7f4724004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 --2- 172.21.15.99:0/1718954574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4724005210 0x7f472400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f473c15d170 con 0x7f4724004800 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f472400c160 con 0x7f4724005210 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f472400c360 con 0x7f4724003a00 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f4741800640 1 --2- 172.21.15.99:0/1718954574 >> v2:172.21.15.181:3300/0 conn(0x7f473c06bc20 0x7f473c15cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.341+0000 7f473be00640 1 --2- 172.21.15.99:0/1718954574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4724004800 0x7f4724004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.342+0000 7f473be00640 1 -- 172.21.15.99:0/1718954574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4724003a00 msgr2=0x7f4724003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.342+0000 7f473be00640 1 --2- 172.21.15.99:0/1718954574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4724003a00 0x7f4724003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.342+0000 7f473be00640 1 -- 172.21.15.99:0/1718954574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4724005210 msgr2=0x7f472400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:05.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.342+0000 7f473be00640 1 --2- 172.21.15.99:0/1718954574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4724005210 0x7f472400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.342+0000 7f473be00640 1 -- 172.21.15.99:0/1718954574 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4724003520 con 0x7f4724004800 2024-03-30T13:11:05.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.342+0000 7f4741800640 1 -- 172.21.15.99:0/1718954574 reap_dead start 2024-03-30T13:11:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.343+0000 7f473be00640 1 --2- 172.21.15.99:0/1718954574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4724004800 0x7f4724004c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f472800c190 tx=0x7f4724005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30937cfc0397c9f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.343+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728007c60 con 0x7f4724004800 2024-03-30T13:11:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.343+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4728030070 con 0x7f4724004800 2024-03-30T13:11:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.343+0000 7f473b400640 1 -- 172.21.15.99:0/1718954574 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728005d90 con 0x7f4724004800 2024-03-30T13:11:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.343+0000 7f4743800640 1 -- 172.21.15.99:0/1718954574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4724004800 msgr2=0x7f4724004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.343+0000 7f4743800640 1 --2- 172.21.15.99:0/1718954574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4724004800 0x7f4724004c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f472800c190 tx=0x7f4724005830 comp rx=0 tx=0).stop 2024-03-30T13:11:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.343+0000 7f4743800640 1 -- 172.21.15.99:0/1718954574 shutdown_connections 2024-03-30T13:11:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.343+0000 7f4743800640 1 --2- 172.21.15.99:0/1718954574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4724004800 0x7f4724004c80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.343+0000 7f4743800640 1 -- 172.21.15.99:0/1718954574 >> 172.21.15.99:0/1718954574 conn(0x7f473c0b6780 msgr2=0x7f473c0b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:05.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.344+0000 7f4743800640 1 -- 172.21.15.99:0/1718954574 shutdown_connections 2024-03-30T13:11:05.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.344+0000 7f4743800640 1 -- 172.21.15.99:0/1718954574 wait complete. 2024-03-30T13:11:05.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.345+0000 7f4743800640 1 Processor -- start 2024-03-30T13:11:05.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.345+0000 7f4743800640 1 -- start start 2024-03-30T13:11:05.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.346+0000 7f4743800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4724004800 0x7f473c1ee4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.346+0000 7f4743800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c0b4b50 0x7f473c1f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.346+0000 7f4743800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f473c1f7eb0 0x7f473c1f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.346+0000 7f4743800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f473c0b1850 con 0x7f473c1f7eb0 2024-03-30T13:11:05.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.346+0000 7f4743800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f473c0b1bc0 con 0x7f473c0b4b50 2024-03-30T13:11:05.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.346+0000 7f4743800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f473c15cc30 con 0x7f4724004800 2024-03-30T13:11:05.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.346+0000 7f4741800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f473c1f7eb0 0x7f473c1f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.346+0000 7f4741800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f473c1f7eb0 0x7f473c1f4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49892/0 (socket says 172.21.15.99:49892) 2024-03-30T13:11:05.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.346+0000 7f4741800640 1 -- 172.21.15.99:0/412884137 learned_addr learned my addr 172.21.15.99:0/412884137 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:05.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4740e00640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4724004800 0x7f473c1ee4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f473be00640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c0b4b50 0x7f473c1f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4741800640 1 -- 172.21.15.99:0/412884137 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4724004800 msgr2=0x7f473c1ee4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4741800640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4724004800 0x7f473c1ee4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4741800640 1 -- 172.21.15.99:0/412884137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c0b4b50 msgr2=0x7f473c1f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4741800640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c0b4b50 0x7f473c1f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4741800640 1 -- 172.21.15.99:0/412884137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c0b4fd0 con 0x7f473c1f7eb0 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4740e00640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4724004800 0x7f473c1ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f473be00640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c0b4b50 0x7f473c1f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4741800640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f473c1f7eb0 0x7f473c1f4380 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f473c0af0b0 tx=0x7f473400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4738c00640 1 -- 172.21.15.99:0/412884137 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473401a070 con 0x7f473c1f7eb0 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4738c00640 1 -- 172.21.15.99:0/412884137 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f473400dd30 con 0x7f473c1f7eb0 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4738c00640 1 -- 172.21.15.99:0/412884137 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734003bd0 con 0x7f473c1f7eb0 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.347+0000 7f4743800640 1 -- 172.21.15.99:0/412884137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473c0b62f0 con 0x7f473c1f7eb0 2024-03-30T13:11:05.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.348+0000 7f4743800640 1 -- 172.21.15.99:0/412884137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473c0b5530 con 0x7f473c1f7eb0 2024-03-30T13:11:05.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.349+0000 7f4743800640 1 -- 172.21.15.99:0/412884137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f473c068d50 con 0x7f473c1f7eb0 2024-03-30T13:11:05.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.350+0000 7f4738c00640 1 -- 172.21.15.99:0/412884137 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4734005d10 con 0x7f473c1f7eb0 2024-03-30T13:11:05.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.351+0000 7f4738c00640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f471c06c560 0x7f471c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.351+0000 7f4738c00640 1 -- 172.21.15.99:0/412884137 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f473408b710 con 0x7f473c1f7eb0 2024-03-30T13:11:05.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.351+0000 7f4740e00640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f471c06c560 0x7f471c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.352+0000 7f4740e00640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f471c06c560 0x7f471c06ea20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f473c0d1a60 tx=0x7f4730009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:05.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.355+0000 7f4738c00640 1 -- 172.21.15.99:0/412884137 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f473c0b4fd0 con 0x7f473c1f7eb0 2024-03-30T13:11:05.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.559+0000 7f4743800640 1 -- 172.21.15.99:0/412884137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f473c145250 con 0x7f473c1f7eb0 2024-03-30T13:11:05.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.561+0000 7f4738c00640 1 -- 172.21.15.99:0/412884137 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16609 (secure 0 0 0) 0x7f4734010070 con 0x7f473c1f7eb0 2024-03-30T13:11:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:05.565 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":22,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:47.229108+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:05.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 -- 172.21.15.99:0/412884137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f471c06c560 msgr2=0x7f471c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f471c06c560 0x7f471c06ea20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f473c0d1a60 tx=0x7f4730009040 comp rx=0 tx=0).stop 2024-03-30T13:11:05.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 -- 172.21.15.99:0/412884137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f473c1f7eb0 msgr2=0x7f473c1f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f473c1f7eb0 0x7f473c1f4380 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f473c0af0b0 tx=0x7f473400d4a0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 -- 172.21.15.99:0/412884137 shutdown_connections 2024-03-30T13:11:05.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f471c06c560 0x7f471c06ea20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f473c1f7eb0 0x7f473c1f4380 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c0b4b50 0x7f473c1f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 --2- 172.21.15.99:0/412884137 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4724004800 0x7f473c1ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 -- 172.21.15.99:0/412884137 >> 172.21.15.99:0/412884137 conn(0x7f473c0b6780 msgr2=0x7f473c15ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:05.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 -- 172.21.15.99:0/412884137 shutdown_connections 2024-03-30T13:11:05.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.564+0000 7f4743800640 1 -- 172.21.15.99:0/412884137 wait complete. 2024-03-30T13:11:05.586 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:05.587 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:05.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.773+0000 7f0fe0e00640 1 Processor -- start 2024-03-30T13:11:05.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.773+0000 7f0fe0e00640 1 -- start start 2024-03-30T13:11:05.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.774+0000 7f0fe0e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0fdc162e50 0x7f0fdc099730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.774+0000 7f0fe0e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fdc099c70 0x7f0fdc0c6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.774+0000 7f0fe0e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0fdc0c6cc0 0x7f0fdc0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.774+0000 7f0fe0e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f0fdc0c56e0 con 0x7f0fdc162e50 2024-03-30T13:11:05.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.774+0000 7f0fe0e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0fdc0c59c0 con 0x7f0fdc0c6cc0 2024-03-30T13:11:05.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.774+0000 7f0fe0e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0fdc0c5ca0 con 0x7f0fdc099c70 2024-03-30T13:11:05.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.775+0000 7f0fd9e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0fdc162e50 0x7f0fdc099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.775+0000 7f0fd9e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0fdc162e50 0x7f0fdc099730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49906/0 (socket says 172.21.15.99:49906) 2024-03-30T13:11:05.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.775+0000 7f0fd9e00640 1 -- 172.21.15.99:0/2132716282 learned_addr learned my addr 172.21.15.99:0/2132716282 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:05.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.775+0000 7f0fda800640 1 --2- 172.21.15.99:0/2132716282 >> v2:172.21.15.181:3300/0 conn(0x7f0fdc0c6cc0 0x7f0fdc0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.775+0000 7f0fd1400640 1 --2- 172.21.15.99:0/2132716282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fdc099c70 0x7f0fdc0c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.775+0000 7f0fd9e00640 1 -- 172.21.15.99:0/2132716282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fdc099c70 msgr2=0x7f0fdc0c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:05.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.775+0000 7f0fd9e00640 1 --2- 172.21.15.99:0/2132716282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fdc099c70 0x7f0fdc0c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.775+0000 7f0fd9e00640 1 -- 172.21.15.99:0/2132716282 >> v2:172.21.15.181:3300/0 conn(0x7f0fdc0c6cc0 msgr2=0x7f0fdc0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:05.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.775+0000 7f0fd9e00640 1 --2- 172.21.15.99:0/2132716282 >> v2:172.21.15.181:3300/0 conn(0x7f0fdc0c6cc0 0x7f0fdc0cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.775+0000 7f0fd9e00640 1 -- 172.21.15.99:0/2132716282 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fdc0c5f80 con 0x7f0fdc162e50 2024-03-30T13:11:05.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.776+0000 7f0fd9e00640 1 --2- 172.21.15.99:0/2132716282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fdc162e50 0x7f0fdc099730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc06fde0 tx=0x7f0fcc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6dd19868005388 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:05.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.777+0000 7f0fd9400640 1 -- 172.21.15.99:0/2132716282 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc02e070 con 0x7f0fdc162e50 2024-03-30T13:11:05.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.777+0000 7f0fd9400640 1 -- 172.21.15.99:0/2132716282 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fcc037070 con 0x7f0fdc162e50 2024-03-30T13:11:05.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.777+0000 7f0fd9400640 1 -- 172.21.15.99:0/2132716282 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc031a00 con 0x7f0fdc162e50 2024-03-30T13:11:05.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.777+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2132716282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fdc162e50 msgr2=0x7f0fdc099730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.777+0000 7f0fe0e00640 1 --2- 172.21.15.99:0/2132716282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fdc162e50 0x7f0fdc099730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc06fde0 tx=0x7f0fcc02b880 comp rx=0 tx=0).stop 2024-03-30T13:11:05.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.778+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2132716282 shutdown_connections 2024-03-30T13:11:05.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.778+0000 7f0fe0e00640 1 --2- 172.21.15.99:0/2132716282 >> v2:172.21.15.181:3300/0 conn(0x7f0fdc0c6cc0 0x7f0fdc0cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.778+0000 7f0fe0e00640 1 --2- 172.21.15.99:0/2132716282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fdc099c70 0x7f0fdc0c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.778+0000 7f0fe0e00640 1 --2- 172.21.15.99:0/2132716282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fdc162e50 0x7f0fdc099730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.778+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2132716282 >> 172.21.15.99:0/2132716282 conn(0x7f0fdc0d0450 msgr2=0x7f0fdc0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:05.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.778+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2132716282 shutdown_connections 2024-03-30T13:11:05.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.778+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2132716282 wait complete. 2024-03-30T13:11:05.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.779+0000 7f0fe0e00640 1 Processor -- start 2024-03-30T13:11:05.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.780+0000 7f0fe0e00640 1 -- start start 2024-03-30T13:11:05.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.780+0000 7f0fe0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fdc099c70 0x7f0fdc0b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.780+0000 7f0fe0e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fdc0c6cc0 0x7f0fdc1f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.780+0000 7f0fe0e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fdc162e50 0x7f0fdc1f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.780+0000 7f0fe0e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0fdc0cfef0 con 0x7f0fdc099c70 2024-03-30T13:11:05.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.780+0000 7f0fe0e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0fdc0cfd70 con 0x7f0fdc162e50 2024-03-30T13:11:05.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.780+0000 7f0fe0e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0fdc0ce2f0 con 0x7f0fdc0c6cc0 2024-03-30T13:11:05.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.781+0000 7f0fd9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fdc099c70 0x7f0fdc0b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.781+0000 7f0fd9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fdc099c70 0x7f0fdc0b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49918/0 (socket says 172.21.15.99:49918) 2024-03-30T13:11:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.781+0000 7f0fd9e00640 1 -- 172.21.15.99:0/2409403834 learned_addr learned my addr 172.21.15.99:0/2409403834 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.781+0000 7f0fd1400640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fdc0c6cc0 0x7f0fdc1f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.781+0000 7f0fda800640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fdc162e50 0x7f0fdc1f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.781+0000 7f0fd9e00640 1 -- 172.21.15.99:0/2409403834 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fdc0c6cc0 msgr2=0x7f0fdc1f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.781+0000 7f0fd9e00640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fdc0c6cc0 0x7f0fdc1f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.781+0000 7f0fd9e00640 1 -- 172.21.15.99:0/2409403834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fdc162e50 msgr2=0x7f0fdc1f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.781+0000 7f0fd9e00640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fdc162e50 0x7f0fdc1f9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.781+0000 7f0fd9e00640 1 -- 172.21.15.99:0/2409403834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fdc1f9a90 con 0x7f0fdc099c70 2024-03-30T13:11:05.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.782+0000 7f0fd9e00640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fdc099c70 0x7f0fdc0b2340 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc02b8c0 tx=0x7f0fcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:05.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.782+0000 7f0fd2a00640 1 -- 172.21.15.99:0/2409403834 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc032880 con 0x7f0fdc099c70 2024-03-30T13:11:05.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.782+0000 7f0fd2a00640 1 -- 172.21.15.99:0/2409403834 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fcc032a40 con 0x7f0fdc099c70 2024-03-30T13:11:05.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.782+0000 7f0fd2a00640 1 -- 172.21.15.99:0/2409403834 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc032e30 con 0x7f0fdc099c70 2024-03-30T13:11:05.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.782+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2409403834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fdc1f9d40 con 0x7f0fdc099c70 2024-03-30T13:11:05.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.782+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2409403834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fdc1fca30 con 0x7f0fdc099c70 2024-03-30T13:11:05.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.783+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2409403834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fdc09e520 con 0x7f0fdc099c70 2024-03-30T13:11:05.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.785+0000 7f0fd2a00640 1 -- 172.21.15.99:0/2409403834 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0fcc04c060 con 0x7f0fdc099c70 2024-03-30T13:11:05.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.786+0000 7f0fd2a00640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0fb806c560 0x7f0fb806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:05.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.786+0000 7f0fd2a00640 1 -- 172.21.15.99:0/2409403834 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0fcc0ad150 con 0x7f0fdc099c70 2024-03-30T13:11:05.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.786+0000 7f0fd1400640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0fb806c560 0x7f0fb806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:05.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.787+0000 7f0fd1400640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0fb806c560 0x7f0fb806ea20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0c7a80 tx=0x7f0fc4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:05.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.796+0000 7f0fd2a00640 1 -- 172.21.15.99:0/2409403834 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0fcc040070 con 0x7f0fdc099c70 2024-03-30T13:11:05.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.989+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2409403834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0fdc04f9d0 con 0x7f0fdc099c70 2024-03-30T13:11:05.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.990+0000 7f0fd2a00640 1 -- 172.21.15.99:0/2409403834 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f0fcc07b920 con 0x7f0fdc099c70 2024-03-30T13:11:05.993 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.992+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2409403834 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0fb806c560 msgr2=0x7f0fb806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.992+0000 7f0fe0e00640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0fb806c560 0x7f0fb806ea20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0c7a80 tx=0x7f0fc4008040 comp rx=0 tx=0).stop 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.992+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2409403834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fdc099c70 msgr2=0x7f0fdc0b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.992+0000 7f0fe0e00640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fdc099c70 0x7f0fdc0b2340 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc02b8c0 tx=0x7f0fcc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.992+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2409403834 shutdown_connections 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.992+0000 7f0fe0e00640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0fb806c560 0x7f0fb806ea20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.992+0000 7f0fe0e00640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fdc162e50 0x7f0fdc1f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.992+0000 7f0fe0e00640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fdc0c6cc0 0x7f0fdc1f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.992+0000 7f0fe0e00640 1 --2- 172.21.15.99:0/2409403834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fdc099c70 0x7f0fdc0b2340 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.992+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2409403834 >> 172.21.15.99:0/2409403834 conn(0x7f0fdc0d0450 msgr2=0x7f0fdc06e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.993+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2409403834 shutdown_connections 2024-03-30T13:11:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:05.993+0000 7f0fe0e00640 1 -- 172.21.15.99:0/2409403834 wait complete. 2024-03-30T13:11:06.014 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:06.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.197+0000 7fd5d6c00640 1 Processor -- start 2024-03-30T13:11:06.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.197+0000 7fd5d6c00640 1 -- start start 2024-03-30T13:11:06.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.199+0000 7fd5d6c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd5d015b350 0x7fd5d0072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.199+0000 7fd5d6c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd5d00b0460 0x7fd5d00b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.199+0000 7fd5d6c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d00b38e0 con 0x7fd5d00b4600 2024-03-30T13:11:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.199+0000 7fd5d6c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d00b4a50 con 0x7fd5d00b0460 2024-03-30T13:11:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.199+0000 7fd5d6c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d00b3600 con 0x7fd5d015b350 2024-03-30T13:11:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.199+0000 7fd5d4e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd5d00b0460 0x7fd5d00b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.199+0000 7fd5d4e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd5d00b0460 0x7fd5d00b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49922/0 (socket says 172.21.15.99:49922) 2024-03-30T13:11:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.199+0000 7fd5d4e00640 1 -- 172.21.15.99:0/1593635224 learned_addr learned my addr 172.21.15.99:0/1593635224 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.200+0000 7fd5d4e00640 1 -- 172.21.15.99:0/1593635224 >> v2:172.21.15.181:3300/0 conn(0x7fd5d015b350 msgr2=0x7fd5d0072bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.200+0000 7fd5d4e00640 1 --2- 172.21.15.99:0/1593635224 >> v2:172.21.15.181:3300/0 conn(0x7fd5d015b350 0x7fd5d0072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.200+0000 7fd5d4e00640 1 -- 172.21.15.99:0/1593635224 >> v1:172.21.15.181:6789/0 conn(0x7fd5d00b4600 legacy=0x7fd5d00b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.200+0000 7fd5d4e00640 1 -- 172.21.15.99:0/1593635224 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d009ab40 con 0x7fd5d00b0460 2024-03-30T13:11:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.201+0000 7fd5d4e00640 1 --2- 172.21.15.99:0/1593635224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d00b0460 0x7fd5d00b40c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00b7190 tx=0x7fd5bc02da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cf114801b52eb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.201+0000 7fd5cfe00640 1 -- 172.21.15.99:0/1593635224 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc02f850 con 0x7fd5d00b0460 2024-03-30T13:11:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.201+0000 7fd5cfe00640 1 -- 172.21.15.99:0/1593635224 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5bc02f9f0 con 0x7fd5d00b0460 2024-03-30T13:11:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.201+0000 7fd5cfe00640 1 -- 172.21.15.99:0/1593635224 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc02fdc0 con 0x7fd5d00b0460 2024-03-30T13:11:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.202+0000 7fd5d6c00640 1 -- 172.21.15.99:0/1593635224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d00b0460 msgr2=0x7fd5d00b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.202+0000 7fd5d6c00640 1 --2- 172.21.15.99:0/1593635224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d00b0460 0x7fd5d00b40c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00b7190 tx=0x7fd5bc02da90 comp rx=0 tx=0).stop 2024-03-30T13:11:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.202+0000 7fd5d6c00640 1 -- 172.21.15.99:0/1593635224 shutdown_connections 2024-03-30T13:11:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.202+0000 7fd5d6c00640 1 --2- 172.21.15.99:0/1593635224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d00b0460 0x7fd5d00b40c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.202+0000 7fd5d6c00640 1 --2- 172.21.15.99:0/1593635224 >> v2:172.21.15.181:3300/0 conn(0x7fd5d015b350 0x7fd5d0072bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.202+0000 7fd5d6c00640 1 -- 172.21.15.99:0/1593635224 >> 172.21.15.99:0/1593635224 conn(0x7fd5d00b6d50 msgr2=0x7fd5d00b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.202+0000 7fd5d6c00640 1 -- 172.21.15.99:0/1593635224 shutdown_connections 2024-03-30T13:11:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.202+0000 7fd5d6c00640 1 -- 172.21.15.99:0/1593635224 wait complete. 2024-03-30T13:11:06.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.204+0000 7fd5d6c00640 1 Processor -- start 2024-03-30T13:11:06.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.205+0000 7fd5d6c00640 1 -- start start 2024-03-30T13:11:06.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.206+0000 7fd5d6c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5d00b0460 0x7fd5d01f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.206+0000 7fd5d6c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d00b4600 0x7fd5d0151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.206+0000 7fd5d6c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5d015b350 0x7fd5d014aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.206+0000 7fd5d6c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d00b0010 con 0x7fd5d00b4600 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.206+0000 7fd5d6c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d00afaf0 con 0x7fd5d015b350 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.206+0000 7fd5d6c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d00b0190 con 0x7fd5d00b0460 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.206+0000 7fd5d4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d00b4600 0x7fd5d0151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.206+0000 7fd5d4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d00b4600 0x7fd5d0151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49928/0 (socket says 172.21.15.99:49928) 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.206+0000 7fd5d4e00640 1 -- 172.21.15.99:0/721169520 learned_addr learned my addr 172.21.15.99:0/721169520 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5d6200640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5d015b350 0x7fd5d014aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5d5800640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5d00b0460 0x7fd5d01f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5d4e00640 1 -- 172.21.15.99:0/721169520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5d00b0460 msgr2=0x7fd5d01f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5d4e00640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5d00b0460 0x7fd5d01f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5d4e00640 1 -- 172.21.15.99:0/721169520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5d015b350 msgr2=0x7fd5d014aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:06.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5d4e00640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5d015b350 0x7fd5d014aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5d4e00640 1 -- 172.21.15.99:0/721169520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d014b3f0 con 0x7fd5d00b4600 2024-03-30T13:11:06.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5d6200640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5d015b350 0x7fd5d014aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:06.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5d4e00640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d00b4600 0x7fd5d0151d40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009960 tx=0x7fd5bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:06.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5cd600640 1 -- 172.21.15.99:0/721169520 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc047070 con 0x7fd5d00b4600 2024-03-30T13:11:06.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5cd600640 1 -- 172.21.15.99:0/721169520 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5bc039750 con 0x7fd5d00b4600 2024-03-30T13:11:06.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.207+0000 7fd5cd600640 1 -- 172.21.15.99:0/721169520 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc039b20 con 0x7fd5d00b4600 2024-03-30T13:11:06.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.208+0000 7fd5d6c00640 1 -- 172.21.15.99:0/721169520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d0151600 con 0x7fd5d00b4600 2024-03-30T13:11:06.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.208+0000 7fd5d6c00640 1 -- 172.21.15.99:0/721169520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d014fb20 con 0x7fd5d00b4600 2024-03-30T13:11:06.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.209+0000 7fd5d6c00640 1 -- 172.21.15.99:0/721169520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d014fd20 con 0x7fd5d00b4600 2024-03-30T13:11:06.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.211+0000 7fd5cd600640 1 -- 172.21.15.99:0/721169520 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd5bc039cc0 con 0x7fd5d00b4600 2024-03-30T13:11:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.211+0000 7fd5cd600640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd5b006c530 0x7fd5b006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.212+0000 7fd5cd600640 1 -- 172.21.15.99:0/721169520 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd5bc0acd60 con 0x7fd5d00b4600 2024-03-30T13:11:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.212+0000 7fd5d5800640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd5b006c530 0x7fd5b006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.212+0000 7fd5d5800640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd5b006c530 0x7fd5b006e9f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd5d014d2f0 tx=0x7fd5c4007310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:06.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.216+0000 7fd5cd600640 1 -- 172.21.15.99:0/721169520 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd5d014fd20 con 0x7fd5d00b4600 2024-03-30T13:11:06.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.509+0000 7fd5d6c00640 1 -- 172.21.15.99:0/721169520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd5d004f8f0 con 0x7fd5d00b4600 2024-03-30T13:11:06.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.510+0000 7fd5cd600640 1 -- 172.21.15.99:0/721169520 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fd5bc07b410 con 0x7fd5d00b4600 2024-03-30T13:11:06.513 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.512+0000 7fd5d6c00640 1 -- 172.21.15.99:0/721169520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd5b006c530 msgr2=0x7fd5b006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.512+0000 7fd5d6c00640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd5b006c530 0x7fd5b006e9f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd5d014d2f0 tx=0x7fd5c4007310 comp rx=0 tx=0).stop 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.512+0000 7fd5d6c00640 1 -- 172.21.15.99:0/721169520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d00b4600 msgr2=0x7fd5d0151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.512+0000 7fd5d6c00640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d00b4600 0x7fd5d0151d40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009960 tx=0x7fd5bc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.512+0000 7fd5d6c00640 1 -- 172.21.15.99:0/721169520 shutdown_connections 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.512+0000 7fd5d6c00640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd5b006c530 0x7fd5b006e9f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.512+0000 7fd5d6c00640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5d015b350 0x7fd5d014aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.512+0000 7fd5d6c00640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d00b4600 0x7fd5d0151d40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.512+0000 7fd5d6c00640 1 --2- 172.21.15.99:0/721169520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd5d00b0460 0x7fd5d01f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.513+0000 7fd5d6c00640 1 -- 172.21.15.99:0/721169520 >> 172.21.15.99:0/721169520 conn(0x7fd5d00b6d50 msgr2=0x7fd5d00af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.513+0000 7fd5d6c00640 1 -- 172.21.15.99:0/721169520 shutdown_connections 2024-03-30T13:11:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.513+0000 7fd5d6c00640 1 -- 172.21.15.99:0/721169520 wait complete. 2024-03-30T13:11:06.532 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:06.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.723+0000 7f7273600640 1 Processor -- start 2024-03-30T13:11:06.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.724+0000 7f7273600640 1 -- start start 2024-03-30T13:11:06.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.725+0000 7f7273600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f726c15e920 0x7f726c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.725+0000 7f7273600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f726c0d16a0 0x7f726c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.725+0000 7f7273600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f726c0d3780 con 0x7f726c0cfde0 2024-03-30T13:11:06.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.725+0000 7f7273600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f726c15ed00 con 0x7f726c0d16a0 2024-03-30T13:11:06.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.725+0000 7f7273600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f726c0d21e0 con 0x7f726c15e920 2024-03-30T13:11:06.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.725+0000 7f7271600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f726c0d16a0 0x7f726c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:06.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.725+0000 7f7271600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f726c0d16a0 0x7f726c0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49940/0 (socket says 172.21.15.99:49940) 2024-03-30T13:11:06.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.725+0000 7f7271600640 1 -- 172.21.15.99:0/1660850022 learned_addr learned my addr 172.21.15.99:0/1660850022 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:06.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.725+0000 7f726be00640 1 --1- 172.21.15.99:0/1660850022 >> v1:172.21.15.99:6789/0 conn(0x7f726c0cfde0 0x7f726c0d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35914/0 (socket says 172.21.15.99:35914) 2024-03-30T13:11:06.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.726+0000 7f7270c00640 1 --2- 172.21.15.99:0/1660850022 >> v2:172.21.15.181:3300/0 conn(0x7f726c15e920 0x7f726c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:06.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.726+0000 7f7271600640 1 -- 172.21.15.99:0/1660850022 >> v2:172.21.15.181:3300/0 conn(0x7f726c15e920 msgr2=0x7f726c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:06.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.726+0000 7f7271600640 1 --2- 172.21.15.99:0/1660850022 >> v2:172.21.15.181:3300/0 conn(0x7f726c15e920 0x7f726c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.726+0000 7f7271600640 1 -- 172.21.15.99:0/1660850022 >> v1:172.21.15.99:6789/0 conn(0x7f726c0cfde0 legacy=0x7f726c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:06.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.726+0000 7f7271600640 1 -- 172.21.15.99:0/1660850022 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c0d2480 con 0x7f726c0d16a0 2024-03-30T13:11:06.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.726+0000 7f7270c00640 1 --2- 172.21.15.99:0/1660850022 >> v2:172.21.15.181:3300/0 conn(0x7f726c15e920 0x7f726c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:06.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.727+0000 7f7271600640 1 --2- 172.21.15.99:0/1660850022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f726c0d16a0 0x7f726c0d0240 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f726c08e880 tx=0x7f726402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1b73a2164bb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:06.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.727+0000 7f726b400640 1 -- 172.21.15.99:0/1660850022 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264034070 con 0x7f726c0d16a0 2024-03-30T13:11:06.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.727+0000 7f726b400640 1 -- 172.21.15.99:0/1660850022 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7264030860 con 0x7f726c0d16a0 2024-03-30T13:11:06.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.727+0000 7f726b400640 1 -- 172.21.15.99:0/1660850022 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264030c30 con 0x7f726c0d16a0 2024-03-30T13:11:06.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.728+0000 7f7273600640 1 -- 172.21.15.99:0/1660850022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f726c0d16a0 msgr2=0x7f726c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:06.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.728+0000 7f7273600640 1 --2- 172.21.15.99:0/1660850022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f726c0d16a0 0x7f726c0d0240 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f726c08e880 tx=0x7f726402b9a0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.728+0000 7f7273600640 1 -- 172.21.15.99:0/1660850022 shutdown_connections 2024-03-30T13:11:06.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.728+0000 7f7273600640 1 --2- 172.21.15.99:0/1660850022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f726c0d16a0 0x7f726c0d0240 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.728+0000 7f7273600640 1 --2- 172.21.15.99:0/1660850022 >> v2:172.21.15.181:3300/0 conn(0x7f726c15e920 0x7f726c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.728+0000 7f7273600640 1 -- 172.21.15.99:0/1660850022 >> 172.21.15.99:0/1660850022 conn(0x7f726c08bfc0 msgr2=0x7f726c0d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:06.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.728+0000 7f7273600640 1 -- 172.21.15.99:0/1660850022 shutdown_connections 2024-03-30T13:11:06.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.728+0000 7f7273600640 1 -- 172.21.15.99:0/1660850022 wait complete. 2024-03-30T13:11:06.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.729+0000 7f7273600640 1 Processor -- start 2024-03-30T13:11:06.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.730+0000 7f7273600640 1 -- start start 2024-03-30T13:11:06.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.730+0000 7f7273600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f726c0cfde0 0x7f726c0ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.730+0000 7f7273600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f726c0d16a0 0x7f726c1e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.730+0000 7f7273600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f726c15e920 0x7f726c1ea1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.730+0000 7f7273600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f726c0d2d20 con 0x7f726c0cfde0 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.730+0000 7f7273600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f726c0d2a40 con 0x7f726c0d16a0 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.730+0000 7f7273600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f726c0d4ef0 con 0x7f726c15e920 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.731+0000 7f7270c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f726c0cfde0 0x7f726c0ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.731+0000 7f7270c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f726c0cfde0 0x7f726c0ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49952/0 (socket says 172.21.15.99:49952) 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.731+0000 7f7270c00640 1 -- 172.21.15.99:0/3081391657 learned_addr learned my addr 172.21.15.99:0/3081391657 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.731+0000 7f7271600640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f726c15e920 0x7f726c1ea1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.731+0000 7f7270c00640 1 -- 172.21.15.99:0/3081391657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f726c15e920 msgr2=0x7f726c1ea1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.731+0000 7f726be00640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f726c0d16a0 0x7f726c1e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.731+0000 7f7270c00640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f726c15e920 0x7f726c1ea1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.731+0000 7f7270c00640 1 -- 172.21.15.99:0/3081391657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f726c0d16a0 msgr2=0x7f726c1e9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:06.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.731+0000 7f7270c00640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f726c0d16a0 0x7f726c1e9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.731+0000 7f7270c00640 1 -- 172.21.15.99:0/3081391657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c1e91e0 con 0x7f726c0cfde0 2024-03-30T13:11:06.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.731+0000 7f7270c00640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f726c0cfde0 0x7f726c0ce170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f725c00cf60 tx=0x7f725c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:06.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.732+0000 7f7268c00640 1 -- 172.21.15.99:0/3081391657 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c01a070 con 0x7f726c0cfde0 2024-03-30T13:11:06.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.732+0000 7f7268c00640 1 -- 172.21.15.99:0/3081391657 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c00d840 con 0x7f726c0cfde0 2024-03-30T13:11:06.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.732+0000 7f7273600640 1 -- 172.21.15.99:0/3081391657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c1e8f00 con 0x7f726c0cfde0 2024-03-30T13:11:06.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.732+0000 7f7268c00640 1 -- 172.21.15.99:0/3081391657 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c00dc10 con 0x7f726c0cfde0 2024-03-30T13:11:06.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.732+0000 7f7273600640 1 -- 172.21.15.99:0/3081391657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c0cbad0 con 0x7f726c0cfde0 2024-03-30T13:11:06.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.733+0000 7f7273600640 1 -- 172.21.15.99:0/3081391657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c0a2560 con 0x7f726c0cfde0 2024-03-30T13:11:06.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.734+0000 7f7268c00640 1 -- 172.21.15.99:0/3081391657 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f725c01d070 con 0x7f726c0cfde0 2024-03-30T13:11:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.735+0000 7f7268c00640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f724806c530 0x7f724806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.735+0000 7f7268c00640 1 -- 172.21.15.99:0/3081391657 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f725c08be10 con 0x7f726c0cfde0 2024-03-30T13:11:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.735+0000 7f726be00640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f724806c530 0x7f724806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.736+0000 7f726be00640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f724806c530 0x7f724806e9f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f726c1e9c20 tx=0x7f7254009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:06.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.740+0000 7f7268c00640 1 -- 172.21.15.99:0/3081391657 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f725c059e70 con 0x7f726c0cfde0 2024-03-30T13:11:06.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.940+0000 7f7273600640 1 -- 172.21.15.99:0/3081391657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f726c04f9d0 con 0x7f726c0cfde0 2024-03-30T13:11:06.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.941+0000 7f7268c00640 1 -- 172.21.15.99:0/3081391657 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f725c05e170 con 0x7f726c0cfde0 2024-03-30T13:11:06.944 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:06.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 -- 172.21.15.99:0/3081391657 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f724806c530 msgr2=0x7f724806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:06.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f724806c530 0x7f724806e9f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f726c1e9c20 tx=0x7f7254009040 comp rx=0 tx=0).stop 2024-03-30T13:11:06.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 -- 172.21.15.99:0/3081391657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f726c0cfde0 msgr2=0x7f726c0ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:06.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f726c0cfde0 0x7f726c0ce170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f725c00cf60 tx=0x7f725c00cf90 comp rx=0 tx=0).stop 2024-03-30T13:11:06.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 -- 172.21.15.99:0/3081391657 shutdown_connections 2024-03-30T13:11:06.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f724806c530 0x7f724806e9f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f726c15e920 0x7f726c1ea1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f726c0d16a0 0x7f726c1e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 --2- 172.21.15.99:0/3081391657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f726c0cfde0 0x7f726c0ce170 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:06.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 -- 172.21.15.99:0/3081391657 >> 172.21.15.99:0/3081391657 conn(0x7f726c08bfc0 msgr2=0x7f726c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:06.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 -- 172.21.15.99:0/3081391657 shutdown_connections 2024-03-30T13:11:06.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:06.943+0000 7f7273600640 1 -- 172.21.15.99:0/3081391657 wait complete. 2024-03-30T13:11:06.965 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:07.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.163+0000 7f7a67600640 1 Processor -- start 2024-03-30T13:11:07.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.163+0000 7f7a67600640 1 -- start start 2024-03-30T13:11:07.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.165+0000 7f7a67600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7a600b3c50 0x7f7a600d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.165+0000 7f7a67600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a600d3140 0x7f7a6006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.165+0000 7f7a67600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a600cfb30 con 0x7f7a6015e930 2024-03-30T13:11:07.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.165+0000 7f7a67600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7a6006c780 con 0x7f7a600b3c50 2024-03-30T13:11:07.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.165+0000 7f7a67600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7a600cfe10 con 0x7f7a600d3140 2024-03-30T13:11:07.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.165+0000 7f7a65600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a600d3140 0x7f7a6006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.165+0000 7f7a5fe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7a600b3c50 0x7f7a600d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.165+0000 7f7a64c00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7a6015e930 0x7f7a600cf130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:33790/0 (socket says 172.21.15.99:33790) 2024-03-30T13:11:07.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.165+0000 7f7a64c00640 1 -- 172.21.15.99:0/3092110017 learned_addr learned my addr 172.21.15.99:0/3092110017 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:07.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.166+0000 7f7a65600640 1 -- 172.21.15.99:0/3092110017 >> v2:172.21.15.181:3300/0 conn(0x7f7a600b3c50 msgr2=0x7f7a600d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.166+0000 7f7a65600640 1 --2- 172.21.15.99:0/3092110017 >> v2:172.21.15.181:3300/0 conn(0x7f7a600b3c50 0x7f7a600d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.166+0000 7f7a5f400640 1 -- 172.21.15.99:0/3092110017 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235728377 0 0) 0x7f7a600cfb30 con 0x7f7a6015e930 2024-03-30T13:11:07.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.166+0000 7f7a65600640 1 -- 172.21.15.99:0/3092110017 >> v1:172.21.15.181:6789/0 conn(0x7f7a6015e930 legacy=0x7f7a600cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.166+0000 7f7a65600640 1 -- 172.21.15.99:0/3092110017 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a600d00f0 con 0x7f7a600d3140 2024-03-30T13:11:07.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.167+0000 7f7a65600640 1 --2- 172.21.15.99:0/3092110017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a600d3140 0x7f7a6006cc10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009d90 tx=0x7f7a5802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cf97029c480abfc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.168+0000 7f7a5f400640 1 -- 172.21.15.99:0/3092110017 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58039070 con 0x7f7a600d3140 2024-03-30T13:11:07.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.168+0000 7f7a5f400640 1 -- 172.21.15.99:0/3092110017 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5802cbc0 con 0x7f7a600d3140 2024-03-30T13:11:07.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.168+0000 7f7a5f400640 1 -- 172.21.15.99:0/3092110017 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58034440 con 0x7f7a600d3140 2024-03-30T13:11:07.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.168+0000 7f7a67600640 1 -- 172.21.15.99:0/3092110017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a600d3140 msgr2=0x7f7a6006cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.168+0000 7f7a67600640 1 --2- 172.21.15.99:0/3092110017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a600d3140 0x7f7a6006cc10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009d90 tx=0x7f7a5802be10 comp rx=0 tx=0).stop 2024-03-30T13:11:07.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.169+0000 7f7a67600640 1 -- 172.21.15.99:0/3092110017 shutdown_connections 2024-03-30T13:11:07.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.169+0000 7f7a67600640 1 --2- 172.21.15.99:0/3092110017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a600d3140 0x7f7a6006cc10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.169+0000 7f7a67600640 1 --2- 172.21.15.99:0/3092110017 >> v2:172.21.15.181:3300/0 conn(0x7f7a600b3c50 0x7f7a600d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.169+0000 7f7a67600640 1 -- 172.21.15.99:0/3092110017 >> 172.21.15.99:0/3092110017 conn(0x7f7a6008bfc0 msgr2=0x7f7a600d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:07.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.169+0000 7f7a67600640 1 -- 172.21.15.99:0/3092110017 shutdown_connections 2024-03-30T13:11:07.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.169+0000 7f7a67600640 1 -- 172.21.15.99:0/3092110017 wait complete. 2024-03-30T13:11:07.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.170+0000 7f7a67600640 1 Processor -- start 2024-03-30T13:11:07.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.171+0000 7f7a67600640 1 -- start start 2024-03-30T13:11:07.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.172+0000 7f7a67600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a600b3c50 0x7f7a600cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.172+0000 7f7a67600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a600d3140 0x7f7a60160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.172+0000 7f7a67600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a6015e930 0x7f7a60155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.172+0000 7f7a67600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6015ed10 con 0x7f7a6015e930 2024-03-30T13:11:07.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.172+0000 7f7a67600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7a600cf840 con 0x7f7a600b3c50 2024-03-30T13:11:07.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.172+0000 7f7a67600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6015ee90 con 0x7f7a600d3140 2024-03-30T13:11:07.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.173+0000 7f7a65600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a6015e930 0x7f7a60155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.173+0000 7f7a65600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a6015e930 0x7f7a60155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49968/0 (socket says 172.21.15.99:49968) 2024-03-30T13:11:07.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.173+0000 7f7a65600640 1 -- 172.21.15.99:0/743278733 learned_addr learned my addr 172.21.15.99:0/743278733 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:07.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.173+0000 7f7a64c00640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a600b3c50 0x7f7a600cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.173+0000 7f7a5fe00640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a600d3140 0x7f7a60160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.173+0000 7f7a65600640 1 -- 172.21.15.99:0/743278733 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a600d3140 msgr2=0x7f7a60160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.173+0000 7f7a65600640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a600d3140 0x7f7a60160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.173+0000 7f7a65600640 1 -- 172.21.15.99:0/743278733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a600b3c50 msgr2=0x7f7a600cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.173+0000 7f7a65600640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a600b3c50 0x7f7a600cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.173+0000 7f7a65600640 1 -- 172.21.15.99:0/743278733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a601614c0 con 0x7f7a6015e930 2024-03-30T13:11:07.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.173+0000 7f7a65600640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a6015e930 0x7f7a60155fe0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7a58037040 tx=0x7f7a58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.174+0000 7f7a5cc00640 1 -- 172.21.15.99:0/743278733 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58039050 con 0x7f7a6015e930 2024-03-30T13:11:07.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.174+0000 7f7a5cc00640 1 -- 172.21.15.99:0/743278733 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a58045070 con 0x7f7a6015e930 2024-03-30T13:11:07.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.174+0000 7f7a5cc00640 1 -- 172.21.15.99:0/743278733 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58009450 con 0x7f7a6015e930 2024-03-30T13:11:07.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.174+0000 7f7a67600640 1 -- 172.21.15.99:0/743278733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a601617a0 con 0x7f7a6015e930 2024-03-30T13:11:07.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.174+0000 7f7a67600640 1 -- 172.21.15.99:0/743278733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6015f0e0 con 0x7f7a6015e930 2024-03-30T13:11:07.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.175+0000 7f7a67600640 1 -- 172.21.15.99:0/743278733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a60068640 con 0x7f7a6015e930 2024-03-30T13:11:07.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.176+0000 7f7a5cc00640 1 -- 172.21.15.99:0/743278733 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7a5803e850 con 0x7f7a6015e930 2024-03-30T13:11:07.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.177+0000 7f7a5cc00640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a4006c530 0x7f7a4006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.177+0000 7f7a5cc00640 1 -- 172.21.15.99:0/743278733 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7a580ae460 con 0x7f7a6015e930 2024-03-30T13:11:07.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.177+0000 7f7a64c00640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a4006c530 0x7f7a4006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.178+0000 7f7a64c00640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a4006c530 0x7f7a4006e9f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7a54000f60 tx=0x7f7a54007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.184+0000 7f7a5cc00640 1 -- 172.21.15.99:0/743278733 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7a5807c960 con 0x7f7a6015e930 2024-03-30T13:11:07.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.478+0000 7f7a67600640 1 -- 172.21.15.99:0/743278733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a600d25a0 con 0x7f7a6015e930 2024-03-30T13:11:07.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.479+0000 7f7a5cc00640 1 -- 172.21.15.99:0/743278733 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f7a5807c260 con 0x7f7a6015e930 2024-03-30T13:11:07.483 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:07.483 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2695284429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2695284429},{"type":"v1","addr":"172.21.15.181:6835","nonce":2695284429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1658040869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1658040869},{"type":"v1","addr":"172.21.15.181:6833","nonce":1658040869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/951752489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":951752489},{"type":"v1","addr":"172.21.15.99:6835","nonce":951752489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:10:45.658137+0000","modified":"2024-03-30T13:10:48.749437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/245796495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":245796495},{"type":"v1","addr":"172.21.15.99:6837","nonce":245796495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-03-30T13:11:07.483 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-03-30T13:11:07.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.482+0000 7f7a67600640 1 -- 172.21.15.99:0/743278733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a4006c530 msgr2=0x7f7a4006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.482+0000 7f7a67600640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a4006c530 0x7f7a4006e9f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7a54000f60 tx=0x7f7a54007c00 comp rx=0 tx=0).stop 2024-03-30T13:11:07.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.482+0000 7f7a67600640 1 -- 172.21.15.99:0/743278733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a6015e930 msgr2=0x7f7a60155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.482+0000 7f7a67600640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a6015e930 0x7f7a60155fe0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7a58037040 tx=0x7f7a58004a40 comp rx=0 tx=0).stop 2024-03-30T13:11:07.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.483+0000 7f7a67600640 1 -- 172.21.15.99:0/743278733 shutdown_connections 2024-03-30T13:11:07.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.483+0000 7f7a67600640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a4006c530 0x7f7a4006e9f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.483+0000 7f7a67600640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a6015e930 0x7f7a60155fe0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.483+0000 7f7a67600640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a600d3140 0x7f7a60160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.483+0000 7f7a67600640 1 --2- 172.21.15.99:0/743278733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a600b3c50 0x7f7a600cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.483+0000 7f7a67600640 1 -- 172.21.15.99:0/743278733 >> 172.21.15.99:0/743278733 conn(0x7f7a6008bfc0 msgr2=0x7f7a6006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:07.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.483+0000 7f7a67600640 1 -- 172.21.15.99:0/743278733 shutdown_connections 2024-03-30T13:11:07.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.483+0000 7f7a67600640 1 -- 172.21.15.99:0/743278733 wait complete. 2024-03-30T13:11:07.504 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:07.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.695+0000 7f7fcaa00640 1 Processor -- start 2024-03-30T13:11:07.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.696+0000 7f7fcaa00640 1 -- start start 2024-03-30T13:11:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.697+0000 7f7fcaa00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc415c000 0x7f7fc415fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.697+0000 7f7fcaa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7fc40d2920 0x7f7fc40cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.698+0000 7f7fcaa00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc406c780 con 0x7f7fc415c3e0 2024-03-30T13:11:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.698+0000 7f7fcaa00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc406ca60 con 0x7f7fc40d2920 2024-03-30T13:11:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.698+0000 7f7fcaa00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc406cd40 con 0x7f7fc415c000 2024-03-30T13:11:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.698+0000 7f7fca000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7fc40d2920 0x7f7fc40cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.698+0000 7f7fca000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7fc40d2920 0x7f7fc40cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49984/0 (socket says 172.21.15.99:49984) 2024-03-30T13:11:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.698+0000 7f7fca000640 1 -- 172.21.15.99:0/3442473010 learned_addr learned my addr 172.21.15.99:0/3442473010 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.698+0000 7f7fc9600640 1 --2- 172.21.15.99:0/3442473010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc415c000 0x7f7fc415fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.698+0000 7f7fca000640 1 -- 172.21.15.99:0/3442473010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc415c000 msgr2=0x7f7fc415fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.698+0000 7f7fca000640 1 --2- 172.21.15.99:0/3442473010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc415c000 0x7f7fc415fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.698+0000 7f7fca000640 1 -- 172.21.15.99:0/3442473010 >> v1:172.21.15.181:6789/0 conn(0x7f7fc415c3e0 legacy=0x7f7fc40d2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.698+0000 7f7fca000640 1 -- 172.21.15.99:0/3442473010 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc406d020 con 0x7f7fc40d2920 2024-03-30T13:11:07.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.699+0000 7f7fca000640 1 --2- 172.21.15.99:0/3442473010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc40d2920 0x7f7fc40cfec0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009870 tx=0x7f7fbc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de1c1d029711eab server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.700+0000 7f7fc3e00640 1 -- 172.21.15.99:0/3442473010 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc034070 con 0x7f7fc40d2920 2024-03-30T13:11:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.700+0000 7f7fc3e00640 1 -- 172.21.15.99:0/3442473010 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fbc030840 con 0x7f7fc40d2920 2024-03-30T13:11:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.700+0000 7f7fc3e00640 1 -- 172.21.15.99:0/3442473010 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc030c10 con 0x7f7fc40d2920 2024-03-30T13:11:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.700+0000 7f7fcaa00640 1 -- 172.21.15.99:0/3442473010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc40d2920 msgr2=0x7f7fc40cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.700+0000 7f7fcaa00640 1 --2- 172.21.15.99:0/3442473010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc40d2920 0x7f7fc40cfec0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009870 tx=0x7f7fbc02b980 comp rx=0 tx=0).stop 2024-03-30T13:11:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.700+0000 7f7fcaa00640 1 -- 172.21.15.99:0/3442473010 shutdown_connections 2024-03-30T13:11:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.700+0000 7f7fcaa00640 1 --2- 172.21.15.99:0/3442473010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc40d2920 0x7f7fc40cfec0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.700+0000 7f7fcaa00640 1 --2- 172.21.15.99:0/3442473010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc415c000 0x7f7fc415fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.700+0000 7f7fcaa00640 1 -- 172.21.15.99:0/3442473010 >> 172.21.15.99:0/3442473010 conn(0x7f7fc406f890 msgr2=0x7f7fc406fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.701+0000 7f7fcaa00640 1 -- 172.21.15.99:0/3442473010 shutdown_connections 2024-03-30T13:11:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.701+0000 7f7fcaa00640 1 -- 172.21.15.99:0/3442473010 wait complete. 2024-03-30T13:11:07.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.702+0000 7f7fcaa00640 1 Processor -- start 2024-03-30T13:11:07.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.702+0000 7f7fcaa00640 1 -- start start 2024-03-30T13:11:07.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.703+0000 7f7fcaa00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc40d2920 0x7f7fc4160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.703+0000 7f7fcaa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7fc415c000 0x7f7fc41570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.703+0000 7f7fcaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc415c3e0 0x7f7fc41603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.703+0000 7f7fcaa00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc40d0580 con 0x7f7fc415c3e0 2024-03-30T13:11:07.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.703+0000 7f7fcaa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc40d0400 con 0x7f7fc415c000 2024-03-30T13:11:07.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.703+0000 7f7fcaa00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc40d0700 con 0x7f7fc40d2920 2024-03-30T13:11:07.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.703+0000 7f7fca000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc415c3e0 0x7f7fc41603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.703+0000 7f7fca000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc415c3e0 0x7f7fc41603e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49996/0 (socket says 172.21.15.99:49996) 2024-03-30T13:11:07.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.703+0000 7f7fca000640 1 -- 172.21.15.99:0/2867156772 learned_addr learned my addr 172.21.15.99:0/2867156772 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:07.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fc9600640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc40d2920 0x7f7fc4160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fca000640 1 -- 172.21.15.99:0/2867156772 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc40d2920 msgr2=0x7f7fc4160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fca000640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc40d2920 0x7f7fc4160dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fca000640 1 -- 172.21.15.99:0/2867156772 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7fc415c000 msgr2=0x7f7fc41570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fca000640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7fc415c000 0x7f7fc41570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fca000640 1 -- 172.21.15.99:0/2867156772 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc41542f0 con 0x7f7fc415c3e0 2024-03-30T13:11:07.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fc9600640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc40d2920 0x7f7fc4160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:07.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fca000640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc415c3e0 0x7f7fc41603e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc02b9c0 tx=0x7f7fbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fc1600640 1 -- 172.21.15.99:0/2867156772 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc048070 con 0x7f7fc415c3e0 2024-03-30T13:11:07.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fc1600640 1 -- 172.21.15.99:0/2867156772 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fbc030640 con 0x7f7fc415c3e0 2024-03-30T13:11:07.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fc1600640 1 -- 172.21.15.99:0/2867156772 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc034040 con 0x7f7fc415c3e0 2024-03-30T13:11:07.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.704+0000 7f7fcaa00640 1 -- 172.21.15.99:0/2867156772 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc4154590 con 0x7f7fc415c3e0 2024-03-30T13:11:07.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.705+0000 7f7fcaa00640 1 -- 172.21.15.99:0/2867156772 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc4161430 con 0x7f7fc415c3e0 2024-03-30T13:11:07.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.706+0000 7f7fcaa00640 1 -- 172.21.15.99:0/2867156772 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc404f8f0 con 0x7f7fc415c3e0 2024-03-30T13:11:07.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.707+0000 7f7fc1600640 1 -- 172.21.15.99:0/2867156772 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7fbc04b070 con 0x7f7fc415c3e0 2024-03-30T13:11:07.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.709+0000 7f7fc1600640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 0x7f7fa806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:07.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.709+0000 7f7fc1600640 1 -- 172.21.15.99:0/2867156772 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7fbc0ad750 con 0x7f7fc415c3e0 2024-03-30T13:11:07.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.709+0000 7f7fc9600640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 0x7f7fa806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:07.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.710+0000 7f7fc9600640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 0x7f7fa806e9f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4006fd0 tx=0x7f7fb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:07.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.713+0000 7f7fc1600640 1 -- 172.21.15.99:0/2867156772 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7fbc07bd60 con 0x7f7fc415c3e0 2024-03-30T13:11:07.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.942+0000 7f7fcaa00640 1 -- 172.21.15.99:0/2867156772 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fc415e950 con 0x7f7fc415c3e0 2024-03-30T13:11:07.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.944+0000 7f7fc1600640 1 -- 172.21.15.99:0/2867156772 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16609 (secure 0 0 0) 0x7f7fbc030810 con 0x7f7fc415c3e0 2024-03-30T13:11:07.947 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:07.947 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":22,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:47.229108+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.947+0000 7f7fcaa00640 1 -- 172.21.15.99:0/2867156772 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 msgr2=0x7f7fa806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.947+0000 7f7fcaa00640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 0x7f7fa806e9f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4006fd0 tx=0x7f7fb4008040 comp rx=0 tx=0).stop 2024-03-30T13:11:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.947+0000 7f7fcaa00640 1 -- 172.21.15.99:0/2867156772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc415c3e0 msgr2=0x7f7fc41603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.947+0000 7f7fcaa00640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc415c3e0 0x7f7fc41603e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc02b9c0 tx=0x7f7fbc004730 comp rx=0 tx=0).stop 2024-03-30T13:11:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.948+0000 7f7fcaa00640 1 -- 172.21.15.99:0/2867156772 shutdown_connections 2024-03-30T13:11:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.948+0000 7f7fcaa00640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 0x7f7fa806e9f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.948+0000 7f7fcaa00640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc415c3e0 0x7f7fc41603e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.948+0000 7f7fcaa00640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7fc415c000 0x7f7fc41570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.948+0000 7f7fcaa00640 1 --2- 172.21.15.99:0/2867156772 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc40d2920 0x7f7fc4160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.948+0000 7f7fcaa00640 1 -- 172.21.15.99:0/2867156772 >> 172.21.15.99:0/2867156772 conn(0x7f7fc406f890 msgr2=0x7f7fc415dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.948+0000 7f7fcaa00640 1 -- 172.21.15.99:0/2867156772 shutdown_connections 2024-03-30T13:11:07.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:07.948+0000 7f7fcaa00640 1 -- 172.21.15.99:0/2867156772 wait complete. 2024-03-30T13:11:07.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:08.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.168+0000 7fb893000640 1 Processor -- start 2024-03-30T13:11:08.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.168+0000 7fb893000640 1 -- start start 2024-03-30T13:11:08.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.169+0000 7fb893000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb88c0d2f50 0x7fb88c162330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:08.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.169+0000 7fb893000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb88c15ec40 con 0x7fb88c15e860 2024-03-30T13:11:08.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.169+0000 7fb893000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb88c0d15d0 con 0x7fb88c0d10d0 2024-03-30T13:11:08.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.169+0000 7fb893000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb88c070140 con 0x7fb88c0d2f50 2024-03-30T13:11:08.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.170+0000 7fb88be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb88c15e860 0x7fb88c0705d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35930/0 (socket says 172.21.15.99:35930) 2024-03-30T13:11:08.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.170+0000 7fb88be00640 1 -- 172.21.15.99:0/3660726824 learned_addr learned my addr 172.21.15.99:0/3660726824 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:08.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.170+0000 7fb891000640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb88c0d2f50 0x7fb88c162330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:08.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.170+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2783159645 0 0) 0x7fb88c15ec40 con 0x7fb88c15e860 2024-03-30T13:11:08.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.170+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb870003520 con 0x7fb88c15e860 2024-03-30T13:11:08.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.170+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 577325622 0 0) 0x7fb870003520 con 0x7fb88c15e860 2024-03-30T13:11:08.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.170+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb88c0d2f50 msgr2=0x7fb88c162330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:08.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.170+0000 7fb88aa00640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb88c0d2f50 0x7fb88c162330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:08.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 >> v1:172.21.15.181:6789/0 conn(0x7fb88c0d10d0 legacy=0x7fb88c0cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:08.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c0d18b0 con 0x7fb88c15e860 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fb87c001670 con 0x7fb88c15e860 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb891000640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb88c0d2f50 0x7fb88c162330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 >> v1:172.21.15.99:6789/0 conn(0x7fb88c15e860 legacy=0x7fb88c0705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88aa00640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8700039e0 0x7fb870003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88aa00640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870004800 0x7fb870004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88aa00640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb88c0d2f50 0x7fb870005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c070140 con 0x7fb8700039e0 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb87000bb50 con 0x7fb870004800 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb87000bd50 con 0x7fb88c0d2f50 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88be00640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8700039e0 0x7fb870003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88b400640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870004800 0x7fb870004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88be00640 1 -- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb88c0d2f50 msgr2=0x7fb870005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb891000640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb88c0d2f50 0x7fb870005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88be00640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb88c0d2f50 0x7fb870005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88be00640 1 -- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870004800 msgr2=0x7fb870004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88be00640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870004800 0x7fb870004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.171+0000 7fb88be00640 1 -- 172.21.15.99:0/3660726824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb870003520 con 0x7fb8700039e0 2024-03-30T13:11:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.172+0000 7fb88b400640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870004800 0x7fb870004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:08.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.173+0000 7fb88be00640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8700039e0 0x7fb870003e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c110 tx=0x7fb870005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6b71098fe8335e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:08.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.173+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c007c40 con 0x7fb8700039e0 2024-03-30T13:11:08.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.173+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb87c030070 con 0x7fb8700039e0 2024-03-30T13:11:08.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.173+0000 7fb88aa00640 1 -- 172.21.15.99:0/3660726824 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c005d30 con 0x7fb8700039e0 2024-03-30T13:11:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.173+0000 7fb893000640 1 -- 172.21.15.99:0/3660726824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8700039e0 msgr2=0x7fb870003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.173+0000 7fb893000640 1 --2- 172.21.15.99:0/3660726824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8700039e0 0x7fb870003e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c110 tx=0x7fb870005830 comp rx=0 tx=0).stop 2024-03-30T13:11:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.173+0000 7fb891000640 1 -- 172.21.15.99:0/3660726824 reap_dead start 2024-03-30T13:11:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.173+0000 7fb893000640 1 -- 172.21.15.99:0/3660726824 shutdown_connections 2024-03-30T13:11:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.173+0000 7fb893000640 1 -- 172.21.15.99:0/3660726824 >> 172.21.15.99:0/3660726824 conn(0x7fb88c0d2430 msgr2=0x7fb88c0d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.173+0000 7fb893000640 1 -- 172.21.15.99:0/3660726824 shutdown_connections 2024-03-30T13:11:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.174+0000 7fb893000640 1 -- 172.21.15.99:0/3660726824 wait complete. 2024-03-30T13:11:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.176+0000 7fb893000640 1 Processor -- start 2024-03-30T13:11:08.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.176+0000 7fb893000640 1 -- start start 2024-03-30T13:11:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.178+0000 7fb893000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8700039e0 0x7fb88c1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.178+0000 7fb893000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c153970 0x7fb88c153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.178+0000 7fb893000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb88c0c8060 0x7fb88c0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.178+0000 7fb893000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c163090 con 0x7fb88c153970 2024-03-30T13:11:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.178+0000 7fb893000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c06fdd0 con 0x7fb88c0c8060 2024-03-30T13:11:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.178+0000 7fb893000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb88c070ce0 con 0x7fb8700039e0 2024-03-30T13:11:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.178+0000 7fb88b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c153970 0x7fb88c153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.178+0000 7fb88b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c153970 0x7fb88c153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50014/0 (socket says 172.21.15.99:50014) 2024-03-30T13:11:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.178+0000 7fb88b400640 1 -- 172.21.15.99:0/177520883 learned_addr learned my addr 172.21.15.99:0/177520883 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb88be00640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8700039e0 0x7fb88c1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb891000640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb88c0c8060 0x7fb88c0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb88b400640 1 -- 172.21.15.99:0/177520883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8700039e0 msgr2=0x7fb88c1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb88b400640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8700039e0 0x7fb88c1529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb88b400640 1 -- 172.21.15.99:0/177520883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb88c0c8060 msgr2=0x7fb88c0c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb88b400640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb88c0c8060 0x7fb88c0c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb88b400640 1 -- 172.21.15.99:0/177520883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c152f10 con 0x7fb88c153970 2024-03-30T13:11:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb891000640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb88c0c8060 0x7fb88c0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb88b400640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c153970 0x7fb88c153df0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb87800d7d0 tx=0x7fb87800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb883e00640 1 -- 172.21.15.99:0/177520883 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb878005270 con 0x7fb88c153970 2024-03-30T13:11:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb883e00640 1 -- 172.21.15.99:0/177520883 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb878017070 con 0x7fb88c153970 2024-03-30T13:11:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb883e00640 1 -- 172.21.15.99:0/177520883 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87800b6b0 con 0x7fb88c153970 2024-03-30T13:11:08.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.179+0000 7fb893000640 1 -- 172.21.15.99:0/177520883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88c155ac0 con 0x7fb88c153970 2024-03-30T13:11:08.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.180+0000 7fb893000640 1 -- 172.21.15.99:0/177520883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88c156080 con 0x7fb88c153970 2024-03-30T13:11:08.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.181+0000 7fb893000640 1 -- 172.21.15.99:0/177520883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88c068640 con 0x7fb88c153970 2024-03-30T13:11:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.181+0000 7fb883e00640 1 -- 172.21.15.99:0/177520883 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb87800b850 con 0x7fb88c153970 2024-03-30T13:11:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.182+0000 7fb883e00640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb86c06c530 0x7fb86c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.182+0000 7fb883e00640 1 -- 172.21.15.99:0/177520883 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb87808b4f0 con 0x7fb88c153970 2024-03-30T13:11:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.183+0000 7fb88be00640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb86c06c530 0x7fb86c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:08.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.183+0000 7fb88be00640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb86c06c530 0x7fb86c06e9f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb87c034000 tx=0x7fb87c009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:08.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.187+0000 7fb883e00640 1 -- 172.21.15.99:0/177520883 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb88c152f10 con 0x7fb88c153970 2024-03-30T13:11:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.502+0000 7fb893000640 1 -- 172.21.15.99:0/177520883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb88c0b83b0 con 0x7fb88c153970 2024-03-30T13:11:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.503+0000 7fb883e00640 1 -- 172.21.15.99:0/177520883 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7fb878019310 con 0x7fb88c153970 2024-03-30T13:11:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:08.506 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2695284429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2695284429},{"type":"v1","addr":"172.21.15.181:6835","nonce":2695284429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1658040869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1658040869},{"type":"v1","addr":"172.21.15.181:6833","nonce":1658040869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/951752489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":951752489},{"type":"v1","addr":"172.21.15.99:6835","nonce":951752489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:10:45.658137+0000","modified":"2024-03-30T13:10:48.749437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/245796495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":245796495},{"type":"v1","addr":"172.21.15.99:6837","nonce":245796495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-03-30T13:11:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-03-30T13:11:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.506+0000 7fb893000640 1 -- 172.21.15.99:0/177520883 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb86c06c530 msgr2=0x7fb86c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.506+0000 7fb893000640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb86c06c530 0x7fb86c06e9f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb87c034000 tx=0x7fb87c009030 comp rx=0 tx=0).stop 2024-03-30T13:11:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.506+0000 7fb893000640 1 -- 172.21.15.99:0/177520883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c153970 msgr2=0x7fb88c153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.506+0000 7fb893000640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c153970 0x7fb88c153df0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb87800d7d0 tx=0x7fb87800dc90 comp rx=0 tx=0).stop 2024-03-30T13:11:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.506+0000 7fb893000640 1 -- 172.21.15.99:0/177520883 shutdown_connections 2024-03-30T13:11:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.506+0000 7fb893000640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb86c06c530 0x7fb86c06e9f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.506+0000 7fb893000640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb88c0c8060 0x7fb88c0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.506+0000 7fb893000640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c153970 0x7fb88c153df0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.506+0000 7fb893000640 1 --2- 172.21.15.99:0/177520883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8700039e0 0x7fb88c1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.506+0000 7fb893000640 1 -- 172.21.15.99:0/177520883 >> 172.21.15.99:0/177520883 conn(0x7fb88c0d2430 msgr2=0x7fb88c15c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.507+0000 7fb893000640 1 -- 172.21.15.99:0/177520883 shutdown_connections 2024-03-30T13:11:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:08.507+0000 7fb893000640 1 -- 172.21.15.99:0/177520883 wait complete. 2024-03-30T13:11:08.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T13:10:45.658137+0000', 'modified': '2024-03-30T13:10:48.749437+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6837/245796495', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 245796495}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 245796495}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4284, 'qdb_cluster': [4284]} 2024-03-30T13:11:08.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-30T13:11:08.932 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-30T13:11:09.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.152+0000 7f095a600640 1 Processor -- start 2024-03-30T13:11:09.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.152+0000 7f095a600640 1 -- start start 2024-03-30T13:11:09.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.154+0000 7f095a600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f09540b5480 0x7f09540d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.154+0000 7f095a600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09540d4790 0x7f09540b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.154+0000 7f095a600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09540d2b80 con 0x7f095415e590 2024-03-30T13:11:09.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.154+0000 7f095a600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f09540d4c20 con 0x7f09540b5480 2024-03-30T13:11:09.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.154+0000 7f095a600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f09540b1110 con 0x7f09540d4790 2024-03-30T13:11:09.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.154+0000 7f0953e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f09540b5480 0x7f09540d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.154+0000 7f0959200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f095415e590 0x7f09540b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35942/0 (socket says 172.21.15.99:35942) 2024-03-30T13:11:09.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.154+0000 7f0959200640 1 -- 172.21.15.99:0/2906788160 learned_addr learned my addr 172.21.15.99:0/2906788160 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:09.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.155+0000 7f0959c00640 1 --2- 172.21.15.99:0/2906788160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09540d4790 0x7f09540b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.155+0000 7f0953e00640 1 -- 172.21.15.99:0/2906788160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09540d4790 msgr2=0x7f09540b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.155+0000 7f0953e00640 1 --2- 172.21.15.99:0/2906788160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09540d4790 0x7f09540b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.155+0000 7f0953e00640 1 -- 172.21.15.99:0/2906788160 >> v1:172.21.15.99:6789/0 conn(0x7f095415e590 legacy=0x7f09540b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.155+0000 7f0953e00640 1 -- 172.21.15.99:0/2906788160 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09540b5930 con 0x7f09540b5480 2024-03-30T13:11:09.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.155+0000 7f0953400640 1 -- 172.21.15.99:0/2906788160 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903838823 0 0) 0x7f093c001110 con 0x7f095415e590 2024-03-30T13:11:09.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.155+0000 7f0959c00640 1 --2- 172.21.15.99:0/2906788160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09540d4790 0x7f09540b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.156+0000 7f0953e00640 1 --2- 172.21.15.99:0/2906788160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09540b5480 0x7f09540d4250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0944009d90 tx=0x7f094402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e47145ddff8c05a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.156+0000 7f0953400640 1 -- 172.21.15.99:0/2906788160 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944039070 con 0x7f09540b5480 2024-03-30T13:11:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.156+0000 7f0953400640 1 -- 172.21.15.99:0/2906788160 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094402cbd0 con 0x7f09540b5480 2024-03-30T13:11:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.156+0000 7f0953400640 1 -- 172.21.15.99:0/2906788160 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944034440 con 0x7f09540b5480 2024-03-30T13:11:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.157+0000 7f095a600640 1 -- 172.21.15.99:0/2906788160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09540b5480 msgr2=0x7f09540d4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.157+0000 7f095a600640 1 --2- 172.21.15.99:0/2906788160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09540b5480 0x7f09540d4250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0944009d90 tx=0x7f094402be20 comp rx=0 tx=0).stop 2024-03-30T13:11:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.157+0000 7f095a600640 1 -- 172.21.15.99:0/2906788160 shutdown_connections 2024-03-30T13:11:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.157+0000 7f095a600640 1 --2- 172.21.15.99:0/2906788160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09540d4790 0x7f09540b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.157+0000 7f095a600640 1 --2- 172.21.15.99:0/2906788160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09540b5480 0x7f09540d4250 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.157+0000 7f095a600640 1 -- 172.21.15.99:0/2906788160 >> 172.21.15.99:0/2906788160 conn(0x7f095409d820 msgr2=0x7f095408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.157+0000 7f095a600640 1 -- 172.21.15.99:0/2906788160 shutdown_connections 2024-03-30T13:11:09.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.157+0000 7f095a600640 1 -- 172.21.15.99:0/2906788160 wait complete. 2024-03-30T13:11:09.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.159+0000 7f095a600640 1 Processor -- start 2024-03-30T13:11:09.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.159+0000 7f095a600640 1 -- start start 2024-03-30T13:11:09.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f095a600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09540b5480 0x7f09540b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f095a600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09540d4790 0x7f09540cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f095a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f095415e590 0x7f09540cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f095a600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f09540b1640 con 0x7f095415e590 2024-03-30T13:11:09.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f095a600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f09540b1360 con 0x7f09540d4790 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f095a600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f095415e970 con 0x7f09540b5480 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f0959c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f095415e590 0x7f09540cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f0959c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f095415e590 0x7f09540cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50030/0 (socket says 172.21.15.99:50030) 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f0959c00640 1 -- 172.21.15.99:0/3984501216 learned_addr learned my addr 172.21.15.99:0/3984501216 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f0959200640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09540b5480 0x7f09540b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f0953e00640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09540d4790 0x7f09540cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f0959c00640 1 -- 172.21.15.99:0/3984501216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09540b5480 msgr2=0x7f09540b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.160+0000 7f0959c00640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09540b5480 0x7f09540b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.161+0000 7f0959c00640 1 -- 172.21.15.99:0/3984501216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09540d4790 msgr2=0x7f09540cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.161+0000 7f0959c00640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09540d4790 0x7f09540cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.161+0000 7f0959c00640 1 -- 172.21.15.99:0/3984501216 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09540cc0d0 con 0x7f095415e590 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.161+0000 7f0953e00640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09540d4790 0x7f09540cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.161+0000 7f0959c00640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f095415e590 0x7f09540cd670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f094c00c820 tx=0x7f094c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.161+0000 7f0950c00640 1 -- 172.21.15.99:0/3984501216 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c015070 con 0x7f095415e590 2024-03-30T13:11:09.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.161+0000 7f0950c00640 1 -- 172.21.15.99:0/3984501216 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094c007a30 con 0x7f095415e590 2024-03-30T13:11:09.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.161+0000 7f095a600640 1 -- 172.21.15.99:0/3984501216 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09540cc370 con 0x7f095415e590 2024-03-30T13:11:09.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.161+0000 7f0950c00640 1 -- 172.21.15.99:0/3984501216 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c007e20 con 0x7f095415e590 2024-03-30T13:11:09.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.161+0000 7f095a600640 1 -- 172.21.15.99:0/3984501216 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09540cc930 con 0x7f095415e590 2024-03-30T13:11:09.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.163+0000 7f0950c00640 1 -- 172.21.15.99:0/3984501216 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f094c018070 con 0x7f095415e590 2024-03-30T13:11:09.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.165+0000 7f0950c00640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f093006c530 0x7f093006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.165+0000 7f0950c00640 1 -- 172.21.15.99:0/3984501216 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f094c08b620 con 0x7f095415e590 2024-03-30T13:11:09.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.165+0000 7f095e834740 1 Processor -- start 2024-03-30T13:11:09.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.165+0000 7f0959200640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f093006c530 0x7f093006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.165+0000 7f095e834740 1 -- start start 2024-03-30T13:11:09.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.166+0000 7f0959200640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f093006c530 0x7f093006e9f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f093c000f60 tx=0x7f093c007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.166+0000 7f095e834740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2d8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.166+0000 7f095e834740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e3058b0 0x55598e308260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.166+0000 7f095e834740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e2d89b0 0x55598e3087a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.166+0000 7f095e834740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55598e29fc80 con 0x55598e3054d0 2024-03-30T13:11:09.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.166+0000 7f095e834740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55598e241fa0 con 0x55598e3058b0 2024-03-30T13:11:09.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.166+0000 7f095e834740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55598e1ea560 con 0x55598e2d89b0 2024-03-30T13:11:09.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.167+0000 7f0959200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2d8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.167+0000 7f0959200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2d8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50040/0 (socket says 172.21.15.99:50040) 2024-03-30T13:11:09.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.167+0000 7f0959200640 1 -- 172.21.15.99:0/2589634943 learned_addr learned my addr 172.21.15.99:0/2589634943 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:09.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.167+0000 7f0959c00640 1 --2- 172.21.15.99:0/2589634943 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e2d89b0 0x55598e3087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.167+0000 7f0953e00640 1 --2- 172.21.15.99:0/2589634943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e3058b0 0x55598e308260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.167+0000 7f0959200640 1 -- 172.21.15.99:0/2589634943 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e2d89b0 msgr2=0x55598e3087a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.167+0000 7f0959200640 1 --2- 172.21.15.99:0/2589634943 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e2d89b0 0x55598e3087a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.167+0000 7f0959200640 1 -- 172.21.15.99:0/2589634943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e3058b0 msgr2=0x55598e308260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.167+0000 7f0959200640 1 --2- 172.21.15.99:0/2589634943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e3058b0 0x55598e308260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.167+0000 7f0959200640 1 -- 172.21.15.99:0/2589634943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55598df562d0 con 0x55598e3054d0 2024-03-30T13:11:09.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.167+0000 7f0959200640 1 --2- 172.21.15.99:0/2589634943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2d8470 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f093c001620 tx=0x7f093c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bde7a5046e79f8b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.168+0000 7f0949600640 1 -- 172.21.15.99:0/2589634943 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c015110 con 0x55598e3054d0 2024-03-30T13:11:09.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.168+0000 7f0949600640 1 -- 172.21.15.99:0/2589634943 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c0159c0 con 0x55598e3054d0 2024-03-30T13:11:09.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.168+0000 7f0949600640 1 -- 172.21.15.99:0/2589634943 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c015d70 con 0x55598e3054d0 2024-03-30T13:11:09.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.168+0000 7f095e834740 1 -- 172.21.15.99:0/2589634943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 msgr2=0x55598e2d8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.168+0000 7f095e834740 1 --2- 172.21.15.99:0/2589634943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2d8470 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f093c001620 tx=0x7f093c012000 comp rx=0 tx=0).stop 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.168+0000 7f095e834740 1 -- 172.21.15.99:0/2589634943 shutdown_connections 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.168+0000 7f095e834740 1 --2- 172.21.15.99:0/2589634943 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e2d89b0 0x55598e3087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.168+0000 7f095e834740 1 --2- 172.21.15.99:0/2589634943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e3058b0 0x55598e308260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.168+0000 7f095e834740 1 --2- 172.21.15.99:0/2589634943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2d8470 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.168+0000 7f095e834740 1 -- 172.21.15.99:0/2589634943 >> 172.21.15.99:0/2589634943 conn(0x55598e2da6e0 msgr2=0x55598e323260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.169+0000 7f095e834740 1 -- 172.21.15.99:0/2589634943 shutdown_connections 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.169+0000 7f095e834740 1 -- 172.21.15.99:0/2589634943 wait complete. 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.169+0000 7f095e834740 1 -- start start 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.169+0000 7f095e834740 1 Processor -- start 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.170+0000 7f095e834740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2f9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.170+0000 7f095e834740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e3058b0 0x55598e31e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.170+0000 7f095e834740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e30b550 0x55598e323900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.170+0000 7f095e834740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55598e1fd920 con 0x55598e3054d0 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.170+0000 7f095e834740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55598e23df50 con 0x55598e30b550 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.170+0000 7f095e834740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55598e2dcc80 con 0x55598e3058b0 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.170+0000 7f095e834740 10 client.0 _ll_register_callbacks cb 0x55598e1fd310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0959200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2f9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0959200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2f9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50054/0 (socket says 172.21.15.99:50054) 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0959200640 1 -- 172.21.15.99:0/442844508 learned_addr learned my addr 172.21.15.99:0/442844508 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0953e00640 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e3058b0 0x55598e31e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0959200640 1 -- 172.21.15.99:0/442844508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e3058b0 msgr2=0x55598e31e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0959200640 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e3058b0 0x55598e31e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0959200640 1 -- 172.21.15.99:0/442844508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e30b550 msgr2=0x55598e323900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0959c00640 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e30b550 0x55598e323900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0959200640 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e30b550 0x55598e323900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0959200640 1 -- 172.21.15.99:0/442844508 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55598e0206b0 con 0x55598e3054d0 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0953e00640 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e3058b0 0x55598e31e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.171+0000 7f0959c00640 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e30b550 0x55598e323900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.172+0000 7f0959200640 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2f9570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f093c015810 tx=0x7f093c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d461ff9b8a3407b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.172+0000 7f0942000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.172+0000 7f0942000640 1 -- 172.21.15.99:0/442844508 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c031060 con 0x55598e3054d0 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.172+0000 7f0942000640 1 -- 172.21.15.99:0/442844508 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f093c02c470 con 0x55598e3054d0 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.172+0000 7f095e834740 1 -- 172.21.15.99:0/442844508 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f093c0159c0 con 0x55598e3054d0 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.172+0000 7f0942000640 1 -- 172.21.15.99:0/442844508 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f093c02c670 con 0x55598e3054d0 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.172+0000 7f095e834740 10 client.4683 fetch_fsmap learned FSMap version 8 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.172+0000 7f095e834740 1 -- 172.21.15.99:0/442844508 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55598e30ad50 con 0x55598e3054d0 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.173+0000 7f0942000640 1 -- 172.21.15.99:0/442844508 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c0159c0 con 0x55598e3054d0 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.173+0000 7f0942000640 1 -- 172.21.15.99:0/442844508 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f093c02c810 con 0x55598e3054d0 2024-03-30T13:11:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.173+0000 7f095e834740 10 client.4683 fetch_fsmap finished waiting for FSMap version 8 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.173+0000 7f095e834740 10 client.4683 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.173+0000 7f095e834740 20 client.4683 populate_metadata read hostname 'smithi099' 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.173+0000 7f095e834740 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.99:6836/245796495,v1:172.21.15.99:6837/245796495] conn(0x55598e336d50 0x55598e337130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.173+0000 7f095e834740 4 client.4683 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.173+0000 7f095e834740 1 -- 172.21.15.99:0/442844508 --> [v2:172.21.15.99:6836/245796495,v1:172.21.15.99:6837/245796495] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55598e24f4e0 con 0x55598e336d50 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.173+0000 7f0953e00640 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.99:6836/245796495,v1:172.21.15.99:6837/245796495] conn(0x55598e336d50 0x55598e337130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.174+0000 7f0953e00640 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.99:6836/245796495,v1:172.21.15.99:6837/245796495] conn(0x55598e336d50 0x55598e337130 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7305348be96692b2 server_cookie=df61996e83bd9cb6 in_seq=0 out_seq=0 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.174+0000 7f0942000640 10 client.4683 ms_handle_connect on v2:172.21.15.99:6836/245796495 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f0942000640 1 -- 172.21.15.99:0/442844508 <== mds.0 v2:172.21.15.99:6836/245796495 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55598e24f4e0 con 0x55598e336d50 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f0942000640 10 client.4683 handle_command_reply: tid=0 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 1 client.4683 shutdown 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 1 -- 172.21.15.99:0/442844508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 msgr2=0x55598e2f9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2f9570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f093c015810 tx=0x7f093c000ed0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 1 -- 172.21.15.99:0/442844508 shutdown_connections 2024-03-30T13:11:09.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e30b550 0x55598e323900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.99:6836/245796495,v1:172.21.15.99:6837/245796495] conn(0x55598e336d50 0x55598e337130 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e3058b0 0x55598e31e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 1 --2- 172.21.15.99:0/442844508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e2f9570 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 1 -- 172.21.15.99:0/442844508 >> 172.21.15.99:0/442844508 conn(0x55598e2d89b0 msgr2=0x55598e31d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f0942000640 0 client.4683 ms_handle_reset on v2:172.21.15.99:6836/245796495 2024-03-30T13:11:09.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 1 -- 172.21.15.99:0/442844508 shutdown_connections 2024-03-30T13:11:09.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 1 -- 172.21.15.99:0/442844508 wait complete. 2024-03-30T13:11:09.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.175+0000 7f095e834740 20 client.4683 trim_cache size 0 max 16384 2024-03-30T13:11:09.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.195+0000 7f095e834740 1 Processor -- start 2024-03-30T13:11:09.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.195+0000 7f095e834740 1 -- start start 2024-03-30T13:11:09.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.196+0000 7f095e834740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e3054d0 0x55598e3047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.196+0000 7f095e834740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3058b0 0x55598e346640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.196+0000 7f095e834740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e30b550 0x55598e346b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.196+0000 7f095e834740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f09540cf950 con 0x55598e3058b0 2024-03-30T13:11:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.196+0000 7f095e834740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f09540cecb0 con 0x55598e30b550 2024-03-30T13:11:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.196+0000 7f095e834740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f09540cf300 con 0x55598e3054d0 2024-03-30T13:11:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.196+0000 7f0953e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3058b0 0x55598e346640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.197+0000 7f0953e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3058b0 0x55598e346640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50062/0 (socket says 172.21.15.99:50062) 2024-03-30T13:11:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.197+0000 7f0953e00640 1 -- 172.21.15.99:0/2897370061 learned_addr learned my addr 172.21.15.99:0/2897370061 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.197+0000 7f0953e00640 1 -- 172.21.15.99:0/2897370061 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e3054d0 msgr2=0x55598e3047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.197+0000 7f0953e00640 1 --2- 172.21.15.99:0/2897370061 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e3054d0 0x55598e3047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.197+0000 7f0953e00640 1 -- 172.21.15.99:0/2897370061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e30b550 msgr2=0x55598e346b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.197+0000 7f0953e00640 1 --2- 172.21.15.99:0/2897370061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e30b550 0x55598e346b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.197+0000 7f0953e00640 1 -- 172.21.15.99:0/2897370061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55598e2f98e0 con 0x55598e3058b0 2024-03-30T13:11:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.197+0000 7f0953e00640 1 --2- 172.21.15.99:0/2897370061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3058b0 0x55598e346640 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f094402be60 tx=0x7f0944030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3558b4a8d0176ddf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.197+0000 7f0948c00640 1 -- 172.21.15.99:0/2897370061 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944039040 con 0x55598e3058b0 2024-03-30T13:11:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.197+0000 7f0948c00640 1 -- 172.21.15.99:0/2897370061 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09440426c0 con 0x55598e3058b0 2024-03-30T13:11:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.197+0000 7f0948c00640 1 -- 172.21.15.99:0/2897370061 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944042a70 con 0x55598e3058b0 2024-03-30T13:11:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.198+0000 7f095e834740 1 -- 172.21.15.99:0/2897370061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3058b0 msgr2=0x55598e346640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.198+0000 7f095e834740 1 --2- 172.21.15.99:0/2897370061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3058b0 0x55598e346640 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f094402be60 tx=0x7f0944030000 comp rx=0 tx=0).stop 2024-03-30T13:11:09.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.198+0000 7f095e834740 1 -- 172.21.15.99:0/2897370061 shutdown_connections 2024-03-30T13:11:09.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.198+0000 7f095e834740 1 --2- 172.21.15.99:0/2897370061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e30b550 0x55598e346b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.198+0000 7f095e834740 1 --2- 172.21.15.99:0/2897370061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3058b0 0x55598e346640 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.198+0000 7f095e834740 1 --2- 172.21.15.99:0/2897370061 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e3054d0 0x55598e3047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.198+0000 7f095e834740 1 -- 172.21.15.99:0/2897370061 >> 172.21.15.99:0/2897370061 conn(0x55598e2d89b0 msgr2=0x55598e347230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.198+0000 7f095e834740 1 -- 172.21.15.99:0/2897370061 shutdown_connections 2024-03-30T13:11:09.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.198+0000 7f095e834740 1 -- 172.21.15.99:0/2897370061 wait complete. 2024-03-30T13:11:09.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.199+0000 7f095e834740 1 -- start start 2024-03-30T13:11:09.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.199+0000 7f095e834740 1 Processor -- start 2024-03-30T13:11:09.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f095e834740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e304060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f095e834740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e3058b0 0x55598e3045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f095e834740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e30b550 0x55598e2f7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f095e834740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55598e323e40 con 0x55598e3054d0 2024-03-30T13:11:09.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f095e834740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55598e30b030 con 0x55598e3058b0 2024-03-30T13:11:09.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f095e834740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55598e30bb20 con 0x55598e30b550 2024-03-30T13:11:09.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f095e834740 10 client.0 _ll_register_callbacks cb 0x7f093c015040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:09.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f0959200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e304060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f0959200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e304060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50072/0 (socket says 172.21.15.99:50072) 2024-03-30T13:11:09.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f0959200640 1 -- 172.21.15.99:0/2514511853 learned_addr learned my addr 172.21.15.99:0/2514511853 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:09.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f0959c00640 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e30b550 0x55598e2f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f0959200640 1 -- 172.21.15.99:0/2514511853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e30b550 msgr2=0x55598e2f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.200+0000 7f0959200640 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e30b550 0x55598e2f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.201+0000 7f0959200640 1 -- 172.21.15.99:0/2514511853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e3058b0 msgr2=0x55598e3045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:09.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.201+0000 7f0959200640 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e3058b0 0x55598e3045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.201+0000 7f0959200640 1 -- 172.21.15.99:0/2514511853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55598e324da0 con 0x55598e3054d0 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.201+0000 7f0959200640 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e304060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f093c015ad0 tx=0x7f093c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02275fe8c5a18ed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.201+0000 7f0942000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.201+0000 7f0942000640 1 -- 172.21.15.99:0/2514511853 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c03b080 con 0x55598e3054d0 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.201+0000 7f0942000640 1 -- 172.21.15.99:0/2514511853 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f093c02c470 con 0x55598e3054d0 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.201+0000 7f095e834740 1 -- 172.21.15.99:0/2514511853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09440426c0 con 0x55598e3054d0 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.201+0000 7f0942000640 1 -- 172.21.15.99:0/2514511853 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f093c013630 con 0x55598e3054d0 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.201+0000 7f095e834740 10 client.4689 fetch_fsmap learned FSMap version 8 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.201+0000 7f095e834740 1 -- 172.21.15.99:0/2514511853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55598e31f710 con 0x55598e3054d0 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.202+0000 7f0942000640 1 -- 172.21.15.99:0/2514511853 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09440426c0 con 0x55598e3054d0 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.202+0000 7f0942000640 1 -- 172.21.15.99:0/2514511853 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f093c0137d0 con 0x55598e3054d0 2024-03-30T13:11:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.202+0000 7f095e834740 10 client.4689 fetch_fsmap finished waiting for FSMap version 8 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.202+0000 7f095e834740 10 client.4689 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.202+0000 7f095e834740 20 client.4689 populate_metadata read hostname 'smithi099' 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.202+0000 7f095e834740 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.99:6836/245796495,v1:172.21.15.99:6837/245796495] conn(0x55598e39f3b0 0x55598e39f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.202+0000 7f095e834740 4 client.4689 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.202+0000 7f095e834740 1 -- 172.21.15.99:0/2514511853 --> [v2:172.21.15.99:6836/245796495,v1:172.21.15.99:6837/245796495] -- command(tid 0: {"prefix": "status"}) -- 0x55598e249830 con 0x55598e39f3b0 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.202+0000 7f0953e00640 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.99:6836/245796495,v1:172.21.15.99:6837/245796495] conn(0x55598e39f3b0 0x55598e39f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f0942000640 10 client.4689 ms_handle_connect on v2:172.21.15.99:6836/245796495 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f0953e00640 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.99:6836/245796495,v1:172.21.15.99:6837/245796495] conn(0x55598e39f3b0 0x55598e39f790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19271cbdc903e460 server_cookie=78ac19b2f2e9131 in_seq=0 out_seq=0 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f0942000640 1 -- 172.21.15.99:0/2514511853 <== mds.0 v2:172.21.15.99:6836/245796495 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55598e249830 con 0x55598e39f3b0 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f0942000640 10 client.4689 handle_command_reply: tid=0 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f095e834740 1 client.4689 shutdown 2024-03-30T13:11:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f095e834740 1 -- 172.21.15.99:0/2514511853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 msgr2=0x55598e304060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f095e834740 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e304060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f093c015ad0 tx=0x7f093c001080 comp rx=0 tx=0).stop 2024-03-30T13:11:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f095e834740 1 -- 172.21.15.99:0/2514511853 shutdown_connections 2024-03-30T13:11:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f095e834740 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.99:6836/245796495,v1:172.21.15.99:6837/245796495] conn(0x55598e39f3b0 0x55598e39f790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f095e834740 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55598e30b550 0x55598e2f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f095e834740 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55598e3058b0 0x55598e3045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f0942000640 0 client.4689 ms_handle_reset on v2:172.21.15.99:6836/245796495 2024-03-30T13:11:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f095e834740 1 --2- 172.21.15.99:0/2514511853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55598e3054d0 0x55598e304060 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.203+0000 7f095e834740 1 -- 172.21.15.99:0/2514511853 >> 172.21.15.99:0/2514511853 conn(0x55598e2d89b0 msgr2=0x55598e346490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.204+0000 7f095e834740 1 -- 172.21.15.99:0/2514511853 shutdown_connections 2024-03-30T13:11:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.204+0000 7f095e834740 1 -- 172.21.15.99:0/2514511853 wait complete. 2024-03-30T13:11:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.204+0000 7f095e834740 20 client.4689 trim_cache size 0 max 16384 2024-03-30T13:11:09.214 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:11:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "e28e230a-999b-4d07-a5bd-ee507abf8d14", 2024-03-30T13:11:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-03-30T13:11:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4284, 2024-03-30T13:11:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-03-30T13:11:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-03-30T13:11:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-03-30T13:11:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 22.968930124, 2024-03-30T13:11:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 8, 2024-03-30T13:11:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 22, 2024-03-30T13:11:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 22, 2024-03-30T13:11:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 28.412213706999999 2024-03-30T13:11:09.215 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:11:09.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.204+0000 7f095a600640 1 -- 172.21.15.99:0/3984501216 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f093006c530 msgr2=0x7f093006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.204+0000 7f095a600640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f093006c530 0x7f093006e9f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f093c000f60 tx=0x7f093c007970 comp rx=0 tx=0).stop 2024-03-30T13:11:09.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.204+0000 7f095a600640 1 -- 172.21.15.99:0/3984501216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f095415e590 msgr2=0x7f09540cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:09.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.204+0000 7f095a600640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f095415e590 0x7f09540cd670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f094c00c820 tx=0x7f094c00cce0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.205+0000 7f095a600640 1 -- 172.21.15.99:0/3984501216 shutdown_connections 2024-03-30T13:11:09.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.205+0000 7f095a600640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f093006c530 0x7f093006e9f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.205+0000 7f095a600640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f095415e590 0x7f09540cd670 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.205+0000 7f095a600640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09540d4790 0x7f09540cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.205+0000 7f095a600640 1 --2- 172.21.15.99:0/3984501216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09540b5480 0x7f09540b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:09.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.205+0000 7f095a600640 1 -- 172.21.15.99:0/3984501216 >> 172.21.15.99:0/3984501216 conn(0x7f095409d820 msgr2=0x7f095406d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:09.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.205+0000 7f095a600640 1 -- 172.21.15.99:0/3984501216 shutdown_connections 2024-03-30T13:11:09.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:09.205+0000 7f095a600640 1 -- 172.21.15.99:0/3984501216 wait complete. 2024-03-30T13:11:09.229 INFO:teuthology.run_tasks:Running task sequential... 2024-03-30T13:11:09.241 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-03-30T13:11:09.241 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-30T13:11:09.242 INFO:teuthology.task.print:Enabling mgr modules 2024-03-30T13:11:09.242 INFO:teuthology.run_tasks:Running task kclient... 2024-03-30T13:11:09.296 INFO:tasks.kclient:Mounting kernel clients... 2024-03-30T13:11:09.297 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-30T13:11:09.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:09.297 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-03-30T13:11:09.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:09.351 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-03-30T13:11:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-03-30T13:11:09.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:11:09.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:09.440 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-03-30T13:11:09.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:09.493 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-03-30T13:11:09.588 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-03-30T13:11:09.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:11:09.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:09.593 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-03-30T13:11:09.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:09.652 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-03-30T13:11:09.749 INFO:teuthology.orchestra.run.smithi181.stderr:Cannot find device "ceph-brx" 2024-03-30T13:11:09.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:11:09.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:09.752 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-03-30T13:11:09.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:09.805 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-03-30T13:11:09.896 INFO:teuthology.orchestra.run.smithi181.stderr:Cannot find device "ceph-brx" 2024-03-30T13:11:09.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:11:09.900 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-03-30T13:11:09.900 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:11:09.900 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T13:11:09.901 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:11:10.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.108+0000 7f2123000640 1 Processor -- start 2024-03-30T13:11:10.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.108+0000 7f2123000640 1 -- start start 2024-03-30T13:11:10.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.109+0000 7f2123000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f211c15b350 0x7f211c15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.110+0000 7f2123000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f211c0d0490 0x7f211c0d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.110+0000 7f2123000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c15bad0 con 0x7f211c0b4cf0 2024-03-30T13:11:10.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.110+0000 7f2123000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f211c15c970 con 0x7f211c15b350 2024-03-30T13:11:10.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.110+0000 7f2123000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f211c15bdd0 con 0x7f211c0d0490 2024-03-30T13:11:10.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.110+0000 7f211be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f211c15b350 0x7f211c15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.110+0000 7f211be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f211c15b350 0x7f211c15efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50086/0 (socket says 172.21.15.99:50086) 2024-03-30T13:11:10.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.110+0000 7f211be00640 1 -- 172.21.15.99:0/464077978 learned_addr learned my addr 172.21.15.99:0/464077978 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:10.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.110+0000 7f2121000640 1 --2- 172.21.15.99:0/464077978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f211c0d0490 0x7f211c0d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.110+0000 7f211be00640 1 -- 172.21.15.99:0/464077978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f211c0d0490 msgr2=0x7f211c0d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.110+0000 7f211be00640 1 --2- 172.21.15.99:0/464077978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f211c0d0490 0x7f211c0d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.110+0000 7f211be00640 1 -- 172.21.15.99:0/464077978 >> v1:172.21.15.181:6789/0 conn(0x7f211c0b4cf0 legacy=0x7f211c15c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:10.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.111+0000 7f211be00640 1 -- 172.21.15.99:0/464077978 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c15f7e0 con 0x7f211c15b350 2024-03-30T13:11:10.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.112+0000 7f211be00640 1 --2- 172.21.15.99:0/464077978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211c15b350 0x7f211c15efb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f210c009870 tx=0x7f210c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3bea8f325b55b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.113+0000 7f211aa00640 1 -- 172.21.15.99:0/464077978 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c035020 con 0x7f211c15b350 2024-03-30T13:11:10.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.113+0000 7f211aa00640 1 -- 172.21.15.99:0/464077978 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f210c031640 con 0x7f211c15b350 2024-03-30T13:11:10.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.113+0000 7f211aa00640 1 -- 172.21.15.99:0/464077978 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c02d040 con 0x7f211c15b350 2024-03-30T13:11:10.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.113+0000 7f2123000640 1 -- 172.21.15.99:0/464077978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211c15b350 msgr2=0x7f211c15efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.113+0000 7f2123000640 1 --2- 172.21.15.99:0/464077978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211c15b350 0x7f211c15efb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f210c009870 tx=0x7f210c02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.113+0000 7f2123000640 1 -- 172.21.15.99:0/464077978 shutdown_connections 2024-03-30T13:11:10.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.113+0000 7f2123000640 1 --2- 172.21.15.99:0/464077978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f211c0d0490 0x7f211c0d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.113+0000 7f2123000640 1 --2- 172.21.15.99:0/464077978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211c15b350 0x7f211c15efb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.113+0000 7f2123000640 1 -- 172.21.15.99:0/464077978 >> 172.21.15.99:0/464077978 conn(0x7f211c06b6f0 msgr2=0x7f211c06bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.114+0000 7f2123000640 1 -- 172.21.15.99:0/464077978 shutdown_connections 2024-03-30T13:11:10.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.114+0000 7f2123000640 1 -- 172.21.15.99:0/464077978 wait complete. 2024-03-30T13:11:10.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.115+0000 7f2123000640 1 Processor -- start 2024-03-30T13:11:10.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.115+0000 7f2123000640 1 -- start start 2024-03-30T13:11:10.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.116+0000 7f2123000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f211c0b4cf0 0x7f211c14c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.116+0000 7f2123000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f211c0d0490 0x7f211c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.116+0000 7f2123000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211c15b350 0x7f211c14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.116+0000 7f2123000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f211c15fda0 con 0x7f211c15b350 2024-03-30T13:11:10.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.116+0000 7f2123000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f211c15f4f0 con 0x7f211c0d0490 2024-03-30T13:11:10.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.116+0000 7f2123000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f211c15b730 con 0x7f211c0b4cf0 2024-03-30T13:11:10.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.117+0000 7f2121000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211c15b350 0x7f211c14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.117+0000 7f2121000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211c15b350 0x7f211c14ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50094/0 (socket says 172.21.15.99:50094) 2024-03-30T13:11:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.117+0000 7f2121000640 1 -- 172.21.15.99:0/2769956794 learned_addr learned my addr 172.21.15.99:0/2769956794 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.117+0000 7f211be00640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f211c0b4cf0 0x7f211c14c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.117+0000 7f211b400640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f211c0d0490 0x7f211c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.117+0000 7f2121000640 1 -- 172.21.15.99:0/2769956794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f211c0b4cf0 msgr2=0x7f211c14c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.117+0000 7f2121000640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f211c0b4cf0 0x7f211c14c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.117+0000 7f2121000640 1 -- 172.21.15.99:0/2769956794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f211c0d0490 msgr2=0x7f211c15a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.117+0000 7f2121000640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f211c0d0490 0x7f211c15a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.117+0000 7f2121000640 1 -- 172.21.15.99:0/2769956794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c152c80 con 0x7f211c15b350 2024-03-30T13:11:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.117+0000 7f2121000640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211c15b350 0x7f211c14ca60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2114007e70 tx=0x7f211400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.118+0000 7f2113e00640 1 -- 172.21.15.99:0/2769956794 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114014620 con 0x7f211c15b350 2024-03-30T13:11:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.118+0000 7f2113e00640 1 -- 172.21.15.99:0/2769956794 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2114019070 con 0x7f211c15b350 2024-03-30T13:11:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.118+0000 7f2113e00640 1 -- 172.21.15.99:0/2769956794 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114014a20 con 0x7f211c15b350 2024-03-30T13:11:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.118+0000 7f2123000640 1 -- 172.21.15.99:0/2769956794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211c152f60 con 0x7f211c15b350 2024-03-30T13:11:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.118+0000 7f2123000640 1 -- 172.21.15.99:0/2769956794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211c153520 con 0x7f211c15b350 2024-03-30T13:11:10.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.119+0000 7f2123000640 1 -- 172.21.15.99:0/2769956794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f211c068640 con 0x7f211c15b350 2024-03-30T13:11:10.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.120+0000 7f2113e00640 1 -- 172.21.15.99:0/2769956794 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2114014bc0 con 0x7f211c15b350 2024-03-30T13:11:10.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.121+0000 7f2113e00640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f20fc06c530 0x7f20fc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:10.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.121+0000 7f2113e00640 1 -- 172.21.15.99:0/2769956794 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f211408c080 con 0x7f211c15b350 2024-03-30T13:11:10.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.121+0000 7f211be00640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f20fc06c530 0x7f20fc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:10.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.122+0000 7f211be00640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f20fc06c530 0x7f20fc06e9f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f210c036000 tx=0x7f210c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:10.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.125+0000 7f2113e00640 1 -- 172.21.15.99:0/2769956794 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f211405a600 con 0x7f211c15b350 2024-03-30T13:11:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.390+0000 7f2123000640 1 -- 172.21.15.99:0/2769956794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f211c06e8e0 con 0x7f211c15b350 2024-03-30T13:11:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.391+0000 7f2113e00640 1 -- 172.21.15.99:0/2769956794 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f2114059f00 con 0x7f211c15b350 2024-03-30T13:11:10.394 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.393+0000 7f2123000640 1 -- 172.21.15.99:0/2769956794 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f20fc06c530 msgr2=0x7f20fc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.393+0000 7f2123000640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f20fc06c530 0x7f20fc06e9f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f210c036000 tx=0x7f210c03c040 comp rx=0 tx=0).stop 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.393+0000 7f2123000640 1 -- 172.21.15.99:0/2769956794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211c15b350 msgr2=0x7f211c14ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.393+0000 7f2123000640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211c15b350 0x7f211c14ca60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2114007e70 tx=0x7f211400e4b0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.393+0000 7f2123000640 1 -- 172.21.15.99:0/2769956794 shutdown_connections 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.393+0000 7f2123000640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f20fc06c530 0x7f20fc06e9f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.393+0000 7f2123000640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211c15b350 0x7f211c14ca60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.393+0000 7f2123000640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f211c0d0490 0x7f211c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.393+0000 7f2123000640 1 --2- 172.21.15.99:0/2769956794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f211c0b4cf0 0x7f211c14c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.393+0000 7f2123000640 1 -- 172.21.15.99:0/2769956794 >> 172.21.15.99:0/2769956794 conn(0x7f211c06b6f0 msgr2=0x7f211c0aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.394+0000 7f2123000640 1 -- 172.21.15.99:0/2769956794 shutdown_connections 2024-03-30T13:11:10.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10.394+0000 7f2123000640 1 -- 172.21.15.99:0/2769956794 wait complete. 2024-03-30T13:11:10.416 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:11:10.416 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:11:10.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-03-30T13:11:10.417 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-30T13:11:10.417 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T13:11:10.417 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:11:10.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:11:10.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:11:10.417 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:11:10.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:10.417 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-03-30T13:11:10.461 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:11:10.461 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:11:10.461 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:11:10.461 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:10.461 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-03-30T13:11:10.461 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42501sec preferred_lft 42501sec 2024-03-30T13:11:10.462 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-03-30T13:11:10.463 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:10.463 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-30T13:11:10.463 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:10.463 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-03-30T13:11:10.463 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add name ceph-brx type bridge 2024-03-30T13:11:10.463 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr flush dev ceph-brx 2024-03-30T13:11:10.463 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set ceph-brx up 2024-03-30T13:11:10.463 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-30T13:11:10.463 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-03-30T13:11:10.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:10.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:10.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:10.992 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:11:11.065 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-03-30T13:11:11.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:11.069 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-03-30T13:11:11.127 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-03-30T13:11:11.128 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:11:11.128 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:11:11.128 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:11:11.128 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:11:11.128 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:11.128 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-03-30T13:11:11.128 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:11:11.128 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:11:11.129 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:11:11.129 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-03-30T13:11:11.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:11.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:11.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:11.899 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-03-30T13:11:11.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:11.943 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-03-30T13:11:12.025 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:12.025 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-03-30T13:11:12.025 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:11:12.025 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-30T13:11:12.025 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-03-30T13:11:12.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:12.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:12.245 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-30T13:11:12.246 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:12.246 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-03-30T13:11:12.246 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-30T13:11:12.246 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-30T13:11:12.246 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-30T13:11:12.246 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-30T13:11:12.246 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-30T13:11:12.246 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-03-30T13:11:12.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:12.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:12.587 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:12.587 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-03-30T13:11:12.587 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-03-30T13:11:12.587 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.0 master ceph-brx 2024-03-30T13:11:12.587 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-03-30T13:11:12.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:12.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:12.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:11:12.811 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-30T13:11:12.852 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:11:12.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:11:12.852 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:11:12.932 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:11:12.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:12.933 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:11:13.110 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:11:13.111 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:11:13.111 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-03-30T13:11:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:11:13.779 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:11:13.779 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-03-30T13:11:13.779 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:11:13.779 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:11:13.781 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:11:13.781 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:11:13.781 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-03-30T13:11:13.781 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:11:13.781 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:11:13.781 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790" 2024-03-30T13:11:13.781 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790:/ 2024-03-30T13:11:13.781 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e28e230a-999b-4d07-a5bd-ee507abf8d14" will pass to kernel 2024-03-30T13:11:13.781 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-30T13:11:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:11:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:11:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:11:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:11:13.782 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:11:13.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:13.782 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:11:13.866 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:13.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:13.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:14.001 INFO:teuthology.orchestra.run.smithi099.stdout:client4495 2024-03-30T13:11:14.001 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:11:14.001 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:14.052 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:14.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:14.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:14.225 INFO:teuthology.orchestra.run.smithi099.stdout:client4495 2024-03-30T13:11:14.226 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:14.344 INFO:teuthology.orchestra.run.smithi099.stdout:client4495 2024-03-30T13:11:14.344 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e28e230a-999b-4d07-a5bd-ee507abf8d14.client4495/status') 2024-03-30T13:11:14.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:14.493 INFO:teuthology.orchestra.run.smithi099.stdout:instance: client.4495 (3)172.21.15.99:0/2519680915 2024-03-30T13:11:14.493 INFO:teuthology.orchestra.run.smithi099.stdout:blocklisted: false 2024-03-30T13:11:14.493 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records in 2024-03-30T13:11:14.493 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records out 2024-03-30T13:11:14.494 INFO:teuthology.orchestra.run.smithi099.stderr:70 bytes copied, 6.459e-05 s, 1.1 MB/s 2024-03-30T13:11:14.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:14.505 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-03-30T13:11:14.506 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:11:14.506 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-30T13:11:14.506 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:11:14.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.698+0000 7f064be00640 1 Processor -- start 2024-03-30T13:11:14.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.698+0000 7f064be00640 1 -- start start 2024-03-30T13:11:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.701+0000 7f064be00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f064c15f9d0 0x7f064c0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.701+0000 7f064be00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0b2130 0x7f064c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.701+0000 7f064be00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064c0cb770 con 0x7f064c06b510 2024-03-30T13:11:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.701+0000 7f064be00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f064c0b2ad0 con 0x7f064c15f9d0 2024-03-30T13:11:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.701+0000 7f064be00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f064c0cd950 con 0x7f064c0b2130 2024-03-30T13:11:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.702+0000 7f064b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f064c06b510 0x7f064c06b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35954/0 (socket says 172.21.15.99:35954) 2024-03-30T13:11:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.702+0000 7f064b400640 1 -- 172.21.15.99:0/105101166 learned_addr learned my addr 172.21.15.99:0/105101166 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.702+0000 7f0642000640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0b2130 0x7f064c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.702+0000 7f064aa00640 1 --2- 172.21.15.99:0/105101166 >> v2:172.21.15.181:3300/0 conn(0x7f064c15f9d0 0x7f064c0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.702+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811068489 0 0) 0x7f064c0cb770 con 0x7f064c06b510 2024-03-30T13:11:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.702+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0630003520 con 0x7f064c06b510 2024-03-30T13:11:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3407502968 0 0) 0x7f0630003520 con 0x7f064c06b510 2024-03-30T13:11:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0b2130 msgr2=0x7f064c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0b2130 0x7f064c0b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 >> v2:172.21.15.181:3300/0 conn(0x7f064c15f9d0 msgr2=0x7f064c0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 --2- 172.21.15.99:0/105101166 >> v2:172.21.15.181:3300/0 conn(0x7f064c15f9d0 0x7f064c0b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c0cdba0 con 0x7f064c06b510 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f06440019f0 con 0x7f064c06b510 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 >> v1:172.21.15.99:6789/0 conn(0x7f064c06b510 legacy=0x7f064c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 0x7f0630003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0630004800 0x7f0630004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0b2130 0x7f06300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f064c0cd950 con 0x7f06300039b0 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f063000b9c0 con 0x7f0630004800 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f063000bb40 con 0x7f064c0b2130 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f064aa00640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 0x7f0630003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.703+0000 7f0642000640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0630004800 0x7f0630004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.704+0000 7f064b400640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0b2130 0x7f06300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.704+0000 7f064aa00640 1 -- 172.21.15.99:0/105101166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0b2130 msgr2=0x7f06300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.704+0000 7f064aa00640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0b2130 0x7f06300051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.704+0000 7f064aa00640 1 -- 172.21.15.99:0/105101166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0630004800 msgr2=0x7f0630004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.704+0000 7f064aa00640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0630004800 0x7f0630004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.704+0000 7f064aa00640 1 -- 172.21.15.99:0/105101166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0630003520 con 0x7f06300039b0 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.705+0000 7f064aa00640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 0x7f0630003dd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f063c009af0 tx=0x7f0630005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcd9b0053c383a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.705+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c039070 con 0x7f06300039b0 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.705+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c02c710 con 0x7f06300039b0 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.705+0000 7f064a000640 1 -- 172.21.15.99:0/105101166 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c009690 con 0x7f06300039b0 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.706+0000 7f064be00640 1 -- 172.21.15.99:0/105101166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 msgr2=0x7f0630003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.706+0000 7f064be00640 1 --2- 172.21.15.99:0/105101166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 0x7f0630003dd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f063c009af0 tx=0x7f0630005830 comp rx=0 tx=0).stop 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.706+0000 7f064b400640 1 -- 172.21.15.99:0/105101166 reap_dead start 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.706+0000 7f064be00640 1 -- 172.21.15.99:0/105101166 shutdown_connections 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.706+0000 7f064be00640 1 -- 172.21.15.99:0/105101166 >> 172.21.15.99:0/105101166 conn(0x7f064c09aa30 msgr2=0x7f064c0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.706+0000 7f064be00640 1 -- 172.21.15.99:0/105101166 shutdown_connections 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.706+0000 7f064be00640 1 -- 172.21.15.99:0/105101166 wait complete. 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.708+0000 7f064be00640 1 Processor -- start 2024-03-30T13:11:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.708+0000 7f064be00640 1 -- start start 2024-03-30T13:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 0x7f064c0c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f064c0b0ac0 0x7f064c1f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064be00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0ae770 0x7f064c0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064be00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f064c0ce440 con 0x7f06300039b0 2024-03-30T13:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064be00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f064c0ce160 con 0x7f064c0b0ac0 2024-03-30T13:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064be00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f064c0ce720 con 0x7f064c0ae770 2024-03-30T13:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 0x7f064c0c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 0x7f064c0c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50114/0 (socket says 172.21.15.99:50114) 2024-03-30T13:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064aa00640 1 -- 172.21.15.99:0/1760999227 learned_addr learned my addr 172.21.15.99:0/1760999227 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064aa00640 1 -- 172.21.15.99:0/1760999227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0ae770 msgr2=0x7f064c0ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064aa00640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0ae770 0x7f064c0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064aa00640 1 -- 172.21.15.99:0/1760999227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f064c0b0ac0 msgr2=0x7f064c1f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064aa00640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f064c0b0ac0 0x7f064c1f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.709+0000 7f064aa00640 1 -- 172.21.15.99:0/1760999227 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c0afa90 con 0x7f06300039b0 2024-03-30T13:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.710+0000 7f064aa00640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 0x7f064c0c7c00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f063c037040 tx=0x7f063c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.710+0000 7f0643400640 1 -- 172.21.15.99:0/1760999227 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c039050 con 0x7f06300039b0 2024-03-30T13:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.710+0000 7f0643400640 1 -- 172.21.15.99:0/1760999227 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c045070 con 0x7f06300039b0 2024-03-30T13:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.710+0000 7f0643400640 1 -- 172.21.15.99:0/1760999227 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c0044e0 con 0x7f06300039b0 2024-03-30T13:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.710+0000 7f064be00640 1 -- 172.21.15.99:0/1760999227 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064c1f5150 con 0x7f06300039b0 2024-03-30T13:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.710+0000 7f064be00640 1 -- 172.21.15.99:0/1760999227 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f064c0affe0 con 0x7f06300039b0 2024-03-30T13:11:14.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.711+0000 7f064be00640 1 -- 172.21.15.99:0/1760999227 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f064c04f8f0 con 0x7f06300039b0 2024-03-30T13:11:14.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.712+0000 7f0643400640 1 -- 172.21.15.99:0/1760999227 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f063c003a50 con 0x7f06300039b0 2024-03-30T13:11:14.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.713+0000 7f0643400640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f062806c530 0x7f062806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:14.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.714+0000 7f0643400640 1 -- 172.21.15.99:0/1760999227 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f063c0ad290 con 0x7f06300039b0 2024-03-30T13:11:14.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.714+0000 7f0642000640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f062806c530 0x7f062806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:14.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.714+0000 7f0642000640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f062806c530 0x7f062806e9f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f064c0c8170 tx=0x7f0634008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:14.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.718+0000 7f0643400640 1 -- 172.21.15.99:0/1760999227 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f063c04e020 con 0x7f06300039b0 2024-03-30T13:11:14.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.960+0000 7f064be00640 1 -- 172.21.15.99:0/1760999227 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f064c0d06c0 con 0x7f06300039b0 2024-03-30T13:11:14.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.961+0000 7f0643400640 1 -- 172.21.15.99:0/1760999227 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f064c1f5150 con 0x7f06300039b0 2024-03-30T13:11:14.965 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:11:14.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 -- 172.21.15.99:0/1760999227 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f062806c530 msgr2=0x7f062806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:14.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f062806c530 0x7f062806e9f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f064c0c8170 tx=0x7f0634008040 comp rx=0 tx=0).stop 2024-03-30T13:11:14.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 -- 172.21.15.99:0/1760999227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 msgr2=0x7f064c0c7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:14.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 0x7f064c0c7c00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f063c037040 tx=0x7f063c004730 comp rx=0 tx=0).stop 2024-03-30T13:11:14.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 -- 172.21.15.99:0/1760999227 shutdown_connections 2024-03-30T13:11:14.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f062806c530 0x7f062806e9f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f064c0ae770 0x7f064c0ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f064c0b0ac0 0x7f064c1f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 --2- 172.21.15.99:0/1760999227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06300039b0 0x7f064c0c7c00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:14.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 -- 172.21.15.99:0/1760999227 >> 172.21.15.99:0/1760999227 conn(0x7f064c09aa30 msgr2=0x7f064c0b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:14.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 -- 172.21.15.99:0/1760999227 shutdown_connections 2024-03-30T13:11:14.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:14.963+0000 7f064be00640 1 -- 172.21.15.99:0/1760999227 wait complete. 2024-03-30T13:11:14.986 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:11:14.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:11:14.986 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-03-30T13:11:14.986 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-30T13:11:14.986 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-30T13:11:14.986 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:11:14.986 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:11:14.986 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:11:14.986 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-30T13:11:14.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:14.987 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-03-30T13:11:15.038 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:11:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:11:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:11:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42496sec preferred_lft 42496sec 2024-03-30T13:11:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-03-30T13:11:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.040 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:11:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether fa:c7:02:df:75:be brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:11:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::a4f7:bff:feca:fd5f/64 scope link 2024-03-30T13:11:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.040 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:11:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether fa:c7:02:df:75:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:11:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::f8c7:2ff:fedf:75be/64 scope link 2024-03-30T13:11:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:15.041 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:11:15.128 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-03-30T13:11:15.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:15.132 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-03-30T13:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-03-30T13:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:11:15.180 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:15.180 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-03-30T13:11:15.181 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:11:15.181 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:11:15.181 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:11:15.181 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-03-30T13:11:15.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:15.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:15.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:15.401 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-03-30T13:11:15.448 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T13:11:15.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:15.448 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-03-30T13:11:15.542 INFO:teuthology.orchestra.run.smithi099.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-30T13:11:15.544 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:15.544 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-03-30T13:11:15.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:11:15.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-30T13:11:15.544 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-03-30T13:11:15.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:15.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:15.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:15.739 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-30T13:11:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:11:15.828 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:11:15.828 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:11:15.828 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.828 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-03-30T13:11:15.829 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:11:15.829 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether d6:e1:3f:09:79:80 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:11:15.829 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:11:15.829 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.829 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::d4e1:3fff:fe09:7980/64 scope link 2024-03-30T13:11:15.829 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:15.833 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-30T13:11:15.909 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:11:15.909 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:11:15.909 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:11:15.909 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.909 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-03-30T13:11:15.909 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.909 INFO:teuthology.orchestra.run.smithi099.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:11:15.909 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether d6:e1:3f:09:79:80 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:11:15.909 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:11:15.909 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.910 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::d4e1:3fff:fe09:7980/64 scope link 2024-03-30T13:11:15.910 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:15.913 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-30T13:11:15.913 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:15.913 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-03-30T13:11:15.913 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-30T13:11:15.913 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-30T13:11:15.914 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-30T13:11:15.914 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-30T13:11:15.914 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-30T13:11:15.914 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-03-30T13:11:16.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:16.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:16.236 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:16.236 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-03-30T13:11:16.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.1 up 2024-03-30T13:11:16.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.1 master ceph-brx 2024-03-30T13:11:16.236 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-03-30T13:11:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:16.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:16.458 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:11:16.458 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-30T13:11:16.498 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-30T13:11:16.498 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:11:16.499 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-30T13:11:16.591 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:11:16.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:16.591 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T13:11:16.709 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T13:11:16.709 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-30T13:11:16.709 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-03-30T13:11:16.729 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T13:11:16.729 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-30T13:11:16.729 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-03-30T13:11:16.729 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:11:16.729 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:11:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T13:11:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-30T13:11:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-03-30T13:11:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:11:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:11:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790" 2024-03-30T13:11:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790:/ 2024-03-30T13:11:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=e28e230a-999b-4d07-a5bd-ee507abf8d14" will pass to kernel 2024-03-30T13:11:16.756 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-30T13:11:16.756 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:11:16.756 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:11:16.756 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:11:16.756 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:11:16.760 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:11:16.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:16.760 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-30T13:11:16.840 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:16.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:16.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:16.947 INFO:teuthology.orchestra.run.smithi099.stdout:client4704 2024-03-30T13:11:16.948 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:11:16.948 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:16.998 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:17.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:17.156 INFO:teuthology.orchestra.run.smithi099.stdout:client4704 2024-03-30T13:11:17.156 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:17.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:17.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:17.279 INFO:teuthology.orchestra.run.smithi099.stdout:client4704 2024-03-30T13:11:17.279 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e28e230a-999b-4d07-a5bd-ee507abf8d14.client4704/status') 2024-03-30T13:11:17.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:17.416 INFO:teuthology.orchestra.run.smithi099.stdout:instance: client.4704 (3)192.168.0.2:0/3320912491 2024-03-30T13:11:17.416 INFO:teuthology.orchestra.run.smithi099.stdout:blocklisted: false 2024-03-30T13:11:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records in 2024-03-30T13:11:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records out 2024-03-30T13:11:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:69 bytes copied, 7.371e-05 s, 936 kB/s 2024-03-30T13:11:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:17.427 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-03-30T13:11:17.427 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:11:17.428 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-30T13:11:17.428 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:11:17.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.629+0000 7f59dc600640 1 Processor -- start 2024-03-30T13:11:17.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.629+0000 7f59dc600640 1 -- start start 2024-03-30T13:11:17.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.631+0000 7f59dc600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f59d415d140 0x7f59d406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:17.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.631+0000 7f59dc600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59d40d0490 0x7f59d40d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:17.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.631+0000 7f59dc600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d4163640 con 0x7f59d4163180 2024-03-30T13:11:17.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.631+0000 7f59dc600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f59d40b3ee0 con 0x7f59d40d0490 2024-03-30T13:11:17.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.631+0000 7f59dc600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f59d40725c0 con 0x7f59d415d140 2024-03-30T13:11:17.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.631+0000 7f59d9200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f59d4163180 0x7f59d40b37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44172/0 (socket says 172.21.15.99:44172) 2024-03-30T13:11:17.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.631+0000 7f59d9200640 1 -- 172.21.15.99:0/3242439404 learned_addr learned my addr 172.21.15.99:0/3242439404 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:17.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.631+0000 7f59da600640 1 --2- 172.21.15.99:0/3242439404 >> v2:172.21.15.99:3300/0 conn(0x7f59d40d0490 0x7f59d40d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:17.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.631+0000 7f59d9c00640 1 --2- 172.21.15.99:0/3242439404 >> v2:172.21.15.181:3300/0 conn(0x7f59d415d140 0x7f59d406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:17.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.632+0000 7f59d3e00640 1 -- 172.21.15.99:0/3242439404 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3567819735 0 0) 0x7f59d4163640 con 0x7f59d4163180 2024-03-30T13:11:17.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.632+0000 7f59d3e00640 1 -- 172.21.15.99:0/3242439404 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59bc003520 con 0x7f59d4163180 2024-03-30T13:11:17.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.632+0000 7f59da600640 1 -- 172.21.15.99:0/3242439404 >> v2:172.21.15.181:3300/0 conn(0x7f59d415d140 msgr2=0x7f59d406f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:17.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.632+0000 7f59da600640 1 --2- 172.21.15.99:0/3242439404 >> v2:172.21.15.181:3300/0 conn(0x7f59d415d140 0x7f59d406f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:17.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.632+0000 7f59da600640 1 -- 172.21.15.99:0/3242439404 >> v1:172.21.15.99:6789/0 conn(0x7f59d4163180 legacy=0x7f59d40b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:17.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.632+0000 7f59da600640 1 -- 172.21.15.99:0/3242439404 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d4163920 con 0x7f59d40d0490 2024-03-30T13:11:17.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.633+0000 7f59da600640 1 --2- 172.21.15.99:0/3242439404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d40d0490 0x7f59d40d08d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59d40d1350 tx=0x7f59cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e57a783e00fbb67 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:17.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.633+0000 7f59d3e00640 1 -- 172.21.15.99:0/3242439404 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0315a0 con 0x7f59d40d0490 2024-03-30T13:11:17.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.633+0000 7f59d3e00640 1 -- 172.21.15.99:0/3242439404 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59cc037070 con 0x7f59d40d0490 2024-03-30T13:11:17.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.633+0000 7f59d3e00640 1 -- 172.21.15.99:0/3242439404 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc031960 con 0x7f59d40d0490 2024-03-30T13:11:17.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.634+0000 7f59dc600640 1 -- 172.21.15.99:0/3242439404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d40d0490 msgr2=0x7f59d40d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:17.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.634+0000 7f59dc600640 1 --2- 172.21.15.99:0/3242439404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d40d0490 0x7f59d40d08d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59d40d1350 tx=0x7f59cc02b840 comp rx=0 tx=0).stop 2024-03-30T13:11:17.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.634+0000 7f59dc600640 1 -- 172.21.15.99:0/3242439404 shutdown_connections 2024-03-30T13:11:17.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.634+0000 7f59dc600640 1 --2- 172.21.15.99:0/3242439404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d40d0490 0x7f59d40d08d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:17.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.634+0000 7f59dc600640 1 --2- 172.21.15.99:0/3242439404 >> v2:172.21.15.181:3300/0 conn(0x7f59d415d140 0x7f59d406f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:17.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.634+0000 7f59dc600640 1 -- 172.21.15.99:0/3242439404 >> 172.21.15.99:0/3242439404 conn(0x7f59d406b6f0 msgr2=0x7f59d406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:17.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.634+0000 7f59dc600640 1 -- 172.21.15.99:0/3242439404 shutdown_connections 2024-03-30T13:11:17.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.634+0000 7f59dc600640 1 -- 172.21.15.99:0/3242439404 wait complete. 2024-03-30T13:11:17.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.636+0000 7f59dc600640 1 Processor -- start 2024-03-30T13:11:17.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.636+0000 7f59dc600640 1 -- start start 2024-03-30T13:11:17.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59dc600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59d40d0490 0x7f59d40ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:17.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59dc600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d415d140 0x7f59d4159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:17.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59dc600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59d4163180 0x7f59d40b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:17.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59dc600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f59d4163ee0 con 0x7f59d415d140 2024-03-30T13:11:17.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59dc600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f59d40d0e10 con 0x7f59d40d0490 2024-03-30T13:11:17.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59dc600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f59d415d520 con 0x7f59d4163180 2024-03-30T13:11:17.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59d9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d415d140 0x7f59d4159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:17.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59d9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d415d140 0x7f59d4159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47668/0 (socket says 172.21.15.99:47668) 2024-03-30T13:11:17.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59d9200640 1 -- 172.21.15.99:0/1004177008 learned_addr learned my addr 172.21.15.99:0/1004177008 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:17.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59da600640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59d4163180 0x7f59d40b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:17.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59d9c00640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59d40d0490 0x7f59d40ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:17.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59d9200640 1 -- 172.21.15.99:0/1004177008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59d4163180 msgr2=0x7f59d40b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:17.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59d9200640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59d4163180 0x7f59d40b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:17.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59d9200640 1 -- 172.21.15.99:0/1004177008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59d40d0490 msgr2=0x7f59d40ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:17.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.637+0000 7f59d9200640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59d40d0490 0x7f59d40ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:17.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.638+0000 7f59d9200640 1 -- 172.21.15.99:0/1004177008 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d40ce200 con 0x7f59d415d140 2024-03-30T13:11:17.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.638+0000 7f59d9200640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d415d140 0x7f59d4159910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59c0001eb0 tx=0x7f59c000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:17.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.638+0000 7f59d1600640 1 -- 172.21.15.99:0/1004177008 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0017070 con 0x7f59d415d140 2024-03-30T13:11:17.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.638+0000 7f59d1600640 1 -- 172.21.15.99:0/1004177008 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c0005d00 con 0x7f59d415d140 2024-03-30T13:11:17.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.638+0000 7f59d1600640 1 -- 172.21.15.99:0/1004177008 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0007310 con 0x7f59d415d140 2024-03-30T13:11:17.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.638+0000 7f59dc600640 1 -- 172.21.15.99:0/1004177008 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d40aee00 con 0x7f59d415d140 2024-03-30T13:11:17.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.638+0000 7f59dc600640 1 -- 172.21.15.99:0/1004177008 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d40cda00 con 0x7f59d415d140 2024-03-30T13:11:17.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.640+0000 7f59dc600640 1 -- 172.21.15.99:0/1004177008 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d4068640 con 0x7f59d415d140 2024-03-30T13:11:17.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.640+0000 7f59d1600640 1 -- 172.21.15.99:0/1004177008 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f59c001a070 con 0x7f59d415d140 2024-03-30T13:11:17.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.642+0000 7f59d1600640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f59b406c560 0x7f59b406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:17.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.642+0000 7f59d1600640 1 -- 172.21.15.99:0/1004177008 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f59c008a9d0 con 0x7f59d415d140 2024-03-30T13:11:17.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.642+0000 7f59d9c00640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f59b406c560 0x7f59b406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:17.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.643+0000 7f59d9c00640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f59b406c560 0x7f59b406ea20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009fd0 tx=0x7f59c800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:17.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.646+0000 7f59d1600640 1 -- 172.21.15.99:0/1004177008 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f59c0059080 con 0x7f59d415d140 2024-03-30T13:11:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.888+0000 7f59dc600640 1 -- 172.21.15.99:0/1004177008 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f59d406f700 con 0x7f59d415d140 2024-03-30T13:11:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.888+0000 7f59d1600640 1 -- 172.21.15.99:0/1004177008 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f59c0058980 con 0x7f59d415d140 2024-03-30T13:11:17.893 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:11:17.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 -- 172.21.15.99:0/1004177008 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f59b406c560 msgr2=0x7f59b406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:17.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f59b406c560 0x7f59b406ea20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009fd0 tx=0x7f59c800b040 comp rx=0 tx=0).stop 2024-03-30T13:11:17.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 -- 172.21.15.99:0/1004177008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d415d140 msgr2=0x7f59d4159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d415d140 0x7f59d4159910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59c0001eb0 tx=0x7f59c000c820 comp rx=0 tx=0).stop 2024-03-30T13:11:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 -- 172.21.15.99:0/1004177008 shutdown_connections 2024-03-30T13:11:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f59b406c560 0x7f59b406ea20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59d4163180 0x7f59d40b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d415d140 0x7f59d4159910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 --2- 172.21.15.99:0/1004177008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59d40d0490 0x7f59d40ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 -- 172.21.15.99:0/1004177008 >> 172.21.15.99:0/1004177008 conn(0x7f59d406b6f0 msgr2=0x7f59d406d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 -- 172.21.15.99:0/1004177008 shutdown_connections 2024-03-30T13:11:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:17.891+0000 7f59dc600640 1 -- 172.21.15.99:0/1004177008 wait complete. 2024-03-30T13:11:17.912 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:11:17.912 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:11:17.913 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-03-30T13:11:17.913 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-30T13:11:17.913 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-30T13:11:17.913 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:11:17.913 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:11:17.913 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:11:17.913 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:11:17.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:17.913 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-03-30T13:11:17.970 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:11:17.970 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:11:17.970 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:11:17.971 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:17.971 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-03-30T13:11:17.971 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:17.971 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:17.971 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:17.971 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-03-30T13:11:17.971 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:17.971 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:17.971 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-03-30T13:11:17.971 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:17.971 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:17.972 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:11:17.972 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:17.972 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T13:11:17.972 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42370sec preferred_lft 42370sec 2024-03-30T13:11:17.972 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-03-30T13:11:17.972 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:17.972 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-30T13:11:17.972 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:17.972 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-03-30T13:11:17.973 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add name ceph-brx type bridge 2024-03-30T13:11:17.973 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip addr flush dev ceph-brx 2024-03-30T13:11:17.973 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set ceph-brx up 2024-03-30T13:11:17.973 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-30T13:11:17.973 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-03-30T13:11:18.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:18.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:18.480 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:11:18.561 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-03-30T13:11:18.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:18.565 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-03-30T13:11:18.616 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-03-30T13:11:18.616 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:11:18.616 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:11:18.616 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:11:18.616 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:11:18.616 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:18.616 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-03-30T13:11:18.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:11:18.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:11:18.617 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:11:18.617 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-03-30T13:11:18.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:19.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:19.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:19.431 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-03-30T13:11:19.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:19.490 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list-id 2024-03-30T13:11:19.542 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:19.542 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-03-30T13:11:19.543 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:11:19.543 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-30T13:11:19.543 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-03-30T13:11:19.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:19.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:19.741 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-30T13:11:19.741 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:19.741 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-03-30T13:11:19.741 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-30T13:11:19.741 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-30T13:11:19.741 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-30T13:11:19.741 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-30T13:11:19.742 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-30T13:11:19.742 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-03-30T13:11:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:20.057 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:20.058 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-03-30T13:11:20.058 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-03-30T13:11:20.058 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set dev brx.0 master ceph-brx 2024-03-30T13:11:20.058 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-03-30T13:11:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:20.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:20.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:11:20.280 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-30T13:11:20.327 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:11:20.328 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:11:20.328 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:11:20.374 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:11:20.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:20.374 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:11:20.504 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:11:20.505 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:11:20.505 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-03-30T13:11:21.106 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:11:21.106 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:11:21.106 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-03-30T13:11:21.106 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:11:21.106 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:11:21.140 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:11:21.140 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:11:21.140 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-03-30T13:11:21.140 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:11:21.141 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:11:21.141 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790" 2024-03-30T13:11:21.141 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790:/ 2024-03-30T13:11:21.141 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=e28e230a-999b-4d07-a5bd-ee507abf8d14" will pass to kernel 2024-03-30T13:11:21.143 INFO:teuthology.orchestra.run.smithi181.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-30T13:11:21.143 INFO:teuthology.orchestra.run.smithi181.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:11:21.143 INFO:teuthology.orchestra.run.smithi181.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:11:21.143 INFO:teuthology.orchestra.run.smithi181.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:11:21.143 INFO:teuthology.orchestra.run.smithi181.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:11:21.149 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:11:21.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:21.149 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:11:21.241 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:21.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:21.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:21.364 INFO:teuthology.orchestra.run.smithi181.stdout:client4445 2024-03-30T13:11:21.364 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:11:21.364 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:21.417 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:21.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:21.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:21.580 INFO:teuthology.orchestra.run.smithi181.stdout:client4445 2024-03-30T13:11:21.580 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:21.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:21.697 INFO:teuthology.orchestra.run.smithi181.stdout:client4445 2024-03-30T13:11:21.697 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e28e230a-999b-4d07-a5bd-ee507abf8d14.client4445/status') 2024-03-30T13:11:21.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:21.839 INFO:teuthology.orchestra.run.smithi181.stdout:instance: client.4445 (3)192.168.0.1:0/3305241402 2024-03-30T13:11:21.839 INFO:teuthology.orchestra.run.smithi181.stdout:blocklisted: false 2024-03-30T13:11:21.839 INFO:teuthology.orchestra.run.smithi181.stderr:0+1 records in 2024-03-30T13:11:21.839 INFO:teuthology.orchestra.run.smithi181.stderr:0+1 records out 2024-03-30T13:11:21.840 INFO:teuthology.orchestra.run.smithi181.stderr:69 bytes copied, 7.4227e-05 s, 930 kB/s 2024-03-30T13:11:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:21.853 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-03-30T13:11:21.853 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:11:21.853 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-30T13:11:21.853 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:11:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.060+0000 7ff024a00640 1 Processor -- start 2024-03-30T13:11:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.060+0000 7ff024a00640 1 -- start start 2024-03-30T13:11:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.061+0000 7ff024a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff02015ea80 0x7ff0200720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.062+0000 7ff024a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff02006c990 0x7ff0200b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.062+0000 7ff024a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff020072690 con 0x7ff0200b40c0 2024-03-30T13:11:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.062+0000 7ff024a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff0200ce9d0 con 0x7ff02006c990 2024-03-30T13:11:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.062+0000 7ff024a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff0200cef90 con 0x7ff02015ea80 2024-03-30T13:11:22.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.062+0000 7ff015400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff02006c990 0x7ff0200b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.062+0000 7ff01de00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff02015ea80 0x7ff0200720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.062+0000 7ff01e800640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff0200b40c0 0x7ff0200cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:51216/0 (socket says 172.21.15.99:51216) 2024-03-30T13:11:22.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.062+0000 7ff01e800640 1 -- 172.21.15.99:0/2996901835 learned_addr learned my addr 172.21.15.99:0/2996901835 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.063+0000 7ff01d400640 1 -- 172.21.15.99:0/2996901835 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121430486 0 0) 0x7ff020072690 con 0x7ff0200b40c0 2024-03-30T13:11:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.063+0000 7ff01d400640 1 -- 172.21.15.99:0/2996901835 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff004003520 con 0x7ff0200b40c0 2024-03-30T13:11:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.063+0000 7ff015400640 1 -- 172.21.15.99:0/2996901835 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff02015ea80 msgr2=0x7ff0200720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.063+0000 7ff015400640 1 --2- 172.21.15.99:0/2996901835 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff02015ea80 0x7ff0200720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.063+0000 7ff015400640 1 -- 172.21.15.99:0/2996901835 >> v1:172.21.15.181:6789/0 conn(0x7ff0200b40c0 legacy=0x7ff0200cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.063+0000 7ff015400640 1 -- 172.21.15.99:0/2996901835 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff020072970 con 0x7ff02006c990 2024-03-30T13:11:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.065+0000 7ff015400640 1 --2- 172.21.15.99:0/2996901835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff02006c990 0x7ff0200b3b80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff0080097a0 tx=0x7ff00802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=352cca7eca923f8e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.065+0000 7ff01d400640 1 -- 172.21.15.99:0/2996901835 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008031780 con 0x7ff02006c990 2024-03-30T13:11:22.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.065+0000 7ff01d400640 1 -- 172.21.15.99:0/2996901835 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff008037070 con 0x7ff02006c990 2024-03-30T13:11:22.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.065+0000 7ff01d400640 1 -- 172.21.15.99:0/2996901835 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008031b20 con 0x7ff02006c990 2024-03-30T13:11:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.066+0000 7ff024a00640 1 -- 172.21.15.99:0/2996901835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff02006c990 msgr2=0x7ff0200b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.066+0000 7ff024a00640 1 --2- 172.21.15.99:0/2996901835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff02006c990 0x7ff0200b3b80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff0080097a0 tx=0x7ff00802b820 comp rx=0 tx=0).stop 2024-03-30T13:11:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.066+0000 7ff024a00640 1 -- 172.21.15.99:0/2996901835 shutdown_connections 2024-03-30T13:11:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.066+0000 7ff024a00640 1 --2- 172.21.15.99:0/2996901835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff02006c990 0x7ff0200b3b80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.066+0000 7ff024a00640 1 --2- 172.21.15.99:0/2996901835 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff02015ea80 0x7ff0200720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.066+0000 7ff024a00640 1 -- 172.21.15.99:0/2996901835 >> 172.21.15.99:0/2996901835 conn(0x7ff0200d0ad0 msgr2=0x7ff0200d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.066+0000 7ff024a00640 1 -- 172.21.15.99:0/2996901835 shutdown_connections 2024-03-30T13:11:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.066+0000 7ff024a00640 1 -- 172.21.15.99:0/2996901835 wait complete. 2024-03-30T13:11:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.068+0000 7ff024a00640 1 Processor -- start 2024-03-30T13:11:22.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.068+0000 7ff024a00640 1 -- start start 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff024a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02006c990 0x7ff02014e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff024a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0200b40c0 0x7ff0200c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff024a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff02015ea80 0x7ff0201f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff024a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff0200cfb30 con 0x7ff02006c990 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff024a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff0200b5ed0 con 0x7ff02015ea80 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff024a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff0200cfcb0 con 0x7ff0200b40c0 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff01de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02006c990 0x7ff02014e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff01de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02006c990 0x7ff02014e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47684/0 (socket says 172.21.15.99:47684) 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff01de00640 1 -- 172.21.15.99:0/762883567 learned_addr learned my addr 172.21.15.99:0/762883567 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff01e800640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff02015ea80 0x7ff0201f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff01de00640 1 -- 172.21.15.99:0/762883567 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0200b40c0 msgr2=0x7ff0200c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff01de00640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0200b40c0 0x7ff0200c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff01de00640 1 -- 172.21.15.99:0/762883567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff02015ea80 msgr2=0x7ff0201f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff01de00640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff02015ea80 0x7ff0201f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.069+0000 7ff01de00640 1 -- 172.21.15.99:0/762883567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0201f4c70 con 0x7ff02006c990 2024-03-30T13:11:22.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.070+0000 7ff01de00640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02006c990 0x7ff02014e760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff01000e9b0 tx=0x7ff01000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.070+0000 7ff016a00640 1 -- 172.21.15.99:0/762883567 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff010017070 con 0x7ff02006c990 2024-03-30T13:11:22.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.070+0000 7ff016a00640 1 -- 172.21.15.99:0/762883567 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff01000c9a0 con 0x7ff02006c990 2024-03-30T13:11:22.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.070+0000 7ff016a00640 1 -- 172.21.15.99:0/762883567 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01000cd90 con 0x7ff02006c990 2024-03-30T13:11:22.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.070+0000 7ff024a00640 1 -- 172.21.15.99:0/762883567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0201f4f50 con 0x7ff02006c990 2024-03-30T13:11:22.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.070+0000 7ff024a00640 1 -- 172.21.15.99:0/762883567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0200c5fe0 con 0x7ff02006c990 2024-03-30T13:11:22.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.071+0000 7ff024a00640 1 -- 172.21.15.99:0/762883567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0200c5af0 con 0x7ff02006c990 2024-03-30T13:11:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.073+0000 7ff016a00640 1 -- 172.21.15.99:0/762883567 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff01001a070 con 0x7ff02006c990 2024-03-30T13:11:22.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.074+0000 7ff016a00640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feffc06c530 0x7feffc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.074+0000 7ff016a00640 1 -- 172.21.15.99:0/762883567 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff01008bae0 con 0x7ff02006c990 2024-03-30T13:11:22.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.075+0000 7ff015400640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feffc06c530 0x7feffc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.075+0000 7ff015400640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feffc06c530 0x7feffc06e9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff008036000 tx=0x7ff008030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.079+0000 7ff016a00640 1 -- 172.21.15.99:0/762883567 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff01005a0f0 con 0x7ff02006c990 2024-03-30T13:11:22.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.321+0000 7ff024a00640 1 -- 172.21.15.99:0/762883567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff020068d50 con 0x7ff02006c990 2024-03-30T13:11:22.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.321+0000 7ff016a00640 1 -- 172.21.15.99:0/762883567 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7ff0100599f0 con 0x7ff02006c990 2024-03-30T13:11:22.326 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:11:22.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 -- 172.21.15.99:0/762883567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feffc06c530 msgr2=0x7feffc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feffc06c530 0x7feffc06e9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff008036000 tx=0x7ff008030000 comp rx=0 tx=0).stop 2024-03-30T13:11:22.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 -- 172.21.15.99:0/762883567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02006c990 msgr2=0x7ff02014e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02006c990 0x7ff02014e760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff01000e9b0 tx=0x7ff01000ee70 comp rx=0 tx=0).stop 2024-03-30T13:11:22.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 -- 172.21.15.99:0/762883567 shutdown_connections 2024-03-30T13:11:22.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feffc06c530 0x7feffc06e9f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff02015ea80 0x7ff0201f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0200b40c0 0x7ff0200c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 --2- 172.21.15.99:0/762883567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02006c990 0x7ff02014e760 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 -- 172.21.15.99:0/762883567 >> 172.21.15.99:0/762883567 conn(0x7ff0200d0ad0 msgr2=0x7ff0200cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 -- 172.21.15.99:0/762883567 shutdown_connections 2024-03-30T13:11:22.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:22.324+0000 7ff024a00640 1 -- 172.21.15.99:0/762883567 wait complete. 2024-03-30T13:11:22.352 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:11:22.352 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:11:22.352 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-03-30T13:11:22.352 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-30T13:11:22.353 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-30T13:11:22.353 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:11:22.353 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:11:22.353 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:11:22.353 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-30T13:11:22.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:22.353 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-03-30T13:11:22.411 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:22.412 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:11:22.413 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:22.413 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T13:11:22.413 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42366sec preferred_lft 42366sec 2024-03-30T13:11:22.413 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-03-30T13:11:22.413 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:22.413 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:11:22.413 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 06:93:ed:d4:56:3f brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:22.413 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:11:22.414 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:22.414 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::64c4:75ff:fe23:1693/64 scope link 2024-03-30T13:11:22.414 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:22.414 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:11:22.414 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 06:93:ed:d4:56:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:11:22.414 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::493:edff:fed4:563f/64 scope link 2024-03-30T13:11:22.414 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:22.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:22.415 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:11:22.508 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-03-30T13:11:22.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:22.512 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-03-30T13:11:22.566 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-03-30T13:11:22.566 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:11:22.566 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:11:22.566 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:11:22.566 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:11:22.567 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:22.567 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-03-30T13:11:22.568 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:11:22.568 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:11:22.568 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:11:22.568 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-03-30T13:11:22.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:22.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:22.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:22.810 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-03-30T13:11:22.862 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-30T13:11:22.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:22.863 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list-id 2024-03-30T13:11:22.914 INFO:teuthology.orchestra.run.smithi181.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-30T13:11:22.915 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:22.915 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-03-30T13:11:22.915 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:11:22.915 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-30T13:11:22.916 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-03-30T13:11:23.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:23.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:23.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:23.118 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-30T13:11:23.208 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:11:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:11:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:11:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-03-30T13:11:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:23.208 INFO:teuthology.orchestra.run.smithi181.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:11:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7a:f4:a1:9f:c7:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:11:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:11:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::78f4:a1ff:fe9f:c717/64 scope link 2024-03-30T13:11:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:23.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:23.212 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-30T13:11:23.299 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:11:23.300 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:11:23.300 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:11:23.300 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:23.300 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-03-30T13:11:23.300 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:23.300 INFO:teuthology.orchestra.run.smithi181.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:11:23.300 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7a:f4:a1:9f:c7:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:11:23.300 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:11:23.300 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:23.301 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::78f4:a1ff:fe9f:c717/64 scope link 2024-03-30T13:11:23.301 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:23.303 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-30T13:11:23.304 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:23.304 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-03-30T13:11:23.304 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-30T13:11:23.304 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-30T13:11:23.304 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-30T13:11:23.304 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-30T13:11:23.304 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-30T13:11:23.304 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-03-30T13:11:23.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:23.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:23.639 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:23.639 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-03-30T13:11:23.639 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.1 up 2024-03-30T13:11:23.639 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set dev brx.1 master ceph-brx 2024-03-30T13:11:23.639 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:23.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:23.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:11:23.874 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-30T13:11:23.921 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-30T13:11:23.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:11:23.921 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-30T13:11:24.017 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:11:24.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:24.017 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T13:11:24.146 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T13:11:24.146 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-30T13:11:24.146 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-03-30T13:11:24.168 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T13:11:24.168 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-30T13:11:24.168 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-03-30T13:11:24.168 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:11:24.168 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:11:24.195 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T13:11:24.195 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-30T13:11:24.195 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-03-30T13:11:24.195 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:11:24.195 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:11:24.195 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790" 2024-03-30T13:11:24.195 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790:/ 2024-03-30T13:11:24.195 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=e28e230a-999b-4d07-a5bd-ee507abf8d14" will pass to kernel 2024-03-30T13:11:24.198 INFO:teuthology.orchestra.run.smithi181.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-30T13:11:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:11:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:11:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:11:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:11:24.201 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:11:24.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:24.201 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-30T13:11:24.282 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:24.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:24.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:24.408 INFO:teuthology.orchestra.run.smithi181.stdout:client4510 2024-03-30T13:11:24.409 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:11:24.409 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:24.462 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:24.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:24.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:24.629 INFO:teuthology.orchestra.run.smithi181.stdout:client4510 2024-03-30T13:11:24.629 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:11:24.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:24.747 INFO:teuthology.orchestra.run.smithi181.stdout:client4510 2024-03-30T13:11:24.747 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e28e230a-999b-4d07-a5bd-ee507abf8d14.client4510/status') 2024-03-30T13:11:24.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:24.891 INFO:teuthology.orchestra.run.smithi181.stdout:instance: client.4510 (3)192.168.0.2:0/3255975799 2024-03-30T13:11:24.891 INFO:teuthology.orchestra.run.smithi181.stdout:blocklisted: false 2024-03-30T13:11:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:0+1 records in 2024-03-30T13:11:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:0+1 records out 2024-03-30T13:11:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:69 bytes copied, 7.7504e-05 s, 890 kB/s 2024-03-30T13:11:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:11:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:24.905 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-30T13:11:24.924 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:25.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.136+0000 7fd913000640 1 Processor -- start 2024-03-30T13:11:25.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.136+0000 7fd913000640 1 -- start start 2024-03-30T13:11:25.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.137+0000 7fd913000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd90c0b3c50 0x7fd90c0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.137+0000 7fd913000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd90c0d3140 0x7fd90c06cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.137+0000 7fd913000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd90c0cfb30 con 0x7fd90c15e930 2024-03-30T13:11:25.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.137+0000 7fd913000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd90c0d3590 con 0x7fd90c0d3140 2024-03-30T13:11:25.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.137+0000 7fd913000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd90c06c780 con 0x7fd90c0b3c50 2024-03-30T13:11:25.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.138+0000 7fd911000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd90c0d3140 0x7fd90c06cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.138+0000 7fd90be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd90c15e930 0x7fd90c0cf130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46516/0 (socket says 172.21.15.99:46516) 2024-03-30T13:11:25.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.138+0000 7fd911000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd90c0d3140 0x7fd90c06cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43350/0 (socket says 172.21.15.99:43350) 2024-03-30T13:11:25.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.138+0000 7fd90be00640 1 -- 172.21.15.99:0/598609096 learned_addr learned my addr 172.21.15.99:0/598609096 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:25.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.138+0000 7fd90b400640 1 --2- 172.21.15.99:0/598609096 >> v2:172.21.15.181:3300/0 conn(0x7fd90c0b3c50 0x7fd90c0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.138+0000 7fd911000640 1 -- 172.21.15.99:0/598609096 >> v2:172.21.15.181:3300/0 conn(0x7fd90c0b3c50 msgr2=0x7fd90c0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:25.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.138+0000 7fd911000640 1 --2- 172.21.15.99:0/598609096 >> v2:172.21.15.181:3300/0 conn(0x7fd90c0b3c50 0x7fd90c0d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.138+0000 7fd911000640 1 -- 172.21.15.99:0/598609096 >> v1:172.21.15.99:6789/0 conn(0x7fd90c15e930 legacy=0x7fd90c0cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.138+0000 7fd911000640 1 -- 172.21.15.99:0/598609096 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c0cfe10 con 0x7fd90c0d3140 2024-03-30T13:11:25.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.139+0000 7fd911000640 1 --2- 172.21.15.99:0/598609096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd90c0d3140 0x7fd90c06cc10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd90c08e610 tx=0x7fd90402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea32c59fadd180f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.140+0000 7fd90aa00640 1 -- 172.21.15.99:0/598609096 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9040315a0 con 0x7fd90c0d3140 2024-03-30T13:11:25.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.140+0000 7fd90aa00640 1 -- 172.21.15.99:0/598609096 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd904037070 con 0x7fd90c0d3140 2024-03-30T13:11:25.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.140+0000 7fd90aa00640 1 -- 172.21.15.99:0/598609096 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904031960 con 0x7fd90c0d3140 2024-03-30T13:11:25.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.140+0000 7fd913000640 1 -- 172.21.15.99:0/598609096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd90c0d3140 msgr2=0x7fd90c06cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.140+0000 7fd913000640 1 --2- 172.21.15.99:0/598609096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd90c0d3140 0x7fd90c06cc10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd90c08e610 tx=0x7fd90402b840 comp rx=0 tx=0).stop 2024-03-30T13:11:25.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.140+0000 7fd913000640 1 -- 172.21.15.99:0/598609096 shutdown_connections 2024-03-30T13:11:25.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.140+0000 7fd913000640 1 --2- 172.21.15.99:0/598609096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd90c0d3140 0x7fd90c06cc10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.140+0000 7fd913000640 1 --2- 172.21.15.99:0/598609096 >> v2:172.21.15.181:3300/0 conn(0x7fd90c0b3c50 0x7fd90c0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.140+0000 7fd913000640 1 -- 172.21.15.99:0/598609096 >> 172.21.15.99:0/598609096 conn(0x7fd90c08bfc0 msgr2=0x7fd90c0d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.140+0000 7fd913000640 1 -- 172.21.15.99:0/598609096 shutdown_connections 2024-03-30T13:11:25.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.140+0000 7fd913000640 1 -- 172.21.15.99:0/598609096 wait complete. 2024-03-30T13:11:25.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.142+0000 7fd913000640 1 Processor -- start 2024-03-30T13:11:25.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.142+0000 7fd913000640 1 -- start start 2024-03-30T13:11:25.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.143+0000 7fd913000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd90c0b3c50 0x7fd90c1f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.143+0000 7fd913000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd90c0d3140 0x7fd90c1610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.143+0000 7fd913000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd90c15e930 0x7fd90c157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.143+0000 7fd913000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c0cf840 con 0x7fd90c0d3140 2024-03-30T13:11:25.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.143+0000 7fd913000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c0d03d0 con 0x7fd90c15e930 2024-03-30T13:11:25.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.143+0000 7fd913000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c15ed10 con 0x7fd90c0b3c50 2024-03-30T13:11:25.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.143+0000 7fd90b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd90c0d3140 0x7fd90c1610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.143+0000 7fd90b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd90c0d3140 0x7fd90c1610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43366/0 (socket says 172.21.15.99:43366) 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.143+0000 7fd90b400640 1 -- 172.21.15.99:0/4095196933 learned_addr learned my addr 172.21.15.99:0/4095196933 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.144+0000 7fd90b400640 1 -- 172.21.15.99:0/4095196933 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd90c0b3c50 msgr2=0x7fd90c1f7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.144+0000 7fd90b400640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd90c0b3c50 0x7fd90c1f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.144+0000 7fd911000640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd90c15e930 0x7fd90c157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.144+0000 7fd90b400640 1 -- 172.21.15.99:0/4095196933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd90c15e930 msgr2=0x7fd90c157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.144+0000 7fd90b400640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd90c15e930 0x7fd90c157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.144+0000 7fd90b400640 1 -- 172.21.15.99:0/4095196933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c1f8b00 con 0x7fd90c0d3140 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.144+0000 7fd90b400640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd90c0d3140 0x7fd90c1610f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c7f0 tx=0x7fd8f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.144+0000 7fd903e00640 1 -- 172.21.15.99:0/4095196933 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8015070 con 0x7fd90c0d3140 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.144+0000 7fd903e00640 1 -- 172.21.15.99:0/4095196933 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f8007820 con 0x7fd90c0d3140 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.144+0000 7fd903e00640 1 -- 172.21.15.99:0/4095196933 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8007bd0 con 0x7fd90c0d3140 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.144+0000 7fd913000640 1 -- 172.21.15.99:0/4095196933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90c1581c0 con 0x7fd90c0d3140 2024-03-30T13:11:25.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.145+0000 7fd913000640 1 -- 172.21.15.99:0/4095196933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd90c1f8540 con 0x7fd90c0d3140 2024-03-30T13:11:25.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.146+0000 7fd913000640 1 -- 172.21.15.99:0/4095196933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd90c068640 con 0x7fd90c0d3140 2024-03-30T13:11:25.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.147+0000 7fd903e00640 1 -- 172.21.15.99:0/4095196933 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd8f8018070 con 0x7fd90c0d3140 2024-03-30T13:11:25.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.147+0000 7fd903e00640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd8ec06c530 0x7fd8ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.148+0000 7fd903e00640 1 -- 172.21.15.99:0/4095196933 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd8f808b400 con 0x7fd90c0d3140 2024-03-30T13:11:25.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.148+0000 7fd90be00640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd8ec06c530 0x7fd8ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.148+0000 7fd90be00640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd8ec06c530 0x7fd8ec06e9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0012e0 tx=0x7fd8fc001630 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.157+0000 7fd903e00640 1 -- 172.21.15.99:0/4095196933 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd8f8059a10 con 0x7fd90c0d3140 2024-03-30T13:11:25.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.363+0000 7fd913000640 1 -- 172.21.15.99:0/4095196933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd90c0d27f0 con 0x7fd90c0d3140 2024-03-30T13:11:25.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.365+0000 7fd903e00640 1 -- 172.21.15.99:0/4095196933 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16609 (secure 0 0 0) 0x7fd8f8059310 con 0x7fd90c0d3140 2024-03-30T13:11:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:25.370 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":22,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:10:47.229108+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.368+0000 7fd913000640 1 -- 172.21.15.99:0/4095196933 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd8ec06c530 msgr2=0x7fd8ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.368+0000 7fd913000640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd8ec06c530 0x7fd8ec06e9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0012e0 tx=0x7fd8fc001630 comp rx=0 tx=0).stop 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.368+0000 7fd913000640 1 -- 172.21.15.99:0/4095196933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd90c0d3140 msgr2=0x7fd90c1610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.368+0000 7fd913000640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd90c0d3140 0x7fd90c1610f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c7f0 tx=0x7fd8f800ccb0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.368+0000 7fd913000640 1 -- 172.21.15.99:0/4095196933 shutdown_connections 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.368+0000 7fd913000640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd8ec06c530 0x7fd8ec06e9f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.368+0000 7fd913000640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd90c15e930 0x7fd90c157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.368+0000 7fd913000640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd90c0d3140 0x7fd90c1610f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.368+0000 7fd913000640 1 --2- 172.21.15.99:0/4095196933 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd90c0b3c50 0x7fd90c1f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.368+0000 7fd913000640 1 -- 172.21.15.99:0/4095196933 >> 172.21.15.99:0/4095196933 conn(0x7fd90c08bfc0 msgr2=0x7fd90c0b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.368+0000 7fd913000640 1 -- 172.21.15.99:0/4095196933 shutdown_connections 2024-03-30T13:11:25.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.369+0000 7fd913000640 1 -- 172.21.15.99:0/4095196933 wait complete. 2024-03-30T13:11:25.391 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:25.392 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:25.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.594+0000 7f1a5f000640 1 Processor -- start 2024-03-30T13:11:25.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.594+0000 7f1a5f000640 1 -- start start 2024-03-30T13:11:25.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.596+0000 7f1a5f000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a580b3c50 0x7f1a5806c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.596+0000 7f1a5f000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1a580cfc80 0x7f1a580d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.596+0000 7f1a5f000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a580d3120 con 0x7f1a580d2c40 2024-03-30T13:11:25.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.596+0000 7f1a5f000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1a580d3400 con 0x7f1a580cfc80 2024-03-30T13:11:25.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.596+0000 7f1a5f000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1a580d36e0 con 0x7f1a580b3c50 2024-03-30T13:11:25.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.596+0000 7f1a4fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1a580d2c40 0x7f1a5806cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46522/0 (socket says 172.21.15.99:46522) 2024-03-30T13:11:25.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.596+0000 7f1a4fe00640 1 -- 172.21.15.99:0/331286757 learned_addr learned my addr 172.21.15.99:0/331286757 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:25.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.596+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564681746 0 0) 0x7f1a580d3120 con 0x7f1a580d2c40 2024-03-30T13:11:25.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.596+0000 7f1a5d000640 1 --2- 172.21.15.99:0/331286757 >> v2:172.21.15.181:3300/0 conn(0x7f1a580cfc80 0x7f1a580d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.596+0000 7f1a57e00640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a580b3c50 0x7f1a5806c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.596+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a3c003520 con 0x7f1a580d2c40 2024-03-30T13:11:25.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2234995002 0 0) 0x7f1a3c003520 con 0x7f1a580d2c40 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a580b3c50 msgr2=0x7f1a5806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a580b3c50 0x7f1a5806c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 >> v2:172.21.15.181:3300/0 conn(0x7f1a580cfc80 msgr2=0x7f1a580d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 --2- 172.21.15.99:0/331286757 >> v2:172.21.15.181:3300/0 conn(0x7f1a580cfc80 0x7f1a580d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a580cf760 con 0x7f1a580d2c40 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f1a40001670 con 0x7f1a580d2c40 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 >> v1:172.21.15.99:6789/0 conn(0x7f1a580d2c40 legacy=0x7f1a5806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a3c0039b0 0x7f1a3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a3c004800 0x7f1a3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a580b3c50 0x7f1a3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1a580d3400 con 0x7f1a3c004800 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1a580d36e0 con 0x7f1a3c0039b0 2024-03-30T13:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3c00bac0 con 0x7f1a580b3c50 2024-03-30T13:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.597+0000 7f1a4fe00640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a3c004800 0x7f1a3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.598+0000 7f1a57e00640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a3c0039b0 0x7f1a3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.598+0000 7f1a5d000640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a580b3c50 0x7f1a3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.598+0000 7f1a4fe00640 1 -- 172.21.15.99:0/331286757 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a580b3c50 msgr2=0x7f1a3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.598+0000 7f1a4fe00640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a580b3c50 0x7f1a3c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.598+0000 7f1a4fe00640 1 -- 172.21.15.99:0/331286757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a3c0039b0 msgr2=0x7f1a3c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.598+0000 7f1a4fe00640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a3c0039b0 0x7f1a3c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.598+0000 7f1a4fe00640 1 -- 172.21.15.99:0/331286757 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c003520 con 0x7f1a3c004800 2024-03-30T13:11:25.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.599+0000 7f1a4fe00640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a3c004800 0x7f1a3c004c80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c190 tx=0x7f1a3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b80492518b6380 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.600+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40007c60 con 0x7f1a3c004800 2024-03-30T13:11:25.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.600+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a40030070 con 0x7f1a3c004800 2024-03-30T13:11:25.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.600+0000 7f1a57400640 1 -- 172.21.15.99:0/331286757 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40005d30 con 0x7f1a3c004800 2024-03-30T13:11:25.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.600+0000 7f1a5f000640 1 -- 172.21.15.99:0/331286757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a3c004800 msgr2=0x7f1a3c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.600+0000 7f1a5f000640 1 --2- 172.21.15.99:0/331286757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a3c004800 0x7f1a3c004c80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c190 tx=0x7f1a3c005830 comp rx=0 tx=0).stop 2024-03-30T13:11:25.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.600+0000 7f1a5d000640 1 -- 172.21.15.99:0/331286757 reap_dead start 2024-03-30T13:11:25.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.600+0000 7f1a5f000640 1 -- 172.21.15.99:0/331286757 shutdown_connections 2024-03-30T13:11:25.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.600+0000 7f1a5f000640 1 -- 172.21.15.99:0/331286757 >> 172.21.15.99:0/331286757 conn(0x7f1a5808bfc0 msgr2=0x7f1a580d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.601+0000 7f1a5f000640 1 -- 172.21.15.99:0/331286757 shutdown_connections 2024-03-30T13:11:25.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.601+0000 7f1a5f000640 1 -- 172.21.15.99:0/331286757 wait complete. 2024-03-30T13:11:25.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.602+0000 7f1a5f000640 1 Processor -- start 2024-03-30T13:11:25.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.602+0000 7f1a5f000640 1 -- start start 2024-03-30T13:11:25.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.603+0000 7f1a5f000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a3c004800 0x7f1a580c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.603+0000 7f1a5f000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a580cbf40 0x7f1a58157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.603+0000 7f1a5f000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a580cc3c0 0x7f1a581580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.603+0000 7f1a5f000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5806d340 con 0x7f1a580cc3c0 2024-03-30T13:11:25.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.603+0000 7f1a5f000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5806dae0 con 0x7f1a580cbf40 2024-03-30T13:11:25.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.603+0000 7f1a5f000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1a5806d4c0 con 0x7f1a3c004800 2024-03-30T13:11:25.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a5d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a580cc3c0 0x7f1a581580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a5d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a580cc3c0 0x7f1a581580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43388/0 (socket says 172.21.15.99:43388) 2024-03-30T13:11:25.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a5d000640 1 -- 172.21.15.99:0/538421480 learned_addr learned my addr 172.21.15.99:0/538421480 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:25.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a4fe00640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a580cbf40 0x7f1a58157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a57e00640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a3c004800 0x7f1a580c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a5d000640 1 -- 172.21.15.99:0/538421480 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a3c004800 msgr2=0x7f1a580c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a5d000640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a3c004800 0x7f1a580c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a5d000640 1 -- 172.21.15.99:0/538421480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a580cbf40 msgr2=0x7f1a58157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a5d000640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a580cbf40 0x7f1a58157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a5d000640 1 -- 172.21.15.99:0/538421480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a580cc990 con 0x7f1a580cc3c0 2024-03-30T13:11:25.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a57e00640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a3c004800 0x7f1a580c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:25.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.604+0000 7f1a5d000640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a580cc3c0 0x7f1a581580b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a5806e6d0 tx=0x7f1a5000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.605+0000 7f1a54c00640 1 -- 172.21.15.99:0/538421480 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50016620 con 0x7f1a580cc3c0 2024-03-30T13:11:25.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.605+0000 7f1a54c00640 1 -- 172.21.15.99:0/538421480 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5001b070 con 0x7f1a580cc3c0 2024-03-30T13:11:25.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.605+0000 7f1a5f000640 1 -- 172.21.15.99:0/538421480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a580b8610 con 0x7f1a580cc3c0 2024-03-30T13:11:25.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.605+0000 7f1a54c00640 1 -- 172.21.15.99:0/538421480 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50016a20 con 0x7f1a580cc3c0 2024-03-30T13:11:25.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.605+0000 7f1a5f000640 1 -- 172.21.15.99:0/538421480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a580b8bd0 con 0x7f1a580cc3c0 2024-03-30T13:11:25.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.606+0000 7f1a5f000640 1 -- 172.21.15.99:0/538421480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a580b8dd0 con 0x7f1a580cc3c0 2024-03-30T13:11:25.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.607+0000 7f1a54c00640 1 -- 172.21.15.99:0/538421480 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1a50016bc0 con 0x7f1a580cc3c0 2024-03-30T13:11:25.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.608+0000 7f1a54c00640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a3406c530 0x7f1a3406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.608+0000 7f1a54c00640 1 -- 172.21.15.99:0/538421480 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f1a5008c5b0 con 0x7f1a580cc3c0 2024-03-30T13:11:25.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.608+0000 7f1a57e00640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a3406c530 0x7f1a3406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.609+0000 7f1a57e00640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a3406c530 0x7f1a3406e9f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a5815b400 tx=0x7f1a48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.617+0000 7f1a54c00640 1 -- 172.21.15.99:0/538421480 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1a580b8dd0 con 0x7f1a580cc3c0 2024-03-30T13:11:25.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.815+0000 7f1a5f000640 1 -- 172.21.15.99:0/538421480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1a580ba270 con 0x7f1a580cc3c0 2024-03-30T13:11:25.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.816+0000 7f1a54c00640 1 -- 172.21.15.99:0/538421480 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f1a5005aba0 con 0x7f1a580cc3c0 2024-03-30T13:11:25.820 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:25.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.818+0000 7f1a5f000640 1 -- 172.21.15.99:0/538421480 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a3406c530 msgr2=0x7f1a3406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.818+0000 7f1a5f000640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a3406c530 0x7f1a3406e9f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a5815b400 tx=0x7f1a48008040 comp rx=0 tx=0).stop 2024-03-30T13:11:25.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.818+0000 7f1a5f000640 1 -- 172.21.15.99:0/538421480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a580cc3c0 msgr2=0x7f1a581580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.818+0000 7f1a5f000640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a580cc3c0 0x7f1a581580b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a5806e6d0 tx=0x7f1a5000f520 comp rx=0 tx=0).stop 2024-03-30T13:11:25.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.819+0000 7f1a5f000640 1 -- 172.21.15.99:0/538421480 shutdown_connections 2024-03-30T13:11:25.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.819+0000 7f1a5f000640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a3406c530 0x7f1a3406e9f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.819+0000 7f1a5f000640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a580cc3c0 0x7f1a581580b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.819+0000 7f1a5f000640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a580cbf40 0x7f1a58157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.819+0000 7f1a5f000640 1 --2- 172.21.15.99:0/538421480 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a3c004800 0x7f1a580c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.819+0000 7f1a5f000640 1 -- 172.21.15.99:0/538421480 >> 172.21.15.99:0/538421480 conn(0x7f1a5808bfc0 msgr2=0x7f1a580b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.819+0000 7f1a5f000640 1 -- 172.21.15.99:0/538421480 shutdown_connections 2024-03-30T13:11:25.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:25.819+0000 7f1a5f000640 1 -- 172.21.15.99:0/538421480 wait complete. 2024-03-30T13:11:25.844 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:26.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.047+0000 7feb5f200640 1 Processor -- start 2024-03-30T13:11:26.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.047+0000 7feb5f200640 1 -- start start 2024-03-30T13:11:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.050+0000 7feb5f200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb600b5f60 0x7feb600b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.050+0000 7feb5f200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb6006cce0 con 0x7feb600cf540 2024-03-30T13:11:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.050+0000 7feb5f200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb600cfae0 con 0x7feb6015e7f0 2024-03-30T13:11:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.050+0000 7feb5f200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7feb600d2c30 con 0x7feb600b5f60 2024-03-30T13:11:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.050+0000 7feb5d400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7feb600cf540 0x7feb6006c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46528/0 (socket says 172.21.15.99:46528) 2024-03-30T13:11:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.050+0000 7feb5d400640 1 -- 172.21.15.99:0/1314512007 learned_addr learned my addr 172.21.15.99:0/1314512007 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:26.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.051+0000 7feb5e800640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb600b5f60 0x7feb600b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.051+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2700524549 0 0) 0x7feb6006cce0 con 0x7feb600cf540 2024-03-30T13:11:26.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.051+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb44003520 con 0x7feb600cf540 2024-03-30T13:11:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.051+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3398849153 0 0) 0x7feb44003520 con 0x7feb600cf540 2024-03-30T13:11:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.051+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb600b5f60 msgr2=0x7feb600b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.051+0000 7feb5ca00640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb600b5f60 0x7feb600b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.051+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 >> v1:172.21.15.181:6789/0 conn(0x7feb6015e7f0 legacy=0x7feb600d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.052+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb600cfdc0 con 0x7feb600cf540 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.052+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7feb4c001670 con 0x7feb600cf540 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.052+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 >> v1:172.21.15.99:6789/0 conn(0x7feb600cf540 legacy=0x7feb6006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.052+0000 7feb5ca00640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb600b5f60 0x7feb440039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.052+0000 7feb5ca00640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 0x7feb44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.052+0000 7feb5ca00640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb44004d40 0x7feb440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.052+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feb600d2c30 con 0x7feb44003f60 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.052+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7feb4400baa0 con 0x7feb44004d40 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.052+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7feb4400bca0 con 0x7feb600b5f60 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.052+0000 7feb5d400640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 0x7feb44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.053+0000 7feb5e800640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb44004d40 0x7feb440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.052+0000 7feb5de00640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb600b5f60 0x7feb440039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.053+0000 7feb5d400640 1 -- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb600b5f60 msgr2=0x7feb440039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.053+0000 7feb5d400640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb600b5f60 0x7feb440039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.053+0000 7feb5d400640 1 -- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb44004d40 msgr2=0x7feb440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.053+0000 7feb5d400640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb44004d40 0x7feb440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.053+0000 7feb5d400640 1 -- 172.21.15.99:0/1314512007 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb44003520 con 0x7feb44003f60 2024-03-30T13:11:26.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.053+0000 7feb5e800640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb44004d40 0x7feb440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:26.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.053+0000 7feb5de00640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb600b5f60 0x7feb440039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.054+0000 7feb5d400640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 0x7feb44004800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c210 tx=0x7feb44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d988ca81e443e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.055+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c007d30 con 0x7feb44003f60 2024-03-30T13:11:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.055+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c030070 con 0x7feb44003f60 2024-03-30T13:11:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.055+0000 7feb5ca00640 1 -- 172.21.15.99:0/1314512007 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c02cda0 con 0x7feb44003f60 2024-03-30T13:11:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.055+0000 7feb5f200640 1 -- 172.21.15.99:0/1314512007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 msgr2=0x7feb44004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.055+0000 7feb5f200640 1 --2- 172.21.15.99:0/1314512007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 0x7feb44004800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c210 tx=0x7feb44005830 comp rx=0 tx=0).stop 2024-03-30T13:11:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.055+0000 7feb5e800640 1 -- 172.21.15.99:0/1314512007 reap_dead start 2024-03-30T13:11:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.055+0000 7feb5f200640 1 -- 172.21.15.99:0/1314512007 shutdown_connections 2024-03-30T13:11:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.055+0000 7feb5f200640 1 -- 172.21.15.99:0/1314512007 >> 172.21.15.99:0/1314512007 conn(0x7feb6009d7f0 msgr2=0x7feb600d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.056+0000 7feb5f200640 1 -- 172.21.15.99:0/1314512007 shutdown_connections 2024-03-30T13:11:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.056+0000 7feb5f200640 1 -- 172.21.15.99:0/1314512007 wait complete. 2024-03-30T13:11:26.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.057+0000 7feb5f200640 1 Processor -- start 2024-03-30T13:11:26.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.057+0000 7feb5f200640 1 -- start start 2024-03-30T13:11:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.058+0000 7feb5f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 0x7feb6015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.058+0000 7feb5f200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb600c8ce0 0x7feb600c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.058+0000 7feb5f200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb6014b000 0x7feb6014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.058+0000 7feb5f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feb600d2570 con 0x7feb44003f60 2024-03-30T13:11:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.058+0000 7feb5f200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7feb6015ebd0 con 0x7feb600c8ce0 2024-03-30T13:11:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.058+0000 7feb5f200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7feb600b63f0 con 0x7feb6014b000 2024-03-30T13:11:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.059+0000 7feb5de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 0x7feb6015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.059+0000 7feb5de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 0x7feb6015efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43410/0 (socket says 172.21.15.99:43410) 2024-03-30T13:11:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.059+0000 7feb5de00640 1 -- 172.21.15.99:0/572983490 learned_addr learned my addr 172.21.15.99:0/572983490 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.059+0000 7feb5d400640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb600c8ce0 0x7feb600c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.059+0000 7feb5de00640 1 -- 172.21.15.99:0/572983490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb6014b000 msgr2=0x7feb6014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.059+0000 7feb5e800640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb6014b000 0x7feb6014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.059+0000 7feb5de00640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb6014b000 0x7feb6014b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.059+0000 7feb5de00640 1 -- 172.21.15.99:0/572983490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb600c8ce0 msgr2=0x7feb600c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.059+0000 7feb5de00640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb600c8ce0 0x7feb600c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.059+0000 7feb5de00640 1 -- 172.21.15.99:0/572983490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb600c9a40 con 0x7feb44003f60 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.059+0000 7feb5de00640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 0x7feb6015efc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d7a0 tx=0x7feb5000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.060+0000 7feb56000640 1 -- 172.21.15.99:0/572983490 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50005070 con 0x7feb44003f60 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.060+0000 7feb56000640 1 -- 172.21.15.99:0/572983490 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb50005210 con 0x7feb44003f60 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.060+0000 7feb56000640 1 -- 172.21.15.99:0/572983490 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50007030 con 0x7feb44003f60 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.060+0000 7feb5f200640 1 -- 172.21.15.99:0/572983490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb600c9d20 con 0x7feb44003f60 2024-03-30T13:11:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.060+0000 7feb5f200640 1 -- 172.21.15.99:0/572983490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb600ca2e0 con 0x7feb44003f60 2024-03-30T13:11:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.061+0000 7feb5f200640 1 -- 172.21.15.99:0/572983490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb6004f8f0 con 0x7feb44003f60 2024-03-30T13:11:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.062+0000 7feb56000640 1 -- 172.21.15.99:0/572983490 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7feb5001a020 con 0x7feb44003f60 2024-03-30T13:11:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.063+0000 7feb56000640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 0x7feb4006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.063+0000 7feb56000640 1 -- 172.21.15.99:0/572983490 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7feb5008b090 con 0x7feb44003f60 2024-03-30T13:11:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.063+0000 7feb5d400640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 0x7feb4006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.064+0000 7feb5d400640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 0x7feb4006e9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feb4c034000 tx=0x7feb4c009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.067+0000 7feb56000640 1 -- 172.21.15.99:0/572983490 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7feb50059560 con 0x7feb44003f60 2024-03-30T13:11:26.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.273+0000 7feb5f200640 1 -- 172.21.15.99:0/572983490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7feb600b6ce0 con 0x7feb44003f60 2024-03-30T13:11:26.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.273+0000 7feb56000640 1 -- 172.21.15.99:0/572983490 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7feb50058e60 con 0x7feb44003f60 2024-03-30T13:11:26.277 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:26.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 -- 172.21.15.99:0/572983490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 msgr2=0x7feb4006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 0x7feb4006e9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feb4c034000 tx=0x7feb4c009030 comp rx=0 tx=0).stop 2024-03-30T13:11:26.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 -- 172.21.15.99:0/572983490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 msgr2=0x7feb6015efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 0x7feb6015efc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d7a0 tx=0x7feb5000dc60 comp rx=0 tx=0).stop 2024-03-30T13:11:26.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 -- 172.21.15.99:0/572983490 shutdown_connections 2024-03-30T13:11:26.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 0x7feb4006e9f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb6014b000 0x7feb6014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb600c8ce0 0x7feb600c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 --2- 172.21.15.99:0/572983490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb44003f60 0x7feb6015efc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 -- 172.21.15.99:0/572983490 >> 172.21.15.99:0/572983490 conn(0x7feb6009d7f0 msgr2=0x7feb600b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:26.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 -- 172.21.15.99:0/572983490 shutdown_connections 2024-03-30T13:11:26.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.276+0000 7feb5f200640 1 -- 172.21.15.99:0/572983490 wait complete. 2024-03-30T13:11:26.306 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:26.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.507+0000 7f35d8c00640 1 Processor -- start 2024-03-30T13:11:26.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.507+0000 7f35d8c00640 1 -- start start 2024-03-30T13:11:26.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.509+0000 7f35d8c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d40cfde0 0x7f35d40d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.509+0000 7f35d8c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f35d40d0f90 0x7f35d40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.509+0000 7f35d8c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35d415ed00 con 0x7f35d415e920 2024-03-30T13:11:26.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.509+0000 7f35d8c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f35d40d21e0 con 0x7f35d40d0f90 2024-03-30T13:11:26.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.509+0000 7f35d8c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f35d40d2480 con 0x7f35d40cfde0 2024-03-30T13:11:26.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.509+0000 7f35d1e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f35d415e920 0x7f35d40d3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46538/0 (socket says 172.21.15.99:46538) 2024-03-30T13:11:26.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.509+0000 7f35d1e00640 1 -- 172.21.15.99:0/2641159531 learned_addr learned my addr 172.21.15.99:0/2641159531 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:26.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865729539 0 0) 0x7f35d415ed00 con 0x7f35d415e920 2024-03-30T13:11:26.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35b8003520 con 0x7f35d415e920 2024-03-30T13:11:26.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d2800640 1 --2- 172.21.15.99:0/2641159531 >> v2:172.21.15.181:3300/0 conn(0x7f35d40d0f90 0x7f35d40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35c9400640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d40cfde0 0x7f35d40d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4282885557 0 0) 0x7f35b8003520 con 0x7f35d415e920 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d40cfde0 msgr2=0x7f35d40d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d40cfde0 0x7f35d40d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 >> v2:172.21.15.181:3300/0 conn(0x7f35d40d0f90 msgr2=0x7f35d40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 --2- 172.21.15.99:0/2641159531 >> v2:172.21.15.181:3300/0 conn(0x7f35d40d0f90 0x7f35d40d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d40d2760 con 0x7f35d415e920 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f35c4001670 con 0x7f35d415e920 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 >> v1:172.21.15.99:6789/0 conn(0x7f35d415e920 legacy=0x7f35d40d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d40cfde0 0x7f35b80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b8003fe0 0x7f35b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b8004d40 0x7f35b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f35d40d21e0 con 0x7f35b8004d40 2024-03-30T13:11:26.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f35d40d2480 con 0x7f35b8003fe0 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f35b800bac0 con 0x7f35d40cfde0 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d2800640 1 --2- 172.21.15.99:0/2641159531 >> v2:172.21.15.181:3300/0 conn(0x7f35d40d0f90 0x7f35d40d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.510+0000 7f35d2800640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b8004d40 0x7f35b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.511+0000 7f35d1e00640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d40cfde0 0x7f35b80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.511+0000 7f35c9400640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b8003fe0 0x7f35b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.511+0000 7f35d2800640 1 -- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d40cfde0 msgr2=0x7f35b80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.511+0000 7f35d2800640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d40cfde0 0x7f35b80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.511+0000 7f35d2800640 1 -- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b8003fe0 msgr2=0x7f35b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.511+0000 7f35d2800640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b8003fe0 0x7f35b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.511+0000 7f35d2800640 1 -- 172.21.15.99:0/2641159531 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b8003520 con 0x7f35b8004d40 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.511+0000 7f35d1e00640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d40cfde0 0x7f35b80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.511+0000 7f35c9400640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b8003fe0 0x7f35b8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:26.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.512+0000 7f35d2800640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b8004d40 0x7f35b80051c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0073e0 tx=0x7f35b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d6f437d71d5779 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.512+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc039070 con 0x7f35b8004d40 2024-03-30T13:11:26.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.512+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35cc02cdc0 con 0x7f35b8004d40 2024-03-30T13:11:26.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.512+0000 7f35d1400640 1 -- 172.21.15.99:0/2641159531 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc009c70 con 0x7f35b8004d40 2024-03-30T13:11:26.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.513+0000 7f35d8c00640 1 -- 172.21.15.99:0/2641159531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b8004d40 msgr2=0x7f35b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.513+0000 7f35d8c00640 1 --2- 172.21.15.99:0/2641159531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b8004d40 0x7f35b80051c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0073e0 tx=0x7f35b8005830 comp rx=0 tx=0).stop 2024-03-30T13:11:26.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.513+0000 7f35d2800640 1 -- 172.21.15.99:0/2641159531 reap_dead start 2024-03-30T13:11:26.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.513+0000 7f35d8c00640 1 -- 172.21.15.99:0/2641159531 shutdown_connections 2024-03-30T13:11:26.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.513+0000 7f35d8c00640 1 -- 172.21.15.99:0/2641159531 >> 172.21.15.99:0/2641159531 conn(0x7f35d408bfc0 msgr2=0x7f35d40d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:26.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.513+0000 7f35d8c00640 1 -- 172.21.15.99:0/2641159531 shutdown_connections 2024-03-30T13:11:26.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.513+0000 7f35d8c00640 1 -- 172.21.15.99:0/2641159531 wait complete. 2024-03-30T13:11:26.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.516+0000 7f35d8c00640 1 Processor -- start 2024-03-30T13:11:26.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.516+0000 7f35d8c00640 1 -- start start 2024-03-30T13:11:26.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.518+0000 7f35d8c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b8004d40 0x7f35d4159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.518+0000 7f35d8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d41593f0 0x7f35d40b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.518+0000 7f35d8c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d415ff40 0x7f35d41603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.518+0000 7f35d8c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f35d40d4ef0 con 0x7f35d41593f0 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.518+0000 7f35d8c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f35d40d2d20 con 0x7f35b8004d40 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.518+0000 7f35d8c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f35d40d5070 con 0x7f35d415ff40 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.518+0000 7f35c9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d41593f0 0x7f35d40b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.518+0000 7f35c9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d41593f0 0x7f35d40b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43422/0 (socket says 172.21.15.99:43422) 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.518+0000 7f35c9400640 1 -- 172.21.15.99:0/3889658414 learned_addr learned my addr 172.21.15.99:0/3889658414 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35c9400640 1 -- 172.21.15.99:0/3889658414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d415ff40 msgr2=0x7f35d41603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35d1e00640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b8004d40 0x7f35d4159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35d2800640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d415ff40 0x7f35d41603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35c9400640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d415ff40 0x7f35d41603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35c9400640 1 -- 172.21.15.99:0/3889658414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b8004d40 msgr2=0x7f35d4159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35c9400640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b8004d40 0x7f35d4159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35c9400640 1 -- 172.21.15.99:0/3889658414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d40b52f0 con 0x7f35d41593f0 2024-03-30T13:11:26.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35c9400640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d41593f0 0x7f35d40b4aa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00e7e0 tx=0x7f35bc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35caa00640 1 -- 172.21.15.99:0/3889658414 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc017070 con 0x7f35d41593f0 2024-03-30T13:11:26.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35caa00640 1 -- 172.21.15.99:0/3889658414 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc00c670 con 0x7f35d41593f0 2024-03-30T13:11:26.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35caa00640 1 -- 172.21.15.99:0/3889658414 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc00f040 con 0x7f35d41593f0 2024-03-30T13:11:26.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35d8c00640 1 -- 172.21.15.99:0/3889658414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d40b55d0 con 0x7f35d41593f0 2024-03-30T13:11:26.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.519+0000 7f35d8c00640 1 -- 172.21.15.99:0/3889658414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d40c98a0 con 0x7f35d41593f0 2024-03-30T13:11:26.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.520+0000 7f35d8c00640 1 -- 172.21.15.99:0/3889658414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d40c93b0 con 0x7f35d41593f0 2024-03-30T13:11:26.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.522+0000 7f35caa00640 1 -- 172.21.15.99:0/3889658414 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f35bc01a070 con 0x7f35d41593f0 2024-03-30T13:11:26.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.523+0000 7f35caa00640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f35b006c560 0x7f35b006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.523+0000 7f35caa00640 1 -- 172.21.15.99:0/3889658414 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5738+0+0 (secure 0 0 0) 0x7f35bc08b2b0 con 0x7f35d41593f0 2024-03-30T13:11:26.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.523+0000 7f35d1e00640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f35b006c560 0x7f35b006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.524+0000 7f35d1e00640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f35b006c560 0x7f35b006ea20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f35c4000f60 tx=0x7f35c4001c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.527+0000 7f35caa00640 1 -- 172.21.15.99:0/3889658414 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f35bc059810 con 0x7f35d41593f0 2024-03-30T13:11:26.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.733+0000 7f35d8c00640 1 -- 172.21.15.99:0/3889658414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f35d40a2560 con 0x7f35d41593f0 2024-03-30T13:11:26.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.733+0000 7f35caa00640 1 -- 172.21.15.99:0/3889658414 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f35bc059110 con 0x7f35d41593f0 2024-03-30T13:11:26.738 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:26.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 -- 172.21.15.99:0/3889658414 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f35b006c560 msgr2=0x7f35b006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f35b006c560 0x7f35b006ea20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f35c4000f60 tx=0x7f35c4001c00 comp rx=0 tx=0).stop 2024-03-30T13:11:26.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 -- 172.21.15.99:0/3889658414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d41593f0 msgr2=0x7f35d40b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d41593f0 0x7f35d40b4aa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00e7e0 tx=0x7f35bc00eca0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 -- 172.21.15.99:0/3889658414 shutdown_connections 2024-03-30T13:11:26.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f35b006c560 0x7f35b006ea20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35d415ff40 0x7f35d41603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d41593f0 0x7f35d40b4aa0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 --2- 172.21.15.99:0/3889658414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b8004d40 0x7f35d4159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 -- 172.21.15.99:0/3889658414 >> 172.21.15.99:0/3889658414 conn(0x7f35d408bfc0 msgr2=0x7f35d40d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:26.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 -- 172.21.15.99:0/3889658414 shutdown_connections 2024-03-30T13:11:26.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.736+0000 7f35d8c00640 1 -- 172.21.15.99:0/3889658414 wait complete. 2024-03-30T13:11:26.760 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:26.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.980+0000 7fbb77e00640 1 Processor -- start 2024-03-30T13:11:26.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.980+0000 7fbb77e00640 1 -- start start 2024-03-30T13:11:26.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.982+0000 7fbb77e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbb781620e0 0x7fbb7806cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.982+0000 7fbb77e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb7806ddd0 con 0x7fbb780d0f70 2024-03-30T13:11:26.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.983+0000 7fbb77e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb7806e070 con 0x7fbb7806d910 2024-03-30T13:11:26.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.983+0000 7fbb77e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fbb780d4be0 con 0x7fbb781620e0 2024-03-30T13:11:26.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.983+0000 7fbb76a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbb780d0f70 0x7fbb781619d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46546/0 (socket says 172.21.15.99:46546) 2024-03-30T13:11:26.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.983+0000 7fbb76a00640 1 -- 172.21.15.99:0/2652436574 learned_addr learned my addr 172.21.15.99:0/2652436574 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:26.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.983+0000 7fbb76000640 1 --2- 172.21.15.99:0/2652436574 >> v2:172.21.15.181:3300/0 conn(0x7fbb781620e0 0x7fbb7806cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.983+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793538562 0 0) 0x7fbb7806ddd0 con 0x7fbb780d0f70 2024-03-30T13:11:26.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.983+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb5c003520 con 0x7fbb780d0f70 2024-03-30T13:11:26.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2634865960 0 0) 0x7fbb5c003520 con 0x7fbb780d0f70 2024-03-30T13:11:26.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 >> v2:172.21.15.181:3300/0 conn(0x7fbb781620e0 msgr2=0x7fbb7806cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 --2- 172.21.15.99:0/2652436574 >> v2:172.21.15.181:3300/0 conn(0x7fbb781620e0 0x7fbb7806cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 >> v1:172.21.15.181:6789/0 conn(0x7fbb7806d910 legacy=0x7fbb780d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb780d4ec0 con 0x7fbb780d0f70 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fbb68001670 con 0x7fbb780d0f70 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 >> v1:172.21.15.99:6789/0 conn(0x7fbb780d0f70 legacy=0x7fbb781619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5c003a00 0x7fbb5c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb5c004800 0x7fbb5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb5c0051c0 0x7fbb5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbb780d4be0 con 0x7fbb5c003a00 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c00c090 con 0x7fbb5c0051c0 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c00c290 con 0x7fbb5c004800 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.984+0000 7fbb76a00640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5c003a00 0x7fbb5c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.985+0000 7fbb76000640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb5c004800 0x7fbb5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.985+0000 7fbb76a00640 1 -- 172.21.15.99:0/2652436574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb5c004800 msgr2=0x7fbb5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.985+0000 7fbb76a00640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb5c004800 0x7fbb5c004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.985+0000 7fbb76a00640 1 -- 172.21.15.99:0/2652436574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb5c0051c0 msgr2=0x7fbb5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:26.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.985+0000 7fbb77400640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb5c0051c0 0x7fbb5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.985+0000 7fbb76a00640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb5c0051c0 0x7fbb5c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.985+0000 7fbb76a00640 1 -- 172.21.15.99:0/2652436574 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c003520 con 0x7fbb5c003a00 2024-03-30T13:11:26.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.985+0000 7fbb77400640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb5c0051c0 0x7fbb5c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:26.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.985+0000 7fbb77400640 1 -- 172.21.15.99:0/2652436574 reap_dead start 2024-03-30T13:11:26.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.986+0000 7fbb76a00640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5c003a00 0x7fbb5c003e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800c110 tx=0x7fbb5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908cc7b152e3eda0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.986+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68007c40 con 0x7fbb5c003a00 2024-03-30T13:11:26.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.986+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb68030070 con 0x7fbb5c003a00 2024-03-30T13:11:26.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.986+0000 7fbb75600640 1 -- 172.21.15.99:0/2652436574 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68005d70 con 0x7fbb5c003a00 2024-03-30T13:11:26.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.986+0000 7fbb77e00640 1 -- 172.21.15.99:0/2652436574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5c003a00 msgr2=0x7fbb5c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.987+0000 7fbb77e00640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5c003a00 0x7fbb5c003e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800c110 tx=0x7fbb5c005830 comp rx=0 tx=0).stop 2024-03-30T13:11:26.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.987+0000 7fbb77e00640 1 -- 172.21.15.99:0/2652436574 shutdown_connections 2024-03-30T13:11:26.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.987+0000 7fbb77e00640 1 --2- 172.21.15.99:0/2652436574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5c003a00 0x7fbb5c003e00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.987+0000 7fbb77e00640 1 -- 172.21.15.99:0/2652436574 >> 172.21.15.99:0/2652436574 conn(0x7fbb7808bfc0 msgr2=0x7fbb780d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:26.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.987+0000 7fbb77e00640 1 -- 172.21.15.99:0/2652436574 shutdown_connections 2024-03-30T13:11:26.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.987+0000 7fbb77e00640 1 -- 172.21.15.99:0/2652436574 wait complete. 2024-03-30T13:11:26.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.989+0000 7fbb77e00640 1 Processor -- start 2024-03-30T13:11:26.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.989+0000 7fbb77e00640 1 -- start start 2024-03-30T13:11:26.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb5c003a00 0x7fbb780c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb781f5150 0x7fbb7815fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb78160530 0x7fbb781f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbb780cef40 con 0x7fbb78160530 2024-03-30T13:11:26.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7806e350 con 0x7fbb781f5150 2024-03-30T13:11:26.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbb780d1350 con 0x7fbb5c003a00 2024-03-30T13:11:26.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb78160530 0x7fbb781f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb78160530 0x7fbb781f7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43444/0 (socket says 172.21.15.99:43444) 2024-03-30T13:11:26.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77400640 1 -- 172.21.15.99:0/3410095485 learned_addr learned my addr 172.21.15.99:0/3410095485 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb76a00640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb5c003a00 0x7fbb780c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb76000640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb781f5150 0x7fbb7815fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77400640 1 -- 172.21.15.99:0/3410095485 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb5c003a00 msgr2=0x7fbb780c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77400640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb5c003a00 0x7fbb780c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77400640 1 -- 172.21.15.99:0/3410095485 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb781f5150 msgr2=0x7fbb7815fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77400640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb781f5150 0x7fbb7815fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb77400640 1 -- 172.21.15.99:0/3410095485 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb781f87a0 con 0x7fbb78160530 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.990+0000 7fbb76000640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb781f5150 0x7fbb7815fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.991+0000 7fbb77400640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb78160530 0x7fbb781f7a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb780cea10 tx=0x7fbb7000d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.991+0000 7fbb6ea00640 1 -- 172.21.15.99:0/3410095485 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70019070 con 0x7fbb78160530 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.991+0000 7fbb6ea00640 1 -- 172.21.15.99:0/3410095485 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb70006d70 con 0x7fbb78160530 2024-03-30T13:11:26.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.991+0000 7fbb6ea00640 1 -- 172.21.15.99:0/3410095485 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70012840 con 0x7fbb78160530 2024-03-30T13:11:26.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.991+0000 7fbb77e00640 1 -- 172.21.15.99:0/3410095485 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb781f4670 con 0x7fbb78160530 2024-03-30T13:11:26.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.991+0000 7fbb77e00640 1 -- 172.21.15.99:0/3410095485 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb781f4c30 con 0x7fbb78160530 2024-03-30T13:11:26.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.993+0000 7fbb77e00640 1 -- 172.21.15.99:0/3410095485 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb781f4e30 con 0x7fbb78160530 2024-03-30T13:11:26.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.994+0000 7fbb6ea00640 1 -- 172.21.15.99:0/3410095485 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbb7001c070 con 0x7fbb78160530 2024-03-30T13:11:26.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.994+0000 7fbb6ea00640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbb5806c530 0x7fbb5806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:26.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.994+0000 7fbb6ea00640 1 -- 172.21.15.99:0/3410095485 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fbb7008aa00 con 0x7fbb78160530 2024-03-30T13:11:26.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.995+0000 7fbb76a00640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbb5806c530 0x7fbb5806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:26.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:26.995+0000 7fbb76a00640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbb5806c530 0x7fbb5806e9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb68034000 tx=0x7fbb68007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.003+0000 7fbb6ea00640 1 -- 172.21.15.99:0/3410095485 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fbb781f4e30 con 0x7fbb78160530 2024-03-30T13:11:27.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.203+0000 7fbb77e00640 1 -- 172.21.15.99:0/3410095485 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb781f4480 con 0x7fbb78160530 2024-03-30T13:11:27.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.206+0000 7fbb6ea00640 1 -- 172.21.15.99:0/3410095485 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16658 (secure 0 0 0) 0x7fbb70059000 con 0x7fbb78160530 2024-03-30T13:11:27.210 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:27.211 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:26.555726+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.38","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:27.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 -- 172.21.15.99:0/3410095485 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbb5806c530 msgr2=0x7fbb5806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbb5806c530 0x7fbb5806e9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb68034000 tx=0x7fbb68007000 comp rx=0 tx=0).stop 2024-03-30T13:11:27.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 -- 172.21.15.99:0/3410095485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb78160530 msgr2=0x7fbb781f7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb78160530 0x7fbb781f7a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb780cea10 tx=0x7fbb7000d920 comp rx=0 tx=0).stop 2024-03-30T13:11:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 -- 172.21.15.99:0/3410095485 shutdown_connections 2024-03-30T13:11:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbb5806c530 0x7fbb5806e9f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb78160530 0x7fbb781f7a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb781f5150 0x7fbb7815fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 --2- 172.21.15.99:0/3410095485 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb5c003a00 0x7fbb780c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 -- 172.21.15.99:0/3410095485 >> 172.21.15.99:0/3410095485 conn(0x7fbb7808bfc0 msgr2=0x7fbb780b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 -- 172.21.15.99:0/3410095485 shutdown_connections 2024-03-30T13:11:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.209+0000 7fbb77e00640 1 -- 172.21.15.99:0/3410095485 wait complete. 2024-03-30T13:11:27.239 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:27.239 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:27.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.448+0000 7f11aae00640 1 Processor -- start 2024-03-30T13:11:27.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.448+0000 7f11aae00640 1 -- start start 2024-03-30T13:11:27.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.450+0000 7f11aae00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11a40b5f60 0x7f11a40b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.450+0000 7f11aae00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11a406cce0 con 0x7f11a40cf540 2024-03-30T13:11:27.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.450+0000 7f11aae00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11a40cfae0 con 0x7f11a415e7f0 2024-03-30T13:11:27.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.450+0000 7f11aae00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f11a40d2c30 con 0x7f11a40b5f60 2024-03-30T13:11:27.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.450+0000 7f11a9000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f11a40cf540 0x7f11a406c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46548/0 (socket says 172.21.15.99:46548) 2024-03-30T13:11:27.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.450+0000 7f11a9000640 1 -- 172.21.15.99:0/1253675091 learned_addr learned my addr 172.21.15.99:0/1253675091 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:27.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.450+0000 7f11aa400640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11a40b5f60 0x7f11a40b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.450+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2121062993 0 0) 0x7f11a406cce0 con 0x7f11a40cf540 2024-03-30T13:11:27.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f118c003520 con 0x7f11a40cf540 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3828662312 0 0) 0x7f118c003520 con 0x7f11a40cf540 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11a40b5f60 msgr2=0x7f11a40b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11a40b5f60 0x7f11a40b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 >> v1:172.21.15.181:6789/0 conn(0x7f11a415e7f0 legacy=0x7f11a40d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a40cfdc0 con 0x7f11a40cf540 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f1190001670 con 0x7f11a40cf540 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 >> v1:172.21.15.99:6789/0 conn(0x7f11a40cf540 legacy=0x7f11a406c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f118c0039e0 0x7f118c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f118c004800 0x7f118c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11a40b5f60 0x7f118c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f11a40d2c30 con 0x7f118c004800 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f118c00bad0 con 0x7f118c0039e0 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.451+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f118c00bcd0 con 0x7f11a40b5f60 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.452+0000 7f11a9000640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f118c004800 0x7f118c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.452+0000 7f11a9a00640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f118c0039e0 0x7f118c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.452+0000 7f11aa400640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11a40b5f60 0x7f118c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.452+0000 7f11a9000640 1 -- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11a40b5f60 msgr2=0x7f118c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.452+0000 7f11a9000640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11a40b5f60 0x7f118c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.452+0000 7f11a9000640 1 -- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f118c0039e0 msgr2=0x7f118c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.452+0000 7f11a9000640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f118c0039e0 0x7f118c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.452+0000 7f11a9000640 1 -- 172.21.15.99:0/1253675091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c003520 con 0x7f118c004800 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.452+0000 7f11aa400640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11a40b5f60 0x7f118c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:27.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.452+0000 7f11a9a00640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f118c0039e0 0x7f118c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.453+0000 7f11a9000640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f118c004800 0x7f118c004c80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f119000c160 tx=0x7f118c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f447957740fc9f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.453+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190007c60 con 0x7f118c004800 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.453+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1190030070 con 0x7f118c004800 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.453+0000 7f11a3e00640 1 -- 172.21.15.99:0/1253675091 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190005d30 con 0x7f118c004800 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.454+0000 7f11aae00640 1 -- 172.21.15.99:0/1253675091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f118c004800 msgr2=0x7f118c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.454+0000 7f11aae00640 1 --2- 172.21.15.99:0/1253675091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f118c004800 0x7f118c004c80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f119000c160 tx=0x7f118c005830 comp rx=0 tx=0).stop 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.454+0000 7f11aa400640 1 -- 172.21.15.99:0/1253675091 reap_dead start 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.454+0000 7f11aae00640 1 -- 172.21.15.99:0/1253675091 shutdown_connections 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.454+0000 7f11aae00640 1 -- 172.21.15.99:0/1253675091 >> 172.21.15.99:0/1253675091 conn(0x7f11a409d7f0 msgr2=0x7f11a40d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.454+0000 7f11aae00640 1 -- 172.21.15.99:0/1253675091 shutdown_connections 2024-03-30T13:11:27.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.454+0000 7f11aae00640 1 -- 172.21.15.99:0/1253675091 wait complete. 2024-03-30T13:11:27.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.457+0000 7f11aae00640 1 Processor -- start 2024-03-30T13:11:27.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.457+0000 7f11aae00640 1 -- start start 2024-03-30T13:11:27.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.459+0000 7f11aae00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f118c004800 0x7f11a40b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.459+0000 7f11aae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a40b9a30 0x7f11a4160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.459+0000 7f11aae00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a415ed50 0x7f11a415f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.459+0000 7f11aae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f11a40d2570 con 0x7f11a40b9a30 2024-03-30T13:11:27.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.459+0000 7f11aae00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11a415ebd0 con 0x7f11a415ed50 2024-03-30T13:11:27.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.459+0000 7f11aae00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f11a40b63f0 con 0x7f118c004800 2024-03-30T13:11:27.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.459+0000 7f11a9000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a40b9a30 0x7f11a4160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.459+0000 7f11a9000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a40b9a30 0x7f11a4160d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43468/0 (socket says 172.21.15.99:43468) 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.459+0000 7f11a9000640 1 -- 172.21.15.99:0/563703092 learned_addr learned my addr 172.21.15.99:0/563703092 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11aa400640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a415ed50 0x7f11a415f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11a9a00640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f118c004800 0x7f11a40b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11a9000640 1 -- 172.21.15.99:0/563703092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f118c004800 msgr2=0x7f11a40b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11a9000640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f118c004800 0x7f11a40b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11a9000640 1 -- 172.21.15.99:0/563703092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a415ed50 msgr2=0x7f11a415f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11a9000640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a415ed50 0x7f11a415f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11a9000640 1 -- 172.21.15.99:0/563703092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a40cc410 con 0x7f11a40b9a30 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11a9a00640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f118c004800 0x7f11a40b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11aa400640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a415ed50 0x7f11a415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:27.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11a9000640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a40b9a30 0x7f11a4160d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f119000c280 tx=0x7f1190001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11a1600640 1 -- 172.21.15.99:0/563703092 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190046070 con 0x7f11a40b9a30 2024-03-30T13:11:27.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11a1600640 1 -- 172.21.15.99:0/563703092 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1190000ed0 con 0x7f11a40b9a30 2024-03-30T13:11:27.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11a1600640 1 -- 172.21.15.99:0/563703092 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190007c60 con 0x7f11a40b9a30 2024-03-30T13:11:27.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.460+0000 7f11aae00640 1 -- 172.21.15.99:0/563703092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a40b80a0 con 0x7f11a40b9a30 2024-03-30T13:11:27.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.461+0000 7f11aae00640 1 -- 172.21.15.99:0/563703092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a40b8660 con 0x7f11a40b9a30 2024-03-30T13:11:27.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.462+0000 7f11aae00640 1 -- 172.21.15.99:0/563703092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a40689b0 con 0x7f11a40b9a30 2024-03-30T13:11:27.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.463+0000 7f11a1600640 1 -- 172.21.15.99:0/563703092 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1190007070 con 0x7f11a40b9a30 2024-03-30T13:11:27.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.464+0000 7f11a1600640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f118406c560 0x7f118406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.464+0000 7f11a1600640 1 -- 172.21.15.99:0/563703092 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f11900ac8e0 con 0x7f11a40b9a30 2024-03-30T13:11:27.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.464+0000 7f11a9a00640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f118406c560 0x7f118406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.465+0000 7f11a9a00640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f118406c560 0x7f118406ea20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1198000c00 tx=0x7f1198009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.469+0000 7f11a1600640 1 -- 172.21.15.99:0/563703092 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f11a40689b0 con 0x7f11a40b9a30 2024-03-30T13:11:27.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.677+0000 7f11aae00640 1 -- 172.21.15.99:0/563703092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f11a40ce8b0 con 0x7f11a40b9a30 2024-03-30T13:11:27.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.678+0000 7f11a1600640 1 -- 172.21.15.99:0/563703092 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f11a40ce8b0 con 0x7f11a40b9a30 2024-03-30T13:11:27.682 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:27.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.680+0000 7f11aae00640 1 -- 172.21.15.99:0/563703092 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f118406c560 msgr2=0x7f118406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.680+0000 7f11aae00640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f118406c560 0x7f118406ea20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1198000c00 tx=0x7f1198009040 comp rx=0 tx=0).stop 2024-03-30T13:11:27.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.680+0000 7f11aae00640 1 -- 172.21.15.99:0/563703092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a40b9a30 msgr2=0x7f11a4160d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.680+0000 7f11aae00640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a40b9a30 0x7f11a4160d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f119000c280 tx=0x7f1190001970 comp rx=0 tx=0).stop 2024-03-30T13:11:27.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.680+0000 7f11aae00640 1 -- 172.21.15.99:0/563703092 shutdown_connections 2024-03-30T13:11:27.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.680+0000 7f11aae00640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f118406c560 0x7f118406ea20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.680+0000 7f11aae00640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a415ed50 0x7f11a415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.680+0000 7f11aae00640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a40b9a30 0x7f11a4160d10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.680+0000 7f11aae00640 1 --2- 172.21.15.99:0/563703092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f118c004800 0x7f11a40b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.680+0000 7f11aae00640 1 -- 172.21.15.99:0/563703092 >> 172.21.15.99:0/563703092 conn(0x7f11a409d7f0 msgr2=0x7f11a406c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:27.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.681+0000 7f11aae00640 1 -- 172.21.15.99:0/563703092 shutdown_connections 2024-03-30T13:11:27.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.681+0000 7f11aae00640 1 -- 172.21.15.99:0/563703092 wait complete. 2024-03-30T13:11:27.703 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:27.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.903+0000 7f54b0200640 1 Processor -- start 2024-03-30T13:11:27.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.903+0000 7f54b0200640 1 -- start start 2024-03-30T13:11:27.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.904+0000 7f54b0200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54a815b3d0 0x7f54a80ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.904+0000 7f54b0200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f54a80b28c0 0x7f54a80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.904+0000 7f54b0200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54a80c6470 con 0x7f54a80b49f0 2024-03-30T13:11:27.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.905+0000 7f54b0200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f54a80c6240 con 0x7f54a80b28c0 2024-03-30T13:11:27.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.905+0000 7f54b0200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f54a80c7080 con 0x7f54a815b3d0 2024-03-30T13:11:27.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.905+0000 7f54ace00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f54a80b49f0 0x7f54a80b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46556/0 (socket says 172.21.15.99:46556) 2024-03-30T13:11:27.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.905+0000 7f54ace00640 1 -- 172.21.15.99:0/1320984900 learned_addr learned my addr 172.21.15.99:0/1320984900 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.905+0000 7f54ae200640 1 --2- 172.21.15.99:0/1320984900 >> v2:172.21.15.181:3300/0 conn(0x7f54a80b28c0 0x7f54a80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.905+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3953101797 0 0) 0x7f54a80c6470 con 0x7f54a80b49f0 2024-03-30T13:11:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.905+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5490003520 con 0x7f54a80b49f0 2024-03-30T13:11:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.905+0000 7f54ad800640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54a815b3d0 0x7f54a80ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1529933676 0 0) 0x7f5490003520 con 0x7f54a80b49f0 2024-03-30T13:11:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54a815b3d0 msgr2=0x7f54a80ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54a815b3d0 0x7f54a80ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 >> v2:172.21.15.181:3300/0 conn(0x7f54a80b28c0 msgr2=0x7f54a80b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 --2- 172.21.15.99:0/1320984900 >> v2:172.21.15.181:3300/0 conn(0x7f54a80b28c0 0x7f54a80b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a80c6750 con 0x7f54a80b49f0 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f5494001670 con 0x7f54a80b49f0 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 >> v1:172.21.15.99:6789/0 conn(0x7f54a80b49f0 legacy=0x7f54a80b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54900039b0 0x7f5490003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5490004800 0x7f5490004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54a815b3d0 0x7f54900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f54a80c7080 con 0x7f54900039b0 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f549000dc80 con 0x7f5490004800 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f549000de30 con 0x7f54a815b3d0 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.906+0000 7f54ad800640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54900039b0 0x7f5490003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.907+0000 7f54ae200640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54a815b3d0 0x7f54900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.907+0000 7f54ace00640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5490004800 0x7f5490004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.907+0000 7f54ad800640 1 -- 172.21.15.99:0/1320984900 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54a815b3d0 msgr2=0x7f54900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.907+0000 7f54ad800640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54a815b3d0 0x7f54900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.907+0000 7f54ad800640 1 -- 172.21.15.99:0/1320984900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5490004800 msgr2=0x7f5490004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.907+0000 7f54ad800640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5490004800 0x7f5490004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.907+0000 7f54ad800640 1 -- 172.21.15.99:0/1320984900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5490003520 con 0x7f54900039b0 2024-03-30T13:11:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.908+0000 7f54ad800640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54900039b0 0x7f5490003dd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f549c007f30 tx=0x7f5490005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0a85e3d390dae5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.908+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c007b30 con 0x7f54900039b0 2024-03-30T13:11:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.908+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549c033600 con 0x7f54900039b0 2024-03-30T13:11:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.908+0000 7f54a7e00640 1 -- 172.21.15.99:0/1320984900 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c0339b0 con 0x7f54900039b0 2024-03-30T13:11:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.909+0000 7f54b0200640 1 -- 172.21.15.99:0/1320984900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54900039b0 msgr2=0x7f5490003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.909+0000 7f54b0200640 1 --2- 172.21.15.99:0/1320984900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54900039b0 0x7f5490003dd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f549c007f30 tx=0x7f5490005830 comp rx=0 tx=0).stop 2024-03-30T13:11:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.909+0000 7f54ae200640 1 -- 172.21.15.99:0/1320984900 reap_dead start 2024-03-30T13:11:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.909+0000 7f54b0200640 1 -- 172.21.15.99:0/1320984900 shutdown_connections 2024-03-30T13:11:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.909+0000 7f54b0200640 1 -- 172.21.15.99:0/1320984900 >> 172.21.15.99:0/1320984900 conn(0x7f54a80d0450 msgr2=0x7f54a80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.909+0000 7f54b0200640 1 -- 172.21.15.99:0/1320984900 shutdown_connections 2024-03-30T13:11:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.909+0000 7f54b0200640 1 -- 172.21.15.99:0/1320984900 wait complete. 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.911+0000 7f54b0200640 1 Processor -- start 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.911+0000 7f54b0200640 1 -- start start 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.912+0000 7f54b0200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54900039b0 0x7f54a815a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.912+0000 7f54b0200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54a815e790 0x7f54a815c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.912+0000 7f54b0200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54a80cba00 0x7f54a80cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.912+0000 7f54b0200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f54a815b7b0 con 0x7f54a80cba00 2024-03-30T13:11:27.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.912+0000 7f54b0200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f54a80c6d10 con 0x7f54a815e790 2024-03-30T13:11:27.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.912+0000 7f54b0200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f54a815b930 con 0x7f54900039b0 2024-03-30T13:11:27.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.912+0000 7f54ae200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54a80cba00 0x7f54a80cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.912+0000 7f54ae200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54a80cba00 0x7f54a80cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43496/0 (socket says 172.21.15.99:43496) 2024-03-30T13:11:27.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.912+0000 7f54ae200640 1 -- 172.21.15.99:0/1433692743 learned_addr learned my addr 172.21.15.99:0/1433692743 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:27.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.912+0000 7f54ace00640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54a815e790 0x7f54a815c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54ae200640 1 -- 172.21.15.99:0/1433692743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54900039b0 msgr2=0x7f54a815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54ad800640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54900039b0 0x7f54a815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54ae200640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54900039b0 0x7f54a815a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54ae200640 1 -- 172.21.15.99:0/1433692743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54a815e790 msgr2=0x7f54a815c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:27.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54ae200640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54a815e790 0x7f54a815c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:27.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54ae200640 1 -- 172.21.15.99:0/1433692743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a80c7450 con 0x7f54a80cba00 2024-03-30T13:11:27.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54ace00640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54a815e790 0x7f54a815c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54ae200640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54a80cba00 0x7f54a80cbe80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54a0011490 tx=0x7f54a0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54a5600640 1 -- 172.21.15.99:0/1433692743 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a0019020 con 0x7f54a80cba00 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54a5600640 1 -- 172.21.15.99:0/1433692743 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a0003610 con 0x7f54a80cba00 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54b0200640 1 -- 172.21.15.99:0/1433692743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a80c7730 con 0x7f54a80cba00 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54a5600640 1 -- 172.21.15.99:0/1433692743 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a0003a40 con 0x7f54a80cba00 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.913+0000 7f54b0200640 1 -- 172.21.15.99:0/1433692743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a80c7cf0 con 0x7f54a80cba00 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.915+0000 7f54b0200640 1 -- 172.21.15.99:0/1433692743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a80c7ef0 con 0x7f54a80cba00 2024-03-30T13:11:27.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.915+0000 7f54a5600640 1 -- 172.21.15.99:0/1433692743 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f54a001c020 con 0x7f54a80cba00 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.916+0000 7f54a5600640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f548806c530 0x7f548806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:27.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.916+0000 7f54a5600640 1 -- 172.21.15.99:0/1433692743 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f54a008b960 con 0x7f54a80cba00 2024-03-30T13:11:27.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.917+0000 7f54ad800640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f548806c530 0x7f548806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:27.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.917+0000 7f54ad800640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f548806c530 0x7f548806e9f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f549c036000 tx=0x7f549c035040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:27.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:27.921+0000 7f54a5600640 1 -- 172.21.15.99:0/1433692743 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f54a80c7ef0 con 0x7f54a80cba00 2024-03-30T13:11:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.119+0000 7f54b0200640 1 -- 172.21.15.99:0/1433692743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f54a804f9d0 con 0x7f54a80cba00 2024-03-30T13:11:28.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.120+0000 7f54a5600640 1 -- 172.21.15.99:0/1433692743 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f54a0023030 con 0x7f54a80cba00 2024-03-30T13:11:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:28.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 -- 172.21.15.99:0/1433692743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f548806c530 msgr2=0x7f548806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f548806c530 0x7f548806e9f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f549c036000 tx=0x7f549c035040 comp rx=0 tx=0).stop 2024-03-30T13:11:28.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 -- 172.21.15.99:0/1433692743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54a80cba00 msgr2=0x7f54a80cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54a80cba00 0x7f54a80cbe80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54a0011490 tx=0x7f54a0009f90 comp rx=0 tx=0).stop 2024-03-30T13:11:28.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 -- 172.21.15.99:0/1433692743 shutdown_connections 2024-03-30T13:11:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f548806c530 0x7f548806e9f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54a80cba00 0x7f54a80cbe80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54a815e790 0x7f54a815c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 --2- 172.21.15.99:0/1433692743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54900039b0 0x7f54a815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 -- 172.21.15.99:0/1433692743 >> 172.21.15.99:0/1433692743 conn(0x7f54a80d0450 msgr2=0x7f54a80b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 -- 172.21.15.99:0/1433692743 shutdown_connections 2024-03-30T13:11:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.123+0000 7f54b0200640 1 -- 172.21.15.99:0/1433692743 wait complete. 2024-03-30T13:11:28.147 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.345+0000 7f1d36a00640 1 Processor -- start 2024-03-30T13:11:28.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.345+0000 7f1d36a00640 1 -- start start 2024-03-30T13:11:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.347+0000 7f1d36a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1d300d1010 0x7f1d300d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.347+0000 7f1d36a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1d300d3430 0x7f1d300cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.347+0000 7f1d36a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d300d1930 con 0x7f1d300d0210 2024-03-30T13:11:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.347+0000 7f1d36a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f1d300d5060 con 0x7f1d300d3430 2024-03-30T13:11:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.347+0000 7f1d36a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1d300d2390 con 0x7f1d300d1010 2024-03-30T13:11:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.348+0000 7f1d27400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1d300d3430 0x7f1d300cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.348+0000 7f1d27400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1d300d3430 0x7f1d300cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43506/0 (socket says 172.21.15.99:43506) 2024-03-30T13:11:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.348+0000 7f1d34a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1d300d0210 0x7f1d301622f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46566/0 (socket says 172.21.15.99:46566) 2024-03-30T13:11:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.348+0000 7f1d27400640 1 -- 172.21.15.99:0/1777909955 learned_addr learned my addr 172.21.15.99:0/1777909955 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.348+0000 7f1d2fe00640 1 --2- 172.21.15.99:0/1777909955 >> v2:172.21.15.181:3300/0 conn(0x7f1d300d1010 0x7f1d300d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.348+0000 7f1d27400640 1 -- 172.21.15.99:0/1777909955 >> v2:172.21.15.181:3300/0 conn(0x7f1d300d1010 msgr2=0x7f1d300d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.348+0000 7f1d27400640 1 --2- 172.21.15.99:0/1777909955 >> v2:172.21.15.181:3300/0 conn(0x7f1d300d1010 0x7f1d300d13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.348+0000 7f1d27400640 1 -- 172.21.15.99:0/1777909955 >> v1:172.21.15.99:6789/0 conn(0x7f1d300d0210 legacy=0x7f1d301622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.348+0000 7f1d27400640 1 -- 172.21.15.99:0/1777909955 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d300d2670 con 0x7f1d300d3430 2024-03-30T13:11:28.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.349+0000 7f1d27400640 1 --2- 172.21.15.99:0/1777909955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d300d3430 0x7f1d300cfcd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d300d1cf0 tx=0x7f1d1802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178ecdcd6297ffb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:28.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.350+0000 7f1d2f400640 1 -- 172.21.15.99:0/1777909955 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18034070 con 0x7f1d300d3430 2024-03-30T13:11:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.350+0000 7f1d2f400640 1 -- 172.21.15.99:0/1777909955 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d18030860 con 0x7f1d300d3430 2024-03-30T13:11:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.350+0000 7f1d2f400640 1 -- 172.21.15.99:0/1777909955 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18030c30 con 0x7f1d300d3430 2024-03-30T13:11:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.350+0000 7f1d36a00640 1 -- 172.21.15.99:0/1777909955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d300d3430 msgr2=0x7f1d300cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.350+0000 7f1d36a00640 1 --2- 172.21.15.99:0/1777909955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d300d3430 0x7f1d300cfcd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d300d1cf0 tx=0x7f1d1802b9a0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.350+0000 7f1d36a00640 1 -- 172.21.15.99:0/1777909955 shutdown_connections 2024-03-30T13:11:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.350+0000 7f1d36a00640 1 --2- 172.21.15.99:0/1777909955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d300d3430 0x7f1d300cfcd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.350+0000 7f1d36a00640 1 --2- 172.21.15.99:0/1777909955 >> v2:172.21.15.181:3300/0 conn(0x7f1d300d1010 0x7f1d300d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.350+0000 7f1d36a00640 1 -- 172.21.15.99:0/1777909955 >> 172.21.15.99:0/1777909955 conn(0x7f1d3008bfc0 msgr2=0x7f1d300d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:28.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.350+0000 7f1d36a00640 1 -- 172.21.15.99:0/1777909955 shutdown_connections 2024-03-30T13:11:28.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.350+0000 7f1d36a00640 1 -- 172.21.15.99:0/1777909955 wait complete. 2024-03-30T13:11:28.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.352+0000 7f1d36a00640 1 Processor -- start 2024-03-30T13:11:28.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.352+0000 7f1d36a00640 1 -- start start 2024-03-30T13:11:28.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.353+0000 7f1d36a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d300d0210 0x7f1d30161970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.353+0000 7f1d36a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d300d1010 0x7f1d30157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.353+0000 7f1d36a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1d300d3430 0x7f1d300cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.353+0000 7f1d36a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1d300d2f10 con 0x7f1d300d0210 2024-03-30T13:11:28.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.353+0000 7f1d36a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1d300d2c30 con 0x7f1d300d1010 2024-03-30T13:11:28.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.353+0000 7f1d36a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3015eaf0 con 0x7f1d300d3430 2024-03-30T13:11:28.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.353+0000 7f1d2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d300d0210 0x7f1d30161970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.353+0000 7f1d2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d300d0210 0x7f1d30161970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43508/0 (socket says 172.21.15.99:43508) 2024-03-30T13:11:28.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.353+0000 7f1d2fe00640 1 -- 172.21.15.99:0/3920185887 learned_addr learned my addr 172.21.15.99:0/3920185887 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:28.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.354+0000 7f1d2fe00640 1 -- 172.21.15.99:0/3920185887 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1d300d3430 msgr2=0x7f1d300cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.354+0000 7f1d2fe00640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1d300d3430 0x7f1d300cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.354+0000 7f1d2fe00640 1 -- 172.21.15.99:0/3920185887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d300d1010 msgr2=0x7f1d30157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.354+0000 7f1d2fe00640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d300d1010 0x7f1d30157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.354+0000 7f1d2fe00640 1 -- 172.21.15.99:0/3920185887 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d300cdd00 con 0x7f1d300d0210 2024-03-30T13:11:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.354+0000 7f1d2fe00640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d300d0210 0x7f1d30161970 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000d800 tx=0x7f1d2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.354+0000 7f1d2cc00640 1 -- 172.21.15.99:0/3920185887 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000b6c0 con 0x7f1d300d0210 2024-03-30T13:11:28.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.354+0000 7f1d2cc00640 1 -- 172.21.15.99:0/3920185887 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d20019070 con 0x7f1d300d0210 2024-03-30T13:11:28.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.354+0000 7f1d2cc00640 1 -- 172.21.15.99:0/3920185887 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000ba80 con 0x7f1d300d0210 2024-03-30T13:11:28.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.354+0000 7f1d36a00640 1 -- 172.21.15.99:0/3920185887 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d300cb790 con 0x7f1d300d0210 2024-03-30T13:11:28.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.355+0000 7f1d36a00640 1 -- 172.21.15.99:0/3920185887 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d300cbd50 con 0x7f1d300d0210 2024-03-30T13:11:28.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.356+0000 7f1d36a00640 1 -- 172.21.15.99:0/3920185887 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d300a2570 con 0x7f1d300d0210 2024-03-30T13:11:28.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.357+0000 7f1d2cc00640 1 -- 172.21.15.99:0/3920185887 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1d2000bc20 con 0x7f1d300d0210 2024-03-30T13:11:28.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.357+0000 7f1d2cc00640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1d0c06c530 0x7f1d0c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.358+0000 7f1d2cc00640 1 -- 172.21.15.99:0/3920185887 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f1d2008bc40 con 0x7f1d300d0210 2024-03-30T13:11:28.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.358+0000 7f1d27400640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1d0c06c530 0x7f1d0c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.359+0000 7f1d27400640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1d0c06c530 0x7f1d0c06e9f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1d18036000 tx=0x7f1d18030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:28.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.363+0000 7f1d2cc00640 1 -- 172.21.15.99:0/3920185887 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1d2005a1a0 con 0x7f1d300d0210 2024-03-30T13:11:28.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.562+0000 7f1d36a00640 1 -- 172.21.15.99:0/3920185887 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1d300d1d40 con 0x7f1d300d0210 2024-03-30T13:11:28.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.562+0000 7f1d2cc00640 1 -- 172.21.15.99:0/3920185887 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f1d20059aa0 con 0x7f1d300d0210 2024-03-30T13:11:28.567 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:28.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 -- 172.21.15.99:0/3920185887 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1d0c06c530 msgr2=0x7f1d0c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1d0c06c530 0x7f1d0c06e9f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1d18036000 tx=0x7f1d18030000 comp rx=0 tx=0).stop 2024-03-30T13:11:28.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 -- 172.21.15.99:0/3920185887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d300d0210 msgr2=0x7f1d30161970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d300d0210 0x7f1d30161970 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000d800 tx=0x7f1d2000dcc0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 -- 172.21.15.99:0/3920185887 shutdown_connections 2024-03-30T13:11:28.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1d0c06c530 0x7f1d0c06e9f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1d300d3430 0x7f1d300cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d300d1010 0x7f1d30157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 --2- 172.21.15.99:0/3920185887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d300d0210 0x7f1d30161970 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 -- 172.21.15.99:0/3920185887 >> 172.21.15.99:0/3920185887 conn(0x7f1d3008bfc0 msgr2=0x7f1d3006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:28.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 -- 172.21.15.99:0/3920185887 shutdown_connections 2024-03-30T13:11:28.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.565+0000 7f1d36a00640 1 -- 172.21.15.99:0/3920185887 wait complete. 2024-03-30T13:11:28.589 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.783+0000 7f30c7200640 1 Processor -- start 2024-03-30T13:11:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.783+0000 7f30c7200640 1 -- start start 2024-03-30T13:11:28.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.785+0000 7f30c7200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f30c806b510 0x7f30c80d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.785+0000 7f30c7200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c80d0610 0x7f30c8162170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.785+0000 7f30c7200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30c80d0da0 con 0x7f30c815e860 2024-03-30T13:11:28.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.785+0000 7f30c7200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f30c8072e60 con 0x7f30c806b510 2024-03-30T13:11:28.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.785+0000 7f30c7200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f30c8072810 con 0x7f30c80d0610 2024-03-30T13:11:28.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.785+0000 7f30c5e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f30c806b510 0x7f30c80d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.785+0000 7f30c6800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c80d0610 0x7f30c8162170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.785+0000 7f30c5e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f30c806b510 0x7f30c80d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47084/0 (socket says 172.21.15.99:47084) 2024-03-30T13:11:28.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.785+0000 7f30c5e00640 1 -- 172.21.15.99:0/1093072828 learned_addr learned my addr 172.21.15.99:0/1093072828 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:28.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.786+0000 7f30c5e00640 1 -- 172.21.15.99:0/1093072828 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c80d0610 msgr2=0x7f30c8162170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:28.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.786+0000 7f30c5e00640 1 --2- 172.21.15.99:0/1093072828 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c80d0610 0x7f30c8162170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.786+0000 7f30c5e00640 1 -- 172.21.15.99:0/1093072828 >> v1:172.21.15.181:6789/0 conn(0x7f30c815e860 legacy=0x7f30c806b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.786+0000 7f30c5e00640 1 -- 172.21.15.99:0/1093072828 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c8072af0 con 0x7f30c806b510 2024-03-30T13:11:28.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.788+0000 7f30c5e00640 1 --2- 172.21.15.99:0/1093072828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c806b510 0x7f30c80d1d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009870 tx=0x7f30b802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aab222767f2c4fc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:28.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.789+0000 7f30c4a00640 1 -- 172.21.15.99:0/1093072828 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8034070 con 0x7f30c806b510 2024-03-30T13:11:28.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.789+0000 7f30c4a00640 1 -- 172.21.15.99:0/1093072828 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b8030840 con 0x7f30c806b510 2024-03-30T13:11:28.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.789+0000 7f30c4a00640 1 -- 172.21.15.99:0/1093072828 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8030c10 con 0x7f30c806b510 2024-03-30T13:11:28.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.789+0000 7f30c7200640 1 -- 172.21.15.99:0/1093072828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c806b510 msgr2=0x7f30c80d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.789+0000 7f30c7200640 1 --2- 172.21.15.99:0/1093072828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c806b510 0x7f30c80d1d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009870 tx=0x7f30b802b980 comp rx=0 tx=0).stop 2024-03-30T13:11:28.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.789+0000 7f30c7200640 1 -- 172.21.15.99:0/1093072828 shutdown_connections 2024-03-30T13:11:28.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.789+0000 7f30c7200640 1 --2- 172.21.15.99:0/1093072828 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c80d0610 0x7f30c8162170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.789+0000 7f30c7200640 1 --2- 172.21.15.99:0/1093072828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c806b510 0x7f30c80d1d10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.789+0000 7f30c7200640 1 -- 172.21.15.99:0/1093072828 >> 172.21.15.99:0/1093072828 conn(0x7f30c80d11f0 msgr2=0x7f30c80d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:28.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.789+0000 7f30c7200640 1 -- 172.21.15.99:0/1093072828 shutdown_connections 2024-03-30T13:11:28.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.789+0000 7f30c7200640 1 -- 172.21.15.99:0/1093072828 wait complete. 2024-03-30T13:11:28.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.791+0000 7f30c7200640 1 Processor -- start 2024-03-30T13:11:28.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.791+0000 7f30c7200640 1 -- start start 2024-03-30T13:11:28.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.792+0000 7f30c7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30c806b510 0x7f30c815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.792+0000 7f30c7200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c80d0610 0x7f30c80af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.792+0000 7f30c7200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c815e860 0x7f30c815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.792+0000 7f30c7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f30c8073470 con 0x7f30c806b510 2024-03-30T13:11:28.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.792+0000 7f30c7200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f30c80732f0 con 0x7f30c80d0610 2024-03-30T13:11:28.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.792+0000 7f30c7200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f30c81626b0 con 0x7f30c815e860 2024-03-30T13:11:28.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.792+0000 7f30c5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30c806b510 0x7f30c815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.792+0000 7f30c5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30c806b510 0x7f30c815ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43518/0 (socket says 172.21.15.99:43518) 2024-03-30T13:11:28.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.792+0000 7f30c5e00640 1 -- 172.21.15.99:0/1728942592 learned_addr learned my addr 172.21.15.99:0/1728942592 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:28.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.793+0000 7f30c5400640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c80d0610 0x7f30c80af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.793+0000 7f30c6800640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c815e860 0x7f30c815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.793+0000 7f30c5e00640 1 -- 172.21.15.99:0/1728942592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c815e860 msgr2=0x7f30c815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.793+0000 7f30c5e00640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c815e860 0x7f30c815a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.793+0000 7f30c5e00640 1 -- 172.21.15.99:0/1728942592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c80d0610 msgr2=0x7f30c80af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:28.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.793+0000 7f30c5e00640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c80d0610 0x7f30c80af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.793+0000 7f30c5e00640 1 -- 172.21.15.99:0/1728942592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c80c4da0 con 0x7f30c806b510 2024-03-30T13:11:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.793+0000 7f30c5e00640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30c806b510 0x7f30c815ee90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000c00 tx=0x7f30b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.794+0000 7f30be000640 1 -- 172.21.15.99:0/1728942592 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8048070 con 0x7f30c806b510 2024-03-30T13:11:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.794+0000 7f30be000640 1 -- 172.21.15.99:0/1728942592 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b8030640 con 0x7f30c806b510 2024-03-30T13:11:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.794+0000 7f30c7200640 1 -- 172.21.15.99:0/1728942592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c80c5080 con 0x7f30c806b510 2024-03-30T13:11:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.794+0000 7f30be000640 1 -- 172.21.15.99:0/1728942592 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8034040 con 0x7f30c806b510 2024-03-30T13:11:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.794+0000 7f30c7200640 1 -- 172.21.15.99:0/1728942592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c80c5640 con 0x7f30c806b510 2024-03-30T13:11:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.795+0000 7f30c7200640 1 -- 172.21.15.99:0/1728942592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c815cd60 con 0x7f30c806b510 2024-03-30T13:11:28.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.796+0000 7f30be000640 1 -- 172.21.15.99:0/1728942592 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f30b804b070 con 0x7f30c806b510 2024-03-30T13:11:28.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.798+0000 7f30be000640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f30a806c580 0x7f30a806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:28.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.798+0000 7f30be000640 1 -- 172.21.15.99:0/1728942592 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f30b80ad690 con 0x7f30c806b510 2024-03-30T13:11:28.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.798+0000 7f30c5400640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f30a806c580 0x7f30a806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:28.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.799+0000 7f30c5400640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f30a806c580 0x7f30a806ea40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f30c80c9a50 tx=0x7f30b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:28.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:28.802+0000 7f30be000640 1 -- 172.21.15.99:0/1728942592 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f30c815cd60 con 0x7f30c806b510 2024-03-30T13:11:29.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.003+0000 7f30c7200640 1 -- 172.21.15.99:0/1728942592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30c804f8f0 con 0x7f30c806b510 2024-03-30T13:11:29.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.005+0000 7f30be000640 1 -- 172.21.15.99:0/1728942592 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16658 (secure 0 0 0) 0x7f30b807be20 con 0x7f30c806b510 2024-03-30T13:11:29.010 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:29.010 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:26.555726+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.38","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:29.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.008+0000 7f30c7200640 1 -- 172.21.15.99:0/1728942592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f30a806c580 msgr2=0x7f30a806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.008+0000 7f30c7200640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f30a806c580 0x7f30a806ea40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f30c80c9a50 tx=0x7f30b4009040 comp rx=0 tx=0).stop 2024-03-30T13:11:29.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.008+0000 7f30c7200640 1 -- 172.21.15.99:0/1728942592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30c806b510 msgr2=0x7f30c815ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.008+0000 7f30c7200640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30c806b510 0x7f30c815ee90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000c00 tx=0x7f30b8004730 comp rx=0 tx=0).stop 2024-03-30T13:11:29.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.008+0000 7f30c7200640 1 -- 172.21.15.99:0/1728942592 shutdown_connections 2024-03-30T13:11:29.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.008+0000 7f30c7200640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f30a806c580 0x7f30a806ea40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.008+0000 7f30c7200640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c815e860 0x7f30c815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.008+0000 7f30c7200640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c80d0610 0x7f30c80af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.008+0000 7f30c7200640 1 --2- 172.21.15.99:0/1728942592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30c806b510 0x7f30c815ee90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.008+0000 7f30c7200640 1 -- 172.21.15.99:0/1728942592 >> 172.21.15.99:0/1728942592 conn(0x7f30c80d11f0 msgr2=0x7f30c806fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:29.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.009+0000 7f30c7200640 1 -- 172.21.15.99:0/1728942592 shutdown_connections 2024-03-30T13:11:29.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.009+0000 7f30c7200640 1 -- 172.21.15.99:0/1728942592 wait complete. 2024-03-30T13:11:29.031 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:29.032 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:29.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.237+0000 7f67a2000640 1 Processor -- start 2024-03-30T13:11:29.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.237+0000 7f67a2000640 1 -- start start 2024-03-30T13:11:29.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.238+0000 7f67a2000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f679c15e920 0x7f679c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.238+0000 7f67a2000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c0d16a0 0x7f679c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.238+0000 7f67a2000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f679c0d3780 con 0x7f679c0cfde0 2024-03-30T13:11:29.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.238+0000 7f67a2000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f679c15ed00 con 0x7f679c15e920 2024-03-30T13:11:29.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.238+0000 7f67a2000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f679c0d21e0 con 0x7f679c0d16a0 2024-03-30T13:11:29.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.239+0000 7f679be00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c0d16a0 0x7f679c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.239+0000 7f679b400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f679c15e920 0x7f679c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.239+0000 7f679b400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f679c15e920 0x7f679c0d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47106/0 (socket says 172.21.15.99:47106) 2024-03-30T13:11:29.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.239+0000 7f679b400640 1 -- 172.21.15.99:0/253761297 learned_addr learned my addr 172.21.15.99:0/253761297 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:29.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.240+0000 7f679be00640 1 -- 172.21.15.99:0/253761297 >> v2:172.21.15.181:3300/0 conn(0x7f679c15e920 msgr2=0x7f679c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:29.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.240+0000 7f679be00640 1 --2- 172.21.15.99:0/253761297 >> v2:172.21.15.181:3300/0 conn(0x7f679c15e920 0x7f679c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.240+0000 7f679be00640 1 -- 172.21.15.99:0/253761297 >> v1:172.21.15.181:6789/0 conn(0x7f679c0cfde0 legacy=0x7f679c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.240+0000 7f679be00640 1 -- 172.21.15.99:0/253761297 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c0d2480 con 0x7f679c0d16a0 2024-03-30T13:11:29.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.241+0000 7f679be00640 1 --2- 172.21.15.99:0/253761297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c0d16a0 0x7f679c0d0240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6794009d90 tx=0x7f679402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d649cf40b6679816 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:29.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.242+0000 7f679a000640 1 -- 172.21.15.99:0/253761297 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794039070 con 0x7f679c0d16a0 2024-03-30T13:11:29.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.242+0000 7f679a000640 1 -- 172.21.15.99:0/253761297 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679402cc50 con 0x7f679c0d16a0 2024-03-30T13:11:29.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.242+0000 7f679a000640 1 -- 172.21.15.99:0/253761297 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794034440 con 0x7f679c0d16a0 2024-03-30T13:11:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.242+0000 7f67a2000640 1 -- 172.21.15.99:0/253761297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c0d16a0 msgr2=0x7f679c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.242+0000 7f67a2000640 1 --2- 172.21.15.99:0/253761297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c0d16a0 0x7f679c0d0240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6794009d90 tx=0x7f679402bea0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.243+0000 7f67a2000640 1 -- 172.21.15.99:0/253761297 shutdown_connections 2024-03-30T13:11:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.243+0000 7f67a2000640 1 --2- 172.21.15.99:0/253761297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c0d16a0 0x7f679c0d0240 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.243+0000 7f67a2000640 1 --2- 172.21.15.99:0/253761297 >> v2:172.21.15.181:3300/0 conn(0x7f679c15e920 0x7f679c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.243+0000 7f67a2000640 1 -- 172.21.15.99:0/253761297 >> 172.21.15.99:0/253761297 conn(0x7f679c08bfc0 msgr2=0x7f679c0d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.243+0000 7f67a2000640 1 -- 172.21.15.99:0/253761297 shutdown_connections 2024-03-30T13:11:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.243+0000 7f67a2000640 1 -- 172.21.15.99:0/253761297 wait complete. 2024-03-30T13:11:29.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.244+0000 7f67a2000640 1 Processor -- start 2024-03-30T13:11:29.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.245+0000 7f67a2000640 1 -- start start 2024-03-30T13:11:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.245+0000 7f67a2000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f679c0cfde0 0x7f679c1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.245+0000 7f67a2000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679c0d16a0 0x7f679c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.245+0000 7f67a2000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c15e920 0x7f679c0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.245+0000 7f67a2000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0d2d20 con 0x7f679c0d16a0 2024-03-30T13:11:29.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.245+0000 7f67a2000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0d2a40 con 0x7f679c0cfde0 2024-03-30T13:11:29.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.245+0000 7f67a2000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f679c0d4ef0 con 0x7f679c15e920 2024-03-30T13:11:29.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.246+0000 7f679aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679c0d16a0 0x7f679c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.246+0000 7f679aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679c0d16a0 0x7f679c159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43534/0 (socket says 172.21.15.99:43534) 2024-03-30T13:11:29.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.246+0000 7f679aa00640 1 -- 172.21.15.99:0/1722900176 learned_addr learned my addr 172.21.15.99:0/1722900176 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:29.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.246+0000 7f679b400640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f679c0cfde0 0x7f679c1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.246+0000 7f679be00640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c15e920 0x7f679c0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.246+0000 7f679aa00640 1 -- 172.21.15.99:0/1722900176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c15e920 msgr2=0x7f679c0c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.246+0000 7f679aa00640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c15e920 0x7f679c0c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.246+0000 7f679aa00640 1 -- 172.21.15.99:0/1722900176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f679c0cfde0 msgr2=0x7f679c1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.246+0000 7f679aa00640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f679c0cfde0 0x7f679c1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.246+0000 7f679aa00640 1 -- 172.21.15.99:0/1722900176 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c1e9bf0 con 0x7f679c0d16a0 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.246+0000 7f679be00640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c15e920 0x7f679c0c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.247+0000 7f679aa00640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679c0d16a0 0x7f679c159b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f678400c400 tx=0x7f678400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.247+0000 7f6793400640 1 -- 172.21.15.99:0/1722900176 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67840052d0 con 0x7f679c0d16a0 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.247+0000 7f6793400640 1 -- 172.21.15.99:0/1722900176 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6784005490 con 0x7f679c0d16a0 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.247+0000 7f67a2000640 1 -- 172.21.15.99:0/1722900176 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c1e8fe0 con 0x7f679c0d16a0 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.247+0000 7f6793400640 1 -- 172.21.15.99:0/1722900176 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6784007260 con 0x7f679c0d16a0 2024-03-30T13:11:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.247+0000 7f67a2000640 1 -- 172.21.15.99:0/1722900176 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c1e95a0 con 0x7f679c0d16a0 2024-03-30T13:11:29.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.248+0000 7f67a2000640 1 -- 172.21.15.99:0/1722900176 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f679c0a2560 con 0x7f679c0d16a0 2024-03-30T13:11:29.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.249+0000 7f6793400640 1 -- 172.21.15.99:0/1722900176 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6784007400 con 0x7f679c0d16a0 2024-03-30T13:11:29.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.250+0000 7f6793400640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f677806c530 0x7f677806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.250+0000 7f6793400640 1 -- 172.21.15.99:0/1722900176 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f678408ad10 con 0x7f679c0d16a0 2024-03-30T13:11:29.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.250+0000 7f679b400640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f677806c530 0x7f677806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.251+0000 7f679b400640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f677806c530 0x7f677806e9f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f678c009ac0 tx=0x7f678c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:29.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.258+0000 7f6793400640 1 -- 172.21.15.99:0/1722900176 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6784090020 con 0x7f679c0d16a0 2024-03-30T13:11:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.458+0000 7f67a2000640 1 -- 172.21.15.99:0/1722900176 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f679c04f9d0 con 0x7f679c0d16a0 2024-03-30T13:11:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.459+0000 7f6793400640 1 -- 172.21.15.99:0/1722900176 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f679c0d3780 con 0x7f679c0d16a0 2024-03-30T13:11:29.463 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.461+0000 7f67a2000640 1 -- 172.21.15.99:0/1722900176 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f677806c530 msgr2=0x7f677806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.461+0000 7f67a2000640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f677806c530 0x7f677806e9f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f678c009ac0 tx=0x7f678c008040 comp rx=0 tx=0).stop 2024-03-30T13:11:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.461+0000 7f67a2000640 1 -- 172.21.15.99:0/1722900176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679c0d16a0 msgr2=0x7f679c159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.461+0000 7f67a2000640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679c0d16a0 0x7f679c159b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f678400c400 tx=0x7f678400c8c0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.462+0000 7f67a2000640 1 -- 172.21.15.99:0/1722900176 shutdown_connections 2024-03-30T13:11:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.462+0000 7f67a2000640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f677806c530 0x7f677806e9f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.462+0000 7f67a2000640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f679c15e920 0x7f679c0c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.462+0000 7f67a2000640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679c0d16a0 0x7f679c159b10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.462+0000 7f67a2000640 1 --2- 172.21.15.99:0/1722900176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f679c0cfde0 0x7f679c1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.462+0000 7f67a2000640 1 -- 172.21.15.99:0/1722900176 >> 172.21.15.99:0/1722900176 conn(0x7f679c08bfc0 msgr2=0x7f679c0b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:29.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.462+0000 7f67a2000640 1 -- 172.21.15.99:0/1722900176 shutdown_connections 2024-03-30T13:11:29.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.462+0000 7f67a2000640 1 -- 172.21.15.99:0/1722900176 wait complete. 2024-03-30T13:11:29.483 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:29.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.679+0000 7f6a72800640 1 Processor -- start 2024-03-30T13:11:29.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.679+0000 7f6a72800640 1 -- start start 2024-03-30T13:11:29.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.680+0000 7f6a72800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6a6c15e920 0x7f6a6c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.680+0000 7f6a72800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6a6c0cfde0 0x7f6a6c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.680+0000 7f6a72800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6c0d3780 con 0x7f6a6c0d0f90 2024-03-30T13:11:29.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.680+0000 7f6a72800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6c15ed00 con 0x7f6a6c15e920 2024-03-30T13:11:29.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.680+0000 7f6a72800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6c0d21e0 con 0x7f6a6c0cfde0 2024-03-30T13:11:29.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.681+0000 7f6a6b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6a6c15e920 0x7f6a6c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.681+0000 7f6a6be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6a6c0d0f90 0x7f6a6c06c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46576/0 (socket says 172.21.15.99:46576) 2024-03-30T13:11:29.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.681+0000 7f6a6be00640 1 -- 172.21.15.99:0/1584210545 learned_addr learned my addr 172.21.15.99:0/1584210545 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:29.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.681+0000 7f6a6aa00640 1 --2- 172.21.15.99:0/1584210545 >> v2:172.21.15.181:3300/0 conn(0x7f6a6c0cfde0 0x7f6a6c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.681+0000 7f6a6b400640 1 -- 172.21.15.99:0/1584210545 >> v2:172.21.15.181:3300/0 conn(0x7f6a6c0cfde0 msgr2=0x7f6a6c0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:29.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.681+0000 7f6a6b400640 1 --2- 172.21.15.99:0/1584210545 >> v2:172.21.15.181:3300/0 conn(0x7f6a6c0cfde0 0x7f6a6c0d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.681+0000 7f6a6b400640 1 -- 172.21.15.99:0/1584210545 >> v1:172.21.15.99:6789/0 conn(0x7f6a6c0d0f90 legacy=0x7f6a6c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.681+0000 7f6a6a000640 1 -- 172.21.15.99:0/1584210545 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2386484639 0 0) 0x7f6a64001490 con 0x7f6a6c0d0f90 2024-03-30T13:11:29.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.681+0000 7f6a6b400640 1 -- 172.21.15.99:0/1584210545 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c0d2480 con 0x7f6a6c15e920 2024-03-30T13:11:29.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.682+0000 7f6a6b400640 1 --2- 172.21.15.99:0/1584210545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a6c15e920 0x7f6a6c0d3240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c08ccb0 tx=0x7f6a5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc23175ed71ffed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:29.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.683+0000 7f6a6a000640 1 -- 172.21.15.99:0/1584210545 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c035020 con 0x7f6a6c15e920 2024-03-30T13:11:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.683+0000 7f6a6a000640 1 -- 172.21.15.99:0/1584210545 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c031830 con 0x7f6a6c15e920 2024-03-30T13:11:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.683+0000 7f6a6a000640 1 -- 172.21.15.99:0/1584210545 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c031c00 con 0x7f6a6c15e920 2024-03-30T13:11:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.683+0000 7f6a72800640 1 -- 172.21.15.99:0/1584210545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a6c15e920 msgr2=0x7f6a6c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.683+0000 7f6a72800640 1 --2- 172.21.15.99:0/1584210545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a6c15e920 0x7f6a6c0d3240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c08ccb0 tx=0x7f6a5c02b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.683+0000 7f6a72800640 1 -- 172.21.15.99:0/1584210545 shutdown_connections 2024-03-30T13:11:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.683+0000 7f6a72800640 1 --2- 172.21.15.99:0/1584210545 >> v2:172.21.15.181:3300/0 conn(0x7f6a6c0cfde0 0x7f6a6c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.683+0000 7f6a72800640 1 --2- 172.21.15.99:0/1584210545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a6c15e920 0x7f6a6c0d3240 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.683+0000 7f6a72800640 1 -- 172.21.15.99:0/1584210545 >> 172.21.15.99:0/1584210545 conn(0x7f6a6c08bfc0 msgr2=0x7f6a6c0d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.683+0000 7f6a72800640 1 -- 172.21.15.99:0/1584210545 shutdown_connections 2024-03-30T13:11:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.683+0000 7f6a72800640 1 -- 172.21.15.99:0/1584210545 wait complete. 2024-03-30T13:11:29.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.685+0000 7f6a72800640 1 Processor -- start 2024-03-30T13:11:29.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.685+0000 7f6a72800640 1 -- start start 2024-03-30T13:11:29.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.686+0000 7f6a72800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a6c0cfde0 0x7f6a6c14b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.686+0000 7f6a72800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a6c0d0f90 0x7f6a6c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.686+0000 7f6a72800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6a6c15e920 0x7f6a6c160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.686+0000 7f6a72800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0d2d20 con 0x7f6a6c0cfde0 2024-03-30T13:11:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.686+0000 7f6a72800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0d2a40 con 0x7f6a6c0d0f90 2024-03-30T13:11:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.686+0000 7f6a72800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c0d4ef0 con 0x7f6a6c15e920 2024-03-30T13:11:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.686+0000 7f6a6b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a6c0cfde0 0x7f6a6c14b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.686+0000 7f6a6b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a6c0cfde0 0x7f6a6c14b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43542/0 (socket says 172.21.15.99:43542) 2024-03-30T13:11:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.686+0000 7f6a6b400640 1 -- 172.21.15.99:0/2030261871 learned_addr learned my addr 172.21.15.99:0/2030261871 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:29.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.687+0000 7f6a6aa00640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a6c0d0f90 0x7f6a6c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.687+0000 7f6a6be00640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6a6c15e920 0x7f6a6c160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.687+0000 7f6a6b400640 1 -- 172.21.15.99:0/2030261871 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6a6c15e920 msgr2=0x7f6a6c160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.687+0000 7f6a6b400640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6a6c15e920 0x7f6a6c160470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.687+0000 7f6a6b400640 1 -- 172.21.15.99:0/2030261871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a6c0d0f90 msgr2=0x7f6a6c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:29.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.687+0000 7f6a6b400640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a6c0d0f90 0x7f6a6c0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:29.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.687+0000 7f6a6b400640 1 -- 172.21.15.99:0/2030261871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c0c8ba0 con 0x7f6a6c0cfde0 2024-03-30T13:11:29.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.687+0000 7f6a6aa00640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a6c0d0f90 0x7f6a6c0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:29.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.687+0000 7f6a6b400640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a6c0cfde0 0x7f6a6c14b8d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009890 tx=0x7f6a5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:29.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.687+0000 7f6a63400640 1 -- 172.21.15.99:0/2030261871 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c041070 con 0x7f6a6c0cfde0 2024-03-30T13:11:29.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.688+0000 7f6a63400640 1 -- 172.21.15.99:0/2030261871 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c03aa30 con 0x7f6a6c0cfde0 2024-03-30T13:11:29.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.688+0000 7f6a63400640 1 -- 172.21.15.99:0/2030261871 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c035040 con 0x7f6a6c0cfde0 2024-03-30T13:11:29.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.688+0000 7f6a72800640 1 -- 172.21.15.99:0/2030261871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c0c8e80 con 0x7f6a6c0cfde0 2024-03-30T13:11:29.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.688+0000 7f6a72800640 1 -- 172.21.15.99:0/2030261871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c0c9440 con 0x7f6a6c0cfde0 2024-03-30T13:11:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.689+0000 7f6a72800640 1 -- 172.21.15.99:0/2030261871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c069060 con 0x7f6a6c0cfde0 2024-03-30T13:11:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.690+0000 7f6a63400640 1 -- 172.21.15.99:0/2030261871 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6a5c038020 con 0x7f6a6c0cfde0 2024-03-30T13:11:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.690+0000 7f6a63400640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6a4c06c560 0x7f6a4c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.691+0000 7f6a63400640 1 -- 172.21.15.99:0/2030261871 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f6a5c0ad1f0 con 0x7f6a6c0cfde0 2024-03-30T13:11:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.691+0000 7f6a6aa00640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6a4c06c560 0x7f6a4c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.692+0000 7f6a6aa00640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6a4c06c560 0x7f6a4c06ea20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6a58006fd0 tx=0x7f6a58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:29.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.695+0000 7f6a63400640 1 -- 172.21.15.99:0/2030261871 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6a6c069060 con 0x7f6a6c0cfde0 2024-03-30T13:11:30.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.997+0000 7f6a72800640 1 -- 172.21.15.99:0/2030261871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6a6c0a2560 con 0x7f6a6c0cfde0 2024-03-30T13:11:30.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:29.998+0000 7f6a63400640 1 -- 172.21.15.99:0/2030261871 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f6a5c07b750 con 0x7f6a6c0cfde0 2024-03-30T13:11:30.002 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:30.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 -- 172.21.15.99:0/2030261871 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6a4c06c560 msgr2=0x7f6a4c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6a4c06c560 0x7f6a4c06ea20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6a58006fd0 tx=0x7f6a58008040 comp rx=0 tx=0).stop 2024-03-30T13:11:30.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 -- 172.21.15.99:0/2030261871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a6c0cfde0 msgr2=0x7f6a6c14b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a6c0cfde0 0x7f6a6c14b8d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009890 tx=0x7f6a5c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 -- 172.21.15.99:0/2030261871 shutdown_connections 2024-03-30T13:11:30.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6a4c06c560 0x7f6a4c06ea20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6a6c15e920 0x7f6a6c160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a6c0d0f90 0x7f6a6c0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 --2- 172.21.15.99:0/2030261871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a6c0cfde0 0x7f6a6c14b8d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 -- 172.21.15.99:0/2030261871 >> 172.21.15.99:0/2030261871 conn(0x7f6a6c08bfc0 msgr2=0x7f6a6c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:30.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 -- 172.21.15.99:0/2030261871 shutdown_connections 2024-03-30T13:11:30.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.001+0000 7f6a72800640 1 -- 172.21.15.99:0/2030261871 wait complete. 2024-03-30T13:11:30.023 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.220+0000 7f37afe00640 1 Processor -- start 2024-03-30T13:11:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.220+0000 7f37afe00640 1 -- start start 2024-03-30T13:11:30.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.221+0000 7f37afe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f37b00cf540 0x7f37b006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.221+0000 7f37afe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b006cb10 0x7f37b00b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.221+0000 7f37afe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b00cfae0 con 0x7f37b015e7f0 2024-03-30T13:11:30.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.221+0000 7f37afe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f37b00d2c30 con 0x7f37b00cf540 2024-03-30T13:11:30.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.221+0000 7f37afe00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f37b00cfdc0 con 0x7f37b006cb10 2024-03-30T13:11:30.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.222+0000 7f37a7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f37b00cf540 0x7f37b006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.222+0000 7f37a7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f37b00cf540 0x7f37b006c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43548/0 (socket says 172.21.15.99:43548) 2024-03-30T13:11:30.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.222+0000 7f37a7e00640 1 -- 172.21.15.99:0/2229282750 learned_addr learned my addr 172.21.15.99:0/2229282750 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:30.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.222+0000 7f37a7e00640 1 -- 172.21.15.99:0/2229282750 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b006cb10 msgr2=0x7f37b00b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:30.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.222+0000 7f37a7e00640 1 --2- 172.21.15.99:0/2229282750 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b006cb10 0x7f37b00b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.222+0000 7f37a7e00640 1 -- 172.21.15.99:0/2229282750 >> v1:172.21.15.181:6789/0 conn(0x7f37b015e7f0 legacy=0x7f37b00d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:30.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.222+0000 7f37a7e00640 1 -- 172.21.15.99:0/2229282750 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b00d28c0 con 0x7f37b00cf540 2024-03-30T13:11:30.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.223+0000 7f37a7e00640 1 --2- 172.21.15.99:0/2229282750 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37b00cf540 0x7f37b006c5d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3798009870 tx=0x7f379802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747f9341753cd52d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:30.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.223+0000 7f37ae000640 1 -- 172.21.15.99:0/2229282750 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798035020 con 0x7f37b00cf540 2024-03-30T13:11:30.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.223+0000 7f37ae000640 1 -- 172.21.15.99:0/2229282750 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3798031640 con 0x7f37b00cf540 2024-03-30T13:11:30.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.223+0000 7f37ae000640 1 -- 172.21.15.99:0/2229282750 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379802d040 con 0x7f37b00cf540 2024-03-30T13:11:30.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.224+0000 7f37afe00640 1 -- 172.21.15.99:0/2229282750 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37b00cf540 msgr2=0x7f37b006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.224+0000 7f37afe00640 1 --2- 172.21.15.99:0/2229282750 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37b00cf540 0x7f37b006c5d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3798009870 tx=0x7f379802b8f0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.224+0000 7f37afe00640 1 -- 172.21.15.99:0/2229282750 shutdown_connections 2024-03-30T13:11:30.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.224+0000 7f37afe00640 1 --2- 172.21.15.99:0/2229282750 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b006cb10 0x7f37b00b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.224+0000 7f37afe00640 1 --2- 172.21.15.99:0/2229282750 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37b00cf540 0x7f37b006c5d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.224+0000 7f37afe00640 1 -- 172.21.15.99:0/2229282750 >> 172.21.15.99:0/2229282750 conn(0x7f37b009d7f0 msgr2=0x7f37b00d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:30.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.224+0000 7f37afe00640 1 -- 172.21.15.99:0/2229282750 shutdown_connections 2024-03-30T13:11:30.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.224+0000 7f37afe00640 1 -- 172.21.15.99:0/2229282750 wait complete. 2024-03-30T13:11:30.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.227+0000 7f37afe00640 1 Processor -- start 2024-03-30T13:11:30.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.227+0000 7f37afe00640 1 -- start start 2024-03-30T13:11:30.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.228+0000 7f37afe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37b00cf540 0x7f37b0159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.228+0000 7f37afe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b015e7f0 0x7f37b00c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.228+0000 7f37afe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37b00c80b0 0x7f37b01ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.228+0000 7f37afe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f37b00b64a0 con 0x7f37b00c80b0 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.228+0000 7f37afe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f37b00d2570 con 0x7f37b00cf540 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.228+0000 7f37afe00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f37b00b6620 con 0x7f37b015e7f0 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.229+0000 7f37af400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37b00c80b0 0x7f37b01ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.229+0000 7f37af400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37b00c80b0 0x7f37b01ea2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43554/0 (socket says 172.21.15.99:43554) 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.229+0000 7f37af400640 1 -- 172.21.15.99:0/4293045733 learned_addr learned my addr 172.21.15.99:0/4293045733 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.229+0000 7f37aea00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37b00cf540 0x7f37b0159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.229+0000 7f37a7e00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b015e7f0 0x7f37b00c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.229+0000 7f37af400640 1 -- 172.21.15.99:0/4293045733 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b015e7f0 msgr2=0x7f37b00c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.229+0000 7f37af400640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b015e7f0 0x7f37b00c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.229+0000 7f37af400640 1 -- 172.21.15.99:0/4293045733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37b00cf540 msgr2=0x7f37b0159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.229+0000 7f37af400640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37b00cf540 0x7f37b0159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.229+0000 7f37af400640 1 -- 172.21.15.99:0/4293045733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b01e7240 con 0x7f37b00c80b0 2024-03-30T13:11:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.229+0000 7f37a7e00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b015e7f0 0x7f37b00c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.230+0000 7f37af400640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37b00c80b0 0x7f37b01ea2a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f37a800ba10 tx=0x7f37a800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.230+0000 7f37a6a00640 1 -- 172.21.15.99:0/4293045733 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a8019070 con 0x7f37b00c80b0 2024-03-30T13:11:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.230+0000 7f37a6a00640 1 -- 172.21.15.99:0/4293045733 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a800cb60 con 0x7f37b00c80b0 2024-03-30T13:11:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.230+0000 7f37a6a00640 1 -- 172.21.15.99:0/4293045733 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a8014440 con 0x7f37b00c80b0 2024-03-30T13:11:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.230+0000 7f37afe00640 1 -- 172.21.15.99:0/4293045733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b01e7520 con 0x7f37b00c80b0 2024-03-30T13:11:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.230+0000 7f37afe00640 1 -- 172.21.15.99:0/4293045733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b01e7ae0 con 0x7f37b00c80b0 2024-03-30T13:11:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.231+0000 7f37afe00640 1 -- 172.21.15.99:0/4293045733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b004f8f0 con 0x7f37b00c80b0 2024-03-30T13:11:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.232+0000 7f37a6a00640 1 -- 172.21.15.99:0/4293045733 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f37a801c070 con 0x7f37b00c80b0 2024-03-30T13:11:30.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.233+0000 7f37a6a00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f378c06c530 0x7f378c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.233+0000 7f37a6a00640 1 -- 172.21.15.99:0/4293045733 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f37a808b410 con 0x7f37b00c80b0 2024-03-30T13:11:30.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.233+0000 7f37aea00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f378c06c530 0x7f378c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.234+0000 7f37aea00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f378c06c530 0x7f378c06e9f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f37a0006fd0 tx=0x7f37a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.238+0000 7f37a6a00640 1 -- 172.21.15.99:0/4293045733 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f37a8059a10 con 0x7f37b00c80b0 2024-03-30T13:11:30.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.429+0000 7f37afe00640 1 -- 172.21.15.99:0/4293045733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f37b00b3630 con 0x7f37b00c80b0 2024-03-30T13:11:30.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.430+0000 7f37a6a00640 1 -- 172.21.15.99:0/4293045733 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f37a8059310 con 0x7f37b00c80b0 2024-03-30T13:11:30.434 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:30.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.433+0000 7f37afe00640 1 -- 172.21.15.99:0/4293045733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f378c06c530 msgr2=0x7f378c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.433+0000 7f37afe00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f378c06c530 0x7f378c06e9f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f37a0006fd0 tx=0x7f37a0008040 comp rx=0 tx=0).stop 2024-03-30T13:11:30.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.433+0000 7f37afe00640 1 -- 172.21.15.99:0/4293045733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37b00c80b0 msgr2=0x7f37b01ea2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.433+0000 7f37afe00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37b00c80b0 0x7f37b01ea2a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f37a800ba10 tx=0x7f37a800bed0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.433+0000 7f37afe00640 1 -- 172.21.15.99:0/4293045733 shutdown_connections 2024-03-30T13:11:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.433+0000 7f37afe00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f378c06c530 0x7f378c06e9f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.433+0000 7f37afe00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37b00c80b0 0x7f37b01ea2a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.433+0000 7f37afe00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b015e7f0 0x7f37b00c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.433+0000 7f37afe00640 1 --2- 172.21.15.99:0/4293045733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37b00cf540 0x7f37b0159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.433+0000 7f37afe00640 1 -- 172.21.15.99:0/4293045733 >> 172.21.15.99:0/4293045733 conn(0x7f37b009d7f0 msgr2=0x7f37b00b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.434+0000 7f37afe00640 1 -- 172.21.15.99:0/4293045733 shutdown_connections 2024-03-30T13:11:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.434+0000 7f37afe00640 1 -- 172.21.15.99:0/4293045733 wait complete. 2024-03-30T13:11:30.457 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:30.588 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:30.597 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:30.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.655+0000 7f6286800640 1 Processor -- start 2024-03-30T13:11:30.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.655+0000 7f6286800640 1 -- start start 2024-03-30T13:11:30.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.656+0000 7f6286800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f628015f9d0 0x7f6280162d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.656+0000 7f6286800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f62800d4e20 0x7f62800d2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.656+0000 7f6286800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62800cf390 con 0x7f62800d1150 2024-03-30T13:11:30.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.656+0000 7f6286800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f62800d06d0 con 0x7f62800d4e20 2024-03-30T13:11:30.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.656+0000 7f6286800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f62800d0240 con 0x7f628015f9d0 2024-03-30T13:11:30.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.657+0000 7f627f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f62800d1150 0x7f62800d2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46590/0 (socket says 172.21.15.99:46590) 2024-03-30T13:11:30.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.657+0000 7f627f400640 1 -- 172.21.15.99:0/2915133219 learned_addr learned my addr 172.21.15.99:0/2915133219 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:30.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.657+0000 7f627fe00640 1 --2- 172.21.15.99:0/2915133219 >> v2:172.21.15.99:3300/0 conn(0x7f62800d4e20 0x7f62800d2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.657+0000 7f627ea00640 1 --2- 172.21.15.99:0/2915133219 >> v2:172.21.15.181:3300/0 conn(0x7f628015f9d0 0x7f6280162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.657+0000 7f627e000640 1 -- 172.21.15.99:0/2915133219 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122942091 0 0) 0x7f62800cf390 con 0x7f62800d1150 2024-03-30T13:11:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.657+0000 7f627fe00640 1 -- 172.21.15.99:0/2915133219 >> v2:172.21.15.181:3300/0 conn(0x7f628015f9d0 msgr2=0x7f6280162d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.657+0000 7f627fe00640 1 --2- 172.21.15.99:0/2915133219 >> v2:172.21.15.181:3300/0 conn(0x7f628015f9d0 0x7f6280162d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.657+0000 7f627fe00640 1 -- 172.21.15.99:0/2915133219 >> v1:172.21.15.99:6789/0 conn(0x7f62800d1150 legacy=0x7f62800d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.657+0000 7f627fe00640 1 -- 172.21.15.99:0/2915133219 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62800cf630 con 0x7f62800d4e20 2024-03-30T13:11:30.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.657+0000 7f627ea00640 1 --2- 172.21.15.99:0/2915133219 >> v2:172.21.15.181:3300/0 conn(0x7f628015f9d0 0x7f6280162d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:30.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.658+0000 7f627fe00640 1 --2- 172.21.15.99:0/2915133219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62800d4e20 0x7f62800d2940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f62800b7160 tx=0x7f627802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107e3940dbc9225c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.659+0000 7f627e000640 1 -- 172.21.15.99:0/2915133219 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278039070 con 0x7f62800d4e20 2024-03-30T13:11:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.659+0000 7f627e000640 1 -- 172.21.15.99:0/2915133219 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627802cc80 con 0x7f62800d4e20 2024-03-30T13:11:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.659+0000 7f627e000640 1 -- 172.21.15.99:0/2915133219 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278034660 con 0x7f62800d4e20 2024-03-30T13:11:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.659+0000 7f6286800640 1 -- 172.21.15.99:0/2915133219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62800d4e20 msgr2=0x7f62800d2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.659+0000 7f6286800640 1 --2- 172.21.15.99:0/2915133219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62800d4e20 0x7f62800d2940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f62800b7160 tx=0x7f627802bed0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.659+0000 7f6286800640 1 -- 172.21.15.99:0/2915133219 shutdown_connections 2024-03-30T13:11:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.659+0000 7f6286800640 1 --2- 172.21.15.99:0/2915133219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62800d4e20 0x7f62800d2940 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.659+0000 7f6286800640 1 --2- 172.21.15.99:0/2915133219 >> v2:172.21.15.181:3300/0 conn(0x7f628015f9d0 0x7f6280162d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.659+0000 7f6286800640 1 -- 172.21.15.99:0/2915133219 >> 172.21.15.99:0/2915133219 conn(0x7f628008bfc0 msgr2=0x7f62800d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.659+0000 7f6286800640 1 -- 172.21.15.99:0/2915133219 shutdown_connections 2024-03-30T13:11:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.659+0000 7f6286800640 1 -- 172.21.15.99:0/2915133219 wait complete. 2024-03-30T13:11:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.661+0000 7f6286800640 1 Processor -- start 2024-03-30T13:11:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.661+0000 7f6286800640 1 -- start start 2024-03-30T13:11:30.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.662+0000 7f6286800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62800d1150 0x7f62801528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.662+0000 7f6286800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62800d4e20 0x7f62800b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.662+0000 7f6286800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f628015f9d0 0x7f62800b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.662+0000 7f6286800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f62800cfed0 con 0x7f62800d1150 2024-03-30T13:11:30.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.662+0000 7f6286800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f62800cfbf0 con 0x7f62800d4e20 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.662+0000 7f6286800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f62800d1530 con 0x7f628015f9d0 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.662+0000 7f627f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62800d1150 0x7f62801528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.662+0000 7f627f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62800d1150 0x7f62801528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43578/0 (socket says 172.21.15.99:43578) 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.662+0000 7f627f400640 1 -- 172.21.15.99:0/4068841787 learned_addr learned my addr 172.21.15.99:0/4068841787 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.663+0000 7f627ea00640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62800d4e20 0x7f62800b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.663+0000 7f627fe00640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f628015f9d0 0x7f62800b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.663+0000 7f627f400640 1 -- 172.21.15.99:0/4068841787 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f628015f9d0 msgr2=0x7f62800b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.663+0000 7f627f400640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f628015f9d0 0x7f62800b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.663+0000 7f627f400640 1 -- 172.21.15.99:0/4068841787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62800d4e20 msgr2=0x7f62800b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.663+0000 7f627f400640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62800d4e20 0x7f62800b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.663+0000 7f627f400640 1 -- 172.21.15.99:0/4068841787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62800b6db0 con 0x7f62800d1150 2024-03-30T13:11:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.663+0000 7f627f400640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62800d1150 0x7f62801528b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f627000c4d0 tx=0x7f627000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.664+0000 7f6277400640 1 -- 172.21.15.99:0/4068841787 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270018070 con 0x7f62800d1150 2024-03-30T13:11:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.664+0000 7f6277400640 1 -- 172.21.15.99:0/4068841787 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6270007500 con 0x7f62800d1150 2024-03-30T13:11:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.664+0000 7f6277400640 1 -- 172.21.15.99:0/4068841787 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270004a20 con 0x7f62800d1150 2024-03-30T13:11:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.664+0000 7f6286800640 1 -- 172.21.15.99:0/4068841787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6280162040 con 0x7f62800d1150 2024-03-30T13:11:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.664+0000 7f6286800640 1 -- 172.21.15.99:0/4068841787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6280162600 con 0x7f62800d1150 2024-03-30T13:11:30.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.665+0000 7f6286800640 1 -- 172.21.15.99:0/4068841787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6280068640 con 0x7f62800d1150 2024-03-30T13:11:30.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.666+0000 7f6277400640 1 -- 172.21.15.99:0/4068841787 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f627001b070 con 0x7f62800d1150 2024-03-30T13:11:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.668+0000 7f6277400640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626006c560 0x7f626006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.668+0000 7f6277400640 1 -- 172.21.15.99:0/4068841787 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f627008a940 con 0x7f62800d1150 2024-03-30T13:11:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.668+0000 7f627ea00640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626006c560 0x7f626006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:30.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.669+0000 7f627ea00640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626006c560 0x7f626006ea20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6280153690 tx=0x7f626c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:30.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.672+0000 7f6277400640 1 -- 172.21.15.99:0/4068841787 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f62800b6db0 con 0x7f62800d1150 2024-03-30T13:11:30.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.871+0000 7f6286800640 1 -- 172.21.15.99:0/4068841787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62800d5570 con 0x7f62800d1150 2024-03-30T13:11:30.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.872+0000 7f6277400640 1 -- 172.21.15.99:0/4068841787 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16658 (secure 0 0 0) 0x7f62700588f0 con 0x7f62800d1150 2024-03-30T13:11:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:30.877 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:26.555726+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.38","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.874+0000 7f6286800640 1 -- 172.21.15.99:0/4068841787 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626006c560 msgr2=0x7f626006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.874+0000 7f6286800640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626006c560 0x7f626006ea20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6280153690 tx=0x7f626c008040 comp rx=0 tx=0).stop 2024-03-30T13:11:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.874+0000 7f6286800640 1 -- 172.21.15.99:0/4068841787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62800d1150 msgr2=0x7f62801528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.874+0000 7f6286800640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62800d1150 0x7f62801528b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f627000c4d0 tx=0x7f627000c990 comp rx=0 tx=0).stop 2024-03-30T13:11:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.874+0000 7f6286800640 1 -- 172.21.15.99:0/4068841787 shutdown_connections 2024-03-30T13:11:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.874+0000 7f6286800640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626006c560 0x7f626006ea20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.874+0000 7f6286800640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f628015f9d0 0x7f62800b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.874+0000 7f6286800640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62800d4e20 0x7f62800b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.874+0000 7f6286800640 1 --2- 172.21.15.99:0/4068841787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62800d1150 0x7f62801528b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.874+0000 7f6286800640 1 -- 172.21.15.99:0/4068841787 >> 172.21.15.99:0/4068841787 conn(0x7f628008bfc0 msgr2=0x7f62800b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.875+0000 7f6286800640 1 -- 172.21.15.99:0/4068841787 shutdown_connections 2024-03-30T13:11:30.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:30.875+0000 7f6286800640 1 -- 172.21.15.99:0/4068841787 wait complete. 2024-03-30T13:11:30.897 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:30.898 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.104+0000 7f1715600640 1 Processor -- start 2024-03-30T13:11:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.104+0000 7f1715600640 1 -- start start 2024-03-30T13:11:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.105+0000 7f1715600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f17100cf330 0x7f171015dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.105+0000 7f1715600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f171015d190 0x7f17100ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.106+0000 7f1715600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171015d7b0 con 0x7f17100acf20 2024-03-30T13:11:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.106+0000 7f1715600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f171006d840 con 0x7f17100cf330 2024-03-30T13:11:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.106+0000 7f1715600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f171006db20 con 0x7f171015d190 2024-03-30T13:11:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.106+0000 7f1707400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f17100acf20 0x7f171015ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46594/0 (socket says 172.21.15.99:46594) 2024-03-30T13:11:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.106+0000 7f1707400640 1 -- 172.21.15.99:0/2909451931 learned_addr learned my addr 172.21.15.99:0/2909451931 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.106+0000 7f170fe00640 1 --2- 172.21.15.99:0/2909451931 >> v2:172.21.15.99:3300/0 conn(0x7f17100cf330 0x7f171015dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.106+0000 7f1714c00640 1 --2- 172.21.15.99:0/2909451931 >> v2:172.21.15.181:3300/0 conn(0x7f171015d190 0x7f17100ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.106+0000 7f170f400640 1 -- 172.21.15.99:0/2909451931 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2885596757 0 0) 0x7f171015d7b0 con 0x7f17100acf20 2024-03-30T13:11:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.107+0000 7f170f400640 1 -- 172.21.15.99:0/2909451931 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16f4003520 con 0x7f17100acf20 2024-03-30T13:11:31.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.107+0000 7f170fe00640 1 -- 172.21.15.99:0/2909451931 >> v2:172.21.15.181:3300/0 conn(0x7f171015d190 msgr2=0x7f17100ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:31.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.107+0000 7f170fe00640 1 --2- 172.21.15.99:0/2909451931 >> v2:172.21.15.181:3300/0 conn(0x7f171015d190 0x7f17100ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.107+0000 7f170fe00640 1 -- 172.21.15.99:0/2909451931 >> v1:172.21.15.99:6789/0 conn(0x7f17100acf20 legacy=0x7f171015ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.107+0000 7f170fe00640 1 -- 172.21.15.99:0/2909451931 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171006de00 con 0x7f17100cf330 2024-03-30T13:11:31.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.107+0000 7f1714c00640 1 --2- 172.21.15.99:0/2909451931 >> v2:172.21.15.181:3300/0 conn(0x7f171015d190 0x7f17100ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:31.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.108+0000 7f170fe00640 1 --2- 172.21.15.99:0/2909451931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17100cf330 0x7f171015dd70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f17100b2840 tx=0x7f170002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb12baf74919d130 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.108+0000 7f170f400640 1 -- 172.21.15.99:0/2909451931 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700039070 con 0x7f17100cf330 2024-03-30T13:11:31.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.108+0000 7f170f400640 1 -- 172.21.15.99:0/2909451931 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170002cc70 con 0x7f17100cf330 2024-03-30T13:11:31.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.108+0000 7f170f400640 1 -- 172.21.15.99:0/2909451931 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700034660 con 0x7f17100cf330 2024-03-30T13:11:31.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.109+0000 7f1715600640 1 -- 172.21.15.99:0/2909451931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17100cf330 msgr2=0x7f171015dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.109+0000 7f1715600640 1 --2- 172.21.15.99:0/2909451931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17100cf330 0x7f171015dd70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f17100b2840 tx=0x7f170002bec0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.109+0000 7f1715600640 1 -- 172.21.15.99:0/2909451931 shutdown_connections 2024-03-30T13:11:31.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.109+0000 7f1715600640 1 --2- 172.21.15.99:0/2909451931 >> v2:172.21.15.181:3300/0 conn(0x7f171015d190 0x7f17100ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.109+0000 7f1715600640 1 --2- 172.21.15.99:0/2909451931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17100cf330 0x7f171015dd70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.109+0000 7f1715600640 1 -- 172.21.15.99:0/2909451931 >> 172.21.15.99:0/2909451931 conn(0x7f171006bb40 msgr2=0x7f17100b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:31.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.109+0000 7f1715600640 1 -- 172.21.15.99:0/2909451931 shutdown_connections 2024-03-30T13:11:31.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.109+0000 7f1715600640 1 -- 172.21.15.99:0/2909451931 wait complete. 2024-03-30T13:11:31.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.111+0000 7f1715600640 1 Processor -- start 2024-03-30T13:11:31.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.111+0000 7f1715600640 1 -- start start 2024-03-30T13:11:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.112+0000 7f1715600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17100acf20 0x7f1710156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.112+0000 7f1715600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17100cf330 0x7f17101f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.112+0000 7f1715600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f171015d190 0x7f171009c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.112+0000 7f1715600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f171006e6b0 con 0x7f17100acf20 2024-03-30T13:11:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.112+0000 7f1715600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f171006e530 con 0x7f17100cf330 2024-03-30T13:11:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.112+0000 7f1715600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f171006e830 con 0x7f171015d190 2024-03-30T13:11:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.112+0000 7f170fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17100acf20 0x7f1710156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.112+0000 7f170fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17100acf20 0x7f1710156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43598/0 (socket says 172.21.15.99:43598) 2024-03-30T13:11:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.112+0000 7f170fe00640 1 -- 172.21.15.99:0/3103069487 learned_addr learned my addr 172.21.15.99:0/3103069487 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.112+0000 7f1707400640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17100cf330 0x7f17101f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f170fe00640 1 -- 172.21.15.99:0/3103069487 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f171015d190 msgr2=0x7f171009c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f1714c00640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f171015d190 0x7f171009c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f170fe00640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f171015d190 0x7f171009c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f170fe00640 1 -- 172.21.15.99:0/3103069487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17100cf330 msgr2=0x7f17101f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f170fe00640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17100cf330 0x7f17101f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f170fe00640 1 -- 172.21.15.99:0/3103069487 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17101583c0 con 0x7f17100acf20 2024-03-30T13:11:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f1707400640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17100cf330 0x7f17101f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f170fe00640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17100acf20 0x7f1710156ad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1700037040 tx=0x7f1700004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f170cc00640 1 -- 172.21.15.99:0/3103069487 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700039050 con 0x7f17100acf20 2024-03-30T13:11:31.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f170cc00640 1 -- 172.21.15.99:0/3103069487 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1700045070 con 0x7f17100acf20 2024-03-30T13:11:31.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f1715600640 1 -- 172.21.15.99:0/3103069487 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17101f7d20 con 0x7f17100acf20 2024-03-30T13:11:31.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.113+0000 7f170cc00640 1 -- 172.21.15.99:0/3103069487 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170003e850 con 0x7f17100acf20 2024-03-30T13:11:31.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.114+0000 7f1715600640 1 -- 172.21.15.99:0/3103069487 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17101f82e0 con 0x7f17100acf20 2024-03-30T13:11:31.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.115+0000 7f1715600640 1 -- 172.21.15.99:0/3103069487 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f171004f8f0 con 0x7f17100acf20 2024-03-30T13:11:31.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.116+0000 7f170cc00640 1 -- 172.21.15.99:0/3103069487 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f170003e9f0 con 0x7f17100acf20 2024-03-30T13:11:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.117+0000 7f170cc00640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f16ec06c530 0x7f16ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.117+0000 7f170cc00640 1 -- 172.21.15.99:0/3103069487 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f17000ae410 con 0x7f17100acf20 2024-03-30T13:11:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.117+0000 7f1707400640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f16ec06c530 0x7f16ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.118+0000 7f1707400640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f16ec06c530 0x7f16ec06e9f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f16f8007fd0 tx=0x7f16f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.121+0000 7f170cc00640 1 -- 172.21.15.99:0/3103069487 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f17101583c0 con 0x7f17100acf20 2024-03-30T13:11:31.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.339+0000 7f1715600640 1 -- 172.21.15.99:0/3103069487 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f17100b3040 con 0x7f17100acf20 2024-03-30T13:11:31.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.340+0000 7f170cc00640 1 -- 172.21.15.99:0/3103069487 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f170002ce20 con 0x7f17100acf20 2024-03-30T13:11:31.344 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:31.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 -- 172.21.15.99:0/3103069487 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f16ec06c530 msgr2=0x7f16ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f16ec06c530 0x7f16ec06e9f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f16f8007fd0 tx=0x7f16f8009040 comp rx=0 tx=0).stop 2024-03-30T13:11:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 -- 172.21.15.99:0/3103069487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17100acf20 msgr2=0x7f1710156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17100acf20 0x7f1710156ad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1700037040 tx=0x7f1700004a40 comp rx=0 tx=0).stop 2024-03-30T13:11:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 -- 172.21.15.99:0/3103069487 shutdown_connections 2024-03-30T13:11:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f16ec06c530 0x7f16ec06e9f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f171015d190 0x7f171009c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17100cf330 0x7f17101f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 --2- 172.21.15.99:0/3103069487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17100acf20 0x7f1710156ad0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 -- 172.21.15.99:0/3103069487 >> 172.21.15.99:0/3103069487 conn(0x7f171006bb40 msgr2=0x7f17100b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 -- 172.21.15.99:0/3103069487 shutdown_connections 2024-03-30T13:11:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.343+0000 7f1715600640 1 -- 172.21.15.99:0/3103069487 wait complete. 2024-03-30T13:11:31.365 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:31.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.572+0000 7feb65600640 1 Processor -- start 2024-03-30T13:11:31.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.572+0000 7feb65600640 1 -- start start 2024-03-30T13:11:31.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.573+0000 7feb65600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feb600cfde0 0x7feb600d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.573+0000 7feb65600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb6015ed00 con 0x7feb600d0f90 2024-03-30T13:11:31.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.573+0000 7feb65600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb600d21e0 con 0x7feb6015e920 2024-03-30T13:11:31.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.573+0000 7feb65600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7feb600d2480 con 0x7feb600cfde0 2024-03-30T13:11:31.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.574+0000 7feb5e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feb600cfde0 0x7feb600d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.574+0000 7feb5f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7feb600d0f90 0x7feb6006c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46604/0 (socket says 172.21.15.99:46604) 2024-03-30T13:11:31.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.574+0000 7feb5f400640 1 -- 172.21.15.99:0/78690106 learned_addr learned my addr 172.21.15.99:0/78690106 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:31.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.575+0000 7feb5e000640 1 -- 172.21.15.99:0/78690106 >> v1:172.21.15.181:6789/0 conn(0x7feb6015e920 legacy=0x7feb600d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.575+0000 7feb5e000640 1 -- 172.21.15.99:0/78690106 >> v1:172.21.15.99:6789/0 conn(0x7feb600d0f90 legacy=0x7feb6006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.575+0000 7feb5d600640 1 -- 172.21.15.99:0/78690106 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990073883 0 0) 0x7feb6015ed00 con 0x7feb600d0f90 2024-03-30T13:11:31.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.575+0000 7feb5e000640 1 -- 172.21.15.99:0/78690106 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb600d2760 con 0x7feb600cfde0 2024-03-30T13:11:31.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.576+0000 7feb5e000640 1 --2- 172.21.15.99:0/78690106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb600cfde0 0x7feb600d0240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0097a0 tx=0x7feb4c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc43cb04dc7fb0df server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.577+0000 7feb5d600640 1 -- 172.21.15.99:0/78690106 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c034070 con 0x7feb600cfde0 2024-03-30T13:11:31.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.577+0000 7feb5d600640 1 -- 172.21.15.99:0/78690106 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c030610 con 0x7feb600cfde0 2024-03-30T13:11:31.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.577+0000 7feb5d600640 1 -- 172.21.15.99:0/78690106 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0309e0 con 0x7feb600cfde0 2024-03-30T13:11:31.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.577+0000 7feb65600640 1 -- 172.21.15.99:0/78690106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb600cfde0 msgr2=0x7feb600d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.577+0000 7feb65600640 1 --2- 172.21.15.99:0/78690106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb600cfde0 0x7feb600d0240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0097a0 tx=0x7feb4c02b960 comp rx=0 tx=0).stop 2024-03-30T13:11:31.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.577+0000 7feb65600640 1 -- 172.21.15.99:0/78690106 shutdown_connections 2024-03-30T13:11:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.577+0000 7feb65600640 1 --2- 172.21.15.99:0/78690106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb600cfde0 0x7feb600d0240 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.577+0000 7feb65600640 1 -- 172.21.15.99:0/78690106 >> 172.21.15.99:0/78690106 conn(0x7feb6008bfc0 msgr2=0x7feb600d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.577+0000 7feb65600640 1 -- 172.21.15.99:0/78690106 shutdown_connections 2024-03-30T13:11:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.577+0000 7feb65600640 1 -- 172.21.15.99:0/78690106 wait complete. 2024-03-30T13:11:31.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.580+0000 7feb65600640 1 Processor -- start 2024-03-30T13:11:31.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.580+0000 7feb65600640 1 -- start start 2024-03-30T13:11:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.582+0000 7feb65600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb600cfde0 0x7feb600ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.582+0000 7feb65600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb600d0f90 0x7feb600ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.582+0000 7feb65600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb6015e920 0x7feb60159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.582+0000 7feb65600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feb600d4ef0 con 0x7feb600d0f90 2024-03-30T13:11:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.582+0000 7feb65600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7feb600d2d20 con 0x7feb600cfde0 2024-03-30T13:11:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.582+0000 7feb65600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7feb600d5070 con 0x7feb6015e920 2024-03-30T13:11:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.582+0000 7feb5e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb600d0f90 0x7feb600ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.582+0000 7feb5e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb600d0f90 0x7feb600ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43628/0 (socket says 172.21.15.99:43628) 2024-03-30T13:11:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.582+0000 7feb5e000640 1 -- 172.21.15.99:0/3415327125 learned_addr learned my addr 172.21.15.99:0/3415327125 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.582+0000 7feb5ea00640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb600cfde0 0x7feb600ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.583+0000 7feb5f400640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb6015e920 0x7feb60159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.583+0000 7feb5e000640 1 -- 172.21.15.99:0/3415327125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb6015e920 msgr2=0x7feb60159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.583+0000 7feb5e000640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb6015e920 0x7feb60159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.583+0000 7feb5e000640 1 -- 172.21.15.99:0/3415327125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb600cfde0 msgr2=0x7feb600ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.583+0000 7feb5e000640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb600cfde0 0x7feb600ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.583+0000 7feb5e000640 1 -- 172.21.15.99:0/3415327125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb600cea00 con 0x7feb600d0f90 2024-03-30T13:11:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.583+0000 7feb5e000640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb600d0f90 0x7feb600ce120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009890 tx=0x7feb4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.583+0000 7feb56a00640 1 -- 172.21.15.99:0/3415327125 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c034040 con 0x7feb600d0f90 2024-03-30T13:11:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.583+0000 7feb56a00640 1 -- 172.21.15.99:0/3415327125 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c039a10 con 0x7feb600d0f90 2024-03-30T13:11:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.583+0000 7feb56a00640 1 -- 172.21.15.99:0/3415327125 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c039de0 con 0x7feb600d0f90 2024-03-30T13:11:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.583+0000 7feb65600640 1 -- 172.21.15.99:0/3415327125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb600cb930 con 0x7feb600d0f90 2024-03-30T13:11:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.584+0000 7feb65600640 1 -- 172.21.15.99:0/3415327125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb600cbef0 con 0x7feb600d0f90 2024-03-30T13:11:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.585+0000 7feb65600640 1 -- 172.21.15.99:0/3415327125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb600a2560 con 0x7feb600d0f90 2024-03-30T13:11:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.586+0000 7feb56a00640 1 -- 172.21.15.99:0/3415327125 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7feb4c037070 con 0x7feb600d0f90 2024-03-30T13:11:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.587+0000 7feb56a00640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 0x7feb4006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.587+0000 7feb56a00640 1 -- 172.21.15.99:0/3415327125 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7feb4c0ad820 con 0x7feb600d0f90 2024-03-30T13:11:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.587+0000 7feb5ea00640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 0x7feb4006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.588+0000 7feb5ea00640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 0x7feb4006e9f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb50000f60 tx=0x7feb50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.592+0000 7feb56a00640 1 -- 172.21.15.99:0/3415327125 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7feb4c07be20 con 0x7feb600d0f90 2024-03-30T13:11:31.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.874+0000 7feb65600640 1 -- 172.21.15.99:0/3415327125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7feb6015e0d0 con 0x7feb600d0f90 2024-03-30T13:11:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.875+0000 7feb56a00640 1 -- 172.21.15.99:0/3415327125 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7feb4c07b720 con 0x7feb600d0f90 2024-03-30T13:11:31.879 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.877+0000 7feb65600640 1 -- 172.21.15.99:0/3415327125 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 msgr2=0x7feb4006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.877+0000 7feb65600640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 0x7feb4006e9f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb50000f60 tx=0x7feb50009040 comp rx=0 tx=0).stop 2024-03-30T13:11:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.877+0000 7feb65600640 1 -- 172.21.15.99:0/3415327125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb600d0f90 msgr2=0x7feb600ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.877+0000 7feb65600640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb600d0f90 0x7feb600ce120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009890 tx=0x7feb4c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.877+0000 7feb65600640 1 -- 172.21.15.99:0/3415327125 shutdown_connections 2024-03-30T13:11:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.877+0000 7feb65600640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7feb4006c530 0x7feb4006e9f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.877+0000 7feb65600640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb6015e920 0x7feb60159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.877+0000 7feb65600640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb600d0f90 0x7feb600ce120 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.877+0000 7feb65600640 1 --2- 172.21.15.99:0/3415327125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb600cfde0 0x7feb600ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.877+0000 7feb65600640 1 -- 172.21.15.99:0/3415327125 >> 172.21.15.99:0/3415327125 conn(0x7feb6008bfc0 msgr2=0x7feb60159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.878+0000 7feb65600640 1 -- 172.21.15.99:0/3415327125 shutdown_connections 2024-03-30T13:11:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:31.878+0000 7feb65600640 1 -- 172.21.15.99:0/3415327125 wait complete. 2024-03-30T13:11:31.901 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:32.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.106+0000 7fad05000640 1 Processor -- start 2024-03-30T13:11:32.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.106+0000 7fad05000640 1 -- start start 2024-03-30T13:11:32.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.109+0000 7fad05000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad0015e920 0x7fad000d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.109+0000 7fad05000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fad000d16a0 0x7fad000d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.109+0000 7fad05000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad000d3780 con 0x7fad000cfde0 2024-03-30T13:11:32.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.109+0000 7fad05000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fad0015ed00 con 0x7fad000d16a0 2024-03-30T13:11:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.109+0000 7fad05000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fad000d21e0 con 0x7fad0015e920 2024-03-30T13:11:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.109+0000 7facfd400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fad000cfde0 0x7fad000d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46616/0 (socket says 172.21.15.99:46616) 2024-03-30T13:11:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.109+0000 7facfd400640 1 -- 172.21.15.99:0/1616615023 learned_addr learned my addr 172.21.15.99:0/1616615023 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.109+0000 7facfde00640 1 --2- 172.21.15.99:0/1616615023 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad0015e920 0x7fad000d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.110+0000 7facfe800640 1 --2- 172.21.15.99:0/1616615023 >> v2:172.21.15.181:3300/0 conn(0x7fad000d16a0 0x7fad000d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.110+0000 7facfca00640 1 -- 172.21.15.99:0/1616615023 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 725298661 0 0) 0x7facec001110 con 0x7fad000cfde0 2024-03-30T13:11:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.110+0000 7facfca00640 1 -- 172.21.15.99:0/1616615023 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7face4003520 con 0x7fad000cfde0 2024-03-30T13:11:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.110+0000 7facfde00640 1 -- 172.21.15.99:0/1616615023 >> v2:172.21.15.181:3300/0 conn(0x7fad000d16a0 msgr2=0x7fad000d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.110+0000 7facfde00640 1 --2- 172.21.15.99:0/1616615023 >> v2:172.21.15.181:3300/0 conn(0x7fad000d16a0 0x7fad000d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.110+0000 7facfde00640 1 -- 172.21.15.99:0/1616615023 >> v1:172.21.15.99:6789/0 conn(0x7fad000cfde0 legacy=0x7fad000d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.110+0000 7facfde00640 1 -- 172.21.15.99:0/1616615023 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad000d2480 con 0x7fad0015e920 2024-03-30T13:11:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.112+0000 7facfde00640 1 --2- 172.21.15.99:0/1616615023 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad0015e920 0x7fad000d3240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7facf00097a0 tx=0x7facf002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=928081829b6d990a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.113+0000 7facfca00640 1 -- 172.21.15.99:0/1616615023 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0035020 con 0x7fad0015e920 2024-03-30T13:11:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.113+0000 7facfca00640 1 -- 172.21.15.99:0/1616615023 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf0031830 con 0x7fad0015e920 2024-03-30T13:11:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.113+0000 7facfca00640 1 -- 172.21.15.99:0/1616615023 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0031be0 con 0x7fad0015e920 2024-03-30T13:11:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.113+0000 7fad05000640 1 -- 172.21.15.99:0/1616615023 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad0015e920 msgr2=0x7fad000d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.113+0000 7fad05000640 1 --2- 172.21.15.99:0/1616615023 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad0015e920 0x7fad000d3240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7facf00097a0 tx=0x7facf002b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.113+0000 7fad05000640 1 -- 172.21.15.99:0/1616615023 shutdown_connections 2024-03-30T13:11:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.113+0000 7fad05000640 1 --2- 172.21.15.99:0/1616615023 >> v2:172.21.15.181:3300/0 conn(0x7fad000d16a0 0x7fad000d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.113+0000 7fad05000640 1 --2- 172.21.15.99:0/1616615023 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad0015e920 0x7fad000d3240 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.113+0000 7fad05000640 1 -- 172.21.15.99:0/1616615023 >> 172.21.15.99:0/1616615023 conn(0x7fad0008bfc0 msgr2=0x7fad000d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.114+0000 7fad05000640 1 -- 172.21.15.99:0/1616615023 shutdown_connections 2024-03-30T13:11:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.114+0000 7fad05000640 1 -- 172.21.15.99:0/1616615023 wait complete. 2024-03-30T13:11:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.116+0000 7fad05000640 1 Processor -- start 2024-03-30T13:11:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.116+0000 7fad05000640 1 -- start start 2024-03-30T13:11:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.118+0000 7fad05000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad000cfde0 0x7fad00160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.118+0000 7fad05000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad000d16a0 0x7fad000cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.118+0000 7fad05000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad0015e920 0x7fad00150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.118+0000 7fad05000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fad000d2d20 con 0x7fad000d16a0 2024-03-30T13:11:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.118+0000 7fad05000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fad000d2a40 con 0x7fad0015e920 2024-03-30T13:11:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.118+0000 7fad05000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fad000d4ef0 con 0x7fad000cfde0 2024-03-30T13:11:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.118+0000 7facfd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad000d16a0 0x7fad000cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.118+0000 7facfde00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad000cfde0 0x7fad00160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.118+0000 7facfd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad000d16a0 0x7fad000cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43630/0 (socket says 172.21.15.99:43630) 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.118+0000 7facfd400640 1 -- 172.21.15.99:0/1687093486 learned_addr learned my addr 172.21.15.99:0/1687093486 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.119+0000 7facfe800640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad0015e920 0x7fad00150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.119+0000 7facfd400640 1 -- 172.21.15.99:0/1687093486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad000cfde0 msgr2=0x7fad00160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.119+0000 7facfd400640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad000cfde0 0x7fad00160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.119+0000 7facfd400640 1 -- 172.21.15.99:0/1687093486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad0015e920 msgr2=0x7fad00150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.119+0000 7facfd400640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad0015e920 0x7fad00150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.119+0000 7facfd400640 1 -- 172.21.15.99:0/1687093486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad001f4c50 con 0x7fad000d16a0 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.119+0000 7facfde00640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad000cfde0 0x7fad00160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.119+0000 7facfd400640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad000d16a0 0x7fad000cc0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7facec00c3d0 tx=0x7facec00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.119+0000 7facf6000640 1 -- 172.21.15.99:0/1687093486 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec017070 con 0x7fad000d16a0 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.120+0000 7facf6000640 1 -- 172.21.15.99:0/1687093486 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec005ce0 con 0x7fad000d16a0 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.120+0000 7facf6000640 1 -- 172.21.15.99:0/1687093486 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec007310 con 0x7fad000d16a0 2024-03-30T13:11:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.120+0000 7fad05000640 1 -- 172.21.15.99:0/1687093486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad001609d0 con 0x7fad000d16a0 2024-03-30T13:11:32.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.120+0000 7fad05000640 1 -- 172.21.15.99:0/1687093486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad00160f90 con 0x7fad000d16a0 2024-03-30T13:11:32.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.121+0000 7fad05000640 1 -- 172.21.15.99:0/1687093486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad001611d0 con 0x7fad000d16a0 2024-03-30T13:11:32.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.122+0000 7facf6000640 1 -- 172.21.15.99:0/1687093486 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7facec01a070 con 0x7fad000d16a0 2024-03-30T13:11:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.123+0000 7facf6000640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7face006c530 0x7face006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.123+0000 7facf6000640 1 -- 172.21.15.99:0/1687093486 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7facec08aa60 con 0x7fad000d16a0 2024-03-30T13:11:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.123+0000 7facfde00640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7face006c530 0x7face006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.124+0000 7facfde00640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7face006c530 0x7face006e9f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7facf0036000 tx=0x7facf0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.128+0000 7facf6000640 1 -- 172.21.15.99:0/1687093486 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fad001611d0 con 0x7fad000d16a0 2024-03-30T13:11:32.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.328+0000 7fad05000640 1 -- 172.21.15.99:0/1687093486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fad000c7ee0 con 0x7fad000d16a0 2024-03-30T13:11:32.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.329+0000 7facf6000640 1 -- 172.21.15.99:0/1687093486 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fad000d3780 con 0x7fad000d16a0 2024-03-30T13:11:32.333 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:32.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 -- 172.21.15.99:0/1687093486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7face006c530 msgr2=0x7face006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7face006c530 0x7face006e9f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7facf0036000 tx=0x7facf0008030 comp rx=0 tx=0).stop 2024-03-30T13:11:32.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 -- 172.21.15.99:0/1687093486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad000d16a0 msgr2=0x7fad000cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad000d16a0 0x7fad000cc0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7facec00c3d0 tx=0x7facec00c890 comp rx=0 tx=0).stop 2024-03-30T13:11:32.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 -- 172.21.15.99:0/1687093486 shutdown_connections 2024-03-30T13:11:32.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7face006c530 0x7face006e9f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad0015e920 0x7fad00150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad000d16a0 0x7fad000cc0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 --2- 172.21.15.99:0/1687093486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad000cfde0 0x7fad00160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 -- 172.21.15.99:0/1687093486 >> 172.21.15.99:0/1687093486 conn(0x7fad0008bfc0 msgr2=0x7fad0006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:32.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 -- 172.21.15.99:0/1687093486 shutdown_connections 2024-03-30T13:11:32.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.332+0000 7fad05000640 1 -- 172.21.15.99:0/1687093486 wait complete. 2024-03-30T13:11:32.365 INFO:tasks.cephfs_test_runner:Starting test: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:11:32.365 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:32.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.562+0000 7f1768000640 1 Processor -- start 2024-03-30T13:11:32.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.562+0000 7f1768000640 1 -- start start 2024-03-30T13:11:32.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.564+0000 7f1768000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176015e930 0x7f17600cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.564+0000 7f1768000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f17600d3310 0x7f176006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.564+0000 7f1768000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17600cfb30 con 0x7f17600cf670 2024-03-30T13:11:32.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.564+0000 7f1768000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f176006c780 con 0x7f17600d3310 2024-03-30T13:11:32.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.564+0000 7f1768000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f17600cfe10 con 0x7f176015e930 2024-03-30T13:11:32.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.564+0000 7f1766000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f17600d3310 0x7f176006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.564+0000 7f1766000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f17600d3310 0x7f176006cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43632/0 (socket says 172.21.15.99:43632) 2024-03-30T13:11:32.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.564+0000 7f1766000640 1 -- 172.21.15.99:0/3449173796 learned_addr learned my addr 172.21.15.99:0/3449173796 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:32.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.565+0000 7f1765600640 1 --2- 172.21.15.99:0/3449173796 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176015e930 0x7f17600cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.565+0000 7f1766000640 1 -- 172.21.15.99:0/3449173796 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176015e930 msgr2=0x7f17600cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:32.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.565+0000 7f1766000640 1 --2- 172.21.15.99:0/3449173796 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176015e930 0x7f17600cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.565+0000 7f1766000640 1 -- 172.21.15.99:0/3449173796 >> v1:172.21.15.99:6789/0 conn(0x7f17600cf670 legacy=0x7f17600d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.565+0000 7f1766000640 1 -- 172.21.15.99:0/3449173796 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17600d00f0 con 0x7f17600d3310 2024-03-30T13:11:32.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.565+0000 7f1765600640 1 --2- 172.21.15.99:0/3449173796 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176015e930 0x7f17600cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:32.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.565+0000 7f175fe00640 1 -- 172.21.15.99:0/3449173796 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 109659519 0 0) 0x7f17600cfb30 con 0x7f17600cf670 2024-03-30T13:11:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.566+0000 7f1766000640 1 --2- 172.21.15.99:0/3449173796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17600d3310 0x7f176006cc10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1758009e50 tx=0x7f175802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c993e022f079336 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.566+0000 7f175fe00640 1 -- 172.21.15.99:0/3449173796 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175802ca70 con 0x7f17600d3310 2024-03-30T13:11:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.566+0000 7f175fe00640 1 -- 172.21.15.99:0/3449173796 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f175802cc10 con 0x7f17600d3310 2024-03-30T13:11:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.566+0000 7f175fe00640 1 -- 172.21.15.99:0/3449173796 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17580343f0 con 0x7f17600d3310 2024-03-30T13:11:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.567+0000 7f1768000640 1 -- 172.21.15.99:0/3449173796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17600d3310 msgr2=0x7f176006cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.567+0000 7f1768000640 1 --2- 172.21.15.99:0/3449173796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17600d3310 0x7f176006cc10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1758009e50 tx=0x7f175802bed0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.567+0000 7f1768000640 1 -- 172.21.15.99:0/3449173796 shutdown_connections 2024-03-30T13:11:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.567+0000 7f1768000640 1 --2- 172.21.15.99:0/3449173796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17600d3310 0x7f176006cc10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.567+0000 7f1768000640 1 --2- 172.21.15.99:0/3449173796 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176015e930 0x7f17600cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.567+0000 7f1768000640 1 -- 172.21.15.99:0/3449173796 >> 172.21.15.99:0/3449173796 conn(0x7f176008bfc0 msgr2=0x7f17600d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.567+0000 7f1768000640 1 -- 172.21.15.99:0/3449173796 shutdown_connections 2024-03-30T13:11:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.567+0000 7f1768000640 1 -- 172.21.15.99:0/3449173796 wait complete. 2024-03-30T13:11:32.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.569+0000 7f1768000640 1 Processor -- start 2024-03-30T13:11:32.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.569+0000 7f1768000640 1 -- start start 2024-03-30T13:11:32.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.570+0000 7f1768000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17600cf670 0x7f176015f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.570+0000 7f1768000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17600d3310 0x7f17601f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.570+0000 7f1768000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176015e930 0x7f17601615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.570+0000 7f1768000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f176015ee90 con 0x7f17600d3310 2024-03-30T13:11:32.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.570+0000 7f1768000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f176015ed10 con 0x7f176015e930 2024-03-30T13:11:32.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.570+0000 7f1768000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f17600b3c50 con 0x7f17600cf670 2024-03-30T13:11:32.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.570+0000 7f1764c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17600d3310 0x7f17601f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.570+0000 7f1764c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17600d3310 0x7f17601f37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43648/0 (socket says 172.21.15.99:43648) 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.570+0000 7f1764c00640 1 -- 172.21.15.99:0/2456739675 learned_addr learned my addr 172.21.15.99:0/2456739675 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.570+0000 7f1764c00640 1 -- 172.21.15.99:0/2456739675 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17600cf670 msgr2=0x7f176015f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.571+0000 7f1764c00640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17600cf670 0x7f176015f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.571+0000 7f1764c00640 1 -- 172.21.15.99:0/2456739675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176015e930 msgr2=0x7f17601615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.571+0000 7f1764c00640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176015e930 0x7f17601615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.571+0000 7f1764c00640 1 -- 172.21.15.99:0/2456739675 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176015f8a0 con 0x7f17600d3310 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.571+0000 7f1764c00640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17600d3310 0x7f17601f37d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f174c00c4b0 tx=0x7f174c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.571+0000 7f175d600640 1 -- 172.21.15.99:0/2456739675 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c017070 con 0x7f17600d3310 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.571+0000 7f175d600640 1 -- 172.21.15.99:0/2456739675 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c005480 con 0x7f17600d3310 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.571+0000 7f175d600640 1 -- 172.21.15.99:0/2456739675 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c003830 con 0x7f17600d3310 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.571+0000 7f1768000640 1 -- 172.21.15.99:0/2456739675 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176015fb80 con 0x7f17600d3310 2024-03-30T13:11:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.571+0000 7f1768000640 1 -- 172.21.15.99:0/2456739675 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1760160140 con 0x7f17600d3310 2024-03-30T13:11:32.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.572+0000 7f1768000640 1 -- 172.21.15.99:0/2456739675 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1760068640 con 0x7f17600d3310 2024-03-30T13:11:32.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.573+0000 7f175d600640 1 -- 172.21.15.99:0/2456739675 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f174c01a070 con 0x7f17600d3310 2024-03-30T13:11:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.574+0000 7f175d600640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f174006c560 0x7f174006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.574+0000 7f175d600640 1 -- 172.21.15.99:0/2456739675 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f174c08ab40 con 0x7f17600d3310 2024-03-30T13:11:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.574+0000 7f1765600640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f174006c560 0x7f174006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.575+0000 7f1765600640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f174006c560 0x7f174006ea20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1750006fd0 tx=0x7f1750008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.579+0000 7f175d600640 1 -- 172.21.15.99:0/2456739675 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f174c0590a0 con 0x7f17600d3310 2024-03-30T13:11:32.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.780+0000 7f1768000640 1 -- 172.21.15.99:0/2456739675 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17600caee0 con 0x7f17600d3310 2024-03-30T13:11:32.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.782+0000 7f175d600640 1 -- 172.21.15.99:0/2456739675 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16658 (secure 0 0 0) 0x7f174c0589a0 con 0x7f17600d3310 2024-03-30T13:11:32.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:32.787 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:26.555726+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.38","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 -- 172.21.15.99:0/2456739675 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f174006c560 msgr2=0x7f174006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f174006c560 0x7f174006ea20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1750006fd0 tx=0x7f1750008040 comp rx=0 tx=0).stop 2024-03-30T13:11:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 -- 172.21.15.99:0/2456739675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17600d3310 msgr2=0x7f17601f37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17600d3310 0x7f17601f37d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f174c00c4b0 tx=0x7f174c00c970 comp rx=0 tx=0).stop 2024-03-30T13:11:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 -- 172.21.15.99:0/2456739675 shutdown_connections 2024-03-30T13:11:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f174006c560 0x7f174006ea20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176015e930 0x7f17601615a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17600d3310 0x7f17601f37d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 --2- 172.21.15.99:0/2456739675 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17600cf670 0x7f176015f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 -- 172.21.15.99:0/2456739675 >> 172.21.15.99:0/2456739675 conn(0x7f176008bfc0 msgr2=0x7f17600d2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 -- 172.21.15.99:0/2456739675 shutdown_connections 2024-03-30T13:11:32.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:32.785+0000 7f1768000640 1 -- 172.21.15.99:0/2456739675 wait complete. 2024-03-30T13:11:32.807 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:32.808 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:33.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.010+0000 7f58f7e00640 1 Processor -- start 2024-03-30T13:11:33.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.010+0000 7f58f7e00640 1 -- start start 2024-03-30T13:11:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.012+0000 7f58f7e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f58f815e7f0 0x7f58f80d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.012+0000 7f58f7e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f806cce0 con 0x7f58f80cf540 2024-03-30T13:11:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.013+0000 7f58f7e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f80cfae0 con 0x7f58f80b5f60 2024-03-30T13:11:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.013+0000 7f58f7e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f58f80d2c30 con 0x7f58f815e7f0 2024-03-30T13:11:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.013+0000 7f58f6000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f58f80cf540 0x7f58f806c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46626/0 (socket says 172.21.15.99:46626) 2024-03-30T13:11:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.013+0000 7f58f6000640 1 -- 172.21.15.99:0/2785449678 learned_addr learned my addr 172.21.15.99:0/2785449678 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.013+0000 7f58f6a00640 1 --2- 172.21.15.99:0/2785449678 >> v2:172.21.15.181:3300/0 conn(0x7f58f815e7f0 0x7f58f80d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.013+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431398225 0 0) 0x7f58f806cce0 con 0x7f58f80cf540 2024-03-30T13:11:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.013+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58dc003520 con 0x7f58f80cf540 2024-03-30T13:11:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1101000348 0 0) 0x7f58dc003520 con 0x7f58f80cf540 2024-03-30T13:11:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 >> v2:172.21.15.181:3300/0 conn(0x7f58f815e7f0 msgr2=0x7f58f80d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 --2- 172.21.15.99:0/2785449678 >> v2:172.21.15.181:3300/0 conn(0x7f58f815e7f0 0x7f58f80d4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 >> v1:172.21.15.181:6789/0 conn(0x7f58f80b5f60 legacy=0x7f58f80d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f80cfdc0 con 0x7f58f80cf540 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f58e4001670 con 0x7f58f80cf540 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 >> v1:172.21.15.99:6789/0 conn(0x7f58f80cf540 legacy=0x7f58f806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 --2- 172.21.15.99:0/2785449678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58dc0039b0 0x7f58dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 --2- 172.21.15.99:0/2785449678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58dc004800 0x7f58dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 --2- 172.21.15.99:0/2785449678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58dc0051c0 0x7f58dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f58f80d2c30 con 0x7f58dc0039b0 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f58dc00c060 con 0x7f58dc0051c0 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f58dc00c260 con 0x7f58dc004800 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f6a00640 1 --2- 172.21.15.99:0/2785449678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58dc0039b0 0x7f58dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f6a00640 1 -- 172.21.15.99:0/2785449678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58dc004800 msgr2=0x7f58dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f6a00640 1 --2- 172.21.15.99:0/2785449678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58dc004800 0x7f58dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f6a00640 1 -- 172.21.15.99:0/2785449678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58dc0051c0 msgr2=0x7f58dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.014+0000 7f58f6a00640 1 --2- 172.21.15.99:0/2785449678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58dc0051c0 0x7f58dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.015+0000 7f58f6a00640 1 -- 172.21.15.99:0/2785449678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58dc003520 con 0x7f58dc0039b0 2024-03-30T13:11:33.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.015+0000 7f58f7400640 1 -- 172.21.15.99:0/2785449678 reap_dead start 2024-03-30T13:11:33.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.016+0000 7f58f6a00640 1 --2- 172.21.15.99:0/2785449678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58dc0039b0 0x7f58dc003dd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009ac0 tx=0x7f58dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34afbeb7299bdcc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.016+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8039070 con 0x7f58dc0039b0 2024-03-30T13:11:33.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.016+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e802c710 con 0x7f58dc0039b0 2024-03-30T13:11:33.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.016+0000 7f58f5600640 1 -- 172.21.15.99:0/2785449678 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8009690 con 0x7f58dc0039b0 2024-03-30T13:11:33.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.016+0000 7f58f7e00640 1 -- 172.21.15.99:0/2785449678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58dc0039b0 msgr2=0x7f58dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.016+0000 7f58f7e00640 1 --2- 172.21.15.99:0/2785449678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58dc0039b0 0x7f58dc003dd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009ac0 tx=0x7f58dc005830 comp rx=0 tx=0).stop 2024-03-30T13:11:33.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.017+0000 7f58f7e00640 1 -- 172.21.15.99:0/2785449678 shutdown_connections 2024-03-30T13:11:33.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.017+0000 7f58f7e00640 1 --2- 172.21.15.99:0/2785449678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58dc0039b0 0x7f58dc003dd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.017+0000 7f58f7e00640 1 -- 172.21.15.99:0/2785449678 >> 172.21.15.99:0/2785449678 conn(0x7f58f809d7f0 msgr2=0x7f58f80d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.017+0000 7f58f7e00640 1 -- 172.21.15.99:0/2785449678 shutdown_connections 2024-03-30T13:11:33.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.017+0000 7f58f7e00640 1 -- 172.21.15.99:0/2785449678 wait complete. 2024-03-30T13:11:33.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.018+0000 7f58f7e00640 1 Processor -- start 2024-03-30T13:11:33.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.019+0000 7f58f7e00640 1 -- start start 2024-03-30T13:11:33.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.019+0000 7f58f7e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58dc0039b0 0x7f58f814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58f815ed50 0x7f58f815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80b8410 0x7f58f80b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f58f80d2570 con 0x7f58f80b8410 2024-03-30T13:11:33.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f58f815ebd0 con 0x7f58f815ed50 2024-03-30T13:11:33.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f58f80b63f0 con 0x7f58dc0039b0 2024-03-30T13:11:33.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80b8410 0x7f58f80b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80b8410 0x7f58f80b8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43672/0 (socket says 172.21.15.99:43672) 2024-03-30T13:11:33.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7400640 1 -- 172.21.15.99:0/3918657401 learned_addr learned my addr 172.21.15.99:0/3918657401 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:33.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f6000640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58f815ed50 0x7f58f815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f6a00640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58dc0039b0 0x7f58f814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7400640 1 -- 172.21.15.99:0/3918657401 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58dc0039b0 msgr2=0x7f58f814bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7400640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58dc0039b0 0x7f58f814bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7400640 1 -- 172.21.15.99:0/3918657401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58f815ed50 msgr2=0x7f58f815f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.020+0000 7f58f7400640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58f815ed50 0x7f58f815f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.021+0000 7f58f7400640 1 -- 172.21.15.99:0/3918657401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f80b9a70 con 0x7f58f80b8410 2024-03-30T13:11:33.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.021+0000 7f58f7400640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80b8410 0x7f58f80b8890 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f58f809de40 tx=0x7f58f000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.021+0000 7f58ef400640 1 -- 172.21.15.99:0/3918657401 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0007070 con 0x7f58f80b8410 2024-03-30T13:11:33.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.021+0000 7f58ef400640 1 -- 172.21.15.99:0/3918657401 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f0007230 con 0x7f58f80b8410 2024-03-30T13:11:33.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.021+0000 7f58f7e00640 1 -- 172.21.15.99:0/3918657401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f80b91d0 con 0x7f58f80b8410 2024-03-30T13:11:33.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.021+0000 7f58ef400640 1 -- 172.21.15.99:0/3918657401 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0007620 con 0x7f58f80b8410 2024-03-30T13:11:33.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.021+0000 7f58f7e00640 1 -- 172.21.15.99:0/3918657401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f80b9790 con 0x7f58f80b8410 2024-03-30T13:11:33.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.022+0000 7f58f7e00640 1 -- 172.21.15.99:0/3918657401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f804f8f0 con 0x7f58f80b8410 2024-03-30T13:11:33.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.024+0000 7f58ef400640 1 -- 172.21.15.99:0/3918657401 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f58f0011070 con 0x7f58f80b8410 2024-03-30T13:11:33.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.025+0000 7f58ef400640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f58d806c530 0x7f58d806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.026+0000 7f58ef400640 1 -- 172.21.15.99:0/3918657401 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f58f008ae20 con 0x7f58f80b8410 2024-03-30T13:11:33.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.026+0000 7f58f6a00640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f58d806c530 0x7f58d806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.026+0000 7f58f6a00640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f58d806c530 0x7f58d806e9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f58e8036000 tx=0x7f58e8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.030+0000 7f58ef400640 1 -- 172.21.15.99:0/3918657401 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f58f0019060 con 0x7f58f80b8410 2024-03-30T13:11:33.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.230+0000 7f58f7e00640 1 -- 172.21.15.99:0/3918657401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f58f80ce870 con 0x7f58f80b8410 2024-03-30T13:11:33.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.231+0000 7f58ef400640 1 -- 172.21.15.99:0/3918657401 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f58f0059410 con 0x7f58f80b8410 2024-03-30T13:11:33.235 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:33.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 -- 172.21.15.99:0/3918657401 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f58d806c530 msgr2=0x7f58d806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f58d806c530 0x7f58d806e9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f58e8036000 tx=0x7f58e8030000 comp rx=0 tx=0).stop 2024-03-30T13:11:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 -- 172.21.15.99:0/3918657401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80b8410 msgr2=0x7f58f80b8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80b8410 0x7f58f80b8890 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f58f809de40 tx=0x7f58f000c8e0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 -- 172.21.15.99:0/3918657401 shutdown_connections 2024-03-30T13:11:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f58d806c530 0x7f58d806e9f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80b8410 0x7f58f80b8890 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58f815ed50 0x7f58f815f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 --2- 172.21.15.99:0/3918657401 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58dc0039b0 0x7f58f814bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 -- 172.21.15.99:0/3918657401 >> 172.21.15.99:0/3918657401 conn(0x7f58f809d7f0 msgr2=0x7f58f806c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 -- 172.21.15.99:0/3918657401 shutdown_connections 2024-03-30T13:11:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.234+0000 7f58f7e00640 1 -- 172.21.15.99:0/3918657401 wait complete. 2024-03-30T13:11:33.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:33.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.460+0000 7f6c8b200640 1 Processor -- start 2024-03-30T13:11:33.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.460+0000 7f6c8b200640 1 -- start start 2024-03-30T13:11:33.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.461+0000 7f6c8b200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c8c15e750 0x7f6c8c0cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.461+0000 7f6c8b200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c8c0d1ad0 con 0x7f6c8c0d0250 2024-03-30T13:11:33.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.461+0000 7f6c8b200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c8c0cf230 con 0x7f6c8c06d1c0 2024-03-30T13:11:33.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.461+0000 7f6c8b200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c0cf000 con 0x7f6c8c15e750 2024-03-30T13:11:33.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.462+0000 7f6c89400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6c8c0d0250 0x7f6c8c06cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46640/0 (socket says 172.21.15.99:46640) 2024-03-30T13:11:33.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.462+0000 7f6c89400640 1 -- 172.21.15.99:0/616933961 learned_addr learned my addr 172.21.15.99:0/616933961 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:33.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.462+0000 7f6c89e00640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c8c15e750 0x7f6c8c0cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.462+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1971967904 0 0) 0x7f6c8c0d1ad0 con 0x7f6c8c0d0250 2024-03-30T13:11:33.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.462+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c70003520 con 0x7f6c8c0d0250 2024-03-30T13:11:33.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4159507327 0 0) 0x7f6c70003520 con 0x7f6c8c0d0250 2024-03-30T13:11:33.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c8c15e750 msgr2=0x7f6c8c0cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c8c15e750 0x7f6c8c0cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 >> v1:172.21.15.181:6789/0 conn(0x7f6c8c06d1c0 legacy=0x7f6c8c0d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c0cf510 con 0x7f6c8c0d0250 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f6c78001670 con 0x7f6c8c0d0250 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 >> v1:172.21.15.99:6789/0 conn(0x7f6c8c0d0250 legacy=0x7f6c8c06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c700039e0 0x7f6c70003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c70004800 0x7f6c70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c8c15e750 0x7f6c70005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7000bac0 con 0x7f6c700039e0 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7000bc70 con 0x7f6c70004800 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7000be70 con 0x7f6c8c15e750 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.463+0000 7f6c89e00640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c700039e0 0x7f6c70003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.464+0000 7f6c89400640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c70004800 0x7f6c70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.464+0000 7f6c89e00640 1 -- 172.21.15.99:0/616933961 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c8c15e750 msgr2=0x7f6c70005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.464+0000 7f6c89e00640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c8c15e750 0x7f6c70005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.464+0000 7f6c89e00640 1 -- 172.21.15.99:0/616933961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c70004800 msgr2=0x7f6c70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.464+0000 7f6c89e00640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c70004800 0x7f6c70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.464+0000 7f6c89e00640 1 -- 172.21.15.99:0/616933961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c70003520 con 0x7f6c700039e0 2024-03-30T13:11:33.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.464+0000 7f6c89400640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c70004800 0x7f6c70004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.465+0000 7f6c89e00640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c700039e0 0x7f6c70003e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009ac0 tx=0x7f6c70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fcb0f39d9a17eb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.465+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c039070 con 0x7f6c700039e0 2024-03-30T13:11:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.465+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7c02c710 con 0x7f6c700039e0 2024-03-30T13:11:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.465+0000 7f6c88a00640 1 -- 172.21.15.99:0/616933961 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c009690 con 0x7f6c700039e0 2024-03-30T13:11:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.466+0000 7f6c8b200640 1 -- 172.21.15.99:0/616933961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c700039e0 msgr2=0x7f6c70003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.466+0000 7f6c8b200640 1 --2- 172.21.15.99:0/616933961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c700039e0 0x7f6c70003e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009ac0 tx=0x7f6c70005830 comp rx=0 tx=0).stop 2024-03-30T13:11:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.466+0000 7f6c8a800640 1 -- 172.21.15.99:0/616933961 reap_dead start 2024-03-30T13:11:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.466+0000 7f6c8b200640 1 -- 172.21.15.99:0/616933961 shutdown_connections 2024-03-30T13:11:33.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.466+0000 7f6c8b200640 1 -- 172.21.15.99:0/616933961 >> 172.21.15.99:0/616933961 conn(0x7f6c8c09d7e0 msgr2=0x7f6c8c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.466+0000 7f6c8b200640 1 -- 172.21.15.99:0/616933961 shutdown_connections 2024-03-30T13:11:33.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.466+0000 7f6c8b200640 1 -- 172.21.15.99:0/616933961 wait complete. 2024-03-30T13:11:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.467+0000 7f6c8b200640 1 Processor -- start 2024-03-30T13:11:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.468+0000 7f6c8b200640 1 -- start start 2024-03-30T13:11:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c8b200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c700039e0 0x7f6c8c1487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c8b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c8c0c8690 0x7f6c8c0b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c8b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c8c0b7590 0x7f6c8c160b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c8b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c0d3150 con 0x7f6c8c0c8690 2024-03-30T13:11:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c8b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c0d1db0 con 0x7f6c8c0b7590 2024-03-30T13:11:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c8b200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c0d32d0 con 0x7f6c700039e0 2024-03-30T13:11:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c89400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c8c0c8690 0x7f6c8c0b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c89400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c8c0c8690 0x7f6c8c0b7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43684/0 (socket says 172.21.15.99:43684) 2024-03-30T13:11:33.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c89400640 1 -- 172.21.15.99:0/1805671113 learned_addr learned my addr 172.21.15.99:0/1805671113 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c8a800640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c8c0b7590 0x7f6c8c160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c89e00640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c700039e0 0x7f6c8c1487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c89400640 1 -- 172.21.15.99:0/1805671113 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c700039e0 msgr2=0x7f6c8c1487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c89400640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c700039e0 0x7f6c8c1487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c89400640 1 -- 172.21.15.99:0/1805671113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c8c0b7590 msgr2=0x7f6c8c160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c89400640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c8c0b7590 0x7f6c8c160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.469+0000 7f6c89400640 1 -- 172.21.15.99:0/1805671113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c1617a0 con 0x7f6c8c0c8690 2024-03-30T13:11:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.470+0000 7f6c89400640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c8c0c8690 0x7f6c8c0b7050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6c78000c00 tx=0x7f6c7800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.470+0000 7f6c82000640 1 -- 172.21.15.99:0/1805671113 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78019070 con 0x7f6c8c0c8690 2024-03-30T13:11:33.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.470+0000 7f6c82000640 1 -- 172.21.15.99:0/1805671113 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c780074e0 con 0x7f6c8c0c8690 2024-03-30T13:11:33.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.470+0000 7f6c82000640 1 -- 172.21.15.99:0/1805671113 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78004a00 con 0x7f6c8c0c8690 2024-03-30T13:11:33.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.470+0000 7f6c8b200640 1 -- 172.21.15.99:0/1805671113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8c161a80 con 0x7f6c8c0c8690 2024-03-30T13:11:33.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.470+0000 7f6c8b200640 1 -- 172.21.15.99:0/1805671113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8c148cf0 con 0x7f6c8c0c8690 2024-03-30T13:11:33.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.472+0000 7f6c8b200640 1 -- 172.21.15.99:0/1805671113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c8c04f8f0 con 0x7f6c8c0c8690 2024-03-30T13:11:33.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.472+0000 7f6c82000640 1 -- 172.21.15.99:0/1805671113 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6c7801c070 con 0x7f6c8c0c8690 2024-03-30T13:11:33.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.473+0000 7f6c82000640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6c6c06c530 0x7f6c6c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.473+0000 7f6c82000640 1 -- 172.21.15.99:0/1805671113 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f6c7808b2c0 con 0x7f6c8c0c8690 2024-03-30T13:11:33.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.474+0000 7f6c89e00640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6c6c06c530 0x7f6c6c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.474+0000 7f6c89e00640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6c6c06c530 0x7f6c6c06e9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c036000 tx=0x7f6c7c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.477+0000 7f6c82000640 1 -- 172.21.15.99:0/1805671113 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6c780598e0 con 0x7f6c8c0c8690 2024-03-30T13:11:33.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.745+0000 7f6c8b200640 1 -- 172.21.15.99:0/1805671113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6c8c06c890 con 0x7f6c8c0c8690 2024-03-30T13:11:33.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.746+0000 7f6c82000640 1 -- 172.21.15.99:0/1805671113 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f6c780591e0 con 0x7f6c8c0c8690 2024-03-30T13:11:33.750 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.748+0000 7f6c8b200640 1 -- 172.21.15.99:0/1805671113 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6c6c06c530 msgr2=0x7f6c6c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.748+0000 7f6c8b200640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6c6c06c530 0x7f6c6c06e9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c036000 tx=0x7f6c7c030000 comp rx=0 tx=0).stop 2024-03-30T13:11:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.748+0000 7f6c8b200640 1 -- 172.21.15.99:0/1805671113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c8c0c8690 msgr2=0x7f6c8c0b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.748+0000 7f6c8b200640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c8c0c8690 0x7f6c8c0b7050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6c78000c00 tx=0x7f6c7800dd40 comp rx=0 tx=0).stop 2024-03-30T13:11:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.748+0000 7f6c8b200640 1 -- 172.21.15.99:0/1805671113 shutdown_connections 2024-03-30T13:11:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.748+0000 7f6c8b200640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6c6c06c530 0x7f6c6c06e9f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.748+0000 7f6c8b200640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c8c0b7590 0x7f6c8c160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.748+0000 7f6c8b200640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c8c0c8690 0x7f6c8c0b7050 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.748+0000 7f6c8b200640 1 --2- 172.21.15.99:0/1805671113 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c700039e0 0x7f6c8c1487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.748+0000 7f6c8b200640 1 -- 172.21.15.99:0/1805671113 >> 172.21.15.99:0/1805671113 conn(0x7f6c8c09d7e0 msgr2=0x7f6c8c0b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.749+0000 7f6c8b200640 1 -- 172.21.15.99:0/1805671113 shutdown_connections 2024-03-30T13:11:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.749+0000 7f6c8b200640 1 -- 172.21.15.99:0/1805671113 wait complete. 2024-03-30T13:11:33.771 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:33.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.970+0000 7f03ae800640 1 Processor -- start 2024-03-30T13:11:33.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.970+0000 7f03ae800640 1 -- start start 2024-03-30T13:11:33.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.972+0000 7f03ae800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f03a815c4a0 0x7f03a80b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.972+0000 7f03ae800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f03a809ab10 0x7f03a80b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.972+0000 7f03ae800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03a80ae3d0 con 0x7f03a80b1170 2024-03-30T13:11:33.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.972+0000 7f03ae800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f03a80b15e0 con 0x7f03a809ab10 2024-03-30T13:11:33.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.972+0000 7f03ae800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f03a80b04f0 con 0x7f03a815c4a0 2024-03-30T13:11:33.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.972+0000 7f03aca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f03a809ab10 0x7f03a80b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.972+0000 7f03aca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f03a809ab10 0x7f03a80b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43686/0 (socket says 172.21.15.99:43686) 2024-03-30T13:11:33.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.972+0000 7f03aca00640 1 -- 172.21.15.99:0/1878081056 learned_addr learned my addr 172.21.15.99:0/1878081056 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:33.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.973+0000 7f03ad400640 1 --2- 172.21.15.99:0/1878081056 >> v2:172.21.15.181:3300/0 conn(0x7f03a815c4a0 0x7f03a80b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.973+0000 7f03aca00640 1 -- 172.21.15.99:0/1878081056 >> v2:172.21.15.181:3300/0 conn(0x7f03a815c4a0 msgr2=0x7f03a80b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.973+0000 7f03aca00640 1 --2- 172.21.15.99:0/1878081056 >> v2:172.21.15.181:3300/0 conn(0x7f03a815c4a0 0x7f03a80b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.973+0000 7f03aca00640 1 -- 172.21.15.99:0/1878081056 >> v1:172.21.15.99:6789/0 conn(0x7f03a80b1170 legacy=0x7f03a806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.973+0000 7f03aca00640 1 -- 172.21.15.99:0/1878081056 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a80b07d0 con 0x7f03a809ab10 2024-03-30T13:11:33.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.974+0000 7f03aca00640 1 --2- 172.21.15.99:0/1878081056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03a809ab10 0x7f03a80b0c30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f03a80b7160 tx=0x7f039402b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7131aa6122b5e8d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.974+0000 7f03a7e00640 1 -- 172.21.15.99:0/1878081056 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0394034070 con 0x7f03a809ab10 2024-03-30T13:11:33.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.974+0000 7f03a7e00640 1 -- 172.21.15.99:0/1878081056 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0394030870 con 0x7f03a809ab10 2024-03-30T13:11:33.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.974+0000 7f03a7e00640 1 -- 172.21.15.99:0/1878081056 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0394030c40 con 0x7f03a809ab10 2024-03-30T13:11:33.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.975+0000 7f03ae800640 1 -- 172.21.15.99:0/1878081056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03a809ab10 msgr2=0x7f03a80b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.975+0000 7f03ae800640 1 --2- 172.21.15.99:0/1878081056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03a809ab10 0x7f03a80b0c30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f03a80b7160 tx=0x7f039402b9b0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.975+0000 7f03ae800640 1 -- 172.21.15.99:0/1878081056 shutdown_connections 2024-03-30T13:11:33.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.975+0000 7f03ae800640 1 --2- 172.21.15.99:0/1878081056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03a809ab10 0x7f03a80b0c30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.975+0000 7f03ae800640 1 --2- 172.21.15.99:0/1878081056 >> v2:172.21.15.181:3300/0 conn(0x7f03a815c4a0 0x7f03a80b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.975+0000 7f03ae800640 1 -- 172.21.15.99:0/1878081056 >> 172.21.15.99:0/1878081056 conn(0x7f03a80b6d50 msgr2=0x7f03a80b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.975+0000 7f03ae800640 1 -- 172.21.15.99:0/1878081056 shutdown_connections 2024-03-30T13:11:33.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.975+0000 7f03ae800640 1 -- 172.21.15.99:0/1878081056 wait complete. 2024-03-30T13:11:33.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.977+0000 7f03ae800640 1 Processor -- start 2024-03-30T13:11:33.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.978+0000 7f03ae800640 1 -- start start 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.979+0000 7f03ae800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03a809ab10 0x7f03a815df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.979+0000 7f03ae800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03a80b1170 0x7f03a8156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.979+0000 7f03ae800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03a815c4a0 0x7f03a8156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.979+0000 7f03ae800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f03a80ae0a0 con 0x7f03a809ab10 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.979+0000 7f03ae800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f03a815c880 con 0x7f03a815c4a0 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.979+0000 7f03ae800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f03a80b2a70 con 0x7f03a80b1170 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.979+0000 7f03ad400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03a809ab10 0x7f03a815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.979+0000 7f03ad400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03a809ab10 0x7f03a815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43688/0 (socket says 172.21.15.99:43688) 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.979+0000 7f03ad400640 1 -- 172.21.15.99:0/3017488532 learned_addr learned my addr 172.21.15.99:0/3017488532 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.980+0000 7f03aca00640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03a80b1170 0x7f03a8156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.980+0000 7f03ad400640 1 -- 172.21.15.99:0/3017488532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03a80b1170 msgr2=0x7f03a8156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.980+0000 7f03ad400640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03a80b1170 0x7f03a8156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.980+0000 7f03ad400640 1 -- 172.21.15.99:0/3017488532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03a815c4a0 msgr2=0x7f03a8156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.980+0000 7f03ad400640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03a815c4a0 0x7f03a8156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.980+0000 7f03ad400640 1 -- 172.21.15.99:0/3017488532 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a815caa0 con 0x7f03a809ab10 2024-03-30T13:11:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.980+0000 7f03ad400640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03a809ab10 0x7f03a815df90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f039c00d830 tx=0x7f039c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.980+0000 7f03a5600640 1 -- 172.21.15.99:0/3017488532 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c00b6c0 con 0x7f03a809ab10 2024-03-30T13:11:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.980+0000 7f03a5600640 1 -- 172.21.15.99:0/3017488532 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f039c019070 con 0x7f03a809ab10 2024-03-30T13:11:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.980+0000 7f03ae800640 1 -- 172.21.15.99:0/3017488532 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a815cd80 con 0x7f03a809ab10 2024-03-30T13:11:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.980+0000 7f03a5600640 1 -- 172.21.15.99:0/3017488532 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c00ba80 con 0x7f03a809ab10 2024-03-30T13:11:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.981+0000 7f03ae800640 1 -- 172.21.15.99:0/3017488532 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a815d340 con 0x7f03a809ab10 2024-03-30T13:11:33.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.982+0000 7f03ae800640 1 -- 172.21.15.99:0/3017488532 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a804f8f0 con 0x7f03a809ab10 2024-03-30T13:11:33.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.983+0000 7f03a5600640 1 -- 172.21.15.99:0/3017488532 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f039c01e460 con 0x7f03a809ab10 2024-03-30T13:11:33.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.983+0000 7f03a5600640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f038806c530 0x7f038806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.984+0000 7f03a5600640 1 -- 172.21.15.99:0/3017488532 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f039c08bdb0 con 0x7f03a809ab10 2024-03-30T13:11:33.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.984+0000 7f03aca00640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f038806c530 0x7f038806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.985+0000 7f03aca00640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f038806c530 0x7f038806e9f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0394036000 tx=0x7f039403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:33.988+0000 7f03a5600640 1 -- 172.21.15.99:0/3017488532 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f039c05a3b0 con 0x7f03a809ab10 2024-03-30T13:11:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.187+0000 7f03ae800640 1 -- 172.21.15.99:0/3017488532 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f03a80b26a0 con 0x7f03a809ab10 2024-03-30T13:11:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.188+0000 7f03a5600640 1 -- 172.21.15.99:0/3017488532 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f039c059cb0 con 0x7f03a809ab10 2024-03-30T13:11:34.192 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:34.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.190+0000 7f03ae800640 1 -- 172.21.15.99:0/3017488532 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f038806c530 msgr2=0x7f038806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.190+0000 7f03ae800640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f038806c530 0x7f038806e9f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0394036000 tx=0x7f039403b040 comp rx=0 tx=0).stop 2024-03-30T13:11:34.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.190+0000 7f03ae800640 1 -- 172.21.15.99:0/3017488532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03a809ab10 msgr2=0x7f03a815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.190+0000 7f03ae800640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03a809ab10 0x7f03a815df90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f039c00d830 tx=0x7f039c00dcf0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.190+0000 7f03ae800640 1 -- 172.21.15.99:0/3017488532 shutdown_connections 2024-03-30T13:11:34.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.190+0000 7f03ae800640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f038806c530 0x7f038806e9f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.190+0000 7f03ae800640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03a815c4a0 0x7f03a8156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.190+0000 7f03ae800640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03a80b1170 0x7f03a8156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.190+0000 7f03ae800640 1 --2- 172.21.15.99:0/3017488532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03a809ab10 0x7f03a815df90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.190+0000 7f03ae800640 1 -- 172.21.15.99:0/3017488532 >> 172.21.15.99:0/3017488532 conn(0x7f03a80b6d50 msgr2=0x7f03a806b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.191+0000 7f03ae800640 1 -- 172.21.15.99:0/3017488532 shutdown_connections 2024-03-30T13:11:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.191+0000 7f03ae800640 1 -- 172.21.15.99:0/3017488532 wait complete. 2024-03-30T13:11:34.212 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining' 2024-03-30T13:11:34.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.411+0000 7f9d4f600640 1 Processor -- start 2024-03-30T13:11:34.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.411+0000 7f9d4f600640 1 -- start start 2024-03-30T13:11:34.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.413+0000 7f9d4f600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9d480d3300 0x7f9d480d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.413+0000 7f9d4f600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d480d4f30 0x7f9d48162f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.413+0000 7f9d4f600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d480d54f0 con 0x7f9d4815e9b0 2024-03-30T13:11:34.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.413+0000 7f9d4f600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9d481634b0 con 0x7f9d480d3300 2024-03-30T13:11:34.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.413+0000 7f9d4f600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f9d480cfcf0 con 0x7f9d480d4f30 2024-03-30T13:11:34.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.413+0000 7f9d3fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9d480d3300 0x7f9d480d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.413+0000 7f9d3fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9d480d3300 0x7f9d480d0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43694/0 (socket says 172.21.15.99:43694) 2024-03-30T13:11:34.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.413+0000 7f9d3fe00640 1 -- 172.21.15.99:0/4122929846 learned_addr learned my addr 172.21.15.99:0/4122929846 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:34.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.413+0000 7f9d4cc00640 1 --1- 172.21.15.99:0/4122929846 >> v1:172.21.15.99:6789/0 conn(0x7f9d4815e9b0 0x7f9d480d2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46654/0 (socket says 172.21.15.99:46654) 2024-03-30T13:11:34.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.414+0000 7f9d4d600640 1 --2- 172.21.15.99:0/4122929846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d480d4f30 0x7f9d48162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.414+0000 7f9d47e00640 1 -- 172.21.15.99:0/4122929846 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721925164 0 0) 0x7f9d480d54f0 con 0x7f9d4815e9b0 2024-03-30T13:11:34.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.414+0000 7f9d47e00640 1 -- 172.21.15.99:0/4122929846 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d2c003520 con 0x7f9d4815e9b0 2024-03-30T13:11:34.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.414+0000 7f9d3fe00640 1 -- 172.21.15.99:0/4122929846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d480d4f30 msgr2=0x7f9d48162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:34.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.414+0000 7f9d3fe00640 1 --2- 172.21.15.99:0/4122929846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d480d4f30 0x7f9d48162f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.414+0000 7f9d3fe00640 1 -- 172.21.15.99:0/4122929846 >> v1:172.21.15.99:6789/0 conn(0x7f9d4815e9b0 legacy=0x7f9d480d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.414+0000 7f9d3fe00640 1 -- 172.21.15.99:0/4122929846 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d480cf3c0 con 0x7f9d480d3300 2024-03-30T13:11:34.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.415+0000 7f9d3fe00640 1 --2- 172.21.15.99:0/4122929846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d480d3300 0x7f9d480d0180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009870 tx=0x7f9d3002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ac4f39b05c5c4f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:34.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.415+0000 7f9d47e00640 1 -- 172.21.15.99:0/4122929846 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30034070 con 0x7f9d480d3300 2024-03-30T13:11:34.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.415+0000 7f9d47e00640 1 -- 172.21.15.99:0/4122929846 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d30030840 con 0x7f9d480d3300 2024-03-30T13:11:34.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.415+0000 7f9d47e00640 1 -- 172.21.15.99:0/4122929846 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30030c10 con 0x7f9d480d3300 2024-03-30T13:11:34.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.416+0000 7f9d4f600640 1 -- 172.21.15.99:0/4122929846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d480d3300 msgr2=0x7f9d480d0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.416+0000 7f9d4f600640 1 --2- 172.21.15.99:0/4122929846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d480d3300 0x7f9d480d0180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009870 tx=0x7f9d3002b980 comp rx=0 tx=0).stop 2024-03-30T13:11:34.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.416+0000 7f9d4f600640 1 -- 172.21.15.99:0/4122929846 shutdown_connections 2024-03-30T13:11:34.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.416+0000 7f9d4f600640 1 --2- 172.21.15.99:0/4122929846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d480d4f30 0x7f9d48162f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.416+0000 7f9d4f600640 1 --2- 172.21.15.99:0/4122929846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d480d3300 0x7f9d480d0180 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.416+0000 7f9d4f600640 1 -- 172.21.15.99:0/4122929846 >> 172.21.15.99:0/4122929846 conn(0x7f9d4808bfc0 msgr2=0x7f9d480d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:34.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.416+0000 7f9d4f600640 1 -- 172.21.15.99:0/4122929846 shutdown_connections 2024-03-30T13:11:34.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.416+0000 7f9d4f600640 1 -- 172.21.15.99:0/4122929846 wait complete. 2024-03-30T13:11:34.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.418+0000 7f9d4f600640 1 Processor -- start 2024-03-30T13:11:34.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.418+0000 7f9d4f600640 1 -- start start 2024-03-30T13:11:34.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.419+0000 7f9d4f600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d480d3300 0x7f9d48161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.419+0000 7f9d4f600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d480d4f30 0x7f9d480b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.419+0000 7f9d4f600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d4815e9b0 0x7f9d480b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.419+0000 7f9d4f600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4815ed90 con 0x7f9d480d4f30 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.419+0000 7f9d4f600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9d480cf980 con 0x7f9d4815e9b0 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.419+0000 7f9d4f600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f9d4806c760 con 0x7f9d480d3300 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.419+0000 7f9d3fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d480d4f30 0x7f9d480b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.419+0000 7f9d3fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d480d4f30 0x7f9d480b99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43708/0 (socket says 172.21.15.99:43708) 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.419+0000 7f9d3fe00640 1 -- 172.21.15.99:0/2926354895 learned_addr learned my addr 172.21.15.99:0/2926354895 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.420+0000 7f9d3fe00640 1 -- 172.21.15.99:0/2926354895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d480d3300 msgr2=0x7f9d48161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.420+0000 7f9d3fe00640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d480d3300 0x7f9d48161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.420+0000 7f9d3fe00640 1 -- 172.21.15.99:0/2926354895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d4815e9b0 msgr2=0x7f9d480b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.420+0000 7f9d3fe00640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d4815e9b0 0x7f9d480b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:34.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.420+0000 7f9d3fe00640 1 -- 172.21.15.99:0/2926354895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d480b55f0 con 0x7f9d480d4f30 2024-03-30T13:11:34.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.420+0000 7f9d3fe00640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d480d4f30 0x7f9d480b99f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9d30000c00 tx=0x7f9d30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:34.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.420+0000 7f9d45600640 1 -- 172.21.15.99:0/2926354895 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30048070 con 0x7f9d480d4f30 2024-03-30T13:11:34.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.420+0000 7f9d45600640 1 -- 172.21.15.99:0/2926354895 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d30030640 con 0x7f9d480d4f30 2024-03-30T13:11:34.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.420+0000 7f9d45600640 1 -- 172.21.15.99:0/2926354895 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30034040 con 0x7f9d480d4f30 2024-03-30T13:11:34.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.420+0000 7f9d4f600640 1 -- 172.21.15.99:0/2926354895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d480b5890 con 0x7f9d480d4f30 2024-03-30T13:11:34.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.420+0000 7f9d4f600640 1 -- 172.21.15.99:0/2926354895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d480b5e50 con 0x7f9d480d4f30 2024-03-30T13:11:34.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.422+0000 7f9d4f600640 1 -- 172.21.15.99:0/2926354895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d48068d50 con 0x7f9d480d4f30 2024-03-30T13:11:34.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.423+0000 7f9d45600640 1 -- 172.21.15.99:0/2926354895 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9d3004b070 con 0x7f9d480d4f30 2024-03-30T13:11:34.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.424+0000 7f9d45600640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9d2406c530 0x7f9d2406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:34.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.424+0000 7f9d45600640 1 -- 172.21.15.99:0/2926354895 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f9d300ad600 con 0x7f9d480d4f30 2024-03-30T13:11:34.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.424+0000 7f9d4cc00640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9d2406c530 0x7f9d2406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:34.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.425+0000 7f9d4cc00640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9d2406c530 0x7f9d2406e9f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d38000f60 tx=0x7f9d380078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:34.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.429+0000 7f9d45600640 1 -- 172.21.15.99:0/2926354895 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9d48068d50 con 0x7f9d480d4f30 2024-03-30T13:11:34.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:34.746+0000 7f9d4f600640 1 -- 172.21.15.99:0/2926354895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]} v 0) -- 0x7f9d48068640 con 0x7f9d480d4f30 2024-03-30T13:11:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.629+0000 7f9d45600640 1 -- 172.21.15.99:0/2926354895 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]}]=0 v67) ==== 150+0+0 (secure 0 0 0) 0x7f9d3007bc00 con 0x7f9d480d4f30 2024-03-30T13:11:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.633+0000 7f9d4f600640 1 -- 172.21.15.99:0/2926354895 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9d2406c530 msgr2=0x7f9d2406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.633+0000 7f9d4f600640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9d2406c530 0x7f9d2406e9f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d38000f60 tx=0x7f9d380078f0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.633+0000 7f9d4f600640 1 -- 172.21.15.99:0/2926354895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d480d4f30 msgr2=0x7f9d480b99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.633+0000 7f9d4f600640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d480d4f30 0x7f9d480b99f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9d30000c00 tx=0x7f9d30004730 comp rx=0 tx=0).stop 2024-03-30T13:11:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.634+0000 7f9d4f600640 1 -- 172.21.15.99:0/2926354895 shutdown_connections 2024-03-30T13:11:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.634+0000 7f9d4f600640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9d2406c530 0x7f9d2406e9f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.634+0000 7f9d4f600640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d4815e9b0 0x7f9d480b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.634+0000 7f9d4f600640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d480d4f30 0x7f9d480b99f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.634+0000 7f9d4f600640 1 --2- 172.21.15.99:0/2926354895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d480d3300 0x7f9d48161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.634+0000 7f9d4f600640 1 -- 172.21.15.99:0/2926354895 >> 172.21.15.99:0/2926354895 conn(0x7f9d4808bfc0 msgr2=0x7f9d480b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.634+0000 7f9d4f600640 1 -- 172.21.15.99:0/2926354895 shutdown_connections 2024-03-30T13:11:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.634+0000 7f9d4f600640 1 -- 172.21.15.99:0/2926354895 wait complete. 2024-03-30T13:11:35.659 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-30T13:11:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.867+0000 7fdfa2e00640 1 Processor -- start 2024-03-30T13:11:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.867+0000 7fdfa2e00640 1 -- start start 2024-03-30T13:11:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.868+0000 7fdfa2e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdf9c156cf0 0x7fdf9c0ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.868+0000 7fdfa2e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c06cc30 0x7fdf9c1602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.868+0000 7fdfa2e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf9c073080 con 0x7fdf9c072b30 2024-03-30T13:11:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.868+0000 7fdfa2e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fdf9c15d500 con 0x7fdf9c156cf0 2024-03-30T13:11:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.868+0000 7fdfa2e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdf9c15ceb0 con 0x7fdf9c06cc30 2024-03-30T13:11:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.869+0000 7fdf9be00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdf9c156cf0 0x7fdf9c0ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.869+0000 7fdfa0e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c06cc30 0x7fdf9c1602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.869+0000 7fdf9be00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdf9c156cf0 0x7fdf9c0ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:44710/0 (socket says 172.21.15.99:44710) 2024-03-30T13:11:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.869+0000 7fdf9be00640 1 -- 172.21.15.99:0/949940604 learned_addr learned my addr 172.21.15.99:0/949940604 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.870+0000 7fdf9be00640 1 -- 172.21.15.99:0/949940604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c06cc30 msgr2=0x7fdf9c1602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.870+0000 7fdf9be00640 1 --2- 172.21.15.99:0/949940604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c06cc30 0x7fdf9c1602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.870+0000 7fdf9be00640 1 -- 172.21.15.99:0/949940604 >> v1:172.21.15.181:6789/0 conn(0x7fdf9c072b30 legacy=0x7fdf9c06c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.870+0000 7fdf9be00640 1 -- 172.21.15.99:0/949940604 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9c15d190 con 0x7fdf9c156cf0 2024-03-30T13:11:35.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.870+0000 7fdfa0e00640 1 --2- 172.21.15.99:0/949940604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c06cc30 0x7fdf9c1602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.872+0000 7fdf9be00640 1 --2- 172.21.15.99:0/949940604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf9c156cf0 0x7fdf9c0ce1e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009870 tx=0x7fdf8c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b873e873a17757ed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.872+0000 7fdf9aa00640 1 -- 172.21.15.99:0/949940604 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c034070 con 0x7fdf9c156cf0 2024-03-30T13:11:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.872+0000 7fdf9aa00640 1 -- 172.21.15.99:0/949940604 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8c030840 con 0x7fdf9c156cf0 2024-03-30T13:11:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.872+0000 7fdf9aa00640 1 -- 172.21.15.99:0/949940604 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c030c10 con 0x7fdf9c156cf0 2024-03-30T13:11:35.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.873+0000 7fdfa2e00640 1 -- 172.21.15.99:0/949940604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf9c156cf0 msgr2=0x7fdf9c0ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.873+0000 7fdfa2e00640 1 --2- 172.21.15.99:0/949940604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf9c156cf0 0x7fdf9c0ce1e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009870 tx=0x7fdf8c02b980 comp rx=0 tx=0).stop 2024-03-30T13:11:35.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.873+0000 7fdfa2e00640 1 -- 172.21.15.99:0/949940604 shutdown_connections 2024-03-30T13:11:35.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.873+0000 7fdfa2e00640 1 --2- 172.21.15.99:0/949940604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c06cc30 0x7fdf9c1602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.873+0000 7fdfa2e00640 1 --2- 172.21.15.99:0/949940604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf9c156cf0 0x7fdf9c0ce1e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.873+0000 7fdfa2e00640 1 -- 172.21.15.99:0/949940604 >> 172.21.15.99:0/949940604 conn(0x7fdf9c072010 msgr2=0x7fdf9c072420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:35.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.873+0000 7fdfa2e00640 1 -- 172.21.15.99:0/949940604 shutdown_connections 2024-03-30T13:11:35.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.873+0000 7fdfa2e00640 1 -- 172.21.15.99:0/949940604 wait complete. 2024-03-30T13:11:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.875+0000 7fdfa2e00640 1 Processor -- start 2024-03-30T13:11:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.875+0000 7fdfa2e00640 1 -- start start 2024-03-30T13:11:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.876+0000 7fdfa2e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf9c06cc30 0x7fdf9c1e5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.876+0000 7fdfa2e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c072b30 0x7fdf9c156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.876+0000 7fdfa2e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c156cf0 0x7fdf9c143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.876+0000 7fdfa2e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9c067590 con 0x7fdf9c072b30 2024-03-30T13:11:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.876+0000 7fdfa2e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9c067410 con 0x7fdf9c06cc30 2024-03-30T13:11:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.876+0000 7fdfa2e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdf9c15d990 con 0x7fdf9c156cf0 2024-03-30T13:11:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.876+0000 7fdf9b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c072b30 0x7fdf9c156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.876+0000 7fdf9b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c072b30 0x7fdf9c156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44936/0 (socket says 172.21.15.99:44936) 2024-03-30T13:11:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.876+0000 7fdf9b400640 1 -- 172.21.15.99:0/1851833593 learned_addr learned my addr 172.21.15.99:0/1851833593 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdf9be00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf9c06cc30 0x7fdf9c1e5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdfa0e00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c156cf0 0x7fdf9c143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdf9b400640 1 -- 172.21.15.99:0/1851833593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c156cf0 msgr2=0x7fdf9c143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdf9b400640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c156cf0 0x7fdf9c143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdf9b400640 1 -- 172.21.15.99:0/1851833593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf9c06cc30 msgr2=0x7fdf9c1e5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdf9b400640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf9c06cc30 0x7fdf9c1e5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdf9b400640 1 -- 172.21.15.99:0/1851833593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9c143ab0 con 0x7fdf9c072b30 2024-03-30T13:11:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdf9be00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf9c06cc30 0x7fdf9c1e5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdfa0e00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c156cf0 0x7fdf9c143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdf9b400640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c072b30 0x7fdf9c156030 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800c440 tx=0x7fdf88001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdf93e00640 1 -- 172.21.15.99:0/1851833593 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf880052d0 con 0x7fdf9c072b30 2024-03-30T13:11:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.877+0000 7fdf93e00640 1 -- 172.21.15.99:0/1851833593 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf88005470 con 0x7fdf9c072b30 2024-03-30T13:11:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.878+0000 7fdfa2e00640 1 -- 172.21.15.99:0/1851833593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9c153810 con 0x7fdf9c072b30 2024-03-30T13:11:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.878+0000 7fdf93e00640 1 -- 172.21.15.99:0/1851833593 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88007260 con 0x7fdf9c072b30 2024-03-30T13:11:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.878+0000 7fdfa2e00640 1 -- 172.21.15.99:0/1851833593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf9c153dd0 con 0x7fdf9c072b30 2024-03-30T13:11:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.879+0000 7fdfa2e00640 1 -- 172.21.15.99:0/1851833593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf9c04f9d0 con 0x7fdf9c072b30 2024-03-30T13:11:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.880+0000 7fdf93e00640 1 -- 172.21.15.99:0/1851833593 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdf88007400 con 0x7fdf9c072b30 2024-03-30T13:11:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.881+0000 7fdf93e00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf7c06c530 0x7fdf7c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:35.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.881+0000 7fdf93e00640 1 -- 172.21.15.99:0/1851833593 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fdf8808ac30 con 0x7fdf9c072b30 2024-03-30T13:11:35.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.881+0000 7fdf9be00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf7c06c530 0x7fdf7c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:35.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.882+0000 7fdf9be00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf7c06c530 0x7fdf7c06e9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c036000 tx=0x7fdf8c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:35.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:35.885+0000 7fdf93e00640 1 -- 172.21.15.99:0/1851833593 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fdf9c143ab0 con 0x7fdf9c072b30 2024-03-30T13:11:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.084+0000 7fdfa2e00640 1 -- 172.21.15.99:0/1851833593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdf9c0b5f40 con 0x7fdf9c072b30 2024-03-30T13:11:36.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.088+0000 7fdf93e00640 1 -- 172.21.15.99:0/1851833593 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fdf88059220 con 0x7fdf9c072b30 2024-03-30T13:11:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 -- 172.21.15.99:0/1851833593 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf7c06c530 msgr2=0x7fdf7c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf7c06c530 0x7fdf7c06e9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c036000 tx=0x7fdf8c03b040 comp rx=0 tx=0).stop 2024-03-30T13:11:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 -- 172.21.15.99:0/1851833593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c072b30 msgr2=0x7fdf9c156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c072b30 0x7fdf9c156030 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800c440 tx=0x7fdf88001e70 comp rx=0 tx=0).stop 2024-03-30T13:11:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 -- 172.21.15.99:0/1851833593 shutdown_connections 2024-03-30T13:11:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdf7c06c530 0x7fdf7c06e9f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf9c156cf0 0x7fdf9c143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c072b30 0x7fdf9c156030 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 --2- 172.21.15.99:0/1851833593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf9c06cc30 0x7fdf9c1e5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 -- 172.21.15.99:0/1851833593 >> 172.21.15.99:0/1851833593 conn(0x7fdf9c072010 msgr2=0x7fdf9c06eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 -- 172.21.15.99:0/1851833593 shutdown_connections 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.092+0000 7fdfa2e00640 1 -- 172.21.15.99:0/1851833593 wait complete. 2024-03-30T13:11:36.113 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-30T13:11:36.114 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:11:36.203 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:11:36.330 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-30T13:11:36.330 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:11:36.330 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:36.379 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:11:36.379 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:36.472 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:11:36.472 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:36.566 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:36.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.754+0000 7f2b4e400640 1 Processor -- start 2024-03-30T13:11:36.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.754+0000 7f2b4e400640 1 -- start start 2024-03-30T13:11:36.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.756+0000 7f2b4e400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2b480d0800 0x7f2b4809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.756+0000 7f2b4e400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b480d0f50 con 0x7f2b4809af70 2024-03-30T13:11:36.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.756+0000 7f2b4e400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b480d1230 con 0x7f2b480ce860 2024-03-30T13:11:36.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.756+0000 7f2b4e400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2b4809b3c0 con 0x7f2b480d0800 2024-03-30T13:11:36.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.756+0000 7f2b47e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2b4809af70 0x7f2b480ccd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34682/0 (socket says 172.21.15.99:34682) 2024-03-30T13:11:36.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.756+0000 7f2b47e00640 1 -- 172.21.15.99:0/2207857777 learned_addr learned my addr 172.21.15.99:0/2207857777 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:36.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46a00640 1 --2- 172.21.15.99:0/2207857777 >> v2:172.21.15.181:3300/0 conn(0x7f2b480d0800 0x7f2b4809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430971074 0 0) 0x7f2b480d0f50 con 0x7f2b4809af70 2024-03-30T13:11:36.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b2c003520 con 0x7f2b4809af70 2024-03-30T13:11:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2431786254 0 0) 0x7f2b2c003520 con 0x7f2b4809af70 2024-03-30T13:11:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 >> v2:172.21.15.181:3300/0 conn(0x7f2b480d0800 msgr2=0x7f2b4809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 --2- 172.21.15.99:0/2207857777 >> v2:172.21.15.181:3300/0 conn(0x7f2b480d0800 0x7f2b4809aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 >> v1:172.21.15.181:6789/0 conn(0x7f2b480ce860 legacy=0x7f2b4806d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b480d1510 con 0x7f2b4809af70 2024-03-30T13:11:36.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f2b400019f0 con 0x7f2b4809af70 2024-03-30T13:11:36.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 >> v1:172.21.15.99:6789/0 conn(0x7f2b4809af70 legacy=0x7f2b480ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0039b0 0x7f2b2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c004800 0x7f2b2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.757+0000 7f2b46000640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0051c0 0x7f2b2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4809b3c0 con 0x7f2b2c0051c0 2024-03-30T13:11:36.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c00c070 con 0x7f2b2c004800 2024-03-30T13:11:36.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c00c270 con 0x7f2b2c0039b0 2024-03-30T13:11:36.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b47e00640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0051c0 0x7f2b2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b46a00640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c004800 0x7f2b2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b47400640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0039b0 0x7f2b2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b47e00640 1 -- 172.21.15.99:0/2207857777 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0039b0 msgr2=0x7f2b2c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b47e00640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0039b0 0x7f2b2c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b47e00640 1 -- 172.21.15.99:0/2207857777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c004800 msgr2=0x7f2b2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b47e00640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c004800 0x7f2b2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b47e00640 1 -- 172.21.15.99:0/2207857777 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c003520 con 0x7f2b2c0051c0 2024-03-30T13:11:36.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.758+0000 7f2b47400640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b2c0039b0 0x7f2b2c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.760+0000 7f2b47e00640 1 -- 172.21.15.99:0/2207857777 reap_dead start 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.760+0000 7f2b47e00640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0051c0 0x7f2b2c00b9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000a850 tx=0x7f2b2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694c187c60887dbe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.760+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000a4a0 con 0x7f2b2c0051c0 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.760+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b40034650 con 0x7f2b2c0051c0 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.760+0000 7f2b46000640 1 -- 172.21.15.99:0/2207857777 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40034a40 con 0x7f2b2c0051c0 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.761+0000 7f2b4e400640 1 -- 172.21.15.99:0/2207857777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0051c0 msgr2=0x7f2b2c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.761+0000 7f2b4e400640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0051c0 0x7f2b2c00b9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000a850 tx=0x7f2b2c005830 comp rx=0 tx=0).stop 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.761+0000 7f2b4e400640 1 -- 172.21.15.99:0/2207857777 shutdown_connections 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.761+0000 7f2b4e400640 1 --2- 172.21.15.99:0/2207857777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0051c0 0x7f2b2c00b9c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.761+0000 7f2b4e400640 1 -- 172.21.15.99:0/2207857777 >> 172.21.15.99:0/2207857777 conn(0x7f2b480b3fc0 msgr2=0x7f2b480b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.761+0000 7f2b4e400640 1 -- 172.21.15.99:0/2207857777 shutdown_connections 2024-03-30T13:11:36.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.761+0000 7f2b4e400640 1 -- 172.21.15.99:0/2207857777 wait complete. 2024-03-30T13:11:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.764+0000 7f2b4e400640 1 Processor -- start 2024-03-30T13:11:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.764+0000 7f2b4e400640 1 -- start start 2024-03-30T13:11:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.765+0000 7f2b4e400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c0051c0 0x7f2b4815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.765+0000 7f2b4e400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b4809c350 0x7f2b4809c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.765+0000 7f2b4e400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b4809de80 0x7f2b4809e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.765+0000 7f2b4e400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2b480d0c40 con 0x7f2b4809de80 2024-03-30T13:11:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.765+0000 7f2b4e400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2b480d1b60 con 0x7f2b2c0051c0 2024-03-30T13:11:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.765+0000 7f2b4e400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2b480cec40 con 0x7f2b4809c350 2024-03-30T13:11:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.766+0000 7f2b47e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b4809de80 0x7f2b4809e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.766+0000 7f2b47e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b4809de80 0x7f2b4809e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44952/0 (socket says 172.21.15.99:44952) 2024-03-30T13:11:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.766+0000 7f2b47e00640 1 -- 172.21.15.99:0/3043548890 learned_addr learned my addr 172.21.15.99:0/3043548890 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.766+0000 7f2b47400640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c0051c0 0x7f2b4815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.766+0000 7f2b47e00640 1 -- 172.21.15.99:0/3043548890 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b4809c350 msgr2=0x7f2b4809c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.766+0000 7f2b47e00640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b4809c350 0x7f2b4809c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.766+0000 7f2b47e00640 1 -- 172.21.15.99:0/3043548890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c0051c0 msgr2=0x7f2b4815cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.766+0000 7f2b47e00640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c0051c0 0x7f2b4815cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.766+0000 7f2b47e00640 1 -- 172.21.15.99:0/3043548890 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4815d1e0 con 0x7f2b4809de80 2024-03-30T13:11:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.766+0000 7f2b47400640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c0051c0 0x7f2b4815cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.766+0000 7f2b47e00640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b4809de80 0x7f2b4809e330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000a850 tx=0x7f2b40001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.767+0000 7f2b3f400640 1 -- 172.21.15.99:0/3043548890 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40045070 con 0x7f2b4809de80 2024-03-30T13:11:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.767+0000 7f2b3f400640 1 -- 172.21.15.99:0/3043548890 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4003a040 con 0x7f2b4809de80 2024-03-30T13:11:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.767+0000 7f2b3f400640 1 -- 172.21.15.99:0/3043548890 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000a480 con 0x7f2b4809de80 2024-03-30T13:11:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.767+0000 7f2b4e400640 1 -- 172.21.15.99:0/3043548890 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4809ce10 con 0x7f2b4809de80 2024-03-30T13:11:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.767+0000 7f2b4e400640 1 -- 172.21.15.99:0/3043548890 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b480b5220 con 0x7f2b4809de80 2024-03-30T13:11:36.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.768+0000 7f2b4e400640 1 -- 172.21.15.99:0/3043548890 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b48068d50 con 0x7f2b4809de80 2024-03-30T13:11:36.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.769+0000 7f2b3f400640 1 -- 172.21.15.99:0/3043548890 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2b40048070 con 0x7f2b4809de80 2024-03-30T13:11:36.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.770+0000 7f2b3f400640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2b2806c560 0x7f2b2806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.770+0000 7f2b3f400640 1 -- 172.21.15.99:0/3043548890 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f2b400ad2c0 con 0x7f2b4809de80 2024-03-30T13:11:36.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.770+0000 7f2b47400640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2b2806c560 0x7f2b2806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.771+0000 7f2b47400640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2b2806c560 0x7f2b2806ea20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b48161140 tx=0x7f2b38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.774+0000 7f2b3f400640 1 -- 172.21.15.99:0/3043548890 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2b4815d1e0 con 0x7f2b4809de80 2024-03-30T13:11:36.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.976+0000 7f2b4e400640 1 -- 172.21.15.99:0/3043548890 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b480b4c20 con 0x7f2b4809de80 2024-03-30T13:11:36.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.977+0000 7f2b3f400640 1 -- 172.21.15.99:0/3043548890 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16658 (secure 0 0 0) 0x7f2b4007b8b0 con 0x7f2b4809de80 2024-03-30T13:11:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:36.982 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:26.555726+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.38","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.980+0000 7f2b4e400640 1 -- 172.21.15.99:0/3043548890 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2b2806c560 msgr2=0x7f2b2806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.980+0000 7f2b4e400640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2b2806c560 0x7f2b2806ea20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b48161140 tx=0x7f2b38009040 comp rx=0 tx=0).stop 2024-03-30T13:11:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.980+0000 7f2b4e400640 1 -- 172.21.15.99:0/3043548890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b4809de80 msgr2=0x7f2b4809e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.980+0000 7f2b4e400640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b4809de80 0x7f2b4809e330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000a850 tx=0x7f2b40001dc0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.980+0000 7f2b4e400640 1 -- 172.21.15.99:0/3043548890 shutdown_connections 2024-03-30T13:11:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.980+0000 7f2b4e400640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2b2806c560 0x7f2b2806ea20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.980+0000 7f2b4e400640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b4809de80 0x7f2b4809e330 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.980+0000 7f2b4e400640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b4809c350 0x7f2b4809c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.980+0000 7f2b4e400640 1 --2- 172.21.15.99:0/3043548890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c0051c0 0x7f2b4815cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.980+0000 7f2b4e400640 1 -- 172.21.15.99:0/3043548890 >> 172.21.15.99:0/3043548890 conn(0x7f2b480b3fc0 msgr2=0x7f2b48071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.980+0000 7f2b4e400640 1 -- 172.21.15.99:0/3043548890 shutdown_connections 2024-03-30T13:11:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:36.981+0000 7f2b4e400640 1 -- 172.21.15.99:0/3043548890 wait complete. 2024-03-30T13:11:37.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:37.004 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.207+0000 7f48f0200640 1 Processor -- start 2024-03-30T13:11:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.207+0000 7f48f0200640 1 -- start start 2024-03-30T13:11:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.209+0000 7f48f0200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e80cfde0 0x7f48e80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.209+0000 7f48f0200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48e815ed00 con 0x7f48e815e920 2024-03-30T13:11:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.209+0000 7f48f0200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48e80d21e0 con 0x7f48e80d0f90 2024-03-30T13:11:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.209+0000 7f48f0200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f48e80d2480 con 0x7f48e80cfde0 2024-03-30T13:11:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.209+0000 7f48ed800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f48e815e920 0x7f48e80d3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34686/0 (socket says 172.21.15.99:34686) 2024-03-30T13:11:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.209+0000 7f48ed800640 1 -- 172.21.15.99:0/734932771 learned_addr learned my addr 172.21.15.99:0/734932771 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:37.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48ece00640 1 --2- 172.21.15.99:0/734932771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e80cfde0 0x7f48e80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3394616660 0 0) 0x7f48e815ed00 con 0x7f48e815e920 2024-03-30T13:11:37.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48cc003520 con 0x7f48e815e920 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 219300708 0 0) 0x7f48cc003520 con 0x7f48e815e920 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e80cfde0 msgr2=0x7f48e80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 --2- 172.21.15.99:0/734932771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e80cfde0 0x7f48e80d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 >> v1:172.21.15.181:6789/0 conn(0x7f48e80d0f90 legacy=0x7f48e806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e80d2760 con 0x7f48e815e920 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f48d8001670 con 0x7f48e815e920 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 >> v1:172.21.15.99:6789/0 conn(0x7f48e815e920 legacy=0x7f48e80d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 --2- 172.21.15.99:0/734932771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e80cfde0 0x7f48cc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 --2- 172.21.15.99:0/734932771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48cc003fb0 0x7f48cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 --2- 172.21.15.99:0/734932771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48cc004d40 0x7f48cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f48e80d2480 con 0x7f48cc004d40 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc00bb00 con 0x7f48cc003fb0 2024-03-30T13:11:37.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.210+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc00bd00 con 0x7f48e80cfde0 2024-03-30T13:11:37.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.211+0000 7f48ee200640 1 --2- 172.21.15.99:0/734932771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48cc004d40 0x7f48cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.211+0000 7f48ece00640 1 --2- 172.21.15.99:0/734932771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48cc003fb0 0x7f48cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.211+0000 7f48ee200640 1 -- 172.21.15.99:0/734932771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e80cfde0 msgr2=0x7f48cc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.211+0000 7f48ee200640 1 --2- 172.21.15.99:0/734932771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e80cfde0 0x7f48cc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.211+0000 7f48ee200640 1 -- 172.21.15.99:0/734932771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48cc003fb0 msgr2=0x7f48cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.211+0000 7f48ee200640 1 --2- 172.21.15.99:0/734932771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48cc003fb0 0x7f48cc004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.211+0000 7f48ee200640 1 -- 172.21.15.99:0/734932771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc003520 con 0x7f48cc004d40 2024-03-30T13:11:37.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.212+0000 7f48ee200640 1 --2- 172.21.15.99:0/734932771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48cc004d40 0x7f48cc0051c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f48e0001750 tx=0x7f48cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c56cd07bc06e5e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.212+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0001370 con 0x7f48cc004d40 2024-03-30T13:11:37.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.212+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e00052d0 con 0x7f48cc004d40 2024-03-30T13:11:37.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.212+0000 7f48e7e00640 1 -- 172.21.15.99:0/734932771 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0003830 con 0x7f48cc004d40 2024-03-30T13:11:37.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.213+0000 7f48f0200640 1 -- 172.21.15.99:0/734932771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48cc004d40 msgr2=0x7f48cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.213+0000 7f48f0200640 1 --2- 172.21.15.99:0/734932771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48cc004d40 0x7f48cc0051c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f48e0001750 tx=0x7f48cc005830 comp rx=0 tx=0).stop 2024-03-30T13:11:37.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.213+0000 7f48ee200640 1 -- 172.21.15.99:0/734932771 reap_dead start 2024-03-30T13:11:37.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.213+0000 7f48f0200640 1 -- 172.21.15.99:0/734932771 shutdown_connections 2024-03-30T13:11:37.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.213+0000 7f48f0200640 1 -- 172.21.15.99:0/734932771 >> 172.21.15.99:0/734932771 conn(0x7f48e808bfc0 msgr2=0x7f48e80d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.213+0000 7f48f0200640 1 -- 172.21.15.99:0/734932771 shutdown_connections 2024-03-30T13:11:37.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.213+0000 7f48f0200640 1 -- 172.21.15.99:0/734932771 wait complete. 2024-03-30T13:11:37.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.216+0000 7f48f0200640 1 Processor -- start 2024-03-30T13:11:37.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.216+0000 7f48f0200640 1 -- start start 2024-03-30T13:11:37.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48f0200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48cc004d40 0x7f48e80b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48f0200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e80b5bc0 0x7f48e81596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48f0200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48e81601e0 0x7f48e8160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48f0200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f48e80d4ef0 con 0x7f48e80b5bc0 2024-03-30T13:11:37.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48f0200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f48e80d2d20 con 0x7f48e81601e0 2024-03-30T13:11:37.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48f0200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f48e80d5070 con 0x7f48cc004d40 2024-03-30T13:11:37.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48ece00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e80b5bc0 0x7f48e81596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48ece00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e80b5bc0 0x7f48e81596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44964/0 (socket says 172.21.15.99:44964) 2024-03-30T13:11:37.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48ece00640 1 -- 172.21.15.99:0/4104882841 learned_addr learned my addr 172.21.15.99:0/4104882841 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:37.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48ee200640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48e81601e0 0x7f48e8160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48ece00640 1 -- 172.21.15.99:0/4104882841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48cc004d40 msgr2=0x7f48e80b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48ed800640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48cc004d40 0x7f48e80b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48ece00640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48cc004d40 0x7f48e80b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48ece00640 1 -- 172.21.15.99:0/4104882841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48e81601e0 msgr2=0x7f48e8160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48ece00640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48e81601e0 0x7f48e8160660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.218+0000 7f48ece00640 1 -- 172.21.15.99:0/4104882841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e80b4110 con 0x7f48e80b5bc0 2024-03-30T13:11:37.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.219+0000 7f48ece00640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e80b5bc0 0x7f48e81596b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48d400f350 tx=0x7f48d400f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.219+0000 7f48e5600640 1 -- 172.21.15.99:0/4104882841 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d401c070 con 0x7f48e80b5bc0 2024-03-30T13:11:37.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.219+0000 7f48e5600640 1 -- 172.21.15.99:0/4104882841 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d4017600 con 0x7f48e80b5bc0 2024-03-30T13:11:37.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.219+0000 7f48e5600640 1 -- 172.21.15.99:0/4104882841 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d40179f0 con 0x7f48e80b5bc0 2024-03-30T13:11:37.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.219+0000 7f48f0200640 1 -- 172.21.15.99:0/4104882841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e80ccee0 con 0x7f48e80b5bc0 2024-03-30T13:11:37.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.219+0000 7f48f0200640 1 -- 172.21.15.99:0/4104882841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e8159bf0 con 0x7f48e80b5bc0 2024-03-30T13:11:37.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.220+0000 7f48f0200640 1 -- 172.21.15.99:0/4104882841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48e80a2560 con 0x7f48e80b5bc0 2024-03-30T13:11:37.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.221+0000 7f48e5600640 1 -- 172.21.15.99:0/4104882841 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f48d4005d10 con 0x7f48e80b5bc0 2024-03-30T13:11:37.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.222+0000 7f48e5600640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c806c560 0x7f48c806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.222+0000 7f48e5600640 1 -- 172.21.15.99:0/4104882841 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f48d408beb0 con 0x7f48e80b5bc0 2024-03-30T13:11:37.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.222+0000 7f48ed800640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c806c560 0x7f48c806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.223+0000 7f48ed800640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c806c560 0x7f48c806ea20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f48d8000fd0 tx=0x7f48d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.227+0000 7f48e5600640 1 -- 172.21.15.99:0/4104882841 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f48d4012070 con 0x7f48e80b5bc0 2024-03-30T13:11:37.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.425+0000 7f48f0200640 1 -- 172.21.15.99:0/4104882841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f48e804f9d0 con 0x7f48e80b5bc0 2024-03-30T13:11:37.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.426+0000 7f48e5600640 1 -- 172.21.15.99:0/4104882841 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f48d405a440 con 0x7f48e80b5bc0 2024-03-30T13:11:37.430 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:37.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 -- 172.21.15.99:0/4104882841 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c806c560 msgr2=0x7f48c806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c806c560 0x7f48c806ea20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f48d8000fd0 tx=0x7f48d8009040 comp rx=0 tx=0).stop 2024-03-30T13:11:37.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 -- 172.21.15.99:0/4104882841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e80b5bc0 msgr2=0x7f48e81596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e80b5bc0 0x7f48e81596b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48d400f350 tx=0x7f48d400f810 comp rx=0 tx=0).stop 2024-03-30T13:11:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 -- 172.21.15.99:0/4104882841 shutdown_connections 2024-03-30T13:11:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c806c560 0x7f48c806ea20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48e81601e0 0x7f48e8160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e80b5bc0 0x7f48e81596b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 --2- 172.21.15.99:0/4104882841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48cc004d40 0x7f48e80b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 -- 172.21.15.99:0/4104882841 >> 172.21.15.99:0/4104882841 conn(0x7f48e808bfc0 msgr2=0x7f48e80b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 -- 172.21.15.99:0/4104882841 shutdown_connections 2024-03-30T13:11:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.429+0000 7f48f0200640 1 -- 172.21.15.99:0/4104882841 wait complete. 2024-03-30T13:11:37.452 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.654+0000 7f56ab200640 1 Processor -- start 2024-03-30T13:11:37.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.654+0000 7f56ab200640 1 -- start start 2024-03-30T13:11:37.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.656+0000 7f56ab200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56ac1425f0 0x7f56ac15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.656+0000 7f56ab200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f56ac06c520 0x7f56ac06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.656+0000 7f56ab200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56ac15d8d0 con 0x7f56ac0b4dc0 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.656+0000 7f56ab200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f56ac0b3af0 con 0x7f56ac06c520 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.656+0000 7f56ab200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f56ac0b3d90 con 0x7f56ac1425f0 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.656+0000 7f56a9400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f56ac06c520 0x7f56ac06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.656+0000 7f56aa800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f56ac0b4dc0 0x7f56ac0b5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34694/0 (socket says 172.21.15.99:34694) 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.656+0000 7f56aa800640 1 -- 172.21.15.99:0/4021480747 learned_addr learned my addr 172.21.15.99:0/4021480747 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.657+0000 7f56a9e00640 1 --2- 172.21.15.99:0/4021480747 >> v2:172.21.15.181:3300/0 conn(0x7f56ac1425f0 0x7f56ac15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.657+0000 7f56a9400640 1 -- 172.21.15.99:0/4021480747 >> v2:172.21.15.181:3300/0 conn(0x7f56ac1425f0 msgr2=0x7f56ac15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.657+0000 7f56a9400640 1 --2- 172.21.15.99:0/4021480747 >> v2:172.21.15.181:3300/0 conn(0x7f56ac1425f0 0x7f56ac15d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.657+0000 7f56a9400640 1 -- 172.21.15.99:0/4021480747 >> v1:172.21.15.99:6789/0 conn(0x7f56ac0b4dc0 legacy=0x7f56ac0b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.657+0000 7f56a9400640 1 -- 172.21.15.99:0/4021480747 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac0b4070 con 0x7f56ac06c520 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.657+0000 7f56a8a00640 1 -- 172.21.15.99:0/4021480747 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364278105 0 0) 0x7f56a4001490 con 0x7f56ac0b4dc0 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.658+0000 7f56a9400640 1 --2- 172.21.15.99:0/4021480747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56ac06c520 0x7f56ac06c9b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0b4d90 tx=0x7f569802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11c8a84cd24591 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.658+0000 7f56a8a00640 1 -- 172.21.15.99:0/4021480747 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5698035020 con 0x7f56ac06c520 2024-03-30T13:11:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.658+0000 7f56a8a00640 1 -- 172.21.15.99:0/4021480747 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5698031830 con 0x7f56ac06c520 2024-03-30T13:11:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.658+0000 7f56a8a00640 1 -- 172.21.15.99:0/4021480747 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5698031c00 con 0x7f56ac06c520 2024-03-30T13:11:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.659+0000 7f56ab200640 1 -- 172.21.15.99:0/4021480747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56ac06c520 msgr2=0x7f56ac06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.659+0000 7f56ab200640 1 --2- 172.21.15.99:0/4021480747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56ac06c520 0x7f56ac06c9b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0b4d90 tx=0x7f569802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.659+0000 7f56ab200640 1 -- 172.21.15.99:0/4021480747 shutdown_connections 2024-03-30T13:11:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.659+0000 7f56ab200640 1 --2- 172.21.15.99:0/4021480747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56ac06c520 0x7f56ac06c9b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.659+0000 7f56ab200640 1 --2- 172.21.15.99:0/4021480747 >> v2:172.21.15.181:3300/0 conn(0x7f56ac1425f0 0x7f56ac15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.659+0000 7f56ab200640 1 -- 172.21.15.99:0/4021480747 >> 172.21.15.99:0/4021480747 conn(0x7f56ac071eb0 msgr2=0x7f56ac0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.659+0000 7f56ab200640 1 -- 172.21.15.99:0/4021480747 shutdown_connections 2024-03-30T13:11:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.659+0000 7f56ab200640 1 -- 172.21.15.99:0/4021480747 wait complete. 2024-03-30T13:11:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.661+0000 7f56ab200640 1 Processor -- start 2024-03-30T13:11:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.661+0000 7f56ab200640 1 -- start start 2024-03-30T13:11:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.662+0000 7f56ab200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56ac06c520 0x7f56ac06e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.662+0000 7f56ab200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56ac0b4dc0 0x7f56ac06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.662+0000 7f56ab200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56ac1425f0 0x7f56ac15eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.662+0000 7f56ab200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac0b4910 con 0x7f56ac06c520 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.662+0000 7f56ab200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac0b4630 con 0x7f56ac0b4dc0 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.662+0000 7f56ab200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f56ac1429d0 con 0x7f56ac1425f0 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.662+0000 7f56a9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56ac06c520 0x7f56ac06e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.662+0000 7f56a9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56ac06c520 0x7f56ac06e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44970/0 (socket says 172.21.15.99:44970) 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.662+0000 7f56a9e00640 1 -- 172.21.15.99:0/3254804849 learned_addr learned my addr 172.21.15.99:0/3254804849 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.663+0000 7f56a9e00640 1 -- 172.21.15.99:0/3254804849 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56ac1425f0 msgr2=0x7f56ac15eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.663+0000 7f56a9e00640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56ac1425f0 0x7f56ac15eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.663+0000 7f56a9e00640 1 -- 172.21.15.99:0/3254804849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56ac0b4dc0 msgr2=0x7f56ac06efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.663+0000 7f56a9e00640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56ac0b4dc0 0x7f56ac06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.663+0000 7f56a9e00640 1 -- 172.21.15.99:0/3254804849 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac06f4e0 con 0x7f56ac06c520 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.663+0000 7f56a9e00640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56ac06c520 0x7f56ac06e0f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f569c00d800 tx=0x7f569c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.663+0000 7f56a2000640 1 -- 172.21.15.99:0/3254804849 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c00b6c0 con 0x7f56ac06c520 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.663+0000 7f56a2000640 1 -- 172.21.15.99:0/3254804849 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f569c019070 con 0x7f56ac06c520 2024-03-30T13:11:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.663+0000 7f56a2000640 1 -- 172.21.15.99:0/3254804849 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c00ba60 con 0x7f56ac06c520 2024-03-30T13:11:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.663+0000 7f56ab200640 1 -- 172.21.15.99:0/3254804849 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac1f43c0 con 0x7f56ac06c520 2024-03-30T13:11:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.663+0000 7f56ab200640 1 -- 172.21.15.99:0/3254804849 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac1f4980 con 0x7f56ac06c520 2024-03-30T13:11:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.665+0000 7f56ab200640 1 -- 172.21.15.99:0/3254804849 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ac04f8f0 con 0x7f56ac06c520 2024-03-30T13:11:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.665+0000 7f56a2000640 1 -- 172.21.15.99:0/3254804849 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f569c00bc00 con 0x7f56ac06c520 2024-03-30T13:11:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.666+0000 7f56a2000640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f568c06c530 0x7f568c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.666+0000 7f56a2000640 1 -- 172.21.15.99:0/3254804849 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f569c08bbf0 con 0x7f56ac06c520 2024-03-30T13:11:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.666+0000 7f56a9400640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f568c06c530 0x7f568c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.667+0000 7f56a9400640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f568c06c530 0x7f568c06e9f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5698036000 tx=0x7f5698030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.670+0000 7f56a2000640 1 -- 172.21.15.99:0/3254804849 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f569c05a1d0 con 0x7f56ac06c520 2024-03-30T13:11:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.870+0000 7f56ab200640 1 -- 172.21.15.99:0/3254804849 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f56ac140fc0 con 0x7f56ac06c520 2024-03-30T13:11:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.871+0000 7f56a2000640 1 -- 172.21.15.99:0/3254804849 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f569c059ad0 con 0x7f56ac06c520 2024-03-30T13:11:37.875 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.873+0000 7f56ab200640 1 -- 172.21.15.99:0/3254804849 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f568c06c530 msgr2=0x7f568c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.873+0000 7f56ab200640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f568c06c530 0x7f568c06e9f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5698036000 tx=0x7f5698030000 comp rx=0 tx=0).stop 2024-03-30T13:11:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.873+0000 7f56ab200640 1 -- 172.21.15.99:0/3254804849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56ac06c520 msgr2=0x7f56ac06e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.873+0000 7f56ab200640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56ac06c520 0x7f56ac06e0f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f569c00d800 tx=0x7f569c00dcc0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.873+0000 7f56ab200640 1 -- 172.21.15.99:0/3254804849 shutdown_connections 2024-03-30T13:11:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.873+0000 7f56ab200640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f568c06c530 0x7f568c06e9f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.873+0000 7f56ab200640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56ac1425f0 0x7f56ac15eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.873+0000 7f56ab200640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56ac0b4dc0 0x7f56ac06efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.873+0000 7f56ab200640 1 --2- 172.21.15.99:0/3254804849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56ac06c520 0x7f56ac06e0f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.873+0000 7f56ab200640 1 -- 172.21.15.99:0/3254804849 >> 172.21.15.99:0/3254804849 conn(0x7f56ac071eb0 msgr2=0x7f56ac140420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.874+0000 7f56ab200640 1 -- 172.21.15.99:0/3254804849 shutdown_connections 2024-03-30T13:11:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:37.874+0000 7f56ab200640 1 -- 172.21.15.99:0/3254804849 wait complete. 2024-03-30T13:11:37.898 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:38.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.100+0000 7f99efc00640 1 Processor -- start 2024-03-30T13:11:38.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.101+0000 7f99efc00640 1 -- start start 2024-03-30T13:11:38.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.103+0000 7f99efc00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f99e815c760 0x7f99e80d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.103+0000 7f99efc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f99e809b640 0x7f99e809bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.103+0000 7f99efc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99e80d11d0 con 0x7f99e80af2b0 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.103+0000 7f99efc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f99e809ab60 con 0x7f99e809b640 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.103+0000 7f99efc00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f99e809ae40 con 0x7f99e815c760 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.104+0000 7f99e7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f99e809b640 0x7f99e809bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.104+0000 7f99edc00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f99e80af2b0 0x7f99e8160410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34704/0 (socket says 172.21.15.99:34704) 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.104+0000 7f99edc00640 1 -- 172.21.15.99:0/3728940175 learned_addr learned my addr 172.21.15.99:0/3728940175 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.104+0000 7f99ed200640 1 --2- 172.21.15.99:0/3728940175 >> v2:172.21.15.181:3300/0 conn(0x7f99e815c760 0x7f99e80d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.104+0000 7f99e7400640 1 -- 172.21.15.99:0/3728940175 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 638845513 0 0) 0x7f99e80d11d0 con 0x7f99e80af2b0 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.104+0000 7f99e7400640 1 -- 172.21.15.99:0/3728940175 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99d0003520 con 0x7f99e80af2b0 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.104+0000 7f99e7e00640 1 -- 172.21.15.99:0/3728940175 >> v2:172.21.15.181:3300/0 conn(0x7f99e815c760 msgr2=0x7f99e80d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.104+0000 7f99e7e00640 1 --2- 172.21.15.99:0/3728940175 >> v2:172.21.15.181:3300/0 conn(0x7f99e815c760 0x7f99e80d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.104+0000 7f99e7e00640 1 -- 172.21.15.99:0/3728940175 >> v1:172.21.15.99:6789/0 conn(0x7f99e80af2b0 legacy=0x7f99e8160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.105+0000 7f99e7e00640 1 -- 172.21.15.99:0/3728940175 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e809b120 con 0x7f99e809b640 2024-03-30T13:11:38.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.106+0000 7f99e7e00640 1 --2- 172.21.15.99:0/3728940175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99e809b640 0x7f99e809bad0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f99e80723b0 tx=0x7f99d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62ebd59146b1562 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.106+0000 7f99e7400640 1 -- 172.21.15.99:0/3728940175 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d40315a0 con 0x7f99e809b640 2024-03-30T13:11:38.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.107+0000 7f99e7400640 1 -- 172.21.15.99:0/3728940175 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d4037070 con 0x7f99e809b640 2024-03-30T13:11:38.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.107+0000 7f99e7400640 1 -- 172.21.15.99:0/3728940175 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d4031960 con 0x7f99e809b640 2024-03-30T13:11:38.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.107+0000 7f99efc00640 1 -- 172.21.15.99:0/3728940175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99e809b640 msgr2=0x7f99e809bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.107+0000 7f99efc00640 1 --2- 172.21.15.99:0/3728940175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99e809b640 0x7f99e809bad0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f99e80723b0 tx=0x7f99d402b840 comp rx=0 tx=0).stop 2024-03-30T13:11:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.107+0000 7f99efc00640 1 -- 172.21.15.99:0/3728940175 shutdown_connections 2024-03-30T13:11:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.107+0000 7f99efc00640 1 --2- 172.21.15.99:0/3728940175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99e809b640 0x7f99e809bad0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.107+0000 7f99efc00640 1 --2- 172.21.15.99:0/3728940175 >> v2:172.21.15.181:3300/0 conn(0x7f99e815c760 0x7f99e80d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.107+0000 7f99efc00640 1 -- 172.21.15.99:0/3728940175 >> 172.21.15.99:0/3728940175 conn(0x7f99e80d24c0 msgr2=0x7f99e80d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.107+0000 7f99efc00640 1 -- 172.21.15.99:0/3728940175 shutdown_connections 2024-03-30T13:11:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.107+0000 7f99efc00640 1 -- 172.21.15.99:0/3728940175 wait complete. 2024-03-30T13:11:38.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.109+0000 7f99efc00640 1 Processor -- start 2024-03-30T13:11:38.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.109+0000 7f99efc00640 1 -- start start 2024-03-30T13:11:38.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.110+0000 7f99efc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99e809b640 0x7f99e815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.110+0000 7f99efc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99e80af2b0 0x7f99e806c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.110+0000 7f99efc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99e815c760 0x7f99e80c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.110+0000 7f99efc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f99e815ccc0 con 0x7f99e80af2b0 2024-03-30T13:11:38.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.110+0000 7f99efc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f99e815cb40 con 0x7f99e809b640 2024-03-30T13:11:38.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.110+0000 7f99efc00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f99e80af6c0 con 0x7f99e815c760 2024-03-30T13:11:38.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.110+0000 7f99e7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99e80af2b0 0x7f99e806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.111+0000 7f99e7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99e80af2b0 0x7f99e806c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44984/0 (socket says 172.21.15.99:44984) 2024-03-30T13:11:38.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.111+0000 7f99e7e00640 1 -- 172.21.15.99:0/2764226846 learned_addr learned my addr 172.21.15.99:0/2764226846 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:38.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.111+0000 7f99ed200640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99e809b640 0x7f99e815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.111+0000 7f99edc00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99e815c760 0x7f99e80c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.111+0000 7f99e7e00640 1 -- 172.21.15.99:0/2764226846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99e815c760 msgr2=0x7f99e80c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.111+0000 7f99e7e00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99e815c760 0x7f99e80c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.111+0000 7f99e7e00640 1 -- 172.21.15.99:0/2764226846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99e809b640 msgr2=0x7f99e815ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.111+0000 7f99e7e00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99e809b640 0x7f99e815ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.111+0000 7f99e7e00640 1 -- 172.21.15.99:0/2764226846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e806d0e0 con 0x7f99e80af2b0 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.111+0000 7f99edc00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99e815c760 0x7f99e80c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.111+0000 7f99e7e00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99e80af2b0 0x7f99e806c620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009890 tx=0x7f99d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.112+0000 7f99e4c00640 1 -- 172.21.15.99:0/2764226846 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d4032630 con 0x7f99e80af2b0 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.112+0000 7f99e4c00640 1 -- 172.21.15.99:0/2764226846 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d40327d0 con 0x7f99e80af2b0 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.112+0000 7f99efc00640 1 -- 172.21.15.99:0/2764226846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e806d3c0 con 0x7f99e80af2b0 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.112+0000 7f99e4c00640 1 -- 172.21.15.99:0/2764226846 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d4032bc0 con 0x7f99e80af2b0 2024-03-30T13:11:38.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.112+0000 7f99efc00640 1 -- 172.21.15.99:0/2764226846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e806d980 con 0x7f99e80af2b0 2024-03-30T13:11:38.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.113+0000 7f99efc00640 1 -- 172.21.15.99:0/2764226846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e809b320 con 0x7f99e80af2b0 2024-03-30T13:11:38.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.114+0000 7f99e4c00640 1 -- 172.21.15.99:0/2764226846 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f99d403b3f0 con 0x7f99e80af2b0 2024-03-30T13:11:38.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.115+0000 7f99e4c00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f99c806c530 0x7f99c806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.116+0000 7f99e4c00640 1 -- 172.21.15.99:0/2764226846 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f99d402f030 con 0x7f99e80af2b0 2024-03-30T13:11:38.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.116+0000 7f99ed200640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f99c806c530 0x7f99c806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.116+0000 7f99ed200640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f99c806c530 0x7f99c806e9f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99dc006fd0 tx=0x7f99dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.119+0000 7f99e4c00640 1 -- 172.21.15.99:0/2764226846 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f99e809b320 con 0x7f99e80af2b0 2024-03-30T13:11:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.321+0000 7f99efc00640 1 -- 172.21.15.99:0/2764226846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f99e804f9d0 con 0x7f99e80af2b0 2024-03-30T13:11:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.321+0000 7f99e4c00640 1 -- 172.21.15.99:0/2764226846 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f99d4040070 con 0x7f99e80af2b0 2024-03-30T13:11:38.326 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:38.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 -- 172.21.15.99:0/2764226846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f99c806c530 msgr2=0x7f99c806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f99c806c530 0x7f99c806e9f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99dc006fd0 tx=0x7f99dc008040 comp rx=0 tx=0).stop 2024-03-30T13:11:38.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 -- 172.21.15.99:0/2764226846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99e80af2b0 msgr2=0x7f99e806c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99e80af2b0 0x7f99e806c620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009890 tx=0x7f99d40046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 -- 172.21.15.99:0/2764226846 shutdown_connections 2024-03-30T13:11:38.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f99c806c530 0x7f99c806e9f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99e815c760 0x7f99e80c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99e80af2b0 0x7f99e806c620 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 --2- 172.21.15.99:0/2764226846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99e809b640 0x7f99e815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 -- 172.21.15.99:0/2764226846 >> 172.21.15.99:0/2764226846 conn(0x7f99e80d24c0 msgr2=0x7f99e806faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 -- 172.21.15.99:0/2764226846 shutdown_connections 2024-03-30T13:11:38.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.324+0000 7f99efc00640 1 -- 172.21.15.99:0/2764226846 wait complete. 2024-03-30T13:11:38.348 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:11:38.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.545+0000 7f1b5fe00640 1 Processor -- start 2024-03-30T13:11:38.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.545+0000 7f1b5fe00640 1 -- start start 2024-03-30T13:11:38.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.546+0000 7f1b5fe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580d0ba0 0x7f1b58160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.546+0000 7f1b5fe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5806e300 con 0x7f1b58156ba0 2024-03-30T13:11:38.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.546+0000 7f1b5fe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5806e5e0 con 0x7f1b5815d630 2024-03-30T13:11:38.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.546+0000 7f1b5fe00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5815ce50 con 0x7f1b580d0ba0 2024-03-30T13:11:38.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.547+0000 7f1b5d400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1b58156ba0 0x7f1b5806d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34706/0 (socket says 172.21.15.99:34706) 2024-03-30T13:11:38.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.547+0000 7f1b5d400640 1 -- 172.21.15.99:0/4124281070 learned_addr learned my addr 172.21.15.99:0/4124281070 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:38.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.547+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677529109 0 0) 0x7f1b5806e300 con 0x7f1b58156ba0 2024-03-30T13:11:38.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.547+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b40003520 con 0x7f1b58156ba0 2024-03-30T13:11:38.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.547+0000 7f1b5de00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580d0ba0 0x7f1b58160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.547+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3521976006 0 0) 0x7f1b40003520 con 0x7f1b58156ba0 2024-03-30T13:11:38.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.547+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580d0ba0 msgr2=0x7f1b58160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b57e00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580d0ba0 0x7f1b58160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 >> v1:172.21.15.181:6789/0 conn(0x7f1b5815d630 legacy=0x7f1b580d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5815d130 con 0x7f1b58156ba0 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f1b4c001670 con 0x7f1b58156ba0 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 >> v1:172.21.15.99:6789/0 conn(0x7f1b58156ba0 legacy=0x7f1b5806d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b57e00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580d0ba0 0x7f1b400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b57e00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b40004060 0x7f1b40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b57e00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5815ce50 con 0x7f1b40004d40 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4000bca0 con 0x7f1b40004060 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4000bea0 con 0x7f1b580d0ba0 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b5de00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.548+0000 7f1b5ca00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b40004060 0x7f1b40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.549+0000 7f1b5de00640 1 -- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580d0ba0 msgr2=0x7f1b400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.549+0000 7f1b5d400640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580d0ba0 0x7f1b400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.549+0000 7f1b5de00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580d0ba0 0x7f1b400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.549+0000 7f1b5de00640 1 -- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b40004060 msgr2=0x7f1b40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:38.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.549+0000 7f1b5de00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b40004060 0x7f1b40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.549+0000 7f1b5de00640 1 -- 172.21.15.99:0/4124281070 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b40003520 con 0x7f1b40004d40 2024-03-30T13:11:38.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.549+0000 7f1b5d400640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580d0ba0 0x7f1b400039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:38.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.549+0000 7f1b5ca00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b40004060 0x7f1b40004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:38.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.550+0000 7f1b5de00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1b50007360 tx=0x7f1b40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f08cc8bd94429a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.550+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b50039070 con 0x7f1b40004d40 2024-03-30T13:11:38.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.550+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5002ccd0 con 0x7f1b40004d40 2024-03-30T13:11:38.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.550+0000 7f1b57e00640 1 -- 172.21.15.99:0/4124281070 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b50009be0 con 0x7f1b40004d40 2024-03-30T13:11:38.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.551+0000 7f1b5fe00640 1 -- 172.21.15.99:0/4124281070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40004d40 msgr2=0x7f1b400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.551+0000 7f1b5fe00640 1 --2- 172.21.15.99:0/4124281070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1b50007360 tx=0x7f1b40005830 comp rx=0 tx=0).stop 2024-03-30T13:11:38.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.551+0000 7f1b5de00640 1 -- 172.21.15.99:0/4124281070 reap_dead start 2024-03-30T13:11:38.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.551+0000 7f1b5fe00640 1 -- 172.21.15.99:0/4124281070 shutdown_connections 2024-03-30T13:11:38.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.551+0000 7f1b5fe00640 1 -- 172.21.15.99:0/4124281070 >> 172.21.15.99:0/4124281070 conn(0x7f1b5806b6f0 msgr2=0x7f1b5806bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.551+0000 7f1b5fe00640 1 -- 172.21.15.99:0/4124281070 shutdown_connections 2024-03-30T13:11:38.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.551+0000 7f1b5fe00640 1 -- 172.21.15.99:0/4124281070 wait complete. 2024-03-30T13:11:38.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.553+0000 7f1b5fe00640 1 Processor -- start 2024-03-30T13:11:38.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.553+0000 7f1b5fe00640 1 -- start start 2024-03-30T13:11:38.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.554+0000 7f1b5fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b58099910 0x7f1b580b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.554+0000 7f1b5fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b580b1b50 0x7f1b580afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.554+0000 7f1b5fe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580b02f0 0x7f1b580b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.554+0000 7f1b5fe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1b580ad3d0 con 0x7f1b580b1b50 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.554+0000 7f1b5fe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5815dac0 con 0x7f1b58099910 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.554+0000 7f1b5fe00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1b58156f80 con 0x7f1b580b02f0 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.554+0000 7f1b5ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b580b1b50 0x7f1b580afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.554+0000 7f1b5ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b580b1b50 0x7f1b580afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45012/0 (socket says 172.21.15.99:45012) 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.554+0000 7f1b5ca00640 1 -- 172.21.15.99:0/3024876415 learned_addr learned my addr 172.21.15.99:0/3024876415 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.555+0000 7f1b5d400640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b58099910 0x7f1b580b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.555+0000 7f1b5ca00640 1 -- 172.21.15.99:0/3024876415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580b02f0 msgr2=0x7f1b580b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.555+0000 7f1b5ca00640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580b02f0 0x7f1b580b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.555+0000 7f1b5ca00640 1 -- 172.21.15.99:0/3024876415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b58099910 msgr2=0x7f1b580b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.555+0000 7f1b5ca00640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b58099910 0x7f1b580b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.555+0000 7f1b5ca00640 1 -- 172.21.15.99:0/3024876415 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b580b2390 con 0x7f1b580b1b50 2024-03-30T13:11:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.555+0000 7f1b5ca00640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b580b1b50 0x7f1b580afdb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400e4d0 tx=0x7f1b4400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.555+0000 7f1b55600640 1 -- 172.21.15.99:0/3024876415 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b440052e0 con 0x7f1b580b1b50 2024-03-30T13:11:38.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.555+0000 7f1b55600640 1 -- 172.21.15.99:0/3024876415 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b44018070 con 0x7f1b580b1b50 2024-03-30T13:11:38.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.555+0000 7f1b55600640 1 -- 172.21.15.99:0/3024876415 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b44003830 con 0x7f1b580b1b50 2024-03-30T13:11:38.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.555+0000 7f1b5fe00640 1 -- 172.21.15.99:0/3024876415 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b580b2670 con 0x7f1b580b1b50 2024-03-30T13:11:38.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.556+0000 7f1b5fe00640 1 -- 172.21.15.99:0/3024876415 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b580b2c30 con 0x7f1b580b1b50 2024-03-30T13:11:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.557+0000 7f1b5fe00640 1 -- 172.21.15.99:0/3024876415 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b58068640 con 0x7f1b580b1b50 2024-03-30T13:11:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.558+0000 7f1b55600640 1 -- 172.21.15.99:0/3024876415 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1b440039d0 con 0x7f1b580b1b50 2024-03-30T13:11:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.559+0000 7f1b55600640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1b3806c560 0x7f1b3806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.559+0000 7f1b55600640 1 -- 172.21.15.99:0/3024876415 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f1b4408b3c0 con 0x7f1b580b1b50 2024-03-30T13:11:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.559+0000 7f1b5d400640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1b3806c560 0x7f1b3806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:38.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.560+0000 7f1b5d400640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1b3806c560 0x7f1b3806ea20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c001eb0 tx=0x7f1b4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.563+0000 7f1b55600640 1 -- 172.21.15.99:0/3024876415 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1b44059920 con 0x7f1b580b1b50 2024-03-30T13:11:38.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.775+0000 7f1b5fe00640 1 -- 172.21.15.99:0/3024876415 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1b5806f070 con 0x7f1b580b1b50 2024-03-30T13:11:38.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.776+0000 7f1b55600640 1 -- 172.21.15.99:0/3024876415 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f1b44059220 con 0x7f1b580b1b50 2024-03-30T13:11:38.780 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.778+0000 7f1b5fe00640 1 -- 172.21.15.99:0/3024876415 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1b3806c560 msgr2=0x7f1b3806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.778+0000 7f1b5fe00640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1b3806c560 0x7f1b3806ea20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c001eb0 tx=0x7f1b4c009040 comp rx=0 tx=0).stop 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.778+0000 7f1b5fe00640 1 -- 172.21.15.99:0/3024876415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b580b1b50 msgr2=0x7f1b580afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.778+0000 7f1b5fe00640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b580b1b50 0x7f1b580afdb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400e4d0 tx=0x7f1b4400e990 comp rx=0 tx=0).stop 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.779+0000 7f1b5fe00640 1 -- 172.21.15.99:0/3024876415 shutdown_connections 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.779+0000 7f1b5fe00640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1b3806c560 0x7f1b3806ea20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.779+0000 7f1b5fe00640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b580b02f0 0x7f1b580b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.779+0000 7f1b5fe00640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b580b1b50 0x7f1b580afdb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.779+0000 7f1b5fe00640 1 --2- 172.21.15.99:0/3024876415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b58099910 0x7f1b580b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.779+0000 7f1b5fe00640 1 -- 172.21.15.99:0/3024876415 >> 172.21.15.99:0/3024876415 conn(0x7f1b5806b6f0 msgr2=0x7f1b580b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.779+0000 7f1b5fe00640 1 -- 172.21.15.99:0/3024876415 shutdown_connections 2024-03-30T13:11:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:38.779+0000 7f1b5fe00640 1 -- 172.21.15.99:0/3024876415 wait complete. 2024-03-30T13:11:38.802 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-30T13:11:38.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:38.802 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-30T13:11:38.886 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:11:38.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:38.886 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-30T13:11:38.933 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:11:38.933 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:38.989 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:11:38.990 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:39.045 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:11:39.045 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:39.097 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:39.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.297+0000 7f2e3e400640 1 Processor -- start 2024-03-30T13:11:39.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.297+0000 7f2e3e400640 1 -- start start 2024-03-30T13:11:39.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.298+0000 7f2e3e400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e3806f060 0x7f2e3806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.298+0000 7f2e3e400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e38146230 con 0x7f2e3815c670 2024-03-30T13:11:39.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.299+0000 7f2e3e400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e3806dfc0 con 0x7f2e380ad940 2024-03-30T13:11:39.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.299+0000 7f2e3e400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3806e2a0 con 0x7f2e3806f060 2024-03-30T13:11:39.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.299+0000 7f2e37400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2e3815c670 0x7f2e380ad230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34714/0 (socket says 172.21.15.99:34714) 2024-03-30T13:11:39.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.299+0000 7f2e37400640 1 -- 172.21.15.99:0/3022413985 learned_addr learned my addr 172.21.15.99:0/3022413985 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:39.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.299+0000 7f2e37e00640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e3806f060 0x7f2e3806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.299+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297481068 0 0) 0x7f2e28001110 con 0x7f2e3815c670 2024-03-30T13:11:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.299+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e1c003520 con 0x7f2e3815c670 2024-03-30T13:11:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2604018123 0 0) 0x7f2e1c003520 con 0x7f2e3815c670 2024-03-30T13:11:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e3806f060 msgr2=0x7f2e3806c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e3806f060 0x7f2e3806c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 >> v1:172.21.15.181:6789/0 conn(0x7f2e380ad940 legacy=0x7f2e380b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3806e580 con 0x7f2e3815c670 2024-03-30T13:11:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f2e28001840 con 0x7f2e3815c670 2024-03-30T13:11:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 >> v1:172.21.15.99:6789/0 conn(0x7f2e3815c670 legacy=0x7f2e380ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e1c0039e0 0x7f2e1c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e1c004800 0x7f2e1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e3806f060 0x7f2e1c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3806e2a0 con 0x7f2e1c004800 2024-03-30T13:11:39.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c00baf0 con 0x7f2e1c0039e0 2024-03-30T13:11:39.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1c00bcf0 con 0x7f2e3806f060 2024-03-30T13:11:39.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.300+0000 7f2e36a00640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e1c004800 0x7f2e1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.301+0000 7f2e37400640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e1c0039e0 0x7f2e1c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.301+0000 7f2e37e00640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e3806f060 0x7f2e1c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.301+0000 7f2e36a00640 1 -- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e3806f060 msgr2=0x7f2e1c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.301+0000 7f2e36a00640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e3806f060 0x7f2e1c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.301+0000 7f2e36a00640 1 -- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e1c0039e0 msgr2=0x7f2e1c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.301+0000 7f2e36a00640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e1c0039e0 0x7f2e1c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.301+0000 7f2e36a00640 1 -- 172.21.15.99:0/3022413985 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c003520 con 0x7f2e1c004800 2024-03-30T13:11:39.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.301+0000 7f2e37400640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e1c0039e0 0x7f2e1c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:39.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.301+0000 7f2e37e00640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e3806f060 0x7f2e1c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:39.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.302+0000 7f2e36a00640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e1c004800 0x7f2e1c004c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2e24001750 tx=0x7f2e1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3947aaaebb0fa1a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.302+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24001370 con 0x7f2e1c004800 2024-03-30T13:11:39.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.302+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e240052d0 con 0x7f2e1c004800 2024-03-30T13:11:39.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.302+0000 7f2e36000640 1 -- 172.21.15.99:0/3022413985 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24003830 con 0x7f2e1c004800 2024-03-30T13:11:39.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.303+0000 7f2e3e400640 1 -- 172.21.15.99:0/3022413985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e1c004800 msgr2=0x7f2e1c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.303+0000 7f2e3e400640 1 --2- 172.21.15.99:0/3022413985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e1c004800 0x7f2e1c004c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2e24001750 tx=0x7f2e1c005830 comp rx=0 tx=0).stop 2024-03-30T13:11:39.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.303+0000 7f2e37e00640 1 -- 172.21.15.99:0/3022413985 reap_dead start 2024-03-30T13:11:39.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.303+0000 7f2e3e400640 1 -- 172.21.15.99:0/3022413985 shutdown_connections 2024-03-30T13:11:39.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.303+0000 7f2e3e400640 1 -- 172.21.15.99:0/3022413985 >> 172.21.15.99:0/3022413985 conn(0x7f2e3806b510 msgr2=0x7f2e3806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:39.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.303+0000 7f2e3e400640 1 -- 172.21.15.99:0/3022413985 shutdown_connections 2024-03-30T13:11:39.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.303+0000 7f2e3e400640 1 -- 172.21.15.99:0/3022413985 wait complete. 2024-03-30T13:11:39.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.305+0000 7f2e3e400640 1 Processor -- start 2024-03-30T13:11:39.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.305+0000 7f2e3e400640 1 -- start start 2024-03-30T13:11:39.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.306+0000 7f2e3e400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e1c004800 0x7f2e3815f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.306+0000 7f2e3e400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e38160630 0x7f2e381f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.306+0000 7f2e3e400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e380cb810 0x7f2e380cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e3e400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3806c030 con 0x7f2e38160630 2024-03-30T13:11:39.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e3e400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3815ca50 con 0x7f2e1c004800 2024-03-30T13:11:39.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e3e400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3806c1b0 con 0x7f2e380cb810 2024-03-30T13:11:39.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e36a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e38160630 0x7f2e381f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e36a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e38160630 0x7f2e381f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45034/0 (socket says 172.21.15.99:45034) 2024-03-30T13:11:39.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e36a00640 1 -- 172.21.15.99:0/1976282044 learned_addr learned my addr 172.21.15.99:0/1976282044 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e37400640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e1c004800 0x7f2e3815f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e37e00640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e380cb810 0x7f2e380cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e36a00640 1 -- 172.21.15.99:0/1976282044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e380cb810 msgr2=0x7f2e380cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e36a00640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e380cb810 0x7f2e380cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e36a00640 1 -- 172.21.15.99:0/1976282044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e1c004800 msgr2=0x7f2e3815f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e36a00640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e1c004800 0x7f2e3815f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.307+0000 7f2e36a00640 1 -- 172.21.15.99:0/1976282044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e381f46a0 con 0x7f2e38160630 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.308+0000 7f2e36a00640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e38160630 0x7f2e381f4160 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2e24005040 tx=0x7f2e24001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.308+0000 7f2e2f400640 1 -- 172.21.15.99:0/1976282044 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24041070 con 0x7f2e38160630 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.308+0000 7f2e2f400640 1 -- 172.21.15.99:0/1976282044 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e24005480 con 0x7f2e38160630 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.308+0000 7f2e3e400640 1 -- 172.21.15.99:0/1976282044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3815f7c0 con 0x7f2e38160630 2024-03-30T13:11:39.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.308+0000 7f2e2f400640 1 -- 172.21.15.99:0/1976282044 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24001370 con 0x7f2e38160630 2024-03-30T13:11:39.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.308+0000 7f2e3e400640 1 -- 172.21.15.99:0/1976282044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3815cd70 con 0x7f2e38160630 2024-03-30T13:11:39.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.309+0000 7f2e3e400640 1 -- 172.21.15.99:0/1976282044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e38068640 con 0x7f2e38160630 2024-03-30T13:11:39.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.311+0000 7f2e2f400640 1 -- 172.21.15.99:0/1976282044 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2e24044070 con 0x7f2e38160630 2024-03-30T13:11:39.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.312+0000 7f2e2f400640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2e1806c560 0x7f2e1806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.312+0000 7f2e2f400640 1 -- 172.21.15.99:0/1976282044 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f2e240ad110 con 0x7f2e38160630 2024-03-30T13:11:39.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.312+0000 7f2e37400640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2e1806c560 0x7f2e1806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.313+0000 7f2e37400640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2e1806c560 0x7f2e1806ea20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2e28000ff0 tx=0x7f2e28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.317+0000 7f2e2f400640 1 -- 172.21.15.99:0/1976282044 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2e2407b670 con 0x7f2e38160630 2024-03-30T13:11:39.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.517+0000 7f2e3e400640 1 -- 172.21.15.99:0/1976282044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e3806f570 con 0x7f2e38160630 2024-03-30T13:11:39.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.518+0000 7f2e2f400640 1 -- 172.21.15.99:0/1976282044 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16658 (secure 0 0 0) 0x7f2e2407af70 con 0x7f2e38160630 2024-03-30T13:11:39.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:39.523 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:26.555726+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.38","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:39.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.520+0000 7f2e3e400640 1 -- 172.21.15.99:0/1976282044 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2e1806c560 msgr2=0x7f2e1806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.520+0000 7f2e3e400640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2e1806c560 0x7f2e1806ea20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2e28000ff0 tx=0x7f2e28009040 comp rx=0 tx=0).stop 2024-03-30T13:11:39.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.521+0000 7f2e3e400640 1 -- 172.21.15.99:0/1976282044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e38160630 msgr2=0x7f2e381f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.521+0000 7f2e3e400640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e38160630 0x7f2e381f4160 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2e24005040 tx=0x7f2e24001120 comp rx=0 tx=0).stop 2024-03-30T13:11:39.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.521+0000 7f2e3e400640 1 -- 172.21.15.99:0/1976282044 shutdown_connections 2024-03-30T13:11:39.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.521+0000 7f2e3e400640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2e1806c560 0x7f2e1806ea20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.521+0000 7f2e3e400640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e380cb810 0x7f2e380cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.521+0000 7f2e3e400640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e38160630 0x7f2e381f4160 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.521+0000 7f2e3e400640 1 --2- 172.21.15.99:0/1976282044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e1c004800 0x7f2e3815f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.521+0000 7f2e3e400640 1 -- 172.21.15.99:0/1976282044 >> 172.21.15.99:0/1976282044 conn(0x7f2e3806b510 msgr2=0x7f2e380b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.521+0000 7f2e3e400640 1 -- 172.21.15.99:0/1976282044 shutdown_connections 2024-03-30T13:11:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.521+0000 7f2e3e400640 1 -- 172.21.15.99:0/1976282044 wait complete. 2024-03-30T13:11:39.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:39.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:39.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.752+0000 7fce07800640 1 Processor -- start 2024-03-30T13:11:39.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.752+0000 7fce07800640 1 -- start start 2024-03-30T13:11:39.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.754+0000 7fce07800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fce0015b3d0 0x7fce000ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.754+0000 7fce07800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce000b49f0 0x7fce000b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.754+0000 7fce07800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce000c6470 con 0x7fce000b21b0 2024-03-30T13:11:39.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.754+0000 7fce07800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fce000c6240 con 0x7fce0015b3d0 2024-03-30T13:11:39.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.754+0000 7fce07800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fce000c7080 con 0x7fce000b49f0 2024-03-30T13:11:39.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.754+0000 7fce05800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fce000b21b0 0x7fce0015be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34720/0 (socket says 172.21.15.99:34720) 2024-03-30T13:11:39.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.754+0000 7fce05800640 1 -- 172.21.15.99:0/832929199 learned_addr learned my addr 172.21.15.99:0/832929199 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:39.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fce04e00640 1 --2- 172.21.15.99:0/832929199 >> v2:172.21.15.181:3300/0 conn(0x7fce0015b3d0 0x7fce000ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdf7e00640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce000b49f0 0x7fce000b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614153577 0 0) 0x7fce000c6470 con 0x7fce000b21b0 2024-03-30T13:11:39.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcde4003520 con 0x7fce000b21b0 2024-03-30T13:11:39.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2589727358 0 0) 0x7fcde4003520 con 0x7fce000b21b0 2024-03-30T13:11:39.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce000b49f0 msgr2=0x7fce000b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce000b49f0 0x7fce000b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 >> v2:172.21.15.181:3300/0 conn(0x7fce0015b3d0 msgr2=0x7fce000ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 --2- 172.21.15.99:0/832929199 >> v2:172.21.15.181:3300/0 conn(0x7fce0015b3d0 0x7fce000ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce000c6750 con 0x7fce000b21b0 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fcdf80019f0 con 0x7fce000b21b0 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 >> v1:172.21.15.99:6789/0 conn(0x7fce000b21b0 legacy=0x7fce0015be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce000b49f0 0x7fcde40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcde4003f80 0x7fcde4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde4004d40 0x7fcde40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fce000c7080 con 0x7fcde4004d40 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcde400b9c0 con 0x7fcde4003f80 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.755+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcde400bb40 con 0x7fce000b49f0 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.756+0000 7fce05800640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde4004d40 0x7fcde40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.756+0000 7fcdf7e00640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcde4003f80 0x7fcde4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.756+0000 7fce05800640 1 -- 172.21.15.99:0/832929199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce000b49f0 msgr2=0x7fcde40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.756+0000 7fce04e00640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce000b49f0 0x7fcde40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.756+0000 7fce05800640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce000b49f0 0x7fcde40039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.756+0000 7fce05800640 1 -- 172.21.15.99:0/832929199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcde4003f80 msgr2=0x7fcde4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.756+0000 7fce05800640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcde4003f80 0x7fcde4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.756+0000 7fce05800640 1 -- 172.21.15.99:0/832929199 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde4003520 con 0x7fcde4004d40 2024-03-30T13:11:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.757+0000 7fce05800640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde4004d40 0x7fcde40051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800a7e0 tx=0x7fcde4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f268c7af307c105f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.757+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800a3d0 con 0x7fcde4004d40 2024-03-30T13:11:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.757+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf8034650 con 0x7fcde4004d40 2024-03-30T13:11:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.757+0000 7fcdffe00640 1 -- 172.21.15.99:0/832929199 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8034a80 con 0x7fcde4004d40 2024-03-30T13:11:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.758+0000 7fce07800640 1 -- 172.21.15.99:0/832929199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde4004d40 msgr2=0x7fcde40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.758+0000 7fce07800640 1 --2- 172.21.15.99:0/832929199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde4004d40 0x7fcde40051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800a7e0 tx=0x7fcde4005830 comp rx=0 tx=0).stop 2024-03-30T13:11:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.758+0000 7fce05800640 1 -- 172.21.15.99:0/832929199 reap_dead start 2024-03-30T13:11:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.758+0000 7fce07800640 1 -- 172.21.15.99:0/832929199 shutdown_connections 2024-03-30T13:11:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.758+0000 7fce07800640 1 -- 172.21.15.99:0/832929199 >> 172.21.15.99:0/832929199 conn(0x7fce000d0450 msgr2=0x7fce000d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.758+0000 7fce07800640 1 -- 172.21.15.99:0/832929199 shutdown_connections 2024-03-30T13:11:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.758+0000 7fce07800640 1 -- 172.21.15.99:0/832929199 wait complete. 2024-03-30T13:11:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.760+0000 7fce07800640 1 Processor -- start 2024-03-30T13:11:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.760+0000 7fce07800640 1 -- start start 2024-03-30T13:11:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.761+0000 7fce07800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce00150980 0x7fce000ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.761+0000 7fce07800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce000afd30 0x7fce000b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.761+0000 7fce07800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce00159c10 0x7fce0015a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.761+0000 7fce07800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fce0015b7b0 con 0x7fce00150980 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.761+0000 7fce07800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fce000c6d10 con 0x7fce000afd30 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.761+0000 7fce07800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fce0015b930 con 0x7fce00159c10 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.761+0000 7fce04e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce00150980 0x7fce000ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.761+0000 7fce04e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce00150980 0x7fce000ad670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45050/0 (socket says 172.21.15.99:45050) 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.761+0000 7fce04e00640 1 -- 172.21.15.99:0/2095080857 learned_addr learned my addr 172.21.15.99:0/2095080857 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.762+0000 7fcdf7e00640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce000afd30 0x7fce000b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.762+0000 7fce05800640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce00159c10 0x7fce0015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.762+0000 7fce04e00640 1 -- 172.21.15.99:0/2095080857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce00159c10 msgr2=0x7fce0015a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.762+0000 7fce04e00640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce00159c10 0x7fce0015a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.762+0000 7fce04e00640 1 -- 172.21.15.99:0/2095080857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce000afd30 msgr2=0x7fce000b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.762+0000 7fce04e00640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce000afd30 0x7fce000b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.762+0000 7fce04e00640 1 -- 172.21.15.99:0/2095080857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce000b0510 con 0x7fce00150980 2024-03-30T13:11:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.762+0000 7fce04e00640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce00150980 0x7fce000ad670 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00108e0 tx=0x7fcdf0010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.762+0000 7fcdfd600640 1 -- 172.21.15.99:0/2095080857 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf000f040 con 0x7fce00150980 2024-03-30T13:11:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.762+0000 7fcdfd600640 1 -- 172.21.15.99:0/2095080857 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf000eb60 con 0x7fce00150980 2024-03-30T13:11:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.763+0000 7fcdfd600640 1 -- 172.21.15.99:0/2095080857 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf001c400 con 0x7fce00150980 2024-03-30T13:11:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.763+0000 7fce07800640 1 -- 172.21.15.99:0/2095080857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce000b07f0 con 0x7fce00150980 2024-03-30T13:11:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.763+0000 7fce07800640 1 -- 172.21.15.99:0/2095080857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce000b0db0 con 0x7fce00150980 2024-03-30T13:11:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.764+0000 7fce07800640 1 -- 172.21.15.99:0/2095080857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce0009e520 con 0x7fce00150980 2024-03-30T13:11:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.765+0000 7fcdfd600640 1 -- 172.21.15.99:0/2095080857 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcdf001c5a0 con 0x7fce00150980 2024-03-30T13:11:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.766+0000 7fcdfd600640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcddc06c530 0x7fcddc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.766+0000 7fcdfd600640 1 -- 172.21.15.99:0/2095080857 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fcdf008bfe0 con 0x7fce00150980 2024-03-30T13:11:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.766+0000 7fcdf7e00640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcddc06c530 0x7fcddc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.767+0000 7fcdf7e00640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcddc06c530 0x7fcddc06e9f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce0015f020 tx=0x7fcde8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:39.773+0000 7fcdfd600640 1 -- 172.21.15.99:0/2095080857 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcdf0018030 con 0x7fce00150980 2024-03-30T13:11:40.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.038+0000 7fce07800640 1 -- 172.21.15.99:0/2095080857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fce0004f9d0 con 0x7fce00150980 2024-03-30T13:11:40.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.039+0000 7fcdfd600640 1 -- 172.21.15.99:0/2095080857 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fcdf005a4d0 con 0x7fce00150980 2024-03-30T13:11:40.043 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:40.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 -- 172.21.15.99:0/2095080857 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcddc06c530 msgr2=0x7fcddc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcddc06c530 0x7fcddc06e9f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce0015f020 tx=0x7fcde8008040 comp rx=0 tx=0).stop 2024-03-30T13:11:40.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 -- 172.21.15.99:0/2095080857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce00150980 msgr2=0x7fce000ad670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce00150980 0x7fce000ad670 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00108e0 tx=0x7fcdf0010da0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 -- 172.21.15.99:0/2095080857 shutdown_connections 2024-03-30T13:11:40.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcddc06c530 0x7fcddc06e9f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fce00159c10 0x7fce0015a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce000afd30 0x7fce000b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 --2- 172.21.15.99:0/2095080857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce00150980 0x7fce000ad670 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 -- 172.21.15.99:0/2095080857 >> 172.21.15.99:0/2095080857 conn(0x7fce000d0450 msgr2=0x7fce000af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:40.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 -- 172.21.15.99:0/2095080857 shutdown_connections 2024-03-30T13:11:40.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.042+0000 7fce07800640 1 -- 172.21.15.99:0/2095080857 wait complete. 2024-03-30T13:11:40.066 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:40.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.272+0000 7ffaf8e00640 1 Processor -- start 2024-03-30T13:11:40.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.273+0000 7ffaf8e00640 1 -- start start 2024-03-30T13:11:40.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.274+0000 7ffaf8e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffaf40b2e20 0x7ffaf409b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.274+0000 7ffaf8e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffaf409b140 0x7ffaf40ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.274+0000 7ffaf8e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf40b32b0 con 0x7ffaf415fcd0 2024-03-30T13:11:40.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.274+0000 7ffaf8e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ffaf40d05c0 con 0x7ffaf40b2e20 2024-03-30T13:11:40.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.274+0000 7ffaf8e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf40d08a0 con 0x7ffaf409b140 2024-03-30T13:11:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.274+0000 7ffaf1400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffaf40b2e20 0x7ffaf409b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.274+0000 7ffaf1400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffaf40b2e20 0x7ffaf409b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45066/0 (socket says 172.21.15.99:45066) 2024-03-30T13:11:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.274+0000 7ffaf1400640 1 -- 172.21.15.99:0/4106249763 learned_addr learned my addr 172.21.15.99:0/4106249763 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.274+0000 7ffaf2800640 1 --2- 172.21.15.99:0/4106249763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffaf409b140 0x7ffaf40ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.275+0000 7ffaf1400640 1 -- 172.21.15.99:0/4106249763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffaf409b140 msgr2=0x7ffaf40ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.275+0000 7ffaf1400640 1 --2- 172.21.15.99:0/4106249763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffaf409b140 0x7ffaf40ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.275+0000 7ffaf1400640 1 -- 172.21.15.99:0/4106249763 >> v1:172.21.15.181:6789/0 conn(0x7ffaf415fcd0 legacy=0x7ffaf409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:40.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.275+0000 7ffaf1400640 1 -- 172.21.15.99:0/4106249763 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf40d0b80 con 0x7ffaf40b2e20 2024-03-30T13:11:40.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.276+0000 7ffaf1400640 1 --2- 172.21.15.99:0/4106249763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf40b2e20 0x7ffaf409b9a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009870 tx=0x7ffae002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f437f74cbbbdafe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:40.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.276+0000 7ffaf0a00640 1 -- 172.21.15.99:0/4106249763 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0035020 con 0x7ffaf40b2e20 2024-03-30T13:11:40.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.276+0000 7ffaf0a00640 1 -- 172.21.15.99:0/4106249763 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffae0031640 con 0x7ffaf40b2e20 2024-03-30T13:11:40.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.276+0000 7ffaf0a00640 1 -- 172.21.15.99:0/4106249763 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae002d040 con 0x7ffaf40b2e20 2024-03-30T13:11:40.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.277+0000 7ffaf8e00640 1 -- 172.21.15.99:0/4106249763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf40b2e20 msgr2=0x7ffaf409b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.277+0000 7ffaf8e00640 1 --2- 172.21.15.99:0/4106249763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf40b2e20 0x7ffaf409b9a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009870 tx=0x7ffae002b8f0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.277+0000 7ffaf8e00640 1 -- 172.21.15.99:0/4106249763 shutdown_connections 2024-03-30T13:11:40.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.277+0000 7ffaf8e00640 1 --2- 172.21.15.99:0/4106249763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffaf409b140 0x7ffaf40ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.277+0000 7ffaf8e00640 1 --2- 172.21.15.99:0/4106249763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf40b2e20 0x7ffaf409b9a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.277+0000 7ffaf8e00640 1 -- 172.21.15.99:0/4106249763 >> 172.21.15.99:0/4106249763 conn(0x7ffaf40b3fa0 msgr2=0x7ffaf40b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.277+0000 7ffaf8e00640 1 -- 172.21.15.99:0/4106249763 shutdown_connections 2024-03-30T13:11:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.277+0000 7ffaf8e00640 1 -- 172.21.15.99:0/4106249763 wait complete. 2024-03-30T13:11:40.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.280+0000 7ffaf8e00640 1 Processor -- start 2024-03-30T13:11:40.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.280+0000 7ffaf8e00640 1 -- start start 2024-03-30T13:11:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.281+0000 7ffaf8e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffaf409b140 0x7ffaf41f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.281+0000 7ffaf8e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf415fcd0 0x7ffaf4159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.281+0000 7ffaf8e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffaf406d0b0 0x7ffaf415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.281+0000 7ffaf8e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf4160230 con 0x7ffaf415fcd0 2024-03-30T13:11:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.281+0000 7ffaf8e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf41600b0 con 0x7ffaf406d0b0 2024-03-30T13:11:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.281+0000 7ffaf8e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf40b1380 con 0x7ffaf409b140 2024-03-30T13:11:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.282+0000 7ffaf1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf415fcd0 0x7ffaf4159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.282+0000 7ffaf1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf415fcd0 0x7ffaf4159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45076/0 (socket says 172.21.15.99:45076) 2024-03-30T13:11:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.282+0000 7ffaf1400640 1 -- 172.21.15.99:0/2496390782 learned_addr learned my addr 172.21.15.99:0/2496390782 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.282+0000 7ffaf1e00640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffaf409b140 0x7ffaf41f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.282+0000 7ffaf2800640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffaf406d0b0 0x7ffaf415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.282+0000 7ffaf1400640 1 -- 172.21.15.99:0/2496390782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffaf409b140 msgr2=0x7ffaf41f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.282+0000 7ffaf1400640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffaf409b140 0x7ffaf41f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.282+0000 7ffaf1400640 1 -- 172.21.15.99:0/2496390782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffaf406d0b0 msgr2=0x7ffaf415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.282+0000 7ffaf1400640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffaf406d0b0 0x7ffaf415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.282+0000 7ffaf1400640 1 -- 172.21.15.99:0/2496390782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf406d900 con 0x7ffaf415fcd0 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.282+0000 7ffaf1e00640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffaf409b140 0x7ffaf41f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.283+0000 7ffaf1400640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf415fcd0 0x7ffaf4159570 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffae002b930 tx=0x7ffae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.283+0000 7ffaea000640 1 -- 172.21.15.99:0/2496390782 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0040070 con 0x7ffaf415fcd0 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.283+0000 7ffaea000640 1 -- 172.21.15.99:0/2496390782 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffae0039c10 con 0x7ffaf415fcd0 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.283+0000 7ffaea000640 1 -- 172.21.15.99:0/2496390782 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0035040 con 0x7ffaf415fcd0 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.283+0000 7ffaf8e00640 1 -- 172.21.15.99:0/2496390782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf406dbe0 con 0x7ffaf415fcd0 2024-03-30T13:11:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.283+0000 7ffaf8e00640 1 -- 172.21.15.99:0/2496390782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf406e1a0 con 0x7ffaf415fcd0 2024-03-30T13:11:40.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.284+0000 7ffaf8e00640 1 -- 172.21.15.99:0/2496390782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf4068720 con 0x7ffaf415fcd0 2024-03-30T13:11:40.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.285+0000 7ffaea000640 1 -- 172.21.15.99:0/2496390782 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ffae0038020 con 0x7ffaf415fcd0 2024-03-30T13:11:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.286+0000 7ffaea000640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffad406c560 0x7ffad406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.286+0000 7ffaea000640 1 -- 172.21.15.99:0/2496390782 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7ffae00ad360 con 0x7ffaf415fcd0 2024-03-30T13:11:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.287+0000 7ffaf1e00640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffad406c560 0x7ffad406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.287+0000 7ffaf1e00640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffad406c560 0x7ffad406ea20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffae400a830 tx=0x7ffae4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:40.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.292+0000 7ffaea000640 1 -- 172.21.15.99:0/2496390782 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ffaf4068720 con 0x7ffaf415fcd0 2024-03-30T13:11:40.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.524+0000 7ffaf8e00640 1 -- 172.21.15.99:0/2496390782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffaf404f9d0 con 0x7ffaf415fcd0 2024-03-30T13:11:40.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.524+0000 7ffaea000640 1 -- 172.21.15.99:0/2496390782 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7ffae007b8c0 con 0x7ffaf415fcd0 2024-03-30T13:11:40.528 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:40.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 -- 172.21.15.99:0/2496390782 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffad406c560 msgr2=0x7ffad406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffad406c560 0x7ffad406ea20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffae400a830 tx=0x7ffae4008040 comp rx=0 tx=0).stop 2024-03-30T13:11:40.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 -- 172.21.15.99:0/2496390782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf415fcd0 msgr2=0x7ffaf4159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf415fcd0 0x7ffaf4159570 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffae002b930 tx=0x7ffae00046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 -- 172.21.15.99:0/2496390782 shutdown_connections 2024-03-30T13:11:40.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffad406c560 0x7ffad406ea20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffaf406d0b0 0x7ffaf415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf415fcd0 0x7ffaf4159570 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 --2- 172.21.15.99:0/2496390782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffaf409b140 0x7ffaf41f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 -- 172.21.15.99:0/2496390782 >> 172.21.15.99:0/2496390782 conn(0x7ffaf40b3fa0 msgr2=0x7ffaf40b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 -- 172.21.15.99:0/2496390782 shutdown_connections 2024-03-30T13:11:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.527+0000 7ffaf8e00640 1 -- 172.21.15.99:0/2496390782 wait complete. 2024-03-30T13:11:40.549 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:40.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.755+0000 7f2557e00640 1 Processor -- start 2024-03-30T13:11:40.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.755+0000 7f2557e00640 1 -- start start 2024-03-30T13:11:40.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.757+0000 7f2557e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f25580b5f60 0x7f25580b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.757+0000 7f2557e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f255806cce0 con 0x7f255815e7f0 2024-03-30T13:11:40.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.757+0000 7f2557e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25580cfae0 con 0x7f25580cf540 2024-03-30T13:11:40.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.757+0000 7f2557e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f25580d2c30 con 0x7f25580b5f60 2024-03-30T13:11:40.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.757+0000 7f2556a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f255815e7f0 0x7f25580d4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34730/0 (socket says 172.21.15.99:34730) 2024-03-30T13:11:40.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.757+0000 7f2556a00640 1 -- 172.21.15.99:0/3564603629 learned_addr learned my addr 172.21.15.99:0/3564603629 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:40.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.757+0000 7f2557400640 1 --2- 172.21.15.99:0/3564603629 >> v2:172.21.15.99:3300/0 conn(0x7f25580b5f60 0x7f25580b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.758+0000 7f2557400640 1 -- 172.21.15.99:0/3564603629 >> v1:172.21.15.181:6789/0 conn(0x7f25580cf540 legacy=0x7f255806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:40.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.758+0000 7f2557400640 1 -- 172.21.15.99:0/3564603629 >> v1:172.21.15.99:6789/0 conn(0x7f255815e7f0 legacy=0x7f25580d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.758+0000 7f2557400640 1 -- 172.21.15.99:0/3564603629 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25580cfdc0 con 0x7f25580b5f60 2024-03-30T13:11:40.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.759+0000 7f2557400640 1 --2- 172.21.15.99:0/3564603629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25580b5f60 0x7f25580b63f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f25500097a0 tx=0x7f255002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8389a84e76ed24a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:40.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.760+0000 7f2555600640 1 -- 172.21.15.99:0/3564603629 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550035020 con 0x7f25580b5f60 2024-03-30T13:11:40.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.760+0000 7f2555600640 1 -- 172.21.15.99:0/3564603629 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2550031830 con 0x7f25580b5f60 2024-03-30T13:11:40.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.760+0000 7f2555600640 1 -- 172.21.15.99:0/3564603629 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550031c00 con 0x7f25580b5f60 2024-03-30T13:11:40.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.760+0000 7f2557e00640 1 -- 172.21.15.99:0/3564603629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25580b5f60 msgr2=0x7f25580b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.760+0000 7f2557e00640 1 --2- 172.21.15.99:0/3564603629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25580b5f60 0x7f25580b63f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f25500097a0 tx=0x7f255002b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.760+0000 7f2557e00640 1 -- 172.21.15.99:0/3564603629 shutdown_connections 2024-03-30T13:11:40.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.760+0000 7f2557e00640 1 --2- 172.21.15.99:0/3564603629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25580b5f60 0x7f25580b63f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.760+0000 7f2557e00640 1 -- 172.21.15.99:0/3564603629 >> 172.21.15.99:0/3564603629 conn(0x7f255809d7f0 msgr2=0x7f25580d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:40.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.761+0000 7f2557e00640 1 -- 172.21.15.99:0/3564603629 shutdown_connections 2024-03-30T13:11:40.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.761+0000 7f2557e00640 1 -- 172.21.15.99:0/3564603629 wait complete. 2024-03-30T13:11:40.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.763+0000 7f2557e00640 1 Processor -- start 2024-03-30T13:11:40.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.763+0000 7f2557e00640 1 -- start start 2024-03-30T13:11:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.764+0000 7f2557e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25580b5f60 0x7f25581618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.764+0000 7f2557e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25580cf540 0x7f25580c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.764+0000 7f2557e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255815e7f0 0x7f255815f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.764+0000 7f2557e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f25580d2570 con 0x7f255815e7f0 2024-03-30T13:11:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.764+0000 7f2557e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f255815ebd0 con 0x7f25580cf540 2024-03-30T13:11:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.764+0000 7f2557e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f25580d30c0 con 0x7f25580b5f60 2024-03-30T13:11:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.765+0000 7f2557400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255815e7f0 0x7f255815f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.765+0000 7f2557400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255815e7f0 0x7f255815f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45100/0 (socket says 172.21.15.99:45100) 2024-03-30T13:11:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.765+0000 7f2557400640 1 -- 172.21.15.99:0/545567909 learned_addr learned my addr 172.21.15.99:0/545567909 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.765+0000 7f2556000640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25580cf540 0x7f25580c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.765+0000 7f2556a00640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25580b5f60 0x7f25581618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.765+0000 7f2557400640 1 -- 172.21.15.99:0/545567909 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25580b5f60 msgr2=0x7f25581618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.765+0000 7f2557400640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25580b5f60 0x7f25581618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.765+0000 7f2557400640 1 -- 172.21.15.99:0/545567909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25580cf540 msgr2=0x7f25580c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.765+0000 7f2557400640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25580cf540 0x7f25580c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.765+0000 7f2557400640 1 -- 172.21.15.99:0/545567909 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25580c8d60 con 0x7f255815e7f0 2024-03-30T13:11:40.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.766+0000 7f2557400640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255815e7f0 0x7f255815f950 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f25500098c0 tx=0x7f25500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:40.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.766+0000 7f254ea00640 1 -- 172.21.15.99:0/545567909 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550041070 con 0x7f255815e7f0 2024-03-30T13:11:40.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.766+0000 7f254ea00640 1 -- 172.21.15.99:0/545567909 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255003a8d0 con 0x7f255815e7f0 2024-03-30T13:11:40.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.766+0000 7f254ea00640 1 -- 172.21.15.99:0/545567909 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550035040 con 0x7f255815e7f0 2024-03-30T13:11:40.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.766+0000 7f2557e00640 1 -- 172.21.15.99:0/545567909 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25580c9040 con 0x7f255815e7f0 2024-03-30T13:11:40.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.766+0000 7f2557e00640 1 -- 172.21.15.99:0/545567909 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255815fe90 con 0x7f255815e7f0 2024-03-30T13:11:40.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.768+0000 7f2557e00640 1 -- 172.21.15.99:0/545567909 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f255804f8f0 con 0x7f255815e7f0 2024-03-30T13:11:40.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.769+0000 7f254ea00640 1 -- 172.21.15.99:0/545567909 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2550038020 con 0x7f255815e7f0 2024-03-30T13:11:40.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.770+0000 7f254ea00640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f253406c530 0x7f253406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.770+0000 7f254ea00640 1 -- 172.21.15.99:0/545567909 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f25500ad1e0 con 0x7f255815e7f0 2024-03-30T13:11:40.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.771+0000 7f2556a00640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f253406c530 0x7f253406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.771+0000 7f2556a00640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f253406c530 0x7f253406e9f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f255815b670 tx=0x7f2548009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:40.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:40.776+0000 7f254ea00640 1 -- 172.21.15.99:0/545567909 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f255007b0f0 con 0x7f255815e7f0 2024-03-30T13:11:41.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.105+0000 7f2557e00640 1 -- 172.21.15.99:0/545567909 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f25580b3630 con 0x7f255815e7f0 2024-03-30T13:11:41.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.106+0000 7f254ea00640 1 -- 172.21.15.99:0/545567909 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f255007f3f0 con 0x7f255815e7f0 2024-03-30T13:11:41.110 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:41.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.109+0000 7f2557e00640 1 -- 172.21.15.99:0/545567909 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f253406c530 msgr2=0x7f253406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.109+0000 7f2557e00640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f253406c530 0x7f253406e9f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f255815b670 tx=0x7f2548009040 comp rx=0 tx=0).stop 2024-03-30T13:11:41.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.110+0000 7f2557e00640 1 -- 172.21.15.99:0/545567909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255815e7f0 msgr2=0x7f255815f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.110+0000 7f2557e00640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255815e7f0 0x7f255815f950 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f25500098c0 tx=0x7f25500046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.110+0000 7f2557e00640 1 -- 172.21.15.99:0/545567909 shutdown_connections 2024-03-30T13:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.110+0000 7f2557e00640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f253406c530 0x7f253406e9f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.110+0000 7f2557e00640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255815e7f0 0x7f255815f950 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.110+0000 7f2557e00640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25580cf540 0x7f25580c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.110+0000 7f2557e00640 1 --2- 172.21.15.99:0/545567909 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25580b5f60 0x7f25581618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.110+0000 7f2557e00640 1 -- 172.21.15.99:0/545567909 >> 172.21.15.99:0/545567909 conn(0x7f255809d7f0 msgr2=0x7f25580b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.110+0000 7f2557e00640 1 -- 172.21.15.99:0/545567909 shutdown_connections 2024-03-30T13:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.110+0000 7f2557e00640 1 -- 172.21.15.99:0/545567909 wait complete. 2024-03-30T13:11:41.133 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:11:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.333+0000 7f4313c00640 1 Processor -- start 2024-03-30T13:11:41.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.333+0000 7f4313c00640 1 -- start start 2024-03-30T13:11:41.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.335+0000 7f4313c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f430c15d630 0x7f430c0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:41.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.335+0000 7f4313c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c0d09d0 0x7f430c160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:41.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.335+0000 7f4313c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f430c06e300 con 0x7f430c156ba0 2024-03-30T13:11:41.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.335+0000 7f4313c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f430c0d0e10 con 0x7f430c15d630 2024-03-30T13:11:41.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.335+0000 7f4313c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f430c06e5e0 con 0x7f430c0d09d0 2024-03-30T13:11:41.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.336+0000 7f4311c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c0d09d0 0x7f430c160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:41.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.336+0000 7f4311c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c0d09d0 0x7f430c160180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:39636/0 (socket says 172.21.15.99:39636) 2024-03-30T13:11:41.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.336+0000 7f4311c00640 1 -- 172.21.15.99:0/2934880622 learned_addr learned my addr 172.21.15.99:0/2934880622 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:41.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.336+0000 7f430be00640 1 --2- 172.21.15.99:0/2934880622 >> v2:172.21.15.181:3300/0 conn(0x7f430c15d630 0x7f430c0d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:41.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.337+0000 7f430b400640 1 -- 172.21.15.99:0/2934880622 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 61216820 0 0) 0x7f430c06e300 con 0x7f430c156ba0 2024-03-30T13:11:41.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.337+0000 7f430be00640 1 -- 172.21.15.99:0/2934880622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c0d09d0 msgr2=0x7f430c160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:41.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.337+0000 7f430be00640 1 --2- 172.21.15.99:0/2934880622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c0d09d0 0x7f430c160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.337+0000 7f430be00640 1 -- 172.21.15.99:0/2934880622 >> v1:172.21.15.181:6789/0 conn(0x7f430c156ba0 legacy=0x7f430c06d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.337+0000 7f430be00640 1 -- 172.21.15.99:0/2934880622 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c15ce50 con 0x7f430c15d630 2024-03-30T13:11:41.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.338+0000 7f430be00640 1 --2- 172.21.15.99:0/2934880622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f430c15d630 0x7f430c0d0490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097a0 tx=0x7f42f802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3c9ce149ccdcb37 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:41.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.339+0000 7f430b400640 1 -- 172.21.15.99:0/2934880622 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f80315a0 con 0x7f430c15d630 2024-03-30T13:11:41.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.339+0000 7f430b400640 1 -- 172.21.15.99:0/2934880622 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f8037070 con 0x7f430c15d630 2024-03-30T13:11:41.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.339+0000 7f430b400640 1 -- 172.21.15.99:0/2934880622 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8031960 con 0x7f430c15d630 2024-03-30T13:11:41.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.339+0000 7f4313c00640 1 -- 172.21.15.99:0/2934880622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f430c15d630 msgr2=0x7f430c0d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.339+0000 7f4313c00640 1 --2- 172.21.15.99:0/2934880622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f430c15d630 0x7f430c0d0490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097a0 tx=0x7f42f802b840 comp rx=0 tx=0).stop 2024-03-30T13:11:41.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.339+0000 7f4313c00640 1 -- 172.21.15.99:0/2934880622 shutdown_connections 2024-03-30T13:11:41.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.339+0000 7f4313c00640 1 --2- 172.21.15.99:0/2934880622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c0d09d0 0x7f430c160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.339+0000 7f4313c00640 1 --2- 172.21.15.99:0/2934880622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f430c15d630 0x7f430c0d0490 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.339+0000 7f4313c00640 1 -- 172.21.15.99:0/2934880622 >> 172.21.15.99:0/2934880622 conn(0x7f430c06b6f0 msgr2=0x7f430c06bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:41.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.340+0000 7f4313c00640 1 -- 172.21.15.99:0/2934880622 shutdown_connections 2024-03-30T13:11:41.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.340+0000 7f4313c00640 1 -- 172.21.15.99:0/2934880622 wait complete. 2024-03-30T13:11:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.342+0000 7f4313c00640 1 Processor -- start 2024-03-30T13:11:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.342+0000 7f4313c00640 1 -- start start 2024-03-30T13:11:41.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.343+0000 7f4313c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0d09d0 0x7f430c14e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:41.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.343+0000 7f4313c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f430c156ba0 0x7f430c0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:41.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.343+0000 7f4313c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c15d630 0x7f430c15b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.343+0000 7f4313c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f430c15dac0 con 0x7f430c0d09d0 2024-03-30T13:11:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.343+0000 7f4313c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f430c15cb40 con 0x7f430c156ba0 2024-03-30T13:11:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.343+0000 7f4313c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f430c0ad3d0 con 0x7f430c15d630 2024-03-30T13:11:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.343+0000 7f4311200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0d09d0 0x7f430c14e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.344+0000 7f4311200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0d09d0 0x7f430c14e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45116/0 (socket says 172.21.15.99:45116) 2024-03-30T13:11:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.344+0000 7f4311200640 1 -- 172.21.15.99:0/3604789637 learned_addr learned my addr 172.21.15.99:0/3604789637 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:41.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.344+0000 7f430be00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f430c156ba0 0x7f430c0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:41.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.344+0000 7f4311c00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c15d630 0x7f430c15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:41.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.344+0000 7f4311200640 1 -- 172.21.15.99:0/3604789637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c15d630 msgr2=0x7f430c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.344+0000 7f4311200640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c15d630 0x7f430c15b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.344+0000 7f4311200640 1 -- 172.21.15.99:0/3604789637 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f430c156ba0 msgr2=0x7f430c0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.344+0000 7f4311200640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f430c156ba0 0x7f430c0b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.344+0000 7f4311200640 1 -- 172.21.15.99:0/3604789637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c154070 con 0x7f430c0d09d0 2024-03-30T13:11:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.344+0000 7f4311c00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c15d630 0x7f430c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.344+0000 7f4311200640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0d09d0 0x7f430c14e8d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f430000c4b0 tx=0x7f430000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.345+0000 7f4308c00640 1 -- 172.21.15.99:0/3604789637 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300017070 con 0x7f430c0d09d0 2024-03-30T13:11:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.345+0000 7f4308c00640 1 -- 172.21.15.99:0/3604789637 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4300005480 con 0x7f430c0d09d0 2024-03-30T13:11:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.345+0000 7f4308c00640 1 -- 172.21.15.99:0/3604789637 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300003830 con 0x7f430c0d09d0 2024-03-30T13:11:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.345+0000 7f4313c00640 1 -- 172.21.15.99:0/3604789637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430c150b30 con 0x7f430c0d09d0 2024-03-30T13:11:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.345+0000 7f4313c00640 1 -- 172.21.15.99:0/3604789637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430c154330 con 0x7f430c0d09d0 2024-03-30T13:11:41.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.346+0000 7f4313c00640 1 -- 172.21.15.99:0/3604789637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430c068640 con 0x7f430c0d09d0 2024-03-30T13:11:41.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.347+0000 7f4308c00640 1 -- 172.21.15.99:0/3604789637 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f430001a070 con 0x7f430c0d09d0 2024-03-30T13:11:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.348+0000 7f4308c00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f42ec06c530 0x7f42ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.348+0000 7f4308c00640 1 -- 172.21.15.99:0/3604789637 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f430008aa90 con 0x7f430c0d09d0 2024-03-30T13:11:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.348+0000 7f430be00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f42ec06c530 0x7f42ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:41.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.349+0000 7f430be00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f42ec06c530 0x7f42ec06e9f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f42f8036000 tx=0x7f42f803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.352+0000 7f4308c00640 1 -- 172.21.15.99:0/3604789637 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4300058a40 con 0x7f430c0d09d0 2024-03-30T13:11:41.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.710+0000 7f4313c00640 1 -- 172.21.15.99:0/3604789637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f430c14ee20 con 0x7f430c0d09d0 2024-03-30T13:11:41.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.711+0000 7f4308c00640 1 -- 172.21.15.99:0/3604789637 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f430005cd40 con 0x7f430c0d09d0 2024-03-30T13:11:41.715 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-03-30T13:11:41.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.713+0000 7f4313c00640 1 -- 172.21.15.99:0/3604789637 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f42ec06c530 msgr2=0x7f42ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.713+0000 7f4313c00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f42ec06c530 0x7f42ec06e9f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f42f8036000 tx=0x7f42f803d040 comp rx=0 tx=0).stop 2024-03-30T13:11:41.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.713+0000 7f4313c00640 1 -- 172.21.15.99:0/3604789637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0d09d0 msgr2=0x7f430c14e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.713+0000 7f4313c00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0d09d0 0x7f430c14e8d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f430000c4b0 tx=0x7f430000c970 comp rx=0 tx=0).stop 2024-03-30T13:11:41.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.713+0000 7f4313c00640 1 -- 172.21.15.99:0/3604789637 shutdown_connections 2024-03-30T13:11:41.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.713+0000 7f4313c00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f42ec06c530 0x7f42ec06e9f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.713+0000 7f4313c00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f430c15d630 0x7f430c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.713+0000 7f4313c00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f430c156ba0 0x7f430c0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.713+0000 7f4313c00640 1 --2- 172.21.15.99:0/3604789637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0d09d0 0x7f430c14e8d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.713+0000 7f4313c00640 1 -- 172.21.15.99:0/3604789637 >> 172.21.15.99:0/3604789637 conn(0x7f430c06b6f0 msgr2=0x7f430c15e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:41.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.714+0000 7f4313c00640 1 -- 172.21.15.99:0/3604789637 shutdown_connections 2024-03-30T13:11:41.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:41.714+0000 7f4313c00640 1 -- 172.21.15.99:0/3604789637 wait complete. 2024-03-30T13:11:41.735 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-30T13:11:41.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:41.736 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-30T13:11:41.841 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:11:41.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:41.841 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-30T13:11:41.902 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:11:41.902 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:41.954 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:11:41.955 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:42.003 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:11:42.003 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:42.096 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:42.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.344+0000 7f7f2c000640 1 Processor -- start 2024-03-30T13:11:42.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.345+0000 7f7f2c000640 1 -- start start 2024-03-30T13:11:42.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.346+0000 7f7f2c000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f2415c670 0x7f7f2406c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.346+0000 7f7f2c000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7f240ad940 0x7f7f2406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.346+0000 7f7f2c000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f24146230 con 0x7f7f2406f060 2024-03-30T13:11:42.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.346+0000 7f7f2c000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2406dfc0 con 0x7f7f2415c670 2024-03-30T13:11:42.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.346+0000 7f7f2c000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2406e2a0 con 0x7f7f240ad940 2024-03-30T13:11:42.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.346+0000 7f7f29600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f2415c670 0x7f7f2406c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.346+0000 7f7f29600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f2415c670 0x7f7f2406c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45126/0 (socket says 172.21.15.99:45126) 2024-03-30T13:11:42.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.346+0000 7f7f29600640 1 -- 172.21.15.99:0/4146645232 learned_addr learned my addr 172.21.15.99:0/4146645232 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:42.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.347+0000 7f7f2a000640 1 --2- 172.21.15.99:0/4146645232 >> v2:172.21.15.181:3300/0 conn(0x7f7f240ad940 0x7f7f2406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.347+0000 7f7f29600640 1 -- 172.21.15.99:0/4146645232 >> v2:172.21.15.181:3300/0 conn(0x7f7f240ad940 msgr2=0x7f7f2406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:42.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.347+0000 7f7f29600640 1 --2- 172.21.15.99:0/4146645232 >> v2:172.21.15.181:3300/0 conn(0x7f7f240ad940 0x7f7f2406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.347+0000 7f7f29600640 1 -- 172.21.15.99:0/4146645232 >> v1:172.21.15.99:6789/0 conn(0x7f7f2406f060 legacy=0x7f7f240ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.347+0000 7f7f29600640 1 -- 172.21.15.99:0/4146645232 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2406e580 con 0x7f7f2415c670 2024-03-30T13:11:42.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.347+0000 7f7f2a000640 1 --2- 172.21.15.99:0/4146645232 >> v2:172.21.15.181:3300/0 conn(0x7f7f240ad940 0x7f7f2406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:42.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.348+0000 7f7f29600640 1 --2- 172.21.15.99:0/4146645232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f2415c670 0x7f7f2406c030 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7f2406fc20 tx=0x7f7f1802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c22036169913360 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:42.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.348+0000 7f7f23e00640 1 -- 172.21.15.99:0/4146645232 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1802ca80 con 0x7f7f2415c670 2024-03-30T13:11:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.348+0000 7f7f23e00640 1 -- 172.21.15.99:0/4146645232 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1802cc20 con 0x7f7f2415c670 2024-03-30T13:11:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.348+0000 7f7f23e00640 1 -- 172.21.15.99:0/4146645232 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f180343f0 con 0x7f7f2415c670 2024-03-30T13:11:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.349+0000 7f7f2c000640 1 -- 172.21.15.99:0/4146645232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f2415c670 msgr2=0x7f7f2406c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.349+0000 7f7f2c000640 1 --2- 172.21.15.99:0/4146645232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f2415c670 0x7f7f2406c030 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7f2406fc20 tx=0x7f7f1802bee0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.349+0000 7f7f2c000640 1 -- 172.21.15.99:0/4146645232 shutdown_connections 2024-03-30T13:11:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.349+0000 7f7f2c000640 1 --2- 172.21.15.99:0/4146645232 >> v2:172.21.15.181:3300/0 conn(0x7f7f240ad940 0x7f7f2406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.349+0000 7f7f2c000640 1 --2- 172.21.15.99:0/4146645232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f2415c670 0x7f7f2406c030 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.349+0000 7f7f2c000640 1 -- 172.21.15.99:0/4146645232 >> 172.21.15.99:0/4146645232 conn(0x7f7f2406b510 msgr2=0x7f7f2406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.349+0000 7f7f2c000640 1 -- 172.21.15.99:0/4146645232 shutdown_connections 2024-03-30T13:11:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.349+0000 7f7f2c000640 1 -- 172.21.15.99:0/4146645232 wait complete. 2024-03-30T13:11:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.351+0000 7f7f2c000640 1 Processor -- start 2024-03-30T13:11:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.351+0000 7f7f2c000640 1 -- start start 2024-03-30T13:11:42.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.352+0000 7f7f2c000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f2406f060 0x7f7f241f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.352+0000 7f7f2c000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f240ad940 0x7f7f241f1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.352+0000 7f7f2c000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f2415c670 0x7f7f2415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.352+0000 7f7f2c000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7f240b32c0 con 0x7f7f2406f060 2024-03-30T13:11:42.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.352+0000 7f7f2c000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2415ca50 con 0x7f7f240ad940 2024-03-30T13:11:42.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.352+0000 7f7f2c000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7f240b3440 con 0x7f7f2415c670 2024-03-30T13:11:42.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.352+0000 7f7f29600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f2406f060 0x7f7f241f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.352+0000 7f7f29600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f2406f060 0x7f7f241f80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45142/0 (socket says 172.21.15.99:45142) 2024-03-30T13:11:42.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.352+0000 7f7f29600640 1 -- 172.21.15.99:0/568269384 learned_addr learned my addr 172.21.15.99:0/568269384 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:42.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.353+0000 7f7f2a000640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f2415c670 0x7f7f2415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.353+0000 7f7f28c00640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f240ad940 0x7f7f241f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.353+0000 7f7f29600640 1 -- 172.21.15.99:0/568269384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f2415c670 msgr2=0x7f7f2415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.353+0000 7f7f29600640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f2415c670 0x7f7f2415e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.353+0000 7f7f29600640 1 -- 172.21.15.99:0/568269384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f240ad940 msgr2=0x7f7f241f1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.353+0000 7f7f29600640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f240ad940 0x7f7f241f1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.353+0000 7f7f29600640 1 -- 172.21.15.99:0/568269384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f241f42e0 con 0x7f7f2406f060 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.353+0000 7f7f2a000640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f2415c670 0x7f7f2415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.353+0000 7f7f28c00640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f240ad940 0x7f7f241f1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.353+0000 7f7f29600640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f2406f060 0x7f7f241f80f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7f18000f80 tx=0x7f7f18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.354+0000 7f7f21600640 1 -- 172.21.15.99:0/568269384 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f18043020 con 0x7f7f2406f060 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.354+0000 7f7f21600640 1 -- 172.21.15.99:0/568269384 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1803e450 con 0x7f7f2406f060 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.354+0000 7f7f21600640 1 -- 172.21.15.99:0/568269384 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1803e840 con 0x7f7f2406f060 2024-03-30T13:11:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.354+0000 7f7f2c000640 1 -- 172.21.15.99:0/568269384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f241f8630 con 0x7f7f2406f060 2024-03-30T13:11:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.354+0000 7f7f2c000640 1 -- 172.21.15.99:0/568269384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f241f4860 con 0x7f7f2406f060 2024-03-30T13:11:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.355+0000 7f7f2c000640 1 -- 172.21.15.99:0/568269384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f24068640 con 0x7f7f2406f060 2024-03-30T13:11:42.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.357+0000 7f7f21600640 1 -- 172.21.15.99:0/568269384 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7f18046020 con 0x7f7f2406f060 2024-03-30T13:11:42.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.358+0000 7f7f21600640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7f0406c530 0x7f7f0406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.358+0000 7f7f21600640 1 -- 172.21.15.99:0/568269384 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f7f180adfd0 con 0x7f7f2406f060 2024-03-30T13:11:42.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.359+0000 7f7f28c00640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7f0406c530 0x7f7f0406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.359+0000 7f7f28c00640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7f0406c530 0x7f7f0406e9f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7f2406c0c0 tx=0x7f7f10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:42.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.363+0000 7f7f21600640 1 -- 172.21.15.99:0/568269384 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7f1804d030 con 0x7f7f2406f060 2024-03-30T13:11:42.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.580+0000 7f7f2c000640 1 -- 172.21.15.99:0/568269384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f240ad230 con 0x7f7f2406f060 2024-03-30T13:11:42.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.582+0000 7f7f21600640 1 -- 172.21.15.99:0/568269384 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16658 (secure 0 0 0) 0x7f7f1807c780 con 0x7f7f2406f060 2024-03-30T13:11:42.587 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:42.587 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:26.555726+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.38","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.585+0000 7f7f2c000640 1 -- 172.21.15.99:0/568269384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7f0406c530 msgr2=0x7f7f0406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.586+0000 7f7f2c000640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7f0406c530 0x7f7f0406e9f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7f2406c0c0 tx=0x7f7f10009040 comp rx=0 tx=0).stop 2024-03-30T13:11:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.586+0000 7f7f2c000640 1 -- 172.21.15.99:0/568269384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f2406f060 msgr2=0x7f7f241f80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.586+0000 7f7f2c000640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f2406f060 0x7f7f241f80f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7f18000f80 tx=0x7f7f18004a40 comp rx=0 tx=0).stop 2024-03-30T13:11:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.586+0000 7f7f2c000640 1 -- 172.21.15.99:0/568269384 shutdown_connections 2024-03-30T13:11:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.586+0000 7f7f2c000640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7f0406c530 0x7f7f0406e9f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.586+0000 7f7f2c000640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f2415c670 0x7f7f2415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.586+0000 7f7f2c000640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f240ad940 0x7f7f241f1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.586+0000 7f7f2c000640 1 --2- 172.21.15.99:0/568269384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f2406f060 0x7f7f241f80f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.586+0000 7f7f2c000640 1 -- 172.21.15.99:0/568269384 >> 172.21.15.99:0/568269384 conn(0x7f7f2406b510 msgr2=0x7f7f240733b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.586+0000 7f7f2c000640 1 -- 172.21.15.99:0/568269384 shutdown_connections 2024-03-30T13:11:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.586+0000 7f7f2c000640 1 -- 172.21.15.99:0/568269384 wait complete. 2024-03-30T13:11:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:42.608 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:42.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.810+0000 7f6f27200640 1 Processor -- start 2024-03-30T13:11:42.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.810+0000 7f6f27200640 1 -- start start 2024-03-30T13:11:42.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.810+0000 7f6f27200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f280d4ab0 0x7f6f280d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.810+0000 7f6f27200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f280b3b00 con 0x7f6f2815eed0 2024-03-30T13:11:42.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.810+0000 7f6f27200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2815fc70 con 0x7f6f280b3720 2024-03-30T13:11:42.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.810+0000 7f6f27200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6f280d0b30 con 0x7f6f280d4ab0 2024-03-30T13:11:42.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.811+0000 7f6f26800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6f2815eed0 0x7f6f2815f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34744/0 (socket says 172.21.15.99:34744) 2024-03-30T13:11:42.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.811+0000 7f6f26800640 1 -- 172.21.15.99:0/2378562683 learned_addr learned my addr 172.21.15.99:0/2378562683 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:42.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.811+0000 7f6f1fe00640 1 --2- 172.21.15.99:0/2378562683 >> v2:172.21.15.181:3300/0 conn(0x7f6f280d4ab0 0x7f6f280d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.811+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396320414 0 0) 0x7f6f280b3b00 con 0x7f6f2815eed0 2024-03-30T13:11:42.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f0c003520 con 0x7f6f2815eed0 2024-03-30T13:11:42.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3933550142 0 0) 0x7f6f0c003520 con 0x7f6f2815eed0 2024-03-30T13:11:42.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 >> v2:172.21.15.181:3300/0 conn(0x7f6f280d4ab0 msgr2=0x7f6f280d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 --2- 172.21.15.99:0/2378562683 >> v2:172.21.15.181:3300/0 conn(0x7f6f280d4ab0 0x7f6f280d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 >> v1:172.21.15.181:6789/0 conn(0x7f6f280b3720 legacy=0x7f6f280d43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f280d0e10 con 0x7f6f2815eed0 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f6f200019f0 con 0x7f6f2815eed0 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 >> v1:172.21.15.99:6789/0 conn(0x7f6f2815eed0 legacy=0x7f6f2815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f0c003a30 0x7f6f0c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f0c004800 0x7f6f0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f0c0051c0 0x7f6f0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280d0b30 con 0x7f6f0c004800 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c00c0f0 con 0x7f6f0c003a30 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0c00c2f0 con 0x7f6f0c0051c0 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.812+0000 7f6f1fe00640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f0c004800 0x7f6f0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.813+0000 7f6f25e00640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f0c003a30 0x7f6f0c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.813+0000 7f6f26800640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f0c0051c0 0x7f6f0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.813+0000 7f6f1fe00640 1 -- 172.21.15.99:0/2378562683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f0c0051c0 msgr2=0x7f6f0c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.813+0000 7f6f1fe00640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f0c0051c0 0x7f6f0c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.813+0000 7f6f1fe00640 1 -- 172.21.15.99:0/2378562683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f0c003a30 msgr2=0x7f6f0c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.813+0000 7f6f1fe00640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f0c003a30 0x7f6f0c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.813+0000 7f6f1fe00640 1 -- 172.21.15.99:0/2378562683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0c003520 con 0x7f6f0c004800 2024-03-30T13:11:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.813+0000 7f6f26800640 1 -- 172.21.15.99:0/2378562683 reap_dead start 2024-03-30T13:11:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.813+0000 7f6f25e00640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f0c003a30 0x7f6f0c003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:42.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.814+0000 7f6f1fe00640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f0c004800 0x7f6f0c004c80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009ab0 tx=0x7f6f0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71a1880a8178f3d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:42.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.814+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10009680 con 0x7f6f0c004800 2024-03-30T13:11:42.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.814+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f10005990 con 0x7f6f0c004800 2024-03-30T13:11:42.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.814+0000 7f6f25400640 1 -- 172.21.15.99:0/2378562683 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10005d80 con 0x7f6f0c004800 2024-03-30T13:11:42.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.815+0000 7f6f27200640 1 -- 172.21.15.99:0/2378562683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f0c004800 msgr2=0x7f6f0c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.815+0000 7f6f27200640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f0c004800 0x7f6f0c004c80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009ab0 tx=0x7f6f0c005830 comp rx=0 tx=0).stop 2024-03-30T13:11:42.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.815+0000 7f6f27200640 1 -- 172.21.15.99:0/2378562683 shutdown_connections 2024-03-30T13:11:42.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.815+0000 7f6f27200640 1 --2- 172.21.15.99:0/2378562683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f0c004800 0x7f6f0c004c80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.815+0000 7f6f27200640 1 -- 172.21.15.99:0/2378562683 >> 172.21.15.99:0/2378562683 conn(0x7f6f2809d7c0 msgr2=0x7f6f2808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:42.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.815+0000 7f6f27200640 1 -- 172.21.15.99:0/2378562683 shutdown_connections 2024-03-30T13:11:42.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.815+0000 7f6f27200640 1 -- 172.21.15.99:0/2378562683 wait complete. 2024-03-30T13:11:42.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.817+0000 7f6f27200640 1 Processor -- start 2024-03-30T13:11:42.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.818+0000 7f6f27200640 1 -- start start 2024-03-30T13:11:42.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.818+0000 7f6f27200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f0c004800 0x7f6f28153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f27200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f280c7af0 0x7f6f2815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f27200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f280c90e0 0x7f6f2815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f27200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280d18f0 con 0x7f6f280c90e0 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f27200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280d13d0 con 0x7f6f0c004800 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f27200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f280d1a70 con 0x7f6f280c7af0 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f26800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f280c90e0 0x7f6f2815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f26800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f280c90e0 0x7f6f2815ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45170/0 (socket says 172.21.15.99:45170) 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f26800640 1 -- 172.21.15.99:0/247428452 learned_addr learned my addr 172.21.15.99:0/247428452 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f25e00640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f0c004800 0x7f6f28153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f1fe00640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f280c7af0 0x7f6f2815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f26800640 1 -- 172.21.15.99:0/247428452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f280c7af0 msgr2=0x7f6f2815c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f26800640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f280c7af0 0x7f6f2815c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f26800640 1 -- 172.21.15.99:0/247428452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f0c004800 msgr2=0x7f6f28153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f26800640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f0c004800 0x7f6f28153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.819+0000 7f6f26800640 1 -- 172.21.15.99:0/247428452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f280c8040 con 0x7f6f280c90e0 2024-03-30T13:11:42.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.820+0000 7f6f26800640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f280c90e0 0x7f6f2815ba60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6f28162210 tx=0x7f6f2000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:42.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.820+0000 7f6f1e000640 1 -- 172.21.15.99:0/247428452 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000ec40 con 0x7f6f280c90e0 2024-03-30T13:11:42.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.820+0000 7f6f1e000640 1 -- 172.21.15.99:0/247428452 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f2000ee00 con 0x7f6f280c90e0 2024-03-30T13:11:42.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.820+0000 7f6f1e000640 1 -- 172.21.15.99:0/247428452 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20014670 con 0x7f6f280c90e0 2024-03-30T13:11:42.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.820+0000 7f6f27200640 1 -- 172.21.15.99:0/247428452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f280c8320 con 0x7f6f280c90e0 2024-03-30T13:11:42.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.820+0000 7f6f27200640 1 -- 172.21.15.99:0/247428452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f280c88e0 con 0x7f6f280c90e0 2024-03-30T13:11:42.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.821+0000 7f6f27200640 1 -- 172.21.15.99:0/247428452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f2804f8f0 con 0x7f6f280c90e0 2024-03-30T13:11:42.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.822+0000 7f6f1e000640 1 -- 172.21.15.99:0/247428452 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6f20014810 con 0x7f6f280c90e0 2024-03-30T13:11:42.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.823+0000 7f6f1e000640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f0406c530 0x7f6f0406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.823+0000 7f6f1e000640 1 -- 172.21.15.99:0/247428452 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f6f2008b5f0 con 0x7f6f280c90e0 2024-03-30T13:11:42.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.823+0000 7f6f25e00640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f0406c530 0x7f6f0406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.824+0000 7f6f25e00640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f0406c530 0x7f6f0406e9f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f18007fd0 tx=0x7f6f18009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:42.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:42.828+0000 7f6f1e000640 1 -- 172.21.15.99:0/247428452 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6f20059bf0 con 0x7f6f280c90e0 2024-03-30T13:11:43.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.030+0000 7f6f27200640 1 -- 172.21.15.99:0/247428452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6f280ba3c0 con 0x7f6f280c90e0 2024-03-30T13:11:43.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.030+0000 7f6f1e000640 1 -- 172.21.15.99:0/247428452 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f6f200594f0 con 0x7f6f280c90e0 2024-03-30T13:11:43.035 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:43.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 -- 172.21.15.99:0/247428452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f0406c530 msgr2=0x7f6f0406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f0406c530 0x7f6f0406e9f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f18007fd0 tx=0x7f6f18009040 comp rx=0 tx=0).stop 2024-03-30T13:11:43.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 -- 172.21.15.99:0/247428452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f280c90e0 msgr2=0x7f6f2815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f280c90e0 0x7f6f2815ba60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6f28162210 tx=0x7f6f2000e530 comp rx=0 tx=0).stop 2024-03-30T13:11:43.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 -- 172.21.15.99:0/247428452 shutdown_connections 2024-03-30T13:11:43.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f0406c530 0x7f6f0406e9f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f280c90e0 0x7f6f2815ba60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f280c7af0 0x7f6f2815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 --2- 172.21.15.99:0/247428452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f0c004800 0x7f6f28153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 -- 172.21.15.99:0/247428452 >> 172.21.15.99:0/247428452 conn(0x7f6f2809d7c0 msgr2=0x7f6f280cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:43.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 -- 172.21.15.99:0/247428452 shutdown_connections 2024-03-30T13:11:43.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.033+0000 7f6f27200640 1 -- 172.21.15.99:0/247428452 wait complete. 2024-03-30T13:11:43.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:43.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.252+0000 7fedad400640 1 Processor -- start 2024-03-30T13:11:43.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.252+0000 7fedad400640 1 -- start start 2024-03-30T13:11:43.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.255+0000 7fedad400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda80d16a0 0x7feda80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.255+0000 7fedad400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda815ed00 con 0x7feda80cfde0 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.255+0000 7fedad400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda80d21e0 con 0x7feda815e920 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.255+0000 7fedad400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7feda80d2480 con 0x7feda80d16a0 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.255+0000 7feda5e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7feda80cfde0 0x7feda80d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34758/0 (socket says 172.21.15.99:34758) 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.255+0000 7feda5e00640 1 -- 172.21.15.99:0/3747620667 learned_addr learned my addr 172.21.15.99:0/3747620667 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.255+0000 7feda7200640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda80d16a0 0x7feda80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.255+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101346184 0 0) 0x7feda815ed00 con 0x7feda80cfde0 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed8c003520 con 0x7feda80cfde0 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 839940743 0 0) 0x7fed8c003520 con 0x7feda80cfde0 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda80d16a0 msgr2=0x7feda80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda80d16a0 0x7feda80d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 >> v1:172.21.15.181:6789/0 conn(0x7feda815e920 legacy=0x7feda80d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda80d2760 con 0x7feda80cfde0 2024-03-30T13:11:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fed94001670 con 0x7feda80cfde0 2024-03-30T13:11:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 >> v1:172.21.15.99:6789/0 conn(0x7feda80cfde0 legacy=0x7feda80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed8c0039e0 0x7fed8c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda80d16a0 0x7fed8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 0x7fed8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feda80d2480 con 0x7fed8c004d40 2024-03-30T13:11:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c00bb00 con 0x7fed8c0039e0 2024-03-30T13:11:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fed8c00bd00 con 0x7feda80d16a0 2024-03-30T13:11:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.256+0000 7feda7200640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 0x7fed8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.257+0000 7feda6800640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed8c0039e0 0x7fed8c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.257+0000 7feda5e00640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda80d16a0 0x7fed8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.257+0000 7feda7200640 1 -- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda80d16a0 msgr2=0x7fed8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.257+0000 7feda7200640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda80d16a0 0x7fed8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.257+0000 7feda7200640 1 -- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed8c0039e0 msgr2=0x7fed8c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.257+0000 7feda7200640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed8c0039e0 0x7fed8c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.257+0000 7feda7200640 1 -- 172.21.15.99:0/3747620667 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8c003520 con 0x7fed8c004d40 2024-03-30T13:11:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.257+0000 7feda5e00640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda80d16a0 0x7fed8c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.258+0000 7feda7200640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 0x7fed8c0051c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feda0009fc0 tx=0x7fed8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40dcc7a9ba39762 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:43.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.259+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0039070 con 0x7fed8c004d40 2024-03-30T13:11:43.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.259+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda002cc20 con 0x7fed8c004d40 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.259+0000 7feda5400640 1 -- 172.21.15.99:0/3747620667 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0009c10 con 0x7fed8c004d40 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.259+0000 7fedad400640 1 -- 172.21.15.99:0/3747620667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 msgr2=0x7fed8c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.259+0000 7fedad400640 1 --2- 172.21.15.99:0/3747620667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 0x7fed8c0051c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feda0009fc0 tx=0x7fed8c005830 comp rx=0 tx=0).stop 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.259+0000 7feda7200640 1 -- 172.21.15.99:0/3747620667 reap_dead start 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.259+0000 7fedad400640 1 -- 172.21.15.99:0/3747620667 shutdown_connections 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.259+0000 7fedad400640 1 -- 172.21.15.99:0/3747620667 >> 172.21.15.99:0/3747620667 conn(0x7feda808bfc0 msgr2=0x7feda80d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.260+0000 7fedad400640 1 -- 172.21.15.99:0/3747620667 shutdown_connections 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.260+0000 7fedad400640 1 -- 172.21.15.99:0/3747620667 wait complete. 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.261+0000 7fedad400640 1 Processor -- start 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.261+0000 7fedad400640 1 -- start start 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.262+0000 7fedad400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 0x7feda815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.262+0000 7fedad400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda809f830 0x7feda80ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.262+0000 7fedad400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8151950 0x7feda81e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.262+0000 7fedad400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feda80d4ef0 con 0x7fed8c004d40 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.262+0000 7fedad400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7feda80d2d20 con 0x7feda8151950 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.262+0000 7fedad400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7feda80d5070 con 0x7feda809f830 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 0x7feda815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 0x7feda815ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45190/0 (socket says 172.21.15.99:45190) 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda6800640 1 -- 172.21.15.99:0/1091904709 learned_addr learned my addr 172.21.15.99:0/1091904709 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda7200640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8151950 0x7feda81e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda5e00640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda809f830 0x7feda80ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda6800640 1 -- 172.21.15.99:0/1091904709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda809f830 msgr2=0x7feda80ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda6800640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda809f830 0x7feda80ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda6800640 1 -- 172.21.15.99:0/1091904709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8151950 msgr2=0x7feda81e8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda6800640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8151950 0x7feda81e8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda6800640 1 -- 172.21.15.99:0/1091904709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda815d590 con 0x7fed8c004d40 2024-03-30T13:11:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda7200640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8151950 0x7feda81e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:43.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda5e00640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda809f830 0x7feda80ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:43.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.263+0000 7feda6800640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 0x7feda815ced0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fed9800e4b0 tx=0x7fed9800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:43.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.264+0000 7fed9ea00640 1 -- 172.21.15.99:0/1091904709 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed980053a0 con 0x7fed8c004d40 2024-03-30T13:11:43.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.264+0000 7fed9ea00640 1 -- 172.21.15.99:0/1091904709 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed98018070 con 0x7fed8c004d40 2024-03-30T13:11:43.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.264+0000 7fed9ea00640 1 -- 172.21.15.99:0/1091904709 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98003810 con 0x7fed8c004d40 2024-03-30T13:11:43.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.264+0000 7fedad400640 1 -- 172.21.15.99:0/1091904709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda80cb880 con 0x7fed8c004d40 2024-03-30T13:11:43.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.264+0000 7fedad400640 1 -- 172.21.15.99:0/1091904709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda8151dd0 con 0x7fed8c004d40 2024-03-30T13:11:43.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.265+0000 7fedad400640 1 -- 172.21.15.99:0/1091904709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda80a2560 con 0x7fed8c004d40 2024-03-30T13:11:43.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.266+0000 7fed9ea00640 1 -- 172.21.15.99:0/1091904709 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fed980039b0 con 0x7fed8c004d40 2024-03-30T13:11:43.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.267+0000 7fed9ea00640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed8806c530 0x7fed8806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.267+0000 7fed9ea00640 1 -- 172.21.15.99:0/1091904709 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fed9808b3a0 con 0x7fed8c004d40 2024-03-30T13:11:43.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.267+0000 7feda5e00640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed8806c530 0x7fed8806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.268+0000 7feda5e00640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed8806c530 0x7fed8806e9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed940017e0 tx=0x7fed94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:43.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.272+0000 7fed9ea00640 1 -- 172.21.15.99:0/1091904709 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fed98059990 con 0x7fed8c004d40 2024-03-30T13:11:43.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.469+0000 7fedad400640 1 -- 172.21.15.99:0/1091904709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7feda80c7ee0 con 0x7fed8c004d40 2024-03-30T13:11:43.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.471+0000 7fed9ea00640 1 -- 172.21.15.99:0/1091904709 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fed98059290 con 0x7fed8c004d40 2024-03-30T13:11:43.474 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:43.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 -- 172.21.15.99:0/1091904709 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed8806c530 msgr2=0x7fed8806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed8806c530 0x7fed8806e9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed940017e0 tx=0x7fed94009040 comp rx=0 tx=0).stop 2024-03-30T13:11:43.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 -- 172.21.15.99:0/1091904709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 msgr2=0x7feda815ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 0x7feda815ced0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fed9800e4b0 tx=0x7fed9800e970 comp rx=0 tx=0).stop 2024-03-30T13:11:43.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 -- 172.21.15.99:0/1091904709 shutdown_connections 2024-03-30T13:11:43.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fed8806c530 0x7fed8806e9f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8151950 0x7feda81e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feda809f830 0x7feda80ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 --2- 172.21.15.99:0/1091904709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed8c004d40 0x7feda815ced0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 -- 172.21.15.99:0/1091904709 >> 172.21.15.99:0/1091904709 conn(0x7feda808bfc0 msgr2=0x7feda815daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:43.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 -- 172.21.15.99:0/1091904709 shutdown_connections 2024-03-30T13:11:43.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.474+0000 7fedad400640 1 -- 172.21.15.99:0/1091904709 wait complete. 2024-03-30T13:11:43.495 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:43.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.684+0000 7f4554e00640 1 Processor -- start 2024-03-30T13:11:43.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.684+0000 7f4554e00640 1 -- start start 2024-03-30T13:11:43.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.685+0000 7f4554e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f455015e7f0 0x7f45500d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.685+0000 7f4554e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455006cce0 con 0x7f45500cf540 2024-03-30T13:11:43.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.685+0000 7f4554e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45500cfae0 con 0x7f45500b5f60 2024-03-30T13:11:43.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.685+0000 7f4554e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f45500d2c30 con 0x7f455015e7f0 2024-03-30T13:11:43.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.686+0000 7f454ea00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f45500cf540 0x7f455006c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34764/0 (socket says 172.21.15.99:34764) 2024-03-30T13:11:43.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.686+0000 7f454ea00640 1 -- 172.21.15.99:0/3783184786 learned_addr learned my addr 172.21.15.99:0/3783184786 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:43.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.686+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 32217576 0 0) 0x7f455006cce0 con 0x7f45500cf540 2024-03-30T13:11:43.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.686+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4534003520 con 0x7f45500cf540 2024-03-30T13:11:43.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.686+0000 7f454f400640 1 --2- 172.21.15.99:0/3783184786 >> v2:172.21.15.181:3300/0 conn(0x7f455015e7f0 0x7f45500d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3276445932 0 0) 0x7f4534003520 con 0x7f45500cf540 2024-03-30T13:11:43.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 >> v2:172.21.15.181:3300/0 conn(0x7f455015e7f0 msgr2=0x7f45500d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:43.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 --2- 172.21.15.99:0/3783184786 >> v2:172.21.15.181:3300/0 conn(0x7f455015e7f0 0x7f45500d4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 >> v1:172.21.15.181:6789/0 conn(0x7f45500b5f60 legacy=0x7f45500d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45500cfdc0 con 0x7f45500cf540 2024-03-30T13:11:43.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f4538001670 con 0x7f45500cf540 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 >> v1:172.21.15.99:6789/0 conn(0x7f45500cf540 legacy=0x7f455006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4534003a00 0x7f4534003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4534004800 0x7f4534004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 0x7f453400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f45500d2c30 con 0x7f45340051c0 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f453400c0c0 con 0x7f4534003a00 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f453400c2c0 con 0x7f4534004800 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.687+0000 7f454fe00640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 0x7f453400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.688+0000 7f454f400640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4534003a00 0x7f4534003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.688+0000 7f454ea00640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4534004800 0x7f4534004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.688+0000 7f454fe00640 1 -- 172.21.15.99:0/3783184786 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4534004800 msgr2=0x7f4534004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.688+0000 7f454fe00640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4534004800 0x7f4534004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.688+0000 7f454fe00640 1 -- 172.21.15.99:0/3783184786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4534003a00 msgr2=0x7f4534003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.688+0000 7f454fe00640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4534003a00 0x7f4534003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.688+0000 7f454fe00640 1 -- 172.21.15.99:0/3783184786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4534003520 con 0x7f45340051c0 2024-03-30T13:11:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.688+0000 7f454ea00640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4534004800 0x7f4534004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.689+0000 7f454fe00640 1 -- 172.21.15.99:0/3783184786 reap_dead start 2024-03-30T13:11:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.689+0000 7f454fe00640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 0x7f453400b9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4548001e50 tx=0x7f4534005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa7d560a8b5ca2b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.689+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548001a70 con 0x7f45340051c0 2024-03-30T13:11:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.689+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4548003bb0 con 0x7f45340051c0 2024-03-30T13:11:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.689+0000 7f454e000640 1 -- 172.21.15.99:0/3783184786 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45480050d0 con 0x7f45340051c0 2024-03-30T13:11:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.690+0000 7f4554e00640 1 -- 172.21.15.99:0/3783184786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 msgr2=0x7f453400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.690+0000 7f4554e00640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 0x7f453400b9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4548001e50 tx=0x7f4534005830 comp rx=0 tx=0).stop 2024-03-30T13:11:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.690+0000 7f4554e00640 1 -- 172.21.15.99:0/3783184786 shutdown_connections 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.690+0000 7f4554e00640 1 --2- 172.21.15.99:0/3783184786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 0x7f453400b9c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.690+0000 7f4554e00640 1 -- 172.21.15.99:0/3783184786 >> 172.21.15.99:0/3783184786 conn(0x7f455009d7f0 msgr2=0x7f45500d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.690+0000 7f4554e00640 1 -- 172.21.15.99:0/3783184786 shutdown_connections 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.690+0000 7f4554e00640 1 -- 172.21.15.99:0/3783184786 wait complete. 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.692+0000 7f4554e00640 1 Processor -- start 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.692+0000 7f4554e00640 1 -- start start 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f4554e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 0x7f45501598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f4554e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455015fab0 0x7f455015ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f4554e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45500cd280 0x7f45500cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f4554e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f45500d2570 con 0x7f45340051c0 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f4554e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f455015ebd0 con 0x7f45500cd280 2024-03-30T13:11:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f4554e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f45500b63f0 con 0x7f455015fab0 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f454f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 0x7f45501598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f454f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 0x7f45501598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45222/0 (socket says 172.21.15.99:45222) 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f454f400640 1 -- 172.21.15.99:0/3897249036 learned_addr learned my addr 172.21.15.99:0/3897249036 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f454f400640 1 -- 172.21.15.99:0/3897249036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455015fab0 msgr2=0x7f455015ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f454f400640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455015fab0 0x7f455015ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f454f400640 1 -- 172.21.15.99:0/3897249036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45500cd280 msgr2=0x7f45500cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f454fe00640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45500cd280 0x7f45500cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f454f400640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45500cd280 0x7f45500cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.693+0000 7f454f400640 1 -- 172.21.15.99:0/3897249036 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4550159de0 con 0x7f45340051c0 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.694+0000 7f454f400640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 0x7f45501598a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4540011540 tx=0x7f4540011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.694+0000 7f4547400640 1 -- 172.21.15.99:0/3897249036 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4540015930 con 0x7f45340051c0 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.694+0000 7f4547400640 1 -- 172.21.15.99:0/3897249036 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4540015ad0 con 0x7f45340051c0 2024-03-30T13:11:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.694+0000 7f4554e00640 1 -- 172.21.15.99:0/3897249036 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45500c7b70 con 0x7f45340051c0 2024-03-30T13:11:43.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.694+0000 7f4547400640 1 -- 172.21.15.99:0/3897249036 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454000f460 con 0x7f45340051c0 2024-03-30T13:11:43.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.694+0000 7f4554e00640 1 -- 172.21.15.99:0/3897249036 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45501608c0 con 0x7f45340051c0 2024-03-30T13:11:43.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.696+0000 7f4554e00640 1 -- 172.21.15.99:0/3897249036 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455004f8f0 con 0x7f45340051c0 2024-03-30T13:11:43.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.696+0000 7f4547400640 1 -- 172.21.15.99:0/3897249036 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f454000f600 con 0x7f45340051c0 2024-03-30T13:11:43.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.697+0000 7f4547400640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f452c06c560 0x7f452c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:43.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.697+0000 7f4547400640 1 -- 172.21.15.99:0/3897249036 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f454008bfb0 con 0x7f45340051c0 2024-03-30T13:11:43.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.697+0000 7f454ea00640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f452c06c560 0x7f452c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:43.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.698+0000 7f454ea00640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f452c06c560 0x7f452c06ea20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4538000c00 tx=0x7f4538009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:43.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:43.701+0000 7f4547400640 1 -- 172.21.15.99:0/3897249036 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f45500c7b70 con 0x7f45340051c0 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.071+0000 7f4554e00640 1 -- 172.21.15.99:0/3897249036 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4550159fd0 con 0x7f45340051c0 2024-03-30T13:11:44.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.072+0000 7f4547400640 1 -- 172.21.15.99:0/3897249036 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f4540019030 con 0x7f45340051c0 2024-03-30T13:11:44.075 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.074+0000 7f4554e00640 1 -- 172.21.15.99:0/3897249036 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f452c06c560 msgr2=0x7f452c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.074+0000 7f4554e00640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f452c06c560 0x7f452c06ea20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4538000c00 tx=0x7f4538009040 comp rx=0 tx=0).stop 2024-03-30T13:11:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.074+0000 7f4554e00640 1 -- 172.21.15.99:0/3897249036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 msgr2=0x7f45501598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.074+0000 7f4554e00640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 0x7f45501598a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4540011540 tx=0x7f4540011a00 comp rx=0 tx=0).stop 2024-03-30T13:11:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.074+0000 7f4554e00640 1 -- 172.21.15.99:0/3897249036 shutdown_connections 2024-03-30T13:11:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.074+0000 7f4554e00640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f452c06c560 0x7f452c06ea20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.074+0000 7f4554e00640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45500cd280 0x7f45500cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.074+0000 7f4554e00640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f455015fab0 0x7f455015ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.074+0000 7f4554e00640 1 --2- 172.21.15.99:0/3897249036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45340051c0 0x7f45501598a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.074+0000 7f4554e00640 1 -- 172.21.15.99:0/3897249036 >> 172.21.15.99:0/3897249036 conn(0x7f455009d7f0 msgr2=0x7f455015a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.075+0000 7f4554e00640 1 -- 172.21.15.99:0/3897249036 shutdown_connections 2024-03-30T13:11:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.075+0000 7f4554e00640 1 -- 172.21.15.99:0/3897249036 wait complete. 2024-03-30T13:11:44.095 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:11:44.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.291+0000 7f354de00640 1 Processor -- start 2024-03-30T13:11:44.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.291+0000 7f354de00640 1 -- start start 2024-03-30T13:11:44.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.293+0000 7f354de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f354815e890 0x7f35480b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.293+0000 7f354de00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35480b5de0 0x7f35480ae240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.293+0000 7f354de00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35480b62f0 con 0x7f35480ae780 2024-03-30T13:11:44.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.293+0000 7f354de00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f35480b0630 con 0x7f354815e890 2024-03-30T13:11:44.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.293+0000 7f354de00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f35480b43e0 con 0x7f35480b5de0 2024-03-30T13:11:44.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.293+0000 7f3546a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f354815e890 0x7f35480b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.293+0000 7f3546a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f354815e890 0x7f35480b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45232/0 (socket says 172.21.15.99:45232) 2024-03-30T13:11:44.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.293+0000 7f3546a00640 1 -- 172.21.15.99:0/3511634183 learned_addr learned my addr 172.21.15.99:0/3511634183 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:44.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.294+0000 7f3546a00640 1 -- 172.21.15.99:0/3511634183 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35480b5de0 msgr2=0x7f35480ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:44.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.294+0000 7f3546000640 1 --2- 172.21.15.99:0/3511634183 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35480b5de0 0x7f35480ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.294+0000 7f3546a00640 1 --2- 172.21.15.99:0/3511634183 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35480b5de0 0x7f35480ae240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.294+0000 7f3546a00640 1 -- 172.21.15.99:0/3511634183 >> v1:172.21.15.181:6789/0 conn(0x7f35480ae780 legacy=0x7f35480b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:44.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.294+0000 7f3546a00640 1 -- 172.21.15.99:0/3511634183 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35480b46c0 con 0x7f354815e890 2024-03-30T13:11:44.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.295+0000 7f3546a00640 1 --2- 172.21.15.99:0/3511634183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f354815e890 0x7f35480b27d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3538009870 tx=0x7f353802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe0a29e0a273434 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:44.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.295+0000 7f3545600640 1 -- 172.21.15.99:0/3511634183 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35380317c0 con 0x7f354815e890 2024-03-30T13:11:44.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.295+0000 7f3545600640 1 -- 172.21.15.99:0/3511634183 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3538037070 con 0x7f354815e890 2024-03-30T13:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.295+0000 7f3545600640 1 -- 172.21.15.99:0/3511634183 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538031b80 con 0x7f354815e890 2024-03-30T13:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.296+0000 7f354de00640 1 -- 172.21.15.99:0/3511634183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f354815e890 msgr2=0x7f35480b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.296+0000 7f354de00640 1 --2- 172.21.15.99:0/3511634183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f354815e890 0x7f35480b27d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3538009870 tx=0x7f353802b860 comp rx=0 tx=0).stop 2024-03-30T13:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.296+0000 7f354de00640 1 -- 172.21.15.99:0/3511634183 shutdown_connections 2024-03-30T13:11:44.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.296+0000 7f354de00640 1 --2- 172.21.15.99:0/3511634183 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35480b5de0 0x7f35480ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.296+0000 7f354de00640 1 --2- 172.21.15.99:0/3511634183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f354815e890 0x7f35480b27d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.296+0000 7f354de00640 1 -- 172.21.15.99:0/3511634183 >> 172.21.15.99:0/3511634183 conn(0x7f35480b6780 msgr2=0x7f35480b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:44.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.296+0000 7f354de00640 1 -- 172.21.15.99:0/3511634183 shutdown_connections 2024-03-30T13:11:44.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.296+0000 7f354de00640 1 -- 172.21.15.99:0/3511634183 wait complete. 2024-03-30T13:11:44.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.299+0000 7f354de00640 1 Processor -- start 2024-03-30T13:11:44.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.299+0000 7f354de00640 1 -- start start 2024-03-30T13:11:44.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f354de00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35480ae780 0x7f354815fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f354de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35480b5de0 0x7f35481626c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f354de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f354815e890 0x7f35480cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f354de00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f35480b1e80 con 0x7f354815e890 2024-03-30T13:11:44.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f354de00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f354815ec70 con 0x7f35480b5de0 2024-03-30T13:11:44.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f354de00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f35480b2000 con 0x7f35480ae780 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f3547400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f354815e890 0x7f35480cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f3547400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f354815e890 0x7f35480cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45248/0 (socket says 172.21.15.99:45248) 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f3547400640 1 -- 172.21.15.99:0/449991045 learned_addr learned my addr 172.21.15.99:0/449991045 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f3546000640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35480b5de0 0x7f35481626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f3547400640 1 -- 172.21.15.99:0/449991045 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35480ae780 msgr2=0x7f354815fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f3546a00640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35480ae780 0x7f354815fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f3547400640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35480ae780 0x7f354815fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f3547400640 1 -- 172.21.15.99:0/449991045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35480b5de0 msgr2=0x7f35481626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f3547400640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35480b5de0 0x7f35481626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f3547400640 1 -- 172.21.15.99:0/449991045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3548160380 con 0x7f354815e890 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.301+0000 7f3546000640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35480b5de0 0x7f35481626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:44.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.302+0000 7f3547400640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f354815e890 0x7f35480cc240 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f354000c700 tx=0x7f354000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:44.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.302+0000 7f353f400640 1 -- 172.21.15.99:0/449991045 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540016020 con 0x7f354815e890 2024-03-30T13:11:44.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.302+0000 7f353f400640 1 -- 172.21.15.99:0/449991045 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354000aa50 con 0x7f354815e890 2024-03-30T13:11:44.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.302+0000 7f353f400640 1 -- 172.21.15.99:0/449991045 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354000ce10 con 0x7f354815e890 2024-03-30T13:11:44.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.302+0000 7f354de00640 1 -- 172.21.15.99:0/449991045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35481f88e0 con 0x7f354815e890 2024-03-30T13:11:44.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.302+0000 7f354de00640 1 -- 172.21.15.99:0/449991045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35480ca960 con 0x7f354815e890 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.303+0000 7f354de00640 1 -- 172.21.15.99:0/449991045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35480cb110 con 0x7f354815e890 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.304+0000 7f353f400640 1 -- 172.21.15.99:0/449991045 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3540019020 con 0x7f354815e890 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.306+0000 7f353f400640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f352806c530 0x7f352806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.306+0000 7f353f400640 1 -- 172.21.15.99:0/449991045 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f354008b9b0 con 0x7f354815e890 2024-03-30T13:11:44.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.306+0000 7f3546a00640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f352806c530 0x7f352806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.306+0000 7f3546a00640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f352806c530 0x7f352806e9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3538036000 tx=0x7f3538008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:44.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.309+0000 7f353f400640 1 -- 172.21.15.99:0/449991045 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3540020020 con 0x7f354815e890 2024-03-30T13:11:44.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.513+0000 7f354de00640 1 -- 172.21.15.99:0/449991045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f35480b5210 con 0x7f354815e890 2024-03-30T13:11:44.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.514+0000 7f353f400640 1 -- 172.21.15.99:0/449991045 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f3540059fa0 con 0x7f354815e890 2024-03-30T13:11:44.517 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-03-30T13:11:44.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 -- 172.21.15.99:0/449991045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f352806c530 msgr2=0x7f352806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f352806c530 0x7f352806e9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3538036000 tx=0x7f3538008030 comp rx=0 tx=0).stop 2024-03-30T13:11:44.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 -- 172.21.15.99:0/449991045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f354815e890 msgr2=0x7f35480cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f354815e890 0x7f35480cc240 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f354000c700 tx=0x7f354000cbc0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 -- 172.21.15.99:0/449991045 shutdown_connections 2024-03-30T13:11:44.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f352806c530 0x7f352806e9f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f354815e890 0x7f35480cc240 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35480b5de0 0x7f35481626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 --2- 172.21.15.99:0/449991045 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35480ae780 0x7f354815fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 -- 172.21.15.99:0/449991045 >> 172.21.15.99:0/449991045 conn(0x7f35480b6780 msgr2=0x7f35480b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:44.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 -- 172.21.15.99:0/449991045 shutdown_connections 2024-03-30T13:11:44.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:44.516+0000 7f354de00640 1 -- 172.21.15.99:0/449991045 wait complete. 2024-03-30T13:11:44.545 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-30T13:11:44.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:44.546 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-30T13:11:44.636 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:11:44.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:44.636 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-30T13:11:44.677 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:11:44.677 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:44.734 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:11:45.119 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:45.179 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:11:45.179 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:45.232 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:45.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.451+0000 7f74a6600640 1 Processor -- start 2024-03-30T13:11:45.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.451+0000 7f74a6600640 1 -- start start 2024-03-30T13:11:45.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.453+0000 7f74a6600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74a006d930 0x7f74a006e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.453+0000 7f74a6600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74a006eee0 con 0x7f74a0161e00 2024-03-30T13:11:45.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.453+0000 7f74a6600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74a006f1c0 con 0x7f74a0071fe0 2024-03-30T13:11:45.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.453+0000 7f74a6600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f74a01621e0 con 0x7f74a006d930 2024-03-30T13:11:45.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.453+0000 7f749f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f74a0161e00 0x7f74a00718d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44262/0 (socket says 172.21.15.99:44262) 2024-03-30T13:11:45.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.453+0000 7f749f400640 1 -- 172.21.15.99:0/4020107669 learned_addr learned my addr 172.21.15.99:0/4020107669 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:45.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.454+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625092872 0 0) 0x7f74a006eee0 con 0x7f74a0161e00 2024-03-30T13:11:45.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.454+0000 7f749fe00640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74a006d930 0x7f74a006e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.454+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7484003520 con 0x7f74a0161e00 2024-03-30T13:11:45.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.454+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579294446 0 0) 0x7f74a006f1c0 con 0x7f74a0071fe0 2024-03-30T13:11:45.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.454+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74a006eee0 con 0x7f74a0071fe0 2024-03-30T13:11:45.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3223921831 0 0) 0x7f7484003520 con 0x7f74a0161e00 2024-03-30T13:11:45.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74a006d930 msgr2=0x7f74a006e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:45.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74a006d930 0x7f74a006e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 >> v1:172.21.15.181:6789/0 conn(0x7f74a0071fe0 legacy=0x7f74a00adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a00ad3b0 con 0x7f74a0161e00 2024-03-30T13:11:45.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f7490001670 con 0x7f74a0161e00 2024-03-30T13:11:45.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 >> v1:172.21.15.99:6789/0 conn(0x7f74a0161e00 legacy=0x7f74a00718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7484003b70 0x7f7484003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 0x7f7484004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74840051c0 0x7f748400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f74a01621e0 con 0x7f7484004800 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f748400bfb0 con 0x7f74840051c0 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f748400c1b0 con 0x7f7484003b70 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749fe00640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74a006d930 0x7f74a006e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.455+0000 7f749ea00640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 0x7f7484004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.456+0000 7f749fe00640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74840051c0 0x7f748400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.456+0000 7f749f400640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7484003b70 0x7f7484003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.456+0000 7f749ea00640 1 -- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7484003b70 msgr2=0x7f7484003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.456+0000 7f749ea00640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7484003b70 0x7f7484003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.456+0000 7f749ea00640 1 -- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74840051c0 msgr2=0x7f748400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.456+0000 7f749ea00640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74840051c0 0x7f748400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.456+0000 7f749ea00640 1 -- 172.21.15.99:0/4020107669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7484003520 con 0x7f7484004800 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.456+0000 7f749f400640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7484003b70 0x7f7484003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.456+0000 7f749fe00640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74840051c0 0x7f748400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:45.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.457+0000 7f749ea00640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 0x7f7484004c80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f748c0018c0 tx=0x7f7484005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f2858c7e743579 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:45.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.457+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c037070 con 0x7f7484004800 2024-03-30T13:11:45.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.457+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f748c0052f0 con 0x7f7484004800 2024-03-30T13:11:45.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.457+0000 7f749e000640 1 -- 172.21.15.99:0/4020107669 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c0014e0 con 0x7f7484004800 2024-03-30T13:11:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.458+0000 7f74a6600640 1 -- 172.21.15.99:0/4020107669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 msgr2=0x7f7484004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.458+0000 7f74a6600640 1 --2- 172.21.15.99:0/4020107669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 0x7f7484004c80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f748c0018c0 tx=0x7f7484005830 comp rx=0 tx=0).stop 2024-03-30T13:11:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.458+0000 7f749fe00640 1 -- 172.21.15.99:0/4020107669 reap_dead start 2024-03-30T13:11:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.458+0000 7f74a6600640 1 -- 172.21.15.99:0/4020107669 shutdown_connections 2024-03-30T13:11:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.458+0000 7f74a6600640 1 -- 172.21.15.99:0/4020107669 >> 172.21.15.99:0/4020107669 conn(0x7f74a006b510 msgr2=0x7f74a006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.458+0000 7f74a6600640 1 -- 172.21.15.99:0/4020107669 shutdown_connections 2024-03-30T13:11:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.458+0000 7f74a6600640 1 -- 172.21.15.99:0/4020107669 wait complete. 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.460+0000 7f74a6600640 1 Processor -- start 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.460+0000 7f74a6600640 1 -- start start 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.461+0000 7f74a6600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 0x7f74a009dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.461+0000 7f74a6600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74a015a910 0x7f74a015ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.461+0000 7f74a6600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74a0158920 0x7f74a0158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.461+0000 7f74a6600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f74a006e850 con 0x7f7484004800 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.461+0000 7f74a6600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f74a00b5270 con 0x7f74a0158920 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.461+0000 7f74a6600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f74a006e9d0 con 0x7f74a015a910 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.461+0000 7f749f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 0x7f74a009dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.461+0000 7f749f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 0x7f74a009dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37224/0 (socket says 172.21.15.99:37224) 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.461+0000 7f749f400640 1 -- 172.21.15.99:0/867119189 learned_addr learned my addr 172.21.15.99:0/867119189 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f749f400640 1 -- 172.21.15.99:0/867119189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74a015a910 msgr2=0x7f74a015ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f749ea00640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74a015a910 0x7f74a015ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f749fe00640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74a0158920 0x7f74a0158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f749f400640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74a015a910 0x7f74a015ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f749f400640 1 -- 172.21.15.99:0/867119189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74a0158920 msgr2=0x7f74a0158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f749f400640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74a0158920 0x7f74a0158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f749f400640 1 -- 172.21.15.99:0/867119189 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a015b2b0 con 0x7f7484004800 2024-03-30T13:11:45.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f749ea00640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74a015a910 0x7f74a015ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:45.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f749f400640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 0x7f74a009dbf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f749000d8b0 tx=0x7f749000dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:45.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f7497400640 1 -- 172.21.15.99:0/867119189 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7490019070 con 0x7f7484004800 2024-03-30T13:11:45.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f7497400640 1 -- 172.21.15.99:0/867119189 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74900074e0 con 0x7f7484004800 2024-03-30T13:11:45.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f7497400640 1 -- 172.21.15.99:0/867119189 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74900049e0 con 0x7f7484004800 2024-03-30T13:11:45.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f74a6600640 1 -- 172.21.15.99:0/867119189 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a009a450 con 0x7f7484004800 2024-03-30T13:11:45.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.462+0000 7f74a6600640 1 -- 172.21.15.99:0/867119189 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a009aa10 con 0x7f7484004800 2024-03-30T13:11:45.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.464+0000 7f74a6600640 1 -- 172.21.15.99:0/867119189 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a0068640 con 0x7f7484004800 2024-03-30T13:11:45.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.465+0000 7f7497400640 1 -- 172.21.15.99:0/867119189 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7490004b80 con 0x7f7484004800 2024-03-30T13:11:45.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.466+0000 7f7497400640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f748006c530 0x7f748006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.466+0000 7f7497400640 1 -- 172.21.15.99:0/867119189 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f749008b300 con 0x7f7484004800 2024-03-30T13:11:45.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.466+0000 7f749ea00640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f748006c530 0x7f748006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.467+0000 7f749ea00640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f748006c530 0x7f748006e9f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f748c034000 tx=0x7f748c009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:45.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.471+0000 7f7497400640 1 -- 172.21.15.99:0/867119189 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f74900597d0 con 0x7f7484004800 2024-03-30T13:11:45.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.669+0000 7f74a6600640 1 -- 172.21.15.99:0/867119189 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74a015ecb0 con 0x7f7484004800 2024-03-30T13:11:45.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.671+0000 7f7497400640 1 -- 172.21.15.99:0/867119189 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16658 (secure 0 0 0) 0x7f74900590d0 con 0x7f7484004800 2024-03-30T13:11:45.674 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:45.675 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:26.555726+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.38","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:45.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.673+0000 7f74a6600640 1 -- 172.21.15.99:0/867119189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f748006c530 msgr2=0x7f748006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.673+0000 7f74a6600640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f748006c530 0x7f748006e9f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f748c034000 tx=0x7f748c009030 comp rx=0 tx=0).stop 2024-03-30T13:11:45.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.673+0000 7f74a6600640 1 -- 172.21.15.99:0/867119189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 msgr2=0x7f74a009dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.673+0000 7f74a6600640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 0x7f74a009dbf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f749000d8b0 tx=0x7f749000dd70 comp rx=0 tx=0).stop 2024-03-30T13:11:45.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.674+0000 7f74a6600640 1 -- 172.21.15.99:0/867119189 shutdown_connections 2024-03-30T13:11:45.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.674+0000 7f74a6600640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f748006c530 0x7f748006e9f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.674+0000 7f74a6600640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74a0158920 0x7f74a0158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.674+0000 7f74a6600640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74a015a910 0x7f74a015ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.674+0000 7f74a6600640 1 --2- 172.21.15.99:0/867119189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7484004800 0x7f74a009dbf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.674+0000 7f74a6600640 1 -- 172.21.15.99:0/867119189 >> 172.21.15.99:0/867119189 conn(0x7f74a006b510 msgr2=0x7f74a00b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:45.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.674+0000 7f74a6600640 1 -- 172.21.15.99:0/867119189 shutdown_connections 2024-03-30T13:11:45.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.674+0000 7f74a6600640 1 -- 172.21.15.99:0/867119189 wait complete. 2024-03-30T13:11:45.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:45.698 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.905+0000 7fc547400640 1 Processor -- start 2024-03-30T13:11:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.905+0000 7fc547400640 1 -- start start 2024-03-30T13:11:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.907+0000 7fc547400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc5400b69b0 0x7fc5400ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.907+0000 7fc547400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5400b02a0 0x7fc540162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.907+0000 7fc547400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc540162850 0x7fc54015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.907+0000 7fc547400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc5400aec50 con 0x7fc5400b02a0 2024-03-30T13:11:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.907+0000 7fc547400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc5400b6d90 con 0x7fc5400b69b0 2024-03-30T13:11:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.907+0000 7fc547400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc5400ae0d0 con 0x7fc540162850 2024-03-30T13:11:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.907+0000 7fc53fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5400b02a0 0x7fc540162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.907+0000 7fc53fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5400b02a0 0x7fc540162310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37232/0 (socket says 172.21.15.99:37232) 2024-03-30T13:11:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.907+0000 7fc53fe00640 1 -- 172.21.15.99:0/385208068 learned_addr learned my addr 172.21.15.99:0/385208068 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.907+0000 7fc545400640 1 --2- 172.21.15.99:0/385208068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc540162850 0x7fc54015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.908+0000 7fc544a00640 1 --2- 172.21.15.99:0/385208068 >> v2:172.21.15.181:3300/0 conn(0x7fc5400b69b0 0x7fc5400ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.908+0000 7fc53fe00640 1 -- 172.21.15.99:0/385208068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc540162850 msgr2=0x7fc54015ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.908+0000 7fc53fe00640 1 --2- 172.21.15.99:0/385208068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc540162850 0x7fc54015ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.908+0000 7fc53fe00640 1 -- 172.21.15.99:0/385208068 >> v2:172.21.15.181:3300/0 conn(0x7fc5400b69b0 msgr2=0x7fc5400ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.908+0000 7fc53fe00640 1 --2- 172.21.15.99:0/385208068 >> v2:172.21.15.181:3300/0 conn(0x7fc5400b69b0 0x7fc5400ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.908+0000 7fc53fe00640 1 -- 172.21.15.99:0/385208068 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5400ae3b0 con 0x7fc5400b02a0 2024-03-30T13:11:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.908+0000 7fc544a00640 1 --2- 172.21.15.99:0/385208068 >> v2:172.21.15.181:3300/0 conn(0x7fc5400b69b0 0x7fc5400ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.909+0000 7fc53fe00640 1 --2- 172.21.15.99:0/385208068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5400b02a0 0x7fc540162310 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc5400673b0 tx=0x7fc52c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a712bec6e33116a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:45.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc53f400640 1 -- 172.21.15.99:0/385208068 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c02e070 con 0x7fc5400b02a0 2024-03-30T13:11:45.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc53f400640 1 -- 172.21.15.99:0/385208068 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc52c037070 con 0x7fc5400b02a0 2024-03-30T13:11:45.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc53f400640 1 -- 172.21.15.99:0/385208068 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c031a00 con 0x7fc5400b02a0 2024-03-30T13:11:45.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc547400640 1 -- 172.21.15.99:0/385208068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5400b02a0 msgr2=0x7fc540162310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc547400640 1 --2- 172.21.15.99:0/385208068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5400b02a0 0x7fc540162310 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc5400673b0 tx=0x7fc52c02b880 comp rx=0 tx=0).stop 2024-03-30T13:11:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc547400640 1 -- 172.21.15.99:0/385208068 shutdown_connections 2024-03-30T13:11:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc547400640 1 --2- 172.21.15.99:0/385208068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc540162850 0x7fc54015ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc547400640 1 --2- 172.21.15.99:0/385208068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5400b02a0 0x7fc540162310 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc547400640 1 --2- 172.21.15.99:0/385208068 >> v2:172.21.15.181:3300/0 conn(0x7fc5400b69b0 0x7fc5400ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc547400640 1 -- 172.21.15.99:0/385208068 >> 172.21.15.99:0/385208068 conn(0x7fc54006b510 msgr2=0x7fc54006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc547400640 1 -- 172.21.15.99:0/385208068 shutdown_connections 2024-03-30T13:11:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.910+0000 7fc547400640 1 -- 172.21.15.99:0/385208068 wait complete. 2024-03-30T13:11:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.912+0000 7fc547400640 1 Processor -- start 2024-03-30T13:11:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.912+0000 7fc547400640 1 -- start start 2024-03-30T13:11:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.913+0000 7fc547400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5400b02a0 0x7fc540161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.913+0000 7fc547400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5400b69b0 0x7fc540146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.913+0000 7fc547400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540162850 0x7fc540143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.913+0000 7fc547400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc5400adde0 con 0x7fc5400b69b0 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.913+0000 7fc547400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc5400ae970 con 0x7fc540162850 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.913+0000 7fc547400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc54015f260 con 0x7fc5400b02a0 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.913+0000 7fc53fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5400b69b0 0x7fc540146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.914+0000 7fc53fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5400b69b0 0x7fc540146c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37238/0 (socket says 172.21.15.99:37238) 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.914+0000 7fc53fe00640 1 -- 172.21.15.99:0/1192368098 learned_addr learned my addr 172.21.15.99:0/1192368098 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.914+0000 7fc545400640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540162850 0x7fc540143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.914+0000 7fc544a00640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5400b02a0 0x7fc540161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.914+0000 7fc53fe00640 1 -- 172.21.15.99:0/1192368098 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5400b02a0 msgr2=0x7fc540161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.914+0000 7fc53fe00640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5400b02a0 0x7fc540161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.914+0000 7fc53fe00640 1 -- 172.21.15.99:0/1192368098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540162850 msgr2=0x7fc540143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.914+0000 7fc53fe00640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540162850 0x7fc540143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.914+0000 7fc53fe00640 1 -- 172.21.15.99:0/1192368098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc540147150 con 0x7fc5400b69b0 2024-03-30T13:11:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.914+0000 7fc53fe00640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5400b69b0 0x7fc540146c10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc52c02b8c0 tx=0x7fc52c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:45.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.915+0000 7fc53cc00640 1 -- 172.21.15.99:0/1192368098 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c032880 con 0x7fc5400b69b0 2024-03-30T13:11:45.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.915+0000 7fc53cc00640 1 -- 172.21.15.99:0/1192368098 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc52c032a40 con 0x7fc5400b69b0 2024-03-30T13:11:45.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.915+0000 7fc53cc00640 1 -- 172.21.15.99:0/1192368098 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c032e30 con 0x7fc5400b69b0 2024-03-30T13:11:45.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.915+0000 7fc547400640 1 -- 172.21.15.99:0/1192368098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc540143e80 con 0x7fc5400b69b0 2024-03-30T13:11:45.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.915+0000 7fc547400640 1 -- 172.21.15.99:0/1192368098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5401619c0 con 0x7fc5400b69b0 2024-03-30T13:11:45.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.916+0000 7fc547400640 1 -- 172.21.15.99:0/1192368098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5401622b0 con 0x7fc5400b69b0 2024-03-30T13:11:45.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.917+0000 7fc53cc00640 1 -- 172.21.15.99:0/1192368098 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc52c04c060 con 0x7fc5400b69b0 2024-03-30T13:11:45.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.918+0000 7fc53cc00640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc52006c530 0x7fc52006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.918+0000 7fc53cc00640 1 -- 172.21.15.99:0/1192368098 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fc52c0ad3b0 con 0x7fc5400b69b0 2024-03-30T13:11:45.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.918+0000 7fc544a00640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc52006c530 0x7fc52006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.919+0000 7fc544a00640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc52006c530 0x7fc52006e9f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc534006b10 tx=0x7fc534008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:45.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:45.923+0000 7fc53cc00640 1 -- 172.21.15.99:0/1192368098 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc52c040070 con 0x7fc5400b69b0 2024-03-30T13:11:46.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.121+0000 7fc547400640 1 -- 172.21.15.99:0/1192368098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc540073a40 con 0x7fc5400b69b0 2024-03-30T13:11:46.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.122+0000 7fc53cc00640 1 -- 172.21.15.99:0/1192368098 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fc52c07ba30 con 0x7fc5400b69b0 2024-03-30T13:11:46.126 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:46.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 -- 172.21.15.99:0/1192368098 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc52006c530 msgr2=0x7fc52006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc52006c530 0x7fc52006e9f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc534006b10 tx=0x7fc534008040 comp rx=0 tx=0).stop 2024-03-30T13:11:46.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 -- 172.21.15.99:0/1192368098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5400b69b0 msgr2=0x7fc540146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5400b69b0 0x7fc540146c10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc52c02b8c0 tx=0x7fc52c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 -- 172.21.15.99:0/1192368098 shutdown_connections 2024-03-30T13:11:46.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc52006c530 0x7fc52006e9f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540162850 0x7fc540143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5400b69b0 0x7fc540146c10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 --2- 172.21.15.99:0/1192368098 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5400b02a0 0x7fc540161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 -- 172.21.15.99:0/1192368098 >> 172.21.15.99:0/1192368098 conn(0x7fc54006b510 msgr2=0x7fc54006e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:46.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 -- 172.21.15.99:0/1192368098 shutdown_connections 2024-03-30T13:11:46.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.124+0000 7fc547400640 1 -- 172.21.15.99:0/1192368098 wait complete. 2024-03-30T13:11:46.147 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:46.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.356+0000 7f7896a00640 1 Processor -- start 2024-03-30T13:11:46.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.356+0000 7f7896a00640 1 -- start start 2024-03-30T13:11:46.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.357+0000 7f7896a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f78900cfde0 0x7f78900d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f7896a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f78900d0f90 0x7f78900d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f7896a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f789015ed00 con 0x7f789015e920 2024-03-30T13:11:46.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f7896a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f78900d21e0 con 0x7f78900cfde0 2024-03-30T13:11:46.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f7896a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f78900d2480 con 0x7f78900d0f90 2024-03-30T13:11:46.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f788f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f78900cfde0 0x7f78900d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f788fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f789015e920 0x7f78900d3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44274/0 (socket says 172.21.15.99:44274) 2024-03-30T13:11:46.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f788fe00640 1 -- 172.21.15.99:0/969378561 learned_addr learned my addr 172.21.15.99:0/969378561 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:46.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f788f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f78900cfde0 0x7f78900d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37240/0 (socket says 172.21.15.99:37240) 2024-03-30T13:11:46.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f7894a00640 1 --2- 172.21.15.99:0/969378561 >> v2:172.21.15.181:3300/0 conn(0x7f78900d0f90 0x7f78900d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f788f400640 1 -- 172.21.15.99:0/969378561 >> v2:172.21.15.181:3300/0 conn(0x7f78900d0f90 msgr2=0x7f78900d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:46.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f788f400640 1 --2- 172.21.15.99:0/969378561 >> v2:172.21.15.181:3300/0 conn(0x7f78900d0f90 0x7f78900d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f788f400640 1 -- 172.21.15.99:0/969378561 >> v1:172.21.15.99:6789/0 conn(0x7f789015e920 legacy=0x7f78900d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.358+0000 7f788f400640 1 -- 172.21.15.99:0/969378561 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78900d2760 con 0x7f78900cfde0 2024-03-30T13:11:46.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.360+0000 7f788f400640 1 --2- 172.21.15.99:0/969378561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78900cfde0 0x7f78900d0240 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f789008dab0 tx=0x7f787802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777e8085465739e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.360+0000 7f788ea00640 1 -- 172.21.15.99:0/969378561 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878035020 con 0x7f78900cfde0 2024-03-30T13:11:46.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.360+0000 7f788ea00640 1 -- 172.21.15.99:0/969378561 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7878031830 con 0x7f78900cfde0 2024-03-30T13:11:46.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.360+0000 7f788ea00640 1 -- 172.21.15.99:0/969378561 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878031c00 con 0x7f78900cfde0 2024-03-30T13:11:46.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.360+0000 7f7896a00640 1 -- 172.21.15.99:0/969378561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78900cfde0 msgr2=0x7f78900d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.360+0000 7f7896a00640 1 --2- 172.21.15.99:0/969378561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78900cfde0 0x7f78900d0240 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f789008dab0 tx=0x7f787802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.361+0000 7f7896a00640 1 -- 172.21.15.99:0/969378561 shutdown_connections 2024-03-30T13:11:46.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.361+0000 7f7896a00640 1 --2- 172.21.15.99:0/969378561 >> v2:172.21.15.181:3300/0 conn(0x7f78900d0f90 0x7f78900d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.361+0000 7f7896a00640 1 --2- 172.21.15.99:0/969378561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78900cfde0 0x7f78900d0240 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.361+0000 7f7896a00640 1 -- 172.21.15.99:0/969378561 >> 172.21.15.99:0/969378561 conn(0x7f789008bfc0 msgr2=0x7f78900d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:46.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.361+0000 7f7896a00640 1 -- 172.21.15.99:0/969378561 shutdown_connections 2024-03-30T13:11:46.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.361+0000 7f7896a00640 1 -- 172.21.15.99:0/969378561 wait complete. 2024-03-30T13:11:46.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.363+0000 7f7896a00640 1 Processor -- start 2024-03-30T13:11:46.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.364+0000 7f7896a00640 1 -- start start 2024-03-30T13:11:46.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.365+0000 7f7896a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78900cfde0 0x7f789014cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.365+0000 7f7896a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78900d0f90 0x7f78900b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.365+0000 7f7896a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f789015e920 0x7f78900b9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.365+0000 7f7896a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f78900d4ef0 con 0x7f78900d0f90 2024-03-30T13:11:46.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.365+0000 7f7896a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f78900d2d20 con 0x7f789015e920 2024-03-30T13:11:46.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.365+0000 7f7896a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f78900d5070 con 0x7f78900cfde0 2024-03-30T13:11:46.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.365+0000 7f788f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78900d0f90 0x7f78900b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.365+0000 7f788f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78900d0f90 0x7f78900b8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37244/0 (socket says 172.21.15.99:37244) 2024-03-30T13:11:46.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.365+0000 7f788f400640 1 -- 172.21.15.99:0/1619096454 learned_addr learned my addr 172.21.15.99:0/1619096454 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:46.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.366+0000 7f788f400640 1 -- 172.21.15.99:0/1619096454 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78900cfde0 msgr2=0x7f789014cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.366+0000 7f788f400640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78900cfde0 0x7f789014cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.366+0000 7f788f400640 1 -- 172.21.15.99:0/1619096454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f789015e920 msgr2=0x7f78900b9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.366+0000 7f788f400640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f789015e920 0x7f78900b9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.366+0000 7f788f400640 1 -- 172.21.15.99:0/1619096454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7890156f30 con 0x7f78900d0f90 2024-03-30T13:11:46.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.366+0000 7f788f400640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78900d0f90 0x7f78900b8be0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7878009890 tx=0x7f78780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.367+0000 7f7887e00640 1 -- 172.21.15.99:0/1619096454 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787803aa70 con 0x7f78900d0f90 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.367+0000 7f7887e00640 1 -- 172.21.15.99:0/1619096454 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787803ac30 con 0x7f78900d0f90 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.367+0000 7f7896a00640 1 -- 172.21.15.99:0/1619096454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78900b9750 con 0x7f78900d0f90 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.367+0000 7f7887e00640 1 -- 172.21.15.99:0/1619096454 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78780443f0 con 0x7f78900d0f90 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.367+0000 7f7896a00640 1 -- 172.21.15.99:0/1619096454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78900b9d10 con 0x7f78900d0f90 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.368+0000 7f7896a00640 1 -- 172.21.15.99:0/1619096454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78900a2560 con 0x7f78900d0f90 2024-03-30T13:11:46.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.369+0000 7f7887e00640 1 -- 172.21.15.99:0/1619096454 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7878038020 con 0x7f78900d0f90 2024-03-30T13:11:46.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.370+0000 7f7887e00640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f786c06c530 0x7f786c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.370+0000 7f7887e00640 1 -- 172.21.15.99:0/1619096454 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f78780ad550 con 0x7f78900d0f90 2024-03-30T13:11:46.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.370+0000 7f788fe00640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f786c06c530 0x7f786c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.371+0000 7f788fe00640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f786c06c530 0x7f786c06e9f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7880000f60 tx=0x7f7880007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.375+0000 7f7887e00640 1 -- 172.21.15.99:0/1619096454 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f787803f070 con 0x7f78900d0f90 2024-03-30T13:11:46.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.595+0000 7f7896a00640 1 -- 172.21.15.99:0/1619096454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f789004f9d0 con 0x7f78900d0f90 2024-03-30T13:11:46.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.596+0000 7f7887e00640 1 -- 172.21.15.99:0/1619096454 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f787807bab0 con 0x7f78900d0f90 2024-03-30T13:11:46.599 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:46.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 -- 172.21.15.99:0/1619096454 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f786c06c530 msgr2=0x7f786c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f786c06c530 0x7f786c06e9f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7880000f60 tx=0x7f7880007a80 comp rx=0 tx=0).stop 2024-03-30T13:11:46.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 -- 172.21.15.99:0/1619096454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78900d0f90 msgr2=0x7f78900b8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78900d0f90 0x7f78900b8be0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7878009890 tx=0x7f78780046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 -- 172.21.15.99:0/1619096454 shutdown_connections 2024-03-30T13:11:46.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f786c06c530 0x7f786c06e9f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f789015e920 0x7f78900b9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78900d0f90 0x7f78900b8be0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 --2- 172.21.15.99:0/1619096454 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78900cfde0 0x7f789014cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 -- 172.21.15.99:0/1619096454 >> 172.21.15.99:0/1619096454 conn(0x7f789008bfc0 msgr2=0x7f78900b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:46.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 -- 172.21.15.99:0/1619096454 shutdown_connections 2024-03-30T13:11:46.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.599+0000 7f7896a00640 1 -- 172.21.15.99:0/1619096454 wait complete. 2024-03-30T13:11:46.619 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:46.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.822+0000 7fa833e00640 1 Processor -- start 2024-03-30T13:11:46.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.822+0000 7fa833e00640 1 -- start start 2024-03-30T13:11:46.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.823+0000 7fa833e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa82c09b970 0x7fa82c0d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.823+0000 7fa833e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c09abb0 con 0x7fa82c161e90 2024-03-30T13:11:46.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.823+0000 7fa833e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c09ae90 con 0x7fa82c0b33e0 2024-03-30T13:11:46.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.823+0000 7fa833e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa82c09bdf0 con 0x7fa82c09b970 2024-03-30T13:11:46.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.824+0000 7fa831400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa82c161e90 0x7fa82c0b1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44284/0 (socket says 172.21.15.99:44284) 2024-03-30T13:11:46.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.824+0000 7fa831400640 1 -- 172.21.15.99:0/2756536310 learned_addr learned my addr 172.21.15.99:0/2756536310 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.824+0000 7fa830a00640 1 --2- 172.21.15.99:0/2756536310 >> v2:172.21.15.181:3300/0 conn(0x7fa82c09b970 0x7fa82c0d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.824+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305410715 0 0) 0x7fa82c09abb0 con 0x7fa82c161e90 2024-03-30T13:11:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.824+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa814003520 con 0x7fa82c161e90 2024-03-30T13:11:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1073322684 0 0) 0x7fa814003520 con 0x7fa82c161e90 2024-03-30T13:11:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 >> v2:172.21.15.181:3300/0 conn(0x7fa82c09b970 msgr2=0x7fa82c0d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 --2- 172.21.15.99:0/2756536310 >> v2:172.21.15.181:3300/0 conn(0x7fa82c09b970 0x7fa82c0d0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 >> v1:172.21.15.181:6789/0 conn(0x7fa82c0b33e0 legacy=0x7fa82c06ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c09b170 con 0x7fa82c161e90 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fa820001670 con 0x7fa82c161e90 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 >> v1:172.21.15.99:6789/0 conn(0x7fa82c161e90 legacy=0x7fa82c0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 --2- 172.21.15.99:0/2756536310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa814003a00 0x7fa814003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 --2- 172.21.15.99:0/2756536310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 0x7fa814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 --2- 172.21.15.99:0/2756536310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8140053c0 0x7fa81400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c09bdf0 con 0x7fa814004800 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa81400c220 con 0x7fa8140053c0 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa81400c420 con 0x7fa814003a00 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.825+0000 7fa830a00640 1 --2- 172.21.15.99:0/2756536310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 0x7fa814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.826+0000 7fa831400640 1 --2- 172.21.15.99:0/2756536310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa814003a00 0x7fa814003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.826+0000 7fa830a00640 1 -- 172.21.15.99:0/2756536310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa814003a00 msgr2=0x7fa814003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.826+0000 7fa830a00640 1 --2- 172.21.15.99:0/2756536310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa814003a00 0x7fa814003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.826+0000 7fa830a00640 1 -- 172.21.15.99:0/2756536310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8140053c0 msgr2=0x7fa81400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.826+0000 7fa830a00640 1 --2- 172.21.15.99:0/2756536310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8140053c0 0x7fa81400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.826+0000 7fa830a00640 1 -- 172.21.15.99:0/2756536310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa814003520 con 0x7fa814004800 2024-03-30T13:11:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.826+0000 7fa831e00640 1 -- 172.21.15.99:0/2756536310 reap_dead start 2024-03-30T13:11:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.826+0000 7fa831400640 1 --2- 172.21.15.99:0/2756536310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa814003a00 0x7fa814003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.827+0000 7fa830a00640 1 --2- 172.21.15.99:0/2756536310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 0x7fa814004c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa81800a9a0 tx=0x7fa814005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ac94bed40383c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.827+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818034070 con 0x7fa814004800 2024-03-30T13:11:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.827+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa818030620 con 0x7fa814004800 2024-03-30T13:11:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.827+0000 7fa82be00640 1 -- 172.21.15.99:0/2756536310 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81800a570 con 0x7fa814004800 2024-03-30T13:11:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.828+0000 7fa833e00640 1 -- 172.21.15.99:0/2756536310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 msgr2=0x7fa814004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.828+0000 7fa833e00640 1 --2- 172.21.15.99:0/2756536310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 0x7fa814004c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa81800a9a0 tx=0x7fa814005830 comp rx=0 tx=0).stop 2024-03-30T13:11:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.828+0000 7fa833e00640 1 -- 172.21.15.99:0/2756536310 shutdown_connections 2024-03-30T13:11:46.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.828+0000 7fa833e00640 1 --2- 172.21.15.99:0/2756536310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 0x7fa814004c80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.828+0000 7fa833e00640 1 -- 172.21.15.99:0/2756536310 >> 172.21.15.99:0/2756536310 conn(0x7fa82c0b3fa0 msgr2=0x7fa82c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:46.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.828+0000 7fa833e00640 1 -- 172.21.15.99:0/2756536310 shutdown_connections 2024-03-30T13:11:46.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.828+0000 7fa833e00640 1 -- 172.21.15.99:0/2756536310 wait complete. 2024-03-30T13:11:46.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.830+0000 7fa833e00640 1 Processor -- start 2024-03-30T13:11:46.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.830+0000 7fa833e00640 1 -- start start 2024-03-30T13:11:46.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa833e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 0x7fa82c0b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa833e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa82c15a970 0x7fa82c151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa833e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c0c8bb0 0x7fa82c15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa833e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c0d0fe0 con 0x7fa814004800 2024-03-30T13:11:46.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa833e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c09b4e0 con 0x7fa82c0c8bb0 2024-03-30T13:11:46.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa833e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c0d1160 con 0x7fa82c15a970 2024-03-30T13:11:46.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa831400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 0x7fa82c0b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa831400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 0x7fa82c0b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37260/0 (socket says 172.21.15.99:37260) 2024-03-30T13:11:46.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa831400640 1 -- 172.21.15.99:0/4242706630 learned_addr learned my addr 172.21.15.99:0/4242706630 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa830a00640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa82c15a970 0x7fa82c151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa831e00640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c0c8bb0 0x7fa82c15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa831400640 1 -- 172.21.15.99:0/4242706630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa82c15a970 msgr2=0x7fa82c151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa831400640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa82c15a970 0x7fa82c151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa831400640 1 -- 172.21.15.99:0/4242706630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c0c8bb0 msgr2=0x7fa82c15fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa831400640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c0c8bb0 0x7fa82c15fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.831+0000 7fa831400640 1 -- 172.21.15.99:0/4242706630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c151e80 con 0x7fa814004800 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.832+0000 7fa831400640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 0x7fa82c0b50d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa82000d800 tx=0x7fa82000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.832+0000 7fa829600640 1 -- 172.21.15.99:0/4242706630 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820019070 con 0x7fa814004800 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.832+0000 7fa829600640 1 -- 172.21.15.99:0/4242706630 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8200074e0 con 0x7fa814004800 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.832+0000 7fa829600640 1 -- 172.21.15.99:0/4242706630 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820004a00 con 0x7fa814004800 2024-03-30T13:11:46.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.832+0000 7fa833e00640 1 -- 172.21.15.99:0/4242706630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c0c7b10 con 0x7fa814004800 2024-03-30T13:11:46.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.832+0000 7fa833e00640 1 -- 172.21.15.99:0/4242706630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c0c80d0 con 0x7fa814004800 2024-03-30T13:11:46.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.833+0000 7fa833e00640 1 -- 172.21.15.99:0/4242706630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c0a0520 con 0x7fa814004800 2024-03-30T13:11:46.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.834+0000 7fa829600640 1 -- 172.21.15.99:0/4242706630 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa820004ba0 con 0x7fa814004800 2024-03-30T13:11:46.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.836+0000 7fa829600640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa80c06c530 0x7fa80c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.836+0000 7fa829600640 1 -- 172.21.15.99:0/4242706630 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fa82008b090 con 0x7fa814004800 2024-03-30T13:11:46.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.836+0000 7fa830a00640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa80c06c530 0x7fa80c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.837+0000 7fa830a00640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa80c06c530 0x7fa80c06e9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa818036000 tx=0x7fa81803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:46.840+0000 7fa829600640 1 -- 172.21.15.99:0/4242706630 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa82c151e80 con 0x7fa814004800 2024-03-30T13:11:47.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.039+0000 7fa833e00640 1 -- 172.21.15.99:0/4242706630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa82c04f9d0 con 0x7fa814004800 2024-03-30T13:11:47.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.040+0000 7fa829600640 1 -- 172.21.15.99:0/4242706630 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fa8200595f0 con 0x7fa814004800 2024-03-30T13:11:47.043 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:47.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.042+0000 7fa833e00640 1 -- 172.21.15.99:0/4242706630 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa80c06c530 msgr2=0x7fa80c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.042+0000 7fa833e00640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa80c06c530 0x7fa80c06e9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa818036000 tx=0x7fa81803b040 comp rx=0 tx=0).stop 2024-03-30T13:11:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.042+0000 7fa833e00640 1 -- 172.21.15.99:0/4242706630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 msgr2=0x7fa82c0b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.042+0000 7fa833e00640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 0x7fa82c0b50d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa82000d800 tx=0x7fa82000dcc0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.042+0000 7fa833e00640 1 -- 172.21.15.99:0/4242706630 shutdown_connections 2024-03-30T13:11:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.042+0000 7fa833e00640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa80c06c530 0x7fa80c06e9f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.043+0000 7fa833e00640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c0c8bb0 0x7fa82c15fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.043+0000 7fa833e00640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa82c15a970 0x7fa82c151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.043+0000 7fa833e00640 1 --2- 172.21.15.99:0/4242706630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa814004800 0x7fa82c0b50d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.043+0000 7fa833e00640 1 -- 172.21.15.99:0/4242706630 >> 172.21.15.99:0/4242706630 conn(0x7fa82c0b3fa0 msgr2=0x7fa82c0ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:47.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.043+0000 7fa833e00640 1 -- 172.21.15.99:0/4242706630 shutdown_connections 2024-03-30T13:11:47.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.043+0000 7fa833e00640 1 -- 172.21.15.99:0/4242706630 wait complete. 2024-03-30T13:11:47.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:11:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.267+0000 7ff079000640 1 Processor -- start 2024-03-30T13:11:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.267+0000 7ff079000640 1 -- start start 2024-03-30T13:11:47.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.269+0000 7ff079000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff07415fbc0 0x7ff0740cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.270+0000 7ff079000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0740b38a0 0x7ff07406b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.270+0000 7ff079000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0740ce0f0 con 0x7ff07406ba50 2024-03-30T13:11:47.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.270+0000 7ff079000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff07406bec0 con 0x7ff07415fbc0 2024-03-30T13:11:47.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.270+0000 7ff079000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff0740cec70 con 0x7ff0740b38a0 2024-03-30T13:11:47.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.270+0000 7ff072800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff07406ba50 0x7ff074160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44288/0 (socket says 172.21.15.99:44288) 2024-03-30T13:11:47.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.270+0000 7ff072800640 1 -- 172.21.15.99:0/1196921463 learned_addr learned my addr 172.21.15.99:0/1196921463 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:47.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.270+0000 7ff069400640 1 --2- 172.21.15.99:0/1196921463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0740b38a0 0x7ff07406b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.270+0000 7ff071e00640 1 --2- 172.21.15.99:0/1196921463 >> v2:172.21.15.181:3300/0 conn(0x7ff07415fbc0 0x7ff0740cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.271+0000 7ff071400640 1 -- 172.21.15.99:0/1196921463 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306881993 0 0) 0x7ff0740ce0f0 con 0x7ff07406ba50 2024-03-30T13:11:47.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.271+0000 7ff071400640 1 -- 172.21.15.99:0/1196921463 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff058003520 con 0x7ff07406ba50 2024-03-30T13:11:47.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.271+0000 7ff071400640 1 -- 172.21.15.99:0/1196921463 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1054760420 0 0) 0x7ff058003520 con 0x7ff07406ba50 2024-03-30T13:11:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.271+0000 7ff069400640 1 -- 172.21.15.99:0/1196921463 >> v2:172.21.15.181:3300/0 conn(0x7ff07415fbc0 msgr2=0x7ff0740cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.271+0000 7ff069400640 1 --2- 172.21.15.99:0/1196921463 >> v2:172.21.15.181:3300/0 conn(0x7ff07415fbc0 0x7ff0740cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.271+0000 7ff069400640 1 -- 172.21.15.99:0/1196921463 >> v1:172.21.15.99:6789/0 conn(0x7ff07406ba50 legacy=0x7ff074160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.271+0000 7ff069400640 1 -- 172.21.15.99:0/1196921463 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0740ce3d0 con 0x7ff0740b38a0 2024-03-30T13:11:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.272+0000 7ff069400640 1 --2- 172.21.15.99:0/1196921463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0740b38a0 0x7ff07406b510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0097a0 tx=0x7ff05c02b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da0644683ad5f82 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.273+0000 7ff071400640 1 -- 172.21.15.99:0/1196921463 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c037070 con 0x7ff0740b38a0 2024-03-30T13:11:47.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.273+0000 7ff071400640 1 -- 172.21.15.99:0/1196921463 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05c030510 con 0x7ff0740b38a0 2024-03-30T13:11:47.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.273+0000 7ff071400640 1 -- 172.21.15.99:0/1196921463 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c02be60 con 0x7ff0740b38a0 2024-03-30T13:11:47.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.274+0000 7ff079000640 1 -- 172.21.15.99:0/1196921463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0740b38a0 msgr2=0x7ff07406b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.274+0000 7ff079000640 1 --2- 172.21.15.99:0/1196921463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0740b38a0 0x7ff07406b510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0097a0 tx=0x7ff05c02b660 comp rx=0 tx=0).stop 2024-03-30T13:11:47.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.274+0000 7ff079000640 1 -- 172.21.15.99:0/1196921463 shutdown_connections 2024-03-30T13:11:47.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.274+0000 7ff079000640 1 --2- 172.21.15.99:0/1196921463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff0740b38a0 0x7ff07406b510 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.274+0000 7ff079000640 1 --2- 172.21.15.99:0/1196921463 >> v2:172.21.15.181:3300/0 conn(0x7ff07415fbc0 0x7ff0740cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.274+0000 7ff079000640 1 -- 172.21.15.99:0/1196921463 >> 172.21.15.99:0/1196921463 conn(0x7ff07409aa30 msgr2=0x7ff0740b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:47.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.274+0000 7ff079000640 1 -- 172.21.15.99:0/1196921463 shutdown_connections 2024-03-30T13:11:47.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.274+0000 7ff079000640 1 -- 172.21.15.99:0/1196921463 wait complete. 2024-03-30T13:11:47.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.277+0000 7ff079000640 1 Processor -- start 2024-03-30T13:11:47.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.278+0000 7ff079000640 1 -- start start 2024-03-30T13:11:47.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.280+0000 7ff079000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff07406ba50 0x7ff0740b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.280+0000 7ff079000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0740b38a0 0x7ff0740b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.280+0000 7ff079000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff07415fbc0 0x7ff0740d1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.280+0000 7ff079000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff0740b3d00 con 0x7ff07406ba50 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.280+0000 7ff079000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff0740ce990 con 0x7ff0740b38a0 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.280+0000 7ff079000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff07415ffa0 con 0x7ff07415fbc0 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.280+0000 7ff071e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff07406ba50 0x7ff0740b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.280+0000 7ff071e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff07406ba50 0x7ff0740b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37264/0 (socket says 172.21.15.99:37264) 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.280+0000 7ff071e00640 1 -- 172.21.15.99:0/769197961 learned_addr learned my addr 172.21.15.99:0/769197961 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.280+0000 7ff069400640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0740b38a0 0x7ff0740b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.280+0000 7ff072800640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff07415fbc0 0x7ff0740d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.281+0000 7ff071e00640 1 -- 172.21.15.99:0/769197961 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff07415fbc0 msgr2=0x7ff0740d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.281+0000 7ff071e00640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff07415fbc0 0x7ff0740d1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.281+0000 7ff071e00640 1 -- 172.21.15.99:0/769197961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0740b38a0 msgr2=0x7ff0740b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.281+0000 7ff071e00640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0740b38a0 0x7ff0740b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.281+0000 7ff071e00640 1 -- 172.21.15.99:0/769197961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0740c9620 con 0x7ff07406ba50 2024-03-30T13:11:47.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.281+0000 7ff071e00640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff07406ba50 0x7ff0740b4210 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff06400e9e0 tx=0x7ff06400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.281+0000 7ff06aa00640 1 -- 172.21.15.99:0/769197961 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064017070 con 0x7ff07406ba50 2024-03-30T13:11:47.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.281+0000 7ff06aa00640 1 -- 172.21.15.99:0/769197961 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06400c9d0 con 0x7ff07406ba50 2024-03-30T13:11:47.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.281+0000 7ff079000640 1 -- 172.21.15.99:0/769197961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0740c9900 con 0x7ff07406ba50 2024-03-30T13:11:47.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.281+0000 7ff06aa00640 1 -- 172.21.15.99:0/769197961 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06400cdc0 con 0x7ff07406ba50 2024-03-30T13:11:47.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.282+0000 7ff079000640 1 -- 172.21.15.99:0/769197961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0740c9ec0 con 0x7ff07406ba50 2024-03-30T13:11:47.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.283+0000 7ff079000640 1 -- 172.21.15.99:0/769197961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff074068640 con 0x7ff07406ba50 2024-03-30T13:11:47.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.284+0000 7ff06aa00640 1 -- 172.21.15.99:0/769197961 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff06401a070 con 0x7ff07406ba50 2024-03-30T13:11:47.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.284+0000 7ff06aa00640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff05006c530 0x7ff05006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.285+0000 7ff06aa00640 1 -- 172.21.15.99:0/769197961 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7ff06408bac0 con 0x7ff07406ba50 2024-03-30T13:11:47.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.285+0000 7ff069400640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff05006c530 0x7ff05006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.286+0000 7ff069400640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff05006c530 0x7ff05006e9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0097a0 tx=0x7ff05c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.289+0000 7ff06aa00640 1 -- 172.21.15.99:0/769197961 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff06405a0b0 con 0x7ff07406ba50 2024-03-30T13:11:47.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.503+0000 7ff079000640 1 -- 172.21.15.99:0/769197961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff0740b7320 con 0x7ff07406ba50 2024-03-30T13:11:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.504+0000 7ff06aa00640 1 -- 172.21.15.99:0/769197961 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7ff0640599b0 con 0x7ff07406ba50 2024-03-30T13:11:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-03-30T13:11:47.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.506+0000 7ff079000640 1 -- 172.21.15.99:0/769197961 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff05006c530 msgr2=0x7ff05006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.506+0000 7ff079000640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff05006c530 0x7ff05006e9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0097a0 tx=0x7ff05c008030 comp rx=0 tx=0).stop 2024-03-30T13:11:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.506+0000 7ff079000640 1 -- 172.21.15.99:0/769197961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff07406ba50 msgr2=0x7ff0740b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.506+0000 7ff079000640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff07406ba50 0x7ff0740b4210 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff06400e9e0 tx=0x7ff06400eea0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.506+0000 7ff079000640 1 -- 172.21.15.99:0/769197961 shutdown_connections 2024-03-30T13:11:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.506+0000 7ff079000640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff05006c530 0x7ff05006e9f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.506+0000 7ff079000640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff07415fbc0 0x7ff0740d1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.506+0000 7ff079000640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0740b38a0 0x7ff0740b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.506+0000 7ff079000640 1 --2- 172.21.15.99:0/769197961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff07406ba50 0x7ff0740b4210 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.507+0000 7ff079000640 1 -- 172.21.15.99:0/769197961 >> 172.21.15.99:0/769197961 conn(0x7ff07409aa30 msgr2=0x7ff0740700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:47.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.507+0000 7ff079000640 1 -- 172.21.15.99:0/769197961 shutdown_connections 2024-03-30T13:11:47.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.507+0000 7ff079000640 1 -- 172.21.15.99:0/769197961 wait complete. 2024-03-30T13:11:47.537 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-30T13:11:47.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:47.537 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-30T13:11:47.643 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:11:47.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:47.644 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-30T13:11:47.693 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-30T13:11:47.694 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:47.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.897+0000 7f6f90e00640 1 Processor -- start 2024-03-30T13:11:47.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.897+0000 7f6f90e00640 1 -- start start 2024-03-30T13:11:47.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.900+0000 7f6f90e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f8c0cf500 0x7f6f8c09dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.900+0000 7f6f90e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f8c0ce1c0 0x7f6f8c165f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.901+0000 7f6f90e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c0ceb60 con 0x7f6f8c15c330 2024-03-30T13:11:47.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.901+0000 7f6f90e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6f8c06d650 con 0x7f6f8c0cf500 2024-03-30T13:11:47.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.901+0000 7f6f90e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6f8c0ce6c0 con 0x7f6f8c0ce1c0 2024-03-30T13:11:47.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.901+0000 7f6f8aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f8c0cf500 0x7f6f8c09dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.901+0000 7f6f8aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f8c0cf500 0x7f6f8c09dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37274/0 (socket says 172.21.15.99:37274) 2024-03-30T13:11:47.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.901+0000 7f6f8aa00640 1 -- 172.21.15.99:0/4161819176 learned_addr learned my addr 172.21.15.99:0/4161819176 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:47.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.901+0000 7f6f8be00640 1 --2- 172.21.15.99:0/4161819176 >> v2:172.21.15.181:3300/0 conn(0x7f6f8c0ce1c0 0x7f6f8c165f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.901+0000 7f6f8aa00640 1 -- 172.21.15.99:0/4161819176 >> v2:172.21.15.181:3300/0 conn(0x7f6f8c0ce1c0 msgr2=0x7f6f8c165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:47.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.902+0000 7f6f8aa00640 1 --2- 172.21.15.99:0/4161819176 >> v2:172.21.15.181:3300/0 conn(0x7f6f8c0ce1c0 0x7f6f8c165f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.902+0000 7f6f8aa00640 1 -- 172.21.15.99:0/4161819176 >> v1:172.21.15.181:6789/0 conn(0x7f6f8c15c330 legacy=0x7f6f8c0cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.902+0000 7f6f8aa00640 1 -- 172.21.15.99:0/4161819176 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c0b4d30 con 0x7f6f8c0cf500 2024-03-30T13:11:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.903+0000 7f6f8aa00640 1 --2- 172.21.15.99:0/4161819176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f8c0cf500 0x7f6f8c09dc70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0b3b60 tx=0x7f6f7802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec304a8cfc59ae6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.903+0000 7f6f8a000640 1 -- 172.21.15.99:0/4161819176 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78035020 con 0x7f6f8c0cf500 2024-03-30T13:11:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.903+0000 7f6f8a000640 1 -- 172.21.15.99:0/4161819176 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f78031870 con 0x7f6f8c0cf500 2024-03-30T13:11:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.903+0000 7f6f8a000640 1 -- 172.21.15.99:0/4161819176 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78031c40 con 0x7f6f8c0cf500 2024-03-30T13:11:47.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.904+0000 7f6f90e00640 1 -- 172.21.15.99:0/4161819176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f8c0cf500 msgr2=0x7f6f8c09dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.904+0000 7f6f90e00640 1 --2- 172.21.15.99:0/4161819176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f8c0cf500 0x7f6f8c09dc70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0b3b60 tx=0x7f6f7802b910 comp rx=0 tx=0).stop 2024-03-30T13:11:47.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.904+0000 7f6f90e00640 1 -- 172.21.15.99:0/4161819176 shutdown_connections 2024-03-30T13:11:47.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.904+0000 7f6f90e00640 1 --2- 172.21.15.99:0/4161819176 >> v2:172.21.15.181:3300/0 conn(0x7f6f8c0ce1c0 0x7f6f8c165f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.904+0000 7f6f90e00640 1 --2- 172.21.15.99:0/4161819176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f8c0cf500 0x7f6f8c09dc70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.904+0000 7f6f90e00640 1 -- 172.21.15.99:0/4161819176 >> 172.21.15.99:0/4161819176 conn(0x7f6f8c06bb40 msgr2=0x7f6f8c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:47.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.904+0000 7f6f90e00640 1 -- 172.21.15.99:0/4161819176 shutdown_connections 2024-03-30T13:11:47.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.904+0000 7f6f90e00640 1 -- 172.21.15.99:0/4161819176 wait complete. 2024-03-30T13:11:47.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.906+0000 7f6f90e00640 1 Processor -- start 2024-03-30T13:11:47.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.906+0000 7f6f90e00640 1 -- start start 2024-03-30T13:11:47.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.907+0000 7f6f90e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f8c0ce1c0 0x7f6f8c06dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.907+0000 7f6f90e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f8c0cf500 0x7f6f8c156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.907+0000 7f6f90e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f8c15c330 0x7f6f8c156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.907+0000 7f6f90e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c15c710 con 0x7f6f8c0ce1c0 2024-03-30T13:11:47.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.907+0000 7f6f90e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c0b52f0 con 0x7f6f8c15c330 2024-03-30T13:11:47.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.907+0000 7f6f90e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8c06eaf0 con 0x7f6f8c0cf500 2024-03-30T13:11:47.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.907+0000 7f6f8b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f8c0ce1c0 0x7f6f8c06dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.907+0000 7f6f8b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f8c0ce1c0 0x7f6f8c06dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37284/0 (socket says 172.21.15.99:37284) 2024-03-30T13:11:47.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.907+0000 7f6f8b400640 1 -- 172.21.15.99:0/2859769252 learned_addr learned my addr 172.21.15.99:0/2859769252 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:47.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.908+0000 7f6f8aa00640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f8c0cf500 0x7f6f8c156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.908+0000 7f6f8be00640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f8c15c330 0x7f6f8c156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.908+0000 7f6f8b400640 1 -- 172.21.15.99:0/2859769252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f8c0cf500 msgr2=0x7f6f8c156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.908+0000 7f6f8b400640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f8c0cf500 0x7f6f8c156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.908+0000 7f6f8b400640 1 -- 172.21.15.99:0/2859769252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f8c15c330 msgr2=0x7f6f8c156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.908+0000 7f6f8b400640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f8c15c330 0x7f6f8c156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.908+0000 7f6f8b400640 1 -- 172.21.15.99:0/2859769252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c15ca30 con 0x7f6f8c0ce1c0 2024-03-30T13:11:47.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.908+0000 7f6f8b400640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f8c0ce1c0 0x7f6f8c06dc50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00c3c0 tx=0x7f6f7c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.909+0000 7f6f83400640 1 -- 172.21.15.99:0/2859769252 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c017070 con 0x7f6f8c0ce1c0 2024-03-30T13:11:47.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.909+0000 7f6f83400640 1 -- 172.21.15.99:0/2859769252 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7c0052d0 con 0x7f6f8c0ce1c0 2024-03-30T13:11:47.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.909+0000 7f6f83400640 1 -- 172.21.15.99:0/2859769252 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c003830 con 0x7f6f8c0ce1c0 2024-03-30T13:11:47.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.909+0000 7f6f90e00640 1 -- 172.21.15.99:0/2859769252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8c15cd10 con 0x7f6f8c0ce1c0 2024-03-30T13:11:47.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.909+0000 7f6f90e00640 1 -- 172.21.15.99:0/2859769252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f8c15d2d0 con 0x7f6f8c0ce1c0 2024-03-30T13:11:47.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.910+0000 7f6f90e00640 1 -- 172.21.15.99:0/2859769252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f8c04f8f0 con 0x7f6f8c0ce1c0 2024-03-30T13:11:47.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.911+0000 7f6f83400640 1 -- 172.21.15.99:0/2859769252 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6f7c01a070 con 0x7f6f8c0ce1c0 2024-03-30T13:11:47.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.912+0000 7f6f83400640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f6c06c530 0x7f6f6c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.912+0000 7f6f83400640 1 -- 172.21.15.99:0/2859769252 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f6f7c08aae0 con 0x7f6f8c0ce1c0 2024-03-30T13:11:47.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.912+0000 7f6f8aa00640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f6c06c530 0x7f6f6c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.913+0000 7f6f8aa00640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f6c06c530 0x7f6f6c06e9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f78036000 tx=0x7f6f7803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:47.917+0000 7f6f83400640 1 -- 172.21.15.99:0/2859769252 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6f7c059040 con 0x7f6f8c0ce1c0 2024-03-30T13:11:48.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.159+0000 7f6f90e00640 1 -- 172.21.15.99:0/2859769252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f8c15b430 con 0x7f6f8c0ce1c0 2024-03-30T13:11:48.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.160+0000 7f6f83400640 1 -- 172.21.15.99:0/2859769252 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f6f7c058940 con 0x7f6f8c0ce1c0 2024-03-30T13:11:48.163 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:48.163 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2695284429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2695284429},{"type":"v1","addr":"172.21.15.181:6835","nonce":2695284429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1658040869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1658040869},{"type":"v1","addr":"172.21.15.181:6833","nonce":1658040869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/951752489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":951752489},{"type":"v1","addr":"172.21.15.99:6835","nonce":951752489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:10:45.658137+0000","modified":"2024-03-30T13:10:48.749437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/245796495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":245796495},{"type":"v1","addr":"172.21.15.99:6837","nonce":245796495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-03-30T13:11:48.163 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-03-30T13:11:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 -- 172.21.15.99:0/2859769252 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f6c06c530 msgr2=0x7f6f6c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f6c06c530 0x7f6f6c06e9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f78036000 tx=0x7f6f7803c040 comp rx=0 tx=0).stop 2024-03-30T13:11:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 -- 172.21.15.99:0/2859769252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f8c0ce1c0 msgr2=0x7f6f8c06dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f8c0ce1c0 0x7f6f8c06dc50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00c3c0 tx=0x7f6f7c00c880 comp rx=0 tx=0).stop 2024-03-30T13:11:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 -- 172.21.15.99:0/2859769252 shutdown_connections 2024-03-30T13:11:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f6c06c530 0x7f6f6c06e9f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f8c15c330 0x7f6f8c156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f8c0cf500 0x7f6f8c156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 --2- 172.21.15.99:0/2859769252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f8c0ce1c0 0x7f6f8c06dc50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 -- 172.21.15.99:0/2859769252 >> 172.21.15.99:0/2859769252 conn(0x7f6f8c06bb40 msgr2=0x7f6f8c0ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 -- 172.21.15.99:0/2859769252 shutdown_connections 2024-03-30T13:11:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.162+0000 7f6f90e00640 1 -- 172.21.15.99:0/2859769252 wait complete. 2024-03-30T13:11:48.183 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:48.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.381+0000 7f18cdc00640 1 Processor -- start 2024-03-30T13:11:48.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.381+0000 7f18cdc00640 1 -- start start 2024-03-30T13:11:48.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.382+0000 7f18cdc00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f18c815b370 0x7f18c80b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.383+0000 7f18cdc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f18c806f3f0 0x7f18c8072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.383+0000 7f18cdc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c8071ae0 con 0x7f18c80730c0 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.383+0000 7f18cdc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f18c8071dc0 con 0x7f18c806f3f0 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.383+0000 7f18cdc00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f18c80720a0 con 0x7f18c815b370 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.383+0000 7f18c7400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f18c80730c0 0x7f18c80ae020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44298/0 (socket says 172.21.15.99:44298) 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.383+0000 7f18c7400640 1 -- 172.21.15.99:0/1935638501 learned_addr learned my addr 172.21.15.99:0/1935638501 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.383+0000 7f18c6000640 1 --2- 172.21.15.99:0/1935638501 >> v2:172.21.15.99:3300/0 conn(0x7f18c806f3f0 0x7f18c8072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.383+0000 7f18c6a00640 1 --2- 172.21.15.99:0/1935638501 >> v2:172.21.15.181:3300/0 conn(0x7f18c815b370 0x7f18c80b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.383+0000 7f18c5600640 1 -- 172.21.15.99:0/1935638501 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1994156129 0 0) 0x7f18c8071ae0 con 0x7f18c80730c0 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.383+0000 7f18c5600640 1 -- 172.21.15.99:0/1935638501 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18ac003520 con 0x7f18c80730c0 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.384+0000 7f18c6000640 1 -- 172.21.15.99:0/1935638501 >> v2:172.21.15.181:3300/0 conn(0x7f18c815b370 msgr2=0x7f18c80b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.384+0000 7f18c6000640 1 --2- 172.21.15.99:0/1935638501 >> v2:172.21.15.181:3300/0 conn(0x7f18c815b370 0x7f18c80b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.384+0000 7f18c6000640 1 -- 172.21.15.99:0/1935638501 >> v1:172.21.15.99:6789/0 conn(0x7f18c80730c0 legacy=0x7f18c80ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.384+0000 7f18c6000640 1 -- 172.21.15.99:0/1935638501 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c8072380 con 0x7f18c806f3f0 2024-03-30T13:11:48.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.385+0000 7f18c6000640 1 --2- 172.21.15.99:0/1935638501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18c806f3f0 0x7f18c8072b80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f18c80d12e0 tx=0x7f18b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a46ea9bc296261 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:48.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.385+0000 7f18c5600640 1 -- 172.21.15.99:0/1935638501 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4035020 con 0x7f18c806f3f0 2024-03-30T13:11:48.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.385+0000 7f18c5600640 1 -- 172.21.15.99:0/1935638501 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b4031830 con 0x7f18c806f3f0 2024-03-30T13:11:48.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.385+0000 7f18c5600640 1 -- 172.21.15.99:0/1935638501 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4031be0 con 0x7f18c806f3f0 2024-03-30T13:11:48.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.386+0000 7f18cdc00640 1 -- 172.21.15.99:0/1935638501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18c806f3f0 msgr2=0x7f18c8072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.386+0000 7f18cdc00640 1 --2- 172.21.15.99:0/1935638501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18c806f3f0 0x7f18c8072b80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f18c80d12e0 tx=0x7f18b402b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.386+0000 7f18cdc00640 1 -- 172.21.15.99:0/1935638501 shutdown_connections 2024-03-30T13:11:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.386+0000 7f18cdc00640 1 --2- 172.21.15.99:0/1935638501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18c806f3f0 0x7f18c8072b80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.386+0000 7f18cdc00640 1 --2- 172.21.15.99:0/1935638501 >> v2:172.21.15.181:3300/0 conn(0x7f18c815b370 0x7f18c80b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.386+0000 7f18cdc00640 1 -- 172.21.15.99:0/1935638501 >> 172.21.15.99:0/1935638501 conn(0x7f18c806b510 msgr2=0x7f18c806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.386+0000 7f18cdc00640 1 -- 172.21.15.99:0/1935638501 shutdown_connections 2024-03-30T13:11:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.386+0000 7f18cdc00640 1 -- 172.21.15.99:0/1935638501 wait complete. 2024-03-30T13:11:48.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.388+0000 7f18cdc00640 1 Processor -- start 2024-03-30T13:11:48.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.388+0000 7f18cdc00640 1 -- start start 2024-03-30T13:11:48.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18cdc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18c806f3f0 0x7f18c81f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18cdc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18c80730c0 0x7f18c80cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18cdc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18c815b370 0x7f18c80ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18cdc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f18c80b3800 con 0x7f18c815b370 2024-03-30T13:11:48.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18cdc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8073550 con 0x7f18c80730c0 2024-03-30T13:11:48.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18cdc00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f18c80b3980 con 0x7f18c806f3f0 2024-03-30T13:11:48.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18c7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18c815b370 0x7f18c80ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18c7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18c815b370 0x7f18c80ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37312/0 (socket says 172.21.15.99:37312) 2024-03-30T13:11:48.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18c7400640 1 -- 172.21.15.99:0/1433626189 learned_addr learned my addr 172.21.15.99:0/1433626189 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:48.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18c6a00640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18c806f3f0 0x7f18c81f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18c7400640 1 -- 172.21.15.99:0/1433626189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18c806f3f0 msgr2=0x7f18c81f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18c7400640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18c806f3f0 0x7f18c81f4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18c7400640 1 -- 172.21.15.99:0/1433626189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18c80730c0 msgr2=0x7f18c80cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18c7400640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18c80730c0 0x7f18c80cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.389+0000 7f18c7400640 1 -- 172.21.15.99:0/1433626189 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c80cce20 con 0x7f18c815b370 2024-03-30T13:11:48.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.390+0000 7f18c7400640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18c815b370 0x7f18c80ca690 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f18c000cb40 tx=0x7f18c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:48.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.390+0000 7f18bea00640 1 -- 172.21.15.99:0/1433626189 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0017070 con 0x7f18c815b370 2024-03-30T13:11:48.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.390+0000 7f18bea00640 1 -- 172.21.15.99:0/1433626189 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c000aca0 con 0x7f18c815b370 2024-03-30T13:11:48.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.390+0000 7f18cdc00640 1 -- 172.21.15.99:0/1433626189 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c80cd0e0 con 0x7f18c815b370 2024-03-30T13:11:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.390+0000 7f18bea00640 1 -- 172.21.15.99:0/1433626189 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0012620 con 0x7f18c815b370 2024-03-30T13:11:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.390+0000 7f18cdc00640 1 -- 172.21.15.99:0/1433626189 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c8158bb0 con 0x7f18c815b370 2024-03-30T13:11:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.392+0000 7f18cdc00640 1 -- 172.21.15.99:0/1433626189 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c8068640 con 0x7f18c815b370 2024-03-30T13:11:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.392+0000 7f18bea00640 1 -- 172.21.15.99:0/1433626189 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f18c001a070 con 0x7f18c815b370 2024-03-30T13:11:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.393+0000 7f18bea00640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18a806c530 0x7f18a806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.393+0000 7f18bea00640 1 -- 172.21.15.99:0/1433626189 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f18c008b5b0 con 0x7f18c815b370 2024-03-30T13:11:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.393+0000 7f18c6a00640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18a806c530 0x7f18a806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.394+0000 7f18c6a00640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18a806c530 0x7f18a806e9f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f18b8006fd0 tx=0x7f18b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:48.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.398+0000 7f18bea00640 1 -- 172.21.15.99:0/1433626189 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f18c0059bb0 con 0x7f18c815b370 2024-03-30T13:11:48.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.700+0000 7f18cdc00640 1 -- 172.21.15.99:0/1433626189 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18c8158720 con 0x7f18c815b370 2024-03-30T13:11:48.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.703+0000 7f18bea00640 1 -- 172.21.15.99:0/1433626189 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16658 (secure 0 0 0) 0x7f18c00594b0 con 0x7f18c815b370 2024-03-30T13:11:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:48.706 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:26.555726+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.38","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:48.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.705+0000 7f18cdc00640 1 -- 172.21.15.99:0/1433626189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18a806c530 msgr2=0x7f18a806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.705+0000 7f18cdc00640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18a806c530 0x7f18a806e9f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f18b8006fd0 tx=0x7f18b8008040 comp rx=0 tx=0).stop 2024-03-30T13:11:48.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.706+0000 7f18cdc00640 1 -- 172.21.15.99:0/1433626189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18c815b370 msgr2=0x7f18c80ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.706+0000 7f18cdc00640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18c815b370 0x7f18c80ca690 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f18c000cb40 tx=0x7f18c000a060 comp rx=0 tx=0).stop 2024-03-30T13:11:48.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.706+0000 7f18cdc00640 1 -- 172.21.15.99:0/1433626189 shutdown_connections 2024-03-30T13:11:48.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.706+0000 7f18cdc00640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18a806c530 0x7f18a806e9f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.706+0000 7f18cdc00640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18c815b370 0x7f18c80ca690 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.706+0000 7f18cdc00640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18c80730c0 0x7f18c80cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.706+0000 7f18cdc00640 1 --2- 172.21.15.99:0/1433626189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18c806f3f0 0x7f18c81f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.706+0000 7f18cdc00640 1 -- 172.21.15.99:0/1433626189 >> 172.21.15.99:0/1433626189 conn(0x7f18c806b510 msgr2=0x7f18c80b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:48.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.706+0000 7f18cdc00640 1 -- 172.21.15.99:0/1433626189 shutdown_connections 2024-03-30T13:11:48.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.706+0000 7f18cdc00640 1 -- 172.21.15.99:0/1433626189 wait complete. 2024-03-30T13:11:48.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:10:43.737951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:10:44.625172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:48.733 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:48.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.942+0000 7f8bef200640 1 Processor -- start 2024-03-30T13:11:48.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.942+0000 7f8bef200640 1 -- start start 2024-03-30T13:11:48.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.944+0000 7f8bef200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8be80ca950 0x7f8be80b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.944+0000 7f8bef200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8be80b26f0 0x7f8be815be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.944+0000 7f8bef200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8be80cade0 con 0x7f8be815b3d0 2024-03-30T13:11:48.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.944+0000 7f8bef200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8be80b2b60 con 0x7f8be80ca950 2024-03-30T13:11:48.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.944+0000 7f8bef200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8be80c6240 con 0x7f8be80b26f0 2024-03-30T13:11:48.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.944+0000 7f8bdf400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8be80ca950 0x7f8be80b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.944+0000 7f8be7e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8be815b3d0 0x7f8be80b49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44304/0 (socket says 172.21.15.99:44304) 2024-03-30T13:11:48.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.944+0000 7f8bdf400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8be80ca950 0x7f8be80b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37322/0 (socket says 172.21.15.99:37322) 2024-03-30T13:11:48.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.944+0000 7f8be7e00640 1 -- 172.21.15.99:0/1453715681 learned_addr learned my addr 172.21.15.99:0/1453715681 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.945+0000 7f8bdf400640 1 -- 172.21.15.99:0/1453715681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8be80b26f0 msgr2=0x7f8be815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.945+0000 7f8bdf400640 1 --2- 172.21.15.99:0/1453715681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8be80b26f0 0x7f8be815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.945+0000 7f8bdf400640 1 -- 172.21.15.99:0/1453715681 >> v1:172.21.15.99:6789/0 conn(0x7f8be815b3d0 legacy=0x7f8be80b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.945+0000 7f8bdf400640 1 -- 172.21.15.99:0/1453715681 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be80c6470 con 0x7f8be80ca950 2024-03-30T13:11:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.945+0000 7f8be7400640 1 -- 172.21.15.99:0/1453715681 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314158529 0 0) 0x7f8be80cade0 con 0x7f8be815b3d0 2024-03-30T13:11:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.946+0000 7f8bdf400640 1 --2- 172.21.15.99:0/1453715681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8be80ca950 0x7f8be80b21b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00097a0 tx=0x7f8bd002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c108984bb26dfed1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:48.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.946+0000 7f8be7400640 1 -- 172.21.15.99:0/1453715681 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0035020 con 0x7f8be80ca950 2024-03-30T13:11:48.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.946+0000 7f8be7400640 1 -- 172.21.15.99:0/1453715681 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd0031830 con 0x7f8be80ca950 2024-03-30T13:11:48.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.946+0000 7f8be7400640 1 -- 172.21.15.99:0/1453715681 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0031c00 con 0x7f8be80ca950 2024-03-30T13:11:48.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.947+0000 7f8bef200640 1 -- 172.21.15.99:0/1453715681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8be80ca950 msgr2=0x7f8be80b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.947+0000 7f8bef200640 1 --2- 172.21.15.99:0/1453715681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8be80ca950 0x7f8be80b21b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00097a0 tx=0x7f8bd002b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.947+0000 7f8bef200640 1 -- 172.21.15.99:0/1453715681 shutdown_connections 2024-03-30T13:11:48.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.947+0000 7f8bef200640 1 --2- 172.21.15.99:0/1453715681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8be80b26f0 0x7f8be815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.947+0000 7f8bef200640 1 --2- 172.21.15.99:0/1453715681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8be80ca950 0x7f8be80b21b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.947+0000 7f8bef200640 1 -- 172.21.15.99:0/1453715681 >> 172.21.15.99:0/1453715681 conn(0x7f8be80d0450 msgr2=0x7f8be80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:48.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.947+0000 7f8bef200640 1 -- 172.21.15.99:0/1453715681 shutdown_connections 2024-03-30T13:11:48.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.947+0000 7f8bef200640 1 -- 172.21.15.99:0/1453715681 wait complete. 2024-03-30T13:11:48.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.949+0000 7f8bef200640 1 Processor -- start 2024-03-30T13:11:48.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.949+0000 7f8bef200640 1 -- start start 2024-03-30T13:11:48.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.950+0000 7f8bef200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8be80b26f0 0x7f8be80c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.950+0000 7f8bef200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8be80ca950 0x7f8be809c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.950+0000 7f8bef200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8be815b3d0 0x7f8be809ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.950+0000 7f8bef200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8be80c6a30 con 0x7f8be80ca950 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.950+0000 7f8bef200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8be80c7080 con 0x7f8be815b3d0 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.950+0000 7f8bef200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8be80c6d10 con 0x7f8be80b26f0 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.950+0000 7f8bdf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8be80ca950 0x7f8be809c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.950+0000 7f8bdf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8be80ca950 0x7f8be809c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37328/0 (socket says 172.21.15.99:37328) 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.950+0000 7f8bdf400640 1 -- 172.21.15.99:0/23120885 learned_addr learned my addr 172.21.15.99:0/23120885 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.950+0000 7f8be7e00640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8be80b26f0 0x7f8be80c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8bed200640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8be815b3d0 0x7f8be809ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8bdf400640 1 -- 172.21.15.99:0/23120885 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8be80b26f0 msgr2=0x7f8be80c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8bdf400640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8be80b26f0 0x7f8be80c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8bdf400640 1 -- 172.21.15.99:0/23120885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8be815b3d0 msgr2=0x7f8be809ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8bdf400640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8be815b3d0 0x7f8be809ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8bdf400640 1 -- 172.21.15.99:0/23120885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be809d7a0 con 0x7f8be80ca950 2024-03-30T13:11:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8bed200640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8be815b3d0 0x7f8be809ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8bdf400640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8be80ca950 0x7f8be809c920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8bd002bee0 tx=0x7f8bd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8be4c00640 1 -- 172.21.15.99:0/23120885 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd003bbf0 con 0x7f8be80ca950 2024-03-30T13:11:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8be4c00640 1 -- 172.21.15.99:0/23120885 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd003bd90 con 0x7f8be80ca950 2024-03-30T13:11:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8bef200640 1 -- 172.21.15.99:0/23120885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be809da80 con 0x7f8be80ca950 2024-03-30T13:11:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.951+0000 7f8be4c00640 1 -- 172.21.15.99:0/23120885 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0045630 con 0x7f8be80ca950 2024-03-30T13:11:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.952+0000 7f8bef200640 1 -- 172.21.15.99:0/23120885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be80c7c10 con 0x7f8be80ca950 2024-03-30T13:11:48.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.953+0000 7f8bef200640 1 -- 172.21.15.99:0/23120885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be809e520 con 0x7f8be80ca950 2024-03-30T13:11:48.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.954+0000 7f8be4c00640 1 -- 172.21.15.99:0/23120885 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8bd0038020 con 0x7f8be80ca950 2024-03-30T13:11:48.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.955+0000 7f8be4c00640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8bc406c530 0x7f8bc406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.955+0000 7f8be4c00640 1 -- 172.21.15.99:0/23120885 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f8bd00ad500 con 0x7f8be80ca950 2024-03-30T13:11:48.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.956+0000 7f8be7e00640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8bc406c530 0x7f8bc406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.956+0000 7f8be7e00640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8bc406c530 0x7f8bc406e9f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80012e0 tx=0x7f8bd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:48.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:48.960+0000 7f8be4c00640 1 -- 172.21.15.99:0/23120885 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8bd0040070 con 0x7f8be80ca950 2024-03-30T13:11:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.257+0000 7f8bef200640 1 -- 172.21.15.99:0/23120885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8be804f9d0 con 0x7f8be80ca950 2024-03-30T13:11:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.258+0000 7f8be4c00640 1 -- 172.21.15.99:0/23120885 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f8bd007bb70 con 0x7f8be80ca950 2024-03-30T13:11:49.261 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:11:49.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 -- 172.21.15.99:0/23120885 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8bc406c530 msgr2=0x7f8bc406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8bc406c530 0x7f8bc406e9f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80012e0 tx=0x7f8bd8009040 comp rx=0 tx=0).stop 2024-03-30T13:11:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 -- 172.21.15.99:0/23120885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8be80ca950 msgr2=0x7f8be809c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8be80ca950 0x7f8be809c920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8bd002bee0 tx=0x7f8bd00046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 -- 172.21.15.99:0/23120885 shutdown_connections 2024-03-30T13:11:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8bc406c530 0x7f8bc406e9f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8be815b3d0 0x7f8be809ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8be80ca950 0x7f8be809c920 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 --2- 172.21.15.99:0/23120885 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8be80b26f0 0x7f8be80c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 -- 172.21.15.99:0/23120885 >> 172.21.15.99:0/23120885 conn(0x7f8be80d0450 msgr2=0x7f8be80c5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 -- 172.21.15.99:0/23120885 shutdown_connections 2024-03-30T13:11:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.260+0000 7f8bef200640 1 -- 172.21.15.99:0/23120885 wait complete. 2024-03-30T13:11:49.281 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.469+0000 7f85e3e00640 1 Processor -- start 2024-03-30T13:11:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.469+0000 7f85e3e00640 1 -- start start 2024-03-30T13:11:49.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.470+0000 7f85e3e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85e4145ed0 0x7f85e415cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.470+0000 7f85e3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85e406bc20 0x7f85e409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e3e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e40b34d0 con 0x7f85e40ae130 2024-03-30T13:11:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e3e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f85e40b37b0 con 0x7f85e406bc20 2024-03-30T13:11:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e3e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f85e40b3a90 con 0x7f85e4145ed0 2024-03-30T13:11:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85e406bc20 0x7f85e409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85e406bc20 0x7f85e409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37344/0 (socket says 172.21.15.99:37344) 2024-03-30T13:11:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e3400640 1 -- 172.21.15.99:0/4148731663 learned_addr learned my addr 172.21.15.99:0/4148731663 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e2000640 1 --1- 172.21.15.99:0/4148731663 >> v1:172.21.15.99:6789/0 conn(0x7f85e40ae130 0x7f85e406b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44316/0 (socket says 172.21.15.99:44316) 2024-03-30T13:11:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e2a00640 1 --2- 172.21.15.99:0/4148731663 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85e4145ed0 0x7f85e415cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e3400640 1 -- 172.21.15.99:0/4148731663 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85e4145ed0 msgr2=0x7f85e415cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e3400640 1 --2- 172.21.15.99:0/4148731663 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85e4145ed0 0x7f85e415cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e3400640 1 -- 172.21.15.99:0/4148731663 >> v1:172.21.15.99:6789/0 conn(0x7f85e40ae130 legacy=0x7f85e406b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e3400640 1 -- 172.21.15.99:0/4148731663 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e40b1630 con 0x7f85e406bc20 2024-03-30T13:11:49.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.471+0000 7f85e2a00640 1 --2- 172.21.15.99:0/4148731663 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85e4145ed0 0x7f85e415cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.472+0000 7f85e3400640 1 --2- 172.21.15.99:0/4148731663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85e406bc20 0x7f85e409aa30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009e50 tx=0x7f85dc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6391e458703ac68 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.473+0000 7f85e1600640 1 -- 172.21.15.99:0/4148731663 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc02cb00 con 0x7f85e406bc20 2024-03-30T13:11:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.473+0000 7f85e1600640 1 -- 172.21.15.99:0/4148731663 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc02cca0 con 0x7f85e406bc20 2024-03-30T13:11:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.473+0000 7f85e1600640 1 -- 172.21.15.99:0/4148731663 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc034610 con 0x7f85e406bc20 2024-03-30T13:11:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.473+0000 7f85e3e00640 1 -- 172.21.15.99:0/4148731663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85e406bc20 msgr2=0x7f85e409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.473+0000 7f85e3e00640 1 --2- 172.21.15.99:0/4148731663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85e406bc20 0x7f85e409aa30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009e50 tx=0x7f85dc02bf60 comp rx=0 tx=0).stop 2024-03-30T13:11:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.473+0000 7f85e3e00640 1 -- 172.21.15.99:0/4148731663 shutdown_connections 2024-03-30T13:11:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.473+0000 7f85e3e00640 1 --2- 172.21.15.99:0/4148731663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85e406bc20 0x7f85e409aa30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.473+0000 7f85e3e00640 1 --2- 172.21.15.99:0/4148731663 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85e4145ed0 0x7f85e415cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.473+0000 7f85e3e00640 1 -- 172.21.15.99:0/4148731663 >> 172.21.15.99:0/4148731663 conn(0x7f85e4072bb0 msgr2=0x7f85e40b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.474+0000 7f85e3e00640 1 -- 172.21.15.99:0/4148731663 shutdown_connections 2024-03-30T13:11:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.474+0000 7f85e3e00640 1 -- 172.21.15.99:0/4148731663 wait complete. 2024-03-30T13:11:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.476+0000 7f85e3e00640 1 Processor -- start 2024-03-30T13:11:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.476+0000 7f85e3e00640 1 -- start start 2024-03-30T13:11:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.478+0000 7f85e3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85e406bc20 0x7f85e40b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.478+0000 7f85e3e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85e40ae130 0x7f85e40b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.478+0000 7f85e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85e4145ed0 0x7f85e415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.478+0000 7f85e3e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f85e40b1fb0 con 0x7f85e4145ed0 2024-03-30T13:11:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.478+0000 7f85e3e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f85e40b1e30 con 0x7f85e406bc20 2024-03-30T13:11:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.478+0000 7f85e3e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f85e40b2130 con 0x7f85e40ae130 2024-03-30T13:11:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.478+0000 7f85e3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85e4145ed0 0x7f85e415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.478+0000 7f85e3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85e4145ed0 0x7f85e415b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37360/0 (socket says 172.21.15.99:37360) 2024-03-30T13:11:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.478+0000 7f85e3400640 1 -- 172.21.15.99:0/1310378351 learned_addr learned my addr 172.21.15.99:0/1310378351 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85e2000640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85e40ae130 0x7f85e40b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85e2a00640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85e406bc20 0x7f85e40b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85e3400640 1 -- 172.21.15.99:0/1310378351 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85e40ae130 msgr2=0x7f85e40b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85e3400640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85e40ae130 0x7f85e40b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85e3400640 1 -- 172.21.15.99:0/1310378351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85e406bc20 msgr2=0x7f85e40b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85e3400640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85e406bc20 0x7f85e40b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85e3400640 1 -- 172.21.15.99:0/1310378351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e40b4910 con 0x7f85e4145ed0 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85e3400640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85e4145ed0 0x7f85e415b8c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009e50 tx=0x7f85dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85daa00640 1 -- 172.21.15.99:0/1310378351 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc043020 con 0x7f85e4145ed0 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85daa00640 1 -- 172.21.15.99:0/1310378351 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc02ce50 con 0x7f85e4145ed0 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85daa00640 1 -- 172.21.15.99:0/1310378351 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc009510 con 0x7f85e4145ed0 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.479+0000 7f85e3e00640 1 -- 172.21.15.99:0/1310378351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e40b4bf0 con 0x7f85e4145ed0 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.480+0000 7f85e3e00640 1 -- 172.21.15.99:0/1310378351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e40b51b0 con 0x7f85e4145ed0 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.481+0000 7f85e3e00640 1 -- 172.21.15.99:0/1310378351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e404f8f0 con 0x7f85e4145ed0 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.482+0000 7f85daa00640 1 -- 172.21.15.99:0/1310378351 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f85dc046020 con 0x7f85e4145ed0 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.482+0000 7f85daa00640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f85c406c530 0x7f85c406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.482+0000 7f85daa00640 1 -- 172.21.15.99:0/1310378351 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f85dc0ade60 con 0x7f85e4145ed0 2024-03-30T13:11:49.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.483+0000 7f85e2a00640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f85c406c530 0x7f85c406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.483+0000 7f85e2a00640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f85c406c530 0x7f85c406e9f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f85d400b840 tx=0x7f85d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.487+0000 7f85daa00640 1 -- 172.21.15.99:0/1310378351 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f85dc04d030 con 0x7f85e4145ed0 2024-03-30T13:11:49.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.679+0000 7f85e3e00640 1 -- 172.21.15.99:0/1310378351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f85e40b4600 con 0x7f85e4145ed0 2024-03-30T13:11:49.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.680+0000 7f85daa00640 1 -- 172.21.15.99:0/1310378351 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f85dc07c450 con 0x7f85e4145ed0 2024-03-30T13:11:49.683 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:11:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.682+0000 7f85e3e00640 1 -- 172.21.15.99:0/1310378351 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f85c406c530 msgr2=0x7f85c406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.682+0000 7f85e3e00640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f85c406c530 0x7f85c406e9f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f85d400b840 tx=0x7f85d4008040 comp rx=0 tx=0).stop 2024-03-30T13:11:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.682+0000 7f85e3e00640 1 -- 172.21.15.99:0/1310378351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85e4145ed0 msgr2=0x7f85e415b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.682+0000 7f85e3e00640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85e4145ed0 0x7f85e415b8c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009e50 tx=0x7f85dc004a40 comp rx=0 tx=0).stop 2024-03-30T13:11:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.682+0000 7f85e3e00640 1 -- 172.21.15.99:0/1310378351 shutdown_connections 2024-03-30T13:11:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.682+0000 7f85e3e00640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f85c406c530 0x7f85c406e9f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.682+0000 7f85e3e00640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85e4145ed0 0x7f85e415b8c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.682+0000 7f85e3e00640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85e40ae130 0x7f85e40b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.682+0000 7f85e3e00640 1 --2- 172.21.15.99:0/1310378351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85e406bc20 0x7f85e40b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.682+0000 7f85e3e00640 1 -- 172.21.15.99:0/1310378351 >> 172.21.15.99:0/1310378351 conn(0x7f85e4072bb0 msgr2=0x7f85e415eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.683+0000 7f85e3e00640 1 -- 172.21.15.99:0/1310378351 shutdown_connections 2024-03-30T13:11:49.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.683+0000 7f85e3e00640 1 -- 172.21.15.99:0/1310378351 wait complete. 2024-03-30T13:11:49.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:49.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.919+0000 7f4d35c00640 1 Processor -- start 2024-03-30T13:11:49.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.919+0000 7f4d35c00640 1 -- start start 2024-03-30T13:11:49.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.921+0000 7f4d35c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4d3015b3d0 0x7f4d300ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.921+0000 7f4d35c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300b28c0 0x7f4d300b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.921+0000 7f4d35c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d300c6470 con 0x7f4d300b49f0 2024-03-30T13:11:49.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.921+0000 7f4d35c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4d300c6240 con 0x7f4d3015b3d0 2024-03-30T13:11:49.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.921+0000 7f4d35c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4d300c7080 con 0x7f4d300b28c0 2024-03-30T13:11:49.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.921+0000 7f4d26000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4d300b49f0 0x7f4d300b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44318/0 (socket says 172.21.15.99:44318) 2024-03-30T13:11:49.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.921+0000 7f4d26000640 1 -- 172.21.15.99:0/827739364 learned_addr learned my addr 172.21.15.99:0/827739364 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:49.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2ea00640 1 --2- 172.21.15.99:0/827739364 >> v2:172.21.15.181:3300/0 conn(0x7f4d3015b3d0 0x7f4d300ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2f400640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300b28c0 0x7f4d300b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926932728 0 0) 0x7f4d300c6470 con 0x7f4d300b49f0 2024-03-30T13:11:49.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d14005730 con 0x7f4d300b49f0 2024-03-30T13:11:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4207140754 0 0) 0x7f4d14005730 con 0x7f4d300b49f0 2024-03-30T13:11:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300b28c0 msgr2=0x7f4d300b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300b28c0 0x7f4d300b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 >> v2:172.21.15.181:3300/0 conn(0x7f4d3015b3d0 msgr2=0x7f4d300ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 --2- 172.21.15.99:0/827739364 >> v2:172.21.15.181:3300/0 conn(0x7f4d3015b3d0 0x7f4d300ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d300c6750 con 0x7f4d300b49f0 2024-03-30T13:11:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f4d18001670 con 0x7f4d300b49f0 2024-03-30T13:11:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 >> v1:172.21.15.99:6789/0 conn(0x7f4d300b49f0 legacy=0x7f4d300b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d14005bc0 0x7f4d14005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d14006a10 0x7f4d14006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300b28c0 0x7f4d140073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300c7080 con 0x7f4d14006a10 2024-03-30T13:11:49.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1400dbd0 con 0x7f4d14005bc0 2024-03-30T13:11:49.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.922+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1400dd50 con 0x7f4d300b28c0 2024-03-30T13:11:49.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.923+0000 7f4d26000640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d14006a10 0x7f4d14006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.923+0000 7f4d2f400640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300b28c0 0x7f4d140073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.923+0000 7f4d2ea00640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d14005bc0 0x7f4d14005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.923+0000 7f4d26000640 1 -- 172.21.15.99:0/827739364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300b28c0 msgr2=0x7f4d140073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.923+0000 7f4d26000640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300b28c0 0x7f4d140073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.923+0000 7f4d26000640 1 -- 172.21.15.99:0/827739364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d14005bc0 msgr2=0x7f4d14005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.923+0000 7f4d26000640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d14005bc0 0x7f4d14005fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.923+0000 7f4d26000640 1 -- 172.21.15.99:0/827739364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d14005730 con 0x7f4d14006a10 2024-03-30T13:11:49.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.924+0000 7f4d26000640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d14006a10 0x7f4d14006e90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800c270 tx=0x7f4d14007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acb5adb6e484bbd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.925+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18007d30 con 0x7f4d14006a10 2024-03-30T13:11:49.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.925+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d18030070 con 0x7f4d14006a10 2024-03-30T13:11:49.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.925+0000 7f4d2e000640 1 -- 172.21.15.99:0/827739364 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1802cd60 con 0x7f4d14006a10 2024-03-30T13:11:49.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.925+0000 7f4d35c00640 1 -- 172.21.15.99:0/827739364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d14006a10 msgr2=0x7f4d14006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.925+0000 7f4d35c00640 1 --2- 172.21.15.99:0/827739364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d14006a10 0x7f4d14006e90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800c270 tx=0x7f4d14007a40 comp rx=0 tx=0).stop 2024-03-30T13:11:49.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.925+0000 7f4d2f400640 1 -- 172.21.15.99:0/827739364 reap_dead start 2024-03-30T13:11:49.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.925+0000 7f4d35c00640 1 -- 172.21.15.99:0/827739364 shutdown_connections 2024-03-30T13:11:49.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.925+0000 7f4d35c00640 1 -- 172.21.15.99:0/827739364 >> 172.21.15.99:0/827739364 conn(0x7f4d300d0450 msgr2=0x7f4d300d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.925+0000 7f4d35c00640 1 -- 172.21.15.99:0/827739364 shutdown_connections 2024-03-30T13:11:49.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.926+0000 7f4d35c00640 1 -- 172.21.15.99:0/827739364 wait complete. 2024-03-30T13:11:49.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.927+0000 7f4d35c00640 1 Processor -- start 2024-03-30T13:11:49.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.927+0000 7f4d35c00640 1 -- start start 2024-03-30T13:11:49.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.928+0000 7f4d35c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d14006a10 0x7f4d3015e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.928+0000 7f4d35c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d30154740 0x7f4d300ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.928+0000 7f4d35c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300ad6e0 0x7f4d300adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.928+0000 7f4d35c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3015b7b0 con 0x7f4d30154740 2024-03-30T13:11:49.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.928+0000 7f4d35c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300c6d10 con 0x7f4d14006a10 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.928+0000 7f4d35c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4d3015b930 con 0x7f4d300ad6e0 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.929+0000 7f4d26000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d30154740 0x7f4d300ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.929+0000 7f4d26000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d30154740 0x7f4d300ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37390/0 (socket says 172.21.15.99:37390) 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.929+0000 7f4d26000640 1 -- 172.21.15.99:0/2304521752 learned_addr learned my addr 172.21.15.99:0/2304521752 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.929+0000 7f4d2ea00640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d14006a10 0x7f4d3015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.929+0000 7f4d2f400640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300ad6e0 0x7f4d300adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.929+0000 7f4d26000640 1 -- 172.21.15.99:0/2304521752 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300ad6e0 msgr2=0x7f4d300adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.929+0000 7f4d26000640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300ad6e0 0x7f4d300adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.929+0000 7f4d26000640 1 -- 172.21.15.99:0/2304521752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d14006a10 msgr2=0x7f4d3015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.929+0000 7f4d26000640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d14006a10 0x7f4d3015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.929+0000 7f4d26000640 1 -- 172.21.15.99:0/2304521752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d300c9b80 con 0x7f4d30154740 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.929+0000 7f4d2f400640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300ad6e0 0x7f4d300adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.930+0000 7f4d26000640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d30154740 0x7f4d300ad1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800c270 tx=0x7f4d300c6ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.930+0000 7f4d27400640 1 -- 172.21.15.99:0/2304521752 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18001c70 con 0x7f4d30154740 2024-03-30T13:11:49.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.930+0000 7f4d27400640 1 -- 172.21.15.99:0/2304521752 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d18004bf0 con 0x7f4d30154740 2024-03-30T13:11:49.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.930+0000 7f4d35c00640 1 -- 172.21.15.99:0/2304521752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d300c9e60 con 0x7f4d30154740 2024-03-30T13:11:49.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.930+0000 7f4d27400640 1 -- 172.21.15.99:0/2304521752 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18007070 con 0x7f4d30154740 2024-03-30T13:11:49.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.930+0000 7f4d35c00640 1 -- 172.21.15.99:0/2304521752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d3015be80 con 0x7f4d30154740 2024-03-30T13:11:49.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.931+0000 7f4d35c00640 1 -- 172.21.15.99:0/2304521752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d3009e520 con 0x7f4d30154740 2024-03-30T13:11:49.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.932+0000 7f4d27400640 1 -- 172.21.15.99:0/2304521752 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4d18047020 con 0x7f4d30154740 2024-03-30T13:11:49.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.933+0000 7f4d27400640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d0c06c560 0x7f4d0c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.933+0000 7f4d27400640 1 -- 172.21.15.99:0/2304521752 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f4d180ac860 con 0x7f4d30154740 2024-03-30T13:11:49.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.933+0000 7f4d2ea00640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d0c06c560 0x7f4d0c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.934+0000 7f4d2ea00640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d0c06c560 0x7f4d0c06ea20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d200074a0 tx=0x7f4d2000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:49.938+0000 7f4d27400640 1 -- 172.21.15.99:0/2304521752 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4d1807ae50 con 0x7f4d30154740 2024-03-30T13:11:50.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.137+0000 7f4d35c00640 1 -- 172.21.15.99:0/2304521752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4d3004f9d0 con 0x7f4d30154740 2024-03-30T13:11:50.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.138+0000 7f4d27400640 1 -- 172.21.15.99:0/2304521752 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f4d1807a750 con 0x7f4d30154740 2024-03-30T13:11:50.141 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:11:50.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 -- 172.21.15.99:0/2304521752 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d0c06c560 msgr2=0x7f4d0c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d0c06c560 0x7f4d0c06ea20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d200074a0 tx=0x7f4d2000b040 comp rx=0 tx=0).stop 2024-03-30T13:11:50.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 -- 172.21.15.99:0/2304521752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d30154740 msgr2=0x7f4d300ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d30154740 0x7f4d300ad1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800c270 tx=0x7f4d300c6ff0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 -- 172.21.15.99:0/2304521752 shutdown_connections 2024-03-30T13:11:50.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d0c06c560 0x7f4d0c06ea20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d300ad6e0 0x7f4d300adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d30154740 0x7f4d300ad1a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 --2- 172.21.15.99:0/2304521752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d14006a10 0x7f4d3015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 -- 172.21.15.99:0/2304521752 >> 172.21.15.99:0/2304521752 conn(0x7f4d300d0450 msgr2=0x7f4d300cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:50.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 -- 172.21.15.99:0/2304521752 shutdown_connections 2024-03-30T13:11:50.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.141+0000 7f4d35c00640 1 -- 172.21.15.99:0/2304521752 wait complete. 2024-03-30T13:11:50.162 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:50.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.356+0000 7f8c8da00640 1 Processor -- start 2024-03-30T13:11:50.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.356+0000 7f8c8da00640 1 -- start start 2024-03-30T13:11:50.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.358+0000 7f8c8da00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8c8809b440 0x7f8c88160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.358+0000 7f8c8da00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8c881610e0 0x7f8c8815f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.358+0000 7f8c8da00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c8809b920 con 0x7f8c881607c0 2024-03-30T13:11:50.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.358+0000 7f8c8da00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8c8809bc00 con 0x7f8c881610e0 2024-03-30T13:11:50.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.358+0000 7f8c8da00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f8c880d0240 con 0x7f8c8809b440 2024-03-30T13:11:50.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.358+0000 7f8c87400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8c881610e0 0x7f8c8815f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.358+0000 7f8c87400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8c881610e0 0x7f8c8815f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37398/0 (socket says 172.21.15.99:37398) 2024-03-30T13:11:50.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.358+0000 7f8c87400640 1 -- 172.21.15.99:0/3992676942 learned_addr learned my addr 172.21.15.99:0/3992676942 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:50.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.358+0000 7f8c86a00640 1 --1- 172.21.15.99:0/3992676942 >> v1:172.21.15.99:6789/0 conn(0x7f8c881607c0 0x7f8c880b5320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44328/0 (socket says 172.21.15.99:44328) 2024-03-30T13:11:50.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.359+0000 7f8c86000640 1 --2- 172.21.15.99:0/3992676942 >> v2:172.21.15.181:3300/0 conn(0x7f8c8809b440 0x7f8c88160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.359+0000 7f8c87400640 1 -- 172.21.15.99:0/3992676942 >> v2:172.21.15.181:3300/0 conn(0x7f8c8809b440 msgr2=0x7f8c88160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.359+0000 7f8c87400640 1 --2- 172.21.15.99:0/3992676942 >> v2:172.21.15.181:3300/0 conn(0x7f8c8809b440 0x7f8c88160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.359+0000 7f8c87400640 1 -- 172.21.15.99:0/3992676942 >> v1:172.21.15.99:6789/0 conn(0x7f8c881607c0 legacy=0x7f8c880b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.359+0000 7f8c87400640 1 -- 172.21.15.99:0/3992676942 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c880d0520 con 0x7f8c881610e0 2024-03-30T13:11:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.359+0000 7f8c86000640 1 --2- 172.21.15.99:0/3992676942 >> v2:172.21.15.181:3300/0 conn(0x7f8c8809b440 0x7f8c88160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.359+0000 7f8c85600640 1 -- 172.21.15.99:0/3992676942 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456318655 0 0) 0x7f8c8809b920 con 0x7f8c881607c0 2024-03-30T13:11:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.360+0000 7f8c87400640 1 --2- 172.21.15.99:0/3992676942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c881610e0 0x7f8c8815f900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8c880b3d30 tx=0x7f8c8002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992bdef5b9cc134 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.360+0000 7f8c85600640 1 -- 172.21.15.99:0/3992676942 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8002ca80 con 0x7f8c881610e0 2024-03-30T13:11:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.360+0000 7f8c85600640 1 -- 172.21.15.99:0/3992676942 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8002cc20 con 0x7f8c881610e0 2024-03-30T13:11:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.360+0000 7f8c85600640 1 -- 172.21.15.99:0/3992676942 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c800343f0 con 0x7f8c881610e0 2024-03-30T13:11:50.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.361+0000 7f8c8da00640 1 -- 172.21.15.99:0/3992676942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c881610e0 msgr2=0x7f8c8815f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.361+0000 7f8c8da00640 1 --2- 172.21.15.99:0/3992676942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c881610e0 0x7f8c8815f900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8c880b3d30 tx=0x7f8c8002bee0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.361+0000 7f8c8da00640 1 -- 172.21.15.99:0/3992676942 shutdown_connections 2024-03-30T13:11:50.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.361+0000 7f8c8da00640 1 --2- 172.21.15.99:0/3992676942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c881610e0 0x7f8c8815f900 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.361+0000 7f8c8da00640 1 --2- 172.21.15.99:0/3992676942 >> v2:172.21.15.181:3300/0 conn(0x7f8c8809b440 0x7f8c88160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.361+0000 7f8c8da00640 1 -- 172.21.15.99:0/3992676942 >> 172.21.15.99:0/3992676942 conn(0x7f8c880b3fc0 msgr2=0x7f8c880b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:50.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.361+0000 7f8c8da00640 1 -- 172.21.15.99:0/3992676942 shutdown_connections 2024-03-30T13:11:50.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.361+0000 7f8c8da00640 1 -- 172.21.15.99:0/3992676942 wait complete. 2024-03-30T13:11:50.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.363+0000 7f8c8da00640 1 Processor -- start 2024-03-30T13:11:50.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.363+0000 7f8c8da00640 1 -- start start 2024-03-30T13:11:50.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.364+0000 7f8c8da00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c8809b440 0x7f8c880c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.364+0000 7f8c8da00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c881607c0 0x7f8c881f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.364+0000 7f8c8da00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c881610e0 0x7f8c880cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.364+0000 7f8c8da00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8815ffc0 con 0x7f8c881610e0 2024-03-30T13:11:50.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.364+0000 7f8c8da00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8815fe40 con 0x7f8c881607c0 2024-03-30T13:11:50.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.364+0000 7f8c8da00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8c88160140 con 0x7f8c8809b440 2024-03-30T13:11:50.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.364+0000 7f8c87400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c881610e0 0x7f8c880cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.364+0000 7f8c87400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c881610e0 0x7f8c880cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37400/0 (socket says 172.21.15.99:37400) 2024-03-30T13:11:50.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.364+0000 7f8c87400640 1 -- 172.21.15.99:0/4061649087 learned_addr learned my addr 172.21.15.99:0/4061649087 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:50.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.365+0000 7f8c86a00640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c8809b440 0x7f8c880c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.365+0000 7f8c86000640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c881607c0 0x7f8c881f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.365+0000 7f8c87400640 1 -- 172.21.15.99:0/4061649087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c8809b440 msgr2=0x7f8c880c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.365+0000 7f8c87400640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c8809b440 0x7f8c880c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.365+0000 7f8c87400640 1 -- 172.21.15.99:0/4061649087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c881607c0 msgr2=0x7f8c881f4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.365+0000 7f8c87400640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c881607c0 0x7f8c881f4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.365+0000 7f8c87400640 1 -- 172.21.15.99:0/4061649087 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8806c990 con 0x7f8c881610e0 2024-03-30T13:11:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.365+0000 7f8c87400640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c881610e0 0x7f8c880cb810 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009f40 tx=0x7f8c80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.365+0000 7f8c7ea00640 1 -- 172.21.15.99:0/4061649087 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80043030 con 0x7f8c881610e0 2024-03-30T13:11:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.366+0000 7f8c7ea00640 1 -- 172.21.15.99:0/4061649087 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c80003990 con 0x7f8c881610e0 2024-03-30T13:11:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.366+0000 7f8c7ea00640 1 -- 172.21.15.99:0/4061649087 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80009510 con 0x7f8c881610e0 2024-03-30T13:11:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.366+0000 7f8c8da00640 1 -- 172.21.15.99:0/4061649087 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8806cc70 con 0x7f8c881610e0 2024-03-30T13:11:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.366+0000 7f8c8da00640 1 -- 172.21.15.99:0/4061649087 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8806d230 con 0x7f8c881610e0 2024-03-30T13:11:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.367+0000 7f8c8da00640 1 -- 172.21.15.99:0/4061649087 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c88068d50 con 0x7f8c881610e0 2024-03-30T13:11:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.368+0000 7f8c7ea00640 1 -- 172.21.15.99:0/4061649087 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8c8002ca90 con 0x7f8c881610e0 2024-03-30T13:11:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.369+0000 7f8c7ea00640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8c6406c530 0x7f8c6406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.369+0000 7f8c7ea00640 1 -- 172.21.15.99:0/4061649087 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f8c800adf10 con 0x7f8c881610e0 2024-03-30T13:11:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.369+0000 7f8c86a00640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8c6406c530 0x7f8c6406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.370+0000 7f8c86a00640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8c6406c530 0x7f8c6406e9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8c78007fd0 tx=0x7f8c78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:50.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.374+0000 7f8c7ea00640 1 -- 172.21.15.99:0/4061649087 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8c8007c470 con 0x7f8c881610e0 2024-03-30T13:11:50.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.615+0000 7f8c8da00640 1 -- 172.21.15.99:0/4061649087 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c880b7650 con 0x7f8c881610e0 2024-03-30T13:11:50.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.616+0000 7f8c7ea00640 1 -- 172.21.15.99:0/4061649087 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f8c8007bd70 con 0x7f8c881610e0 2024-03-30T13:11:50.619 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:50.619 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2695284429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2695284429},{"type":"v1","addr":"172.21.15.181:6835","nonce":2695284429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1658040869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1658040869},{"type":"v1","addr":"172.21.15.181:6833","nonce":1658040869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/951752489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":951752489},{"type":"v1","addr":"172.21.15.99:6835","nonce":951752489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:10:45.658137+0000","modified":"2024-03-30T13:10:48.749437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/245796495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":245796495},{"type":"v1","addr":"172.21.15.99:6837","nonce":245796495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-03-30T13:11:50.619 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-03-30T13:11:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.618+0000 7f8c8da00640 1 -- 172.21.15.99:0/4061649087 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8c6406c530 msgr2=0x7f8c6406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.618+0000 7f8c8da00640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8c6406c530 0x7f8c6406e9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8c78007fd0 tx=0x7f8c78009040 comp rx=0 tx=0).stop 2024-03-30T13:11:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.618+0000 7f8c8da00640 1 -- 172.21.15.99:0/4061649087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c881610e0 msgr2=0x7f8c880cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.618+0000 7f8c8da00640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c881610e0 0x7f8c880cb810 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009f40 tx=0x7f8c80004a40 comp rx=0 tx=0).stop 2024-03-30T13:11:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.618+0000 7f8c8da00640 1 -- 172.21.15.99:0/4061649087 shutdown_connections 2024-03-30T13:11:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.618+0000 7f8c8da00640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8c6406c530 0x7f8c6406e9f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.619+0000 7f8c8da00640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c881610e0 0x7f8c880cb810 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.619+0000 7f8c8da00640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c881607c0 0x7f8c881f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.619+0000 7f8c8da00640 1 --2- 172.21.15.99:0/4061649087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c8809b440 0x7f8c880c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.619+0000 7f8c8da00640 1 -- 172.21.15.99:0/4061649087 >> 172.21.15.99:0/4061649087 conn(0x7f8c880b3fc0 msgr2=0x7f8c8815cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:50.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.619+0000 7f8c8da00640 1 -- 172.21.15.99:0/4061649087 shutdown_connections 2024-03-30T13:11:50.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.619+0000 7f8c8da00640 1 -- 172.21.15.99:0/4061649087 wait complete. 2024-03-30T13:11:50.640 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:50.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.825+0000 7f0f89800640 1 Processor -- start 2024-03-30T13:11:50.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.825+0000 7f0f89800640 1 -- start start 2024-03-30T13:11:50.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.827+0000 7f0f89800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0f84145980 0x7f0f84160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.827+0000 7f0f89800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840ae1b0 0x7f0f8406b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.827+0000 7f0f89800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f840ae610 con 0x7f0f8406ba50 2024-03-30T13:11:50.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.827+0000 7f0f89800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0f84145d60 con 0x7f0f84145980 2024-03-30T13:11:50.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.827+0000 7f0f89800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0f840b07b0 con 0x7f0f840ae1b0 2024-03-30T13:11:50.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.827+0000 7f0f83400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0f8406ba50 0x7f0f840d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44334/0 (socket says 172.21.15.99:44334) 2024-03-30T13:11:50.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.827+0000 7f0f83400640 1 -- 172.21.15.99:0/1311827440 learned_addr learned my addr 172.21.15.99:0/1311827440 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:50.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.827+0000 7f0f82000640 1 --2- 172.21.15.99:0/1311827440 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840ae1b0 0x7f0f8406b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.827+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284218746 0 0) 0x7f0f840ae610 con 0x7f0f8406ba50 2024-03-30T13:11:50.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.827+0000 7f0f82a00640 1 --2- 172.21.15.99:0/1311827440 >> v2:172.21.15.181:3300/0 conn(0x7f0f84145980 0x7f0f84160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.827+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f68003520 con 0x7f0f8406ba50 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 990145746 0 0) 0x7f0f68003520 con 0x7f0f8406ba50 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840ae1b0 msgr2=0x7f0f8406b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 --2- 172.21.15.99:0/1311827440 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840ae1b0 0x7f0f8406b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 >> v2:172.21.15.181:3300/0 conn(0x7f0f84145980 msgr2=0x7f0f84160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 --2- 172.21.15.99:0/1311827440 >> v2:172.21.15.181:3300/0 conn(0x7f0f84145980 0x7f0f84160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f840afe80 con 0x7f0f8406ba50 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f0f7c0019f0 con 0x7f0f8406ba50 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 >> v1:172.21.15.99:6789/0 conn(0x7f0f8406ba50 legacy=0x7f0f840d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 --2- 172.21.15.99:0/1311827440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f680039b0 0x7f0f68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 --2- 172.21.15.99:0/1311827440 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840ae1b0 0x7f0f68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 --2- 172.21.15.99:0/1311827440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f68004d40 0x7f0f680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84145d60 con 0x7f0f680039b0 2024-03-30T13:11:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0f840b07b0 con 0x7f0f68004d40 2024-03-30T13:11:50.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6800b9c0 con 0x7f0f840ae1b0 2024-03-30T13:11:50.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f82a00640 1 --2- 172.21.15.99:0/1311827440 >> v2:172.21.15.181:3300/0 conn(0x7f0f84145980 0x7f0f84160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:50.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.828+0000 7f0f82a00640 1 --2- 172.21.15.99:0/1311827440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f680039b0 0x7f0f68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.829+0000 7f0f82000640 1 --2- 172.21.15.99:0/1311827440 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840ae1b0 0x7f0f68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.829+0000 7f0f82a00640 1 -- 172.21.15.99:0/1311827440 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840ae1b0 msgr2=0x7f0f68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:50.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.829+0000 7f0f82a00640 1 --2- 172.21.15.99:0/1311827440 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840ae1b0 0x7f0f68004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.829+0000 7f0f82a00640 1 -- 172.21.15.99:0/1311827440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f68004d40 msgr2=0x7f0f680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:50.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.829+0000 7f0f82a00640 1 --2- 172.21.15.99:0/1311827440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f68004d40 0x7f0f680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.829+0000 7f0f82a00640 1 -- 172.21.15.99:0/1311827440 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f68003520 con 0x7f0f680039b0 2024-03-30T13:11:50.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.830+0000 7f0f82a00640 1 --2- 172.21.15.99:0/1311827440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f680039b0 0x7f0f68003dd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f740098d0 tx=0x7f0f68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472e52cac7c2dda5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:50.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.830+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f74034070 con 0x7f0f680039b0 2024-03-30T13:11:50.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.830+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f74030680 con 0x7f0f680039b0 2024-03-30T13:11:50.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.830+0000 7f0f81600640 1 -- 172.21.15.99:0/1311827440 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400f040 con 0x7f0f680039b0 2024-03-30T13:11:50.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.830+0000 7f0f89800640 1 -- 172.21.15.99:0/1311827440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f680039b0 msgr2=0x7f0f68003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.830+0000 7f0f89800640 1 --2- 172.21.15.99:0/1311827440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f680039b0 0x7f0f68003dd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f740098d0 tx=0x7f0f68005830 comp rx=0 tx=0).stop 2024-03-30T13:11:50.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.830+0000 7f0f83400640 1 -- 172.21.15.99:0/1311827440 reap_dead start 2024-03-30T13:11:50.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.831+0000 7f0f89800640 1 -- 172.21.15.99:0/1311827440 shutdown_connections 2024-03-30T13:11:50.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.831+0000 7f0f89800640 1 -- 172.21.15.99:0/1311827440 >> 172.21.15.99:0/1311827440 conn(0x7f0f8409aa30 msgr2=0x7f0f840b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:50.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.831+0000 7f0f89800640 1 -- 172.21.15.99:0/1311827440 shutdown_connections 2024-03-30T13:11:50.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.831+0000 7f0f89800640 1 -- 172.21.15.99:0/1311827440 wait complete. 2024-03-30T13:11:50.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.832+0000 7f0f89800640 1 Processor -- start 2024-03-30T13:11:50.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.832+0000 7f0f89800640 1 -- start start 2024-03-30T13:11:50.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.833+0000 7f0f89800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f680039b0 0x7f0f84140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.833+0000 7f0f89800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840cf6c0 0x7f0f840cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.833+0000 7f0f89800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f8406eac0 0x7f0f8406ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.833+0000 7f0f89800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0f840b5250 con 0x7f0f8406eac0 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.833+0000 7f0f89800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0f840b0440 con 0x7f0f680039b0 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.833+0000 7f0f89800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0f840b0c40 con 0x7f0f840cf6c0 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.834+0000 7f0f83400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f8406eac0 0x7f0f8406ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.834+0000 7f0f83400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f8406eac0 0x7f0f8406ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37414/0 (socket says 172.21.15.99:37414) 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.834+0000 7f0f83400640 1 -- 172.21.15.99:0/4052325512 learned_addr learned my addr 172.21.15.99:0/4052325512 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.834+0000 7f0f82a00640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f680039b0 0x7f0f84140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.834+0000 7f0f82000640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840cf6c0 0x7f0f840cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.834+0000 7f0f83400640 1 -- 172.21.15.99:0/4052325512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840cf6c0 msgr2=0x7f0f840cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.834+0000 7f0f83400640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840cf6c0 0x7f0f840cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.834+0000 7f0f83400640 1 -- 172.21.15.99:0/4052325512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f680039b0 msgr2=0x7f0f84140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.834+0000 7f0f83400640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f680039b0 0x7f0f84140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.834+0000 7f0f83400640 1 -- 172.21.15.99:0/4052325512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f840d0110 con 0x7f0f8406eac0 2024-03-30T13:11:50.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.835+0000 7f0f83400640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f8406eac0 0x7f0f8406ef40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0f840d10b0 tx=0x7f0f7c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:50.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.835+0000 7f0f7aa00640 1 -- 172.21.15.99:0/4052325512 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c00a5b0 con 0x7f0f8406eac0 2024-03-30T13:11:50.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.835+0000 7f0f7aa00640 1 -- 172.21.15.99:0/4052325512 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7c00a750 con 0x7f0f8406eac0 2024-03-30T13:11:50.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.835+0000 7f0f7aa00640 1 -- 172.21.15.99:0/4052325512 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c00ab20 con 0x7f0f8406eac0 2024-03-30T13:11:50.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.835+0000 7f0f89800640 1 -- 172.21.15.99:0/4052325512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f840d03f0 con 0x7f0f8406eac0 2024-03-30T13:11:50.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.835+0000 7f0f89800640 1 -- 172.21.15.99:0/4052325512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f840d09b0 con 0x7f0f8406eac0 2024-03-30T13:11:50.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.836+0000 7f0f89800640 1 -- 172.21.15.99:0/4052325512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f84068d50 con 0x7f0f8406eac0 2024-03-30T13:11:50.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.837+0000 7f0f7aa00640 1 -- 172.21.15.99:0/4052325512 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0f7c00acc0 con 0x7f0f8406eac0 2024-03-30T13:11:50.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.838+0000 7f0f7aa00640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f6406c530 0x7f0f6406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:50.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.838+0000 7f0f7aa00640 1 -- 172.21.15.99:0/4052325512 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f0f7c08afe0 con 0x7f0f8406eac0 2024-03-30T13:11:50.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.839+0000 7f0f82a00640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f6406c530 0x7f0f6406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:50.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.839+0000 7f0f82a00640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f6406c530 0x7f0f6406e9f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0f74036000 tx=0x7f0f74031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:50.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:50.843+0000 7f0f7aa00640 1 -- 172.21.15.99:0/4052325512 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0f7c059560 con 0x7f0f8406eac0 2024-03-30T13:11:51.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.104+0000 7f0f89800640 1 -- 172.21.15.99:0/4052325512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f8415f700 con 0x7f0f8406eac0 2024-03-30T13:11:51.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.106+0000 7f0f7aa00640 1 -- 172.21.15.99:0/4052325512 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16658 (secure 0 0 0) 0x7f0f7c058e60 con 0x7f0f8406eac0 2024-03-30T13:11:51.110 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:51.110 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:26.555726+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.38","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:51.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.108+0000 7f0f89800640 1 -- 172.21.15.99:0/4052325512 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f6406c530 msgr2=0x7f0f6406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:51.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.108+0000 7f0f89800640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f6406c530 0x7f0f6406e9f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0f74036000 tx=0x7f0f74031000 comp rx=0 tx=0).stop 2024-03-30T13:11:51.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.108+0000 7f0f89800640 1 -- 172.21.15.99:0/4052325512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f8406eac0 msgr2=0x7f0f8406ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:51.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.108+0000 7f0f89800640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f8406eac0 0x7f0f8406ef40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0f840d10b0 tx=0x7f0f7c00cc50 comp rx=0 tx=0).stop 2024-03-30T13:11:51.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.109+0000 7f0f89800640 1 -- 172.21.15.99:0/4052325512 shutdown_connections 2024-03-30T13:11:51.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.109+0000 7f0f89800640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f6406c530 0x7f0f6406e9f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.109+0000 7f0f89800640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f8406eac0 0x7f0f8406ef40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.109+0000 7f0f89800640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f840cf6c0 0x7f0f840cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.109+0000 7f0f89800640 1 --2- 172.21.15.99:0/4052325512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f680039b0 0x7f0f84140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.109+0000 7f0f89800640 1 -- 172.21.15.99:0/4052325512 >> 172.21.15.99:0/4052325512 conn(0x7f0f8409aa30 msgr2=0x7f0f84144c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:51.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.109+0000 7f0f89800640 1 -- 172.21.15.99:0/4052325512 shutdown_connections 2024-03-30T13:11:51.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.109+0000 7f0f89800640 1 -- 172.21.15.99:0/4052325512 wait complete. 2024-03-30T13:11:51.130 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T13:11:51.131 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.323+0000 7f92af800640 1 Processor -- start 2024-03-30T13:11:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.323+0000 7f92af800640 1 -- start start 2024-03-30T13:11:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.324+0000 7f92af800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f92a80d1150 0x7f92a8162d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.324+0000 7f92af800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f92a815f9d0 0x7f92a80d2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92af800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92a80cf390 con 0x7f92a80d4e20 2024-03-30T13:11:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92af800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f92a80d06d0 con 0x7f92a815f9d0 2024-03-30T13:11:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92af800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f92a80d0240 con 0x7f92a80d1150 2024-03-30T13:11:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92ad800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f92a815f9d0 0x7f92a80d2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92ad800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f92a815f9d0 0x7f92a80d2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37422/0 (socket says 172.21.15.99:37422) 2024-03-30T13:11:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92ad800640 1 -- 172.21.15.99:0/2098234640 learned_addr learned my addr 172.21.15.99:0/2098234640 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92ad800640 1 -- 172.21.15.99:0/2098234640 >> v2:172.21.15.181:3300/0 conn(0x7f92a80d1150 msgr2=0x7f92a8162d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92ace00640 1 --2- 172.21.15.99:0/2098234640 >> v2:172.21.15.181:3300/0 conn(0x7f92a80d1150 0x7f92a8162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92ad800640 1 --2- 172.21.15.99:0/2098234640 >> v2:172.21.15.181:3300/0 conn(0x7f92a80d1150 0x7f92a8162d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92ad800640 1 -- 172.21.15.99:0/2098234640 >> v1:172.21.15.181:6789/0 conn(0x7f92a80d4e20 legacy=0x7f92a80d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92ad800640 1 -- 172.21.15.99:0/2098234640 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a80cf630 con 0x7f92a815f9d0 2024-03-30T13:11:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.325+0000 7f92ace00640 1 --2- 172.21.15.99:0/2098234640 >> v2:172.21.15.181:3300/0 conn(0x7f92a80d1150 0x7f92a8162d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.326+0000 7f92ad800640 1 --2- 172.21.15.99:0/2098234640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a815f9d0 0x7f92a80d2940 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f92a80b7220 tx=0x7f92a002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b01bc72d1f7718 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.327+0000 7f92a7400640 1 -- 172.21.15.99:0/2098234640 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a002ca80 con 0x7f92a815f9d0 2024-03-30T13:11:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.327+0000 7f92a7400640 1 -- 172.21.15.99:0/2098234640 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a002cc20 con 0x7f92a815f9d0 2024-03-30T13:11:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.327+0000 7f92a7400640 1 -- 172.21.15.99:0/2098234640 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a00343f0 con 0x7f92a815f9d0 2024-03-30T13:11:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.328+0000 7f92af800640 1 -- 172.21.15.99:0/2098234640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a815f9d0 msgr2=0x7f92a80d2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.328+0000 7f92af800640 1 --2- 172.21.15.99:0/2098234640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a815f9d0 0x7f92a80d2940 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f92a80b7220 tx=0x7f92a002bee0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.328+0000 7f92af800640 1 -- 172.21.15.99:0/2098234640 shutdown_connections 2024-03-30T13:11:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.328+0000 7f92af800640 1 --2- 172.21.15.99:0/2098234640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a815f9d0 0x7f92a80d2940 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.328+0000 7f92af800640 1 --2- 172.21.15.99:0/2098234640 >> v2:172.21.15.181:3300/0 conn(0x7f92a80d1150 0x7f92a8162d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.328+0000 7f92af800640 1 -- 172.21.15.99:0/2098234640 >> 172.21.15.99:0/2098234640 conn(0x7f92a808bfc0 msgr2=0x7f92a80d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.328+0000 7f92af800640 1 -- 172.21.15.99:0/2098234640 shutdown_connections 2024-03-30T13:11:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.328+0000 7f92af800640 1 -- 172.21.15.99:0/2098234640 wait complete. 2024-03-30T13:11:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.329+0000 7f92af800640 1 Processor -- start 2024-03-30T13:11:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.329+0000 7f92af800640 1 -- start start 2024-03-30T13:11:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.330+0000 7f92af800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a80d1150 0x7f92a80c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.330+0000 7f92af800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a80d4e20 0x7f92a80ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.330+0000 7f92af800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92a815f9d0 0x7f92a81f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.330+0000 7f92af800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f92a80cfed0 con 0x7f92a80d1150 2024-03-30T13:11:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.330+0000 7f92af800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f92a80cfbf0 con 0x7f92a815f9d0 2024-03-30T13:11:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.330+0000 7f92af800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f92a80d1530 con 0x7f92a80d4e20 2024-03-30T13:11:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.331+0000 7f92ace00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a80d1150 0x7f92a80c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.331+0000 7f92ace00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a80d1150 0x7f92a80c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37434/0 (socket says 172.21.15.99:37434) 2024-03-30T13:11:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.331+0000 7f92ace00640 1 -- 172.21.15.99:0/4050843527 learned_addr learned my addr 172.21.15.99:0/4050843527 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.331+0000 7f92ad800640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92a815f9d0 0x7f92a81f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.331+0000 7f92a7e00640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a80d4e20 0x7f92a80ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.331+0000 7f92ace00640 1 -- 172.21.15.99:0/4050843527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a80d4e20 msgr2=0x7f92a80ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.331+0000 7f92ace00640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a80d4e20 0x7f92a80ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.331+0000 7f92ace00640 1 -- 172.21.15.99:0/4050843527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92a815f9d0 msgr2=0x7f92a81f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.331+0000 7f92ace00640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92a815f9d0 0x7f92a81f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.331+0000 7f92ace00640 1 -- 172.21.15.99:0/4050843527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a80c9950 con 0x7f92a80d1150 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.331+0000 7f92a7e00640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a80d4e20 0x7f92a80ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.332+0000 7f92ace00640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a80d1150 0x7f92a80c91e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f929c00c7f0 tx=0x7f929c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.332+0000 7f92a4c00640 1 -- 172.21.15.99:0/4050843527 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c015070 con 0x7f92a80d1150 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.332+0000 7f92a4c00640 1 -- 172.21.15.99:0/4050843527 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929c007a30 con 0x7f92a80d1150 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.332+0000 7f92af800640 1 -- 172.21.15.99:0/4050843527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a80c9c30 con 0x7f92a80d1150 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.332+0000 7f92a4c00640 1 -- 172.21.15.99:0/4050843527 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c007e00 con 0x7f92a80d1150 2024-03-30T13:11:51.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.332+0000 7f92af800640 1 -- 172.21.15.99:0/4050843527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a80ca1f0 con 0x7f92a80d1150 2024-03-30T13:11:51.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.333+0000 7f92af800640 1 -- 172.21.15.99:0/4050843527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a8068640 con 0x7f92a80d1150 2024-03-30T13:11:51.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.334+0000 7f92a4c00640 1 -- 172.21.15.99:0/4050843527 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f929c018070 con 0x7f92a80d1150 2024-03-30T13:11:51.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.335+0000 7f92a4c00640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928806c530 0x7f928806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.335+0000 7f92a4c00640 1 -- 172.21.15.99:0/4050843527 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f929c08b700 con 0x7f92a80d1150 2024-03-30T13:11:51.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.335+0000 7f92a7e00640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928806c530 0x7f928806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:51.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.336+0000 7f92a7e00640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928806c530 0x7f928806e9f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f92a80ce7a0 tx=0x7f9294009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:51.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.344+0000 7f92a4c00640 1 -- 172.21.15.99:0/4050843527 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f929c059d00 con 0x7f92a80d1150 2024-03-30T13:11:51.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.583+0000 7f92af800640 1 -- 172.21.15.99:0/4050843527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92a80d5570 con 0x7f92a80d1150 2024-03-30T13:11:51.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.584+0000 7f92a4c00640 1 -- 172.21.15.99:0/4050843527 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f929c059600 con 0x7f92a80d1150 2024-03-30T13:11:51.587 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:51.587 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2695284429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2695284429},{"type":"v1","addr":"172.21.15.181:6835","nonce":2695284429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1658040869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1658040869},{"type":"v1","addr":"172.21.15.181:6833","nonce":1658040869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/951752489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":951752489},{"type":"v1","addr":"172.21.15.99:6835","nonce":951752489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:10:45.658137+0000","modified":"2024-03-30T13:10:48.749437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/245796495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":245796495},{"type":"v1","addr":"172.21.15.99:6837","nonce":245796495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-03-30T13:11:51.588 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-03-30T13:11:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.586+0000 7f92af800640 1 -- 172.21.15.99:0/4050843527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928806c530 msgr2=0x7f928806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.586+0000 7f92af800640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928806c530 0x7f928806e9f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f92a80ce7a0 tx=0x7f9294009040 comp rx=0 tx=0).stop 2024-03-30T13:11:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.586+0000 7f92af800640 1 -- 172.21.15.99:0/4050843527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a80d1150 msgr2=0x7f92a80c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.586+0000 7f92af800640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a80d1150 0x7f92a80c91e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f929c00c7f0 tx=0x7f929c00cbf0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.587+0000 7f92af800640 1 -- 172.21.15.99:0/4050843527 shutdown_connections 2024-03-30T13:11:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.587+0000 7f92af800640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928806c530 0x7f928806e9f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.587+0000 7f92af800640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92a815f9d0 0x7f92a81f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.587+0000 7f92af800640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a80d4e20 0x7f92a80ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.587+0000 7f92af800640 1 --2- 172.21.15.99:0/4050843527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a80d1150 0x7f92a80c91e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.587+0000 7f92af800640 1 -- 172.21.15.99:0/4050843527 >> 172.21.15.99:0/4050843527 conn(0x7f92a808bfc0 msgr2=0x7f92a80b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.587+0000 7f92af800640 1 -- 172.21.15.99:0/4050843527 shutdown_connections 2024-03-30T13:11:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.587+0000 7f92af800640 1 -- 172.21.15.99:0/4050843527 wait complete. 2024-03-30T13:11:51.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:51.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.825+0000 7f1e39e00640 1 Processor -- start 2024-03-30T13:11:51.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.825+0000 7f1e39e00640 1 -- start start 2024-03-30T13:11:51.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.826+0000 7f1e39e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e340ad230 0x7f1e340718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.826+0000 7f1e39e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e34071e10 0x7f1e3406e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.826+0000 7f1e39e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e340ad6c0 con 0x7f1e34162c70 2024-03-30T13:11:51.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.826+0000 7f1e39e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f1e34072260 con 0x7f1e340ad230 2024-03-30T13:11:51.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.826+0000 7f1e39e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3406d9d0 con 0x7f1e34071e10 2024-03-30T13:11:51.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.827+0000 7f1e2a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e340ad230 0x7f1e340718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:51.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.827+0000 7f1e32a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1e34162c70 0x7f1e340b47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44340/0 (socket says 172.21.15.99:44340) 2024-03-30T13:11:51.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.827+0000 7f1e32a00640 1 -- 172.21.15.99:0/2977551232 learned_addr learned my addr 172.21.15.99:0/2977551232 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:51.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.827+0000 7f1e33400640 1 --2- 172.21.15.99:0/2977551232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e34071e10 0x7f1e3406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:51.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.827+0000 7f1e2a000640 1 -- 172.21.15.99:0/2977551232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e34071e10 msgr2=0x7f1e3406e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:51.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.827+0000 7f1e2a000640 1 --2- 172.21.15.99:0/2977551232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e34071e10 0x7f1e3406e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.827+0000 7f1e2a000640 1 -- 172.21.15.99:0/2977551232 >> v1:172.21.15.99:6789/0 conn(0x7f1e34162c70 legacy=0x7f1e340b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:51.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.827+0000 7f1e2a000640 1 -- 172.21.15.99:0/2977551232 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e34163050 con 0x7f1e340ad230 2024-03-30T13:11:51.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.827+0000 7f1e32000640 1 -- 172.21.15.99:0/2977551232 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089801213 0 0) 0x7f1e340ad6c0 con 0x7f1e34162c70 2024-03-30T13:11:51.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.829+0000 7f1e2a000640 1 --2- 172.21.15.99:0/2977551232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e340ad230 0x7f1e340718d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0097a0 tx=0x7f1e1c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9141461463f9a50 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:51.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.829+0000 7f1e32000640 1 -- 172.21.15.99:0/2977551232 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c035020 con 0x7f1e340ad230 2024-03-30T13:11:51.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.829+0000 7f1e32000640 1 -- 172.21.15.99:0/2977551232 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e1c031830 con 0x7f1e340ad230 2024-03-30T13:11:51.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.829+0000 7f1e32000640 1 -- 172.21.15.99:0/2977551232 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c031c00 con 0x7f1e340ad230 2024-03-30T13:11:51.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.830+0000 7f1e39e00640 1 -- 172.21.15.99:0/2977551232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e340ad230 msgr2=0x7f1e340718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:51.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.830+0000 7f1e39e00640 1 --2- 172.21.15.99:0/2977551232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e340ad230 0x7f1e340718d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0097a0 tx=0x7f1e1c02b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.830+0000 7f1e39e00640 1 -- 172.21.15.99:0/2977551232 shutdown_connections 2024-03-30T13:11:51.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.830+0000 7f1e39e00640 1 --2- 172.21.15.99:0/2977551232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e34071e10 0x7f1e3406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.830+0000 7f1e39e00640 1 --2- 172.21.15.99:0/2977551232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e340ad230 0x7f1e340718d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.830+0000 7f1e39e00640 1 -- 172.21.15.99:0/2977551232 >> 172.21.15.99:0/2977551232 conn(0x7f1e3406b510 msgr2=0x7f1e3406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.830+0000 7f1e39e00640 1 -- 172.21.15.99:0/2977551232 shutdown_connections 2024-03-30T13:11:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.830+0000 7f1e39e00640 1 -- 172.21.15.99:0/2977551232 wait complete. 2024-03-30T13:11:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.831+0000 7f1e39e00640 1 Processor -- start 2024-03-30T13:11:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.832+0000 7f1e39e00640 1 -- start start 2024-03-30T13:11:51.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e39e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e34071e10 0x7f1e341fbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e39e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e340ad230 0x7f1e3409de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e39e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e34162c70 0x7f1e3409b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e39e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3406e230 con 0x7f1e34071e10 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e39e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3406df50 con 0x7f1e34162c70 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e39e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1e340b52b0 con 0x7f1e340ad230 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e32a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e34071e10 0x7f1e341fbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e32a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e34071e10 0x7f1e341fbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37460/0 (socket says 172.21.15.99:37460) 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e32a00640 1 -- 172.21.15.99:0/1494475941 learned_addr learned my addr 172.21.15.99:0/1494475941 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e2a000640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e340ad230 0x7f1e3409de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e32a00640 1 -- 172.21.15.99:0/1494475941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e340ad230 msgr2=0x7f1e3409de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e32a00640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e340ad230 0x7f1e3409de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e32a00640 1 -- 172.21.15.99:0/1494475941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e34162c70 msgr2=0x7f1e3409b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e32a00640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e34162c70 0x7f1e3409b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.833+0000 7f1e32a00640 1 -- 172.21.15.99:0/1494475941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3409b7d0 con 0x7f1e34071e10 2024-03-30T13:11:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.834+0000 7f1e32a00640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e34071e10 0x7f1e341fbc90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400c890 tx=0x7f1e2400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.834+0000 7f1e2be00640 1 -- 172.21.15.99:0/1494475941 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e24018070 con 0x7f1e34071e10 2024-03-30T13:11:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.834+0000 7f1e2be00640 1 -- 172.21.15.99:0/1494475941 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2400a640 con 0x7f1e34071e10 2024-03-30T13:11:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.834+0000 7f1e2be00640 1 -- 172.21.15.99:0/1494475941 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2400aa30 con 0x7f1e34071e10 2024-03-30T13:11:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.834+0000 7f1e39e00640 1 -- 172.21.15.99:0/1494475941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e341fc320 con 0x7f1e34071e10 2024-03-30T13:11:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.834+0000 7f1e39e00640 1 -- 172.21.15.99:0/1494475941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e341fc8e0 con 0x7f1e34071e10 2024-03-30T13:11:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.835+0000 7f1e39e00640 1 -- 172.21.15.99:0/1494475941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e341fcb20 con 0x7f1e34071e10 2024-03-30T13:11:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.836+0000 7f1e2be00640 1 -- 172.21.15.99:0/1494475941 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1e2401b070 con 0x7f1e34071e10 2024-03-30T13:11:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.837+0000 7f1e2be00640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1e1006c560 0x7f1e1006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.837+0000 7f1e2be00640 1 -- 172.21.15.99:0/1494475941 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f1e2408ae00 con 0x7f1e34071e10 2024-03-30T13:11:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.837+0000 7f1e2a000640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1e1006c560 0x7f1e1006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:51.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.838+0000 7f1e2a000640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1e1006c560 0x7f1e1006ea20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c036000 tx=0x7f1e1c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:51.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:51.846+0000 7f1e2be00640 1 -- 172.21.15.99:0/1494475941 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1e341fcb20 con 0x7f1e34071e10 2024-03-30T13:11:52.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.075+0000 7f1e39e00640 1 -- 172.21.15.99:0/1494475941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e34068640 con 0x7f1e34071e10 2024-03-30T13:11:52.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.075+0000 7f1e2be00640 1 -- 172.21.15.99:0/1494475941 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f1e24059360 con 0x7f1e34071e10 2024-03-30T13:11:52.079 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:52.079 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2695284429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2695284429},{"type":"v1","addr":"172.21.15.181:6835","nonce":2695284429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1658040869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1658040869},{"type":"v1","addr":"172.21.15.181:6833","nonce":1658040869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/951752489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":951752489},{"type":"v1","addr":"172.21.15.99:6835","nonce":951752489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:10:45.658137+0000","modified":"2024-03-30T13:10:48.749437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/245796495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":245796495},{"type":"v1","addr":"172.21.15.99:6837","nonce":245796495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 -- 172.21.15.99:0/1494475941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1e1006c560 msgr2=0x7f1e1006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1e1006c560 0x7f1e1006ea20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c036000 tx=0x7f1e1c008030 comp rx=0 tx=0).stop 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 -- 172.21.15.99:0/1494475941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e34071e10 msgr2=0x7f1e341fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e34071e10 0x7f1e341fbc90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400c890 tx=0x7f1e2400cd50 comp rx=0 tx=0).stop 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 -- 172.21.15.99:0/1494475941 shutdown_connections 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1e1006c560 0x7f1e1006ea20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e34162c70 0x7f1e3409b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1e340ad230 0x7f1e3409de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 --2- 172.21.15.99:0/1494475941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e34071e10 0x7f1e341fbc90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 -- 172.21.15.99:0/1494475941 >> 172.21.15.99:0/1494475941 conn(0x7f1e3406b510 msgr2=0x7f1e341602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:52.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 -- 172.21.15.99:0/1494475941 shutdown_connections 2024-03-30T13:11:52.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.078+0000 7f1e39e00640 1 -- 172.21.15.99:0/1494475941 wait complete. 2024-03-30T13:11:52.099 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:52.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.298+0000 7f263b200640 1 Processor -- start 2024-03-30T13:11:52.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.298+0000 7f263b200640 1 -- start start 2024-03-30T13:11:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.300+0000 7f263b200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f263415e920 0x7f26340b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.300+0000 7f263b200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263406b510 0x7f263406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.300+0000 7f263b200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f263415ffa0 con 0x7f263415fa50 2024-03-30T13:11:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.300+0000 7f263b200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f26340b4370 con 0x7f263415e920 2024-03-30T13:11:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.300+0000 7f263b200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f26340b4650 con 0x7f263406b510 2024-03-30T13:11:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.301+0000 7f2639200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263406b510 0x7f263406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.301+0000 7f2639200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263406b510 0x7f263406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:45008/0 (socket says 172.21.15.99:45008) 2024-03-30T13:11:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.301+0000 7f2639200640 1 -- 172.21.15.99:0/1608436822 learned_addr learned my addr 172.21.15.99:0/1608436822 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.301+0000 7f2633e00640 1 --2- 172.21.15.99:0/1608436822 >> v2:172.21.15.181:3300/0 conn(0x7f263415e920 0x7f26340b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.302+0000 7f2639200640 1 -- 172.21.15.99:0/1608436822 >> v2:172.21.15.181:3300/0 conn(0x7f263415e920 msgr2=0x7f26340b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.302+0000 7f2639200640 1 --2- 172.21.15.99:0/1608436822 >> v2:172.21.15.181:3300/0 conn(0x7f263415e920 0x7f26340b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.302+0000 7f2639200640 1 -- 172.21.15.99:0/1608436822 >> v1:172.21.15.181:6789/0 conn(0x7f263415fa50 legacy=0x7f26340b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.302+0000 7f2639200640 1 -- 172.21.15.99:0/1608436822 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26340b4930 con 0x7f263406b510 2024-03-30T13:11:52.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.303+0000 7f2639200640 1 --2- 172.21.15.99:0/1608436822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263406b510 0x7f263406b9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f262c009e50 tx=0x7f262c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=183a654662b4b462 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:52.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.304+0000 7f2633400640 1 -- 172.21.15.99:0/1608436822 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c02cb00 con 0x7f263406b510 2024-03-30T13:11:52.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.304+0000 7f2633400640 1 -- 172.21.15.99:0/1608436822 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c02cca0 con 0x7f263406b510 2024-03-30T13:11:52.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.304+0000 7f2633400640 1 -- 172.21.15.99:0/1608436822 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c034610 con 0x7f263406b510 2024-03-30T13:11:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.305+0000 7f263b200640 1 -- 172.21.15.99:0/1608436822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263406b510 msgr2=0x7f263406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.305+0000 7f263b200640 1 --2- 172.21.15.99:0/1608436822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263406b510 0x7f263406b9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f262c009e50 tx=0x7f262c02bf60 comp rx=0 tx=0).stop 2024-03-30T13:11:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.305+0000 7f263b200640 1 -- 172.21.15.99:0/1608436822 shutdown_connections 2024-03-30T13:11:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.305+0000 7f263b200640 1 --2- 172.21.15.99:0/1608436822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263406b510 0x7f263406b9a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.305+0000 7f263b200640 1 --2- 172.21.15.99:0/1608436822 >> v2:172.21.15.181:3300/0 conn(0x7f263415e920 0x7f26340b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.305+0000 7f263b200640 1 -- 172.21.15.99:0/1608436822 >> 172.21.15.99:0/1608436822 conn(0x7f26340b6780 msgr2=0x7f26340b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:52.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.305+0000 7f263b200640 1 -- 172.21.15.99:0/1608436822 shutdown_connections 2024-03-30T13:11:52.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.305+0000 7f263b200640 1 -- 172.21.15.99:0/1608436822 wait complete. 2024-03-30T13:11:52.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.306+0000 7f263b200640 1 Processor -- start 2024-03-30T13:11:52.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.307+0000 7f263b200640 1 -- start start 2024-03-30T13:11:52.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.307+0000 7f263b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263406b510 0x7f2634157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.307+0000 7f263b200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263415e920 0x7f2634146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.307+0000 7f263b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f263415fa50 0x7f263415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f263b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f26340d1710 con 0x7f263406b510 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f263b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f26340d1590 con 0x7f263415fa50 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f263b200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f26340d1890 con 0x7f263415e920 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f2633e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263406b510 0x7f2634157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f2633e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263406b510 0x7f2634157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37470/0 (socket says 172.21.15.99:37470) 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f2633e00640 1 -- 172.21.15.99:0/3449835126 learned_addr learned my addr 172.21.15.99:0/3449835126 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f262be00640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263415e920 0x7f2634146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f2633e00640 1 -- 172.21.15.99:0/3449835126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263415e920 msgr2=0x7f2634146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f2639200640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f263415fa50 0x7f263415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f2633e00640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263415e920 0x7f2634146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f2633e00640 1 -- 172.21.15.99:0/3449835126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f263415fa50 msgr2=0x7f263415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f2633e00640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f263415fa50 0x7f263415b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f2633e00640 1 -- 172.21.15.99:0/3449835126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263415a8a0 con 0x7f263406b510 2024-03-30T13:11:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f262be00640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263415e920 0x7f2634146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.308+0000 7f2639200640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f263415fa50 0x7f263415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.309+0000 7f2633e00640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263406b510 0x7f2634157ea0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f262400e9b0 tx=0x7f262400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.309+0000 7f2630c00640 1 -- 172.21.15.99:0/3449835126 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2624017070 con 0x7f263406b510 2024-03-30T13:11:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.309+0000 7f2630c00640 1 -- 172.21.15.99:0/3449835126 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262400c9a0 con 0x7f263406b510 2024-03-30T13:11:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.309+0000 7f263b200640 1 -- 172.21.15.99:0/3449835126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2634150ec0 con 0x7f263406b510 2024-03-30T13:11:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.309+0000 7f2630c00640 1 -- 172.21.15.99:0/3449835126 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262400cd90 con 0x7f263406b510 2024-03-30T13:11:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.309+0000 7f263b200640 1 -- 172.21.15.99:0/3449835126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2634151480 con 0x7f263406b510 2024-03-30T13:11:52.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.310+0000 7f263b200640 1 -- 172.21.15.99:0/3449835126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2634068d50 con 0x7f263406b510 2024-03-30T13:11:52.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.311+0000 7f2630c00640 1 -- 172.21.15.99:0/3449835126 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f262401a070 con 0x7f263406b510 2024-03-30T13:11:52.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.312+0000 7f2630c00640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f261006c560 0x7f261006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.312+0000 7f2630c00640 1 -- 172.21.15.99:0/3449835126 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f262408b650 con 0x7f263406b510 2024-03-30T13:11:52.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.312+0000 7f262be00640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f261006c560 0x7f261006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.313+0000 7f262be00640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f261006c560 0x7f261006ea20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f263406c550 tx=0x7f261c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:52.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.317+0000 7f2630c00640 1 -- 172.21.15.99:0/3449835126 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2624059ce0 con 0x7f263406b510 2024-03-30T13:11:52.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.529+0000 7f263b200640 1 -- 172.21.15.99:0/3449835126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f263406c260 con 0x7f263406b510 2024-03-30T13:11:52.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.532+0000 7f2630c00640 1 -- 172.21.15.99:0/3449835126 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16658 (secure 0 0 0) 0x7f26240595e0 con 0x7f263406b510 2024-03-30T13:11:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:52.535 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:26.555726+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:10:43.737951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:10:44.625172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.38","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.534+0000 7f263b200640 1 -- 172.21.15.99:0/3449835126 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f261006c560 msgr2=0x7f261006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.534+0000 7f263b200640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f261006c560 0x7f261006ea20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f263406c550 tx=0x7f261c009040 comp rx=0 tx=0).stop 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.534+0000 7f263b200640 1 -- 172.21.15.99:0/3449835126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263406b510 msgr2=0x7f2634157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.534+0000 7f263b200640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263406b510 0x7f2634157ea0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f262400e9b0 tx=0x7f262400ee70 comp rx=0 tx=0).stop 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.534+0000 7f263b200640 1 -- 172.21.15.99:0/3449835126 shutdown_connections 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.534+0000 7f263b200640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f261006c560 0x7f261006ea20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.534+0000 7f263b200640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f263415fa50 0x7f263415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.534+0000 7f263b200640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f263415e920 0x7f2634146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.534+0000 7f263b200640 1 --2- 172.21.15.99:0/3449835126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f263406b510 0x7f2634157ea0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.534+0000 7f263b200640 1 -- 172.21.15.99:0/3449835126 >> 172.21.15.99:0/3449835126 conn(0x7f26340b6780 msgr2=0x7f26340ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.534+0000 7f263b200640 1 -- 172.21.15.99:0/3449835126 shutdown_connections 2024-03-30T13:11:52.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.535+0000 7f263b200640 1 -- 172.21.15.99:0/3449835126 wait complete. 2024-03-30T13:11:52.558 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-30T13:11:52.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.754+0000 7fad87400640 1 Processor -- start 2024-03-30T13:11:52.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.754+0000 7fad87400640 1 -- start start 2024-03-30T13:11:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.755+0000 7fad87400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800b3b40 0x7fad800d2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.755+0000 7fad87400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fad800d01d0 0x7fad80162660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.755+0000 7fad87400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad8006cae0 con 0x7fad8006c680 2024-03-30T13:11:52.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.755+0000 7fad87400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fad800b3f20 con 0x7fad800d01d0 2024-03-30T13:11:52.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.755+0000 7fad87400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fad800cf370 con 0x7fad800b3b40 2024-03-30T13:11:52.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.756+0000 7fad84a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800b3b40 0x7fad800d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.756+0000 7fad84a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800b3b40 0x7fad800d2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:45022/0 (socket says 172.21.15.99:45022) 2024-03-30T13:11:52.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.756+0000 7fad84a00640 1 -- 172.21.15.99:0/1924158660 learned_addr learned my addr 172.21.15.99:0/1924158660 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:52.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.756+0000 7fad85400640 1 --2- 172.21.15.99:0/1924158660 >> v2:172.21.15.181:3300/0 conn(0x7fad800d01d0 0x7fad80162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.757+0000 7fad84a00640 1 -- 172.21.15.99:0/1924158660 >> v2:172.21.15.181:3300/0 conn(0x7fad800d01d0 msgr2=0x7fad80162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:52.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.757+0000 7fad84a00640 1 --2- 172.21.15.99:0/1924158660 >> v2:172.21.15.181:3300/0 conn(0x7fad800d01d0 0x7fad80162660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.757+0000 7fad84a00640 1 -- 172.21.15.99:0/1924158660 >> v1:172.21.15.181:6789/0 conn(0x7fad8006c680 legacy=0x7fad800cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.757+0000 7fad84a00640 1 -- 172.21.15.99:0/1924158660 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad800d5060 con 0x7fad800b3b40 2024-03-30T13:11:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.758+0000 7fad84a00640 1 --2- 172.21.15.99:0/1924158660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800b3b40 0x7fad800d2760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad74009870 tx=0x7fad7402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3a64e18480c862c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.759+0000 7fad7f400640 1 -- 172.21.15.99:0/1924158660 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74034070 con 0x7fad800b3b40 2024-03-30T13:11:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.759+0000 7fad7f400640 1 -- 172.21.15.99:0/1924158660 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad74030840 con 0x7fad800b3b40 2024-03-30T13:11:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.759+0000 7fad7f400640 1 -- 172.21.15.99:0/1924158660 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74030c10 con 0x7fad800b3b40 2024-03-30T13:11:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.759+0000 7fad87400640 1 -- 172.21.15.99:0/1924158660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800b3b40 msgr2=0x7fad800d2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.759+0000 7fad87400640 1 --2- 172.21.15.99:0/1924158660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800b3b40 0x7fad800d2760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad74009870 tx=0x7fad7402b980 comp rx=0 tx=0).stop 2024-03-30T13:11:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.759+0000 7fad87400640 1 -- 172.21.15.99:0/1924158660 shutdown_connections 2024-03-30T13:11:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.759+0000 7fad87400640 1 --2- 172.21.15.99:0/1924158660 >> v2:172.21.15.181:3300/0 conn(0x7fad800d01d0 0x7fad80162660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.759+0000 7fad87400640 1 --2- 172.21.15.99:0/1924158660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800b3b40 0x7fad800d2760 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.759+0000 7fad87400640 1 -- 172.21.15.99:0/1924158660 >> 172.21.15.99:0/1924158660 conn(0x7fad8008bfc0 msgr2=0x7fad800d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.760+0000 7fad87400640 1 -- 172.21.15.99:0/1924158660 shutdown_connections 2024-03-30T13:11:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.760+0000 7fad87400640 1 -- 172.21.15.99:0/1924158660 wait complete. 2024-03-30T13:11:52.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.762+0000 7fad87400640 1 Processor -- start 2024-03-30T13:11:52.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.762+0000 7fad87400640 1 -- start start 2024-03-30T13:11:52.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.763+0000 7fad87400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad8006c680 0x7fad801d5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.763+0000 7fad87400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800b3b40 0x7fad801e1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.763+0000 7fad87400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800d01d0 0x7fad800ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.763+0000 7fad87400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fad8006e2d0 con 0x7fad800b3b40 2024-03-30T13:11:52.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.763+0000 7fad87400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fad800d2d40 con 0x7fad8006c680 2024-03-30T13:11:52.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.763+0000 7fad87400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fad8006dff0 con 0x7fad800d01d0 2024-03-30T13:11:52.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.763+0000 7fad7fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800b3b40 0x7fad801e1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.763+0000 7fad7fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800b3b40 0x7fad801e1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37478/0 (socket says 172.21.15.99:37478) 2024-03-30T13:11:52.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.763+0000 7fad7fe00640 1 -- 172.21.15.99:0/3575965905 learned_addr learned my addr 172.21.15.99:0/3575965905 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad85400640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800d01d0 0x7fad800ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad84a00640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad8006c680 0x7fad801d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad7fe00640 1 -- 172.21.15.99:0/3575965905 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800d01d0 msgr2=0x7fad800ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad7fe00640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800d01d0 0x7fad800ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad7fe00640 1 -- 172.21.15.99:0/3575965905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad8006c680 msgr2=0x7fad801d5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad7fe00640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad8006c680 0x7fad801d5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad7fe00640 1 -- 172.21.15.99:0/3575965905 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad801e2570 con 0x7fad800b3b40 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad84a00640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad8006c680 0x7fad801d5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad7fe00640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800b3b40 0x7fad801e1e00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00c400 tx=0x7fad6c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad7cc00640 1 -- 172.21.15.99:0/3575965905 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0052d0 con 0x7fad800b3b40 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad7cc00640 1 -- 172.21.15.99:0/3575965905 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6c0054b0 con 0x7fad800b3b40 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad87400640 1 -- 172.21.15.99:0/3575965905 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad801f8000 con 0x7fad800b3b40 2024-03-30T13:11:52.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.764+0000 7fad7cc00640 1 -- 172.21.15.99:0/3575965905 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c006a40 con 0x7fad800b3b40 2024-03-30T13:11:52.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.765+0000 7fad87400640 1 -- 172.21.15.99:0/3575965905 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad801f8580 con 0x7fad800b3b40 2024-03-30T13:11:52.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.766+0000 7fad87400640 1 -- 172.21.15.99:0/3575965905 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad80068640 con 0x7fad800b3b40 2024-03-30T13:11:52.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.766+0000 7fad7cc00640 1 -- 172.21.15.99:0/3575965905 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fad6c006be0 con 0x7fad800b3b40 2024-03-30T13:11:52.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.768+0000 7fad7cc00640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fad6006c530 0x7fad6006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:52.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.768+0000 7fad7cc00640 1 -- 172.21.15.99:0/3575965905 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fad6c08ab70 con 0x7fad800b3b40 2024-03-30T13:11:52.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.768+0000 7fad84a00640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fad6006c530 0x7fad6006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:52.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.769+0000 7fad84a00640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fad6006c530 0x7fad6006e9f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fad74036000 tx=0x7fad7403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:52.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:52.772+0000 7fad7cc00640 1 -- 172.21.15.99:0/3575965905 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fad6c059160 con 0x7fad800b3b40 2024-03-30T13:11:53.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.010+0000 7fad87400640 1 -- 172.21.15.99:0/3575965905 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fad8008e760 con 0x7fad800b3b40 2024-03-30T13:11:53.014 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-03-30T13:11:53.011+0000 7f9063800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T13:11:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.014+0000 7fad7cc00640 1 -- 172.21.15.99:0/3575965905 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fad6c058a60 con 0x7fad800b3b40 2024-03-30T13:11:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-30T13:11:53.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 -- 172.21.15.99:0/3575965905 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fad6006c530 msgr2=0x7fad6006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:53.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fad6006c530 0x7fad6006e9f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fad74036000 tx=0x7fad7403b040 comp rx=0 tx=0).stop 2024-03-30T13:11:53.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 -- 172.21.15.99:0/3575965905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800b3b40 msgr2=0x7fad801e1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:53.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800b3b40 0x7fad801e1e00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00c400 tx=0x7fad6c00c8c0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 -- 172.21.15.99:0/3575965905 shutdown_connections 2024-03-30T13:11:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fad6006c530 0x7fad6006e9f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad800d01d0 0x7fad800ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800b3b40 0x7fad801e1e00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 --2- 172.21.15.99:0/3575965905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad8006c680 0x7fad801d5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 -- 172.21.15.99:0/3575965905 >> 172.21.15.99:0/3575965905 conn(0x7fad8008bfc0 msgr2=0x7fad800b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 -- 172.21.15.99:0/3575965905 shutdown_connections 2024-03-30T13:11:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.019+0000 7fad87400640 1 -- 172.21.15.99:0/3575965905 wait complete. 2024-03-30T13:11:53.041 INFO:tasks.ceph.mds.c.smithi099.stderr: -8744> 2024-03-30T13:10:51.799+0000 7f5506400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T13:11:53.042 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-30T13:11:53.104 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-03-30T13:11:53.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.221+0000 7f86cb000640 1 Processor -- start 2024-03-30T13:11:53.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.222+0000 7f86cb000640 1 -- start start 2024-03-30T13:11:53.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.223+0000 7f86cb000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f86c415e940 0x7f86c40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.223+0000 7f86cb000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f86c40d0400 0x7f86c40b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.223+0000 7f86cb000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c40cf640 con 0x7f86c40d52a0 2024-03-30T13:11:53.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.223+0000 7f86cb000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f86c40cf920 con 0x7f86c40d0400 2024-03-30T13:11:53.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.223+0000 7f86cb000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f86c40cfc00 con 0x7f86c415e940 2024-03-30T13:11:53.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.223+0000 7f86c9000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f86c40d0400 0x7f86c40b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.223+0000 7f86c9000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f86c40d0400 0x7f86c40b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37518/0 (socket says 172.21.15.99:37518) 2024-03-30T13:11:53.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.223+0000 7f86c9000640 1 -- 172.21.15.99:0/1430419856 learned_addr learned my addr 172.21.15.99:0/1430419856 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:53.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.224+0000 7f86c3e00640 1 --2- 172.21.15.99:0/1430419856 >> v2:172.21.15.181:3300/0 conn(0x7f86c415e940 0x7f86c40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.224+0000 7f86c9000640 1 -- 172.21.15.99:0/1430419856 >> v2:172.21.15.181:3300/0 conn(0x7f86c415e940 msgr2=0x7f86c40d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:53.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.224+0000 7f86c9000640 1 --2- 172.21.15.99:0/1430419856 >> v2:172.21.15.181:3300/0 conn(0x7f86c415e940 0x7f86c40d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.224+0000 7f86c9000640 1 -- 172.21.15.99:0/1430419856 >> v1:172.21.15.181:6789/0 conn(0x7f86c40d52a0 legacy=0x7f86c40d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:53.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.224+0000 7f86c9000640 1 -- 172.21.15.99:0/1430419856 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c415ed20 con 0x7f86c40d0400 2024-03-30T13:11:53.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.225+0000 7f86c9000640 1 --2- 172.21.15.99:0/1430419856 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c40d0400 0x7f86c40b3ef0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f86c40b7220 tx=0x7f86bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbce5d56636e12ee server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:53.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.225+0000 7f86c2a00640 1 -- 172.21.15.99:0/1430419856 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc02e070 con 0x7f86c40d0400 2024-03-30T13:11:53.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.225+0000 7f86c2a00640 1 -- 172.21.15.99:0/1430419856 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86bc037070 con 0x7f86c40d0400 2024-03-30T13:11:53.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.225+0000 7f86c2a00640 1 -- 172.21.15.99:0/1430419856 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc031a00 con 0x7f86c40d0400 2024-03-30T13:11:53.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.226+0000 7f86cb000640 1 -- 172.21.15.99:0/1430419856 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c40d0400 msgr2=0x7f86c40b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:53.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.226+0000 7f86cb000640 1 --2- 172.21.15.99:0/1430419856 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c40d0400 0x7f86c40b3ef0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f86c40b7220 tx=0x7f86bc02b880 comp rx=0 tx=0).stop 2024-03-30T13:11:53.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.226+0000 7f86cb000640 1 -- 172.21.15.99:0/1430419856 shutdown_connections 2024-03-30T13:11:53.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.226+0000 7f86cb000640 1 --2- 172.21.15.99:0/1430419856 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c40d0400 0x7f86c40b3ef0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.226+0000 7f86cb000640 1 --2- 172.21.15.99:0/1430419856 >> v2:172.21.15.181:3300/0 conn(0x7f86c415e940 0x7f86c40d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.226+0000 7f86cb000640 1 -- 172.21.15.99:0/1430419856 >> 172.21.15.99:0/1430419856 conn(0x7f86c408bfc0 msgr2=0x7f86c40d4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:53.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.226+0000 7f86cb000640 1 -- 172.21.15.99:0/1430419856 shutdown_connections 2024-03-30T13:11:53.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.226+0000 7f86cb000640 1 -- 172.21.15.99:0/1430419856 wait complete. 2024-03-30T13:11:53.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.227+0000 7f86cb000640 1 Processor -- start 2024-03-30T13:11:53.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.228+0000 7f86cb000640 1 -- start start 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.228+0000 7f86cb000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86c40d0400 0x7f86c40c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86cb000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86c40d52a0 0x7f86c40c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86cb000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c415e940 0x7f86c40c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86cb000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f86c40d28c0 con 0x7f86c415e940 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86cb000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f86c40d2740 con 0x7f86c40d52a0 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86cb000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f86c40d31f0 con 0x7f86c40d0400 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86c9000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c415e940 0x7f86c40c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86c9000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c415e940 0x7f86c40c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37522/0 (socket says 172.21.15.99:37522) 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86c9000640 1 -- 172.21.15.99:0/3936279979 learned_addr learned my addr 172.21.15.99:0/3936279979 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86c3e00640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86c40d0400 0x7f86c40c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86c9000640 1 -- 172.21.15.99:0/3936279979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86c40d0400 msgr2=0x7f86c40c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86c9000640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86c40d0400 0x7f86c40c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86c9000640 1 -- 172.21.15.99:0/3936279979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86c40d52a0 msgr2=0x7f86c40c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:53.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86c3400640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86c40d52a0 0x7f86c40c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86c9000640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86c40d52a0 0x7f86c40c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86c9000640 1 -- 172.21.15.99:0/3936279979 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c40c9b20 con 0x7f86c415e940 2024-03-30T13:11:53.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.229+0000 7f86c3e00640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86c40d0400 0x7f86c40c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:53.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.230+0000 7f86c9000640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c415e940 0x7f86c40c91f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f86bc02b8c0 tx=0x7f86bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:53.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.230+0000 7f86bbe00640 1 -- 172.21.15.99:0/3936279979 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc032880 con 0x7f86c415e940 2024-03-30T13:11:53.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.230+0000 7f86bbe00640 1 -- 172.21.15.99:0/3936279979 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86bc032a40 con 0x7f86c415e940 2024-03-30T13:11:53.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.230+0000 7f86bbe00640 1 -- 172.21.15.99:0/3936279979 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc032e30 con 0x7f86c415e940 2024-03-30T13:11:53.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.230+0000 7f86cb000640 1 -- 172.21.15.99:0/3936279979 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c41543f0 con 0x7f86c415e940 2024-03-30T13:11:53.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.230+0000 7f86cb000640 1 -- 172.21.15.99:0/3936279979 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c41549b0 con 0x7f86c415e940 2024-03-30T13:11:53.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.231+0000 7f86cb000640 1 -- 172.21.15.99:0/3936279979 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c40a2600 con 0x7f86c415e940 2024-03-30T13:11:53.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.232+0000 7f86bbe00640 1 -- 172.21.15.99:0/3936279979 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f86bc0453f0 con 0x7f86c415e940 2024-03-30T13:11:53.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.234+0000 7f86bbe00640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86a006c530 0x7f86a006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.234+0000 7f86bbe00640 1 -- 172.21.15.99:0/3936279979 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5824+0+0 (secure 0 0 0) 0x7f86bc0ad7a0 con 0x7f86c415e940 2024-03-30T13:11:53.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.234+0000 7f86c3e00640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86a006c530 0x7f86a006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.234+0000 7f86c3e00640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86a006c530 0x7f86a006e9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f86c41f8060 tx=0x7f86b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:53.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.238+0000 7f86bbe00640 1 -- 172.21.15.99:0/3936279979 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f86bc040070 con 0x7f86c415e940 2024-03-30T13:11:53.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:53.477+0000 7f86cb000640 1 -- 172.21.15.99:0/3936279979 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f86c415d730 con 0x7f86c415e940 2024-03-30T13:11:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.023+0000 7f86bbe00640 1 -- 172.21.15.99:0/3936279979 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f86bc07bde0 con 0x7f86c415e940 2024-03-30T13:11:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 -- 172.21.15.99:0/3936279979 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86a006c530 msgr2=0x7f86a006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86a006c530 0x7f86a006e9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f86c41f8060 tx=0x7f86b4008040 comp rx=0 tx=0).stop 2024-03-30T13:11:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 -- 172.21.15.99:0/3936279979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c415e940 msgr2=0x7f86c40c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c415e940 0x7f86c40c91f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f86bc02b8c0 tx=0x7f86bc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 -- 172.21.15.99:0/3936279979 shutdown_connections 2024-03-30T13:11:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86a006c530 0x7f86a006e9f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c415e940 0x7f86c40c91f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86c40d52a0 0x7f86c40c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 --2- 172.21.15.99:0/3936279979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86c40d0400 0x7f86c40c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 -- 172.21.15.99:0/3936279979 >> 172.21.15.99:0/3936279979 conn(0x7f86c408bfc0 msgr2=0x7f86c40b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 -- 172.21.15.99:0/3936279979 shutdown_connections 2024-03-30T13:11:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.027+0000 7f86cb000640 1 -- 172.21.15.99:0/3936279979 wait complete. 2024-03-30T13:11:54.054 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-30T13:11:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.250+0000 7f22f2e00640 1 Processor -- start 2024-03-30T13:11:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.250+0000 7f22f2e00640 1 -- start start 2024-03-30T13:11:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.251+0000 7f22f2e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f22ec156ba0 0x7f22ec15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.251+0000 7f22f2e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22ec06e300 con 0x7f22ec06d860 2024-03-30T13:11:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.251+0000 7f22f2e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22ec06e5e0 con 0x7f22ec0d0ba0 2024-03-30T13:11:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.251+0000 7f22f2e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f22ec15db70 con 0x7f22ec156ba0 2024-03-30T13:11:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.252+0000 7f22ebe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f22ec156ba0 0x7f22ec15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.252+0000 7f22e3400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f22ec06d860 0x7f22ec0d0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44352/0 (socket says 172.21.15.99:44352) 2024-03-30T13:11:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.252+0000 7f22ebe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f22ec156ba0 0x7f22ec15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37538/0 (socket says 172.21.15.99:37538) 2024-03-30T13:11:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.252+0000 7f22e3400640 1 -- 172.21.15.99:0/274396586 learned_addr learned my addr 172.21.15.99:0/274396586 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.252+0000 7f22ebe00640 1 -- 172.21.15.99:0/274396586 >> v1:172.21.15.181:6789/0 conn(0x7f22ec0d0ba0 legacy=0x7f22ec160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.252+0000 7f22ebe00640 1 -- 172.21.15.99:0/274396586 >> v1:172.21.15.99:6789/0 conn(0x7f22ec06d860 legacy=0x7f22ec0d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.252+0000 7f22ebe00640 1 -- 172.21.15.99:0/274396586 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec15ce50 con 0x7f22ec156ba0 2024-03-30T13:11:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.253+0000 7f22ebe00640 1 --2- 172.21.15.99:0/274396586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22ec156ba0 0x7f22ec15d630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0097a0 tx=0x7f22dc02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d8f42f15ad6a4e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:54.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.254+0000 7f22eb400640 1 -- 172.21.15.99:0/274396586 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc038070 con 0x7f22ec156ba0 2024-03-30T13:11:54.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.254+0000 7f22eb400640 1 -- 172.21.15.99:0/274396586 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22dc031700 con 0x7f22ec156ba0 2024-03-30T13:11:54.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.254+0000 7f22eb400640 1 -- 172.21.15.99:0/274396586 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc031ad0 con 0x7f22ec156ba0 2024-03-30T13:11:54.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.254+0000 7f22f2e00640 1 -- 172.21.15.99:0/274396586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22ec156ba0 msgr2=0x7f22ec15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.254+0000 7f22f2e00640 1 --2- 172.21.15.99:0/274396586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22ec156ba0 0x7f22ec15d630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0097a0 tx=0x7f22dc02b7a0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.254+0000 7f22f2e00640 1 -- 172.21.15.99:0/274396586 shutdown_connections 2024-03-30T13:11:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.254+0000 7f22f2e00640 1 --2- 172.21.15.99:0/274396586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22ec156ba0 0x7f22ec15d630 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.254+0000 7f22f2e00640 1 -- 172.21.15.99:0/274396586 >> 172.21.15.99:0/274396586 conn(0x7f22ec06b6f0 msgr2=0x7f22ec06bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.254+0000 7f22f2e00640 1 -- 172.21.15.99:0/274396586 shutdown_connections 2024-03-30T13:11:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.254+0000 7f22f2e00640 1 -- 172.21.15.99:0/274396586 wait complete. 2024-03-30T13:11:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.256+0000 7f22f2e00640 1 Processor -- start 2024-03-30T13:11:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.256+0000 7f22f2e00640 1 -- start start 2024-03-30T13:11:54.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.257+0000 7f22f2e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22ec06d860 0x7f22ec09aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.257+0000 7f22f2e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22ec0d0ba0 0x7f22ec14e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.257+0000 7f22f2e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22ec156ba0 0x7f22ec1f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.257+0000 7f22f2e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec0ad3d0 con 0x7f22ec156ba0 2024-03-30T13:11:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.257+0000 7f22f2e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec15cb40 con 0x7f22ec06d860 2024-03-30T13:11:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.257+0000 7f22f2e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f22ec156f80 con 0x7f22ec0d0ba0 2024-03-30T13:11:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.257+0000 7f22f0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22ec156ba0 0x7f22ec1f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.257+0000 7f22f0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22ec156ba0 0x7f22ec1f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37550/0 (socket says 172.21.15.99:37550) 2024-03-30T13:11:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.257+0000 7f22f0e00640 1 -- 172.21.15.99:0/2090144212 learned_addr learned my addr 172.21.15.99:0/2090144212 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.258+0000 7f22f0e00640 1 -- 172.21.15.99:0/2090144212 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22ec0d0ba0 msgr2=0x7f22ec14e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.258+0000 7f22f0e00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22ec0d0ba0 0x7f22ec14e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.258+0000 7f22f0e00640 1 -- 172.21.15.99:0/2090144212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22ec06d860 msgr2=0x7f22ec09aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.258+0000 7f22f0e00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22ec06d860 0x7f22ec09aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.258+0000 7f22f0e00640 1 -- 172.21.15.99:0/2090144212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec09baa0 con 0x7f22ec156ba0 2024-03-30T13:11:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.258+0000 7f22f0e00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22ec156ba0 0x7f22ec1f6560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c780 tx=0x7f22e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.258+0000 7f22e8c00640 1 -- 172.21.15.99:0/2090144212 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4017070 con 0x7f22ec156ba0 2024-03-30T13:11:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.258+0000 7f22e8c00640 1 -- 172.21.15.99:0/2090144212 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e4003da0 con 0x7f22ec156ba0 2024-03-30T13:11:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.258+0000 7f22e8c00640 1 -- 172.21.15.99:0/2090144212 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e40052b0 con 0x7f22ec156ba0 2024-03-30T13:11:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.258+0000 7f22f2e00640 1 -- 172.21.15.99:0/2090144212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ec09b7c0 con 0x7f22ec156ba0 2024-03-30T13:11:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.258+0000 7f22f2e00640 1 -- 172.21.15.99:0/2090144212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ec09a6c0 con 0x7f22ec156ba0 2024-03-30T13:11:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.260+0000 7f22f2e00640 1 -- 172.21.15.99:0/2090144212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ec068640 con 0x7f22ec156ba0 2024-03-30T13:11:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.261+0000 7f22e8c00640 1 -- 172.21.15.99:0/2090144212 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f22e4005450 con 0x7f22ec156ba0 2024-03-30T13:11:54.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.261+0000 7f22e8c00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f22c806c560 0x7f22c806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.261+0000 7f22e8c00640 1 -- 172.21.15.99:0/2090144212 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5824+0+0 (secure 0 0 0) 0x7f22e408ac60 con 0x7f22ec156ba0 2024-03-30T13:11:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.262+0000 7f22ebe00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f22c806c560 0x7f22c806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.262+0000 7f22ebe00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f22c806c560 0x7f22c806ea20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f22dc035000 tx=0x7f22dc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.266+0000 7f22e8c00640 1 -- 172.21.15.99:0/2090144212 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f22e40592a0 con 0x7f22ec156ba0 2024-03-30T13:11:54.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:54.465+0000 7f22f2e00640 1 -- 172.21.15.99:0/2090144212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f22ec06f070 con 0x7f22ec156ba0 2024-03-30T13:11:55.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.027+0000 7f22e8c00640 1 -- 172.21.15.99:0/2090144212 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) ==== 181+0+0 (secure 0 0 0) 0x7f22e4058ba0 con 0x7f22ec156ba0 2024-03-30T13:11:55.031 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-03-30T13:11:55.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.030+0000 7f22f2e00640 1 -- 172.21.15.99:0/2090144212 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f22c806c560 msgr2=0x7f22c806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.030+0000 7f22f2e00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f22c806c560 0x7f22c806ea20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f22dc035000 tx=0x7f22dc030000 comp rx=0 tx=0).stop 2024-03-30T13:11:55.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.031+0000 7f22f2e00640 1 -- 172.21.15.99:0/2090144212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22ec156ba0 msgr2=0x7f22ec1f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.031+0000 7f22f2e00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22ec156ba0 0x7f22ec1f6560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c780 tx=0x7f22e400cc40 comp rx=0 tx=0).stop 2024-03-30T13:11:55.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.031+0000 7f22f2e00640 1 -- 172.21.15.99:0/2090144212 shutdown_connections 2024-03-30T13:11:55.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.031+0000 7f22f2e00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f22c806c560 0x7f22c806ea20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.031+0000 7f22f2e00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22ec156ba0 0x7f22ec1f6560 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.031+0000 7f22f2e00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22ec0d0ba0 0x7f22ec14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.031+0000 7f22f2e00640 1 --2- 172.21.15.99:0/2090144212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22ec06d860 0x7f22ec09aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.031+0000 7f22f2e00640 1 -- 172.21.15.99:0/2090144212 >> 172.21.15.99:0/2090144212 conn(0x7f22ec06b6f0 msgr2=0x7f22ec15ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:55.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.033+0000 7f22f2e00640 1 -- 172.21.15.99:0/2090144212 shutdown_connections 2024-03-30T13:11:55.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.033+0000 7f22f2e00640 1 -- 172.21.15.99:0/2090144212 wait complete. 2024-03-30T13:11:55.065 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-30T13:11:55.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.257+0000 7f8a8f800640 1 Processor -- start 2024-03-30T13:11:55.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.258+0000 7f8a8f800640 1 -- start start 2024-03-30T13:11:55.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.259+0000 7f8a8f800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8a880cffe0 0x7f8a881694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.259+0000 7f8a8f800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880ce810 con 0x7f8a880b2c10 2024-03-30T13:11:55.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.259+0000 7f8a8f800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880b6420 con 0x7f8a8806b510 2024-03-30T13:11:55.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.259+0000 7f8a8f800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8a880b6700 con 0x7f8a880cffe0 2024-03-30T13:11:55.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.259+0000 7f8a7fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8a880b2c10 0x7f8a880b43b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39854/0 (socket says 172.21.15.99:39854) 2024-03-30T13:11:55.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.259+0000 7f8a8d800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8a880cffe0 0x7f8a881694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.260+0000 7f8a7fe00640 1 -- 172.21.15.99:0/3151822220 learned_addr learned my addr 172.21.15.99:0/3151822220 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:55.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.260+0000 7f8a8d800640 1 -- 172.21.15.99:0/3151822220 >> v1:172.21.15.181:6789/0 conn(0x7f8a8806b510 legacy=0x7f8a8806b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:55.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.260+0000 7f8a8d800640 1 -- 172.21.15.99:0/3151822220 >> v1:172.21.15.99:6789/0 conn(0x7f8a880b2c10 legacy=0x7f8a880b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.260+0000 7f8a8d800640 1 -- 172.21.15.99:0/3151822220 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a880ceab0 con 0x7f8a880cffe0 2024-03-30T13:11:55.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.261+0000 7f8a8d800640 1 --2- 172.21.15.99:0/3151822220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a880cffe0 0x7f8a881694d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009d90 tx=0x7f8a8002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad98fb677714ed1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:55.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.261+0000 7f8a87e00640 1 -- 172.21.15.99:0/3151822220 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80039070 con 0x7f8a880cffe0 2024-03-30T13:11:55.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.261+0000 7f8a87e00640 1 -- 172.21.15.99:0/3151822220 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8002cbd0 con 0x7f8a880cffe0 2024-03-30T13:11:55.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.261+0000 7f8a87e00640 1 -- 172.21.15.99:0/3151822220 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80034440 con 0x7f8a880cffe0 2024-03-30T13:11:55.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.262+0000 7f8a8f800640 1 -- 172.21.15.99:0/3151822220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a880cffe0 msgr2=0x7f8a881694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.262+0000 7f8a8f800640 1 --2- 172.21.15.99:0/3151822220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a880cffe0 0x7f8a881694d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009d90 tx=0x7f8a8002be20 comp rx=0 tx=0).stop 2024-03-30T13:11:55.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.262+0000 7f8a8f800640 1 -- 172.21.15.99:0/3151822220 shutdown_connections 2024-03-30T13:11:55.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.262+0000 7f8a8f800640 1 --2- 172.21.15.99:0/3151822220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a880cffe0 0x7f8a881694d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.262+0000 7f8a8f800640 1 -- 172.21.15.99:0/3151822220 >> 172.21.15.99:0/3151822220 conn(0x7f8a880b6af0 msgr2=0x7f8a8809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:55.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.262+0000 7f8a8f800640 1 -- 172.21.15.99:0/3151822220 shutdown_connections 2024-03-30T13:11:55.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.262+0000 7f8a8f800640 1 -- 172.21.15.99:0/3151822220 wait complete. 2024-03-30T13:11:55.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.264+0000 7f8a8f800640 1 Processor -- start 2024-03-30T13:11:55.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.264+0000 7f8a8f800640 1 -- start start 2024-03-30T13:11:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.265+0000 7f8a8f800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a8806b510 0x7f8a880ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.265+0000 7f8a8f800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a880b2c10 0x7f8a881616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.265+0000 7f8a8f800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a880cffe0 0x7f8a8815f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.265+0000 7f8a8f800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880b61c0 con 0x7f8a880b2c10 2024-03-30T13:11:55.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.265+0000 7f8a8f800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880b6040 con 0x7f8a8806b510 2024-03-30T13:11:55.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.265+0000 7f8a8f800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8a88169a10 con 0x7f8a880cffe0 2024-03-30T13:11:55.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.265+0000 7f8a7fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a880b2c10 0x7f8a881616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.265+0000 7f8a7fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a880b2c10 0x7f8a881616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53386/0 (socket says 172.21.15.99:53386) 2024-03-30T13:11:55.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.265+0000 7f8a7fe00640 1 -- 172.21.15.99:0/1000921490 learned_addr learned my addr 172.21.15.99:0/1000921490 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:55.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a8ce00640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a8806b510 0x7f8a880ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a8d800640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a880cffe0 0x7f8a8815f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a7fe00640 1 -- 172.21.15.99:0/1000921490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a880cffe0 msgr2=0x7f8a8815f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a7fe00640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a880cffe0 0x7f8a8815f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a7fe00640 1 -- 172.21.15.99:0/1000921490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a8806b510 msgr2=0x7f8a880ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a7fe00640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a8806b510 0x7f8a880ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a7fe00640 1 -- 172.21.15.99:0/1000921490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a88155e80 con 0x7f8a880b2c10 2024-03-30T13:11:55.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a7fe00640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a880b2c10 0x7f8a881616a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c470 tx=0x7f8a70001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:55.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a85600640 1 -- 172.21.15.99:0/1000921490 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70017070 con 0x7f8a880b2c10 2024-03-30T13:11:55.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a85600640 1 -- 172.21.15.99:0/1000921490 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a70005ce0 con 0x7f8a880b2c10 2024-03-30T13:11:55.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a85600640 1 -- 172.21.15.99:0/1000921490 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a700072f0 con 0x7f8a880b2c10 2024-03-30T13:11:55.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a8f800640 1 -- 172.21.15.99:0/1000921490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a88156160 con 0x7f8a880b2c10 2024-03-30T13:11:55.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.266+0000 7f8a8f800640 1 -- 172.21.15.99:0/1000921490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a880cac70 con 0x7f8a880b2c10 2024-03-30T13:11:55.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.267+0000 7f8a8f800640 1 -- 172.21.15.99:0/1000921490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a88068640 con 0x7f8a880b2c10 2024-03-30T13:11:55.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.269+0000 7f8a85600640 1 -- 172.21.15.99:0/1000921490 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8a7001a070 con 0x7f8a880b2c10 2024-03-30T13:11:55.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.270+0000 7f8a85600640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8a6406c530 0x7f8a6406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.270+0000 7f8a85600640 1 -- 172.21.15.99:0/1000921490 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5386+0+0 (secure 0 0 0) 0x7f8a7008a980 con 0x7f8a880b2c10 2024-03-30T13:11:55.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.270+0000 7f8a8ce00640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8a6406c530 0x7f8a6406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.271+0000 7f8a8ce00640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8a6406c530 0x7f8a6406e9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8a880704b0 tx=0x7f8a78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.274+0000 7f8a85600640 1 -- 172.21.15.99:0/1000921490 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8a700590d0 con 0x7f8a880b2c10 2024-03-30T13:11:55.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:55.475+0000 7f8a8f800640 1 -- 172.21.15.99:0/1000921490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8a88072fc0 con 0x7f8a880b2c10 2024-03-30T13:11:56.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.037+0000 7f8a85600640 1 -- 172.21.15.99:0/1000921490 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) ==== 169+0+0 (secure 0 0 0) 0x7f8a700589d0 con 0x7f8a880b2c10 2024-03-30T13:11:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-03-30T13:11:56.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 -- 172.21.15.99:0/1000921490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8a6406c530 msgr2=0x7f8a6406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8a6406c530 0x7f8a6406e9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8a880704b0 tx=0x7f8a78009040 comp rx=0 tx=0).stop 2024-03-30T13:11:56.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 -- 172.21.15.99:0/1000921490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a880b2c10 msgr2=0x7f8a881616a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a880b2c10 0x7f8a881616a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c470 tx=0x7f8a70001e70 comp rx=0 tx=0).stop 2024-03-30T13:11:56.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 -- 172.21.15.99:0/1000921490 shutdown_connections 2024-03-30T13:11:56.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8a6406c530 0x7f8a6406e9f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a880cffe0 0x7f8a8815f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a880b2c10 0x7f8a881616a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 --2- 172.21.15.99:0/1000921490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a8806b510 0x7f8a880ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 -- 172.21.15.99:0/1000921490 >> 172.21.15.99:0/1000921490 conn(0x7f8a880b6af0 msgr2=0x7f8a8809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:56.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 -- 172.21.15.99:0/1000921490 shutdown_connections 2024-03-30T13:11:56.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.041+0000 7f8a8f800640 1 -- 172.21.15.99:0/1000921490 wait complete. 2024-03-30T13:11:56.072 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-30T13:11:56.072 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-30T13:11:56.072 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-30T13:11:56.072 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:11:56.073 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-30T13:11:56.073 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-30T13:11:56.073 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-30T13:11:56.073 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:11:56.073 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-30T13:11:56.073 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-30T13:11:56.074 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-30T13:11:56.074 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:11:56.074 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-30T13:11:56.074 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-30T13:11:56.074 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-30T13:11:56.074 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:11:56.093 INFO:tasks.ceph.mds.a:Stopped 2024-03-30T13:11:56.093 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-30T13:11:56.097 INFO:tasks.ceph.mds.c:Stopped 2024-03-30T13:11:56.097 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-30T13:11:56.097 INFO:tasks.ceph.mds.b:Stopped 2024-03-30T13:11:56.098 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-30T13:11:56.099 INFO:tasks.ceph.mds.d:Stopped 2024-03-30T13:11:56.099 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-30T13:11:56.144 INFO:tasks.ceph.mds.a:Started 2024-03-30T13:11:56.145 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:56.146 INFO:tasks.ceph.mds.b:Started 2024-03-30T13:11:56.147 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:56.151 INFO:tasks.ceph.mds.c:Started 2024-03-30T13:11:56.151 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:56.153 INFO:tasks.ceph.mds.d:Started 2024-03-30T13:11:56.153 DEBUG:teuthology.parallel:result is None 2024-03-30T13:11:56.153 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-30T13:11:56.302 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-03-30T13:11:56.306 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-03-30T13:11:56.307 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-03-30T13:11:56.314 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-03-30T13:11:56.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.343+0000 7ffbb1e00640 1 Processor -- start 2024-03-30T13:11:56.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.343+0000 7ffbb1e00640 1 -- start start 2024-03-30T13:11:56.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.344+0000 7ffbb1e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffbac15d140 0x7ffbac06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.344+0000 7ffbb1e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbac163640 con 0x7ffbac163180 2024-03-30T13:11:56.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.344+0000 7ffbb1e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbac163920 con 0x7ffbac0d0490 2024-03-30T13:11:56.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.344+0000 7ffbb1e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ffbac0b3ee0 con 0x7ffbac15d140 2024-03-30T13:11:56.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.344+0000 7ffbaaa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffbac15d140 0x7ffbac06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.344+0000 7ffbaa000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ffbac163180 0x7ffbac0b37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39862/0 (socket says 172.21.15.99:39862) 2024-03-30T13:11:56.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.344+0000 7ffbaaa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffbac15d140 0x7ffbac06f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53418/0 (socket says 172.21.15.99:53418) 2024-03-30T13:11:56.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.344+0000 7ffbaaa00640 1 -- 172.21.15.99:0/3777552054 learned_addr learned my addr 172.21.15.99:0/3777552054 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:56.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.345+0000 7ffbaaa00640 1 -- 172.21.15.99:0/3777552054 >> v1:172.21.15.181:6789/0 conn(0x7ffbac0d0490 legacy=0x7ffbac166bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.345+0000 7ffbaaa00640 1 -- 172.21.15.99:0/3777552054 >> v1:172.21.15.99:6789/0 conn(0x7ffbac163180 legacy=0x7ffbac0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.345+0000 7ffbaaa00640 1 -- 172.21.15.99:0/3777552054 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac163c00 con 0x7ffbac15d140 2024-03-30T13:11:56.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.345+0000 7ffba9600640 1 -- 172.21.15.99:0/3777552054 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668617120 0 0) 0x7ffbac163640 con 0x7ffbac163180 2024-03-30T13:11:56.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.346+0000 7ffbaaa00640 1 --2- 172.21.15.99:0/3777552054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbac15d140 0x7ffbac06f0b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009870 tx=0x7ffb9c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e033a4af3e7d40 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:56.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.346+0000 7ffba9600640 1 -- 172.21.15.99:0/3777552054 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c034070 con 0x7ffbac15d140 2024-03-30T13:11:56.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.346+0000 7ffba9600640 1 -- 172.21.15.99:0/3777552054 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb9c030860 con 0x7ffbac15d140 2024-03-30T13:11:56.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.346+0000 7ffba9600640 1 -- 172.21.15.99:0/3777552054 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c030c30 con 0x7ffbac15d140 2024-03-30T13:11:56.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.347+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3777552054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbac15d140 msgr2=0x7ffbac06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.347+0000 7ffbb1e00640 1 --2- 172.21.15.99:0/3777552054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbac15d140 0x7ffbac06f0b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009870 tx=0x7ffb9c02b9a0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.347+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3777552054 shutdown_connections 2024-03-30T13:11:56.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.347+0000 7ffbb1e00640 1 --2- 172.21.15.99:0/3777552054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbac15d140 0x7ffbac06f0b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.347+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3777552054 >> 172.21.15.99:0/3777552054 conn(0x7ffbac06b6f0 msgr2=0x7ffbac06bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:56.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.347+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3777552054 shutdown_connections 2024-03-30T13:11:56.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.347+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3777552054 wait complete. 2024-03-30T13:11:56.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.349+0000 7ffbb1e00640 1 Processor -- start 2024-03-30T13:11:56.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.349+0000 7ffbb1e00640 1 -- start start 2024-03-30T13:11:56.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbb1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbac0d0490 0x7ffbac0ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbb1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbac15d140 0x7ffbac157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbb1e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffbac163180 0x7ffbac149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbb1e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac15d520 con 0x7ffbac15d140 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbb1e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac0b33f0 con 0x7ffbac0d0490 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbb1e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ffbac1672d0 con 0x7ffbac163180 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbaa000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbac15d140 0x7ffbac157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbaa000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbac15d140 0x7ffbac157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53424/0 (socket says 172.21.15.99:53424) 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbaa000640 1 -- 172.21.15.99:0/3148145937 learned_addr learned my addr 172.21.15.99:0/3148145937 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbab400640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffbac163180 0x7ffbac149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbaaa00640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbac0d0490 0x7ffbac0ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbaa000640 1 -- 172.21.15.99:0/3148145937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffbac163180 msgr2=0x7ffbac149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbaa000640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffbac163180 0x7ffbac149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbaa000640 1 -- 172.21.15.99:0/3148145937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbac0d0490 msgr2=0x7ffbac0ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbaa000640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbac0d0490 0x7ffbac0ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.350+0000 7ffbaa000640 1 -- 172.21.15.99:0/3148145937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac157930 con 0x7ffbac15d140 2024-03-30T13:11:56.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.351+0000 7ffbaa000640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbac15d140 0x7ffbac157100 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c3c0 tx=0x7ffb9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:56.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.351+0000 7ffba3400640 1 -- 172.21.15.99:0/3148145937 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb980074e0 con 0x7ffbac15d140 2024-03-30T13:11:56.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.351+0000 7ffba3400640 1 -- 172.21.15.99:0/3148145937 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb980047e0 con 0x7ffbac15d140 2024-03-30T13:11:56.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.351+0000 7ffba3400640 1 -- 172.21.15.99:0/3148145937 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98004bd0 con 0x7ffbac15d140 2024-03-30T13:11:56.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.351+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3148145937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbac157c10 con 0x7ffbac15d140 2024-03-30T13:11:56.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.351+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3148145937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbac1581d0 con 0x7ffbac15d140 2024-03-30T13:11:56.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.353+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3148145937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbac068640 con 0x7ffbac15d140 2024-03-30T13:11:56.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.353+0000 7ffba3400640 1 -- 172.21.15.99:0/3148145937 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ffb98011070 con 0x7ffbac15d140 2024-03-30T13:11:56.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.354+0000 7ffba3400640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffb8c06c530 0x7ffb8c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.354+0000 7ffba3400640 1 -- 172.21.15.99:0/3148145937 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4943+0+0 (secure 0 0 0) 0x7ffb9808aec0 con 0x7ffbac15d140 2024-03-30T13:11:56.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.355+0000 7ffbaaa00640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffb8c06c530 0x7ffb8c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.355+0000 7ffbaaa00640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffb8c06c530 0x7ffb8c06e9f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c036000 tx=0x7ffb9c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.359+0000 7ffba3400640 1 -- 172.21.15.99:0/3148145937 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ffb98059180 con 0x7ffbac15d140 2024-03-30T13:11:56.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:56.575+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3148145937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ffbac06f1e0 con 0x7ffbac15d140 2024-03-30T13:11:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.059+0000 7ffba3400640 1 -- 172.21.15.99:0/3148145937 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) ==== 97+0+0 (secure 0 0 0) 0x7ffb9805d480 con 0x7ffbac15d140 2024-03-30T13:11:57.064 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-03-30T13:11:57.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.063+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3148145937 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffb8c06c530 msgr2=0x7ffb8c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.063+0000 7ffbb1e00640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffb8c06c530 0x7ffb8c06e9f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c036000 tx=0x7ffb9c008030 comp rx=0 tx=0).stop 2024-03-30T13:11:57.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.063+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3148145937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbac15d140 msgr2=0x7ffbac157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.063+0000 7ffbb1e00640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbac15d140 0x7ffbac157100 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c3c0 tx=0x7ffb9800c880 comp rx=0 tx=0).stop 2024-03-30T13:11:57.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.063+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3148145937 shutdown_connections 2024-03-30T13:11:57.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.063+0000 7ffbb1e00640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffb8c06c530 0x7ffb8c06e9f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.063+0000 7ffbb1e00640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffbac163180 0x7ffbac149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.063+0000 7ffbb1e00640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbac15d140 0x7ffbac157100 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.063+0000 7ffbb1e00640 1 --2- 172.21.15.99:0/3148145937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbac0d0490 0x7ffbac0ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.063+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3148145937 >> 172.21.15.99:0/3148145937 conn(0x7ffbac06b6f0 msgr2=0x7ffbac0adb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.064+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3148145937 shutdown_connections 2024-03-30T13:11:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.064+0000 7ffbb1e00640 1 -- 172.21.15.99:0/3148145937 wait complete. 2024-03-30T13:11:57.089 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-30T13:11:57.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.280+0000 7efd18600640 1 Processor -- start 2024-03-30T13:11:57.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.280+0000 7efd18600640 1 -- start start 2024-03-30T13:11:57.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd18600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efd100ad940 0x7efd1006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd18600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efd1006f060 0x7efd1006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd18600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd10146230 con 0x7efd1015c670 2024-03-30T13:11:57.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd18600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7efd1006dfc0 con 0x7efd1006f060 2024-03-30T13:11:57.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd18600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7efd1006e2a0 con 0x7efd100ad940 2024-03-30T13:11:57.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd16600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efd1006f060 0x7efd1006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd15c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7efd1015c670 0x7efd100ad230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39864/0 (socket says 172.21.15.99:39864) 2024-03-30T13:11:57.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd16600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efd1006f060 0x7efd1006d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53440/0 (socket says 172.21.15.99:53440) 2024-03-30T13:11:57.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd15c00640 1 -- 172.21.15.99:0/352022242 learned_addr learned my addr 172.21.15.99:0/352022242 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:57.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd15200640 1 --2- 172.21.15.99:0/352022242 >> v2:172.21.15.181:3300/0 conn(0x7efd100ad940 0x7efd1006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd16600640 1 -- 172.21.15.99:0/352022242 >> v2:172.21.15.181:3300/0 conn(0x7efd100ad940 msgr2=0x7efd1006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:57.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd16600640 1 --2- 172.21.15.99:0/352022242 >> v2:172.21.15.181:3300/0 conn(0x7efd100ad940 0x7efd1006c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.282+0000 7efd16600640 1 -- 172.21.15.99:0/352022242 >> v1:172.21.15.99:6789/0 conn(0x7efd1015c670 legacy=0x7efd100ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.283+0000 7efd16600640 1 -- 172.21.15.99:0/352022242 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1006e580 con 0x7efd1006f060 2024-03-30T13:11:57.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.283+0000 7efd0fe00640 1 -- 172.21.15.99:0/352022242 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379117728 0 0) 0x7efd04001110 con 0x7efd1015c670 2024-03-30T13:11:57.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.284+0000 7efd16600640 1 --2- 172.21.15.99:0/352022242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd1006f060 0x7efd1006d930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efd101612e0 tx=0x7efd0802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f1b8e22b7b6c69 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.284+0000 7efd0fe00640 1 -- 172.21.15.99:0/352022242 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08039070 con 0x7efd1006f060 2024-03-30T13:11:57.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.284+0000 7efd0fe00640 1 -- 172.21.15.99:0/352022242 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0802cbf0 con 0x7efd1006f060 2024-03-30T13:11:57.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.284+0000 7efd0fe00640 1 -- 172.21.15.99:0/352022242 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08034440 con 0x7efd1006f060 2024-03-30T13:11:57.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.284+0000 7efd18600640 1 -- 172.21.15.99:0/352022242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd1006f060 msgr2=0x7efd1006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.284+0000 7efd18600640 1 --2- 172.21.15.99:0/352022242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd1006f060 0x7efd1006d930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efd101612e0 tx=0x7efd0802be40 comp rx=0 tx=0).stop 2024-03-30T13:11:57.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.285+0000 7efd18600640 1 -- 172.21.15.99:0/352022242 shutdown_connections 2024-03-30T13:11:57.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.285+0000 7efd18600640 1 --2- 172.21.15.99:0/352022242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd1006f060 0x7efd1006d930 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.285+0000 7efd18600640 1 --2- 172.21.15.99:0/352022242 >> v2:172.21.15.181:3300/0 conn(0x7efd100ad940 0x7efd1006c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.285+0000 7efd18600640 1 -- 172.21.15.99:0/352022242 >> 172.21.15.99:0/352022242 conn(0x7efd1006b510 msgr2=0x7efd1006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:57.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.285+0000 7efd18600640 1 -- 172.21.15.99:0/352022242 shutdown_connections 2024-03-30T13:11:57.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.285+0000 7efd18600640 1 -- 172.21.15.99:0/352022242 wait complete. 2024-03-30T13:11:57.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.286+0000 7efd18600640 1 Processor -- start 2024-03-30T13:11:57.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.287+0000 7efd18600640 1 -- start start 2024-03-30T13:11:57.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.287+0000 7efd18600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efd1006f060 0x7efd100b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.287+0000 7efd18600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd100ad940 0x7efd101f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.287+0000 7efd18600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd1015c670 0x7efd101f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.287+0000 7efd18600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7efd100b32c0 con 0x7efd100ad940 2024-03-30T13:11:57.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.287+0000 7efd18600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efd1015ca50 con 0x7efd1015c670 2024-03-30T13:11:57.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.287+0000 7efd18600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7efd100b3440 con 0x7efd1006f060 2024-03-30T13:11:57.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.288+0000 7efd15200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd100ad940 0x7efd101f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.288+0000 7efd15200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd100ad940 0x7efd101f81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53444/0 (socket says 172.21.15.99:53444) 2024-03-30T13:11:57.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.288+0000 7efd15200640 1 -- 172.21.15.99:0/3786784128 learned_addr learned my addr 172.21.15.99:0/3786784128 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:57.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.288+0000 7efd15200640 1 -- 172.21.15.99:0/3786784128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efd1006f060 msgr2=0x7efd100b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.288+0000 7efd15200640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efd1006f060 0x7efd100b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.288+0000 7efd15200640 1 -- 172.21.15.99:0/3786784128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd1015c670 msgr2=0x7efd101f86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.288+0000 7efd15200640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd1015c670 0x7efd101f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.288+0000 7efd15200640 1 -- 172.21.15.99:0/3786784128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd10142480 con 0x7efd100ad940 2024-03-30T13:11:57.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.288+0000 7efd15200640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd100ad940 0x7efd101f81a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c7f0 tx=0x7efcfc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.289+0000 7efd0d600640 1 -- 172.21.15.99:0/3786784128 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc015070 con 0x7efd100ad940 2024-03-30T13:11:57.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.289+0000 7efd0d600640 1 -- 172.21.15.99:0/3786784128 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcfc004240 con 0x7efd100ad940 2024-03-30T13:11:57.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.289+0000 7efd18600640 1 -- 172.21.15.99:0/3786784128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd101416c0 con 0x7efd100ad940 2024-03-30T13:11:57.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.289+0000 7efd0d600640 1 -- 172.21.15.99:0/3786784128 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc007620 con 0x7efd100ad940 2024-03-30T13:11:57.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.289+0000 7efd18600640 1 -- 172.21.15.99:0/3786784128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd10141c80 con 0x7efd100ad940 2024-03-30T13:11:57.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.290+0000 7efd18600640 1 -- 172.21.15.99:0/3786784128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd10068640 con 0x7efd100ad940 2024-03-30T13:11:57.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.291+0000 7efd0d600640 1 -- 172.21.15.99:0/3786784128 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efcfc0079d0 con 0x7efd100ad940 2024-03-30T13:11:57.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.292+0000 7efd0d600640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efcf006c530 0x7efcf006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.292+0000 7efd0d600640 1 -- 172.21.15.99:0/3786784128 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7efcfc08b870 con 0x7efd100ad940 2024-03-30T13:11:57.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.292+0000 7efd15c00640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efcf006c530 0x7efcf006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.293+0000 7efd15c00640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efcf006c530 0x7efcf006e9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efd04007fd0 tx=0x7efd04007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.298+0000 7efd0d600640 1 -- 172.21.15.99:0/3786784128 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7efcfc05a140 con 0x7efd100ad940 2024-03-30T13:11:57.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.570+0000 7efd18600640 1 -- 172.21.15.99:0/3786784128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7efd1006f570 con 0x7efd100ad940 2024-03-30T13:11:57.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.571+0000 7efd0d600640 1 -- 172.21.15.99:0/3786784128 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7efcfc059a40 con 0x7efd100ad940 2024-03-30T13:11:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAODwhmP7HRDRAA8NMmT4JCax3iRyXyh/wkEw==", 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAODwhmwRxBLxAAN/8w22SdCe4qaATXvdfzhw==", 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.c", 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAODwhmaWpzHhAAdz2L8LoRb0LE3A/+vPxANA==", 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-03-30T13:11:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.d", 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAPDwhme5JtBBAAnOiaypXSgWLI5R1lzmUIXQ==", 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-03-30T13:11:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQATDwhmRUiUMBAAZGj6JwbrL7FVdi2PMEIPmA==", 2024-03-30T13:11:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-03-30T13:11:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-03-30T13:11:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAXDwhmLF3VABAAsY91R1ApayM/aeSjtuFaow==", 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAaDwhmJ4UDCxAAAMR3I0gA4+6dTxo800TMsA==", 2024-03-30T13:11:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAdDwhm108hFBAAmzE/hQDRurtRYA4CVYpm6A==", 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAkDwhmpcpeDRAACT+uYHkAO2vl/j6O5YGJpw==", 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAnDwhmzluOJhAAnmp5BHuTJWOIL7bPU0gPIA==", 2024-03-30T13:11:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQArDwhmYLjYAxAAVhcQAXPwmmu6sehJ81dvdQ==", 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAuDwhmKA4cDBAAOFGPqCvvn96WA3b8zxGnUg==", 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAPDwhm6lNaEhAAeg1SFtdfeWCF8xpQ5LFMYA==", 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-03-30T13:11:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.1", 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAPDwhmxoqkJxAA1Pj7GyHALzz2URro7nJl3g==", 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.2", 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAPDwhmQVqnHBAAmnn6+7SsAmPqWuO4HDXYxw==", 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.3", 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAPDwhm1gwfMxAAjkUUpB4vr7OP4jur6glICg==", 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQANDwhm2XMLABAAVXVlsyYCn51nx6zwxrePzA==", 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-mds", 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQA8DwhmJJdJFhAA5oRIW05yhenRIPji69y8HQ==", 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-mds" 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-mgr", 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQA8DwhmTcZJFhAAXwuJ7rOGkva21wjkcUOf7w==", 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-osd", 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQA8DwhmPO1JFhAAWn/wJ/S73VvxERalcuks+Q==", 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-osd" 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-rbd", 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQA8Dwhm5BdKFhAAxQaHk8aCHmfgrYBHpblbHw==", 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQA8DwhmuUFKFhAABdbkdynbyzJKm6bLwMyOWw==", 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-rgw", 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQA8DwhmMWpKFhAAauEujfAqgG1BW8DHb2lw7A==", 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQAODwhmtSxiAhAAEce22e+VUrrUXiI+nbBMdQ==", 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQANDwhmq0lLMRAAeaF3DcrJXHqEG8bvHiGmVA==", 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-03-30T13:11:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-03-30T13:11:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-03-30T13:11:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:11:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-03-30T13:11:57.592 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:11:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 -- 172.21.15.99:0/3786784128 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efcf006c530 msgr2=0x7efcf006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efcf006c530 0x7efcf006e9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efd04007fd0 tx=0x7efd04007960 comp rx=0 tx=0).stop 2024-03-30T13:11:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 -- 172.21.15.99:0/3786784128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd100ad940 msgr2=0x7efd101f81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd100ad940 0x7efd101f81a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c7f0 tx=0x7efcfc00ccb0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 -- 172.21.15.99:0/3786784128 shutdown_connections 2024-03-30T13:11:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efcf006c530 0x7efcf006e9f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd1015c670 0x7efd101f86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd100ad940 0x7efd101f81a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 --2- 172.21.15.99:0/3786784128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efd1006f060 0x7efd100b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 -- 172.21.15.99:0/3786784128 >> 172.21.15.99:0/3786784128 conn(0x7efd1006b510 msgr2=0x7efd100b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 -- 172.21.15.99:0/3786784128 shutdown_connections 2024-03-30T13:11:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.574+0000 7efd18600640 1 -- 172.21.15.99:0/3786784128 wait complete. 2024-03-30T13:11:57.596 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-30T13:11:57.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.785+0000 7fb291400640 1 Processor -- start 2024-03-30T13:11:57.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.785+0000 7fb291400640 1 -- start start 2024-03-30T13:11:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.787+0000 7fb291400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c161ef0 0x7fb28c0d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.787+0000 7fb291400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb28c1622d0 0x7fb28c0d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.787+0000 7fb291400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb28c09aa30 0x7fb28c09aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.787+0000 7fb291400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb28c0ce720 con 0x7fb28c09aa30 2024-03-30T13:11:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.787+0000 7fb291400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb28c09b3e0 con 0x7fb28c1622d0 2024-03-30T13:11:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.787+0000 7fb291400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb28c0ce290 con 0x7fb28c161ef0 2024-03-30T13:11:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.787+0000 7fb28b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb28c09aa30 0x7fb28c09aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.787+0000 7fb28b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb28c09aa30 0x7fb28c09aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53446/0 (socket says 172.21.15.99:53446) 2024-03-30T13:11:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.787+0000 7fb28b200640 1 -- 172.21.15.99:0/1854505701 learned_addr learned my addr 172.21.15.99:0/1854505701 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.787+0000 7fb281e00640 1 --2- 172.21.15.99:0/1854505701 >> v2:172.21.15.181:3300/0 conn(0x7fb28c1622d0 0x7fb28c0d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.788+0000 7fb28a800640 1 --2- 172.21.15.99:0/1854505701 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c161ef0 0x7fb28c0d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.788+0000 7fb28b200640 1 -- 172.21.15.99:0/1854505701 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c161ef0 msgr2=0x7fb28c0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:57.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.788+0000 7fb28b200640 1 --2- 172.21.15.99:0/1854505701 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c161ef0 0x7fb28c0d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.788+0000 7fb28b200640 1 -- 172.21.15.99:0/1854505701 >> v2:172.21.15.181:3300/0 conn(0x7fb28c1622d0 msgr2=0x7fb28c0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:57.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.788+0000 7fb28b200640 1 --2- 172.21.15.99:0/1854505701 >> v2:172.21.15.181:3300/0 conn(0x7fb28c1622d0 0x7fb28c0d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.788+0000 7fb28b200640 1 -- 172.21.15.99:0/1854505701 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c0cd680 con 0x7fb28c09aa30 2024-03-30T13:11:57.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.788+0000 7fb28a800640 1 --2- 172.21.15.99:0/1854505701 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c161ef0 0x7fb28c0d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:57.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.789+0000 7fb28b200640 1 --2- 172.21.15.99:0/1854505701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb28c09aa30 0x7fb28c09aea0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0754d0 tx=0x7fb28402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690138807a45ca99 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.789+0000 7fb289e00640 1 -- 172.21.15.99:0/1854505701 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28402c9e0 con 0x7fb28c09aa30 2024-03-30T13:11:57.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.789+0000 7fb289e00640 1 -- 172.21.15.99:0/1854505701 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28402cb80 con 0x7fb28c09aa30 2024-03-30T13:11:57.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.789+0000 7fb289e00640 1 -- 172.21.15.99:0/1854505701 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2840343f0 con 0x7fb28c09aa30 2024-03-30T13:11:57.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.790+0000 7fb291400640 1 -- 172.21.15.99:0/1854505701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb28c09aa30 msgr2=0x7fb28c09aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.790+0000 7fb291400640 1 --2- 172.21.15.99:0/1854505701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb28c09aa30 0x7fb28c09aea0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0754d0 tx=0x7fb28402be40 comp rx=0 tx=0).stop 2024-03-30T13:11:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.790+0000 7fb291400640 1 -- 172.21.15.99:0/1854505701 shutdown_connections 2024-03-30T13:11:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.790+0000 7fb291400640 1 --2- 172.21.15.99:0/1854505701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb28c09aa30 0x7fb28c09aea0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.790+0000 7fb291400640 1 --2- 172.21.15.99:0/1854505701 >> v2:172.21.15.181:3300/0 conn(0x7fb28c1622d0 0x7fb28c0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.790+0000 7fb291400640 1 --2- 172.21.15.99:0/1854505701 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c161ef0 0x7fb28c0d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.790+0000 7fb291400640 1 -- 172.21.15.99:0/1854505701 >> 172.21.15.99:0/1854505701 conn(0x7fb28c0b3f00 msgr2=0x7fb28c0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.790+0000 7fb291400640 1 -- 172.21.15.99:0/1854505701 shutdown_connections 2024-03-30T13:11:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.790+0000 7fb291400640 1 -- 172.21.15.99:0/1854505701 wait complete. 2024-03-30T13:11:57.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.791+0000 7fb291400640 1 Processor -- start 2024-03-30T13:11:57.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.792+0000 7fb291400640 1 -- start start 2024-03-30T13:11:57.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.792+0000 7fb291400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb28c09aa30 0x7fb28c161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.792+0000 7fb291400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c161ef0 0x7fb28c150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.792+0000 7fb291400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb28c1622d0 0x7fb28c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.792+0000 7fb291400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c0cdf20 con 0x7fb28c1622d0 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.792+0000 7fb291400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c0cdc40 con 0x7fb28c09aa30 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.792+0000 7fb291400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb28c0cd300 con 0x7fb28c161ef0 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb28b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb28c1622d0 0x7fb28c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb28b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb28c1622d0 0x7fb28c06d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53456/0 (socket says 172.21.15.99:53456) 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb28b200640 1 -- 172.21.15.99:0/3065304635 learned_addr learned my addr 172.21.15.99:0/3065304635 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb281e00640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c161ef0 0x7fb28c150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb28a800640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb28c09aa30 0x7fb28c161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb28b200640 1 -- 172.21.15.99:0/3065304635 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c161ef0 msgr2=0x7fb28c150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb28b200640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c161ef0 0x7fb28c150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb28b200640 1 -- 172.21.15.99:0/3065304635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb28c09aa30 msgr2=0x7fb28c161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb28b200640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb28c09aa30 0x7fb28c161050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb28b200640 1 -- 172.21.15.99:0/3065304635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c161590 con 0x7fb28c1622d0 2024-03-30T13:11:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb28a800640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb28c09aa30 0x7fb28c161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.793+0000 7fb28b200640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb28c1622d0 0x7fb28c06d360 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb284009f40 tx=0x7fb284004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.794+0000 7fb283400640 1 -- 172.21.15.99:0/3065304635 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284043020 con 0x7fb28c1622d0 2024-03-30T13:11:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.794+0000 7fb283400640 1 -- 172.21.15.99:0/3065304635 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28403e450 con 0x7fb28c1622d0 2024-03-30T13:11:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.794+0000 7fb291400640 1 -- 172.21.15.99:0/3065304635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28c15e900 con 0x7fb28c1622d0 2024-03-30T13:11:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.794+0000 7fb283400640 1 -- 172.21.15.99:0/3065304635 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284009510 con 0x7fb28c1622d0 2024-03-30T13:11:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.794+0000 7fb291400640 1 -- 172.21.15.99:0/3065304635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28c0c6470 con 0x7fb28c1622d0 2024-03-30T13:11:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.795+0000 7fb291400640 1 -- 172.21.15.99:0/3065304635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28c068640 con 0x7fb28c1622d0 2024-03-30T13:11:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.796+0000 7fb283400640 1 -- 172.21.15.99:0/3065304635 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb284046020 con 0x7fb28c1622d0 2024-03-30T13:11:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.797+0000 7fb283400640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb26806c530 0x7fb26806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.797+0000 7fb283400640 1 -- 172.21.15.99:0/3065304635 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fb2840adc00 con 0x7fb28c1622d0 2024-03-30T13:11:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.797+0000 7fb28a800640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb26806c530 0x7fb26806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.798+0000 7fb28a800640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb26806c530 0x7fb26806e9f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0088b0 tx=0x7fb27c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:57.801+0000 7fb283400640 1 -- 172.21.15.99:0/3065304635 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb28404d030 con 0x7fb28c1622d0 2024-03-30T13:11:58.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.075+0000 7fb291400640 1 -- 172.21.15.99:0/3065304635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fb28c0b46f0 con 0x7fb28c1622d0 2024-03-30T13:11:58.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.078+0000 7fb283400640 1 -- 172.21.15.99:0/3065304635 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7fb28407c560 con 0x7fb28c1622d0 2024-03-30T13:11:58.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 -- 172.21.15.99:0/3065304635 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb26806c530 msgr2=0x7fb26806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb26806c530 0x7fb26806e9f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0088b0 tx=0x7fb27c008040 comp rx=0 tx=0).stop 2024-03-30T13:11:58.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 -- 172.21.15.99:0/3065304635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb28c1622d0 msgr2=0x7fb28c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb28c1622d0 0x7fb28c06d360 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb284009f40 tx=0x7fb284004a40 comp rx=0 tx=0).stop 2024-03-30T13:11:58.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 -- 172.21.15.99:0/3065304635 shutdown_connections 2024-03-30T13:11:58.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb26806c530 0x7fb26806e9f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb28c1622d0 0x7fb28c06d360 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c161ef0 0x7fb28c150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 --2- 172.21.15.99:0/3065304635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb28c09aa30 0x7fb28c161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 -- 172.21.15.99:0/3065304635 >> 172.21.15.99:0/3065304635 conn(0x7fb28c0b3f00 msgr2=0x7fb28c0d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:58.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 -- 172.21.15.99:0/3065304635 shutdown_connections 2024-03-30T13:11:58.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.081+0000 7fb291400640 1 -- 172.21.15.99:0/3065304635 wait complete. 2024-03-30T13:11:58.102 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-30T13:11:58.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.294+0000 7fc600000640 1 Processor -- start 2024-03-30T13:11:58.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.295+0000 7fc600000640 1 -- start start 2024-03-30T13:11:58.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.296+0000 7fc600000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc5f8160320 0x7fc5f8160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.296+0000 7fc600000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5f8070bd0 0x7fc5f8070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.296+0000 7fc600000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f80d0180 con 0x7fc5f80ce970 2024-03-30T13:11:58.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.296+0000 7fc600000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f809aa30 con 0x7fc5f8070bd0 2024-03-30T13:11:58.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.296+0000 7fc600000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f80716e0 con 0x7fc5f8160320 2024-03-30T13:11:58.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.296+0000 7fc5fe000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5f8070bd0 0x7fc5f8070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.296+0000 7fc5fe000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5f8070bd0 0x7fc5f8070190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53470/0 (socket says 172.21.15.99:53470) 2024-03-30T13:11:58.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.296+0000 7fc5fe000640 1 -- 172.21.15.99:0/16245905 learned_addr learned my addr 172.21.15.99:0/16245905 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:58.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.297+0000 7fc5fd600640 1 --2- 172.21.15.99:0/16245905 >> v2:172.21.15.181:3300/0 conn(0x7fc5f8160320 0x7fc5f8160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.297+0000 7fc5fe000640 1 -- 172.21.15.99:0/16245905 >> v2:172.21.15.181:3300/0 conn(0x7fc5f8160320 msgr2=0x7fc5f8160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:58.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.297+0000 7fc5fe000640 1 --2- 172.21.15.99:0/16245905 >> v2:172.21.15.181:3300/0 conn(0x7fc5f8160320 0x7fc5f8160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.297+0000 7fc5fe000640 1 -- 172.21.15.99:0/16245905 >> v1:172.21.15.181:6789/0 conn(0x7fc5f80ce970 legacy=0x7fc5f806fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:58.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.297+0000 7fc5fe000640 1 -- 172.21.15.99:0/16245905 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f81610a0 con 0x7fc5f8070bd0 2024-03-30T13:11:58.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.298+0000 7fc5fe000640 1 --2- 172.21.15.99:0/16245905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8070bd0 0x7fc5f8070190 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8075650 tx=0x7fc5f002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed07a28f6c683140 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.298+0000 7fc5f7e00640 1 -- 172.21.15.99:0/16245905 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f002c9f0 con 0x7fc5f8070bd0 2024-03-30T13:11:58.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.298+0000 7fc5f7e00640 1 -- 172.21.15.99:0/16245905 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f002cb90 con 0x7fc5f8070bd0 2024-03-30T13:11:58.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.298+0000 7fc5f7e00640 1 -- 172.21.15.99:0/16245905 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f00343f0 con 0x7fc5f8070bd0 2024-03-30T13:11:58.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.299+0000 7fc600000640 1 -- 172.21.15.99:0/16245905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8070bd0 msgr2=0x7fc5f8070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.299+0000 7fc600000640 1 --2- 172.21.15.99:0/16245905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8070bd0 0x7fc5f8070190 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8075650 tx=0x7fc5f002be50 comp rx=0 tx=0).stop 2024-03-30T13:11:58.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.299+0000 7fc600000640 1 -- 172.21.15.99:0/16245905 shutdown_connections 2024-03-30T13:11:58.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.299+0000 7fc600000640 1 --2- 172.21.15.99:0/16245905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8070bd0 0x7fc5f8070190 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.299+0000 7fc600000640 1 --2- 172.21.15.99:0/16245905 >> v2:172.21.15.181:3300/0 conn(0x7fc5f8160320 0x7fc5f8160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.299+0000 7fc600000640 1 -- 172.21.15.99:0/16245905 >> 172.21.15.99:0/16245905 conn(0x7fc5f80b3f00 msgr2=0x7fc5f80b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:58.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.299+0000 7fc600000640 1 -- 172.21.15.99:0/16245905 shutdown_connections 2024-03-30T13:11:58.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.299+0000 7fc600000640 1 -- 172.21.15.99:0/16245905 wait complete. 2024-03-30T13:11:58.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.301+0000 7fc600000640 1 Processor -- start 2024-03-30T13:11:58.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.301+0000 7fc600000640 1 -- start start 2024-03-30T13:11:58.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc600000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f8070bd0 0x7fc5f80c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc600000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5f80ce970 0x7fc5f80b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc600000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8160320 0x7fc5f80cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc600000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f80ce070 con 0x7fc5f8160320 2024-03-30T13:11:58.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc600000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f80719c0 con 0x7fc5f8070bd0 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc600000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f80c5f40 con 0x7fc5f80ce970 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc5fe000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8160320 0x7fc5f80cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc5fe000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8160320 0x7fc5f80cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53480/0 (socket says 172.21.15.99:53480) 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc5fe000640 1 -- 172.21.15.99:0/3802472539 learned_addr learned my addr 172.21.15.99:0/3802472539 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc5fd600640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f8070bd0 0x7fc5f80c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc5fcc00640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5f80ce970 0x7fc5f80b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc5fe000640 1 -- 172.21.15.99:0/3802472539 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5f80ce970 msgr2=0x7fc5f80b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc5fe000640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5f80ce970 0x7fc5f80b6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc5fe000640 1 -- 172.21.15.99:0/3802472539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f8070bd0 msgr2=0x7fc5f80c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc5fe000640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f8070bd0 0x7fc5f80c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.302+0000 7fc5fe000640 1 -- 172.21.15.99:0/3802472539 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f80b74f0 con 0x7fc5f8160320 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.303+0000 7fc5fe000640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8160320 0x7fc5f80cee20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0036040 tx=0x7fc5f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.303+0000 7fc5f5600640 1 -- 172.21.15.99:0/3802472539 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0043020 con 0x7fc5f8160320 2024-03-30T13:11:58.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.303+0000 7fc5f5600640 1 -- 172.21.15.99:0/3802472539 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f003e450 con 0x7fc5f8160320 2024-03-30T13:11:58.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.303+0000 7fc5f5600640 1 -- 172.21.15.99:0/3802472539 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0009510 con 0x7fc5f8160320 2024-03-30T13:11:58.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.303+0000 7fc600000640 1 -- 172.21.15.99:0/3802472539 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f80b77d0 con 0x7fc5f8160320 2024-03-30T13:11:58.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.303+0000 7fc600000640 1 -- 172.21.15.99:0/3802472539 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f80c6470 con 0x7fc5f8160320 2024-03-30T13:11:58.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.304+0000 7fc600000640 1 -- 172.21.15.99:0/3802472539 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f8068d50 con 0x7fc5f8160320 2024-03-30T13:11:58.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.305+0000 7fc5f5600640 1 -- 172.21.15.99:0/3802472539 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc5f0046020 con 0x7fc5f8160320 2024-03-30T13:11:58.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.306+0000 7fc5f5600640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5d806c560 0x7fc5d806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.306+0000 7fc5f5600640 1 -- 172.21.15.99:0/3802472539 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fc5f00ada00 con 0x7fc5f8160320 2024-03-30T13:11:58.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.306+0000 7fc5fd600640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5d806c560 0x7fc5d806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.307+0000 7fc5fd600640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5d806c560 0x7fc5d806ea20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec006fd0 tx=0x7fc5ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.310+0000 7fc5f5600640 1 -- 172.21.15.99:0/3802472539 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc5f004d070 con 0x7fc5f8160320 2024-03-30T13:11:58.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.579+0000 7fc600000640 1 -- 172.21.15.99:0/3802472539 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fc5f80b4b60 con 0x7fc5f8160320 2024-03-30T13:11:58.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.583+0000 7fc5f5600640 1 -- 172.21.15.99:0/3802472539 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7fc5f007c2d0 con 0x7fc5f8160320 2024-03-30T13:11:58.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.585+0000 7fc600000640 1 -- 172.21.15.99:0/3802472539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5d806c560 msgr2=0x7fc5d806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.585+0000 7fc600000640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5d806c560 0x7fc5d806ea20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec006fd0 tx=0x7fc5ec008040 comp rx=0 tx=0).stop 2024-03-30T13:11:58.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.585+0000 7fc600000640 1 -- 172.21.15.99:0/3802472539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8160320 msgr2=0x7fc5f80cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.585+0000 7fc600000640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8160320 0x7fc5f80cee20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0036040 tx=0x7fc5f0004a40 comp rx=0 tx=0).stop 2024-03-30T13:11:58.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.586+0000 7fc600000640 1 -- 172.21.15.99:0/3802472539 shutdown_connections 2024-03-30T13:11:58.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.586+0000 7fc600000640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5d806c560 0x7fc5d806ea20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.586+0000 7fc600000640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8160320 0x7fc5f80cee20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.586+0000 7fc600000640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5f80ce970 0x7fc5f80b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.586+0000 7fc600000640 1 --2- 172.21.15.99:0/3802472539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f8070bd0 0x7fc5f80c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.586+0000 7fc600000640 1 -- 172.21.15.99:0/3802472539 >> 172.21.15.99:0/3802472539 conn(0x7fc5f80b3f00 msgr2=0x7fc5f80b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:58.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.586+0000 7fc600000640 1 -- 172.21.15.99:0/3802472539 shutdown_connections 2024-03-30T13:11:58.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.586+0000 7fc600000640 1 -- 172.21.15.99:0/3802472539 wait complete. 2024-03-30T13:11:58.608 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-30T13:11:58.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.811+0000 7f6806200640 1 Processor -- start 2024-03-30T13:11:58.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.811+0000 7f6806200640 1 -- start start 2024-03-30T13:11:58.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.812+0000 7f6806200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f680015fc20 0x7f68000c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.812+0000 7f6806200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68000c5020 0x7f68000c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.812+0000 7f6806200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6800160480 con 0x7f68000b4b20 2024-03-30T13:11:58.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.812+0000 7f6806200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6800161090 con 0x7f680015fc20 2024-03-30T13:11:58.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.812+0000 7f6806200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6800160760 con 0x7f68000c5020 2024-03-30T13:11:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.813+0000 7f67ff400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f680015fc20 0x7f68000c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.813+0000 7f67ff400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f680015fc20 0x7f68000c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53494/0 (socket says 172.21.15.99:53494) 2024-03-30T13:11:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.813+0000 7f67ff400640 1 -- 172.21.15.99:0/2959824334 learned_addr learned my addr 172.21.15.99:0/2959824334 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.813+0000 7f67f6a00640 1 --2- 172.21.15.99:0/2959824334 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68000c5020 0x7f68000c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.813+0000 7f67ff400640 1 -- 172.21.15.99:0/2959824334 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68000c5020 msgr2=0x7f68000c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.813+0000 7f67ff400640 1 --2- 172.21.15.99:0/2959824334 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68000c5020 0x7f68000c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.813+0000 7f67ff400640 1 -- 172.21.15.99:0/2959824334 >> v1:172.21.15.181:6789/0 conn(0x7f68000b4b20 legacy=0x7f68000d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.813+0000 7f67ff400640 1 -- 172.21.15.99:0/2959824334 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6800160a40 con 0x7f680015fc20 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.814+0000 7f67ff400640 1 --2- 172.21.15.99:0/2959824334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f680015fc20 0x7f68000c6140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009870 tx=0x7f67f002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118cbce69758e1c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.815+0000 7f67fea00640 1 -- 172.21.15.99:0/2959824334 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00317c0 con 0x7f680015fc20 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.815+0000 7f67fea00640 1 -- 172.21.15.99:0/2959824334 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f0037070 con 0x7f680015fc20 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.815+0000 7f67fea00640 1 -- 172.21.15.99:0/2959824334 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0031b80 con 0x7f680015fc20 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.815+0000 7f6806200640 1 -- 172.21.15.99:0/2959824334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f680015fc20 msgr2=0x7f68000c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.815+0000 7f6806200640 1 --2- 172.21.15.99:0/2959824334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f680015fc20 0x7f68000c6140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009870 tx=0x7f67f002b860 comp rx=0 tx=0).stop 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.815+0000 7f6806200640 1 -- 172.21.15.99:0/2959824334 shutdown_connections 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.815+0000 7f6806200640 1 --2- 172.21.15.99:0/2959824334 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68000c5020 0x7f68000c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.815+0000 7f6806200640 1 --2- 172.21.15.99:0/2959824334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f680015fc20 0x7f68000c6140 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.815+0000 7f6806200640 1 -- 172.21.15.99:0/2959824334 >> 172.21.15.99:0/2959824334 conn(0x7f680006b510 msgr2=0x7f680006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.816+0000 7f6806200640 1 -- 172.21.15.99:0/2959824334 shutdown_connections 2024-03-30T13:11:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.816+0000 7f6806200640 1 -- 172.21.15.99:0/2959824334 wait complete. 2024-03-30T13:11:58.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.817+0000 7f6806200640 1 Processor -- start 2024-03-30T13:11:58.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.817+0000 7f6806200640 1 -- start start 2024-03-30T13:11:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.818+0000 7f6806200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68000b4b20 0x7f68001f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.818+0000 7f6806200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68000c5020 0x7f68000b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.818+0000 7f6806200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680015fc20 0x7f68000c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.818+0000 7f6806200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6800160260 con 0x7f68000b4b20 2024-03-30T13:11:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.818+0000 7f6806200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f68001600e0 con 0x7f680015fc20 2024-03-30T13:11:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.818+0000 7f6806200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f68000ccbe0 con 0x7f68000c5020 2024-03-30T13:11:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.818+0000 7f67ff400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68000b4b20 0x7f68001f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.819+0000 7f67ff400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68000b4b20 0x7f68001f44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53500/0 (socket says 172.21.15.99:53500) 2024-03-30T13:11:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.819+0000 7f67ff400640 1 -- 172.21.15.99:0/2574166768 learned_addr learned my addr 172.21.15.99:0/2574166768 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.819+0000 7f67f6a00640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68000c5020 0x7f68000b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.819+0000 7f67ffe00640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680015fc20 0x7f68000c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.819+0000 7f67ff400640 1 -- 172.21.15.99:0/2574166768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68000c5020 msgr2=0x7f68000b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.819+0000 7f67ff400640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68000c5020 0x7f68000b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.819+0000 7f67ff400640 1 -- 172.21.15.99:0/2574166768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680015fc20 msgr2=0x7f68000c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.819+0000 7f67ff400640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680015fc20 0x7f68000c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.819+0000 7f67ff400640 1 -- 172.21.15.99:0/2574166768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68000b1180 con 0x7f68000b4b20 2024-03-30T13:11:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.819+0000 7f67ff400640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68000b4b20 0x7f68001f44a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f67f002b8a0 tx=0x7f67f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.820+0000 7f67f7e00640 1 -- 172.21.15.99:0/2574166768 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0032650 con 0x7f68000b4b20 2024-03-30T13:11:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.820+0000 7f67f7e00640 1 -- 172.21.15.99:0/2574166768 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f0032810 con 0x7f68000b4b20 2024-03-30T13:11:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.820+0000 7f67f7e00640 1 -- 172.21.15.99:0/2574166768 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0032c00 con 0x7f68000b4b20 2024-03-30T13:11:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.820+0000 7f6806200640 1 -- 172.21.15.99:0/2574166768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68000b1460 con 0x7f68000b4b20 2024-03-30T13:11:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.820+0000 7f6806200640 1 -- 172.21.15.99:0/2574166768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68000c7640 con 0x7f68000b4b20 2024-03-30T13:11:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.821+0000 7f6806200640 1 -- 172.21.15.99:0/2574166768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68000caab0 con 0x7f68000b4b20 2024-03-30T13:11:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.822+0000 7f67f7e00640 1 -- 172.21.15.99:0/2574166768 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f67f004c060 con 0x7f68000b4b20 2024-03-30T13:11:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.823+0000 7f67f7e00640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f67dc06c530 0x7f67dc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.823+0000 7f67f7e00640 1 -- 172.21.15.99:0/2574166768 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f67f00ace70 con 0x7f68000b4b20 2024-03-30T13:11:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.823+0000 7f67f6a00640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f67dc06c530 0x7f67dc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.824+0000 7f67f6a00640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f67dc06c530 0x7f67dc06e9f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f68001f8180 tx=0x7f67e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:58.828+0000 7f67f7e00640 1 -- 172.21.15.99:0/2574166768 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f68000caab0 con 0x7f68000b4b20 2024-03-30T13:11:59.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.084+0000 7f6806200640 1 -- 172.21.15.99:0/2574166768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f6800068640 con 0x7f68000b4b20 2024-03-30T13:11:59.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.089+0000 7f67f7e00640 1 -- 172.21.15.99:0/2574166768 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f67f0040070 con 0x7f68000b4b20 2024-03-30T13:11:59.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 -- 172.21.15.99:0/2574166768 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f67dc06c530 msgr2=0x7f67dc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f67dc06c530 0x7f67dc06e9f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f68001f8180 tx=0x7f67e8008040 comp rx=0 tx=0).stop 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 -- 172.21.15.99:0/2574166768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68000b4b20 msgr2=0x7f68001f44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68000b4b20 0x7f68001f44a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f67f002b8a0 tx=0x7f67f00046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 -- 172.21.15.99:0/2574166768 shutdown_connections 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f67dc06c530 0x7f67dc06e9f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680015fc20 0x7f68000c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68000c5020 0x7f68000b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 --2- 172.21.15.99:0/2574166768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68000b4b20 0x7f68001f44a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 -- 172.21.15.99:0/2574166768 >> 172.21.15.99:0/2574166768 conn(0x7f680006b510 msgr2=0x7f6800072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 -- 172.21.15.99:0/2574166768 shutdown_connections 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.092+0000 7f6806200640 1 -- 172.21.15.99:0/2574166768 wait complete. 2024-03-30T13:11:59.114 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-30T13:11:59.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.309+0000 7f78a5c00640 1 Processor -- start 2024-03-30T13:11:59.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.310+0000 7f78a5c00640 1 -- start start 2024-03-30T13:11:59.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.311+0000 7f78a5c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a00c5020 0x7f78a00cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.311+0000 7f78a5c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a0160480 con 0x7f78a015fc20 2024-03-30T13:11:59.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.311+0000 7f78a5c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a0160760 con 0x7f78a00c6850 2024-03-30T13:11:59.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.311+0000 7f78a5c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f78a0161090 con 0x7f78a00c5020 2024-03-30T13:11:59.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.311+0000 7f789ea00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f78a015fc20 0x7f78a00c6140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39874/0 (socket says 172.21.15.99:39874) 2024-03-30T13:11:59.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.311+0000 7f789ea00640 1 -- 172.21.15.99:0/788513490 learned_addr learned my addr 172.21.15.99:0/788513490 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:11:59.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789f400640 1 --2- 172.21.15.99:0/788513490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a00c5020 0x7f78a00cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3659099243 0 0) 0x7f78a0160480 con 0x7f78a015fc20 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7884003520 con 0x7f78a015fc20 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3107420351 0 0) 0x7f7884003520 con 0x7f78a015fc20 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a00c5020 msgr2=0x7f78a00cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 --2- 172.21.15.99:0/788513490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a00c5020 0x7f78a00cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 >> v1:172.21.15.181:6789/0 conn(0x7f78a00c6850 legacy=0x7f78a00cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a0160a40 con 0x7f78a015fc20 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f7890001670 con 0x7f78a015fc20 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 >> v1:172.21.15.99:6789/0 conn(0x7f78a015fc20 legacy=0x7f78a00c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 --2- 172.21.15.99:0/788513490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a00c5020 0x7f78840039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 --2- 172.21.15.99:0/788513490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7884003f60 0x7f7884004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 --2- 172.21.15.99:0/788513490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884004d40 0x7f78840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f78a0161090 con 0x7f7884003f60 2024-03-30T13:11:59.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f788400bb50 con 0x7f7884004d40 2024-03-30T13:11:59.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f788400bd50 con 0x7f78a00c5020 2024-03-30T13:11:59.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.312+0000 7f7896000640 1 --2- 172.21.15.99:0/788513490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7884003f60 0x7f7884004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.313+0000 7f7896000640 1 -- 172.21.15.99:0/788513490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a00c5020 msgr2=0x7f78840039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:59.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.313+0000 7f7896000640 1 --2- 172.21.15.99:0/788513490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78a00c5020 0x7f78840039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.313+0000 7f789f400640 1 --2- 172.21.15.99:0/788513490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884004d40 0x7f78840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.313+0000 7f7896000640 1 -- 172.21.15.99:0/788513490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884004d40 msgr2=0x7f78840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:59.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.313+0000 7f7896000640 1 --2- 172.21.15.99:0/788513490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884004d40 0x7f78840051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.313+0000 7f7896000640 1 -- 172.21.15.99:0/788513490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7884003520 con 0x7f7884003f60 2024-03-30T13:11:59.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.314+0000 7f7896000640 1 --2- 172.21.15.99:0/788513490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7884003f60 0x7f7884004800 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7888001750 tx=0x7f7884005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901d36a09b684b43 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.314+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7888001370 con 0x7f7884003f60 2024-03-30T13:11:59.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.314+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78880052d0 con 0x7f7884003f60 2024-03-30T13:11:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.314+0000 7f789e000640 1 -- 172.21.15.99:0/788513490 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7888003830 con 0x7f7884003f60 2024-03-30T13:11:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.315+0000 7f78a5c00640 1 -- 172.21.15.99:0/788513490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7884003f60 msgr2=0x7f7884004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.315+0000 7f78a5c00640 1 --2- 172.21.15.99:0/788513490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7884003f60 0x7f7884004800 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7888001750 tx=0x7f7884005830 comp rx=0 tx=0).stop 2024-03-30T13:11:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.315+0000 7f789f400640 1 -- 172.21.15.99:0/788513490 reap_dead start 2024-03-30T13:11:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.315+0000 7f78a5c00640 1 -- 172.21.15.99:0/788513490 shutdown_connections 2024-03-30T13:11:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.315+0000 7f78a5c00640 1 -- 172.21.15.99:0/788513490 >> 172.21.15.99:0/788513490 conn(0x7f78a006b510 msgr2=0x7f78a006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.315+0000 7f78a5c00640 1 -- 172.21.15.99:0/788513490 shutdown_connections 2024-03-30T13:11:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.315+0000 7f78a5c00640 1 -- 172.21.15.99:0/788513490 wait complete. 2024-03-30T13:11:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.317+0000 7f78a5c00640 1 Processor -- start 2024-03-30T13:11:59.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.317+0000 7f78a5c00640 1 -- start start 2024-03-30T13:11:59.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f78a5c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7884003f60 0x7f78a01568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f78a5c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78a00af0e0 0x7f78a0072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f78a5c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a0159110 0x7f78a0159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f78a5c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f78a0160260 con 0x7f78a0159110 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f78a5c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f78a01600e0 con 0x7f78a00af0e0 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f78a5c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f78a00b4b20 con 0x7f7884003f60 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f789f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a0159110 0x7f78a0159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f789f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a0159110 0x7f78a0159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53510/0 (socket says 172.21.15.99:53510) 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f789f400640 1 -- 172.21.15.99:0/3959339071 learned_addr learned my addr 172.21.15.99:0/3959339071 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f789ea00640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7884003f60 0x7f78a01568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f7896000640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78a00af0e0 0x7f78a0072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f789f400640 1 -- 172.21.15.99:0/3959339071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7884003f60 msgr2=0x7f78a01568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f789f400640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7884003f60 0x7f78a01568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f789f400640 1 -- 172.21.15.99:0/3959339071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78a00af0e0 msgr2=0x7f78a0072ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f789f400640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78a00af0e0 0x7f78a0072ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.318+0000 7f789f400640 1 -- 172.21.15.99:0/3959339071 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a00ae7e0 con 0x7f78a0159110 2024-03-30T13:11:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.319+0000 7f789f400640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a0159110 0x7f78a0159590 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7898009f30 tx=0x7f789800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.319+0000 7f7897400640 1 -- 172.21.15.99:0/3959339071 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898003990 con 0x7f78a0159110 2024-03-30T13:11:59.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.319+0000 7f7897400640 1 -- 172.21.15.99:0/3959339071 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7898003b50 con 0x7f78a0159110 2024-03-30T13:11:59.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.319+0000 7f78a5c00640 1 -- 172.21.15.99:0/3959339071 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a00aeac0 con 0x7f78a0159110 2024-03-30T13:11:59.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.319+0000 7f7897400640 1 -- 172.21.15.99:0/3959339071 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898004020 con 0x7f78a0159110 2024-03-30T13:11:59.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.319+0000 7f78a5c00640 1 -- 172.21.15.99:0/3959339071 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a015a1c0 con 0x7f78a0159110 2024-03-30T13:11:59.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.320+0000 7f78a5c00640 1 -- 172.21.15.99:0/3959339071 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a0068640 con 0x7f78a0159110 2024-03-30T13:11:59.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.321+0000 7f7897400640 1 -- 172.21.15.99:0/3959339071 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7898005d10 con 0x7f78a0159110 2024-03-30T13:11:59.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.322+0000 7f7897400640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f787c06c560 0x7f787c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.322+0000 7f7897400640 1 -- 172.21.15.99:0/3959339071 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f789808b710 con 0x7f78a0159110 2024-03-30T13:11:59.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.322+0000 7f789ea00640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f787c06c560 0x7f787c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.323+0000 7f789ea00640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f787c06c560 0x7f787c06ea20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f78900079b0 tx=0x7f7890009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.326+0000 7f7897400640 1 -- 172.21.15.99:0/3959339071 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7898012070 con 0x7f78a0159110 2024-03-30T13:11:59.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.599+0000 7f78a5c00640 1 -- 172.21.15.99:0/3959339071 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f78a00b3ce0 con 0x7f78a0159110 2024-03-30T13:11:59.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.602+0000 7f7897400640 1 -- 172.21.15.99:0/3959339071 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f789805ee20 con 0x7f78a0159110 2024-03-30T13:11:59.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 -- 172.21.15.99:0/3959339071 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f787c06c560 msgr2=0x7f787c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f787c06c560 0x7f787c06ea20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f78900079b0 tx=0x7f7890009040 comp rx=0 tx=0).stop 2024-03-30T13:11:59.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 -- 172.21.15.99:0/3959339071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a0159110 msgr2=0x7f78a0159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a0159110 0x7f78a0159590 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7898009f30 tx=0x7f789800f4a0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 -- 172.21.15.99:0/3959339071 shutdown_connections 2024-03-30T13:11:59.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f787c06c560 0x7f787c06ea20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a0159110 0x7f78a0159590 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78a00af0e0 0x7f78a0072ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 --2- 172.21.15.99:0/3959339071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7884003f60 0x7f78a01568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 -- 172.21.15.99:0/3959339071 >> 172.21.15.99:0/3959339071 conn(0x7f78a006b510 msgr2=0x7f78a015a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:59.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 -- 172.21.15.99:0/3959339071 shutdown_connections 2024-03-30T13:11:59.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.605+0000 7f78a5c00640 1 -- 172.21.15.99:0/3959339071 wait complete. 2024-03-30T13:11:59.627 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-30T13:11:59.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.817+0000 7fc926000640 1 Processor -- start 2024-03-30T13:11:59.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.818+0000 7fc926000640 1 -- start start 2024-03-30T13:11:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.819+0000 7fc926000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92015fc20 0x7fc9200c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.819+0000 7fc926000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc9200ccbe0 0x7fc9200c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.819+0000 7fc926000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc920160480 con 0x7fc9200c5020 2024-03-30T13:11:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.819+0000 7fc926000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc920161090 con 0x7fc9200ccbe0 2024-03-30T13:11:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.819+0000 7fc926000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc920160760 con 0x7fc92015fc20 2024-03-30T13:11:59.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.820+0000 7fc91f400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92015fc20 0x7fc9200c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.820+0000 7fc91fe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc9200ccbe0 0x7fc9200c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.820+0000 7fc91f400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92015fc20 0x7fc9200c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:36676/0 (socket says 172.21.15.99:36676) 2024-03-30T13:11:59.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.820+0000 7fc91f400640 1 -- 172.21.15.99:0/523687918 learned_addr learned my addr 172.21.15.99:0/523687918 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:59.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.821+0000 7fc91f400640 1 -- 172.21.15.99:0/523687918 >> v2:172.21.15.181:3300/0 conn(0x7fc9200ccbe0 msgr2=0x7fc9200c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:59.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.821+0000 7fc91f400640 1 --2- 172.21.15.99:0/523687918 >> v2:172.21.15.181:3300/0 conn(0x7fc9200ccbe0 0x7fc9200c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.821+0000 7fc91f400640 1 -- 172.21.15.99:0/523687918 >> v1:172.21.15.181:6789/0 conn(0x7fc9200c5020 legacy=0x7fc9200d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.821+0000 7fc91f400640 1 -- 172.21.15.99:0/523687918 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc920160a40 con 0x7fc92015fc20 2024-03-30T13:11:59.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.822+0000 7fc91f400640 1 --2- 172.21.15.99:0/523687918 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92015fc20 0x7fc9200c6140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc910009870 tx=0x7fc91002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3423515925113f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.822+0000 7fc91ea00640 1 -- 172.21.15.99:0/523687918 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910035020 con 0x7fc92015fc20 2024-03-30T13:11:59.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.823+0000 7fc91ea00640 1 -- 172.21.15.99:0/523687918 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc910031640 con 0x7fc92015fc20 2024-03-30T13:11:59.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.823+0000 7fc91ea00640 1 -- 172.21.15.99:0/523687918 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91002d040 con 0x7fc92015fc20 2024-03-30T13:11:59.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.823+0000 7fc926000640 1 -- 172.21.15.99:0/523687918 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92015fc20 msgr2=0x7fc9200c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.823+0000 7fc926000640 1 --2- 172.21.15.99:0/523687918 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92015fc20 0x7fc9200c6140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc910009870 tx=0x7fc91002b8f0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.823+0000 7fc926000640 1 -- 172.21.15.99:0/523687918 shutdown_connections 2024-03-30T13:11:59.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.823+0000 7fc926000640 1 --2- 172.21.15.99:0/523687918 >> v2:172.21.15.181:3300/0 conn(0x7fc9200ccbe0 0x7fc9200c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.823+0000 7fc926000640 1 --2- 172.21.15.99:0/523687918 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92015fc20 0x7fc9200c6140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.823+0000 7fc926000640 1 -- 172.21.15.99:0/523687918 >> 172.21.15.99:0/523687918 conn(0x7fc92006b510 msgr2=0x7fc92006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:59.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.823+0000 7fc926000640 1 -- 172.21.15.99:0/523687918 shutdown_connections 2024-03-30T13:11:59.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.823+0000 7fc926000640 1 -- 172.21.15.99:0/523687918 wait complete. 2024-03-30T13:11:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.826+0000 7fc926000640 1 Processor -- start 2024-03-30T13:11:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.826+0000 7fc926000640 1 -- start start 2024-03-30T13:11:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.827+0000 7fc926000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9200c5020 0x7fc9200c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.827+0000 7fc926000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9200ccbe0 0x7fc9200c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.827+0000 7fc926000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92015fc20 0x7fc920153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.827+0000 7fc926000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc920160260 con 0x7fc9200c5020 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.827+0000 7fc926000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc9201600e0 con 0x7fc92015fc20 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.827+0000 7fc926000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc9200b4b20 con 0x7fc9200ccbe0 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.827+0000 7fc91f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9200c5020 0x7fc9200c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.827+0000 7fc91f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9200c5020 0x7fc9200c98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53514/0 (socket says 172.21.15.99:53514) 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.827+0000 7fc91f400640 1 -- 172.21.15.99:0/2549421622 learned_addr learned my addr 172.21.15.99:0/2549421622 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc91fe00640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92015fc20 0x7fc920153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc917e00640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9200ccbe0 0x7fc9200c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc91f400640 1 -- 172.21.15.99:0/2549421622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9200ccbe0 msgr2=0x7fc9200c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc91f400640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9200ccbe0 0x7fc9200c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc91f400640 1 -- 172.21.15.99:0/2549421622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92015fc20 msgr2=0x7fc920153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc91f400640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92015fc20 0x7fc920153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc91f400640 1 -- 172.21.15.99:0/2549421622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc920153c80 con 0x7fc9200c5020 2024-03-30T13:11:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc91f400640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9200c5020 0x7fc9200c98b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc91002b930 tx=0x7fc9100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc917400640 1 -- 172.21.15.99:0/2549421622 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910040070 con 0x7fc9200c5020 2024-03-30T13:11:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc917400640 1 -- 172.21.15.99:0/2549421622 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91003e070 con 0x7fc9200c5020 2024-03-30T13:11:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc926000640 1 -- 172.21.15.99:0/2549421622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9200c7930 con 0x7fc9200c5020 2024-03-30T13:11:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc917400640 1 -- 172.21.15.99:0/2549421622 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910035040 con 0x7fc9200c5020 2024-03-30T13:11:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.828+0000 7fc926000640 1 -- 172.21.15.99:0/2549421622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9200c7ef0 con 0x7fc9200c5020 2024-03-30T13:11:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.829+0000 7fc926000640 1 -- 172.21.15.99:0/2549421622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc920068640 con 0x7fc9200c5020 2024-03-30T13:11:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.830+0000 7fc917400640 1 -- 172.21.15.99:0/2549421622 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc910038020 con 0x7fc9200c5020 2024-03-30T13:11:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.831+0000 7fc917400640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc8fc06c530 0x7fc8fc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.831+0000 7fc917400640 1 -- 172.21.15.99:0/2549421622 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fc9100acd50 con 0x7fc9200c5020 2024-03-30T13:11:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.831+0000 7fc917e00640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc8fc06c530 0x7fc8fc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.832+0000 7fc917e00640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc8fc06c530 0x7fc8fc06e9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc920099790 tx=0x7fc908009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:11:59.835+0000 7fc917400640 1 -- 172.21.15.99:0/2549421622 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc920153c80 con 0x7fc9200c5020 2024-03-30T13:12:00.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.109+0000 7fc926000640 1 -- 172.21.15.99:0/2549421622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fc9200cd470 con 0x7fc9200c5020 2024-03-30T13:12:00.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.115+0000 7fc917400640 1 -- 172.21.15.99:0/2549421622 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7fc91007b620 con 0x7fc9200c5020 2024-03-30T13:12:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 -- 172.21.15.99:0/2549421622 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc8fc06c530 msgr2=0x7fc8fc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc8fc06c530 0x7fc8fc06e9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc920099790 tx=0x7fc908009040 comp rx=0 tx=0).stop 2024-03-30T13:12:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 -- 172.21.15.99:0/2549421622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9200c5020 msgr2=0x7fc9200c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9200c5020 0x7fc9200c98b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc91002b930 tx=0x7fc9100046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 -- 172.21.15.99:0/2549421622 shutdown_connections 2024-03-30T13:12:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc8fc06c530 0x7fc8fc06e9f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92015fc20 0x7fc920153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9200ccbe0 0x7fc9200c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 --2- 172.21.15.99:0/2549421622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9200c5020 0x7fc9200c98b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 -- 172.21.15.99:0/2549421622 >> 172.21.15.99:0/2549421622 conn(0x7fc92006b510 msgr2=0x7fc9200c54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 -- 172.21.15.99:0/2549421622 shutdown_connections 2024-03-30T13:12:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.118+0000 7fc926000640 1 -- 172.21.15.99:0/2549421622 wait complete. 2024-03-30T13:12:00.141 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-30T13:12:00.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.340+0000 7fb7ebe00640 1 Processor -- start 2024-03-30T13:12:00.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.340+0000 7fb7ebe00640 1 -- start start 2024-03-30T13:12:00.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.342+0000 7fb7ebe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb7ec0cee00 0x7fb7ec0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.342+0000 7fb7ebe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb7ec0ccf30 0x7fb7ec15fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.342+0000 7fb7ebe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7ec0cd360 con 0x7fb7ec159fe0 2024-03-30T13:12:00.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.342+0000 7fb7ebe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb7ec15c9d0 con 0x7fb7ec0cee00 2024-03-30T13:12:00.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.342+0000 7fb7ebe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb7ec15cc90 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.342+0000 7fb7ea000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb7ec0cee00 0x7fb7ec0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.342+0000 7fb7eaa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb7ec159fe0 0x7fb7ec0ca660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39890/0 (socket says 172.21.15.99:39890) 2024-03-30T13:12:00.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.342+0000 7fb7eaa00640 1 -- 172.21.15.99:0/1546563637 learned_addr learned my addr 172.21.15.99:0/1546563637 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:00.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.342+0000 7fb7e9600640 1 -- 172.21.15.99:0/1546563637 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2942504116 0 0) 0x7fb7ec0cd360 con 0x7fb7ec159fe0 2024-03-30T13:12:00.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.342+0000 7fb7ea000640 1 -- 172.21.15.99:0/1546563637 >> v2:172.21.15.181:3300/0 conn(0x7fb7ec0ccf30 msgr2=0x7fb7ec15fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:00.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.342+0000 7fb7eb400640 1 --2- 172.21.15.99:0/1546563637 >> v2:172.21.15.181:3300/0 conn(0x7fb7ec0ccf30 0x7fb7ec15fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.343+0000 7fb7ea000640 1 --2- 172.21.15.99:0/1546563637 >> v2:172.21.15.181:3300/0 conn(0x7fb7ec0ccf30 0x7fb7ec15fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.343+0000 7fb7ea000640 1 -- 172.21.15.99:0/1546563637 >> v1:172.21.15.99:6789/0 conn(0x7fb7ec159fe0 legacy=0x7fb7ec0ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.343+0000 7fb7ea000640 1 -- 172.21.15.99:0/1546563637 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ec15cf70 con 0x7fb7ec0cee00 2024-03-30T13:12:00.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.343+0000 7fb7eb400640 1 --2- 172.21.15.99:0/1546563637 >> v2:172.21.15.181:3300/0 conn(0x7fb7ec0ccf30 0x7fb7ec15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:00.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.344+0000 7fb7ea000640 1 --2- 172.21.15.99:0/1546563637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7ec0cee00 0x7fb7ec0cc9f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0afb60 tx=0x7fb7d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb1925367376593 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.344+0000 7fb7e9600640 1 -- 172.21.15.99:0/1546563637 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8035020 con 0x7fb7ec0cee00 2024-03-30T13:12:00.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.344+0000 7fb7e9600640 1 -- 172.21.15.99:0/1546563637 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d8031830 con 0x7fb7ec0cee00 2024-03-30T13:12:00.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.344+0000 7fb7e9600640 1 -- 172.21.15.99:0/1546563637 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8031c00 con 0x7fb7ec0cee00 2024-03-30T13:12:00.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.345+0000 7fb7ebe00640 1 -- 172.21.15.99:0/1546563637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7ec0cee00 msgr2=0x7fb7ec0cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.345+0000 7fb7ebe00640 1 --2- 172.21.15.99:0/1546563637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7ec0cee00 0x7fb7ec0cc9f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0afb60 tx=0x7fb7d802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.345+0000 7fb7ebe00640 1 -- 172.21.15.99:0/1546563637 shutdown_connections 2024-03-30T13:12:00.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.345+0000 7fb7ebe00640 1 --2- 172.21.15.99:0/1546563637 >> v2:172.21.15.181:3300/0 conn(0x7fb7ec0ccf30 0x7fb7ec15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.345+0000 7fb7ebe00640 1 --2- 172.21.15.99:0/1546563637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7ec0cee00 0x7fb7ec0cc9f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.345+0000 7fb7ebe00640 1 -- 172.21.15.99:0/1546563637 >> 172.21.15.99:0/1546563637 conn(0x7fb7ec0b1e20 msgr2=0x7fb7ec0b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:00.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.345+0000 7fb7ebe00640 1 -- 172.21.15.99:0/1546563637 shutdown_connections 2024-03-30T13:12:00.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.345+0000 7fb7ebe00640 1 -- 172.21.15.99:0/1546563637 wait complete. 2024-03-30T13:12:00.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.346+0000 7fb7ebe00640 1 Processor -- start 2024-03-30T13:12:00.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.346+0000 7fb7ebe00640 1 -- start start 2024-03-30T13:12:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.347+0000 7fb7ebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7ec0ccf30 0x7fb7ec15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.347+0000 7fb7ebe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7ec0cee00 0x7fb7ec14aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.347+0000 7fb7ebe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7ec159fe0 0x7fb7ec14b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.347+0000 7fb7ebe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec0cc5d0 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.347+0000 7fb7ebe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec15d530 con 0x7fb7ec159fe0 2024-03-30T13:12:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.347+0000 7fb7ebe00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb7ec0cc750 con 0x7fb7ec0cee00 2024-03-30T13:12:00.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7eaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7ec0ccf30 0x7fb7ec15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7eaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7ec0ccf30 0x7fb7ec15b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53536/0 (socket says 172.21.15.99:53536) 2024-03-30T13:12:00.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7eaa00640 1 -- 172.21.15.99:0/83611267 learned_addr learned my addr 172.21.15.99:0/83611267 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:00.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7eaa00640 1 -- 172.21.15.99:0/83611267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7ec0cee00 msgr2=0x7fb7ec14aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7eaa00640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7ec0cee00 0x7fb7ec14aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7eaa00640 1 -- 172.21.15.99:0/83611267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7ec159fe0 msgr2=0x7fb7ec14b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7eaa00640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7ec159fe0 0x7fb7ec14b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7eaa00640 1 -- 172.21.15.99:0/83611267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ec1575d0 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7eaa00640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7ec0ccf30 0x7fb7ec15b710 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00c4d0 tx=0x7fb7dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7e2a00640 1 -- 172.21.15.99:0/83611267 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc018070 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7e2a00640 1 -- 172.21.15.99:0/83611267 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7dc007500 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.348+0000 7fb7ebe00640 1 -- 172.21.15.99:0/83611267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ec0c5ba0 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.349+0000 7fb7e2a00640 1 -- 172.21.15.99:0/83611267 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc004a20 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.349+0000 7fb7ebe00640 1 -- 172.21.15.99:0/83611267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ec157870 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.350+0000 7fb7ebe00640 1 -- 172.21.15.99:0/83611267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7ec04f8f0 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.350+0000 7fb7e2a00640 1 -- 172.21.15.99:0/83611267 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb7dc01b070 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.351+0000 7fb7e2a00640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c560 0x7fb7cc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.351+0000 7fb7e2a00640 1 -- 172.21.15.99:0/83611267 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fb7dc08a750 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.352+0000 7fb7ea000640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c560 0x7fb7cc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.352+0000 7fb7ea000640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c560 0x7fb7cc06ea20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8036000 tx=0x7fb7d8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.356+0000 7fb7e2a00640 1 -- 172.21.15.99:0/83611267 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb7dc059020 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.610+0000 7fb7ebe00640 1 -- 172.21.15.99:0/83611267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fb7ec156c90 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.614+0000 7fb7e2a00640 1 -- 172.21.15.99:0/83611267 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fb7dc058920 con 0x7fb7ec0ccf30 2024-03-30T13:12:00.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 -- 172.21.15.99:0/83611267 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c560 msgr2=0x7fb7cc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c560 0x7fb7cc06ea20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8036000 tx=0x7fb7d8030000 comp rx=0 tx=0).stop 2024-03-30T13:12:00.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 -- 172.21.15.99:0/83611267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7ec0ccf30 msgr2=0x7fb7ec15b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7ec0ccf30 0x7fb7ec15b710 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00c4d0 tx=0x7fb7dc00c990 comp rx=0 tx=0).stop 2024-03-30T13:12:00.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 -- 172.21.15.99:0/83611267 shutdown_connections 2024-03-30T13:12:00.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c560 0x7fb7cc06ea20 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8036000 tx=0x7fb7d8030000 comp rx=0 tx=0).stop 2024-03-30T13:12:00.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7ec159fe0 0x7fb7ec14b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7ec0cee00 0x7fb7ec14aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 --2- 172.21.15.99:0/83611267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7ec0ccf30 0x7fb7ec15b710 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 -- 172.21.15.99:0/83611267 >> 172.21.15.99:0/83611267 conn(0x7fb7ec0b1e20 msgr2=0x7fb7ec15e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:00.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 -- 172.21.15.99:0/83611267 shutdown_connections 2024-03-30T13:12:00.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.617+0000 7fb7ebe00640 1 -- 172.21.15.99:0/83611267 wait complete. 2024-03-30T13:12:00.639 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:00.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:00.729 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:00.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.844+0000 7f6172000640 1 Processor -- start 2024-03-30T13:12:00.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.844+0000 7f6172000640 1 -- start start 2024-03-30T13:12:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.845+0000 7f6172000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c0ce130 0x7f616c15ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.845+0000 7f6172000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f616c0ce6d0 con 0x7f616c0cf770 2024-03-30T13:12:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.845+0000 7f6172000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f616c0ce9b0 con 0x7f616c153280 2024-03-30T13:12:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.845+0000 7f6172000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f616c0cf2e0 con 0x7f616c0ce130 2024-03-30T13:12:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.846+0000 7f6171600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f616c0cf770 0x7f616c06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39892/0 (socket says 172.21.15.99:39892) 2024-03-30T13:12:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.846+0000 7f6171600640 1 -- 172.21.15.99:0/3983015824 learned_addr learned my addr 172.21.15.99:0/3983015824 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:00.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.846+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76968885 0 0) 0x7f616c0ce6d0 con 0x7f616c0cf770 2024-03-30T13:12:00.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.846+0000 7f616be00640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c0ce130 0x7f616c15ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.846+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6154003520 con 0x7f616c0cf770 2024-03-30T13:12:00.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3783701498 0 0) 0x7f6154003520 con 0x7f616c0cf770 2024-03-30T13:12:00.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c0ce130 msgr2=0x7f616c15ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:00.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c0ce130 0x7f616c15ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 >> v1:172.21.15.181:6789/0 conn(0x7f616c153280 legacy=0x7f616c0b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c0cec90 con 0x7f616c0cf770 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f61640019f0 con 0x7f616c0cf770 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 >> v1:172.21.15.99:6789/0 conn(0x7f616c0cf770 legacy=0x7f616c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c0ce130 0x7f6154003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6154004030 0x7f6154004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6154004d40 0x7f61540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f616c0cf2e0 con 0x7f6154004d40 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f615400bb80 con 0x7f6154004030 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f615400bd80 con 0x7f616c0ce130 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f6171600640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6154004d40 0x7f61540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f616be00640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6154004030 0x7f6154004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.847+0000 7f6170c00640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c0ce130 0x7f6154003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.848+0000 7f6171600640 1 -- 172.21.15.99:0/3983015824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c0ce130 msgr2=0x7f6154003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.848+0000 7f6171600640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c0ce130 0x7f6154003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.848+0000 7f6171600640 1 -- 172.21.15.99:0/3983015824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6154004030 msgr2=0x7f6154004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:00.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.848+0000 7f6171600640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6154004030 0x7f6154004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.848+0000 7f6171600640 1 -- 172.21.15.99:0/3983015824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6154003520 con 0x7f6154004d40 2024-03-30T13:12:00.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.849+0000 7f6171600640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6154004d40 0x7f61540051c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f616400a840 tx=0x7f6154005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7bbaf2f86ec00f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.849+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616400a460 con 0x7f6154004d40 2024-03-30T13:12:00.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.849+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6164034650 con 0x7f6154004d40 2024-03-30T13:12:00.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.849+0000 7f616b400640 1 -- 172.21.15.99:0/3983015824 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6164034a80 con 0x7f6154004d40 2024-03-30T13:12:00.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.849+0000 7f6172000640 1 -- 172.21.15.99:0/3983015824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6154004d40 msgr2=0x7f61540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.849+0000 7f6172000640 1 --2- 172.21.15.99:0/3983015824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6154004d40 0x7f61540051c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f616400a840 tx=0x7f6154005830 comp rx=0 tx=0).stop 2024-03-30T13:12:00.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.849+0000 7f6171600640 1 -- 172.21.15.99:0/3983015824 reap_dead start 2024-03-30T13:12:00.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.849+0000 7f6172000640 1 -- 172.21.15.99:0/3983015824 shutdown_connections 2024-03-30T13:12:00.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.850+0000 7f6172000640 1 -- 172.21.15.99:0/3983015824 >> 172.21.15.99:0/3983015824 conn(0x7f616c06bb40 msgr2=0x7f616c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:00.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.850+0000 7f6172000640 1 -- 172.21.15.99:0/3983015824 shutdown_connections 2024-03-30T13:12:00.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.850+0000 7f6172000640 1 -- 172.21.15.99:0/3983015824 wait complete. 2024-03-30T13:12:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.851+0000 7f6172000640 1 Processor -- start 2024-03-30T13:12:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.851+0000 7f6172000640 1 -- start start 2024-03-30T13:12:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.852+0000 7f6172000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6154004d40 0x7f616c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.852+0000 7f6172000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f616c151690 0x7f616c151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.852+0000 7f6172000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c09d080 0x7f616c09d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.852+0000 7f6172000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f616c1537e0 con 0x7f616c151690 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.852+0000 7f6172000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f616c153660 con 0x7f6154004d40 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.852+0000 7f6172000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f616c06dd60 con 0x7f616c09d080 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f616be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f616c151690 0x7f616c151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f616be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f616c151690 0x7f616c151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53558/0 (socket says 172.21.15.99:53558) 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f616be00640 1 -- 172.21.15.99:0/3580619594 learned_addr learned my addr 172.21.15.99:0/3580619594 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f6170c00640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6154004d40 0x7f616c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f6171600640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c09d080 0x7f616c09d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f616be00640 1 -- 172.21.15.99:0/3580619594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c09d080 msgr2=0x7f616c09d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f616be00640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c09d080 0x7f616c09d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f616be00640 1 -- 172.21.15.99:0/3580619594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6154004d40 msgr2=0x7f616c06ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f616be00640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6154004d40 0x7f616c06ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f616be00640 1 -- 172.21.15.99:0/3580619594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c0b0e70 con 0x7f616c151690 2024-03-30T13:12:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f6171600640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c09d080 0x7f616c09d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.853+0000 7f616be00640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f616c151690 0x7f616c151b10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f615800f580 tx=0x7f615800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.854+0000 7f6168c00640 1 -- 172.21.15.99:0/3580619594 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6158019020 con 0x7f616c151690 2024-03-30T13:12:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.854+0000 7f6168c00640 1 -- 172.21.15.99:0/3580619594 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6158014870 con 0x7f616c151690 2024-03-30T13:12:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.854+0000 7f6168c00640 1 -- 172.21.15.99:0/3580619594 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6158014c60 con 0x7f616c151690 2024-03-30T13:12:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.854+0000 7f6172000640 1 -- 172.21.15.99:0/3580619594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f616c0b1150 con 0x7f616c151690 2024-03-30T13:12:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.854+0000 7f6172000640 1 -- 172.21.15.99:0/3580619594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f616c152050 con 0x7f616c151690 2024-03-30T13:12:00.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.855+0000 7f6172000640 1 -- 172.21.15.99:0/3580619594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f616c04f8f0 con 0x7f616c151690 2024-03-30T13:12:00.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.856+0000 7f6168c00640 1 -- 172.21.15.99:0/3580619594 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f615801c020 con 0x7f616c151690 2024-03-30T13:12:00.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.857+0000 7f6168c00640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f614c06c530 0x7f614c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:00.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.857+0000 7f6168c00640 1 -- 172.21.15.99:0/3580619594 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f615808bbf0 con 0x7f616c151690 2024-03-30T13:12:00.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.857+0000 7f6170c00640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f614c06c530 0x7f614c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:00.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.858+0000 7f6170c00640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f614c06c530 0x7f614c06e9f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6160007fd0 tx=0x7f6160009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:00.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:00.861+0000 7f6168c00640 1 -- 172.21.15.99:0/3580619594 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6158023020 con 0x7f616c151690 2024-03-30T13:12:01.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.061+0000 7f6172000640 1 -- 172.21.15.99:0/3580619594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f616c0b4250 con 0x7f616c151690 2024-03-30T13:12:01.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.062+0000 7f6168c00640 1 -- 172.21.15.99:0/3580619594 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+12891 (secure 0 0 0) 0x7f6158026350 con 0x7f616c151690 2024-03-30T13:12:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:01.067 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":31,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:11:57.073672+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:01.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 -- 172.21.15.99:0/3580619594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f614c06c530 msgr2=0x7f614c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f614c06c530 0x7f614c06e9f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6160007fd0 tx=0x7f6160009040 comp rx=0 tx=0).stop 2024-03-30T13:12:01.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 -- 172.21.15.99:0/3580619594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f616c151690 msgr2=0x7f616c151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f616c151690 0x7f616c151b10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f615800f580 tx=0x7f615800fa40 comp rx=0 tx=0).stop 2024-03-30T13:12:01.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 -- 172.21.15.99:0/3580619594 shutdown_connections 2024-03-30T13:12:01.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f614c06c530 0x7f614c06e9f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616c09d080 0x7f616c09d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f616c151690 0x7f616c151b10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 --2- 172.21.15.99:0/3580619594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6154004d40 0x7f616c06ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 -- 172.21.15.99:0/3580619594 >> 172.21.15.99:0/3580619594 conn(0x7f616c06bb40 msgr2=0x7f616c15ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:01.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 -- 172.21.15.99:0/3580619594 shutdown_connections 2024-03-30T13:12:01.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.065+0000 7f6172000640 1 -- 172.21.15.99:0/3580619594 wait complete. 2024-03-30T13:12:01.086 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:12:01.089 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:12:01.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.340+0000 7fc58f600640 1 Processor -- start 2024-03-30T13:12:01.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.340+0000 7fc58f600640 1 -- start start 2024-03-30T13:12:01.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.341+0000 7fc58f600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc58815b3d0 0x7fc5880ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.341+0000 7fc58f600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5880c6470 con 0x7fc5880b49f0 2024-03-30T13:12:01.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.341+0000 7fc58f600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5880c6750 con 0x7fc5880b28c0 2024-03-30T13:12:01.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.341+0000 7fc58f600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc5880c6240 con 0x7fc58815b3d0 2024-03-30T13:12:01.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.341+0000 7fc57fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc5880b49f0 0x7fc5880b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39906/0 (socket says 172.21.15.99:39906) 2024-03-30T13:12:01.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.341+0000 7fc57fe00640 1 -- 172.21.15.99:0/3426761058 learned_addr learned my addr 172.21.15.99:0/3426761058 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712702215 0 0) 0x7fc5880c6470 con 0x7fc5880b49f0 2024-03-30T13:12:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc58cc00640 1 --2- 172.21.15.99:0/3426761058 >> v2:172.21.15.181:3300/0 conn(0x7fc58815b3d0 0x7fc5880ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc56c003520 con 0x7fc5880b49f0 2024-03-30T13:12:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 859006484 0 0) 0x7fc56c003520 con 0x7fc5880b49f0 2024-03-30T13:12:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 >> v2:172.21.15.181:3300/0 conn(0x7fc58815b3d0 msgr2=0x7fc5880ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 --2- 172.21.15.99:0/3426761058 >> v2:172.21.15.181:3300/0 conn(0x7fc58815b3d0 0x7fc5880ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 >> v1:172.21.15.181:6789/0 conn(0x7fc5880b28c0 legacy=0x7fc58815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5880c6a30 con 0x7fc5880b49f0 2024-03-30T13:12:01.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fc570001670 con 0x7fc5880b49f0 2024-03-30T13:12:01.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 >> v1:172.21.15.99:6789/0 conn(0x7fc5880b49f0 legacy=0x7fc5880b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 --2- 172.21.15.99:0/3426761058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc56c0039b0 0x7fc56c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 --2- 172.21.15.99:0/3426761058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c004800 0x7fc56c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 --2- 172.21.15.99:0/3426761058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc56c0051c0 0x7fc56c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c00c030 con 0x7fc56c004800 2024-03-30T13:12:01.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c00c1e0 con 0x7fc56c0039b0 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.342+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc56c00c3e0 con 0x7fc56c0051c0 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.343+0000 7fc57fe00640 1 --2- 172.21.15.99:0/3426761058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c004800 0x7fc56c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.343+0000 7fc58cc00640 1 --2- 172.21.15.99:0/3426761058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc56c0039b0 0x7fc56c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.343+0000 7fc57fe00640 1 -- 172.21.15.99:0/3426761058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc56c0051c0 msgr2=0x7fc56c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.343+0000 7fc58d600640 1 --2- 172.21.15.99:0/3426761058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc56c0051c0 0x7fc56c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.343+0000 7fc57fe00640 1 --2- 172.21.15.99:0/3426761058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc56c0051c0 0x7fc56c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.343+0000 7fc57fe00640 1 -- 172.21.15.99:0/3426761058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc56c0039b0 msgr2=0x7fc56c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.343+0000 7fc57fe00640 1 --2- 172.21.15.99:0/3426761058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc56c0039b0 0x7fc56c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.343+0000 7fc57fe00640 1 -- 172.21.15.99:0/3426761058 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c003520 con 0x7fc56c004800 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.343+0000 7fc58d600640 1 -- 172.21.15.99:0/3426761058 reap_dead start 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.344+0000 7fc57fe00640 1 --2- 172.21.15.99:0/3426761058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c004800 0x7fc56c004c80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c240 tx=0x7fc56c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626a13b03abe6e11 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:01.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.344+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570007cf0 con 0x7fc56c004800 2024-03-30T13:12:01.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.344+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc570030070 con 0x7fc56c004800 2024-03-30T13:12:01.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.344+0000 7fc587e00640 1 -- 172.21.15.99:0/3426761058 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570005d70 con 0x7fc56c004800 2024-03-30T13:12:01.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.345+0000 7fc58f600640 1 -- 172.21.15.99:0/3426761058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c004800 msgr2=0x7fc56c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.345+0000 7fc58f600640 1 --2- 172.21.15.99:0/3426761058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c004800 0x7fc56c004c80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c240 tx=0x7fc56c005830 comp rx=0 tx=0).stop 2024-03-30T13:12:01.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.345+0000 7fc58f600640 1 -- 172.21.15.99:0/3426761058 shutdown_connections 2024-03-30T13:12:01.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.345+0000 7fc58f600640 1 --2- 172.21.15.99:0/3426761058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c004800 0x7fc56c004c80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.345+0000 7fc58f600640 1 -- 172.21.15.99:0/3426761058 >> 172.21.15.99:0/3426761058 conn(0x7fc5880d0450 msgr2=0x7fc5880d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:01.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.345+0000 7fc58f600640 1 -- 172.21.15.99:0/3426761058 shutdown_connections 2024-03-30T13:12:01.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.345+0000 7fc58f600640 1 -- 172.21.15.99:0/3426761058 wait complete. 2024-03-30T13:12:01.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.347+0000 7fc58f600640 1 Processor -- start 2024-03-30T13:12:01.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.347+0000 7fc58f600640 1 -- start start 2024-03-30T13:12:01.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc58f600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc56c004800 0x7fc5880c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc58f600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5881552b0 0x7fc588155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc58f600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5880ad440 0x7fc5880ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc58f600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc58815b7b0 con 0x7fc5881552b0 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc58f600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc5880c7080 con 0x7fc5880ad440 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc58f600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc58815b930 con 0x7fc56c004800 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc57fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5881552b0 0x7fc588155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc57fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5881552b0 0x7fc588155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53564/0 (socket says 172.21.15.99:53564) 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc57fe00640 1 -- 172.21.15.99:0/2471224594 learned_addr learned my addr 172.21.15.99:0/2471224594 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc57fe00640 1 -- 172.21.15.99:0/2471224594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc56c004800 msgr2=0x7fc5880c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc57fe00640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc56c004800 0x7fc5880c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc57fe00640 1 -- 172.21.15.99:0/2471224594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5880ad440 msgr2=0x7fc5880ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc57fe00640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5880ad440 0x7fc5880ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.348+0000 7fc57fe00640 1 -- 172.21.15.99:0/2471224594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5880ae1b0 con 0x7fc5881552b0 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.349+0000 7fc57fe00640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5881552b0 0x7fc588155730 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c240 tx=0x7fc5880c6640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.349+0000 7fc585600640 1 -- 172.21.15.99:0/2471224594 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570004bf0 con 0x7fc5881552b0 2024-03-30T13:12:01.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.349+0000 7fc585600640 1 -- 172.21.15.99:0/2471224594 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc570004d90 con 0x7fc5881552b0 2024-03-30T13:12:01.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.349+0000 7fc585600640 1 -- 172.21.15.99:0/2471224594 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570007290 con 0x7fc5881552b0 2024-03-30T13:12:01.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.349+0000 7fc58f600640 1 -- 172.21.15.99:0/2471224594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5880ae490 con 0x7fc5881552b0 2024-03-30T13:12:01.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.349+0000 7fc58f600640 1 -- 172.21.15.99:0/2471224594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5880aea50 con 0x7fc5881552b0 2024-03-30T13:12:01.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.350+0000 7fc58f600640 1 -- 172.21.15.99:0/2471224594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5880aec90 con 0x7fc5881552b0 2024-03-30T13:12:01.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.351+0000 7fc585600640 1 -- 172.21.15.99:0/2471224594 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc570007430 con 0x7fc5881552b0 2024-03-30T13:12:01.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.352+0000 7fc585600640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc56406c4d0 0x7fc56406e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.352+0000 7fc585600640 1 -- 172.21.15.99:0/2471224594 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fc5700acaf0 con 0x7fc5881552b0 2024-03-30T13:12:01.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.352+0000 7fc58cc00640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc56406c4d0 0x7fc56406e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.353+0000 7fc58cc00640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc56406c4d0 0x7fc56406e990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc578009990 tx=0x7fc578008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:01.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.356+0000 7fc585600640 1 -- 172.21.15.99:0/2471224594 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc5880aec90 con 0x7fc5881552b0 2024-03-30T13:12:01.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.552+0000 7fc58f600640 1 -- 172.21.15.99:0/2471224594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc58809e520 con 0x7fc5881552b0 2024-03-30T13:12:01.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.553+0000 7fc585600640 1 -- 172.21.15.99:0/2471224594 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) ==== 93+0+10 (secure 0 0 0) 0x7fc57007b570 con 0x7fc5881552b0 2024-03-30T13:12:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:12:01.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.555+0000 7fc58f600640 1 -- 172.21.15.99:0/2471224594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc56406c4d0 msgr2=0x7fc56406e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.555+0000 7fc58f600640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc56406c4d0 0x7fc56406e990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc578009990 tx=0x7fc578008040 comp rx=0 tx=0).stop 2024-03-30T13:12:01.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.555+0000 7fc58f600640 1 -- 172.21.15.99:0/2471224594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5881552b0 msgr2=0x7fc588155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.555+0000 7fc58f600640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5881552b0 0x7fc588155730 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c240 tx=0x7fc5880c6640 comp rx=0 tx=0).stop 2024-03-30T13:12:01.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.555+0000 7fc58f600640 1 -- 172.21.15.99:0/2471224594 shutdown_connections 2024-03-30T13:12:01.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.556+0000 7fc58f600640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc56406c4d0 0x7fc56406e990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.556+0000 7fc58f600640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5880ad440 0x7fc5880ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.556+0000 7fc58f600640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5881552b0 0x7fc588155730 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.556+0000 7fc58f600640 1 --2- 172.21.15.99:0/2471224594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc56c004800 0x7fc5880c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.556+0000 7fc58f600640 1 -- 172.21.15.99:0/2471224594 >> 172.21.15.99:0/2471224594 conn(0x7fc5880d0450 msgr2=0x7fc5880ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:01.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.556+0000 7fc58f600640 1 -- 172.21.15.99:0/2471224594 shutdown_connections 2024-03-30T13:12:01.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.556+0000 7fc58f600640 1 -- 172.21.15.99:0/2471224594 wait complete. 2024-03-30T13:12:01.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-30T13:12:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.775+0000 7fd27f600640 1 Processor -- start 2024-03-30T13:12:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.776+0000 7fd27f600640 1 -- start start 2024-03-30T13:12:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.777+0000 7fd27f600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd27815c670 0x7fd27806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.777+0000 7fd27f600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd27806f060 0x7fd27806d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.777+0000 7fd27f600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd278146230 con 0x7fd2780ad230 2024-03-30T13:12:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.777+0000 7fd27f600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd27806dfc0 con 0x7fd27806f060 2024-03-30T13:12:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.777+0000 7fd27f600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd27806e2a0 con 0x7fd27815c670 2024-03-30T13:12:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.777+0000 7fd277e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd27806f060 0x7fd27806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.777+0000 7fd277e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd27806f060 0x7fd27806d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53574/0 (socket says 172.21.15.99:53574) 2024-03-30T13:12:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.777+0000 7fd277e00640 1 -- 172.21.15.99:0/1135615846 learned_addr learned my addr 172.21.15.99:0/1135615846 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.778+0000 7fd27cc00640 1 --2- 172.21.15.99:0/1135615846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd27815c670 0x7fd27806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.778+0000 7fd277e00640 1 -- 172.21.15.99:0/1135615846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd27815c670 msgr2=0x7fd27806c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.778+0000 7fd277e00640 1 --2- 172.21.15.99:0/1135615846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd27815c670 0x7fd27806c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.778+0000 7fd277e00640 1 -- 172.21.15.99:0/1135615846 >> v1:172.21.15.181:6789/0 conn(0x7fd2780ad230 legacy=0x7fd2780b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.778+0000 7fd277e00640 1 -- 172.21.15.99:0/1135615846 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27806e580 con 0x7fd27806f060 2024-03-30T13:12:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.779+0000 7fd277e00640 1 --2- 172.21.15.99:0/1135615846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27806f060 0x7fd27806d930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd260009e50 tx=0x7fd26002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423211de419f0eab server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.779+0000 7fd277400640 1 -- 172.21.15.99:0/1135615846 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26002c9e0 con 0x7fd27806f060 2024-03-30T13:12:01.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.779+0000 7fd277400640 1 -- 172.21.15.99:0/1135615846 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd26002cb80 con 0x7fd27806f060 2024-03-30T13:12:01.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.779+0000 7fd277400640 1 -- 172.21.15.99:0/1135615846 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2600343f0 con 0x7fd27806f060 2024-03-30T13:12:01.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.780+0000 7fd27f600640 1 -- 172.21.15.99:0/1135615846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27806f060 msgr2=0x7fd27806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.780+0000 7fd27f600640 1 --2- 172.21.15.99:0/1135615846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27806f060 0x7fd27806d930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd260009e50 tx=0x7fd26002be40 comp rx=0 tx=0).stop 2024-03-30T13:12:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.780+0000 7fd27f600640 1 -- 172.21.15.99:0/1135615846 shutdown_connections 2024-03-30T13:12:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.780+0000 7fd27f600640 1 --2- 172.21.15.99:0/1135615846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27806f060 0x7fd27806d930 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.780+0000 7fd27f600640 1 --2- 172.21.15.99:0/1135615846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd27815c670 0x7fd27806c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.780+0000 7fd27f600640 1 -- 172.21.15.99:0/1135615846 >> 172.21.15.99:0/1135615846 conn(0x7fd27806b510 msgr2=0x7fd27806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.780+0000 7fd27f600640 1 -- 172.21.15.99:0/1135615846 shutdown_connections 2024-03-30T13:12:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.780+0000 7fd27f600640 1 -- 172.21.15.99:0/1135615846 wait complete. 2024-03-30T13:12:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.782+0000 7fd27f600640 1 Processor -- start 2024-03-30T13:12:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.782+0000 7fd27f600640 1 -- start start 2024-03-30T13:12:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27f600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd27806f060 0x7fd2780caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27f600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2780ad230 0x7fd2780cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27f600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27815c670 0x7fd2781f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27f600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd2780ad6c0 con 0x7fd27815c670 2024-03-30T13:12:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27f600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd27815ca50 con 0x7fd2780ad230 2024-03-30T13:12:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27f600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd2780ad840 con 0x7fd27806f060 2024-03-30T13:12:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27815c670 0x7fd2781f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27815c670 0x7fd2781f3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53588/0 (socket says 172.21.15.99:53588) 2024-03-30T13:12:01.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27d600640 1 -- 172.21.15.99:0/1921904868 learned_addr learned my addr 172.21.15.99:0/1921904868 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:01.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27cc00640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd27806f060 0x7fd2780caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd277e00640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2780ad230 0x7fd2780cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27d600640 1 -- 172.21.15.99:0/1921904868 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd27806f060 msgr2=0x7fd2780caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27d600640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd27806f060 0x7fd2780caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27d600640 1 -- 172.21.15.99:0/1921904868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2780ad230 msgr2=0x7fd2780cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:01.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27d600640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2780ad230 0x7fd2780cb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:01.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.783+0000 7fd27d600640 1 -- 172.21.15.99:0/1921904868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2781557c0 con 0x7fd27815c670 2024-03-30T13:12:01.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.784+0000 7fd27d600640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27815c670 0x7fd2781f3db0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c440 tx=0x7fd27000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:01.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.784+0000 7fd274c00640 1 -- 172.21.15.99:0/1921904868 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270011790 con 0x7fd27815c670 2024-03-30T13:12:01.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.784+0000 7fd274c00640 1 -- 172.21.15.99:0/1921904868 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd270017070 con 0x7fd27815c670 2024-03-30T13:12:01.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.784+0000 7fd274c00640 1 -- 172.21.15.99:0/1921904868 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270011b70 con 0x7fd27815c670 2024-03-30T13:12:01.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.784+0000 7fd27f600640 1 -- 172.21.15.99:0/1921904868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2780cbb30 con 0x7fd27815c670 2024-03-30T13:12:01.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.784+0000 7fd27f600640 1 -- 172.21.15.99:0/1921904868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2780cc0f0 con 0x7fd27815c670 2024-03-30T13:12:01.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.785+0000 7fd27f600640 1 -- 172.21.15.99:0/1921904868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd278068640 con 0x7fd27815c670 2024-03-30T13:12:01.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.786+0000 7fd274c00640 1 -- 172.21.15.99:0/1921904868 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd270011d10 con 0x7fd27815c670 2024-03-30T13:12:01.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.787+0000 7fd274c00640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd25406c530 0x7fd25406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:01.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.787+0000 7fd274c00640 1 -- 172.21.15.99:0/1921904868 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fd27008b160 con 0x7fd27815c670 2024-03-30T13:12:01.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.787+0000 7fd27cc00640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd25406c530 0x7fd25406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:01.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.788+0000 7fd27cc00640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd25406c530 0x7fd25406e9f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd268006fd0 tx=0x7fd268008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:01.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.792+0000 7fd274c00640 1 -- 172.21.15.99:0/1921904868 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd270059b60 con 0x7fd27815c670 2024-03-30T13:12:01.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.993+0000 7fd27f600640 1 -- 172.21.15.99:0/1921904868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd2780cfa40 con 0x7fd27815c670 2024-03-30T13:12:01.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.994+0000 7fd274c00640 1 -- 172.21.15.99:0/1921904868 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) ==== 84+0+65 (secure 0 0 0) 0x7fd270059460 con 0x7fd27815c670 2024-03-30T13:12:01.998 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:01.998 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-03-30T13:12:01.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:12:01.998 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-03-30T13:12:01.999 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-03-30T13:12:01.999 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:12:01.999 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-03-30T13:12:02.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.996+0000 7fd27f600640 1 -- 172.21.15.99:0/1921904868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd25406c530 msgr2=0x7fd25406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:02.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.996+0000 7fd27f600640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd25406c530 0x7fd25406e9f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd268006fd0 tx=0x7fd268008040 comp rx=0 tx=0).stop 2024-03-30T13:12:02.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.996+0000 7fd27f600640 1 -- 172.21.15.99:0/1921904868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27815c670 msgr2=0x7fd2781f3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:02.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.996+0000 7fd27f600640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27815c670 0x7fd2781f3db0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c440 tx=0x7fd27000c900 comp rx=0 tx=0).stop 2024-03-30T13:12:02.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.996+0000 7fd27f600640 1 -- 172.21.15.99:0/1921904868 shutdown_connections 2024-03-30T13:12:02.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.996+0000 7fd27f600640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd25406c530 0x7fd25406e9f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.996+0000 7fd27f600640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27815c670 0x7fd2781f3db0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.996+0000 7fd27f600640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2780ad230 0x7fd2780cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.996+0000 7fd27f600640 1 --2- 172.21.15.99:0/1921904868 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd27806f060 0x7fd2780caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.996+0000 7fd27f600640 1 -- 172.21.15.99:0/1921904868 >> 172.21.15.99:0/1921904868 conn(0x7fd27806b510 msgr2=0x7fd2780afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:02.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.997+0000 7fd27f600640 1 -- 172.21.15.99:0/1921904868 shutdown_connections 2024-03-30T13:12:02.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:01.997+0000 7fd27f600640 1 -- 172.21.15.99:0/1921904868 wait complete. 2024-03-30T13:12:02.019 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-30T13:12:02.019 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-30T13:12:02.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.227+0000 7f364f200640 1 Processor -- start 2024-03-30T13:12:02.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.228+0000 7f364f200640 1 -- start start 2024-03-30T13:12:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.229+0000 7f364f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f364815e8d0 0x7f36480b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.229+0000 7f364f200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f364815ecb0 0x7f36480d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.229+0000 7f364f200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f36480d2990 0x7f36480d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.229+0000 7f364f200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f36480cf260 con 0x7f364815e8d0 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.229+0000 7f364f200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f36480b4ac0 con 0x7f36480d2990 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.229+0000 7f364f200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f36480b4d90 con 0x7f364815ecb0 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.230+0000 7f3647e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f364815e8d0 0x7f36480b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.230+0000 7f3647e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f364815e8d0 0x7f36480b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53596/0 (socket says 172.21.15.99:53596) 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.230+0000 7f3647e00640 1 -- 172.21.15.99:0/1170538586 learned_addr learned my addr 172.21.15.99:0/1170538586 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.230+0000 7f3647400640 1 --2- 172.21.15.99:0/1170538586 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f364815ecb0 0x7f36480d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.230+0000 7f364d200640 1 --2- 172.21.15.99:0/1170538586 >> v2:172.21.15.181:3300/0 conn(0x7f36480d2990 0x7f36480d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.230+0000 7f3647e00640 1 -- 172.21.15.99:0/1170538586 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f364815ecb0 msgr2=0x7f36480d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.230+0000 7f3647e00640 1 --2- 172.21.15.99:0/1170538586 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f364815ecb0 0x7f36480d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.230+0000 7f3647e00640 1 -- 172.21.15.99:0/1170538586 >> v2:172.21.15.181:3300/0 conn(0x7f36480d2990 msgr2=0x7f36480d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.230+0000 7f3647e00640 1 --2- 172.21.15.99:0/1170538586 >> v2:172.21.15.181:3300/0 conn(0x7f36480d2990 0x7f36480d13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.230+0000 7f3647e00640 1 -- 172.21.15.99:0/1170538586 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36480b5070 con 0x7f364815e8d0 2024-03-30T13:12:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.230+0000 7f364d200640 1 --2- 172.21.15.99:0/1170538586 >> v2:172.21.15.181:3300/0 conn(0x7f36480d2990 0x7f36480d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.231+0000 7f3647e00640 1 --2- 172.21.15.99:0/1170538586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364815e8d0 0x7f36480b4580 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f36480b7120 tx=0x7f363002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444d5a8ad3b25831 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f3646a00640 1 -- 172.21.15.99:0/1170538586 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630034070 con 0x7f364815e8d0 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f3646a00640 1 -- 172.21.15.99:0/1170538586 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3630030860 con 0x7f364815e8d0 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f3646a00640 1 -- 172.21.15.99:0/1170538586 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630030c30 con 0x7f364815e8d0 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f364f200640 1 -- 172.21.15.99:0/1170538586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364815e8d0 msgr2=0x7f36480b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f364f200640 1 --2- 172.21.15.99:0/1170538586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364815e8d0 0x7f36480b4580 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f36480b7120 tx=0x7f363002b9a0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f364f200640 1 -- 172.21.15.99:0/1170538586 shutdown_connections 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f364f200640 1 --2- 172.21.15.99:0/1170538586 >> v2:172.21.15.181:3300/0 conn(0x7f36480d2990 0x7f36480d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f364f200640 1 --2- 172.21.15.99:0/1170538586 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f364815ecb0 0x7f36480d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f364f200640 1 --2- 172.21.15.99:0/1170538586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364815e8d0 0x7f36480b4580 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f364f200640 1 -- 172.21.15.99:0/1170538586 >> 172.21.15.99:0/1170538586 conn(0x7f364809d940 msgr2=0x7f364808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f364f200640 1 -- 172.21.15.99:0/1170538586 shutdown_connections 2024-03-30T13:12:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.232+0000 7f364f200640 1 -- 172.21.15.99:0/1170538586 wait complete. 2024-03-30T13:12:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.234+0000 7f364f200640 1 Processor -- start 2024-03-30T13:12:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.234+0000 7f364f200640 1 -- start start 2024-03-30T13:12:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.235+0000 7f364f200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36480d2990 0x7f3648160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.235+0000 7f364f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364815e8d0 0x7f3648161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.235+0000 7f364f200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f364815ecb0 0x7f36480cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.235+0000 7f364f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f36480b5c60 con 0x7f364815e8d0 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.235+0000 7f364f200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f36480b5630 con 0x7f364815ecb0 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.235+0000 7f364f200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f36480b5de0 con 0x7f36480d2990 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.235+0000 7f3647400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364815e8d0 0x7f3648161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.235+0000 7f3647400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364815e8d0 0x7f3648161040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53604/0 (socket says 172.21.15.99:53604) 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.235+0000 7f3647400640 1 -- 172.21.15.99:0/4042888539 learned_addr learned my addr 172.21.15.99:0/4042888539 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f3647e00640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36480d2990 0x7f3648160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f364d200640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f364815ecb0 0x7f36480cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f3647400640 1 -- 172.21.15.99:0/4042888539 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36480d2990 msgr2=0x7f3648160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f3647400640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36480d2990 0x7f3648160220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f3647400640 1 -- 172.21.15.99:0/4042888539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f364815ecb0 msgr2=0x7f36480cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f3647400640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f364815ecb0 0x7f36480cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f3647400640 1 -- 172.21.15.99:0/4042888539 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36480ce430 con 0x7f364815e8d0 2024-03-30T13:12:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f3647400640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364815e8d0 0x7f3648161040 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3638007f20 tx=0x7f363800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f363fe00640 1 -- 172.21.15.99:0/4042888539 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638014620 con 0x7f364815e8d0 2024-03-30T13:12:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f363fe00640 1 -- 172.21.15.99:0/4042888539 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3638019070 con 0x7f364815e8d0 2024-03-30T13:12:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f363fe00640 1 -- 172.21.15.99:0/4042888539 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638014a00 con 0x7f364815e8d0 2024-03-30T13:12:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.236+0000 7f364f200640 1 -- 172.21.15.99:0/4042888539 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36481f3f70 con 0x7f364815e8d0 2024-03-30T13:12:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.237+0000 7f364f200640 1 -- 172.21.15.99:0/4042888539 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36481f4510 con 0x7f364815e8d0 2024-03-30T13:12:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.238+0000 7f364f200640 1 -- 172.21.15.99:0/4042888539 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3648068640 con 0x7f364815e8d0 2024-03-30T13:12:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.238+0000 7f363fe00640 1 -- 172.21.15.99:0/4042888539 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3638014ba0 con 0x7f364815e8d0 2024-03-30T13:12:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.239+0000 7f363fe00640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f362406c530 0x7f362406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.239+0000 7f363fe00640 1 -- 172.21.15.99:0/4042888539 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f363808bc50 con 0x7f364815e8d0 2024-03-30T13:12:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.239+0000 7f3647e00640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f362406c530 0x7f362406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.240+0000 7f3647e00640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f362406c530 0x7f362406e9f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3630036000 tx=0x7f363003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.244+0000 7f363fe00640 1 -- 172.21.15.99:0/4042888539 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f363805a5b0 con 0x7f364815e8d0 2024-03-30T13:12:02.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:02.443+0000 7f364f200640 1 -- 172.21.15.99:0/4042888539 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f36480cb430 con 0x7f364815e8d0 2024-03-30T13:12:03.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.112+0000 7f363fe00640 1 -- 172.21.15.99:0/4042888539 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) ==== 138+0+0 (secure 0 0 0) 0x7f3638059eb0 con 0x7f364815e8d0 2024-03-30T13:12:03.117 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-03-30T13:12:03.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 -- 172.21.15.99:0/4042888539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f362406c530 msgr2=0x7f362406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:03.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f362406c530 0x7f362406e9f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3630036000 tx=0x7f363003b040 comp rx=0 tx=0).stop 2024-03-30T13:12:03.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 -- 172.21.15.99:0/4042888539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364815e8d0 msgr2=0x7f3648161040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:03.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364815e8d0 0x7f3648161040 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3638007f20 tx=0x7f363800e570 comp rx=0 tx=0).stop 2024-03-30T13:12:03.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 -- 172.21.15.99:0/4042888539 shutdown_connections 2024-03-30T13:12:03.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f362406c530 0x7f362406e9f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:03.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f364815ecb0 0x7f36480cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364815e8d0 0x7f3648161040 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 --2- 172.21.15.99:0/4042888539 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36480d2990 0x7f3648160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 -- 172.21.15.99:0/4042888539 >> 172.21.15.99:0/4042888539 conn(0x7f364809d940 msgr2=0x7f36480d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 -- 172.21.15.99:0/4042888539 shutdown_connections 2024-03-30T13:12:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.116+0000 7f364f200640 1 -- 172.21.15.99:0/4042888539 wait complete. 2024-03-30T13:12:03.147 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-30T13:12:03.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.361+0000 7fdc82a00640 1 Processor -- start 2024-03-30T13:12:03.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.361+0000 7fdc82a00640 1 -- start start 2024-03-30T13:12:03.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.363+0000 7fdc82a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc7c06e3f0 0x7fdc7c0d2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:03.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.363+0000 7fdc82a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc7c0d0300 con 0x7fdc7c0d2ca0 2024-03-30T13:12:03.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.363+0000 7fdc82a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc7c0cf260 con 0x7fdc7c06e010 2024-03-30T13:12:03.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.363+0000 7fdc82a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7c0d30e0 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.363+0000 7fdc82000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdc7c0d2ca0 0x7fdc7c06c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39918/0 (socket says 172.21.15.99:39918) 2024-03-30T13:12:03.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.363+0000 7fdc82000640 1 -- 172.21.15.99:0/2096117366 learned_addr learned my addr 172.21.15.99:0/2096117366 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.364+0000 7fdc80c00640 1 --2- 172.21.15.99:0/2096117366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc7c06e3f0 0x7fdc7c0d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.364+0000 7fdc7be00640 1 -- 172.21.15.99:0/2096117366 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 495705681 0 0) 0x7fdc74001490 con 0x7fdc7c0d2ca0 2024-03-30T13:12:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.364+0000 7fdc7be00640 1 -- 172.21.15.99:0/2096117366 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc60003520 con 0x7fdc7c0d2ca0 2024-03-30T13:12:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.364+0000 7fdc7be00640 1 -- 172.21.15.99:0/2096117366 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092805766 0 0) 0x7fdc7c0cf260 con 0x7fdc7c06e010 2024-03-30T13:12:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.364+0000 7fdc7be00640 1 -- 172.21.15.99:0/2096117366 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc74001490 con 0x7fdc7c06e010 2024-03-30T13:12:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.364+0000 7fdc80c00640 1 -- 172.21.15.99:0/2096117366 >> v1:172.21.15.181:6789/0 conn(0x7fdc7c06e010 legacy=0x7fdc7c0d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.364+0000 7fdc80c00640 1 -- 172.21.15.99:0/2096117366 >> v1:172.21.15.99:6789/0 conn(0x7fdc7c0d2ca0 legacy=0x7fdc7c06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.364+0000 7fdc80c00640 1 -- 172.21.15.99:0/2096117366 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c0cf540 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.366+0000 7fdc80c00640 1 --2- 172.21.15.99:0/2096117366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc7c06e3f0 0x7fdc7c0d2760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0d3260 tx=0x7fdc6802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8df9584d22454a6e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:03.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.366+0000 7fdc7be00640 1 -- 172.21.15.99:0/2096117366 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68034070 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.366+0000 7fdc7be00640 1 -- 172.21.15.99:0/2096117366 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc68030800 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.366+0000 7fdc7be00640 1 -- 172.21.15.99:0/2096117366 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68030bd0 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.367+0000 7fdc82a00640 1 -- 172.21.15.99:0/2096117366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc7c06e3f0 msgr2=0x7fdc7c0d2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:03.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.367+0000 7fdc82a00640 1 --2- 172.21.15.99:0/2096117366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc7c06e3f0 0x7fdc7c0d2760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0d3260 tx=0x7fdc6802b940 comp rx=0 tx=0).stop 2024-03-30T13:12:03.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.367+0000 7fdc82a00640 1 -- 172.21.15.99:0/2096117366 shutdown_connections 2024-03-30T13:12:03.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.367+0000 7fdc82a00640 1 --2- 172.21.15.99:0/2096117366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc7c06e3f0 0x7fdc7c0d2760 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:03.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.367+0000 7fdc82a00640 1 -- 172.21.15.99:0/2096117366 >> 172.21.15.99:0/2096117366 conn(0x7fdc7c08bfc0 msgr2=0x7fdc7c0d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:03.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.367+0000 7fdc82a00640 1 -- 172.21.15.99:0/2096117366 shutdown_connections 2024-03-30T13:12:03.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.367+0000 7fdc82a00640 1 -- 172.21.15.99:0/2096117366 wait complete. 2024-03-30T13:12:03.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.369+0000 7fdc82a00640 1 Processor -- start 2024-03-30T13:12:03.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.369+0000 7fdc82a00640 1 -- start start 2024-03-30T13:12:03.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.370+0000 7fdc82a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc7c06e010 0x7fdc7c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:03.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.370+0000 7fdc82a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc7c06e3f0 0x7fdc7c1f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.370+0000 7fdc82a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc7c0d2ca0 0x7fdc7c0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.370+0000 7fdc82a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c0cfde0 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.370+0000 7fdc82a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c0cfb00 con 0x7fdc7c0d2ca0 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.370+0000 7fdc82a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7c0cef10 con 0x7fdc7c06e010 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.371+0000 7fdc80c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc7c06e3f0 0x7fdc7c1f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.371+0000 7fdc80c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc7c06e3f0 0x7fdc7c1f7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53606/0 (socket says 172.21.15.99:53606) 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.371+0000 7fdc80c00640 1 -- 172.21.15.99:0/919592069 learned_addr learned my addr 172.21.15.99:0/919592069 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.371+0000 7fdc81600640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc7c06e010 0x7fdc7c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.371+0000 7fdc82000640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc7c0d2ca0 0x7fdc7c0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.371+0000 7fdc80c00640 1 -- 172.21.15.99:0/919592069 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc7c06e010 msgr2=0x7fdc7c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.371+0000 7fdc80c00640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc7c06e010 0x7fdc7c0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.371+0000 7fdc80c00640 1 -- 172.21.15.99:0/919592069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc7c0d2ca0 msgr2=0x7fdc7c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.371+0000 7fdc80c00640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc7c0d2ca0 0x7fdc7c0b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.371+0000 7fdc80c00640 1 -- 172.21.15.99:0/919592069 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c1f83a0 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.372+0000 7fdc80c00640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc7c06e3f0 0x7fdc7c1f7b50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009890 tx=0x7fdc680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:03.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.372+0000 7fdc79600640 1 -- 172.21.15.99:0/919592069 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68034040 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.372+0000 7fdc79600640 1 -- 172.21.15.99:0/919592069 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc68030e30 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.372+0000 7fdc82a00640 1 -- 172.21.15.99:0/919592069 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7c1f8680 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.372+0000 7fdc79600640 1 -- 172.21.15.99:0/919592069 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68039d40 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.372+0000 7fdc82a00640 1 -- 172.21.15.99:0/919592069 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c15c620 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.373+0000 7fdc82a00640 1 -- 172.21.15.99:0/919592069 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc7c04f8f0 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.375+0000 7fdc79600640 1 -- 172.21.15.99:0/919592069 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdc68037070 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.375+0000 7fdc79600640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc5c06c530 0x7fdc5c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:03.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.376+0000 7fdc79600640 1 -- 172.21.15.99:0/919592069 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5227+0+0 (secure 0 0 0) 0x7fdc680ad630 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.376+0000 7fdc81600640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc5c06c530 0x7fdc5c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:03.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.376+0000 7fdc81600640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc5c06c530 0x7fdc5c06e9f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0011e0 tx=0x7fdc6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:03.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.380+0000 7fdc79600640 1 -- 172.21.15.99:0/919592069 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fdc6807b740 con 0x7fdc7c06e3f0 2024-03-30T13:12:03.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:03.580+0000 7fdc82a00640 1 -- 172.21.15.99:0/919592069 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdc7c0b6d90 con 0x7fdc7c06e3f0 2024-03-30T13:12:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.119+0000 7fdc79600640 1 -- 172.21.15.99:0/919592069 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) ==== 170+0+0 (secure 0 0 0) 0x7fdc6807fa40 con 0x7fdc7c06e3f0 2024-03-30T13:12:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-03-30T13:12:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.122+0000 7fdc82a00640 1 -- 172.21.15.99:0/919592069 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc5c06c530 msgr2=0x7fdc5c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.122+0000 7fdc82a00640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc5c06c530 0x7fdc5c06e9f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0011e0 tx=0x7fdc6c009040 comp rx=0 tx=0).stop 2024-03-30T13:12:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.122+0000 7fdc82a00640 1 -- 172.21.15.99:0/919592069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc7c06e3f0 msgr2=0x7fdc7c1f7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.122+0000 7fdc82a00640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc7c06e3f0 0x7fdc7c1f7b50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009890 tx=0x7fdc680046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:04.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.122+0000 7fdc82a00640 1 -- 172.21.15.99:0/919592069 shutdown_connections 2024-03-30T13:12:04.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.122+0000 7fdc82a00640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fdc5c06c530 0x7fdc5c06e9f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:04.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.122+0000 7fdc82a00640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc7c0d2ca0 0x7fdc7c0b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:04.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.122+0000 7fdc82a00640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc7c06e3f0 0x7fdc7c1f7b50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:04.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.122+0000 7fdc82a00640 1 --2- 172.21.15.99:0/919592069 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdc7c06e010 0x7fdc7c0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:04.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.122+0000 7fdc82a00640 1 -- 172.21.15.99:0/919592069 >> 172.21.15.99:0/919592069 conn(0x7fdc7c08bfc0 msgr2=0x7fdc7c06c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:04.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.123+0000 7fdc82a00640 1 -- 172.21.15.99:0/919592069 shutdown_connections 2024-03-30T13:12:04.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.123+0000 7fdc82a00640 1 -- 172.21.15.99:0/919592069 wait complete. 2024-03-30T13:12:04.162 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-30T13:12:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.341+0000 7fa3c7200640 1 Processor -- start 2024-03-30T13:12:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.341+0000 7fa3c7200640 1 -- start start 2024-03-30T13:12:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.342+0000 7fa3c7200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa3c00b2810 0x7fa3c00cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.342+0000 7fa3c7200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c01604d0 con 0x7fa3c00c6820 2024-03-30T13:12:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.342+0000 7fa3c7200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c01607b0 con 0x7fa3c00b4e40 2024-03-30T13:12:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.342+0000 7fa3c7200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c00cba20 con 0x7fa3c00b2810 2024-03-30T13:12:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.343+0000 7fa3bf400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa3c00c6820 0x7fa3c00b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39920/0 (socket says 172.21.15.99:39920) 2024-03-30T13:12:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.343+0000 7fa3bf400640 1 -- 172.21.15.99:0/2556507107 learned_addr learned my addr 172.21.15.99:0/2556507107 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.343+0000 7fa3c5200640 1 --2- 172.21.15.99:0/2556507107 >> v2:172.21.15.181:3300/0 conn(0x7fa3c00b2810 0x7fa3c00cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.343+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847160406 0 0) 0x7fa3c01604d0 con 0x7fa3c00c6820 2024-03-30T13:12:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.343+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3a4003520 con 0x7fa3c00c6820 2024-03-30T13:12:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1634476101 0 0) 0x7fa3a4003520 con 0x7fa3c00c6820 2024-03-30T13:12:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 >> v2:172.21.15.181:3300/0 conn(0x7fa3c00b2810 msgr2=0x7fa3c00cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 --2- 172.21.15.99:0/2556507107 >> v2:172.21.15.181:3300/0 conn(0x7fa3c00b2810 0x7fa3c00cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 >> v1:172.21.15.181:6789/0 conn(0x7fa3c00b4e40 legacy=0x7fa3c00b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c0160a90 con 0x7fa3c00c6820 2024-03-30T13:12:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fa3ac001670 con 0x7fa3c00c6820 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 >> v1:172.21.15.99:6789/0 conn(0x7fa3c00c6820 legacy=0x7fa3c00b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 --2- 172.21.15.99:0/2556507107 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3a4003a00 0x7fa3a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 --2- 172.21.15.99:0/2556507107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3a4004800 0x7fa3a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 --2- 172.21.15.99:0/2556507107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3a4005210 0x7fa3a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c00cba20 con 0x7fa3a4004800 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a400c160 con 0x7fa3a4005210 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a400c360 con 0x7fa3a4003a00 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bf400640 1 --2- 172.21.15.99:0/2556507107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3a4004800 0x7fa3a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bf400640 1 -- 172.21.15.99:0/2556507107 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3a4003a00 msgr2=0x7fa3a4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bf400640 1 --2- 172.21.15.99:0/2556507107 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3a4003a00 0x7fa3a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bf400640 1 -- 172.21.15.99:0/2556507107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3a4005210 msgr2=0x7fa3a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bf400640 1 --2- 172.21.15.99:0/2556507107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3a4005210 0x7fa3a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3bf400640 1 -- 172.21.15.99:0/2556507107 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a4003520 con 0x7fa3a4004800 2024-03-30T13:12:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.344+0000 7fa3c5200640 1 -- 172.21.15.99:0/2556507107 reap_dead start 2024-03-30T13:12:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.346+0000 7fa3bf400640 1 --2- 172.21.15.99:0/2556507107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3a4004800 0x7fa3a4004c80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac001050 tx=0x7fa3a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56337417bf4935f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.346+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac007c40 con 0x7fa3a4004800 2024-03-30T13:12:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.346+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac030070 con 0x7fa3a4004800 2024-03-30T13:12:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.346+0000 7fa3bea00640 1 -- 172.21.15.99:0/2556507107 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac005d30 con 0x7fa3a4004800 2024-03-30T13:12:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.346+0000 7fa3c7200640 1 -- 172.21.15.99:0/2556507107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3a4004800 msgr2=0x7fa3a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.346+0000 7fa3c7200640 1 --2- 172.21.15.99:0/2556507107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3a4004800 0x7fa3a4004c80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac001050 tx=0x7fa3a4005830 comp rx=0 tx=0).stop 2024-03-30T13:12:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.346+0000 7fa3c7200640 1 -- 172.21.15.99:0/2556507107 shutdown_connections 2024-03-30T13:12:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.346+0000 7fa3c7200640 1 --2- 172.21.15.99:0/2556507107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3a4004800 0x7fa3a4004c80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.346+0000 7fa3c7200640 1 -- 172.21.15.99:0/2556507107 >> 172.21.15.99:0/2556507107 conn(0x7fa3c00d0450 msgr2=0x7fa3c00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.346+0000 7fa3c7200640 1 -- 172.21.15.99:0/2556507107 shutdown_connections 2024-03-30T13:12:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.347+0000 7fa3c7200640 1 -- 172.21.15.99:0/2556507107 wait complete. 2024-03-30T13:12:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.348+0000 7fa3c7200640 1 Processor -- start 2024-03-30T13:12:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.348+0000 7fa3c7200640 1 -- start start 2024-03-30T13:12:04.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.349+0000 7fa3c7200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3a4004800 0x7fa3c00aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:04.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.349+0000 7fa3c7200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3c00cdfc0 0x7fa3c01f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.349+0000 7fa3c7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c01f5650 0x7fa3c00b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.349+0000 7fa3c7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c00c60f0 con 0x7fa3c01f5650 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.349+0000 7fa3c7200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c00c6cb0 con 0x7fa3a4004800 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.349+0000 7fa3c7200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c01600f0 con 0x7fa3c00cdfc0 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.350+0000 7fa3c5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c01f5650 0x7fa3c00b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.350+0000 7fa3c5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c01f5650 0x7fa3c00b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53618/0 (socket says 172.21.15.99:53618) 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.350+0000 7fa3c5200640 1 -- 172.21.15.99:0/2076549573 learned_addr learned my addr 172.21.15.99:0/2076549573 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.350+0000 7fa3bf400640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3c00cdfc0 0x7fa3c01f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.350+0000 7fa3bfe00640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3a4004800 0x7fa3c00aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.350+0000 7fa3c5200640 1 -- 172.21.15.99:0/2076549573 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3c00cdfc0 msgr2=0x7fa3c01f5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.350+0000 7fa3c5200640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3c00cdfc0 0x7fa3c01f5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.350+0000 7fa3c5200640 1 -- 172.21.15.99:0/2076549573 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3a4004800 msgr2=0x7fa3c00aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.350+0000 7fa3c5200640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3a4004800 0x7fa3c00aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.350+0000 7fa3c5200640 1 -- 172.21.15.99:0/2076549573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c0072cf0 con 0x7fa3c01f5650 2024-03-30T13:12:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.350+0000 7fa3bfe00640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3a4004800 0x7fa3c00aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.351+0000 7fa3c5200640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c01f5650 0x7fa3c00b0f20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00afa60 tx=0x7fa3b800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.351+0000 7fa3b7e00640 1 -- 172.21.15.99:0/2076549573 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800cb90 con 0x7fa3c01f5650 2024-03-30T13:12:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.351+0000 7fa3b7e00640 1 -- 172.21.15.99:0/2076549573 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b801a070 con 0x7fa3c01f5650 2024-03-30T13:12:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.351+0000 7fa3c7200640 1 -- 172.21.15.99:0/2076549573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c00af2c0 con 0x7fa3c01f5650 2024-03-30T13:12:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.351+0000 7fa3b7e00640 1 -- 172.21.15.99:0/2076549573 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8014480 con 0x7fa3c01f5650 2024-03-30T13:12:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.351+0000 7fa3c7200640 1 -- 172.21.15.99:0/2076549573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c00cee60 con 0x7fa3c01f5650 2024-03-30T13:12:04.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.352+0000 7fa3c7200640 1 -- 172.21.15.99:0/2076549573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c004f9d0 con 0x7fa3c01f5650 2024-03-30T13:12:04.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.354+0000 7fa3b7e00640 1 -- 172.21.15.99:0/2076549573 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa3b8012050 con 0x7fa3c01f5650 2024-03-30T13:12:04.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.354+0000 7fa3b7e00640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa3a006c530 0x7fa3a006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:04.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.354+0000 7fa3b7e00640 1 -- 172.21.15.99:0/2076549573 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5609+0+0 (secure 0 0 0) 0x7fa3b808c7f0 con 0x7fa3c01f5650 2024-03-30T13:12:04.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.355+0000 7fa3bfe00640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa3a006c530 0x7fa3a006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:04.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.355+0000 7fa3bfe00640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa3a006c530 0x7fa3a006e9f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00510d0 tx=0x7fa3b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:04.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.358+0000 7fa3b7e00640 1 -- 172.21.15.99:0/2076549573 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa3b8010040 con 0x7fa3c01f5650 2024-03-30T13:12:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:04.592+0000 7fa3c7200640 1 -- 172.21.15.99:0/2076549573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa3c00c5cb0 con 0x7fa3c01f5650 2024-03-30T13:12:05.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.160+0000 7fa3b7e00640 1 -- 172.21.15.99:0/2076549573 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fa3b805ae50 con 0x7fa3c01f5650 2024-03-30T13:12:05.165 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 4 and data pool 5 2024-03-30T13:12:05.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.164+0000 7fa3c7200640 1 -- 172.21.15.99:0/2076549573 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa3a006c530 msgr2=0x7fa3a006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.164+0000 7fa3c7200640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa3a006c530 0x7fa3a006e9f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00510d0 tx=0x7fa3b0009040 comp rx=0 tx=0).stop 2024-03-30T13:12:05.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.164+0000 7fa3c7200640 1 -- 172.21.15.99:0/2076549573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c01f5650 msgr2=0x7fa3c00b0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.164+0000 7fa3c7200640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c01f5650 0x7fa3c00b0f20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00afa60 tx=0x7fa3b800c0c0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.164+0000 7fa3c7200640 1 -- 172.21.15.99:0/2076549573 shutdown_connections 2024-03-30T13:12:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.164+0000 7fa3c7200640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa3a006c530 0x7fa3a006e9f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.164+0000 7fa3c7200640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c01f5650 0x7fa3c00b0f20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.164+0000 7fa3c7200640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3c00cdfc0 0x7fa3c01f5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.164+0000 7fa3c7200640 1 --2- 172.21.15.99:0/2076549573 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3a4004800 0x7fa3c00aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.164+0000 7fa3c7200640 1 -- 172.21.15.99:0/2076549573 >> 172.21.15.99:0/2076549573 conn(0x7fa3c00d0450 msgr2=0x7fa3c00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.165+0000 7fa3c7200640 1 -- 172.21.15.99:0/2076549573 shutdown_connections 2024-03-30T13:12:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.165+0000 7fa3c7200640 1 -- 172.21.15.99:0/2076549573 wait complete. 2024-03-30T13:12:05.216 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:05.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.380+0000 7fd08ee00640 1 Processor -- start 2024-03-30T13:12:05.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.381+0000 7fd08ee00640 1 -- start start 2024-03-30T13:12:05.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.382+0000 7fd08ee00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08806f3f0 0x7fd088072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.382+0000 7fd08ee00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd088071ae0 con 0x7fd0880730c0 2024-03-30T13:12:05.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.382+0000 7fd08ee00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd088071dc0 con 0x7fd08815b370 2024-03-30T13:12:05.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.382+0000 7fd08ee00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd0880b39d0 con 0x7fd08806f3f0 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.382+0000 7fd08ce00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd0880730c0 0x7fd08815f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55770/0 (socket says 172.21.15.99:55770) 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.382+0000 7fd08ce00640 1 -- 172.21.15.99:0/824922510 learned_addr learned my addr 172.21.15.99:0/824922510 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.382+0000 7fd07f400640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08806f3f0 0x7fd088072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462259810 0 0) 0x7fd088071ae0 con 0x7fd0880730c0 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd06c005730 con 0x7fd0880730c0 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 144495956 0 0) 0x7fd06c005730 con 0x7fd0880730c0 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08806f3f0 msgr2=0x7fd088072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08806f3f0 0x7fd088072b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 >> v1:172.21.15.181:6789/0 conn(0x7fd08815b370 legacy=0x7fd0880b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0880720a0 con 0x7fd0880730c0 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fd0800019f0 con 0x7fd0880730c0 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 >> v1:172.21.15.99:6789/0 conn(0x7fd0880730c0 legacy=0x7fd08815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c005bf0 0x7fd06c006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd06c006a10 0x7fd06c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08806f3f0 0x7fd06c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd0880b39d0 con 0x7fd06c006a10 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c00dcb0 con 0x7fd06c005bf0 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c00deb0 con 0x7fd08806f3f0 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.383+0000 7fd07f400640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd06c006a10 0x7fd06c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.384+0000 7fd087e00640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c005bf0 0x7fd06c006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.384+0000 7fd07f400640 1 -- 172.21.15.99:0/824922510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08806f3f0 msgr2=0x7fd06c0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.384+0000 7fd07f400640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08806f3f0 0x7fd06c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.384+0000 7fd07f400640 1 -- 172.21.15.99:0/824922510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c005bf0 msgr2=0x7fd06c006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.384+0000 7fd07f400640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c005bf0 0x7fd06c006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.384+0000 7fd07f400640 1 -- 172.21.15.99:0/824922510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c005730 con 0x7fd06c006a10 2024-03-30T13:12:05.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.384+0000 7fd087e00640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c005bf0 0x7fd06c006010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:05.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.385+0000 7fd07f400640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd06c006a10 0x7fd06c006e90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd070009a90 tx=0x7fd06c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edd0327c4822bf0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:05.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.385+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070039070 con 0x7fd06c006a10 2024-03-30T13:12:05.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.385+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07002c6b0 con 0x7fd06c006a10 2024-03-30T13:12:05.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.385+0000 7fd087400640 1 -- 172.21.15.99:0/824922510 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070009690 con 0x7fd06c006a10 2024-03-30T13:12:05.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.385+0000 7fd08ee00640 1 -- 172.21.15.99:0/824922510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd06c006a10 msgr2=0x7fd06c006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.385+0000 7fd08ee00640 1 --2- 172.21.15.99:0/824922510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd06c006a10 0x7fd06c006e90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd070009a90 tx=0x7fd06c007a40 comp rx=0 tx=0).stop 2024-03-30T13:12:05.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.386+0000 7fd08ce00640 1 -- 172.21.15.99:0/824922510 reap_dead start 2024-03-30T13:12:05.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.386+0000 7fd08ee00640 1 -- 172.21.15.99:0/824922510 shutdown_connections 2024-03-30T13:12:05.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.386+0000 7fd08ee00640 1 -- 172.21.15.99:0/824922510 >> 172.21.15.99:0/824922510 conn(0x7fd08806b510 msgr2=0x7fd08806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:05.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.386+0000 7fd08ee00640 1 -- 172.21.15.99:0/824922510 shutdown_connections 2024-03-30T13:12:05.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.386+0000 7fd08ee00640 1 -- 172.21.15.99:0/824922510 wait complete. 2024-03-30T13:12:05.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.387+0000 7fd08ee00640 1 Processor -- start 2024-03-30T13:12:05.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.388+0000 7fd08ee00640 1 -- start start 2024-03-30T13:12:05.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.388+0000 7fd08ee00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd06c006a10 0x7fd088159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.388+0000 7fd08ee00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0880ccfd0 0x7fd0880cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.388+0000 7fd08ee00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd08815c0e0 0x7fd08815c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.388+0000 7fd08ee00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd088073550 con 0x7fd0880ccfd0 2024-03-30T13:12:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.388+0000 7fd08ee00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd088072660 con 0x7fd08815c0e0 2024-03-30T13:12:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.388+0000 7fd08ee00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd08815b750 con 0x7fd06c006a10 2024-03-30T13:12:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.389+0000 7fd07f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0880ccfd0 0x7fd0880cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.389+0000 7fd07f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0880ccfd0 0x7fd0880cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42286/0 (socket says 172.21.15.99:42286) 2024-03-30T13:12:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.389+0000 7fd07f400640 1 -- 172.21.15.99:0/951925547 learned_addr learned my addr 172.21.15.99:0/951925547 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.389+0000 7fd087e00640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd06c006a10 0x7fd088159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.389+0000 7fd08ce00640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd08815c0e0 0x7fd08815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.389+0000 7fd07f400640 1 -- 172.21.15.99:0/951925547 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd06c006a10 msgr2=0x7fd088159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.389+0000 7fd07f400640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd06c006a10 0x7fd088159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.389+0000 7fd07f400640 1 -- 172.21.15.99:0/951925547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd08815c0e0 msgr2=0x7fd08815c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.389+0000 7fd07f400640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd08815c0e0 0x7fd08815c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.389+0000 7fd07f400640 1 -- 172.21.15.99:0/951925547 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0880cd990 con 0x7fd0880ccfd0 2024-03-30T13:12:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.389+0000 7fd07f400640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0880ccfd0 0x7fd0880cd450 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd070037040 tx=0x7fd070004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.390+0000 7fd084c00640 1 -- 172.21.15.99:0/951925547 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070042020 con 0x7fd0880ccfd0 2024-03-30T13:12:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.390+0000 7fd084c00640 1 -- 172.21.15.99:0/951925547 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07003a040 con 0x7fd0880ccfd0 2024-03-30T13:12:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.390+0000 7fd08ee00640 1 -- 172.21.15.99:0/951925547 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0880cdc20 con 0x7fd0880ccfd0 2024-03-30T13:12:05.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.390+0000 7fd084c00640 1 -- 172.21.15.99:0/951925547 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070039070 con 0x7fd0880ccfd0 2024-03-30T13:12:05.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.390+0000 7fd08ee00640 1 -- 172.21.15.99:0/951925547 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0880ce1e0 con 0x7fd0880ccfd0 2024-03-30T13:12:05.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.391+0000 7fd08ee00640 1 -- 172.21.15.99:0/951925547 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd088068640 con 0x7fd0880ccfd0 2024-03-30T13:12:05.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.392+0000 7fd084c00640 1 -- 172.21.15.99:0/951925547 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd070045020 con 0x7fd0880ccfd0 2024-03-30T13:12:05.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.393+0000 7fd084c00640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd06406c530 0x7fd06406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.393+0000 7fd084c00640 1 -- 172.21.15.99:0/951925547 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd0700acb60 con 0x7fd0880ccfd0 2024-03-30T13:12:05.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.393+0000 7fd087e00640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd06406c530 0x7fd06406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.394+0000 7fd087e00640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd06406c530 0x7fd06406e9f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd078000c00 tx=0x7fd078009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:05.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.397+0000 7fd084c00640 1 -- 172.21.15.99:0/951925547 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd07004c070 con 0x7fd0880ccfd0 2024-03-30T13:12:05.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.583+0000 7fd08ee00640 1 -- 172.21.15.99:0/951925547 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0880cb7f0 con 0x7fd0880ccfd0 2024-03-30T13:12:05.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.585+0000 7fd084c00640 1 -- 172.21.15.99:0/951925547 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16622 (secure 0 0 0) 0x7fd07007b170 con 0x7fd0880ccfd0 2024-03-30T13:12:05.590 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:05.590 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":34,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:12:04.594573+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:12:02.458079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:12:03.597299+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:05.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 -- 172.21.15.99:0/951925547 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd06406c530 msgr2=0x7fd06406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd06406c530 0x7fd06406e9f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd078000c00 tx=0x7fd078009040 comp rx=0 tx=0).stop 2024-03-30T13:12:05.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 -- 172.21.15.99:0/951925547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0880ccfd0 msgr2=0x7fd0880cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0880ccfd0 0x7fd0880cd450 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd070037040 tx=0x7fd070004730 comp rx=0 tx=0).stop 2024-03-30T13:12:05.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 -- 172.21.15.99:0/951925547 shutdown_connections 2024-03-30T13:12:05.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd06406c530 0x7fd06406e9f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd08815c0e0 0x7fd08815c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0880ccfd0 0x7fd0880cd450 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 --2- 172.21.15.99:0/951925547 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd06c006a10 0x7fd088159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 -- 172.21.15.99:0/951925547 >> 172.21.15.99:0/951925547 conn(0x7fd08806b510 msgr2=0x7fd0880b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:05.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 -- 172.21.15.99:0/951925547 shutdown_connections 2024-03-30T13:12:05.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.588+0000 7fd08ee00640 1 -- 172.21.15.99:0/951925547 wait complete. 2024-03-30T13:12:05.614 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.816+0000 7fd2c5e00640 1 Processor -- start 2024-03-30T13:12:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.817+0000 7fd2c5e00640 1 -- start start 2024-03-30T13:12:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.818+0000 7fd2c5e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd2c015b370 0x7fd2c00b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.818+0000 7fd2c5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd2c006f3f0 0x7fd2c0072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.818+0000 7fd2c5e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2c0071ae0 con 0x7fd2c00730c0 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.818+0000 7fd2c5e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd2c0071dc0 con 0x7fd2c006f3f0 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.818+0000 7fd2c5e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd2c00720a0 con 0x7fd2c015b370 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.818+0000 7fd2b6000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd2c006f3f0 0x7fd2c0072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.818+0000 7fd2bf400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd2c00730c0 0x7fd2c00ae020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55780/0 (socket says 172.21.15.99:55780) 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.819+0000 7fd2bf400640 1 -- 172.21.15.99:0/2615677614 learned_addr learned my addr 172.21.15.99:0/2615677614 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.819+0000 7fd2bea00640 1 --2- 172.21.15.99:0/2615677614 >> v2:172.21.15.181:3300/0 conn(0x7fd2c015b370 0x7fd2c00b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.819+0000 7fd2b6000640 1 -- 172.21.15.99:0/2615677614 >> v2:172.21.15.181:3300/0 conn(0x7fd2c015b370 msgr2=0x7fd2c00b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.819+0000 7fd2b6000640 1 --2- 172.21.15.99:0/2615677614 >> v2:172.21.15.181:3300/0 conn(0x7fd2c015b370 0x7fd2c00b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.819+0000 7fd2b6000640 1 -- 172.21.15.99:0/2615677614 >> v1:172.21.15.99:6789/0 conn(0x7fd2c00730c0 legacy=0x7fd2c00ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.819+0000 7fd2b6000640 1 -- 172.21.15.99:0/2615677614 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c0072380 con 0x7fd2c006f3f0 2024-03-30T13:12:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.819+0000 7fd2be000640 1 -- 172.21.15.99:0/2615677614 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306939599 0 0) 0x7fd2c0071ae0 con 0x7fd2c00730c0 2024-03-30T13:12:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.820+0000 7fd2b6000640 1 --2- 172.21.15.99:0/2615677614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c006f3f0 0x7fd2c0072b80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00d12e0 tx=0x7fd2a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c607d8434576c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.820+0000 7fd2be000640 1 -- 172.21.15.99:0/2615677614 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8035020 con 0x7fd2c006f3f0 2024-03-30T13:12:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.820+0000 7fd2be000640 1 -- 172.21.15.99:0/2615677614 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a8031830 con 0x7fd2c006f3f0 2024-03-30T13:12:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.820+0000 7fd2be000640 1 -- 172.21.15.99:0/2615677614 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8031c00 con 0x7fd2c006f3f0 2024-03-30T13:12:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.821+0000 7fd2c5e00640 1 -- 172.21.15.99:0/2615677614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c006f3f0 msgr2=0x7fd2c0072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.821+0000 7fd2c5e00640 1 --2- 172.21.15.99:0/2615677614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c006f3f0 0x7fd2c0072b80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00d12e0 tx=0x7fd2a802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.821+0000 7fd2c5e00640 1 -- 172.21.15.99:0/2615677614 shutdown_connections 2024-03-30T13:12:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.821+0000 7fd2c5e00640 1 --2- 172.21.15.99:0/2615677614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c006f3f0 0x7fd2c0072b80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.821+0000 7fd2c5e00640 1 --2- 172.21.15.99:0/2615677614 >> v2:172.21.15.181:3300/0 conn(0x7fd2c015b370 0x7fd2c00b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.821+0000 7fd2c5e00640 1 -- 172.21.15.99:0/2615677614 >> 172.21.15.99:0/2615677614 conn(0x7fd2c006b510 msgr2=0x7fd2c006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.821+0000 7fd2c5e00640 1 -- 172.21.15.99:0/2615677614 shutdown_connections 2024-03-30T13:12:05.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.821+0000 7fd2c5e00640 1 -- 172.21.15.99:0/2615677614 wait complete. 2024-03-30T13:12:05.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.823+0000 7fd2c5e00640 1 Processor -- start 2024-03-30T13:12:05.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.823+0000 7fd2c5e00640 1 -- start start 2024-03-30T13:12:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.824+0000 7fd2c5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2c006f3f0 0x7fd2c00cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.824+0000 7fd2c5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c00730c0 0x7fd2c01f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.824+0000 7fd2c5e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2c015b370 0x7fd2c01f8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.824+0000 7fd2c5e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c00b3800 con 0x7fd2c00730c0 2024-03-30T13:12:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.824+0000 7fd2c5e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0073550 con 0x7fd2c006f3f0 2024-03-30T13:12:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.824+0000 7fd2c5e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c00b3980 con 0x7fd2c015b370 2024-03-30T13:12:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.824+0000 7fd2b6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c00730c0 0x7fd2c01f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.824+0000 7fd2b6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c00730c0 0x7fd2c01f7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42306/0 (socket says 172.21.15.99:42306) 2024-03-30T13:12:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.824+0000 7fd2b6000640 1 -- 172.21.15.99:0/3664318444 learned_addr learned my addr 172.21.15.99:0/3664318444 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2bea00640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2c006f3f0 0x7fd2c00cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2b6000640 1 -- 172.21.15.99:0/3664318444 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2c015b370 msgr2=0x7fd2c01f8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2b6000640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2c015b370 0x7fd2c01f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2b6000640 1 -- 172.21.15.99:0/3664318444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2c006f3f0 msgr2=0x7fd2c00cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2b6000640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2c006f3f0 0x7fd2c00cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2b6000640 1 -- 172.21.15.99:0/3664318444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c00c9cf0 con 0x7fd2c00730c0 2024-03-30T13:12:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2b6000640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c00730c0 0x7fd2c01f7d50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8000c00 tx=0x7fd2a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2b7e00640 1 -- 172.21.15.99:0/3664318444 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8040070 con 0x7fd2c00730c0 2024-03-30T13:12:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2b7e00640 1 -- 172.21.15.99:0/3664318444 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a8039960 con 0x7fd2c00730c0 2024-03-30T13:12:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2b7e00640 1 -- 172.21.15.99:0/3664318444 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8035040 con 0x7fd2c00730c0 2024-03-30T13:12:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2c5e00640 1 -- 172.21.15.99:0/3664318444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c00cce40 con 0x7fd2c00730c0 2024-03-30T13:12:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.825+0000 7fd2c5e00640 1 -- 172.21.15.99:0/3664318444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c00cf9f0 con 0x7fd2c00730c0 2024-03-30T13:12:05.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.827+0000 7fd2c5e00640 1 -- 172.21.15.99:0/3664318444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c0068640 con 0x7fd2c00730c0 2024-03-30T13:12:05.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.827+0000 7fd2b7e00640 1 -- 172.21.15.99:0/3664318444 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd2a804b060 con 0x7fd2c00730c0 2024-03-30T13:12:05.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.828+0000 7fd2b7e00640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd29c06c560 0x7fd29c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.828+0000 7fd2b7e00640 1 -- 172.21.15.99:0/3664318444 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd2a80ad0b0 con 0x7fd2c00730c0 2024-03-30T13:12:05.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.829+0000 7fd2bea00640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd29c06c560 0x7fd29c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.829+0000 7fd2bea00640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd29c06c560 0x7fd29c06ea20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009f30 tx=0x7fd2b000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:05.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:05.833+0000 7fd2b7e00640 1 -- 172.21.15.99:0/3664318444 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd2a807b630 con 0x7fd2c00730c0 2024-03-30T13:12:06.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.031+0000 7fd2c5e00640 1 -- 172.21.15.99:0/3664318444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2c00d0000 con 0x7fd2c00730c0 2024-03-30T13:12:06.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.033+0000 7fd2b7e00640 1 -- 172.21.15.99:0/3664318444 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16622 (secure 0 0 0) 0x7fd2a807af30 con 0x7fd2c00730c0 2024-03-30T13:12:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:06.038 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":34,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:12:04.594573+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:12:02.458079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:12:03.597299+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:06.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 -- 172.21.15.99:0/3664318444 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd29c06c560 msgr2=0x7fd29c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd29c06c560 0x7fd29c06ea20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009f30 tx=0x7fd2b000b040 comp rx=0 tx=0).stop 2024-03-30T13:12:06.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 -- 172.21.15.99:0/3664318444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c00730c0 msgr2=0x7fd2c01f7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c00730c0 0x7fd2c01f7d50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8000c00 tx=0x7fd2a80046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 -- 172.21.15.99:0/3664318444 shutdown_connections 2024-03-30T13:12:06.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd29c06c560 0x7fd29c06ea20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2c015b370 0x7fd2c01f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c00730c0 0x7fd2c01f7d50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 --2- 172.21.15.99:0/3664318444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2c006f3f0 0x7fd2c00cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 -- 172.21.15.99:0/3664318444 >> 172.21.15.99:0/3664318444 conn(0x7fd2c006b510 msgr2=0x7fd2c0154240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:06.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 -- 172.21.15.99:0/3664318444 shutdown_connections 2024-03-30T13:12:06.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.036+0000 7fd2c5e00640 1 -- 172.21.15.99:0/3664318444 wait complete. 2024-03-30T13:12:06.060 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-30T13:12:06.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.272+0000 7f623a400640 1 Processor -- start 2024-03-30T13:12:06.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.272+0000 7f623a400640 1 -- start start 2024-03-30T13:12:06.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.273+0000 7f623a400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f62340b4e40 0x7f62340c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.273+0000 7f623a400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62340b2810 0x7f62340cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.273+0000 7f623a400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62341604d0 con 0x7f62340b31c0 2024-03-30T13:12:06.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.273+0000 7f623a400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f62340c6d60 con 0x7f62340b4e40 2024-03-30T13:12:06.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.273+0000 7f623a400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f62340cba20 con 0x7f62340b2810 2024-03-30T13:12:06.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.274+0000 7f6233e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62340b2810 0x7f62340cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.274+0000 7f6233400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f62340b4e40 0x7f62340c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.274+0000 7f6233400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f62340b4e40 0x7f62340c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:36274/0 (socket says 172.21.15.99:36274) 2024-03-30T13:12:06.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.274+0000 7f6233400640 1 -- 172.21.15.99:0/3789715396 learned_addr learned my addr 172.21.15.99:0/3789715396 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:06.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.275+0000 7f6233400640 1 -- 172.21.15.99:0/3789715396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62340b2810 msgr2=0x7f62340cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:06.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.275+0000 7f6233400640 1 --2- 172.21.15.99:0/3789715396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62340b2810 0x7f62340cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.275+0000 7f6233400640 1 -- 172.21.15.99:0/3789715396 >> v1:172.21.15.181:6789/0 conn(0x7f62340b31c0 legacy=0x7f62340b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.275+0000 7f6233400640 1 -- 172.21.15.99:0/3789715396 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62341607b0 con 0x7f62340b4e40 2024-03-30T13:12:06.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.276+0000 7f6233400640 1 --2- 172.21.15.99:0/3789715396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62340b4e40 0x7f62340c6820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6224009870 tx=0x7f622402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d32905b207c9248a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:06.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.276+0000 7f6232a00640 1 -- 172.21.15.99:0/3789715396 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6224035020 con 0x7f62340b4e40 2024-03-30T13:12:06.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.277+0000 7f6232a00640 1 -- 172.21.15.99:0/3789715396 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6224031640 con 0x7f62340b4e40 2024-03-30T13:12:06.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.277+0000 7f6232a00640 1 -- 172.21.15.99:0/3789715396 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622402d040 con 0x7f62340b4e40 2024-03-30T13:12:06.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.277+0000 7f623a400640 1 -- 172.21.15.99:0/3789715396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62340b4e40 msgr2=0x7f62340c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.277+0000 7f623a400640 1 --2- 172.21.15.99:0/3789715396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62340b4e40 0x7f62340c6820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6224009870 tx=0x7f622402b8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.277+0000 7f623a400640 1 -- 172.21.15.99:0/3789715396 shutdown_connections 2024-03-30T13:12:06.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.277+0000 7f623a400640 1 --2- 172.21.15.99:0/3789715396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62340b2810 0x7f62340cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.277+0000 7f623a400640 1 --2- 172.21.15.99:0/3789715396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62340b4e40 0x7f62340c6820 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.277+0000 7f623a400640 1 -- 172.21.15.99:0/3789715396 >> 172.21.15.99:0/3789715396 conn(0x7f62340d0450 msgr2=0x7f62340d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:06.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.277+0000 7f623a400640 1 -- 172.21.15.99:0/3789715396 shutdown_connections 2024-03-30T13:12:06.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.277+0000 7f623a400640 1 -- 172.21.15.99:0/3789715396 wait complete. 2024-03-30T13:12:06.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.279+0000 7f623a400640 1 Processor -- start 2024-03-30T13:12:06.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.279+0000 7f623a400640 1 -- start start 2024-03-30T13:12:06.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.280+0000 7f623a400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62340b2810 0x7f623406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.280+0000 7f623a400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62340b31c0 0x7f623406ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.280+0000 7f623a400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62340b4e40 0x7f62340ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.280+0000 7f623a400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f62340b3650 con 0x7f62340b31c0 2024-03-30T13:12:06.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.280+0000 7f623a400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6234160d70 con 0x7f62340b2810 2024-03-30T13:12:06.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.280+0000 7f623a400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f62340c60f0 con 0x7f62340b4e40 2024-03-30T13:12:06.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.280+0000 7f622be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62340b31c0 0x7f623406ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.280+0000 7f622be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62340b31c0 0x7f623406ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42320/0 (socket says 172.21.15.99:42320) 2024-03-30T13:12:06.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.280+0000 7f622be00640 1 -- 172.21.15.99:0/3339856699 learned_addr learned my addr 172.21.15.99:0/3339856699 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:06.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f6233400640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62340b2810 0x7f623406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f6233e00640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62340b4e40 0x7f62340ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f622be00640 1 -- 172.21.15.99:0/3339856699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62340b4e40 msgr2=0x7f62340ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f622be00640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62340b4e40 0x7f62340ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f622be00640 1 -- 172.21.15.99:0/3339856699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62340b2810 msgr2=0x7f623406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f622be00640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62340b2810 0x7f623406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f622be00640 1 -- 172.21.15.99:0/3339856699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62340aefc0 con 0x7f62340b31c0 2024-03-30T13:12:06.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f6233400640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62340b2810 0x7f623406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:06.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f622be00640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62340b31c0 0x7f623406ee60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c400 tx=0x7f621c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:06.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f622b400640 1 -- 172.21.15.99:0/3339856699 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0052d0 con 0x7f62340b31c0 2024-03-30T13:12:06.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f622b400640 1 -- 172.21.15.99:0/3339856699 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c005490 con 0x7f62340b31c0 2024-03-30T13:12:06.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.281+0000 7f622b400640 1 -- 172.21.15.99:0/3339856699 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c007260 con 0x7f62340b31c0 2024-03-30T13:12:06.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.282+0000 7f623a400640 1 -- 172.21.15.99:0/3339856699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62341f8560 con 0x7f62340b31c0 2024-03-30T13:12:06.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.282+0000 7f623a400640 1 -- 172.21.15.99:0/3339856699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62341f9040 con 0x7f62340b31c0 2024-03-30T13:12:06.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.283+0000 7f623a400640 1 -- 172.21.15.99:0/3339856699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6234073a10 con 0x7f62340b31c0 2024-03-30T13:12:06.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.284+0000 7f622b400640 1 -- 172.21.15.99:0/3339856699 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f621c007400 con 0x7f62340b31c0 2024-03-30T13:12:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.284+0000 7f622b400640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f621006c530 0x7f621006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.285+0000 7f622b400640 1 -- 172.21.15.99:0/3339856699 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f621c08ac60 con 0x7f62340b31c0 2024-03-30T13:12:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.285+0000 7f6233400640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f621006c530 0x7f621006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.285+0000 7f6233400640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f621006c530 0x7f621006e9f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6224036000 tx=0x7f622403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:06.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.289+0000 7f622b400640 1 -- 172.21.15.99:0/3339856699 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f621c059270 con 0x7f62340b31c0 2024-03-30T13:12:06.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:06.532+0000 7f623a400640 1 -- 172.21.15.99:0/3339856699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f623404f9d0 con 0x7f62340b31c0 2024-03-30T13:12:07.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.199+0000 7f622b400640 1 -- 172.21.15.99:0/3339856699 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f621c058b70 con 0x7f62340b31c0 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.203+0000 7f623a400640 1 -- 172.21.15.99:0/3339856699 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f621006c530 msgr2=0x7f621006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.203+0000 7f623a400640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f621006c530 0x7f621006e9f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6224036000 tx=0x7f622403c040 comp rx=0 tx=0).stop 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.203+0000 7f623a400640 1 -- 172.21.15.99:0/3339856699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62340b31c0 msgr2=0x7f623406ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.203+0000 7f623a400640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62340b31c0 0x7f623406ee60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c400 tx=0x7f621c00c8c0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.203+0000 7f623a400640 1 -- 172.21.15.99:0/3339856699 shutdown_connections 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.203+0000 7f623a400640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f621006c530 0x7f621006e9f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.203+0000 7f623a400640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62340b4e40 0x7f62340ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.203+0000 7f623a400640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62340b31c0 0x7f623406ee60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.203+0000 7f623a400640 1 --2- 172.21.15.99:0/3339856699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62340b2810 0x7f623406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.203+0000 7f623a400640 1 -- 172.21.15.99:0/3339856699 >> 172.21.15.99:0/3339856699 conn(0x7f62340d0450 msgr2=0x7f6234153270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.204+0000 7f623a400640 1 -- 172.21.15.99:0/3339856699 shutdown_connections 2024-03-30T13:12:07.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.204+0000 7f623a400640 1 -- 172.21.15.99:0/3339856699 wait complete. 2024-03-30T13:12:07.229 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-30T13:12:07.230 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-30T13:12:07.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.441+0000 7f5c17e00640 1 Processor -- start 2024-03-30T13:12:07.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.441+0000 7f5c17e00640 1 -- start start 2024-03-30T13:12:07.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.442+0000 7f5c17e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c180b3a00 0x7f5c1806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.442+0000 7f5c17e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5c180d0b70 0x7f5c180ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.442+0000 7f5c17e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c180b3de0 con 0x7f5c18144850 2024-03-30T13:12:07.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.442+0000 7f5c17e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f5c180cdfd0 con 0x7f5c180d0b70 2024-03-30T13:12:07.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.442+0000 7f5c17e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1806dd50 con 0x7f5c180b3a00 2024-03-30T13:12:07.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.443+0000 7f5c17400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5c180d0b70 0x7f5c180ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.443+0000 7f5c17400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5c180d0b70 0x7f5c180ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42326/0 (socket says 172.21.15.99:42326) 2024-03-30T13:12:07.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.443+0000 7f5c17400640 1 -- 172.21.15.99:0/2895997452 learned_addr learned my addr 172.21.15.99:0/2895997452 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.443+0000 7f5c16a00640 1 --2- 172.21.15.99:0/2895997452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c180b3a00 0x7f5c1806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.443+0000 7f5c17400640 1 -- 172.21.15.99:0/2895997452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c180b3a00 msgr2=0x7f5c1806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.443+0000 7f5c17400640 1 --2- 172.21.15.99:0/2895997452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c180b3a00 0x7f5c1806d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.443+0000 7f5c17400640 1 -- 172.21.15.99:0/2895997452 >> v1:172.21.15.181:6789/0 conn(0x7f5c18144850 legacy=0x7f5c180d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.443+0000 7f5c17400640 1 -- 172.21.15.99:0/2895997452 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1806e030 con 0x7f5c180d0b70 2024-03-30T13:12:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.444+0000 7f5c17400640 1 --2- 172.21.15.99:0/2895997452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c180d0b70 0x7f5c180ce460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009e50 tx=0x7f5c1002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715268626d3e5075 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.445+0000 7f5c16000640 1 -- 172.21.15.99:0/2895997452 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1002ca70 con 0x7f5c180d0b70 2024-03-30T13:12:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.445+0000 7f5c16000640 1 -- 172.21.15.99:0/2895997452 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1002cc10 con 0x7f5c180d0b70 2024-03-30T13:12:07.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.445+0000 7f5c16000640 1 -- 172.21.15.99:0/2895997452 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c100343f0 con 0x7f5c180d0b70 2024-03-30T13:12:07.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.445+0000 7f5c17e00640 1 -- 172.21.15.99:0/2895997452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c180d0b70 msgr2=0x7f5c180ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.445+0000 7f5c17e00640 1 --2- 172.21.15.99:0/2895997452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c180d0b70 0x7f5c180ce460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009e50 tx=0x7f5c1002bed0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.445+0000 7f5c17e00640 1 -- 172.21.15.99:0/2895997452 shutdown_connections 2024-03-30T13:12:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.445+0000 7f5c17e00640 1 --2- 172.21.15.99:0/2895997452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c180d0b70 0x7f5c180ce460 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.445+0000 7f5c17e00640 1 --2- 172.21.15.99:0/2895997452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c180b3a00 0x7f5c1806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.445+0000 7f5c17e00640 1 -- 172.21.15.99:0/2895997452 >> 172.21.15.99:0/2895997452 conn(0x7f5c180b21d0 msgr2=0x7f5c180b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.446+0000 7f5c17e00640 1 -- 172.21.15.99:0/2895997452 shutdown_connections 2024-03-30T13:12:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.446+0000 7f5c17e00640 1 -- 172.21.15.99:0/2895997452 wait complete. 2024-03-30T13:12:07.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.447+0000 7f5c17e00640 1 Processor -- start 2024-03-30T13:12:07.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.447+0000 7f5c17e00640 1 -- start start 2024-03-30T13:12:07.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.448+0000 7f5c17e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c180b3a00 0x7f5c1809d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.448+0000 7f5c17e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c180d0b70 0x7f5c1809d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.448+0000 7f5c17e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c18144850 0x7f5c180cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.448+0000 7f5c17e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18144cb0 con 0x7f5c180b3a00 2024-03-30T13:12:07.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.448+0000 7f5c17e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1806e5f0 con 0x7f5c18144850 2024-03-30T13:12:07.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.448+0000 7f5c17e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5c180ce9a0 con 0x7f5c180d0b70 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.449+0000 7f5c16a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c180b3a00 0x7f5c1809d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.449+0000 7f5c16a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c180b3a00 0x7f5c1809d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42334/0 (socket says 172.21.15.99:42334) 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.449+0000 7f5c16a00640 1 -- 172.21.15.99:0/1657930370 learned_addr learned my addr 172.21.15.99:0/1657930370 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.449+0000 7f5c0fe00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c180d0b70 0x7f5c1809d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.449+0000 7f5c16a00640 1 -- 172.21.15.99:0/1657930370 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c180d0b70 msgr2=0x7f5c1809d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.449+0000 7f5c16a00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c180d0b70 0x7f5c1809d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.449+0000 7f5c16a00640 1 -- 172.21.15.99:0/1657930370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c18144850 msgr2=0x7f5c180cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.449+0000 7f5c17400640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c18144850 0x7f5c180cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.449+0000 7f5c16a00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c18144850 0x7f5c180cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.449+0000 7f5c16a00640 1 -- 172.21.15.99:0/1657930370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1809e1e0 con 0x7f5c180b3a00 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.449+0000 7f5c16a00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c180b3a00 0x7f5c1809d080 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800c7f0 tx=0x7f5c0800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.450+0000 7f5c0ea00640 1 -- 172.21.15.99:0/1657930370 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08015070 con 0x7f5c180b3a00 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.450+0000 7f5c0ea00640 1 -- 172.21.15.99:0/1657930370 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c08004240 con 0x7f5c180b3a00 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.450+0000 7f5c0ea00640 1 -- 172.21.15.99:0/1657930370 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08007620 con 0x7f5c180b3a00 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.450+0000 7f5c17e00640 1 -- 172.21.15.99:0/1657930370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1809dc20 con 0x7f5c180b3a00 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.450+0000 7f5c17e00640 1 -- 172.21.15.99:0/1657930370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c180b0440 con 0x7f5c180b3a00 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.451+0000 7f5c17e00640 1 -- 172.21.15.99:0/1657930370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1804f8f0 con 0x7f5c180b3a00 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.452+0000 7f5c0ea00640 1 -- 172.21.15.99:0/1657930370 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5c080079d0 con 0x7f5c180b3a00 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.453+0000 7f5c0ea00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5bf406c530 0x7f5bf406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.453+0000 7f5c0ea00640 1 -- 172.21.15.99:0/1657930370 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f5c0808bbc0 con 0x7f5c180b3a00 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.453+0000 7f5c0fe00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5bf406c530 0x7f5bf406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.453+0000 7f5c0fe00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5bf406c530 0x7f5bf406e9f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5c00006fd0 tx=0x7f5c00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:07.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.457+0000 7f5c0ea00640 1 -- 172.21.15.99:0/1657930370 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5c0805a140 con 0x7f5c180b3a00 2024-03-30T13:12:07.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:07.690+0000 7f5c17e00640 1 -- 172.21.15.99:0/1657930370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5c180cd260 con 0x7f5c180b3a00 2024-03-30T13:12:08.079 INFO:tasks.ceph.mds.b.smithi181.stderr:2024-03-30T13:12:08.076+0000 7f9157600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T13:12:08.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.210+0000 7f5c0ea00640 1 -- 172.21.15.99:0/1657930370 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f5c08059a40 con 0x7f5c180b3a00 2024-03-30T13:12:08.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.214+0000 7f5c17e00640 1 -- 172.21.15.99:0/1657930370 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5bf406c530 msgr2=0x7f5bf406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.214+0000 7f5c17e00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5bf406c530 0x7f5bf406e9f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5c00006fd0 tx=0x7f5c00008040 comp rx=0 tx=0).stop 2024-03-30T13:12:08.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.214+0000 7f5c17e00640 1 -- 172.21.15.99:0/1657930370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c180b3a00 msgr2=0x7f5c1809d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.214+0000 7f5c17e00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c180b3a00 0x7f5c1809d080 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800c7f0 tx=0x7f5c0800ccb0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.214+0000 7f5c17e00640 1 -- 172.21.15.99:0/1657930370 shutdown_connections 2024-03-30T13:12:08.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.214+0000 7f5c17e00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f5bf406c530 0x7f5bf406e9f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.214+0000 7f5c17e00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c18144850 0x7f5c180cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.214+0000 7f5c17e00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5c180d0b70 0x7f5c1809d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.214+0000 7f5c17e00640 1 --2- 172.21.15.99:0/1657930370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c180b3a00 0x7f5c1809d080 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.214+0000 7f5c17e00640 1 -- 172.21.15.99:0/1657930370 >> 172.21.15.99:0/1657930370 conn(0x7f5c180b21d0 msgr2=0x7f5c180ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:08.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.215+0000 7f5c17e00640 1 -- 172.21.15.99:0/1657930370 shutdown_connections 2024-03-30T13:12:08.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.215+0000 7f5c17e00640 1 -- 172.21.15.99:0/1657930370 wait complete. 2024-03-30T13:12:08.240 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-30T13:12:08.240 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:12:08.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.442+0000 7eff8fe00640 1 Processor -- start 2024-03-30T13:12:08.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.443+0000 7eff8fe00640 1 -- start start 2024-03-30T13:12:08.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.444+0000 7eff8fe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7eff90071b00 0x7eff9015f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.444+0000 7eff8fe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff90155e40 con 0x7eff90071ee0 2024-03-30T13:12:08.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.444+0000 7eff8fe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff9015f780 con 0x7eff901559b0 2024-03-30T13:12:08.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.444+0000 7eff8fe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7eff9015f550 con 0x7eff90071b00 2024-03-30T13:12:08.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.444+0000 7eff87e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7eff90071ee0 0x7eff901552a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55790/0 (socket says 172.21.15.99:55790) 2024-03-30T13:12:08.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.444+0000 7eff87e00640 1 -- 172.21.15.99:0/242752492 learned_addr learned my addr 172.21.15.99:0/242752492 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.445+0000 7eff8ea00640 1 --2- 172.21.15.99:0/242752492 >> v2:172.21.15.181:3300/0 conn(0x7eff90071b00 0x7eff9015f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.445+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011604224 0 0) 0x7eff90155e40 con 0x7eff90071ee0 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.445+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff74005730 con 0x7eff90071ee0 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.445+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2488416742 0 0) 0x7eff74005730 con 0x7eff90071ee0 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.445+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 >> v2:172.21.15.181:3300/0 conn(0x7eff90071b00 msgr2=0x7eff9015f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.445+0000 7eff8e000640 1 --2- 172.21.15.99:0/242752492 >> v2:172.21.15.181:3300/0 conn(0x7eff90071b00 0x7eff9015f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.445+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 >> v1:172.21.15.181:6789/0 conn(0x7eff901559b0 legacy=0x7eff9015ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.445+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9015fa60 con 0x7eff90071ee0 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.445+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7eff78001670 con 0x7eff90071ee0 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.445+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 >> v1:172.21.15.99:6789/0 conn(0x7eff90071ee0 legacy=0x7eff901552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.445+0000 7eff8e000640 1 --2- 172.21.15.99:0/242752492 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff74005c10 0x7eff74006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff8e000640 1 --2- 172.21.15.99:0/242752492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 0x7eff74006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff8e000640 1 --2- 172.21.15.99:0/242752492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff740073d0 0x7eff7400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7eff7400e2a0 con 0x7eff74006a10 2024-03-30T13:12:08.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff7400e450 con 0x7eff740073d0 2024-03-30T13:12:08.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7eff7400e650 con 0x7eff74005c10 2024-03-30T13:12:08.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff87e00640 1 --2- 172.21.15.99:0/242752492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 0x7eff74006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff87e00640 1 -- 172.21.15.99:0/242752492 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff74005c10 msgr2=0x7eff74006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:08.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff87e00640 1 --2- 172.21.15.99:0/242752492 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff74005c10 0x7eff74006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff87e00640 1 -- 172.21.15.99:0/242752492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff740073d0 msgr2=0x7eff7400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:08.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff87e00640 1 --2- 172.21.15.99:0/242752492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff740073d0 0x7eff7400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff87e00640 1 -- 172.21.15.99:0/242752492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff74005730 con 0x7eff74006a10 2024-03-30T13:12:08.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.446+0000 7eff8f400640 1 -- 172.21.15.99:0/242752492 reap_dead start 2024-03-30T13:12:08.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.447+0000 7eff87e00640 1 --2- 172.21.15.99:0/242752492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 0x7eff74006e90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7eff7800c110 tx=0x7eff74007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a35b15bad54d9a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.447+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78007c40 con 0x7eff74006a10 2024-03-30T13:12:08.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.447+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff78030070 con 0x7eff74006a10 2024-03-30T13:12:08.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.447+0000 7eff8e000640 1 -- 172.21.15.99:0/242752492 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78005d70 con 0x7eff74006a10 2024-03-30T13:12:08.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.448+0000 7eff8fe00640 1 -- 172.21.15.99:0/242752492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 msgr2=0x7eff74006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.448+0000 7eff8fe00640 1 --2- 172.21.15.99:0/242752492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 0x7eff74006e90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7eff7800c110 tx=0x7eff74007a40 comp rx=0 tx=0).stop 2024-03-30T13:12:08.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.448+0000 7eff8fe00640 1 -- 172.21.15.99:0/242752492 shutdown_connections 2024-03-30T13:12:08.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.448+0000 7eff8fe00640 1 --2- 172.21.15.99:0/242752492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 0x7eff74006e90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.448+0000 7eff8fe00640 1 -- 172.21.15.99:0/242752492 >> 172.21.15.99:0/242752492 conn(0x7eff9006bb40 msgr2=0x7eff900b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:08.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.448+0000 7eff8fe00640 1 -- 172.21.15.99:0/242752492 shutdown_connections 2024-03-30T13:12:08.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.448+0000 7eff8fe00640 1 -- 172.21.15.99:0/242752492 wait complete. 2024-03-30T13:12:08.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.450+0000 7eff8fe00640 1 Processor -- start 2024-03-30T13:12:08.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.450+0000 7eff8fe00640 1 -- start start 2024-03-30T13:12:08.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.451+0000 7eff8fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 0x7eff9014a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.451+0000 7eff8fe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff900ca190 0x7eff900afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.451+0000 7eff8fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff900b0380 0x7eff9009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.451+0000 7eff8fe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7eff9006d860 con 0x7eff74006a10 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.451+0000 7eff8fe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff90072580 con 0x7eff900b0380 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.451+0000 7eff8fe00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7eff9015f010 con 0x7eff900ca190 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.451+0000 7eff8ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 0x7eff9014a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.451+0000 7eff8ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 0x7eff9014a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42362/0 (socket says 172.21.15.99:42362) 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.451+0000 7eff8ea00640 1 -- 172.21.15.99:0/2380352569 learned_addr learned my addr 172.21.15.99:0/2380352569 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff8f400640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff900b0380 0x7eff9009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff8ea00640 1 -- 172.21.15.99:0/2380352569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff900ca190 msgr2=0x7eff900afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff8ea00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff900ca190 0x7eff900afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff8ea00640 1 -- 172.21.15.99:0/2380352569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff900b0380 msgr2=0x7eff9009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff8ea00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff900b0380 0x7eff9009aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff8ea00640 1 -- 172.21.15.99:0/2380352569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff900c93d0 con 0x7eff74006a10 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff8ea00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 0x7eff9014a9b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7eff8000e770 tx=0x7eff8000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff86a00640 1 -- 172.21.15.99:0/2380352569 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80017070 con 0x7eff74006a10 2024-03-30T13:12:08.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff86a00640 1 -- 172.21.15.99:0/2380352569 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8000c730 con 0x7eff74006a10 2024-03-30T13:12:08.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff86a00640 1 -- 172.21.15.99:0/2380352569 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8000cb20 con 0x7eff74006a10 2024-03-30T13:12:08.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff8fe00640 1 -- 172.21.15.99:0/2380352569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff900c96b0 con 0x7eff74006a10 2024-03-30T13:12:08.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.452+0000 7eff8fe00640 1 -- 172.21.15.99:0/2380352569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff900c9c70 con 0x7eff74006a10 2024-03-30T13:12:08.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.454+0000 7eff8fe00640 1 -- 172.21.15.99:0/2380352569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9004f8f0 con 0x7eff74006a10 2024-03-30T13:12:08.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.454+0000 7eff86a00640 1 -- 172.21.15.99:0/2380352569 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7eff8001a070 con 0x7eff74006a10 2024-03-30T13:12:08.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.455+0000 7eff86a00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7eff6c06c530 0x7eff6c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.455+0000 7eff86a00640 1 -- 172.21.15.99:0/2380352569 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7eff8008b8d0 con 0x7eff74006a10 2024-03-30T13:12:08.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.455+0000 7eff87e00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7eff6c06c530 0x7eff6c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.456+0000 7eff87e00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7eff6c06c530 0x7eff6c06e9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff78034000 tx=0x7eff78007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.460+0000 7eff86a00640 1 -- 172.21.15.99:0/2380352569 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7eff80059ee0 con 0x7eff74006a10 2024-03-30T13:12:08.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.700+0000 7eff8fe00640 1 -- 172.21.15.99:0/2380352569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff900b2920 con 0x7eff74006a10 2024-03-30T13:12:08.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.701+0000 7eff86a00640 1 -- 172.21.15.99:0/2380352569 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7eff800597e0 con 0x7eff74006a10 2024-03-30T13:12:08.706 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:08.706 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1591088829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1591088829},{"type":"v1","addr":"172.21.15.99:6837","nonce":1591088829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5115,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/333253843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":333253843},{"type":"v1","addr":"172.21.15.99:6835","nonce":333253843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6834/859511813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":859511813},{"type":"v1","addr":"172.21.15.181:6834","nonce":859511813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:12:04.595024+0000","modified":"2024-03-30T13:12:07.691913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6835/1594018738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6833","nonce":1594018738},{"type":"v1","addr":"172.21.15.181:6835","nonce":1594018738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5121,"qdb_cluster":[5121]},"id":2}]} 2024-03-30T13:12:08.706 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-03-30T13:12:08.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.704+0000 7eff8fe00640 1 -- 172.21.15.99:0/2380352569 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7eff6c06c530 msgr2=0x7eff6c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.704+0000 7eff8fe00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7eff6c06c530 0x7eff6c06e9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff78034000 tx=0x7eff78007000 comp rx=0 tx=0).stop 2024-03-30T13:12:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.704+0000 7eff8fe00640 1 -- 172.21.15.99:0/2380352569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 msgr2=0x7eff9014a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.704+0000 7eff8fe00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 0x7eff9014a9b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7eff8000e770 tx=0x7eff8000ec30 comp rx=0 tx=0).stop 2024-03-30T13:12:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.704+0000 7eff8fe00640 1 -- 172.21.15.99:0/2380352569 shutdown_connections 2024-03-30T13:12:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.704+0000 7eff8fe00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7eff6c06c530 0x7eff6c06e9f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.704+0000 7eff8fe00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff900b0380 0x7eff9009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.704+0000 7eff8fe00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff900ca190 0x7eff900afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.704+0000 7eff8fe00640 1 --2- 172.21.15.99:0/2380352569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff74006a10 0x7eff9014a9b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.704+0000 7eff8fe00640 1 -- 172.21.15.99:0/2380352569 >> 172.21.15.99:0/2380352569 conn(0x7eff9006bb40 msgr2=0x7eff90152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.704+0000 7eff8fe00640 1 -- 172.21.15.99:0/2380352569 shutdown_connections 2024-03-30T13:12:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.705+0000 7eff8fe00640 1 -- 172.21.15.99:0/2380352569 wait complete. 2024-03-30T13:12:08.727 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:08.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.925+0000 7f516a200640 1 Processor -- start 2024-03-30T13:12:08.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.925+0000 7f516a200640 1 -- start start 2024-03-30T13:12:08.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.927+0000 7f516a200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640d0f70 0x7f516406cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.927+0000 7f516a200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516406ddd0 con 0x7f51641620e0 2024-03-30T13:12:08.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.927+0000 7f516a200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516406e070 con 0x7f516406d910 2024-03-30T13:12:08.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.927+0000 7f516a200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f51640d4be0 con 0x7f51640d0f70 2024-03-30T13:12:08.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.927+0000 7f5169800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f51641620e0 0x7f51640d2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55806/0 (socket says 172.21.15.99:55806) 2024-03-30T13:12:08.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.927+0000 7f5169800640 1 -- 172.21.15.99:0/2654554779 learned_addr learned my addr 172.21.15.99:0/2654554779 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:08.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5168e00640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640d0f70 0x7f516406cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579432106 0 0) 0x7f516406ddd0 con 0x7f51641620e0 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5148003520 con 0x7f51641620e0 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 299591266 0 0) 0x7f5148003520 con 0x7f51641620e0 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640d0f70 msgr2=0x7f516406cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640d0f70 0x7f516406cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 >> v1:172.21.15.181:6789/0 conn(0x7f516406d910 legacy=0x7f51641619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51640d4ec0 con 0x7f51641620e0 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f515c0019f0 con 0x7f51641620e0 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 >> v1:172.21.15.99:6789/0 conn(0x7f51641620e0 legacy=0x7f51640d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51480039e0 0x7f5148003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640d0f70 0x7f5148004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5148004d40 0x7f51480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f51640d4be0 con 0x7f51480039e0 2024-03-30T13:12:08.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f514800bb50 con 0x7f5148004d40 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.928+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f514800bd20 con 0x7f51640d0f70 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.929+0000 7f5168e00640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51480039e0 0x7f5148003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.929+0000 7f515be00640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640d0f70 0x7f5148004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.929+0000 7f5169800640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5148004d40 0x7f51480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.929+0000 7f5168e00640 1 -- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640d0f70 msgr2=0x7f5148004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.929+0000 7f5168e00640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640d0f70 0x7f5148004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.929+0000 7f5168e00640 1 -- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5148004d40 msgr2=0x7f51480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.929+0000 7f5168e00640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5148004d40 0x7f51480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.929+0000 7f5168e00640 1 -- 172.21.15.99:0/2654554779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5148003520 con 0x7f51480039e0 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.929+0000 7f5169800640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5148004d40 0x7f51480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.930+0000 7f5168e00640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51480039e0 0x7f5148003e00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f515400ba60 tx=0x7f5148005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9c9fbceb07566a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.930+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154036020 con 0x7f51480039e0 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.930+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5154032630 con 0x7f51480039e0 2024-03-30T13:12:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.930+0000 7f5163e00640 1 -- 172.21.15.99:0/2654554779 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515400b600 con 0x7f51480039e0 2024-03-30T13:12:08.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.931+0000 7f516a200640 1 -- 172.21.15.99:0/2654554779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51480039e0 msgr2=0x7f5148003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.931+0000 7f516a200640 1 --2- 172.21.15.99:0/2654554779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51480039e0 0x7f5148003e00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f515400ba60 tx=0x7f5148005830 comp rx=0 tx=0).stop 2024-03-30T13:12:08.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.931+0000 7f5169800640 1 -- 172.21.15.99:0/2654554779 reap_dead start 2024-03-30T13:12:08.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.931+0000 7f516a200640 1 -- 172.21.15.99:0/2654554779 shutdown_connections 2024-03-30T13:12:08.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.931+0000 7f516a200640 1 -- 172.21.15.99:0/2654554779 >> 172.21.15.99:0/2654554779 conn(0x7f516408bfc0 msgr2=0x7f51640d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:08.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.931+0000 7f516a200640 1 -- 172.21.15.99:0/2654554779 shutdown_connections 2024-03-30T13:12:08.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.931+0000 7f516a200640 1 -- 172.21.15.99:0/2654554779 wait complete. 2024-03-30T13:12:08.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.933+0000 7f516a200640 1 Processor -- start 2024-03-30T13:12:08.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.933+0000 7f516a200640 1 -- start start 2024-03-30T13:12:08.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.934+0000 7f516a200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51480039e0 0x7f51640cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.934+0000 7f516a200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51640b92f0 0x7f51640d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.934+0000 7f516a200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640b6ff0 0x7f51640b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.934+0000 7f516a200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f51640cef40 con 0x7f51640b92f0 2024-03-30T13:12:08.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.934+0000 7f516a200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f516406e350 con 0x7f51480039e0 2024-03-30T13:12:08.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.934+0000 7f516a200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f51640d1350 con 0x7f51640b6ff0 2024-03-30T13:12:08.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.934+0000 7f515be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51640b92f0 0x7f51640d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.934+0000 7f515be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51640b92f0 0x7f51640d25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42382/0 (socket says 172.21.15.99:42382) 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.934+0000 7f515be00640 1 -- 172.21.15.99:0/377082759 learned_addr learned my addr 172.21.15.99:0/377082759 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f5169800640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640b6ff0 0x7f51640b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f5168e00640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51480039e0 0x7f51640cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f515be00640 1 -- 172.21.15.99:0/377082759 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640b6ff0 msgr2=0x7f51640b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f515be00640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640b6ff0 0x7f51640b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f515be00640 1 -- 172.21.15.99:0/377082759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51480039e0 msgr2=0x7f51640cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f515be00640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51480039e0 0x7f51640cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f515be00640 1 -- 172.21.15.99:0/377082759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51641f4770 con 0x7f51640b92f0 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f5169800640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640b6ff0 0x7f51640b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f5168e00640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51480039e0 0x7f51640cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f515be00640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51640b92f0 0x7f51640d25a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f514c00e580 tx=0x7f514c00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f5161600640 1 -- 172.21.15.99:0/377082759 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c0052e0 con 0x7f51640b92f0 2024-03-30T13:12:08.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f5161600640 1 -- 172.21.15.99:0/377082759 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514c018070 con 0x7f51640b92f0 2024-03-30T13:12:08.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f5161600640 1 -- 172.21.15.99:0/377082759 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c003810 con 0x7f51640b92f0 2024-03-30T13:12:08.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f516a200640 1 -- 172.21.15.99:0/377082759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51640cca80 con 0x7f51640b92f0 2024-03-30T13:12:08.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.935+0000 7f516a200640 1 -- 172.21.15.99:0/377082759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51640cd040 con 0x7f51640b92f0 2024-03-30T13:12:08.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.937+0000 7f516a200640 1 -- 172.21.15.99:0/377082759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f516404f8f0 con 0x7f51640b92f0 2024-03-30T13:12:08.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.937+0000 7f5161600640 1 -- 172.21.15.99:0/377082759 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f514c0039b0 con 0x7f51640b92f0 2024-03-30T13:12:08.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.938+0000 7f5161600640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f514006c530 0x7f514006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.938+0000 7f5161600640 1 -- 172.21.15.99:0/377082759 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f514c08b4c0 con 0x7f51640b92f0 2024-03-30T13:12:08.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.939+0000 7f5168e00640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f514006c530 0x7f514006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.939+0000 7f5168e00640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f514006c530 0x7f514006e9f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f515400ba30 tx=0x7f5154030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:08.943+0000 7f5161600640 1 -- 172.21.15.99:0/377082759 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f51641f4770 con 0x7f51640b92f0 2024-03-30T13:12:09.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.131+0000 7f516a200640 1 -- 172.21.15.99:0/377082759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51640d49a0 con 0x7f51640b92f0 2024-03-30T13:12:09.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.133+0000 7f5161600640 1 -- 172.21.15.99:0/377082759 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16609 (secure 0 0 0) 0x7f514c059a50 con 0x7f51640b92f0 2024-03-30T13:12:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:09.138 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":35,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:12:06.177888+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:12:02.458079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:12:03.597299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:09.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 -- 172.21.15.99:0/377082759 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f514006c530 msgr2=0x7f514006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f514006c530 0x7f514006e9f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f515400ba30 tx=0x7f5154030000 comp rx=0 tx=0).stop 2024-03-30T13:12:09.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 -- 172.21.15.99:0/377082759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51640b92f0 msgr2=0x7f51640d25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51640b92f0 0x7f51640d25a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f514c00e580 tx=0x7f514c00ea40 comp rx=0 tx=0).stop 2024-03-30T13:12:09.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 -- 172.21.15.99:0/377082759 shutdown_connections 2024-03-30T13:12:09.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f514006c530 0x7f514006e9f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51640b6ff0 0x7f51640b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51640b92f0 0x7f51640d25a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 --2- 172.21.15.99:0/377082759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51480039e0 0x7f51640cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 -- 172.21.15.99:0/377082759 >> 172.21.15.99:0/377082759 conn(0x7f516408bfc0 msgr2=0x7f51640d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:09.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 -- 172.21.15.99:0/377082759 shutdown_connections 2024-03-30T13:12:09.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.136+0000 7f516a200640 1 -- 172.21.15.99:0/377082759 wait complete. 2024-03-30T13:12:09.157 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-30T13:12:09.157 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:12:09.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.344+0000 7fbe0e200640 1 Processor -- start 2024-03-30T13:12:09.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.344+0000 7fbe0e200640 1 -- start start 2024-03-30T13:12:09.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.345+0000 7fbe0e200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe0815c670 0x7fbe0806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.345+0000 7fbe0e200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbe0806f060 0x7fbe0806d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.345+0000 7fbe0e200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe08146230 con 0x7fbe080ad230 2024-03-30T13:12:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.345+0000 7fbe0e200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0806dfc0 con 0x7fbe0806f060 2024-03-30T13:12:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.345+0000 7fbe0e200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0806e2a0 con 0x7fbe0815c670 2024-03-30T13:12:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.346+0000 7fbdffe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbe0806f060 0x7fbe0806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.346+0000 7fbe07400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe0815c670 0x7fbe0806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.346+0000 7fbdffe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbe0806f060 0x7fbe0806d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:36342/0 (socket says 172.21.15.99:36342) 2024-03-30T13:12:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.346+0000 7fbe07e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fbe080ad230 0x7fbe080b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:35278/0 (socket says 172.21.15.99:35278) 2024-03-30T13:12:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.346+0000 7fbdffe00640 1 -- 172.21.15.99:0/2415956504 learned_addr learned my addr 172.21.15.99:0/2415956504 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:09.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.347+0000 7fbdffe00640 1 -- 172.21.15.99:0/2415956504 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe0815c670 msgr2=0x7fbe0806c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:09.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.347+0000 7fbdffe00640 1 --2- 172.21.15.99:0/2415956504 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe0815c670 0x7fbe0806c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.347+0000 7fbdffe00640 1 -- 172.21.15.99:0/2415956504 >> v1:172.21.15.181:6789/0 conn(0x7fbe080ad230 legacy=0x7fbe080b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.347+0000 7fbe06a00640 1 -- 172.21.15.99:0/2415956504 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441128477 0 0) 0x7fbe00001490 con 0x7fbe080ad230 2024-03-30T13:12:09.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.347+0000 7fbdffe00640 1 -- 172.21.15.99:0/2415956504 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0806e580 con 0x7fbe0806f060 2024-03-30T13:12:09.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.347+0000 7fbe07400640 1 --2- 172.21.15.99:0/2415956504 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe0815c670 0x7fbe0806c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:09.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.349+0000 7fbdffe00640 1 --2- 172.21.15.99:0/2415956504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe0806f060 0x7fbe0806d930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009870 tx=0x7fbdf002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa56211a6fd9f414 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:09.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.349+0000 7fbe06a00640 1 -- 172.21.15.99:0/2415956504 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0035020 con 0x7fbe0806f060 2024-03-30T13:12:09.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.349+0000 7fbe06a00640 1 -- 172.21.15.99:0/2415956504 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf0031640 con 0x7fbe0806f060 2024-03-30T13:12:09.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.349+0000 7fbe06a00640 1 -- 172.21.15.99:0/2415956504 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf002d040 con 0x7fbe0806f060 2024-03-30T13:12:09.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.350+0000 7fbe0e200640 1 -- 172.21.15.99:0/2415956504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe0806f060 msgr2=0x7fbe0806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.350+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2415956504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe0806f060 0x7fbe0806d930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009870 tx=0x7fbdf002b8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.350+0000 7fbe0e200640 1 -- 172.21.15.99:0/2415956504 shutdown_connections 2024-03-30T13:12:09.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.350+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2415956504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe0806f060 0x7fbe0806d930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.350+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2415956504 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe0815c670 0x7fbe0806c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.350+0000 7fbe0e200640 1 -- 172.21.15.99:0/2415956504 >> 172.21.15.99:0/2415956504 conn(0x7fbe0806b510 msgr2=0x7fbe0806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:09.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.350+0000 7fbe0e200640 1 -- 172.21.15.99:0/2415956504 shutdown_connections 2024-03-30T13:12:09.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.350+0000 7fbe0e200640 1 -- 172.21.15.99:0/2415956504 wait complete. 2024-03-30T13:12:09.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.352+0000 7fbe0e200640 1 Processor -- start 2024-03-30T13:12:09.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.352+0000 7fbe0e200640 1 -- start start 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe0e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0806f060 0x7fbe0815f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe0e200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe080ad230 0x7fbe081f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe0e200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe0815c670 0x7fbe080cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe0e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbe080ad6c0 con 0x7fbe0806f060 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe0e200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0815ca50 con 0x7fbe080ad230 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe0e200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbe080ad840 con 0x7fbe0815c670 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe07400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0806f060 0x7fbe0815f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe07400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0806f060 0x7fbe0815f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42386/0 (socket says 172.21.15.99:42386) 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe07400640 1 -- 172.21.15.99:0/2893283500 learned_addr learned my addr 172.21.15.99:0/2893283500 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe07400640 1 -- 172.21.15.99:0/2893283500 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe0815c670 msgr2=0x7fbe080cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe07400640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe0815c670 0x7fbe080cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe07400640 1 -- 172.21.15.99:0/2893283500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe080ad230 msgr2=0x7fbe081f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe07400640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe080ad230 0x7fbe081f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.353+0000 7fbe07400640 1 -- 172.21.15.99:0/2893283500 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0815f8f0 con 0x7fbe0806f060 2024-03-30T13:12:09.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.354+0000 7fbe07400640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0806f060 0x7fbe0815f2a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800e960 tx=0x7fbdf800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:09.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.354+0000 7fbdff400640 1 -- 172.21.15.99:0/2893283500 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8017070 con 0x7fbe0806f060 2024-03-30T13:12:09.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.354+0000 7fbdff400640 1 -- 172.21.15.99:0/2893283500 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf800ca00 con 0x7fbe0806f060 2024-03-30T13:12:09.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.354+0000 7fbdff400640 1 -- 172.21.15.99:0/2893283500 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800cdb0 con 0x7fbe0806f060 2024-03-30T13:12:09.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.354+0000 7fbe0e200640 1 -- 172.21.15.99:0/2893283500 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0815d590 con 0x7fbe0806f060 2024-03-30T13:12:09.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.354+0000 7fbe0e200640 1 -- 172.21.15.99:0/2893283500 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0815db50 con 0x7fbe0806f060 2024-03-30T13:12:09.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.355+0000 7fbe0e200640 1 -- 172.21.15.99:0/2893283500 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe08068640 con 0x7fbe0806f060 2024-03-30T13:12:09.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.356+0000 7fbdff400640 1 -- 172.21.15.99:0/2893283500 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbdf801a070 con 0x7fbe0806f060 2024-03-30T13:12:09.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.357+0000 7fbdff400640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbde406c560 0x7fbde406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.358+0000 7fbdff400640 1 -- 172.21.15.99:0/2893283500 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fbdf808b9d0 con 0x7fbe0806f060 2024-03-30T13:12:09.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.358+0000 7fbdffe00640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbde406c560 0x7fbde406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.358+0000 7fbdffe00640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbde406c560 0x7fbde406ea20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0036000 tx=0x7fbdf0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:09.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.362+0000 7fbdff400640 1 -- 172.21.15.99:0/2893283500 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fbdf8059f60 con 0x7fbe0806f060 2024-03-30T13:12:09.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.555+0000 7fbe0e200640 1 -- 172.21.15.99:0/2893283500 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe080cb060 con 0x7fbde406c560 2024-03-30T13:12:09.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.567+0000 7fbdff400640 1 -- 172.21.15.99:0/2893283500 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249150 (secure 0 0 0) 0x7fbe080cb060 con 0x7fbde406c560 2024-03-30T13:12:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:09.576 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:12:09.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 -- 172.21.15.99:0/2893283500 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbde406c560 msgr2=0x7fbde406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbde406c560 0x7fbde406ea20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0036000 tx=0x7fbdf0030000 comp rx=0 tx=0).stop 2024-03-30T13:12:09.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 -- 172.21.15.99:0/2893283500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0806f060 msgr2=0x7fbe0815f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0806f060 0x7fbe0815f2a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800e960 tx=0x7fbdf800ee20 comp rx=0 tx=0).stop 2024-03-30T13:12:09.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 -- 172.21.15.99:0/2893283500 shutdown_connections 2024-03-30T13:12:09.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbde406c560 0x7fbde406ea20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbe0815c670 0x7fbe080cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe080ad230 0x7fbe081f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2893283500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0806f060 0x7fbe0815f2a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 -- 172.21.15.99:0/2893283500 >> 172.21.15.99:0/2893283500 conn(0x7fbe0806b510 msgr2=0x7fbe08160090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:09.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 -- 172.21.15.99:0/2893283500 shutdown_connections 2024-03-30T13:12:09.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.573+0000 7fbe0e200640 1 -- 172.21.15.99:0/2893283500 wait complete. 2024-03-30T13:12:09.594 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-03-30T13:12:09.460396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220244,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754476,"statfs":{"total":773094113280,"available":772868583424,"internally_reserved":0,"allocated":4169728,"data_stored":2316277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001414"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.141701+0000","last_change":"2024-03-30T13:12:04.141701+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.141701+0000","last_undegraded":"2024-03-30T13:12:04.141701+0000","last_fullsized":"2024-03-30T13:12:04.141701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184893+0000","last_change":"2024-03-30T13:12:05.197119+0000","last_active":"2024-03-30T13:12:07.184893+0000","last_peered":"2024-03-30T13:12:07.184893+0000","last_clean":"2024-03-30T13:12:07.184893+0000","last_became_active":"2024-03-30T13:12:05.189811+0000","last_became_peered":"2024-03-30T13:12:05.189811+0000","last_unstale":"2024-03-30T13:12:07.184893+0000","last_undegraded":"2024-03-30T13:12:07.184893+0000","last_fullsized":"2024-03-30T13:12:07.184893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.148195+0000","last_change":"2024-03-30T13:12:04.148195+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.148195+0000","last_undegraded":"2024-03-30T13:12:04.148195+0000","last_fullsized":"2024-03-30T13:12:04.148195+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631004+0000","last_change":"2024-03-30T13:12:05.195748+0000","last_active":"2024-03-30T13:12:07.631004+0000","last_peered":"2024-03-30T13:12:07.631004+0000","last_clean":"2024-03-30T13:12:07.631004+0000","last_became_active":"2024-03-30T13:12:05.194975+0000","last_became_peered":"2024-03-30T13:12:05.194975+0000","last_unstale":"2024-03-30T13:12:07.631004+0000","last_undegraded":"2024-03-30T13:12:07.631004+0000","last_fullsized":"2024-03-30T13:12:07.631004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:21:53.293558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184896+0000","last_change":"2024-03-30T13:12:05.197297+0000","last_active":"2024-03-30T13:12:07.184896+0000","last_peered":"2024-03-30T13:12:07.184896+0000","last_clean":"2024-03-30T13:12:07.184896+0000","last_became_active":"2024-03-30T13:12:05.196664+0000","last_became_peered":"2024-03-30T13:12:05.196664+0000","last_unstale":"2024-03-30T13:12:07.184896+0000","last_undegraded":"2024-03-30T13:12:07.184896+0000","last_fullsized":"2024-03-30T13:12:07.184896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198172+0000","last_change":"2024-03-30T13:12:05.200209+0000","last_active":"2024-03-30T13:12:06.198172+0000","last_peered":"2024-03-30T13:12:06.198172+0000","last_clean":"2024-03-30T13:12:06.198172+0000","last_became_active":"2024-03-30T13:12:05.193470+0000","last_became_peered":"2024-03-30T13:12:05.193470+0000","last_unstale":"2024-03-30T13:12:06.198172+0000","last_undegraded":"2024-03-30T13:12:06.198172+0000","last_fullsized":"2024-03-30T13:12:06.198172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:14:38.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.141050+0000","last_change":"2024-03-30T13:12:04.141050+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.141050+0000","last_undegraded":"2024-03-30T13:12:04.141050+0000","last_fullsized":"2024-03-30T13:12:04.141050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.135360+0000","last_change":"2024-03-30T13:12:04.135360+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.135360+0000","last_undegraded":"2024-03-30T13:12:04.135360+0000","last_fullsized":"2024-03-30T13:12:04.135360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.150523+0000","last_change":"2024-03-30T13:12:04.150523+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.150523+0000","last_undegraded":"2024-03-30T13:12:04.150523+0000","last_fullsized":"2024-03-30T13:12:04.150523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631308+0000","last_change":"2024-03-30T13:12:05.193985+0000","last_active":"2024-03-30T13:12:07.631308+0000","last_peered":"2024-03-30T13:12:07.631308+0000","last_clean":"2024-03-30T13:12:07.631308+0000","last_became_active":"2024-03-30T13:12:05.193520+0000","last_became_peered":"2024-03-30T13:12:05.193520+0000","last_unstale":"2024-03-30T13:12:07.631308+0000","last_undegraded":"2024-03-30T13:12:07.631308+0000","last_fullsized":"2024-03-30T13:12:07.631308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:11.335766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.153720+0000","last_change":"2024-03-30T13:12:04.153720+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.153720+0000","last_undegraded":"2024-03-30T13:12:04.153720+0000","last_fullsized":"2024-03-30T13:12:04.153720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.147400+0000","last_change":"2024-03-30T13:12:04.147400+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.147400+0000","last_undegraded":"2024-03-30T13:12:04.147400+0000","last_fullsized":"2024-03-30T13:12:04.147400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473411+0000","last_change":"2024-03-30T13:12:05.190953+0000","last_active":"2024-03-30T13:12:07.473411+0000","last_peered":"2024-03-30T13:12:07.473411+0000","last_clean":"2024-03-30T13:12:07.473411+0000","last_became_active":"2024-03-30T13:12:05.190117+0000","last_became_peered":"2024-03-30T13:12:05.190117+0000","last_unstale":"2024-03-30T13:12:07.473411+0000","last_undegraded":"2024-03-30T13:12:07.473411+0000","last_fullsized":"2024-03-30T13:12:07.473411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630995+0000","last_change":"2024-03-30T13:12:05.189430+0000","last_active":"2024-03-30T13:12:07.630995+0000","last_peered":"2024-03-30T13:12:07.630995+0000","last_clean":"2024-03-30T13:12:07.630995+0000","last_became_active":"2024-03-30T13:12:05.188612+0000","last_became_peered":"2024-03-30T13:12:05.188612+0000","last_unstale":"2024-03-30T13:12:07.630995+0000","last_undegraded":"2024-03-30T13:12:07.630995+0000","last_fullsized":"2024-03-30T13:12:07.630995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:35:26.826667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126085+0000","last_change":"2024-03-30T13:12:04.126085+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126085+0000","last_undegraded":"2024-03-30T13:12:04.126085+0000","last_fullsized":"2024-03-30T13:12:04.126085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126001+0000","last_change":"2024-03-30T13:12:04.126001+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126001+0000","last_undegraded":"2024-03-30T13:12:04.126001+0000","last_fullsized":"2024-03-30T13:12:04.126001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.150815+0000","last_change":"2024-03-30T13:12:04.150815+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.150815+0000","last_undegraded":"2024-03-30T13:12:04.150815+0000","last_fullsized":"2024-03-30T13:12:04.150815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198673+0000","last_change":"2024-03-30T13:12:05.202224+0000","last_active":"2024-03-30T13:12:06.198673+0000","last_peered":"2024-03-30T13:12:06.198673+0000","last_clean":"2024-03-30T13:12:06.198673+0000","last_became_active":"2024-03-30T13:12:05.201944+0000","last_became_peered":"2024-03-30T13:12:05.201944+0000","last_unstale":"2024-03-30T13:12:06.198673+0000","last_undegraded":"2024-03-30T13:12:06.198673+0000","last_fullsized":"2024-03-30T13:12:06.198673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:58.129468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198924+0000","last_change":"2024-03-30T13:12:05.194980+0000","last_active":"2024-03-30T13:12:06.198924+0000","last_peered":"2024-03-30T13:12:06.198924+0000","last_clean":"2024-03-30T13:12:06.198924+0000","last_became_active":"2024-03-30T13:12:05.194702+0000","last_became_peered":"2024-03-30T13:12:05.194702+0000","last_unstale":"2024-03-30T13:12:06.198924+0000","last_undegraded":"2024-03-30T13:12:06.198924+0000","last_fullsized":"2024-03-30T13:12:06.198924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:09.286734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472876+0000","last_change":"2024-03-30T13:12:05.189386+0000","last_active":"2024-03-30T13:12:07.472876+0000","last_peered":"2024-03-30T13:12:07.472876+0000","last_clean":"2024-03-30T13:12:07.472876+0000","last_became_active":"2024-03-30T13:12:05.189025+0000","last_became_peered":"2024-03-30T13:12:05.189025+0000","last_unstale":"2024-03-30T13:12:07.472876+0000","last_undegraded":"2024-03-30T13:12:07.472876+0000","last_fullsized":"2024-03-30T13:12:07.472876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126394+0000","last_change":"2024-03-30T13:12:04.126394+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126394+0000","last_undegraded":"2024-03-30T13:12:04.126394+0000","last_fullsized":"2024-03-30T13:12:04.126394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.135164+0000","last_change":"2024-03-30T13:12:04.135164+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.135164+0000","last_undegraded":"2024-03-30T13:12:04.135164+0000","last_fullsized":"2024-03-30T13:12:04.135164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472492+0000","last_change":"2024-03-30T13:12:05.196711+0000","last_active":"2024-03-30T13:12:07.472492+0000","last_peered":"2024-03-30T13:12:07.472492+0000","last_clean":"2024-03-30T13:12:07.472492+0000","last_became_active":"2024-03-30T13:12:05.196491+0000","last_became_peered":"2024-03-30T13:12:05.196491+0000","last_unstale":"2024-03-30T13:12:07.472492+0000","last_undegraded":"2024-03-30T13:12:07.472492+0000","last_fullsized":"2024-03-30T13:12:07.472492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:19:59.448920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.134707+0000","last_change":"2024-03-30T13:12:04.134707+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.134707+0000","last_undegraded":"2024-03-30T13:12:04.134707+0000","last_fullsized":"2024-03-30T13:12:04.134707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631777+0000","last_change":"2024-03-30T13:12:05.196765+0000","last_active":"2024-03-30T13:12:07.631777+0000","last_peered":"2024-03-30T13:12:07.631777+0000","last_clean":"2024-03-30T13:12:07.631777+0000","last_became_active":"2024-03-30T13:12:05.196494+0000","last_became_peered":"2024-03-30T13:12:05.196494+0000","last_unstale":"2024-03-30T13:12:07.631777+0000","last_undegraded":"2024-03-30T13:12:07.631777+0000","last_fullsized":"2024-03-30T13:12:07.631777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:04:04.845593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631641+0000","last_change":"2024-03-30T13:12:05.195759+0000","last_active":"2024-03-30T13:12:07.631641+0000","last_peered":"2024-03-30T13:12:07.631641+0000","last_clean":"2024-03-30T13:12:07.631641+0000","last_became_active":"2024-03-30T13:12:05.194287+0000","last_became_peered":"2024-03-30T13:12:05.194287+0000","last_unstale":"2024-03-30T13:12:07.631641+0000","last_undegraded":"2024-03-30T13:12:07.631641+0000","last_fullsized":"2024-03-30T13:12:07.631641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:42.770626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184547+0000","last_change":"2024-03-30T13:12:05.193501+0000","last_active":"2024-03-30T13:12:07.184547+0000","last_peered":"2024-03-30T13:12:07.184547+0000","last_clean":"2024-03-30T13:12:07.184547+0000","last_became_active":"2024-03-30T13:12:05.193217+0000","last_became_peered":"2024-03-30T13:12:05.193217+0000","last_unstale":"2024-03-30T13:12:07.184547+0000","last_undegraded":"2024-03-30T13:12:07.184547+0000","last_fullsized":"2024-03-30T13:12:07.184547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.140189+0000","last_change":"2024-03-30T13:12:04.140189+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.140189+0000","last_undegraded":"2024-03-30T13:12:04.140189+0000","last_fullsized":"2024-03-30T13:12:04.140189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.127572+0000","last_change":"2024-03-30T13:12:04.127572+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.127572+0000","last_undegraded":"2024-03-30T13:12:04.127572+0000","last_fullsized":"2024-03-30T13:12:04.127572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.127523+0000","last_change":"2024-03-30T13:12:04.127523+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.127523+0000","last_undegraded":"2024-03-30T13:12:04.127523+0000","last_fullsized":"2024-03-30T13:12:04.127523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.136357+0000","last_change":"2024-03-30T13:12:04.136357+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.136357+0000","last_undegraded":"2024-03-30T13:12:04.136357+0000","last_fullsized":"2024-03-30T13:12:04.136357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.147562+0000","last_change":"2024-03-30T13:12:04.147562+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.147562+0000","last_undegraded":"2024-03-30T13:12:04.147562+0000","last_fullsized":"2024-03-30T13:12:04.147562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473000+0000","last_change":"2024-03-30T13:12:05.203814+0000","last_active":"2024-03-30T13:12:07.473000+0000","last_peered":"2024-03-30T13:12:07.473000+0000","last_clean":"2024-03-30T13:12:07.473000+0000","last_became_active":"2024-03-30T13:12:05.203408+0000","last_became_peered":"2024-03-30T13:12:05.203408+0000","last_unstale":"2024-03-30T13:12:07.473000+0000","last_undegraded":"2024-03-30T13:12:07.473000+0000","last_fullsized":"2024-03-30T13:12:07.473000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.163919+0000","last_change":"2024-03-30T13:12:04.161934+0000","last_active":"2024-03-30T13:12:04.163919+0000","last_peered":"2024-03-30T13:12:04.163919+0000","last_clean":"2024-03-30T13:12:04.163919+0000","last_became_active":"2024-03-30T13:12:04.161721+0000","last_became_peered":"2024-03-30T13:12:04.161721+0000","last_unstale":"2024-03-30T13:12:04.163919+0000","last_undegraded":"2024-03-30T13:12:04.163919+0000","last_fullsized":"2024-03-30T13:12:04.163919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:59.135017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.133498+0000","last_change":"2024-03-30T13:12:04.133498+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.133498+0000","last_undegraded":"2024-03-30T13:12:04.133498+0000","last_fullsized":"2024-03-30T13:12:04.133498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631425+0000","last_change":"2024-03-30T13:12:04.156757+0000","last_active":"2024-03-30T13:12:07.631425+0000","last_peered":"2024-03-30T13:12:07.631425+0000","last_clean":"2024-03-30T13:12:07.631425+0000","last_became_active":"2024-03-30T13:12:04.156049+0000","last_became_peered":"2024-03-30T13:12:04.156049+0000","last_unstale":"2024-03-30T13:12:07.631425+0000","last_undegraded":"2024-03-30T13:12:07.631425+0000","last_fullsized":"2024-03-30T13:12:07.631425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:54.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.139641+0000","last_change":"2024-03-30T13:12:04.139641+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.139641+0000","last_undegraded":"2024-03-30T13:12:04.139641+0000","last_fullsized":"2024-03-30T13:12:04.139641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199295+0000","last_change":"2024-03-30T13:12:04.160804+0000","last_active":"2024-03-30T13:12:06.199295+0000","last_peered":"2024-03-30T13:12:06.199295+0000","last_clean":"2024-03-30T13:12:06.199295+0000","last_became_active":"2024-03-30T13:12:04.160592+0000","last_became_peered":"2024-03-30T13:12:04.160592+0000","last_unstale":"2024-03-30T13:12:06.199295+0000","last_undegraded":"2024-03-30T13:12:06.199295+0000","last_fullsized":"2024-03-30T13:12:06.199295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:48.643179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631257+0000","last_change":"2024-03-30T13:12:05.198359+0000","last_active":"2024-03-30T13:12:07.631257+0000","last_peered":"2024-03-30T13:12:07.631257+0000","last_clean":"2024-03-30T13:12:07.631257+0000","last_became_active":"2024-03-30T13:12:05.197998+0000","last_became_peered":"2024-03-30T13:12:05.197998+0000","last_unstale":"2024-03-30T13:12:07.631257+0000","last_undegraded":"2024-03-30T13:12:07.631257+0000","last_fullsized":"2024-03-30T13:12:07.631257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:38.341209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631575+0000","last_change":"2024-03-30T13:12:04.160626+0000","last_active":"2024-03-30T13:12:07.631575+0000","last_peered":"2024-03-30T13:12:07.631575+0000","last_clean":"2024-03-30T13:12:07.631575+0000","last_became_active":"2024-03-30T13:12:04.160357+0000","last_became_peered":"2024-03-30T13:12:04.160357+0000","last_unstale":"2024-03-30T13:12:07.631575+0000","last_undegraded":"2024-03-30T13:12:07.631575+0000","last_fullsized":"2024-03-30T13:12:07.631575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:06:07.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.146171+0000","last_change":"2024-03-30T13:12:04.146171+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.146171+0000","last_undegraded":"2024-03-30T13:12:04.146171+0000","last_fullsized":"2024-03-30T13:12:04.146171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.155450+0000","last_change":"2024-03-30T13:12:04.150040+0000","last_active":"2024-03-30T13:12:04.155450+0000","last_peered":"2024-03-30T13:12:04.155450+0000","last_clean":"2024-03-30T13:12:04.155450+0000","last_became_active":"2024-03-30T13:12:04.149747+0000","last_became_peered":"2024-03-30T13:12:04.149747+0000","last_unstale":"2024-03-30T13:12:04.155450+0000","last_undegraded":"2024-03-30T13:12:04.155450+0000","last_fullsized":"2024-03-30T13:12:04.155450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:39:14.217210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.137242+0000","last_change":"2024-03-30T13:12:04.137242+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.137242+0000","last_undegraded":"2024-03-30T13:12:04.137242+0000","last_fullsized":"2024-03-30T13:12:04.137242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.154437+0000","last_change":"2024-03-30T13:12:04.149618+0000","last_active":"2024-03-30T13:12:04.154437+0000","last_peered":"2024-03-30T13:12:04.154437+0000","last_clean":"2024-03-30T13:12:04.154437+0000","last_became_active":"2024-03-30T13:12:04.149252+0000","last_became_peered":"2024-03-30T13:12:04.149252+0000","last_unstale":"2024-03-30T13:12:04.154437+0000","last_undegraded":"2024-03-30T13:12:04.154437+0000","last_fullsized":"2024-03-30T13:12:04.154437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:28.166977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.141830+0000","last_change":"2024-03-30T13:12:04.141830+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.141830+0000","last_undegraded":"2024-03-30T13:12:04.141830+0000","last_fullsized":"2024-03-30T13:12:04.141830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198401+0000","last_change":"2024-03-30T13:12:04.157894+0000","last_active":"2024-03-30T13:12:06.198401+0000","last_peered":"2024-03-30T13:12:06.198401+0000","last_clean":"2024-03-30T13:12:06.198401+0000","last_became_active":"2024-03-30T13:12:04.157491+0000","last_became_peered":"2024-03-30T13:12:04.157491+0000","last_unstale":"2024-03-30T13:12:06.198401+0000","last_undegraded":"2024-03-30T13:12:06.198401+0000","last_fullsized":"2024-03-30T13:12:06.198401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:34:25.438955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630535+0000","last_change":"2024-03-30T13:12:05.199546+0000","last_active":"2024-03-30T13:12:07.630535+0000","last_peered":"2024-03-30T13:12:07.630535+0000","last_clean":"2024-03-30T13:12:07.630535+0000","last_became_active":"2024-03-30T13:12:05.199239+0000","last_became_peered":"2024-03-30T13:12:05.199239+0000","last_unstale":"2024-03-30T13:12:07.630535+0000","last_undegraded":"2024-03-30T13:12:07.630535+0000","last_fullsized":"2024-03-30T13:12:07.630535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:28.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.159716+0000","last_change":"2024-03-30T13:12:04.155737+0000","last_active":"2024-03-30T13:12:04.159716+0000","last_peered":"2024-03-30T13:12:04.159716+0000","last_clean":"2024-03-30T13:12:04.159716+0000","last_became_active":"2024-03-30T13:12:04.155473+0000","last_became_peered":"2024-03-30T13:12:04.155473+0000","last_unstale":"2024-03-30T13:12:04.159716+0000","last_undegraded":"2024-03-30T13:12:04.159716+0000","last_fullsized":"2024-03-30T13:12:04.159716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:07:16.905846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.144841+0000","last_change":"2024-03-30T13:12:04.144841+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.144841+0000","last_undegraded":"2024-03-30T13:12:04.144841+0000","last_fullsized":"2024-03-30T13:12:04.144841+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184977+0000","last_change":"2024-03-30T13:12:04.152194+0000","last_active":"2024-03-30T13:12:07.184977+0000","last_peered":"2024-03-30T13:12:07.184977+0000","last_clean":"2024-03-30T13:12:07.184977+0000","last_became_active":"2024-03-30T13:12:04.151844+0000","last_became_peered":"2024-03-30T13:12:04.151844+0000","last_unstale":"2024-03-30T13:12:07.184977+0000","last_undegraded":"2024-03-30T13:12:07.184977+0000","last_fullsized":"2024-03-30T13:12:07.184977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.632067+0000","last_change":"2024-03-30T13:12:05.191219+0000","last_active":"2024-03-30T13:12:07.632067+0000","last_peered":"2024-03-30T13:12:07.632067+0000","last_clean":"2024-03-30T13:12:07.632067+0000","last_became_active":"2024-03-30T13:12:05.187503+0000","last_became_peered":"2024-03-30T13:12:05.187503+0000","last_unstale":"2024-03-30T13:12:07.632067+0000","last_undegraded":"2024-03-30T13:12:07.632067+0000","last_fullsized":"2024-03-30T13:12:07.632067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:34:30.445284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184510+0000","last_change":"2024-03-30T13:12:04.151674+0000","last_active":"2024-03-30T13:12:07.184510+0000","last_peered":"2024-03-30T13:12:07.184510+0000","last_clean":"2024-03-30T13:12:07.184510+0000","last_became_active":"2024-03-30T13:12:04.151273+0000","last_became_peered":"2024-03-30T13:12:04.151273+0000","last_unstale":"2024-03-30T13:12:07.184510+0000","last_undegraded":"2024-03-30T13:12:07.184510+0000","last_fullsized":"2024-03-30T13:12:07.184510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:35:19.563529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631362+0000","last_change":"2024-03-30T13:12:05.195768+0000","last_active":"2024-03-30T13:12:07.631362+0000","last_peered":"2024-03-30T13:12:07.631362+0000","last_clean":"2024-03-30T13:12:07.631362+0000","last_became_active":"2024-03-30T13:12:05.190015+0000","last_became_peered":"2024-03-30T13:12:05.190015+0000","last_unstale":"2024-03-30T13:12:07.631362+0000","last_undegraded":"2024-03-30T13:12:07.631362+0000","last_fullsized":"2024-03-30T13:12:07.631362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:45:05.346910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.161184+0000","last_change":"2024-03-30T13:12:04.158663+0000","last_active":"2024-03-30T13:12:04.161184+0000","last_peered":"2024-03-30T13:12:04.161184+0000","last_clean":"2024-03-30T13:12:04.161184+0000","last_became_active":"2024-03-30T13:12:04.154124+0000","last_became_peered":"2024-03-30T13:12:04.154124+0000","last_unstale":"2024-03-30T13:12:04.161184+0000","last_undegraded":"2024-03-30T13:12:04.161184+0000","last_fullsized":"2024-03-30T13:12:04.161184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:19:58.443719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.144722+0000","last_change":"2024-03-30T13:12:04.144722+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.144722+0000","last_undegraded":"2024-03-30T13:12:04.144722+0000","last_fullsized":"2024-03-30T13:12:04.144722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472817+0000","last_change":"2024-03-30T13:12:04.157305+0000","last_active":"2024-03-30T13:12:07.472817+0000","last_peered":"2024-03-30T13:12:07.472817+0000","last_clean":"2024-03-30T13:12:07.472817+0000","last_became_active":"2024-03-30T13:12:04.156997+0000","last_became_peered":"2024-03-30T13:12:04.156997+0000","last_unstale":"2024-03-30T13:12:07.472817+0000","last_undegraded":"2024-03-30T13:12:07.472817+0000","last_fullsized":"2024-03-30T13:12:07.472817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:01.032056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472534+0000","last_change":"2024-03-30T13:12:05.195191+0000","last_active":"2024-03-30T13:12:07.472534+0000","last_peered":"2024-03-30T13:12:07.472534+0000","last_clean":"2024-03-30T13:12:07.472534+0000","last_became_active":"2024-03-30T13:12:05.194888+0000","last_became_peered":"2024-03-30T13:12:05.194888+0000","last_unstale":"2024-03-30T13:12:07.472534+0000","last_undegraded":"2024-03-30T13:12:07.472534+0000","last_fullsized":"2024-03-30T13:12:07.472534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.164717+0000","last_change":"2024-03-30T13:12:04.160490+0000","last_active":"2024-03-30T13:12:04.164717+0000","last_peered":"2024-03-30T13:12:04.164717+0000","last_clean":"2024-03-30T13:12:04.164717+0000","last_became_active":"2024-03-30T13:12:04.160169+0000","last_became_peered":"2024-03-30T13:12:04.160169+0000","last_unstale":"2024-03-30T13:12:04.164717+0000","last_undegraded":"2024-03-30T13:12:04.164717+0000","last_fullsized":"2024-03-30T13:12:04.164717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:14.622222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631210+0000","last_change":"2024-03-30T13:12:05.201558+0000","last_active":"2024-03-30T13:12:07.631210+0000","last_peered":"2024-03-30T13:12:07.631210+0000","last_clean":"2024-03-30T13:12:07.631210+0000","last_became_active":"2024-03-30T13:12:05.198153+0000","last_became_peered":"2024-03-30T13:12:05.198153+0000","last_unstale":"2024-03-30T13:12:07.631210+0000","last_undegraded":"2024-03-30T13:12:07.631210+0000","last_fullsized":"2024-03-30T13:12:07.631210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:05:21.340816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631182+0000","last_change":"2024-03-30T13:12:04.159693+0000","last_active":"2024-03-30T13:12:07.631182+0000","last_peered":"2024-03-30T13:12:07.631182+0000","last_clean":"2024-03-30T13:12:07.631182+0000","last_became_active":"2024-03-30T13:12:04.159246+0000","last_became_peered":"2024-03-30T13:12:04.159246+0000","last_unstale":"2024-03-30T13:12:07.631182+0000","last_undegraded":"2024-03-30T13:12:07.631182+0000","last_fullsized":"2024-03-30T13:12:07.631182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:30.867699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.133960+0000","last_change":"2024-03-30T13:12:04.133960+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.133960+0000","last_undegraded":"2024-03-30T13:12:04.133960+0000","last_fullsized":"2024-03-30T13:12:04.133960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630232+0000","last_change":"2024-03-30T13:12:04.152863+0000","last_active":"2024-03-30T13:12:07.630232+0000","last_peered":"2024-03-30T13:12:07.630232+0000","last_clean":"2024-03-30T13:12:07.630232+0000","last_became_active":"2024-03-30T13:12:04.152533+0000","last_became_peered":"2024-03-30T13:12:04.152533+0000","last_unstale":"2024-03-30T13:12:07.630232+0000","last_undegraded":"2024-03-30T13:12:07.630232+0000","last_fullsized":"2024-03-30T13:12:07.630232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:01.032056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.146900+0000","last_change":"2024-03-30T13:12:04.146900+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.146900+0000","last_undegraded":"2024-03-30T13:12:04.146900+0000","last_fullsized":"2024-03-30T13:12:04.146900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198210+0000","last_change":"2024-03-30T13:12:04.158169+0000","last_active":"2024-03-30T13:12:06.198210+0000","last_peered":"2024-03-30T13:12:06.198210+0000","last_clean":"2024-03-30T13:12:06.198210+0000","last_became_active":"2024-03-30T13:12:04.157877+0000","last_became_peered":"2024-03-30T13:12:04.157877+0000","last_unstale":"2024-03-30T13:12:06.198210+0000","last_undegraded":"2024-03-30T13:12:06.198210+0000","last_fullsized":"2024-03-30T13:12:06.198210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:21:40.866398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.142745+0000","last_change":"2024-03-30T13:12:04.142745+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.142745+0000","last_undegraded":"2024-03-30T13:12:04.142745+0000","last_fullsized":"2024-03-30T13:12:04.142745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199102+0000","last_change":"2024-03-30T13:12:04.160389+0000","last_active":"2024-03-30T13:12:06.199102+0000","last_peered":"2024-03-30T13:12:06.199102+0000","last_clean":"2024-03-30T13:12:06.199102+0000","last_became_active":"2024-03-30T13:12:04.158808+0000","last_became_peered":"2024-03-30T13:12:04.158808+0000","last_unstale":"2024-03-30T13:12:06.199102+0000","last_undegraded":"2024-03-30T13:12:06.199102+0000","last_fullsized":"2024-03-30T13:12:06.199102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:21.807992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.148847+0000","last_change":"2024-03-30T13:12:04.148847+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.148847+0000","last_undegraded":"2024-03-30T13:12:04.148847+0000","last_fullsized":"2024-03-30T13:12:04.148847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.164720+0000","last_change":"2024-03-30T13:12:04.160282+0000","last_active":"2024-03-30T13:12:04.164720+0000","last_peered":"2024-03-30T13:12:04.164720+0000","last_clean":"2024-03-30T13:12:04.164720+0000","last_became_active":"2024-03-30T13:12:04.159950+0000","last_became_peered":"2024-03-30T13:12:04.159950+0000","last_unstale":"2024-03-30T13:12:04.164720+0000","last_undegraded":"2024-03-30T13:12:04.164720+0000","last_fullsized":"2024-03-30T13:12:04.164720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:27.651002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184613+0000","last_change":"2024-03-30T13:12:05.195404+0000","last_active":"2024-03-30T13:12:07.184613+0000","last_peered":"2024-03-30T13:12:07.184613+0000","last_clean":"2024-03-30T13:12:07.184613+0000","last_became_active":"2024-03-30T13:12:05.195140+0000","last_became_peered":"2024-03-30T13:12:05.195140+0000","last_unstale":"2024-03-30T13:12:07.184613+0000","last_undegraded":"2024-03-30T13:12:07.184613+0000","last_fullsized":"2024-03-30T13:12:07.184613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.166114+0000","last_change":"2024-03-30T13:12:04.164305+0000","last_active":"2024-03-30T13:12:04.166114+0000","last_peered":"2024-03-30T13:12:04.166114+0000","last_clean":"2024-03-30T13:12:04.166114+0000","last_became_active":"2024-03-30T13:12:04.163883+0000","last_became_peered":"2024-03-30T13:12:04.163883+0000","last_unstale":"2024-03-30T13:12:04.166114+0000","last_undegraded":"2024-03-30T13:12:04.166114+0000","last_fullsized":"2024-03-30T13:12:04.166114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:47.459513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198949+0000","last_change":"2024-03-30T13:12:05.203694+0000","last_active":"2024-03-30T13:12:06.198949+0000","last_peered":"2024-03-30T13:12:06.198949+0000","last_clean":"2024-03-30T13:12:06.198949+0000","last_became_active":"2024-03-30T13:12:05.203389+0000","last_became_peered":"2024-03-30T13:12:05.203389+0000","last_unstale":"2024-03-30T13:12:06.198949+0000","last_undegraded":"2024-03-30T13:12:06.198949+0000","last_fullsized":"2024-03-30T13:12:06.198949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:07.797910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.158821+0000","last_change":"2024-03-30T13:12:04.156484+0000","last_active":"2024-03-30T13:12:04.158821+0000","last_peered":"2024-03-30T13:12:04.158821+0000","last_clean":"2024-03-30T13:12:04.158821+0000","last_became_active":"2024-03-30T13:12:04.156142+0000","last_became_peered":"2024-03-30T13:12:04.156142+0000","last_unstale":"2024-03-30T13:12:04.158821+0000","last_undegraded":"2024-03-30T13:12:04.158821+0000","last_fullsized":"2024-03-30T13:12:04.158821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472751+0000","last_change":"2024-03-30T13:12:05.189181+0000","last_active":"2024-03-30T13:12:07.472751+0000","last_peered":"2024-03-30T13:12:07.472751+0000","last_clean":"2024-03-30T13:12:07.472751+0000","last_became_active":"2024-03-30T13:12:05.188836+0000","last_became_peered":"2024-03-30T13:12:05.188836+0000","last_unstale":"2024-03-30T13:12:07.472751+0000","last_undegraded":"2024-03-30T13:12:07.472751+0000","last_fullsized":"2024-03-30T13:12:07.472751+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184602+0000","last_change":"2024-03-30T13:12:04.160445+0000","last_active":"2024-03-30T13:12:07.184602+0000","last_peered":"2024-03-30T13:12:07.184602+0000","last_clean":"2024-03-30T13:12:07.184602+0000","last_became_active":"2024-03-30T13:12:04.159088+0000","last_became_peered":"2024-03-30T13:12:04.159088+0000","last_unstale":"2024-03-30T13:12:07.184602+0000","last_undegraded":"2024-03-30T13:12:07.184602+0000","last_fullsized":"2024-03-30T13:12:07.184602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:18.892572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184485+0000","last_change":"2024-03-30T13:12:05.206205+0000","last_active":"2024-03-30T13:12:07.184485+0000","last_peered":"2024-03-30T13:12:07.184485+0000","last_clean":"2024-03-30T13:12:07.184485+0000","last_became_active":"2024-03-30T13:12:05.205165+0000","last_became_peered":"2024-03-30T13:12:05.205165+0000","last_unstale":"2024-03-30T13:12:07.184485+0000","last_undegraded":"2024-03-30T13:12:07.184485+0000","last_fullsized":"2024-03-30T13:12:07.184485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.164762+0000","last_change":"2024-03-30T13:12:04.160477+0000","last_active":"2024-03-30T13:12:04.164762+0000","last_peered":"2024-03-30T13:12:04.164762+0000","last_clean":"2024-03-30T13:12:04.164762+0000","last_became_active":"2024-03-30T13:12:04.159861+0000","last_became_peered":"2024-03-30T13:12:04.159861+0000","last_unstale":"2024-03-30T13:12:04.164762+0000","last_undegraded":"2024-03-30T13:12:04.164762+0000","last_fullsized":"2024-03-30T13:12:04.164762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:34:22.185576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472282+0000","last_change":"2024-03-30T13:12:05.188342+0000","last_active":"2024-03-30T13:12:07.472282+0000","last_peered":"2024-03-30T13:12:07.472282+0000","last_clean":"2024-03-30T13:12:07.472282+0000","last_became_active":"2024-03-30T13:12:05.187979+0000","last_became_peered":"2024-03-30T13:12:05.187979+0000","last_unstale":"2024-03-30T13:12:07.472282+0000","last_undegraded":"2024-03-30T13:12:07.472282+0000","last_fullsized":"2024-03-30T13:12:07.472282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:21:11.680054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.158265+0000","last_change":"2024-03-30T13:12:04.153187+0000","last_active":"2024-03-30T13:12:04.158265+0000","last_peered":"2024-03-30T13:12:04.158265+0000","last_clean":"2024-03-30T13:12:04.158265+0000","last_became_active":"2024-03-30T13:12:04.151861+0000","last_became_peered":"2024-03-30T13:12:04.151861+0000","last_unstale":"2024-03-30T13:12:04.158265+0000","last_undegraded":"2024-03-30T13:12:04.158265+0000","last_fullsized":"2024-03-30T13:12:04.158265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:51.432156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.143872+0000","last_change":"2024-03-30T13:12:04.143872+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.143872+0000","last_undegraded":"2024-03-30T13:12:04.143872+0000","last_fullsized":"2024-03-30T13:12:04.143872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.166308+0000","last_change":"2024-03-30T13:12:04.163783+0000","last_active":"2024-03-30T13:12:04.166308+0000","last_peered":"2024-03-30T13:12:04.166308+0000","last_clean":"2024-03-30T13:12:04.166308+0000","last_became_active":"2024-03-30T13:12:04.163480+0000","last_became_peered":"2024-03-30T13:12:04.163480+0000","last_unstale":"2024-03-30T13:12:04.166308+0000","last_undegraded":"2024-03-30T13:12:04.166308+0000","last_fullsized":"2024-03-30T13:12:04.166308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:23.927066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199312+0000","last_change":"2024-03-30T13:12:05.201073+0000","last_active":"2024-03-30T13:12:06.199312+0000","last_peered":"2024-03-30T13:12:06.199312+0000","last_clean":"2024-03-30T13:12:06.199312+0000","last_became_active":"2024-03-30T13:12:05.197377+0000","last_became_peered":"2024-03-30T13:12:05.197377+0000","last_unstale":"2024-03-30T13:12:06.199312+0000","last_undegraded":"2024-03-30T13:12:06.199312+0000","last_fullsized":"2024-03-30T13:12:06.199312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:09.490280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472403+0000","last_change":"2024-03-30T13:12:04.138835+0000","last_active":"2024-03-30T13:12:07.472403+0000","last_peered":"2024-03-30T13:12:07.472403+0000","last_clean":"2024-03-30T13:12:07.472403+0000","last_became_active":"2024-03-30T13:12:04.138108+0000","last_became_peered":"2024-03-30T13:12:04.138108+0000","last_unstale":"2024-03-30T13:12:07.472403+0000","last_undegraded":"2024-03-30T13:12:07.472403+0000","last_fullsized":"2024-03-30T13:12:07.472403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:54.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.139844+0000","last_change":"2024-03-30T13:12:04.139844+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.139844+0000","last_undegraded":"2024-03-30T13:12:04.139844+0000","last_fullsized":"2024-03-30T13:12:04.139844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184886+0000","last_change":"2024-03-30T13:12:04.151193+0000","last_active":"2024-03-30T13:12:07.184886+0000","last_peered":"2024-03-30T13:12:07.184886+0000","last_clean":"2024-03-30T13:12:07.184886+0000","last_became_active":"2024-03-30T13:12:04.150870+0000","last_became_peered":"2024-03-30T13:12:04.150870+0000","last_unstale":"2024-03-30T13:12:07.184886+0000","last_undegraded":"2024-03-30T13:12:07.184886+0000","last_fullsized":"2024-03-30T13:12:07.184886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:10:39.110454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199433+0000","last_change":"2024-03-30T13:12:05.195497+0000","last_active":"2024-03-30T13:12:06.199433+0000","last_peered":"2024-03-30T13:12:06.199433+0000","last_clean":"2024-03-30T13:12:06.199433+0000","last_became_active":"2024-03-30T13:12:05.194357+0000","last_became_peered":"2024-03-30T13:12:05.194357+0000","last_unstale":"2024-03-30T13:12:06.199433+0000","last_undegraded":"2024-03-30T13:12:06.199433+0000","last_fullsized":"2024-03-30T13:12:06.199433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:27:20.267950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472991+0000","last_change":"2024-03-30T13:12:04.156791+0000","last_active":"2024-03-30T13:12:07.472991+0000","last_peered":"2024-03-30T13:12:07.472991+0000","last_clean":"2024-03-30T13:12:07.472991+0000","last_became_active":"2024-03-30T13:12:04.155722+0000","last_became_peered":"2024-03-30T13:12:04.155722+0000","last_unstale":"2024-03-30T13:12:07.472991+0000","last_undegraded":"2024-03-30T13:12:07.472991+0000","last_fullsized":"2024-03-30T13:12:07.472991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:06:07.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126417+0000","last_change":"2024-03-30T13:12:04.126417+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126417+0000","last_undegraded":"2024-03-30T13:12:04.126417+0000","last_fullsized":"2024-03-30T13:12:04.126417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473356+0000","last_change":"2024-03-30T13:12:04.145008+0000","last_active":"2024-03-30T13:12:07.473356+0000","last_peered":"2024-03-30T13:12:07.473356+0000","last_clean":"2024-03-30T13:12:07.473356+0000","last_became_active":"2024-03-30T13:12:04.144537+0000","last_became_peered":"2024-03-30T13:12:04.144537+0000","last_unstale":"2024-03-30T13:12:07.473356+0000","last_undegraded":"2024-03-30T13:12:07.473356+0000","last_fullsized":"2024-03-30T13:12:07.473356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:30.328150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631725+0000","last_change":"2024-03-30T13:12:05.198424+0000","last_active":"2024-03-30T13:12:07.631725+0000","last_peered":"2024-03-30T13:12:07.631725+0000","last_clean":"2024-03-30T13:12:07.631725+0000","last_became_active":"2024-03-30T13:12:05.197807+0000","last_became_peered":"2024-03-30T13:12:05.197807+0000","last_unstale":"2024-03-30T13:12:07.631725+0000","last_undegraded":"2024-03-30T13:12:07.631725+0000","last_fullsized":"2024-03-30T13:12:07.631725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:02.120513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472673+0000","last_change":"2024-03-30T13:12:04.156286+0000","last_active":"2024-03-30T13:12:07.472673+0000","last_peered":"2024-03-30T13:12:07.472673+0000","last_clean":"2024-03-30T13:12:07.472673+0000","last_became_active":"2024-03-30T13:12:04.155947+0000","last_became_peered":"2024-03-30T13:12:04.155947+0000","last_unstale":"2024-03-30T13:12:07.472673+0000","last_undegraded":"2024-03-30T13:12:07.472673+0000","last_fullsized":"2024-03-30T13:12:07.472673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:47:50.782317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630786+0000","last_change":"2024-03-30T13:12:05.193970+0000","last_active":"2024-03-30T13:12:07.630786+0000","last_peered":"2024-03-30T13:12:07.630786+0000","last_clean":"2024-03-30T13:12:07.630786+0000","last_became_active":"2024-03-30T13:12:05.193676+0000","last_became_peered":"2024-03-30T13:12:05.193676+0000","last_unstale":"2024-03-30T13:12:07.630786+0000","last_undegraded":"2024-03-30T13:12:07.630786+0000","last_fullsized":"2024-03-30T13:12:07.630786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:02.262900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.163158+0000","last_change":"2024-03-30T13:12:04.159232+0000","last_active":"2024-03-30T13:12:04.163158+0000","last_peered":"2024-03-30T13:12:04.163158+0000","last_clean":"2024-03-30T13:12:04.163158+0000","last_became_active":"2024-03-30T13:12:04.158956+0000","last_became_peered":"2024-03-30T13:12:04.158956+0000","last_unstale":"2024-03-30T13:12:04.163158+0000","last_undegraded":"2024-03-30T13:12:04.163158+0000","last_fullsized":"2024-03-30T13:12:04.163158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:43:39.942742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.138564+0000","last_change":"2024-03-30T13:12:04.138564+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.138564+0000","last_undegraded":"2024-03-30T13:12:04.138564+0000","last_fullsized":"2024-03-30T13:12:04.138564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630473+0000","last_change":"2024-03-30T13:12:04.156959+0000","last_active":"2024-03-30T13:12:07.630473+0000","last_peered":"2024-03-30T13:12:07.630473+0000","last_clean":"2024-03-30T13:12:07.630473+0000","last_became_active":"2024-03-30T13:12:04.156016+0000","last_became_peered":"2024-03-30T13:12:04.156016+0000","last_unstale":"2024-03-30T13:12:07.630473+0000","last_undegraded":"2024-03-30T13:12:07.630473+0000","last_fullsized":"2024-03-30T13:12:07.630473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126023+0000","last_change":"2024-03-30T13:12:04.126023+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126023+0000","last_undegraded":"2024-03-30T13:12:04.126023+0000","last_fullsized":"2024-03-30T13:12:04.126023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.166095+0000","last_change":"2024-03-30T13:12:04.164087+0000","last_active":"2024-03-30T13:12:04.166095+0000","last_peered":"2024-03-30T13:12:04.166095+0000","last_clean":"2024-03-30T13:12:04.166095+0000","last_became_active":"2024-03-30T13:12:04.163450+0000","last_became_peered":"2024-03-30T13:12:04.163450+0000","last_unstale":"2024-03-30T13:12:04.166095+0000","last_undegraded":"2024-03-30T13:12:04.166095+0000","last_fullsized":"2024-03-30T13:12:04.166095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:16.635465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.145335+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:12:04.145335+0000","last_peered":"2024-03-30T13:12:04.145335+0000","last_clean":"2024-03-30T13:12:04.145335+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:12:04.145335+0000","last_undegraded":"2024-03-30T13:12:04.145335+0000","last_fullsized":"2024-03-30T13:12:04.145335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476757,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":137277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476757,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":721370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":151964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":741302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":151986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":150374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:12:09.598 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:12:09.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.834+0000 7f90bb000640 1 Processor -- start 2024-03-30T13:12:09.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.834+0000 7f90bb000640 1 -- start start 2024-03-30T13:12:09.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.835+0000 7f90bb000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90b4161e00 0x7f90b406e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.835+0000 7f90bb000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f90b406d930 0x7f90b40718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.835+0000 7f90bb000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f90b4071e10 0x7f90b40b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.835+0000 7f90bb000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f90b4072280 con 0x7f90b4071e10 2024-03-30T13:12:09.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.835+0000 7f90bb000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f90b41621e0 con 0x7f90b406d930 2024-03-30T13:12:09.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.835+0000 7f90bb000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f90b406eee0 con 0x7f90b4161e00 2024-03-30T13:12:09.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.835+0000 7f90b9000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f90b4071e10 0x7f90b40b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.836+0000 7f90b9000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f90b4071e10 0x7f90b40b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42396/0 (socket says 172.21.15.99:42396) 2024-03-30T13:12:09.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.836+0000 7f90b9000640 1 -- 172.21.15.99:0/526330681 learned_addr learned my addr 172.21.15.99:0/526330681 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:09.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.836+0000 7f90ab400640 1 --2- 172.21.15.99:0/526330681 >> v2:172.21.15.181:3300/0 conn(0x7f90b406d930 0x7f90b40718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.836+0000 7f90b3e00640 1 --2- 172.21.15.99:0/526330681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90b4161e00 0x7f90b406e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.836+0000 7f90b9000640 1 -- 172.21.15.99:0/526330681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90b4161e00 msgr2=0x7f90b406e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:09.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.836+0000 7f90b9000640 1 --2- 172.21.15.99:0/526330681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90b4161e00 0x7f90b406e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.836+0000 7f90b9000640 1 -- 172.21.15.99:0/526330681 >> v2:172.21.15.181:3300/0 conn(0x7f90b406d930 msgr2=0x7f90b40718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:09.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.836+0000 7f90b9000640 1 --2- 172.21.15.99:0/526330681 >> v2:172.21.15.181:3300/0 conn(0x7f90b406d930 0x7f90b40718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.836+0000 7f90b9000640 1 -- 172.21.15.99:0/526330681 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b406f1c0 con 0x7f90b4071e10 2024-03-30T13:12:09.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.837+0000 7f90b9000640 1 --2- 172.21.15.99:0/526330681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90b4071e10 0x7f90b40b38d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f90b40b3080 tx=0x7f90ac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a739a86cd89a70 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:09.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.837+0000 7f90b3400640 1 -- 172.21.15.99:0/526330681 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac02ca70 con 0x7f90b4071e10 2024-03-30T13:12:09.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.837+0000 7f90b3400640 1 -- 172.21.15.99:0/526330681 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90ac02cc10 con 0x7f90b4071e10 2024-03-30T13:12:09.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.837+0000 7f90b3400640 1 -- 172.21.15.99:0/526330681 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac0343f0 con 0x7f90b4071e10 2024-03-30T13:12:09.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.838+0000 7f90bb000640 1 -- 172.21.15.99:0/526330681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90b4071e10 msgr2=0x7f90b40b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.838+0000 7f90bb000640 1 --2- 172.21.15.99:0/526330681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90b4071e10 0x7f90b40b38d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f90b40b3080 tx=0x7f90ac02bed0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.838+0000 7f90bb000640 1 -- 172.21.15.99:0/526330681 shutdown_connections 2024-03-30T13:12:09.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.838+0000 7f90bb000640 1 --2- 172.21.15.99:0/526330681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90b4071e10 0x7f90b40b38d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.838+0000 7f90bb000640 1 --2- 172.21.15.99:0/526330681 >> v2:172.21.15.181:3300/0 conn(0x7f90b406d930 0x7f90b40718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.838+0000 7f90bb000640 1 --2- 172.21.15.99:0/526330681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90b4161e00 0x7f90b406e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.838+0000 7f90bb000640 1 -- 172.21.15.99:0/526330681 >> 172.21.15.99:0/526330681 conn(0x7f90b406b510 msgr2=0x7f90b406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:09.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.838+0000 7f90bb000640 1 -- 172.21.15.99:0/526330681 shutdown_connections 2024-03-30T13:12:09.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.838+0000 7f90bb000640 1 -- 172.21.15.99:0/526330681 wait complete. 2024-03-30T13:12:09.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.840+0000 7f90bb000640 1 Processor -- start 2024-03-30T13:12:09.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.840+0000 7f90bb000640 1 -- start start 2024-03-30T13:12:09.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.841+0000 7f90bb000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90b406d930 0x7f90b409a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.841+0000 7f90bb000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90b4071e10 0x7f90b414c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.841+0000 7f90bb000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90b4161e00 0x7f90b40b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.841+0000 7f90bb000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f90b40b5270 con 0x7f90b4071e10 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.841+0000 7f90bb000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f90b40ad690 con 0x7f90b4161e00 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.841+0000 7f90bb000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f90b40b3e10 con 0x7f90b406d930 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.841+0000 7f90ab400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90b4071e10 0x7f90b414c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.841+0000 7f90ab400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90b4071e10 0x7f90b414c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42398/0 (socket says 172.21.15.99:42398) 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.841+0000 7f90ab400640 1 -- 172.21.15.99:0/2763651708 learned_addr learned my addr 172.21.15.99:0/2763651708 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90b9000640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90b4161e00 0x7f90b40b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90b3e00640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90b406d930 0x7f90b409a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90ab400640 1 -- 172.21.15.99:0/2763651708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90b406d930 msgr2=0x7f90b409a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90ab400640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90b406d930 0x7f90b409a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90ab400640 1 -- 172.21.15.99:0/2763651708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90b4161e00 msgr2=0x7f90b40b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90ab400640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90b4161e00 0x7f90b40b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90ab400640 1 -- 172.21.15.99:0/2763651708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b409d630 con 0x7f90b4071e10 2024-03-30T13:12:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90ab400640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90b4071e10 0x7f90b414c550 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f909c00c7f0 tx=0x7f909c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90b0c00640 1 -- 172.21.15.99:0/2763651708 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c015070 con 0x7f90b4071e10 2024-03-30T13:12:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90b0c00640 1 -- 172.21.15.99:0/2763651708 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f909c004220 con 0x7f90b4071e10 2024-03-30T13:12:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90bb000640 1 -- 172.21.15.99:0/2763651708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b409d910 con 0x7f90b4071e10 2024-03-30T13:12:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90b0c00640 1 -- 172.21.15.99:0/2763651708 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c007620 con 0x7f90b4071e10 2024-03-30T13:12:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.842+0000 7f90bb000640 1 -- 172.21.15.99:0/2763651708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b409ded0 con 0x7f90b4071e10 2024-03-30T13:12:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.843+0000 7f90bb000640 1 -- 172.21.15.99:0/2763651708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b4068640 con 0x7f90b4071e10 2024-03-30T13:12:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.844+0000 7f90b0c00640 1 -- 172.21.15.99:0/2763651708 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f909c0079d0 con 0x7f90b4071e10 2024-03-30T13:12:09.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.845+0000 7f90b0c00640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f909006c560 0x7f909006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.845+0000 7f90b0c00640 1 -- 172.21.15.99:0/2763651708 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f909c08b790 con 0x7f90b4071e10 2024-03-30T13:12:09.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.845+0000 7f90b3e00640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f909006c560 0x7f909006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.846+0000 7f90b3e00640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f909006c560 0x7f909006ea20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f90a4006fd0 tx=0x7f90a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:09.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:09.850+0000 7f90b0c00640 1 -- 172.21.15.99:0/2763651708 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f909c059d20 con 0x7f90b4071e10 2024-03-30T13:12:10.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.042+0000 7f90bb000640 1 -- 172.21.15.99:0/2763651708 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90b4161020 con 0x7f909006c560 2024-03-30T13:12:10.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.049+0000 7f90b0c00640 1 -- 172.21.15.99:0/2763651708 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249150 (secure 0 0 0) 0x7f90b4161020 con 0x7f909006c560 2024-03-30T13:12:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:10.059 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:12:10.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.055+0000 7f90bb000640 1 -- 172.21.15.99:0/2763651708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f909006c560 msgr2=0x7f909006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.055+0000 7f90bb000640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f909006c560 0x7f909006ea20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f90a4006fd0 tx=0x7f90a4008040 comp rx=0 tx=0).stop 2024-03-30T13:12:10.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.055+0000 7f90bb000640 1 -- 172.21.15.99:0/2763651708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90b4071e10 msgr2=0x7f90b414c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.055+0000 7f90bb000640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90b4071e10 0x7f90b414c550 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f909c00c7f0 tx=0x7f909c00ccb0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.055+0000 7f90bb000640 1 -- 172.21.15.99:0/2763651708 shutdown_connections 2024-03-30T13:12:10.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.055+0000 7f90bb000640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f909006c560 0x7f909006ea20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.055+0000 7f90bb000640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90b4161e00 0x7f90b40b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.055+0000 7f90bb000640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90b4071e10 0x7f90b414c550 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.055+0000 7f90bb000640 1 --2- 172.21.15.99:0/2763651708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90b406d930 0x7f90b409a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.055+0000 7f90bb000640 1 -- 172.21.15.99:0/2763651708 >> 172.21.15.99:0/2763651708 conn(0x7f90b406b510 msgr2=0x7f90b415ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:10.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.056+0000 7f90bb000640 1 -- 172.21.15.99:0/2763651708 shutdown_connections 2024-03-30T13:12:10.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.056+0000 7f90bb000640 1 -- 172.21.15.99:0/2763651708 wait complete. 2024-03-30T13:12:10.077 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-03-30T13:12:09.460396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220244,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754476,"statfs":{"total":773094113280,"available":772868583424,"internally_reserved":0,"allocated":4169728,"data_stored":2316277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001414"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.141701+0000","last_change":"2024-03-30T13:12:04.141701+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.141701+0000","last_undegraded":"2024-03-30T13:12:04.141701+0000","last_fullsized":"2024-03-30T13:12:04.141701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184893+0000","last_change":"2024-03-30T13:12:05.197119+0000","last_active":"2024-03-30T13:12:07.184893+0000","last_peered":"2024-03-30T13:12:07.184893+0000","last_clean":"2024-03-30T13:12:07.184893+0000","last_became_active":"2024-03-30T13:12:05.189811+0000","last_became_peered":"2024-03-30T13:12:05.189811+0000","last_unstale":"2024-03-30T13:12:07.184893+0000","last_undegraded":"2024-03-30T13:12:07.184893+0000","last_fullsized":"2024-03-30T13:12:07.184893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.148195+0000","last_change":"2024-03-30T13:12:04.148195+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.148195+0000","last_undegraded":"2024-03-30T13:12:04.148195+0000","last_fullsized":"2024-03-30T13:12:04.148195+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631004+0000","last_change":"2024-03-30T13:12:05.195748+0000","last_active":"2024-03-30T13:12:07.631004+0000","last_peered":"2024-03-30T13:12:07.631004+0000","last_clean":"2024-03-30T13:12:07.631004+0000","last_became_active":"2024-03-30T13:12:05.194975+0000","last_became_peered":"2024-03-30T13:12:05.194975+0000","last_unstale":"2024-03-30T13:12:07.631004+0000","last_undegraded":"2024-03-30T13:12:07.631004+0000","last_fullsized":"2024-03-30T13:12:07.631004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:21:53.293558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184896+0000","last_change":"2024-03-30T13:12:05.197297+0000","last_active":"2024-03-30T13:12:07.184896+0000","last_peered":"2024-03-30T13:12:07.184896+0000","last_clean":"2024-03-30T13:12:07.184896+0000","last_became_active":"2024-03-30T13:12:05.196664+0000","last_became_peered":"2024-03-30T13:12:05.196664+0000","last_unstale":"2024-03-30T13:12:07.184896+0000","last_undegraded":"2024-03-30T13:12:07.184896+0000","last_fullsized":"2024-03-30T13:12:07.184896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198172+0000","last_change":"2024-03-30T13:12:05.200209+0000","last_active":"2024-03-30T13:12:06.198172+0000","last_peered":"2024-03-30T13:12:06.198172+0000","last_clean":"2024-03-30T13:12:06.198172+0000","last_became_active":"2024-03-30T13:12:05.193470+0000","last_became_peered":"2024-03-30T13:12:05.193470+0000","last_unstale":"2024-03-30T13:12:06.198172+0000","last_undegraded":"2024-03-30T13:12:06.198172+0000","last_fullsized":"2024-03-30T13:12:06.198172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:14:38.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.141050+0000","last_change":"2024-03-30T13:12:04.141050+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.141050+0000","last_undegraded":"2024-03-30T13:12:04.141050+0000","last_fullsized":"2024-03-30T13:12:04.141050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.135360+0000","last_change":"2024-03-30T13:12:04.135360+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.135360+0000","last_undegraded":"2024-03-30T13:12:04.135360+0000","last_fullsized":"2024-03-30T13:12:04.135360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.150523+0000","last_change":"2024-03-30T13:12:04.150523+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.150523+0000","last_undegraded":"2024-03-30T13:12:04.150523+0000","last_fullsized":"2024-03-30T13:12:04.150523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631308+0000","last_change":"2024-03-30T13:12:05.193985+0000","last_active":"2024-03-30T13:12:07.631308+0000","last_peered":"2024-03-30T13:12:07.631308+0000","last_clean":"2024-03-30T13:12:07.631308+0000","last_became_active":"2024-03-30T13:12:05.193520+0000","last_became_peered":"2024-03-30T13:12:05.193520+0000","last_unstale":"2024-03-30T13:12:07.631308+0000","last_undegraded":"2024-03-30T13:12:07.631308+0000","last_fullsized":"2024-03-30T13:12:07.631308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:11.335766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.153720+0000","last_change":"2024-03-30T13:12:04.153720+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.153720+0000","last_undegraded":"2024-03-30T13:12:04.153720+0000","last_fullsized":"2024-03-30T13:12:04.153720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.147400+0000","last_change":"2024-03-30T13:12:04.147400+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.147400+0000","last_undegraded":"2024-03-30T13:12:04.147400+0000","last_fullsized":"2024-03-30T13:12:04.147400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473411+0000","last_change":"2024-03-30T13:12:05.190953+0000","last_active":"2024-03-30T13:12:07.473411+0000","last_peered":"2024-03-30T13:12:07.473411+0000","last_clean":"2024-03-30T13:12:07.473411+0000","last_became_active":"2024-03-30T13:12:05.190117+0000","last_became_peered":"2024-03-30T13:12:05.190117+0000","last_unstale":"2024-03-30T13:12:07.473411+0000","last_undegraded":"2024-03-30T13:12:07.473411+0000","last_fullsized":"2024-03-30T13:12:07.473411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630995+0000","last_change":"2024-03-30T13:12:05.189430+0000","last_active":"2024-03-30T13:12:07.630995+0000","last_peered":"2024-03-30T13:12:07.630995+0000","last_clean":"2024-03-30T13:12:07.630995+0000","last_became_active":"2024-03-30T13:12:05.188612+0000","last_became_peered":"2024-03-30T13:12:05.188612+0000","last_unstale":"2024-03-30T13:12:07.630995+0000","last_undegraded":"2024-03-30T13:12:07.630995+0000","last_fullsized":"2024-03-30T13:12:07.630995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:35:26.826667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126085+0000","last_change":"2024-03-30T13:12:04.126085+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126085+0000","last_undegraded":"2024-03-30T13:12:04.126085+0000","last_fullsized":"2024-03-30T13:12:04.126085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126001+0000","last_change":"2024-03-30T13:12:04.126001+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126001+0000","last_undegraded":"2024-03-30T13:12:04.126001+0000","last_fullsized":"2024-03-30T13:12:04.126001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.150815+0000","last_change":"2024-03-30T13:12:04.150815+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.150815+0000","last_undegraded":"2024-03-30T13:12:04.150815+0000","last_fullsized":"2024-03-30T13:12:04.150815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198673+0000","last_change":"2024-03-30T13:12:05.202224+0000","last_active":"2024-03-30T13:12:06.198673+0000","last_peered":"2024-03-30T13:12:06.198673+0000","last_clean":"2024-03-30T13:12:06.198673+0000","last_became_active":"2024-03-30T13:12:05.201944+0000","last_became_peered":"2024-03-30T13:12:05.201944+0000","last_unstale":"2024-03-30T13:12:06.198673+0000","last_undegraded":"2024-03-30T13:12:06.198673+0000","last_fullsized":"2024-03-30T13:12:06.198673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:58.129468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198924+0000","last_change":"2024-03-30T13:12:05.194980+0000","last_active":"2024-03-30T13:12:06.198924+0000","last_peered":"2024-03-30T13:12:06.198924+0000","last_clean":"2024-03-30T13:12:06.198924+0000","last_became_active":"2024-03-30T13:12:05.194702+0000","last_became_peered":"2024-03-30T13:12:05.194702+0000","last_unstale":"2024-03-30T13:12:06.198924+0000","last_undegraded":"2024-03-30T13:12:06.198924+0000","last_fullsized":"2024-03-30T13:12:06.198924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:09.286734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472876+0000","last_change":"2024-03-30T13:12:05.189386+0000","last_active":"2024-03-30T13:12:07.472876+0000","last_peered":"2024-03-30T13:12:07.472876+0000","last_clean":"2024-03-30T13:12:07.472876+0000","last_became_active":"2024-03-30T13:12:05.189025+0000","last_became_peered":"2024-03-30T13:12:05.189025+0000","last_unstale":"2024-03-30T13:12:07.472876+0000","last_undegraded":"2024-03-30T13:12:07.472876+0000","last_fullsized":"2024-03-30T13:12:07.472876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126394+0000","last_change":"2024-03-30T13:12:04.126394+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126394+0000","last_undegraded":"2024-03-30T13:12:04.126394+0000","last_fullsized":"2024-03-30T13:12:04.126394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.135164+0000","last_change":"2024-03-30T13:12:04.135164+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.135164+0000","last_undegraded":"2024-03-30T13:12:04.135164+0000","last_fullsized":"2024-03-30T13:12:04.135164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472492+0000","last_change":"2024-03-30T13:12:05.196711+0000","last_active":"2024-03-30T13:12:07.472492+0000","last_peered":"2024-03-30T13:12:07.472492+0000","last_clean":"2024-03-30T13:12:07.472492+0000","last_became_active":"2024-03-30T13:12:05.196491+0000","last_became_peered":"2024-03-30T13:12:05.196491+0000","last_unstale":"2024-03-30T13:12:07.472492+0000","last_undegraded":"2024-03-30T13:12:07.472492+0000","last_fullsized":"2024-03-30T13:12:07.472492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:19:59.448920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.134707+0000","last_change":"2024-03-30T13:12:04.134707+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.134707+0000","last_undegraded":"2024-03-30T13:12:04.134707+0000","last_fullsized":"2024-03-30T13:12:04.134707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631777+0000","last_change":"2024-03-30T13:12:05.196765+0000","last_active":"2024-03-30T13:12:07.631777+0000","last_peered":"2024-03-30T13:12:07.631777+0000","last_clean":"2024-03-30T13:12:07.631777+0000","last_became_active":"2024-03-30T13:12:05.196494+0000","last_became_peered":"2024-03-30T13:12:05.196494+0000","last_unstale":"2024-03-30T13:12:07.631777+0000","last_undegraded":"2024-03-30T13:12:07.631777+0000","last_fullsized":"2024-03-30T13:12:07.631777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:04:04.845593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631641+0000","last_change":"2024-03-30T13:12:05.195759+0000","last_active":"2024-03-30T13:12:07.631641+0000","last_peered":"2024-03-30T13:12:07.631641+0000","last_clean":"2024-03-30T13:12:07.631641+0000","last_became_active":"2024-03-30T13:12:05.194287+0000","last_became_peered":"2024-03-30T13:12:05.194287+0000","last_unstale":"2024-03-30T13:12:07.631641+0000","last_undegraded":"2024-03-30T13:12:07.631641+0000","last_fullsized":"2024-03-30T13:12:07.631641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:42.770626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184547+0000","last_change":"2024-03-30T13:12:05.193501+0000","last_active":"2024-03-30T13:12:07.184547+0000","last_peered":"2024-03-30T13:12:07.184547+0000","last_clean":"2024-03-30T13:12:07.184547+0000","last_became_active":"2024-03-30T13:12:05.193217+0000","last_became_peered":"2024-03-30T13:12:05.193217+0000","last_unstale":"2024-03-30T13:12:07.184547+0000","last_undegraded":"2024-03-30T13:12:07.184547+0000","last_fullsized":"2024-03-30T13:12:07.184547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.140189+0000","last_change":"2024-03-30T13:12:04.140189+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.140189+0000","last_undegraded":"2024-03-30T13:12:04.140189+0000","last_fullsized":"2024-03-30T13:12:04.140189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.127572+0000","last_change":"2024-03-30T13:12:04.127572+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.127572+0000","last_undegraded":"2024-03-30T13:12:04.127572+0000","last_fullsized":"2024-03-30T13:12:04.127572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.127523+0000","last_change":"2024-03-30T13:12:04.127523+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.127523+0000","last_undegraded":"2024-03-30T13:12:04.127523+0000","last_fullsized":"2024-03-30T13:12:04.127523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.136357+0000","last_change":"2024-03-30T13:12:04.136357+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.136357+0000","last_undegraded":"2024-03-30T13:12:04.136357+0000","last_fullsized":"2024-03-30T13:12:04.136357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.147562+0000","last_change":"2024-03-30T13:12:04.147562+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.147562+0000","last_undegraded":"2024-03-30T13:12:04.147562+0000","last_fullsized":"2024-03-30T13:12:04.147562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473000+0000","last_change":"2024-03-30T13:12:05.203814+0000","last_active":"2024-03-30T13:12:07.473000+0000","last_peered":"2024-03-30T13:12:07.473000+0000","last_clean":"2024-03-30T13:12:07.473000+0000","last_became_active":"2024-03-30T13:12:05.203408+0000","last_became_peered":"2024-03-30T13:12:05.203408+0000","last_unstale":"2024-03-30T13:12:07.473000+0000","last_undegraded":"2024-03-30T13:12:07.473000+0000","last_fullsized":"2024-03-30T13:12:07.473000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.163919+0000","last_change":"2024-03-30T13:12:04.161934+0000","last_active":"2024-03-30T13:12:04.163919+0000","last_peered":"2024-03-30T13:12:04.163919+0000","last_clean":"2024-03-30T13:12:04.163919+0000","last_became_active":"2024-03-30T13:12:04.161721+0000","last_became_peered":"2024-03-30T13:12:04.161721+0000","last_unstale":"2024-03-30T13:12:04.163919+0000","last_undegraded":"2024-03-30T13:12:04.163919+0000","last_fullsized":"2024-03-30T13:12:04.163919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:59.135017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.133498+0000","last_change":"2024-03-30T13:12:04.133498+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.133498+0000","last_undegraded":"2024-03-30T13:12:04.133498+0000","last_fullsized":"2024-03-30T13:12:04.133498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631425+0000","last_change":"2024-03-30T13:12:04.156757+0000","last_active":"2024-03-30T13:12:07.631425+0000","last_peered":"2024-03-30T13:12:07.631425+0000","last_clean":"2024-03-30T13:12:07.631425+0000","last_became_active":"2024-03-30T13:12:04.156049+0000","last_became_peered":"2024-03-30T13:12:04.156049+0000","last_unstale":"2024-03-30T13:12:07.631425+0000","last_undegraded":"2024-03-30T13:12:07.631425+0000","last_fullsized":"2024-03-30T13:12:07.631425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:54.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.139641+0000","last_change":"2024-03-30T13:12:04.139641+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.139641+0000","last_undegraded":"2024-03-30T13:12:04.139641+0000","last_fullsized":"2024-03-30T13:12:04.139641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199295+0000","last_change":"2024-03-30T13:12:04.160804+0000","last_active":"2024-03-30T13:12:06.199295+0000","last_peered":"2024-03-30T13:12:06.199295+0000","last_clean":"2024-03-30T13:12:06.199295+0000","last_became_active":"2024-03-30T13:12:04.160592+0000","last_became_peered":"2024-03-30T13:12:04.160592+0000","last_unstale":"2024-03-30T13:12:06.199295+0000","last_undegraded":"2024-03-30T13:12:06.199295+0000","last_fullsized":"2024-03-30T13:12:06.199295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:48.643179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631257+0000","last_change":"2024-03-30T13:12:05.198359+0000","last_active":"2024-03-30T13:12:07.631257+0000","last_peered":"2024-03-30T13:12:07.631257+0000","last_clean":"2024-03-30T13:12:07.631257+0000","last_became_active":"2024-03-30T13:12:05.197998+0000","last_became_peered":"2024-03-30T13:12:05.197998+0000","last_unstale":"2024-03-30T13:12:07.631257+0000","last_undegraded":"2024-03-30T13:12:07.631257+0000","last_fullsized":"2024-03-30T13:12:07.631257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:38.341209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631575+0000","last_change":"2024-03-30T13:12:04.160626+0000","last_active":"2024-03-30T13:12:07.631575+0000","last_peered":"2024-03-30T13:12:07.631575+0000","last_clean":"2024-03-30T13:12:07.631575+0000","last_became_active":"2024-03-30T13:12:04.160357+0000","last_became_peered":"2024-03-30T13:12:04.160357+0000","last_unstale":"2024-03-30T13:12:07.631575+0000","last_undegraded":"2024-03-30T13:12:07.631575+0000","last_fullsized":"2024-03-30T13:12:07.631575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:06:07.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.146171+0000","last_change":"2024-03-30T13:12:04.146171+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.146171+0000","last_undegraded":"2024-03-30T13:12:04.146171+0000","last_fullsized":"2024-03-30T13:12:04.146171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.155450+0000","last_change":"2024-03-30T13:12:04.150040+0000","last_active":"2024-03-30T13:12:04.155450+0000","last_peered":"2024-03-30T13:12:04.155450+0000","last_clean":"2024-03-30T13:12:04.155450+0000","last_became_active":"2024-03-30T13:12:04.149747+0000","last_became_peered":"2024-03-30T13:12:04.149747+0000","last_unstale":"2024-03-30T13:12:04.155450+0000","last_undegraded":"2024-03-30T13:12:04.155450+0000","last_fullsized":"2024-03-30T13:12:04.155450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:39:14.217210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.137242+0000","last_change":"2024-03-30T13:12:04.137242+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.137242+0000","last_undegraded":"2024-03-30T13:12:04.137242+0000","last_fullsized":"2024-03-30T13:12:04.137242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.154437+0000","last_change":"2024-03-30T13:12:04.149618+0000","last_active":"2024-03-30T13:12:04.154437+0000","last_peered":"2024-03-30T13:12:04.154437+0000","last_clean":"2024-03-30T13:12:04.154437+0000","last_became_active":"2024-03-30T13:12:04.149252+0000","last_became_peered":"2024-03-30T13:12:04.149252+0000","last_unstale":"2024-03-30T13:12:04.154437+0000","last_undegraded":"2024-03-30T13:12:04.154437+0000","last_fullsized":"2024-03-30T13:12:04.154437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:28.166977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.141830+0000","last_change":"2024-03-30T13:12:04.141830+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.141830+0000","last_undegraded":"2024-03-30T13:12:04.141830+0000","last_fullsized":"2024-03-30T13:12:04.141830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198401+0000","last_change":"2024-03-30T13:12:04.157894+0000","last_active":"2024-03-30T13:12:06.198401+0000","last_peered":"2024-03-30T13:12:06.198401+0000","last_clean":"2024-03-30T13:12:06.198401+0000","last_became_active":"2024-03-30T13:12:04.157491+0000","last_became_peered":"2024-03-30T13:12:04.157491+0000","last_unstale":"2024-03-30T13:12:06.198401+0000","last_undegraded":"2024-03-30T13:12:06.198401+0000","last_fullsized":"2024-03-30T13:12:06.198401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:34:25.438955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630535+0000","last_change":"2024-03-30T13:12:05.199546+0000","last_active":"2024-03-30T13:12:07.630535+0000","last_peered":"2024-03-30T13:12:07.630535+0000","last_clean":"2024-03-30T13:12:07.630535+0000","last_became_active":"2024-03-30T13:12:05.199239+0000","last_became_peered":"2024-03-30T13:12:05.199239+0000","last_unstale":"2024-03-30T13:12:07.630535+0000","last_undegraded":"2024-03-30T13:12:07.630535+0000","last_fullsized":"2024-03-30T13:12:07.630535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:28.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.159716+0000","last_change":"2024-03-30T13:12:04.155737+0000","last_active":"2024-03-30T13:12:04.159716+0000","last_peered":"2024-03-30T13:12:04.159716+0000","last_clean":"2024-03-30T13:12:04.159716+0000","last_became_active":"2024-03-30T13:12:04.155473+0000","last_became_peered":"2024-03-30T13:12:04.155473+0000","last_unstale":"2024-03-30T13:12:04.159716+0000","last_undegraded":"2024-03-30T13:12:04.159716+0000","last_fullsized":"2024-03-30T13:12:04.159716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:07:16.905846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.144841+0000","last_change":"2024-03-30T13:12:04.144841+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.144841+0000","last_undegraded":"2024-03-30T13:12:04.144841+0000","last_fullsized":"2024-03-30T13:12:04.144841+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184977+0000","last_change":"2024-03-30T13:12:04.152194+0000","last_active":"2024-03-30T13:12:07.184977+0000","last_peered":"2024-03-30T13:12:07.184977+0000","last_clean":"2024-03-30T13:12:07.184977+0000","last_became_active":"2024-03-30T13:12:04.151844+0000","last_became_peered":"2024-03-30T13:12:04.151844+0000","last_unstale":"2024-03-30T13:12:07.184977+0000","last_undegraded":"2024-03-30T13:12:07.184977+0000","last_fullsized":"2024-03-30T13:12:07.184977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.632067+0000","last_change":"2024-03-30T13:12:05.191219+0000","last_active":"2024-03-30T13:12:07.632067+0000","last_peered":"2024-03-30T13:12:07.632067+0000","last_clean":"2024-03-30T13:12:07.632067+0000","last_became_active":"2024-03-30T13:12:05.187503+0000","last_became_peered":"2024-03-30T13:12:05.187503+0000","last_unstale":"2024-03-30T13:12:07.632067+0000","last_undegraded":"2024-03-30T13:12:07.632067+0000","last_fullsized":"2024-03-30T13:12:07.632067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:34:30.445284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184510+0000","last_change":"2024-03-30T13:12:04.151674+0000","last_active":"2024-03-30T13:12:07.184510+0000","last_peered":"2024-03-30T13:12:07.184510+0000","last_clean":"2024-03-30T13:12:07.184510+0000","last_became_active":"2024-03-30T13:12:04.151273+0000","last_became_peered":"2024-03-30T13:12:04.151273+0000","last_unstale":"2024-03-30T13:12:07.184510+0000","last_undegraded":"2024-03-30T13:12:07.184510+0000","last_fullsized":"2024-03-30T13:12:07.184510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:35:19.563529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631362+0000","last_change":"2024-03-30T13:12:05.195768+0000","last_active":"2024-03-30T13:12:07.631362+0000","last_peered":"2024-03-30T13:12:07.631362+0000","last_clean":"2024-03-30T13:12:07.631362+0000","last_became_active":"2024-03-30T13:12:05.190015+0000","last_became_peered":"2024-03-30T13:12:05.190015+0000","last_unstale":"2024-03-30T13:12:07.631362+0000","last_undegraded":"2024-03-30T13:12:07.631362+0000","last_fullsized":"2024-03-30T13:12:07.631362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:45:05.346910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.161184+0000","last_change":"2024-03-30T13:12:04.158663+0000","last_active":"2024-03-30T13:12:04.161184+0000","last_peered":"2024-03-30T13:12:04.161184+0000","last_clean":"2024-03-30T13:12:04.161184+0000","last_became_active":"2024-03-30T13:12:04.154124+0000","last_became_peered":"2024-03-30T13:12:04.154124+0000","last_unstale":"2024-03-30T13:12:04.161184+0000","last_undegraded":"2024-03-30T13:12:04.161184+0000","last_fullsized":"2024-03-30T13:12:04.161184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:19:58.443719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.144722+0000","last_change":"2024-03-30T13:12:04.144722+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.144722+0000","last_undegraded":"2024-03-30T13:12:04.144722+0000","last_fullsized":"2024-03-30T13:12:04.144722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472817+0000","last_change":"2024-03-30T13:12:04.157305+0000","last_active":"2024-03-30T13:12:07.472817+0000","last_peered":"2024-03-30T13:12:07.472817+0000","last_clean":"2024-03-30T13:12:07.472817+0000","last_became_active":"2024-03-30T13:12:04.156997+0000","last_became_peered":"2024-03-30T13:12:04.156997+0000","last_unstale":"2024-03-30T13:12:07.472817+0000","last_undegraded":"2024-03-30T13:12:07.472817+0000","last_fullsized":"2024-03-30T13:12:07.472817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:01.032056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472534+0000","last_change":"2024-03-30T13:12:05.195191+0000","last_active":"2024-03-30T13:12:07.472534+0000","last_peered":"2024-03-30T13:12:07.472534+0000","last_clean":"2024-03-30T13:12:07.472534+0000","last_became_active":"2024-03-30T13:12:05.194888+0000","last_became_peered":"2024-03-30T13:12:05.194888+0000","last_unstale":"2024-03-30T13:12:07.472534+0000","last_undegraded":"2024-03-30T13:12:07.472534+0000","last_fullsized":"2024-03-30T13:12:07.472534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.164717+0000","last_change":"2024-03-30T13:12:04.160490+0000","last_active":"2024-03-30T13:12:04.164717+0000","last_peered":"2024-03-30T13:12:04.164717+0000","last_clean":"2024-03-30T13:12:04.164717+0000","last_became_active":"2024-03-30T13:12:04.160169+0000","last_became_peered":"2024-03-30T13:12:04.160169+0000","last_unstale":"2024-03-30T13:12:04.164717+0000","last_undegraded":"2024-03-30T13:12:04.164717+0000","last_fullsized":"2024-03-30T13:12:04.164717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:14.622222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631210+0000","last_change":"2024-03-30T13:12:05.201558+0000","last_active":"2024-03-30T13:12:07.631210+0000","last_peered":"2024-03-30T13:12:07.631210+0000","last_clean":"2024-03-30T13:12:07.631210+0000","last_became_active":"2024-03-30T13:12:05.198153+0000","last_became_peered":"2024-03-30T13:12:05.198153+0000","last_unstale":"2024-03-30T13:12:07.631210+0000","last_undegraded":"2024-03-30T13:12:07.631210+0000","last_fullsized":"2024-03-30T13:12:07.631210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:05:21.340816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631182+0000","last_change":"2024-03-30T13:12:04.159693+0000","last_active":"2024-03-30T13:12:07.631182+0000","last_peered":"2024-03-30T13:12:07.631182+0000","last_clean":"2024-03-30T13:12:07.631182+0000","last_became_active":"2024-03-30T13:12:04.159246+0000","last_became_peered":"2024-03-30T13:12:04.159246+0000","last_unstale":"2024-03-30T13:12:07.631182+0000","last_undegraded":"2024-03-30T13:12:07.631182+0000","last_fullsized":"2024-03-30T13:12:07.631182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:30.867699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.133960+0000","last_change":"2024-03-30T13:12:04.133960+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.133960+0000","last_undegraded":"2024-03-30T13:12:04.133960+0000","last_fullsized":"2024-03-30T13:12:04.133960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630232+0000","last_change":"2024-03-30T13:12:04.152863+0000","last_active":"2024-03-30T13:12:07.630232+0000","last_peered":"2024-03-30T13:12:07.630232+0000","last_clean":"2024-03-30T13:12:07.630232+0000","last_became_active":"2024-03-30T13:12:04.152533+0000","last_became_peered":"2024-03-30T13:12:04.152533+0000","last_unstale":"2024-03-30T13:12:07.630232+0000","last_undegraded":"2024-03-30T13:12:07.630232+0000","last_fullsized":"2024-03-30T13:12:07.630232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:01.032056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.146900+0000","last_change":"2024-03-30T13:12:04.146900+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.146900+0000","last_undegraded":"2024-03-30T13:12:04.146900+0000","last_fullsized":"2024-03-30T13:12:04.146900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198210+0000","last_change":"2024-03-30T13:12:04.158169+0000","last_active":"2024-03-30T13:12:06.198210+0000","last_peered":"2024-03-30T13:12:06.198210+0000","last_clean":"2024-03-30T13:12:06.198210+0000","last_became_active":"2024-03-30T13:12:04.157877+0000","last_became_peered":"2024-03-30T13:12:04.157877+0000","last_unstale":"2024-03-30T13:12:06.198210+0000","last_undegraded":"2024-03-30T13:12:06.198210+0000","last_fullsized":"2024-03-30T13:12:06.198210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:21:40.866398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.142745+0000","last_change":"2024-03-30T13:12:04.142745+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.142745+0000","last_undegraded":"2024-03-30T13:12:04.142745+0000","last_fullsized":"2024-03-30T13:12:04.142745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199102+0000","last_change":"2024-03-30T13:12:04.160389+0000","last_active":"2024-03-30T13:12:06.199102+0000","last_peered":"2024-03-30T13:12:06.199102+0000","last_clean":"2024-03-30T13:12:06.199102+0000","last_became_active":"2024-03-30T13:12:04.158808+0000","last_became_peered":"2024-03-30T13:12:04.158808+0000","last_unstale":"2024-03-30T13:12:06.199102+0000","last_undegraded":"2024-03-30T13:12:06.199102+0000","last_fullsized":"2024-03-30T13:12:06.199102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:21.807992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.148847+0000","last_change":"2024-03-30T13:12:04.148847+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.148847+0000","last_undegraded":"2024-03-30T13:12:04.148847+0000","last_fullsized":"2024-03-30T13:12:04.148847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.164720+0000","last_change":"2024-03-30T13:12:04.160282+0000","last_active":"2024-03-30T13:12:04.164720+0000","last_peered":"2024-03-30T13:12:04.164720+0000","last_clean":"2024-03-30T13:12:04.164720+0000","last_became_active":"2024-03-30T13:12:04.159950+0000","last_became_peered":"2024-03-30T13:12:04.159950+0000","last_unstale":"2024-03-30T13:12:04.164720+0000","last_undegraded":"2024-03-30T13:12:04.164720+0000","last_fullsized":"2024-03-30T13:12:04.164720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:27.651002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184613+0000","last_change":"2024-03-30T13:12:05.195404+0000","last_active":"2024-03-30T13:12:07.184613+0000","last_peered":"2024-03-30T13:12:07.184613+0000","last_clean":"2024-03-30T13:12:07.184613+0000","last_became_active":"2024-03-30T13:12:05.195140+0000","last_became_peered":"2024-03-30T13:12:05.195140+0000","last_unstale":"2024-03-30T13:12:07.184613+0000","last_undegraded":"2024-03-30T13:12:07.184613+0000","last_fullsized":"2024-03-30T13:12:07.184613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.166114+0000","last_change":"2024-03-30T13:12:04.164305+0000","last_active":"2024-03-30T13:12:04.166114+0000","last_peered":"2024-03-30T13:12:04.166114+0000","last_clean":"2024-03-30T13:12:04.166114+0000","last_became_active":"2024-03-30T13:12:04.163883+0000","last_became_peered":"2024-03-30T13:12:04.163883+0000","last_unstale":"2024-03-30T13:12:04.166114+0000","last_undegraded":"2024-03-30T13:12:04.166114+0000","last_fullsized":"2024-03-30T13:12:04.166114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:47.459513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198949+0000","last_change":"2024-03-30T13:12:05.203694+0000","last_active":"2024-03-30T13:12:06.198949+0000","last_peered":"2024-03-30T13:12:06.198949+0000","last_clean":"2024-03-30T13:12:06.198949+0000","last_became_active":"2024-03-30T13:12:05.203389+0000","last_became_peered":"2024-03-30T13:12:05.203389+0000","last_unstale":"2024-03-30T13:12:06.198949+0000","last_undegraded":"2024-03-30T13:12:06.198949+0000","last_fullsized":"2024-03-30T13:12:06.198949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:07.797910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.158821+0000","last_change":"2024-03-30T13:12:04.156484+0000","last_active":"2024-03-30T13:12:04.158821+0000","last_peered":"2024-03-30T13:12:04.158821+0000","last_clean":"2024-03-30T13:12:04.158821+0000","last_became_active":"2024-03-30T13:12:04.156142+0000","last_became_peered":"2024-03-30T13:12:04.156142+0000","last_unstale":"2024-03-30T13:12:04.158821+0000","last_undegraded":"2024-03-30T13:12:04.158821+0000","last_fullsized":"2024-03-30T13:12:04.158821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472751+0000","last_change":"2024-03-30T13:12:05.189181+0000","last_active":"2024-03-30T13:12:07.472751+0000","last_peered":"2024-03-30T13:12:07.472751+0000","last_clean":"2024-03-30T13:12:07.472751+0000","last_became_active":"2024-03-30T13:12:05.188836+0000","last_became_peered":"2024-03-30T13:12:05.188836+0000","last_unstale":"2024-03-30T13:12:07.472751+0000","last_undegraded":"2024-03-30T13:12:07.472751+0000","last_fullsized":"2024-03-30T13:12:07.472751+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184602+0000","last_change":"2024-03-30T13:12:04.160445+0000","last_active":"2024-03-30T13:12:07.184602+0000","last_peered":"2024-03-30T13:12:07.184602+0000","last_clean":"2024-03-30T13:12:07.184602+0000","last_became_active":"2024-03-30T13:12:04.159088+0000","last_became_peered":"2024-03-30T13:12:04.159088+0000","last_unstale":"2024-03-30T13:12:07.184602+0000","last_undegraded":"2024-03-30T13:12:07.184602+0000","last_fullsized":"2024-03-30T13:12:07.184602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:18.892572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184485+0000","last_change":"2024-03-30T13:12:05.206205+0000","last_active":"2024-03-30T13:12:07.184485+0000","last_peered":"2024-03-30T13:12:07.184485+0000","last_clean":"2024-03-30T13:12:07.184485+0000","last_became_active":"2024-03-30T13:12:05.205165+0000","last_became_peered":"2024-03-30T13:12:05.205165+0000","last_unstale":"2024-03-30T13:12:07.184485+0000","last_undegraded":"2024-03-30T13:12:07.184485+0000","last_fullsized":"2024-03-30T13:12:07.184485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.164762+0000","last_change":"2024-03-30T13:12:04.160477+0000","last_active":"2024-03-30T13:12:04.164762+0000","last_peered":"2024-03-30T13:12:04.164762+0000","last_clean":"2024-03-30T13:12:04.164762+0000","last_became_active":"2024-03-30T13:12:04.159861+0000","last_became_peered":"2024-03-30T13:12:04.159861+0000","last_unstale":"2024-03-30T13:12:04.164762+0000","last_undegraded":"2024-03-30T13:12:04.164762+0000","last_fullsized":"2024-03-30T13:12:04.164762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:34:22.185576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472282+0000","last_change":"2024-03-30T13:12:05.188342+0000","last_active":"2024-03-30T13:12:07.472282+0000","last_peered":"2024-03-30T13:12:07.472282+0000","last_clean":"2024-03-30T13:12:07.472282+0000","last_became_active":"2024-03-30T13:12:05.187979+0000","last_became_peered":"2024-03-30T13:12:05.187979+0000","last_unstale":"2024-03-30T13:12:07.472282+0000","last_undegraded":"2024-03-30T13:12:07.472282+0000","last_fullsized":"2024-03-30T13:12:07.472282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:21:11.680054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.158265+0000","last_change":"2024-03-30T13:12:04.153187+0000","last_active":"2024-03-30T13:12:04.158265+0000","last_peered":"2024-03-30T13:12:04.158265+0000","last_clean":"2024-03-30T13:12:04.158265+0000","last_became_active":"2024-03-30T13:12:04.151861+0000","last_became_peered":"2024-03-30T13:12:04.151861+0000","last_unstale":"2024-03-30T13:12:04.158265+0000","last_undegraded":"2024-03-30T13:12:04.158265+0000","last_fullsized":"2024-03-30T13:12:04.158265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:51.432156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.143872+0000","last_change":"2024-03-30T13:12:04.143872+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.143872+0000","last_undegraded":"2024-03-30T13:12:04.143872+0000","last_fullsized":"2024-03-30T13:12:04.143872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.166308+0000","last_change":"2024-03-30T13:12:04.163783+0000","last_active":"2024-03-30T13:12:04.166308+0000","last_peered":"2024-03-30T13:12:04.166308+0000","last_clean":"2024-03-30T13:12:04.166308+0000","last_became_active":"2024-03-30T13:12:04.163480+0000","last_became_peered":"2024-03-30T13:12:04.163480+0000","last_unstale":"2024-03-30T13:12:04.166308+0000","last_undegraded":"2024-03-30T13:12:04.166308+0000","last_fullsized":"2024-03-30T13:12:04.166308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:23.927066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199312+0000","last_change":"2024-03-30T13:12:05.201073+0000","last_active":"2024-03-30T13:12:06.199312+0000","last_peered":"2024-03-30T13:12:06.199312+0000","last_clean":"2024-03-30T13:12:06.199312+0000","last_became_active":"2024-03-30T13:12:05.197377+0000","last_became_peered":"2024-03-30T13:12:05.197377+0000","last_unstale":"2024-03-30T13:12:06.199312+0000","last_undegraded":"2024-03-30T13:12:06.199312+0000","last_fullsized":"2024-03-30T13:12:06.199312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:09.490280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472403+0000","last_change":"2024-03-30T13:12:04.138835+0000","last_active":"2024-03-30T13:12:07.472403+0000","last_peered":"2024-03-30T13:12:07.472403+0000","last_clean":"2024-03-30T13:12:07.472403+0000","last_became_active":"2024-03-30T13:12:04.138108+0000","last_became_peered":"2024-03-30T13:12:04.138108+0000","last_unstale":"2024-03-30T13:12:07.472403+0000","last_undegraded":"2024-03-30T13:12:07.472403+0000","last_fullsized":"2024-03-30T13:12:07.472403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:54.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.139844+0000","last_change":"2024-03-30T13:12:04.139844+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.139844+0000","last_undegraded":"2024-03-30T13:12:04.139844+0000","last_fullsized":"2024-03-30T13:12:04.139844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184886+0000","last_change":"2024-03-30T13:12:04.151193+0000","last_active":"2024-03-30T13:12:07.184886+0000","last_peered":"2024-03-30T13:12:07.184886+0000","last_clean":"2024-03-30T13:12:07.184886+0000","last_became_active":"2024-03-30T13:12:04.150870+0000","last_became_peered":"2024-03-30T13:12:04.150870+0000","last_unstale":"2024-03-30T13:12:07.184886+0000","last_undegraded":"2024-03-30T13:12:07.184886+0000","last_fullsized":"2024-03-30T13:12:07.184886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:10:39.110454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199433+0000","last_change":"2024-03-30T13:12:05.195497+0000","last_active":"2024-03-30T13:12:06.199433+0000","last_peered":"2024-03-30T13:12:06.199433+0000","last_clean":"2024-03-30T13:12:06.199433+0000","last_became_active":"2024-03-30T13:12:05.194357+0000","last_became_peered":"2024-03-30T13:12:05.194357+0000","last_unstale":"2024-03-30T13:12:06.199433+0000","last_undegraded":"2024-03-30T13:12:06.199433+0000","last_fullsized":"2024-03-30T13:12:06.199433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:27:20.267950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472991+0000","last_change":"2024-03-30T13:12:04.156791+0000","last_active":"2024-03-30T13:12:07.472991+0000","last_peered":"2024-03-30T13:12:07.472991+0000","last_clean":"2024-03-30T13:12:07.472991+0000","last_became_active":"2024-03-30T13:12:04.155722+0000","last_became_peered":"2024-03-30T13:12:04.155722+0000","last_unstale":"2024-03-30T13:12:07.472991+0000","last_undegraded":"2024-03-30T13:12:07.472991+0000","last_fullsized":"2024-03-30T13:12:07.472991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:06:07.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126417+0000","last_change":"2024-03-30T13:12:04.126417+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126417+0000","last_undegraded":"2024-03-30T13:12:04.126417+0000","last_fullsized":"2024-03-30T13:12:04.126417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473356+0000","last_change":"2024-03-30T13:12:04.145008+0000","last_active":"2024-03-30T13:12:07.473356+0000","last_peered":"2024-03-30T13:12:07.473356+0000","last_clean":"2024-03-30T13:12:07.473356+0000","last_became_active":"2024-03-30T13:12:04.144537+0000","last_became_peered":"2024-03-30T13:12:04.144537+0000","last_unstale":"2024-03-30T13:12:07.473356+0000","last_undegraded":"2024-03-30T13:12:07.473356+0000","last_fullsized":"2024-03-30T13:12:07.473356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:30.328150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631725+0000","last_change":"2024-03-30T13:12:05.198424+0000","last_active":"2024-03-30T13:12:07.631725+0000","last_peered":"2024-03-30T13:12:07.631725+0000","last_clean":"2024-03-30T13:12:07.631725+0000","last_became_active":"2024-03-30T13:12:05.197807+0000","last_became_peered":"2024-03-30T13:12:05.197807+0000","last_unstale":"2024-03-30T13:12:07.631725+0000","last_undegraded":"2024-03-30T13:12:07.631725+0000","last_fullsized":"2024-03-30T13:12:07.631725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:02.120513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472673+0000","last_change":"2024-03-30T13:12:04.156286+0000","last_active":"2024-03-30T13:12:07.472673+0000","last_peered":"2024-03-30T13:12:07.472673+0000","last_clean":"2024-03-30T13:12:07.472673+0000","last_became_active":"2024-03-30T13:12:04.155947+0000","last_became_peered":"2024-03-30T13:12:04.155947+0000","last_unstale":"2024-03-30T13:12:07.472673+0000","last_undegraded":"2024-03-30T13:12:07.472673+0000","last_fullsized":"2024-03-30T13:12:07.472673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:47:50.782317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630786+0000","last_change":"2024-03-30T13:12:05.193970+0000","last_active":"2024-03-30T13:12:07.630786+0000","last_peered":"2024-03-30T13:12:07.630786+0000","last_clean":"2024-03-30T13:12:07.630786+0000","last_became_active":"2024-03-30T13:12:05.193676+0000","last_became_peered":"2024-03-30T13:12:05.193676+0000","last_unstale":"2024-03-30T13:12:07.630786+0000","last_undegraded":"2024-03-30T13:12:07.630786+0000","last_fullsized":"2024-03-30T13:12:07.630786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:02.262900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.163158+0000","last_change":"2024-03-30T13:12:04.159232+0000","last_active":"2024-03-30T13:12:04.163158+0000","last_peered":"2024-03-30T13:12:04.163158+0000","last_clean":"2024-03-30T13:12:04.163158+0000","last_became_active":"2024-03-30T13:12:04.158956+0000","last_became_peered":"2024-03-30T13:12:04.158956+0000","last_unstale":"2024-03-30T13:12:04.163158+0000","last_undegraded":"2024-03-30T13:12:04.163158+0000","last_fullsized":"2024-03-30T13:12:04.163158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:43:39.942742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.138564+0000","last_change":"2024-03-30T13:12:04.138564+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.138564+0000","last_undegraded":"2024-03-30T13:12:04.138564+0000","last_fullsized":"2024-03-30T13:12:04.138564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630473+0000","last_change":"2024-03-30T13:12:04.156959+0000","last_active":"2024-03-30T13:12:07.630473+0000","last_peered":"2024-03-30T13:12:07.630473+0000","last_clean":"2024-03-30T13:12:07.630473+0000","last_became_active":"2024-03-30T13:12:04.156016+0000","last_became_peered":"2024-03-30T13:12:04.156016+0000","last_unstale":"2024-03-30T13:12:07.630473+0000","last_undegraded":"2024-03-30T13:12:07.630473+0000","last_fullsized":"2024-03-30T13:12:07.630473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126023+0000","last_change":"2024-03-30T13:12:04.126023+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126023+0000","last_undegraded":"2024-03-30T13:12:04.126023+0000","last_fullsized":"2024-03-30T13:12:04.126023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.166095+0000","last_change":"2024-03-30T13:12:04.164087+0000","last_active":"2024-03-30T13:12:04.166095+0000","last_peered":"2024-03-30T13:12:04.166095+0000","last_clean":"2024-03-30T13:12:04.166095+0000","last_became_active":"2024-03-30T13:12:04.163450+0000","last_became_peered":"2024-03-30T13:12:04.163450+0000","last_unstale":"2024-03-30T13:12:04.166095+0000","last_undegraded":"2024-03-30T13:12:04.166095+0000","last_fullsized":"2024-03-30T13:12:04.166095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:16.635465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.145335+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:12:04.145335+0000","last_peered":"2024-03-30T13:12:04.145335+0000","last_clean":"2024-03-30T13:12:04.145335+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:12:04.145335+0000","last_undegraded":"2024-03-30T13:12:04.145335+0000","last_fullsized":"2024-03-30T13:12:04.145335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476757,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":137277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476757,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":721370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":151964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":741302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":151986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":150374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:12:10.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:12:10.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.325+0000 7f0fa7e00640 1 Processor -- start 2024-03-30T13:12:10.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.326+0000 7f0fa7e00640 1 -- start start 2024-03-30T13:12:10.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.327+0000 7f0fa7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0fa015c670 0x7f0fa006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.327+0000 7f0fa7e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0fa006f060 0x7f0fa006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.327+0000 7f0fa7e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa0146230 con 0x7f0fa00ad230 2024-03-30T13:12:10.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.327+0000 7f0fa7e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa006dfc0 con 0x7f0fa015c670 2024-03-30T13:12:10.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.327+0000 7f0fa7e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa006e2a0 con 0x7f0fa006f060 2024-03-30T13:12:10.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.327+0000 7f0fa5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0fa015c670 0x7f0fa006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.327+0000 7f0fa5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0fa015c670 0x7f0fa006c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42412/0 (socket says 172.21.15.99:42412) 2024-03-30T13:12:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.327+0000 7f0fa5400640 1 -- 172.21.15.99:0/3024702471 learned_addr learned my addr 172.21.15.99:0/3024702471 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.328+0000 7f0fa4a00640 1 --2- 172.21.15.99:0/3024702471 >> v2:172.21.15.181:3300/0 conn(0x7f0fa006f060 0x7f0fa006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.328+0000 7f0fa5400640 1 -- 172.21.15.99:0/3024702471 >> v2:172.21.15.181:3300/0 conn(0x7f0fa006f060 msgr2=0x7f0fa006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.328+0000 7f0fa5400640 1 --2- 172.21.15.99:0/3024702471 >> v2:172.21.15.181:3300/0 conn(0x7f0fa006f060 0x7f0fa006d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.328+0000 7f0fa5400640 1 -- 172.21.15.99:0/3024702471 >> v1:172.21.15.181:6789/0 conn(0x7f0fa00ad230 legacy=0x7f0fa00ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.328+0000 7f0fa5400640 1 -- 172.21.15.99:0/3024702471 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa006e580 con 0x7f0fa015c670 2024-03-30T13:12:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.329+0000 7f0fa5400640 1 --2- 172.21.15.99:0/3024702471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa015c670 0x7f0fa006c030 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0071690 tx=0x7f0f9002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4aef9ebc47bcf57 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.330+0000 7f0f9fe00640 1 -- 172.21.15.99:0/3024702471 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9002e070 con 0x7f0fa015c670 2024-03-30T13:12:10.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.330+0000 7f0f9fe00640 1 -- 172.21.15.99:0/3024702471 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f90037070 con 0x7f0fa015c670 2024-03-30T13:12:10.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.330+0000 7f0f9fe00640 1 -- 172.21.15.99:0/3024702471 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f90031a00 con 0x7f0fa015c670 2024-03-30T13:12:10.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.330+0000 7f0fa7e00640 1 -- 172.21.15.99:0/3024702471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa015c670 msgr2=0x7f0fa006c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.330+0000 7f0fa7e00640 1 --2- 172.21.15.99:0/3024702471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa015c670 0x7f0fa006c030 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0071690 tx=0x7f0f9002b880 comp rx=0 tx=0).stop 2024-03-30T13:12:10.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.331+0000 7f0fa7e00640 1 -- 172.21.15.99:0/3024702471 shutdown_connections 2024-03-30T13:12:10.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.331+0000 7f0fa7e00640 1 --2- 172.21.15.99:0/3024702471 >> v2:172.21.15.181:3300/0 conn(0x7f0fa006f060 0x7f0fa006d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.331+0000 7f0fa7e00640 1 --2- 172.21.15.99:0/3024702471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa015c670 0x7f0fa006c030 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.331+0000 7f0fa7e00640 1 -- 172.21.15.99:0/3024702471 >> 172.21.15.99:0/3024702471 conn(0x7f0fa006b510 msgr2=0x7f0fa006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.331+0000 7f0fa7e00640 1 -- 172.21.15.99:0/3024702471 shutdown_connections 2024-03-30T13:12:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.331+0000 7f0fa7e00640 1 -- 172.21.15.99:0/3024702471 wait complete. 2024-03-30T13:12:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.332+0000 7f0fa7e00640 1 Processor -- start 2024-03-30T13:12:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.332+0000 7f0fa7e00640 1 -- start start 2024-03-30T13:12:10.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.333+0000 7f0fa7e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fa006f060 0x7f0fa00cf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.333+0000 7f0fa7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa00ad230 0x7f0fa0145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.333+0000 7f0fa7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fa015c670 0x7f0fa00ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.333+0000 7f0fa7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa00b32c0 con 0x7f0fa00ad230 2024-03-30T13:12:10.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.333+0000 7f0fa7e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa015ca50 con 0x7f0fa015c670 2024-03-30T13:12:10.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.333+0000 7f0fa7e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa00b3440 con 0x7f0fa006f060 2024-03-30T13:12:10.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.334+0000 7f0fa4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa00ad230 0x7f0fa0145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.334+0000 7f0fa4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa00ad230 0x7f0fa0145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42422/0 (socket says 172.21.15.99:42422) 2024-03-30T13:12:10.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.334+0000 7f0fa4a00640 1 -- 172.21.15.99:0/2360568947 learned_addr learned my addr 172.21.15.99:0/2360568947 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.334+0000 7f0fa5400640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fa006f060 0x7f0fa00cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.334+0000 7f0fa4a00640 1 -- 172.21.15.99:0/2360568947 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fa006f060 msgr2=0x7f0fa00cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.334+0000 7f0fa5e00640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fa015c670 0x7f0fa00ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.334+0000 7f0fa4a00640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fa006f060 0x7f0fa00cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.334+0000 7f0fa4a00640 1 -- 172.21.15.99:0/2360568947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fa015c670 msgr2=0x7f0fa00ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.334+0000 7f0fa4a00640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fa015c670 0x7f0fa00ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.334+0000 7f0fa4a00640 1 -- 172.21.15.99:0/2360568947 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa0071dc0 con 0x7f0fa00ad230 2024-03-30T13:12:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.335+0000 7f0fa4a00640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa00ad230 0x7f0fa0145020 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0f94007f20 tx=0x7f0f9400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.335+0000 7f0f9d600640 1 -- 172.21.15.99:0/2360568947 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94014620 con 0x7f0fa00ad230 2024-03-30T13:12:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.335+0000 7f0f9d600640 1 -- 172.21.15.99:0/2360568947 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f94019070 con 0x7f0fa00ad230 2024-03-30T13:12:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.335+0000 7f0f9d600640 1 -- 172.21.15.99:0/2360568947 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94014a00 con 0x7f0fa00ad230 2024-03-30T13:12:10.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.335+0000 7f0fa7e00640 1 -- 172.21.15.99:0/2360568947 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa00ade20 con 0x7f0fa00ad230 2024-03-30T13:12:10.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.335+0000 7f0fa7e00640 1 -- 172.21.15.99:0/2360568947 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa00718d0 con 0x7f0fa00ad230 2024-03-30T13:12:10.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.336+0000 7f0fa7e00640 1 -- 172.21.15.99:0/2360568947 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa0071f90 con 0x7f0fa00ad230 2024-03-30T13:12:10.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.337+0000 7f0f9d600640 1 -- 172.21.15.99:0/2360568947 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0f94014ba0 con 0x7f0fa00ad230 2024-03-30T13:12:10.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.339+0000 7f0f9d600640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f8406c560 0x7f0f8406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.339+0000 7f0f9d600640 1 -- 172.21.15.99:0/2360568947 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f0f9408bfb0 con 0x7f0fa00ad230 2024-03-30T13:12:10.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.339+0000 7f0fa5400640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f8406c560 0x7f0f8406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.339+0000 7f0fa5400640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f8406c560 0x7f0f8406ea20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0f90036000 tx=0x7f0f90008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.344+0000 7f0f9d600640 1 -- 172.21.15.99:0/2360568947 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0f9405a5d0 con 0x7f0fa00ad230 2024-03-30T13:12:10.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.533+0000 7f0fa7e00640 1 -- 172.21.15.99:0/2360568947 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0fa00cf550 con 0x7f0f8406c560 2024-03-30T13:12:10.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.551+0000 7f0f9d600640 1 -- 172.21.15.99:0/2360568947 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249150 (secure 0 0 0) 0x7f0f90037040 con 0x7f0f8406c560 2024-03-30T13:12:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:10.560 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:12:10.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.556+0000 7f0fa7e00640 1 -- 172.21.15.99:0/2360568947 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f8406c560 msgr2=0x7f0f8406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.556+0000 7f0fa7e00640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f8406c560 0x7f0f8406ea20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0f90036000 tx=0x7f0f90008030 comp rx=0 tx=0).stop 2024-03-30T13:12:10.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.556+0000 7f0fa7e00640 1 -- 172.21.15.99:0/2360568947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa00ad230 msgr2=0x7f0fa0145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.556+0000 7f0fa7e00640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa00ad230 0x7f0fa0145020 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0f94007f20 tx=0x7f0f9400e570 comp rx=0 tx=0).stop 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.557+0000 7f0fa7e00640 1 -- 172.21.15.99:0/2360568947 shutdown_connections 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.557+0000 7f0fa7e00640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f8406c560 0x7f0f8406ea20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.557+0000 7f0fa7e00640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fa015c670 0x7f0fa00ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.557+0000 7f0fa7e00640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa00ad230 0x7f0fa0145020 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.557+0000 7f0fa7e00640 1 --2- 172.21.15.99:0/2360568947 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fa006f060 0x7f0fa00cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.557+0000 7f0fa7e00640 1 -- 172.21.15.99:0/2360568947 >> 172.21.15.99:0/2360568947 conn(0x7f0fa006b510 msgr2=0x7f0fa00b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.557+0000 7f0fa7e00640 1 -- 172.21.15.99:0/2360568947 shutdown_connections 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.557+0000 7f0fa7e00640 1 -- 172.21.15.99:0/2360568947 wait complete. 2024-03-30T13:12:10.578 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-03-30T13:12:09.460396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220244,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754476,"statfs":{"total":773094113280,"available":772868583424,"internally_reserved":0,"allocated":4169728,"data_stored":2316277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001414"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.141701+0000","last_change":"2024-03-30T13:12:04.141701+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.141701+0000","last_undegraded":"2024-03-30T13:12:04.141701+0000","last_fullsized":"2024-03-30T13:12:04.141701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184893+0000","last_change":"2024-03-30T13:12:05.197119+0000","last_active":"2024-03-30T13:12:07.184893+0000","last_peered":"2024-03-30T13:12:07.184893+0000","last_clean":"2024-03-30T13:12:07.184893+0000","last_became_active":"2024-03-30T13:12:05.189811+0000","last_became_peered":"2024-03-30T13:12:05.189811+0000","last_unstale":"2024-03-30T13:12:07.184893+0000","last_undegraded":"2024-03-30T13:12:07.184893+0000","last_fullsized":"2024-03-30T13:12:07.184893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.148195+0000","last_change":"2024-03-30T13:12:04.148195+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.148195+0000","last_undegraded":"2024-03-30T13:12:04.148195+0000","last_fullsized":"2024-03-30T13:12:04.148195+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631004+0000","last_change":"2024-03-30T13:12:05.195748+0000","last_active":"2024-03-30T13:12:07.631004+0000","last_peered":"2024-03-30T13:12:07.631004+0000","last_clean":"2024-03-30T13:12:07.631004+0000","last_became_active":"2024-03-30T13:12:05.194975+0000","last_became_peered":"2024-03-30T13:12:05.194975+0000","last_unstale":"2024-03-30T13:12:07.631004+0000","last_undegraded":"2024-03-30T13:12:07.631004+0000","last_fullsized":"2024-03-30T13:12:07.631004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:21:53.293558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184896+0000","last_change":"2024-03-30T13:12:05.197297+0000","last_active":"2024-03-30T13:12:07.184896+0000","last_peered":"2024-03-30T13:12:07.184896+0000","last_clean":"2024-03-30T13:12:07.184896+0000","last_became_active":"2024-03-30T13:12:05.196664+0000","last_became_peered":"2024-03-30T13:12:05.196664+0000","last_unstale":"2024-03-30T13:12:07.184896+0000","last_undegraded":"2024-03-30T13:12:07.184896+0000","last_fullsized":"2024-03-30T13:12:07.184896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198172+0000","last_change":"2024-03-30T13:12:05.200209+0000","last_active":"2024-03-30T13:12:06.198172+0000","last_peered":"2024-03-30T13:12:06.198172+0000","last_clean":"2024-03-30T13:12:06.198172+0000","last_became_active":"2024-03-30T13:12:05.193470+0000","last_became_peered":"2024-03-30T13:12:05.193470+0000","last_unstale":"2024-03-30T13:12:06.198172+0000","last_undegraded":"2024-03-30T13:12:06.198172+0000","last_fullsized":"2024-03-30T13:12:06.198172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:14:38.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.141050+0000","last_change":"2024-03-30T13:12:04.141050+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.141050+0000","last_undegraded":"2024-03-30T13:12:04.141050+0000","last_fullsized":"2024-03-30T13:12:04.141050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.135360+0000","last_change":"2024-03-30T13:12:04.135360+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.135360+0000","last_undegraded":"2024-03-30T13:12:04.135360+0000","last_fullsized":"2024-03-30T13:12:04.135360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.150523+0000","last_change":"2024-03-30T13:12:04.150523+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.150523+0000","last_undegraded":"2024-03-30T13:12:04.150523+0000","last_fullsized":"2024-03-30T13:12:04.150523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631308+0000","last_change":"2024-03-30T13:12:05.193985+0000","last_active":"2024-03-30T13:12:07.631308+0000","last_peered":"2024-03-30T13:12:07.631308+0000","last_clean":"2024-03-30T13:12:07.631308+0000","last_became_active":"2024-03-30T13:12:05.193520+0000","last_became_peered":"2024-03-30T13:12:05.193520+0000","last_unstale":"2024-03-30T13:12:07.631308+0000","last_undegraded":"2024-03-30T13:12:07.631308+0000","last_fullsized":"2024-03-30T13:12:07.631308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:11.335766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.153720+0000","last_change":"2024-03-30T13:12:04.153720+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.153720+0000","last_undegraded":"2024-03-30T13:12:04.153720+0000","last_fullsized":"2024-03-30T13:12:04.153720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.147400+0000","last_change":"2024-03-30T13:12:04.147400+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.147400+0000","last_undegraded":"2024-03-30T13:12:04.147400+0000","last_fullsized":"2024-03-30T13:12:04.147400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473411+0000","last_change":"2024-03-30T13:12:05.190953+0000","last_active":"2024-03-30T13:12:07.473411+0000","last_peered":"2024-03-30T13:12:07.473411+0000","last_clean":"2024-03-30T13:12:07.473411+0000","last_became_active":"2024-03-30T13:12:05.190117+0000","last_became_peered":"2024-03-30T13:12:05.190117+0000","last_unstale":"2024-03-30T13:12:07.473411+0000","last_undegraded":"2024-03-30T13:12:07.473411+0000","last_fullsized":"2024-03-30T13:12:07.473411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630995+0000","last_change":"2024-03-30T13:12:05.189430+0000","last_active":"2024-03-30T13:12:07.630995+0000","last_peered":"2024-03-30T13:12:07.630995+0000","last_clean":"2024-03-30T13:12:07.630995+0000","last_became_active":"2024-03-30T13:12:05.188612+0000","last_became_peered":"2024-03-30T13:12:05.188612+0000","last_unstale":"2024-03-30T13:12:07.630995+0000","last_undegraded":"2024-03-30T13:12:07.630995+0000","last_fullsized":"2024-03-30T13:12:07.630995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:35:26.826667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126085+0000","last_change":"2024-03-30T13:12:04.126085+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126085+0000","last_undegraded":"2024-03-30T13:12:04.126085+0000","last_fullsized":"2024-03-30T13:12:04.126085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126001+0000","last_change":"2024-03-30T13:12:04.126001+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126001+0000","last_undegraded":"2024-03-30T13:12:04.126001+0000","last_fullsized":"2024-03-30T13:12:04.126001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.150815+0000","last_change":"2024-03-30T13:12:04.150815+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.150815+0000","last_undegraded":"2024-03-30T13:12:04.150815+0000","last_fullsized":"2024-03-30T13:12:04.150815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198673+0000","last_change":"2024-03-30T13:12:05.202224+0000","last_active":"2024-03-30T13:12:06.198673+0000","last_peered":"2024-03-30T13:12:06.198673+0000","last_clean":"2024-03-30T13:12:06.198673+0000","last_became_active":"2024-03-30T13:12:05.201944+0000","last_became_peered":"2024-03-30T13:12:05.201944+0000","last_unstale":"2024-03-30T13:12:06.198673+0000","last_undegraded":"2024-03-30T13:12:06.198673+0000","last_fullsized":"2024-03-30T13:12:06.198673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:58.129468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198924+0000","last_change":"2024-03-30T13:12:05.194980+0000","last_active":"2024-03-30T13:12:06.198924+0000","last_peered":"2024-03-30T13:12:06.198924+0000","last_clean":"2024-03-30T13:12:06.198924+0000","last_became_active":"2024-03-30T13:12:05.194702+0000","last_became_peered":"2024-03-30T13:12:05.194702+0000","last_unstale":"2024-03-30T13:12:06.198924+0000","last_undegraded":"2024-03-30T13:12:06.198924+0000","last_fullsized":"2024-03-30T13:12:06.198924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:09.286734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472876+0000","last_change":"2024-03-30T13:12:05.189386+0000","last_active":"2024-03-30T13:12:07.472876+0000","last_peered":"2024-03-30T13:12:07.472876+0000","last_clean":"2024-03-30T13:12:07.472876+0000","last_became_active":"2024-03-30T13:12:05.189025+0000","last_became_peered":"2024-03-30T13:12:05.189025+0000","last_unstale":"2024-03-30T13:12:07.472876+0000","last_undegraded":"2024-03-30T13:12:07.472876+0000","last_fullsized":"2024-03-30T13:12:07.472876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126394+0000","last_change":"2024-03-30T13:12:04.126394+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126394+0000","last_undegraded":"2024-03-30T13:12:04.126394+0000","last_fullsized":"2024-03-30T13:12:04.126394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.135164+0000","last_change":"2024-03-30T13:12:04.135164+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.135164+0000","last_undegraded":"2024-03-30T13:12:04.135164+0000","last_fullsized":"2024-03-30T13:12:04.135164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472492+0000","last_change":"2024-03-30T13:12:05.196711+0000","last_active":"2024-03-30T13:12:07.472492+0000","last_peered":"2024-03-30T13:12:07.472492+0000","last_clean":"2024-03-30T13:12:07.472492+0000","last_became_active":"2024-03-30T13:12:05.196491+0000","last_became_peered":"2024-03-30T13:12:05.196491+0000","last_unstale":"2024-03-30T13:12:07.472492+0000","last_undegraded":"2024-03-30T13:12:07.472492+0000","last_fullsized":"2024-03-30T13:12:07.472492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:19:59.448920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.134707+0000","last_change":"2024-03-30T13:12:04.134707+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.134707+0000","last_undegraded":"2024-03-30T13:12:04.134707+0000","last_fullsized":"2024-03-30T13:12:04.134707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631777+0000","last_change":"2024-03-30T13:12:05.196765+0000","last_active":"2024-03-30T13:12:07.631777+0000","last_peered":"2024-03-30T13:12:07.631777+0000","last_clean":"2024-03-30T13:12:07.631777+0000","last_became_active":"2024-03-30T13:12:05.196494+0000","last_became_peered":"2024-03-30T13:12:05.196494+0000","last_unstale":"2024-03-30T13:12:07.631777+0000","last_undegraded":"2024-03-30T13:12:07.631777+0000","last_fullsized":"2024-03-30T13:12:07.631777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:04:04.845593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631641+0000","last_change":"2024-03-30T13:12:05.195759+0000","last_active":"2024-03-30T13:12:07.631641+0000","last_peered":"2024-03-30T13:12:07.631641+0000","last_clean":"2024-03-30T13:12:07.631641+0000","last_became_active":"2024-03-30T13:12:05.194287+0000","last_became_peered":"2024-03-30T13:12:05.194287+0000","last_unstale":"2024-03-30T13:12:07.631641+0000","last_undegraded":"2024-03-30T13:12:07.631641+0000","last_fullsized":"2024-03-30T13:12:07.631641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:42.770626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184547+0000","last_change":"2024-03-30T13:12:05.193501+0000","last_active":"2024-03-30T13:12:07.184547+0000","last_peered":"2024-03-30T13:12:07.184547+0000","last_clean":"2024-03-30T13:12:07.184547+0000","last_became_active":"2024-03-30T13:12:05.193217+0000","last_became_peered":"2024-03-30T13:12:05.193217+0000","last_unstale":"2024-03-30T13:12:07.184547+0000","last_undegraded":"2024-03-30T13:12:07.184547+0000","last_fullsized":"2024-03-30T13:12:07.184547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.140189+0000","last_change":"2024-03-30T13:12:04.140189+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.140189+0000","last_undegraded":"2024-03-30T13:12:04.140189+0000","last_fullsized":"2024-03-30T13:12:04.140189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.127572+0000","last_change":"2024-03-30T13:12:04.127572+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.127572+0000","last_undegraded":"2024-03-30T13:12:04.127572+0000","last_fullsized":"2024-03-30T13:12:04.127572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.127523+0000","last_change":"2024-03-30T13:12:04.127523+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.127523+0000","last_undegraded":"2024-03-30T13:12:04.127523+0000","last_fullsized":"2024-03-30T13:12:04.127523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.136357+0000","last_change":"2024-03-30T13:12:04.136357+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.136357+0000","last_undegraded":"2024-03-30T13:12:04.136357+0000","last_fullsized":"2024-03-30T13:12:04.136357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.147562+0000","last_change":"2024-03-30T13:12:04.147562+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.147562+0000","last_undegraded":"2024-03-30T13:12:04.147562+0000","last_fullsized":"2024-03-30T13:12:04.147562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473000+0000","last_change":"2024-03-30T13:12:05.203814+0000","last_active":"2024-03-30T13:12:07.473000+0000","last_peered":"2024-03-30T13:12:07.473000+0000","last_clean":"2024-03-30T13:12:07.473000+0000","last_became_active":"2024-03-30T13:12:05.203408+0000","last_became_peered":"2024-03-30T13:12:05.203408+0000","last_unstale":"2024-03-30T13:12:07.473000+0000","last_undegraded":"2024-03-30T13:12:07.473000+0000","last_fullsized":"2024-03-30T13:12:07.473000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.163919+0000","last_change":"2024-03-30T13:12:04.161934+0000","last_active":"2024-03-30T13:12:04.163919+0000","last_peered":"2024-03-30T13:12:04.163919+0000","last_clean":"2024-03-30T13:12:04.163919+0000","last_became_active":"2024-03-30T13:12:04.161721+0000","last_became_peered":"2024-03-30T13:12:04.161721+0000","last_unstale":"2024-03-30T13:12:04.163919+0000","last_undegraded":"2024-03-30T13:12:04.163919+0000","last_fullsized":"2024-03-30T13:12:04.163919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:59.135017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.133498+0000","last_change":"2024-03-30T13:12:04.133498+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.133498+0000","last_undegraded":"2024-03-30T13:12:04.133498+0000","last_fullsized":"2024-03-30T13:12:04.133498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631425+0000","last_change":"2024-03-30T13:12:04.156757+0000","last_active":"2024-03-30T13:12:07.631425+0000","last_peered":"2024-03-30T13:12:07.631425+0000","last_clean":"2024-03-30T13:12:07.631425+0000","last_became_active":"2024-03-30T13:12:04.156049+0000","last_became_peered":"2024-03-30T13:12:04.156049+0000","last_unstale":"2024-03-30T13:12:07.631425+0000","last_undegraded":"2024-03-30T13:12:07.631425+0000","last_fullsized":"2024-03-30T13:12:07.631425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:54.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.139641+0000","last_change":"2024-03-30T13:12:04.139641+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.139641+0000","last_undegraded":"2024-03-30T13:12:04.139641+0000","last_fullsized":"2024-03-30T13:12:04.139641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199295+0000","last_change":"2024-03-30T13:12:04.160804+0000","last_active":"2024-03-30T13:12:06.199295+0000","last_peered":"2024-03-30T13:12:06.199295+0000","last_clean":"2024-03-30T13:12:06.199295+0000","last_became_active":"2024-03-30T13:12:04.160592+0000","last_became_peered":"2024-03-30T13:12:04.160592+0000","last_unstale":"2024-03-30T13:12:06.199295+0000","last_undegraded":"2024-03-30T13:12:06.199295+0000","last_fullsized":"2024-03-30T13:12:06.199295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:48.643179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631257+0000","last_change":"2024-03-30T13:12:05.198359+0000","last_active":"2024-03-30T13:12:07.631257+0000","last_peered":"2024-03-30T13:12:07.631257+0000","last_clean":"2024-03-30T13:12:07.631257+0000","last_became_active":"2024-03-30T13:12:05.197998+0000","last_became_peered":"2024-03-30T13:12:05.197998+0000","last_unstale":"2024-03-30T13:12:07.631257+0000","last_undegraded":"2024-03-30T13:12:07.631257+0000","last_fullsized":"2024-03-30T13:12:07.631257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:38.341209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631575+0000","last_change":"2024-03-30T13:12:04.160626+0000","last_active":"2024-03-30T13:12:07.631575+0000","last_peered":"2024-03-30T13:12:07.631575+0000","last_clean":"2024-03-30T13:12:07.631575+0000","last_became_active":"2024-03-30T13:12:04.160357+0000","last_became_peered":"2024-03-30T13:12:04.160357+0000","last_unstale":"2024-03-30T13:12:07.631575+0000","last_undegraded":"2024-03-30T13:12:07.631575+0000","last_fullsized":"2024-03-30T13:12:07.631575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:06:07.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.146171+0000","last_change":"2024-03-30T13:12:04.146171+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.146171+0000","last_undegraded":"2024-03-30T13:12:04.146171+0000","last_fullsized":"2024-03-30T13:12:04.146171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.155450+0000","last_change":"2024-03-30T13:12:04.150040+0000","last_active":"2024-03-30T13:12:04.155450+0000","last_peered":"2024-03-30T13:12:04.155450+0000","last_clean":"2024-03-30T13:12:04.155450+0000","last_became_active":"2024-03-30T13:12:04.149747+0000","last_became_peered":"2024-03-30T13:12:04.149747+0000","last_unstale":"2024-03-30T13:12:04.155450+0000","last_undegraded":"2024-03-30T13:12:04.155450+0000","last_fullsized":"2024-03-30T13:12:04.155450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:39:14.217210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.137242+0000","last_change":"2024-03-30T13:12:04.137242+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.137242+0000","last_undegraded":"2024-03-30T13:12:04.137242+0000","last_fullsized":"2024-03-30T13:12:04.137242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.154437+0000","last_change":"2024-03-30T13:12:04.149618+0000","last_active":"2024-03-30T13:12:04.154437+0000","last_peered":"2024-03-30T13:12:04.154437+0000","last_clean":"2024-03-30T13:12:04.154437+0000","last_became_active":"2024-03-30T13:12:04.149252+0000","last_became_peered":"2024-03-30T13:12:04.149252+0000","last_unstale":"2024-03-30T13:12:04.154437+0000","last_undegraded":"2024-03-30T13:12:04.154437+0000","last_fullsized":"2024-03-30T13:12:04.154437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:28.166977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.141830+0000","last_change":"2024-03-30T13:12:04.141830+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.141830+0000","last_undegraded":"2024-03-30T13:12:04.141830+0000","last_fullsized":"2024-03-30T13:12:04.141830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198401+0000","last_change":"2024-03-30T13:12:04.157894+0000","last_active":"2024-03-30T13:12:06.198401+0000","last_peered":"2024-03-30T13:12:06.198401+0000","last_clean":"2024-03-30T13:12:06.198401+0000","last_became_active":"2024-03-30T13:12:04.157491+0000","last_became_peered":"2024-03-30T13:12:04.157491+0000","last_unstale":"2024-03-30T13:12:06.198401+0000","last_undegraded":"2024-03-30T13:12:06.198401+0000","last_fullsized":"2024-03-30T13:12:06.198401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:34:25.438955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630535+0000","last_change":"2024-03-30T13:12:05.199546+0000","last_active":"2024-03-30T13:12:07.630535+0000","last_peered":"2024-03-30T13:12:07.630535+0000","last_clean":"2024-03-30T13:12:07.630535+0000","last_became_active":"2024-03-30T13:12:05.199239+0000","last_became_peered":"2024-03-30T13:12:05.199239+0000","last_unstale":"2024-03-30T13:12:07.630535+0000","last_undegraded":"2024-03-30T13:12:07.630535+0000","last_fullsized":"2024-03-30T13:12:07.630535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:28.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.159716+0000","last_change":"2024-03-30T13:12:04.155737+0000","last_active":"2024-03-30T13:12:04.159716+0000","last_peered":"2024-03-30T13:12:04.159716+0000","last_clean":"2024-03-30T13:12:04.159716+0000","last_became_active":"2024-03-30T13:12:04.155473+0000","last_became_peered":"2024-03-30T13:12:04.155473+0000","last_unstale":"2024-03-30T13:12:04.159716+0000","last_undegraded":"2024-03-30T13:12:04.159716+0000","last_fullsized":"2024-03-30T13:12:04.159716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:07:16.905846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.144841+0000","last_change":"2024-03-30T13:12:04.144841+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.144841+0000","last_undegraded":"2024-03-30T13:12:04.144841+0000","last_fullsized":"2024-03-30T13:12:04.144841+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184977+0000","last_change":"2024-03-30T13:12:04.152194+0000","last_active":"2024-03-30T13:12:07.184977+0000","last_peered":"2024-03-30T13:12:07.184977+0000","last_clean":"2024-03-30T13:12:07.184977+0000","last_became_active":"2024-03-30T13:12:04.151844+0000","last_became_peered":"2024-03-30T13:12:04.151844+0000","last_unstale":"2024-03-30T13:12:07.184977+0000","last_undegraded":"2024-03-30T13:12:07.184977+0000","last_fullsized":"2024-03-30T13:12:07.184977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.632067+0000","last_change":"2024-03-30T13:12:05.191219+0000","last_active":"2024-03-30T13:12:07.632067+0000","last_peered":"2024-03-30T13:12:07.632067+0000","last_clean":"2024-03-30T13:12:07.632067+0000","last_became_active":"2024-03-30T13:12:05.187503+0000","last_became_peered":"2024-03-30T13:12:05.187503+0000","last_unstale":"2024-03-30T13:12:07.632067+0000","last_undegraded":"2024-03-30T13:12:07.632067+0000","last_fullsized":"2024-03-30T13:12:07.632067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:34:30.445284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184510+0000","last_change":"2024-03-30T13:12:04.151674+0000","last_active":"2024-03-30T13:12:07.184510+0000","last_peered":"2024-03-30T13:12:07.184510+0000","last_clean":"2024-03-30T13:12:07.184510+0000","last_became_active":"2024-03-30T13:12:04.151273+0000","last_became_peered":"2024-03-30T13:12:04.151273+0000","last_unstale":"2024-03-30T13:12:07.184510+0000","last_undegraded":"2024-03-30T13:12:07.184510+0000","last_fullsized":"2024-03-30T13:12:07.184510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:35:19.563529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631362+0000","last_change":"2024-03-30T13:12:05.195768+0000","last_active":"2024-03-30T13:12:07.631362+0000","last_peered":"2024-03-30T13:12:07.631362+0000","last_clean":"2024-03-30T13:12:07.631362+0000","last_became_active":"2024-03-30T13:12:05.190015+0000","last_became_peered":"2024-03-30T13:12:05.190015+0000","last_unstale":"2024-03-30T13:12:07.631362+0000","last_undegraded":"2024-03-30T13:12:07.631362+0000","last_fullsized":"2024-03-30T13:12:07.631362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:45:05.346910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.161184+0000","last_change":"2024-03-30T13:12:04.158663+0000","last_active":"2024-03-30T13:12:04.161184+0000","last_peered":"2024-03-30T13:12:04.161184+0000","last_clean":"2024-03-30T13:12:04.161184+0000","last_became_active":"2024-03-30T13:12:04.154124+0000","last_became_peered":"2024-03-30T13:12:04.154124+0000","last_unstale":"2024-03-30T13:12:04.161184+0000","last_undegraded":"2024-03-30T13:12:04.161184+0000","last_fullsized":"2024-03-30T13:12:04.161184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:19:58.443719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.144722+0000","last_change":"2024-03-30T13:12:04.144722+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.144722+0000","last_undegraded":"2024-03-30T13:12:04.144722+0000","last_fullsized":"2024-03-30T13:12:04.144722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472817+0000","last_change":"2024-03-30T13:12:04.157305+0000","last_active":"2024-03-30T13:12:07.472817+0000","last_peered":"2024-03-30T13:12:07.472817+0000","last_clean":"2024-03-30T13:12:07.472817+0000","last_became_active":"2024-03-30T13:12:04.156997+0000","last_became_peered":"2024-03-30T13:12:04.156997+0000","last_unstale":"2024-03-30T13:12:07.472817+0000","last_undegraded":"2024-03-30T13:12:07.472817+0000","last_fullsized":"2024-03-30T13:12:07.472817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:01.032056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472534+0000","last_change":"2024-03-30T13:12:05.195191+0000","last_active":"2024-03-30T13:12:07.472534+0000","last_peered":"2024-03-30T13:12:07.472534+0000","last_clean":"2024-03-30T13:12:07.472534+0000","last_became_active":"2024-03-30T13:12:05.194888+0000","last_became_peered":"2024-03-30T13:12:05.194888+0000","last_unstale":"2024-03-30T13:12:07.472534+0000","last_undegraded":"2024-03-30T13:12:07.472534+0000","last_fullsized":"2024-03-30T13:12:07.472534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.164717+0000","last_change":"2024-03-30T13:12:04.160490+0000","last_active":"2024-03-30T13:12:04.164717+0000","last_peered":"2024-03-30T13:12:04.164717+0000","last_clean":"2024-03-30T13:12:04.164717+0000","last_became_active":"2024-03-30T13:12:04.160169+0000","last_became_peered":"2024-03-30T13:12:04.160169+0000","last_unstale":"2024-03-30T13:12:04.164717+0000","last_undegraded":"2024-03-30T13:12:04.164717+0000","last_fullsized":"2024-03-30T13:12:04.164717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:14.622222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631210+0000","last_change":"2024-03-30T13:12:05.201558+0000","last_active":"2024-03-30T13:12:07.631210+0000","last_peered":"2024-03-30T13:12:07.631210+0000","last_clean":"2024-03-30T13:12:07.631210+0000","last_became_active":"2024-03-30T13:12:05.198153+0000","last_became_peered":"2024-03-30T13:12:05.198153+0000","last_unstale":"2024-03-30T13:12:07.631210+0000","last_undegraded":"2024-03-30T13:12:07.631210+0000","last_fullsized":"2024-03-30T13:12:07.631210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:05:21.340816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631182+0000","last_change":"2024-03-30T13:12:04.159693+0000","last_active":"2024-03-30T13:12:07.631182+0000","last_peered":"2024-03-30T13:12:07.631182+0000","last_clean":"2024-03-30T13:12:07.631182+0000","last_became_active":"2024-03-30T13:12:04.159246+0000","last_became_peered":"2024-03-30T13:12:04.159246+0000","last_unstale":"2024-03-30T13:12:07.631182+0000","last_undegraded":"2024-03-30T13:12:07.631182+0000","last_fullsized":"2024-03-30T13:12:07.631182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:30.867699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.133960+0000","last_change":"2024-03-30T13:12:04.133960+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.133960+0000","last_undegraded":"2024-03-30T13:12:04.133960+0000","last_fullsized":"2024-03-30T13:12:04.133960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630232+0000","last_change":"2024-03-30T13:12:04.152863+0000","last_active":"2024-03-30T13:12:07.630232+0000","last_peered":"2024-03-30T13:12:07.630232+0000","last_clean":"2024-03-30T13:12:07.630232+0000","last_became_active":"2024-03-30T13:12:04.152533+0000","last_became_peered":"2024-03-30T13:12:04.152533+0000","last_unstale":"2024-03-30T13:12:07.630232+0000","last_undegraded":"2024-03-30T13:12:07.630232+0000","last_fullsized":"2024-03-30T13:12:07.630232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:01.032056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.146900+0000","last_change":"2024-03-30T13:12:04.146900+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.146900+0000","last_undegraded":"2024-03-30T13:12:04.146900+0000","last_fullsized":"2024-03-30T13:12:04.146900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198210+0000","last_change":"2024-03-30T13:12:04.158169+0000","last_active":"2024-03-30T13:12:06.198210+0000","last_peered":"2024-03-30T13:12:06.198210+0000","last_clean":"2024-03-30T13:12:06.198210+0000","last_became_active":"2024-03-30T13:12:04.157877+0000","last_became_peered":"2024-03-30T13:12:04.157877+0000","last_unstale":"2024-03-30T13:12:06.198210+0000","last_undegraded":"2024-03-30T13:12:06.198210+0000","last_fullsized":"2024-03-30T13:12:06.198210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:21:40.866398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.142745+0000","last_change":"2024-03-30T13:12:04.142745+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.142745+0000","last_undegraded":"2024-03-30T13:12:04.142745+0000","last_fullsized":"2024-03-30T13:12:04.142745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199102+0000","last_change":"2024-03-30T13:12:04.160389+0000","last_active":"2024-03-30T13:12:06.199102+0000","last_peered":"2024-03-30T13:12:06.199102+0000","last_clean":"2024-03-30T13:12:06.199102+0000","last_became_active":"2024-03-30T13:12:04.158808+0000","last_became_peered":"2024-03-30T13:12:04.158808+0000","last_unstale":"2024-03-30T13:12:06.199102+0000","last_undegraded":"2024-03-30T13:12:06.199102+0000","last_fullsized":"2024-03-30T13:12:06.199102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:21.807992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.148847+0000","last_change":"2024-03-30T13:12:04.148847+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.148847+0000","last_undegraded":"2024-03-30T13:12:04.148847+0000","last_fullsized":"2024-03-30T13:12:04.148847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.164720+0000","last_change":"2024-03-30T13:12:04.160282+0000","last_active":"2024-03-30T13:12:04.164720+0000","last_peered":"2024-03-30T13:12:04.164720+0000","last_clean":"2024-03-30T13:12:04.164720+0000","last_became_active":"2024-03-30T13:12:04.159950+0000","last_became_peered":"2024-03-30T13:12:04.159950+0000","last_unstale":"2024-03-30T13:12:04.164720+0000","last_undegraded":"2024-03-30T13:12:04.164720+0000","last_fullsized":"2024-03-30T13:12:04.164720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:27.651002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184613+0000","last_change":"2024-03-30T13:12:05.195404+0000","last_active":"2024-03-30T13:12:07.184613+0000","last_peered":"2024-03-30T13:12:07.184613+0000","last_clean":"2024-03-30T13:12:07.184613+0000","last_became_active":"2024-03-30T13:12:05.195140+0000","last_became_peered":"2024-03-30T13:12:05.195140+0000","last_unstale":"2024-03-30T13:12:07.184613+0000","last_undegraded":"2024-03-30T13:12:07.184613+0000","last_fullsized":"2024-03-30T13:12:07.184613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.166114+0000","last_change":"2024-03-30T13:12:04.164305+0000","last_active":"2024-03-30T13:12:04.166114+0000","last_peered":"2024-03-30T13:12:04.166114+0000","last_clean":"2024-03-30T13:12:04.166114+0000","last_became_active":"2024-03-30T13:12:04.163883+0000","last_became_peered":"2024-03-30T13:12:04.163883+0000","last_unstale":"2024-03-30T13:12:04.166114+0000","last_undegraded":"2024-03-30T13:12:04.166114+0000","last_fullsized":"2024-03-30T13:12:04.166114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:47.459513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198949+0000","last_change":"2024-03-30T13:12:05.203694+0000","last_active":"2024-03-30T13:12:06.198949+0000","last_peered":"2024-03-30T13:12:06.198949+0000","last_clean":"2024-03-30T13:12:06.198949+0000","last_became_active":"2024-03-30T13:12:05.203389+0000","last_became_peered":"2024-03-30T13:12:05.203389+0000","last_unstale":"2024-03-30T13:12:06.198949+0000","last_undegraded":"2024-03-30T13:12:06.198949+0000","last_fullsized":"2024-03-30T13:12:06.198949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:07.797910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.158821+0000","last_change":"2024-03-30T13:12:04.156484+0000","last_active":"2024-03-30T13:12:04.158821+0000","last_peered":"2024-03-30T13:12:04.158821+0000","last_clean":"2024-03-30T13:12:04.158821+0000","last_became_active":"2024-03-30T13:12:04.156142+0000","last_became_peered":"2024-03-30T13:12:04.156142+0000","last_unstale":"2024-03-30T13:12:04.158821+0000","last_undegraded":"2024-03-30T13:12:04.158821+0000","last_fullsized":"2024-03-30T13:12:04.158821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472751+0000","last_change":"2024-03-30T13:12:05.189181+0000","last_active":"2024-03-30T13:12:07.472751+0000","last_peered":"2024-03-30T13:12:07.472751+0000","last_clean":"2024-03-30T13:12:07.472751+0000","last_became_active":"2024-03-30T13:12:05.188836+0000","last_became_peered":"2024-03-30T13:12:05.188836+0000","last_unstale":"2024-03-30T13:12:07.472751+0000","last_undegraded":"2024-03-30T13:12:07.472751+0000","last_fullsized":"2024-03-30T13:12:07.472751+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184602+0000","last_change":"2024-03-30T13:12:04.160445+0000","last_active":"2024-03-30T13:12:07.184602+0000","last_peered":"2024-03-30T13:12:07.184602+0000","last_clean":"2024-03-30T13:12:07.184602+0000","last_became_active":"2024-03-30T13:12:04.159088+0000","last_became_peered":"2024-03-30T13:12:04.159088+0000","last_unstale":"2024-03-30T13:12:07.184602+0000","last_undegraded":"2024-03-30T13:12:07.184602+0000","last_fullsized":"2024-03-30T13:12:07.184602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:18.892572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184485+0000","last_change":"2024-03-30T13:12:05.206205+0000","last_active":"2024-03-30T13:12:07.184485+0000","last_peered":"2024-03-30T13:12:07.184485+0000","last_clean":"2024-03-30T13:12:07.184485+0000","last_became_active":"2024-03-30T13:12:05.205165+0000","last_became_peered":"2024-03-30T13:12:05.205165+0000","last_unstale":"2024-03-30T13:12:07.184485+0000","last_undegraded":"2024-03-30T13:12:07.184485+0000","last_fullsized":"2024-03-30T13:12:07.184485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.164762+0000","last_change":"2024-03-30T13:12:04.160477+0000","last_active":"2024-03-30T13:12:04.164762+0000","last_peered":"2024-03-30T13:12:04.164762+0000","last_clean":"2024-03-30T13:12:04.164762+0000","last_became_active":"2024-03-30T13:12:04.159861+0000","last_became_peered":"2024-03-30T13:12:04.159861+0000","last_unstale":"2024-03-30T13:12:04.164762+0000","last_undegraded":"2024-03-30T13:12:04.164762+0000","last_fullsized":"2024-03-30T13:12:04.164762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:34:22.185576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472282+0000","last_change":"2024-03-30T13:12:05.188342+0000","last_active":"2024-03-30T13:12:07.472282+0000","last_peered":"2024-03-30T13:12:07.472282+0000","last_clean":"2024-03-30T13:12:07.472282+0000","last_became_active":"2024-03-30T13:12:05.187979+0000","last_became_peered":"2024-03-30T13:12:05.187979+0000","last_unstale":"2024-03-30T13:12:07.472282+0000","last_undegraded":"2024-03-30T13:12:07.472282+0000","last_fullsized":"2024-03-30T13:12:07.472282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:21:11.680054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.158265+0000","last_change":"2024-03-30T13:12:04.153187+0000","last_active":"2024-03-30T13:12:04.158265+0000","last_peered":"2024-03-30T13:12:04.158265+0000","last_clean":"2024-03-30T13:12:04.158265+0000","last_became_active":"2024-03-30T13:12:04.151861+0000","last_became_peered":"2024-03-30T13:12:04.151861+0000","last_unstale":"2024-03-30T13:12:04.158265+0000","last_undegraded":"2024-03-30T13:12:04.158265+0000","last_fullsized":"2024-03-30T13:12:04.158265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:51.432156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.143872+0000","last_change":"2024-03-30T13:12:04.143872+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.143872+0000","last_undegraded":"2024-03-30T13:12:04.143872+0000","last_fullsized":"2024-03-30T13:12:04.143872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.166308+0000","last_change":"2024-03-30T13:12:04.163783+0000","last_active":"2024-03-30T13:12:04.166308+0000","last_peered":"2024-03-30T13:12:04.166308+0000","last_clean":"2024-03-30T13:12:04.166308+0000","last_became_active":"2024-03-30T13:12:04.163480+0000","last_became_peered":"2024-03-30T13:12:04.163480+0000","last_unstale":"2024-03-30T13:12:04.166308+0000","last_undegraded":"2024-03-30T13:12:04.166308+0000","last_fullsized":"2024-03-30T13:12:04.166308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:23.927066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199312+0000","last_change":"2024-03-30T13:12:05.201073+0000","last_active":"2024-03-30T13:12:06.199312+0000","last_peered":"2024-03-30T13:12:06.199312+0000","last_clean":"2024-03-30T13:12:06.199312+0000","last_became_active":"2024-03-30T13:12:05.197377+0000","last_became_peered":"2024-03-30T13:12:05.197377+0000","last_unstale":"2024-03-30T13:12:06.199312+0000","last_undegraded":"2024-03-30T13:12:06.199312+0000","last_fullsized":"2024-03-30T13:12:06.199312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:09.490280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472403+0000","last_change":"2024-03-30T13:12:04.138835+0000","last_active":"2024-03-30T13:12:07.472403+0000","last_peered":"2024-03-30T13:12:07.472403+0000","last_clean":"2024-03-30T13:12:07.472403+0000","last_became_active":"2024-03-30T13:12:04.138108+0000","last_became_peered":"2024-03-30T13:12:04.138108+0000","last_unstale":"2024-03-30T13:12:07.472403+0000","last_undegraded":"2024-03-30T13:12:07.472403+0000","last_fullsized":"2024-03-30T13:12:07.472403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:54.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.139844+0000","last_change":"2024-03-30T13:12:04.139844+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.139844+0000","last_undegraded":"2024-03-30T13:12:04.139844+0000","last_fullsized":"2024-03-30T13:12:04.139844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184886+0000","last_change":"2024-03-30T13:12:04.151193+0000","last_active":"2024-03-30T13:12:07.184886+0000","last_peered":"2024-03-30T13:12:07.184886+0000","last_clean":"2024-03-30T13:12:07.184886+0000","last_became_active":"2024-03-30T13:12:04.150870+0000","last_became_peered":"2024-03-30T13:12:04.150870+0000","last_unstale":"2024-03-30T13:12:07.184886+0000","last_undegraded":"2024-03-30T13:12:07.184886+0000","last_fullsized":"2024-03-30T13:12:07.184886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:10:39.110454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199433+0000","last_change":"2024-03-30T13:12:05.195497+0000","last_active":"2024-03-30T13:12:06.199433+0000","last_peered":"2024-03-30T13:12:06.199433+0000","last_clean":"2024-03-30T13:12:06.199433+0000","last_became_active":"2024-03-30T13:12:05.194357+0000","last_became_peered":"2024-03-30T13:12:05.194357+0000","last_unstale":"2024-03-30T13:12:06.199433+0000","last_undegraded":"2024-03-30T13:12:06.199433+0000","last_fullsized":"2024-03-30T13:12:06.199433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:27:20.267950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472991+0000","last_change":"2024-03-30T13:12:04.156791+0000","last_active":"2024-03-30T13:12:07.472991+0000","last_peered":"2024-03-30T13:12:07.472991+0000","last_clean":"2024-03-30T13:12:07.472991+0000","last_became_active":"2024-03-30T13:12:04.155722+0000","last_became_peered":"2024-03-30T13:12:04.155722+0000","last_unstale":"2024-03-30T13:12:07.472991+0000","last_undegraded":"2024-03-30T13:12:07.472991+0000","last_fullsized":"2024-03-30T13:12:07.472991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:06:07.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126417+0000","last_change":"2024-03-30T13:12:04.126417+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126417+0000","last_undegraded":"2024-03-30T13:12:04.126417+0000","last_fullsized":"2024-03-30T13:12:04.126417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473356+0000","last_change":"2024-03-30T13:12:04.145008+0000","last_active":"2024-03-30T13:12:07.473356+0000","last_peered":"2024-03-30T13:12:07.473356+0000","last_clean":"2024-03-30T13:12:07.473356+0000","last_became_active":"2024-03-30T13:12:04.144537+0000","last_became_peered":"2024-03-30T13:12:04.144537+0000","last_unstale":"2024-03-30T13:12:07.473356+0000","last_undegraded":"2024-03-30T13:12:07.473356+0000","last_fullsized":"2024-03-30T13:12:07.473356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:30.328150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631725+0000","last_change":"2024-03-30T13:12:05.198424+0000","last_active":"2024-03-30T13:12:07.631725+0000","last_peered":"2024-03-30T13:12:07.631725+0000","last_clean":"2024-03-30T13:12:07.631725+0000","last_became_active":"2024-03-30T13:12:05.197807+0000","last_became_peered":"2024-03-30T13:12:05.197807+0000","last_unstale":"2024-03-30T13:12:07.631725+0000","last_undegraded":"2024-03-30T13:12:07.631725+0000","last_fullsized":"2024-03-30T13:12:07.631725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:02.120513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472673+0000","last_change":"2024-03-30T13:12:04.156286+0000","last_active":"2024-03-30T13:12:07.472673+0000","last_peered":"2024-03-30T13:12:07.472673+0000","last_clean":"2024-03-30T13:12:07.472673+0000","last_became_active":"2024-03-30T13:12:04.155947+0000","last_became_peered":"2024-03-30T13:12:04.155947+0000","last_unstale":"2024-03-30T13:12:07.472673+0000","last_undegraded":"2024-03-30T13:12:07.472673+0000","last_fullsized":"2024-03-30T13:12:07.472673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:47:50.782317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630786+0000","last_change":"2024-03-30T13:12:05.193970+0000","last_active":"2024-03-30T13:12:07.630786+0000","last_peered":"2024-03-30T13:12:07.630786+0000","last_clean":"2024-03-30T13:12:07.630786+0000","last_became_active":"2024-03-30T13:12:05.193676+0000","last_became_peered":"2024-03-30T13:12:05.193676+0000","last_unstale":"2024-03-30T13:12:07.630786+0000","last_undegraded":"2024-03-30T13:12:07.630786+0000","last_fullsized":"2024-03-30T13:12:07.630786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:02.262900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.163158+0000","last_change":"2024-03-30T13:12:04.159232+0000","last_active":"2024-03-30T13:12:04.163158+0000","last_peered":"2024-03-30T13:12:04.163158+0000","last_clean":"2024-03-30T13:12:04.163158+0000","last_became_active":"2024-03-30T13:12:04.158956+0000","last_became_peered":"2024-03-30T13:12:04.158956+0000","last_unstale":"2024-03-30T13:12:04.163158+0000","last_undegraded":"2024-03-30T13:12:04.163158+0000","last_fullsized":"2024-03-30T13:12:04.163158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:43:39.942742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.138564+0000","last_change":"2024-03-30T13:12:04.138564+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.138564+0000","last_undegraded":"2024-03-30T13:12:04.138564+0000","last_fullsized":"2024-03-30T13:12:04.138564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630473+0000","last_change":"2024-03-30T13:12:04.156959+0000","last_active":"2024-03-30T13:12:07.630473+0000","last_peered":"2024-03-30T13:12:07.630473+0000","last_clean":"2024-03-30T13:12:07.630473+0000","last_became_active":"2024-03-30T13:12:04.156016+0000","last_became_peered":"2024-03-30T13:12:04.156016+0000","last_unstale":"2024-03-30T13:12:07.630473+0000","last_undegraded":"2024-03-30T13:12:07.630473+0000","last_fullsized":"2024-03-30T13:12:07.630473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-30T13:12:04.126023+0000","last_change":"2024-03-30T13:12:04.126023+0000","last_active":"2024-03-30T13:12:04.112860+0000","last_peered":"2024-03-30T13:12:04.112860+0000","last_clean":"2024-03-30T13:12:04.112860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:12:04.126023+0000","last_undegraded":"2024-03-30T13:12:04.126023+0000","last_fullsized":"2024-03-30T13:12:04.126023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.166095+0000","last_change":"2024-03-30T13:12:04.164087+0000","last_active":"2024-03-30T13:12:04.166095+0000","last_peered":"2024-03-30T13:12:04.166095+0000","last_clean":"2024-03-30T13:12:04.166095+0000","last_became_active":"2024-03-30T13:12:04.163450+0000","last_became_peered":"2024-03-30T13:12:04.163450+0000","last_unstale":"2024-03-30T13:12:04.166095+0000","last_undegraded":"2024-03-30T13:12:04.166095+0000","last_fullsized":"2024-03-30T13:12:04.166095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:16.635465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-30T13:12:04.145335+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:12:04.145335+0000","last_peered":"2024-03-30T13:12:04.145335+0000","last_clean":"2024-03-30T13:12:04.145335+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:12:04.145335+0000","last_undegraded":"2024-03-30T13:12:04.145335+0000","last_fullsized":"2024-03-30T13:12:04.145335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476757,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":137277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476757,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":721370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":151964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":741302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":151986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":150374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:12:10.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-03-30T13:12:10.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.141701+0000', 'last_change': '2024-03-30T13:12:04.141701+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.141701+0000', 'last_undegraded': '2024-03-30T13:12:04.141701+0000', 'last_fullsized': '2024-03-30T13:12:04.141701+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:12:10.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-03-30T13:12:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.148195+0000', 'last_change': '2024-03-30T13:12:04.148195+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.148195+0000', 'last_undegraded': '2024-03-30T13:12:04.148195+0000', 'last_fullsized': '2024-03-30T13:12:04.148195+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-30T13:12:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-03-30T13:12:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.141050+0000', 'last_change': '2024-03-30T13:12:04.141050+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.141050+0000', 'last_undegraded': '2024-03-30T13:12:04.141050+0000', 'last_fullsized': '2024-03-30T13:12:04.141050+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:12:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-03-30T13:12:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.135360+0000', 'last_change': '2024-03-30T13:12:04.135360+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.135360+0000', 'last_undegraded': '2024-03-30T13:12:04.135360+0000', 'last_fullsized': '2024-03-30T13:12:04.135360+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:12:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-03-30T13:12:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.150523+0000', 'last_change': '2024-03-30T13:12:04.150523+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.150523+0000', 'last_undegraded': '2024-03-30T13:12:04.150523+0000', 'last_fullsized': '2024-03-30T13:12:04.150523+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-30T13:12:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-03-30T13:12:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.153720+0000', 'last_change': '2024-03-30T13:12:04.153720+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.153720+0000', 'last_undegraded': '2024-03-30T13:12:04.153720+0000', 'last_fullsized': '2024-03-30T13:12:04.153720+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T13:12:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-03-30T13:12:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.147400+0000', 'last_change': '2024-03-30T13:12:04.147400+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.147400+0000', 'last_undegraded': '2024-03-30T13:12:04.147400+0000', 'last_fullsized': '2024-03-30T13:12:04.147400+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-30T13:12:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-03-30T13:12:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.126085+0000', 'last_change': '2024-03-30T13:12:04.126085+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.126085+0000', 'last_undegraded': '2024-03-30T13:12:04.126085+0000', 'last_fullsized': '2024-03-30T13:12:04.126085+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-30T13:12:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-03-30T13:12:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.126001+0000', 'last_change': '2024-03-30T13:12:04.126001+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.126001+0000', 'last_undegraded': '2024-03-30T13:12:04.126001+0000', 'last_fullsized': '2024-03-30T13:12:04.126001+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-30T13:12:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-03-30T13:12:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.150815+0000', 'last_change': '2024-03-30T13:12:04.150815+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.150815+0000', 'last_undegraded': '2024-03-30T13:12:04.150815+0000', 'last_fullsized': '2024-03-30T13:12:04.150815+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T13:12:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-03-30T13:12:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.126394+0000', 'last_change': '2024-03-30T13:12:04.126394+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.126394+0000', 'last_undegraded': '2024-03-30T13:12:04.126394+0000', 'last_fullsized': '2024-03-30T13:12:04.126394+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-30T13:12:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-03-30T13:12:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.135164+0000', 'last_change': '2024-03-30T13:12:04.135164+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.135164+0000', 'last_undegraded': '2024-03-30T13:12:04.135164+0000', 'last_fullsized': '2024-03-30T13:12:04.135164+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:12:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-03-30T13:12:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.134707+0000', 'last_change': '2024-03-30T13:12:04.134707+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.134707+0000', 'last_undegraded': '2024-03-30T13:12:04.134707+0000', 'last_fullsized': '2024-03-30T13:12:04.134707+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:12:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-03-30T13:12:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.140189+0000', 'last_change': '2024-03-30T13:12:04.140189+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.140189+0000', 'last_undegraded': '2024-03-30T13:12:04.140189+0000', 'last_fullsized': '2024-03-30T13:12:04.140189+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:12:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-03-30T13:12:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.127572+0000', 'last_change': '2024-03-30T13:12:04.127572+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.127572+0000', 'last_undegraded': '2024-03-30T13:12:04.127572+0000', 'last_fullsized': '2024-03-30T13:12:04.127572+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-30T13:12:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-03-30T13:12:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.127523+0000', 'last_change': '2024-03-30T13:12:04.127523+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.127523+0000', 'last_undegraded': '2024-03-30T13:12:04.127523+0000', 'last_fullsized': '2024-03-30T13:12:04.127523+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-30T13:12:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-03-30T13:12:10.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.136357+0000', 'last_change': '2024-03-30T13:12:04.136357+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.136357+0000', 'last_undegraded': '2024-03-30T13:12:04.136357+0000', 'last_fullsized': '2024-03-30T13:12:04.136357+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:12:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-03-30T13:12:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.147562+0000', 'last_change': '2024-03-30T13:12:04.147562+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.147562+0000', 'last_undegraded': '2024-03-30T13:12:04.147562+0000', 'last_fullsized': '2024-03-30T13:12:04.147562+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T13:12:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-03-30T13:12:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.133498+0000', 'last_change': '2024-03-30T13:12:04.133498+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.133498+0000', 'last_undegraded': '2024-03-30T13:12:04.133498+0000', 'last_fullsized': '2024-03-30T13:12:04.133498+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:12:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-03-30T13:12:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.139641+0000', 'last_change': '2024-03-30T13:12:04.139641+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.139641+0000', 'last_undegraded': '2024-03-30T13:12:04.139641+0000', 'last_fullsized': '2024-03-30T13:12:04.139641+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:12:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-03-30T13:12:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.146171+0000', 'last_change': '2024-03-30T13:12:04.146171+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.146171+0000', 'last_undegraded': '2024-03-30T13:12:04.146171+0000', 'last_fullsized': '2024-03-30T13:12:04.146171+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-30T13:12:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-03-30T13:12:10.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.137242+0000', 'last_change': '2024-03-30T13:12:04.137242+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.137242+0000', 'last_undegraded': '2024-03-30T13:12:04.137242+0000', 'last_fullsized': '2024-03-30T13:12:04.137242+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.141830+0000', 'last_change': '2024-03-30T13:12:04.141830+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.141830+0000', 'last_undegraded': '2024-03-30T13:12:04.141830+0000', 'last_fullsized': '2024-03-30T13:12:04.141830+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.144841+0000', 'last_change': '2024-03-30T13:12:04.144841+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.144841+0000', 'last_undegraded': '2024-03-30T13:12:04.144841+0000', 'last_fullsized': '2024-03-30T13:12:04.144841+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.144722+0000', 'last_change': '2024-03-30T13:12:04.144722+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.144722+0000', 'last_undegraded': '2024-03-30T13:12:04.144722+0000', 'last_fullsized': '2024-03-30T13:12:04.144722+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.133960+0000', 'last_change': '2024-03-30T13:12:04.133960+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.133960+0000', 'last_undegraded': '2024-03-30T13:12:04.133960+0000', 'last_fullsized': '2024-03-30T13:12:04.133960+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.146900+0000', 'last_change': '2024-03-30T13:12:04.146900+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.146900+0000', 'last_undegraded': '2024-03-30T13:12:04.146900+0000', 'last_fullsized': '2024-03-30T13:12:04.146900+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-03-30T13:12:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.142745+0000', 'last_change': '2024-03-30T13:12:04.142745+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.142745+0000', 'last_undegraded': '2024-03-30T13:12:04.142745+0000', 'last_fullsized': '2024-03-30T13:12:04.142745+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.148847+0000', 'last_change': '2024-03-30T13:12:04.148847+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.148847+0000', 'last_undegraded': '2024-03-30T13:12:04.148847+0000', 'last_fullsized': '2024-03-30T13:12:04.148847+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.143872+0000', 'last_change': '2024-03-30T13:12:04.143872+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.143872+0000', 'last_undegraded': '2024-03-30T13:12:04.143872+0000', 'last_fullsized': '2024-03-30T13:12:04.143872+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.139844+0000', 'last_change': '2024-03-30T13:12:04.139844+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.139844+0000', 'last_undegraded': '2024-03-30T13:12:04.139844+0000', 'last_fullsized': '2024-03-30T13:12:04.139844+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.126417+0000', 'last_change': '2024-03-30T13:12:04.126417+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.126417+0000', 'last_undegraded': '2024-03-30T13:12:04.126417+0000', 'last_fullsized': '2024-03-30T13:12:04.126417+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.138564+0000', 'last_change': '2024-03-30T13:12:04.138564+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.138564+0000', 'last_undegraded': '2024-03-30T13:12:04.138564+0000', 'last_fullsized': '2024-03-30T13:12:04.138564+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-03-30T13:12:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-30T13:12:04.126023+0000', 'last_change': '2024-03-30T13:12:04.126023+0000', 'last_active': '2024-03-30T13:12:04.112860+0000', 'last_peered': '2024-03-30T13:12:04.112860+0000', 'last_clean': '2024-03-30T13:12:04.112860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T13:12:04.126023+0000', 'last_undegraded': '2024-03-30T13:12:04.126023+0000', 'last_fullsized': '2024-03-30T13:12:04.126023+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'last_clean_scrub_stamp': '2024-03-30T13:12:04.112860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-30T13:12:10.589 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-30T13:12:10.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.826+0000 7f62de400640 1 Processor -- start 2024-03-30T13:12:10.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.826+0000 7f62de400640 1 -- start start 2024-03-30T13:12:10.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.828+0000 7f62de400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f62d8071fe0 0x7f62d806e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.828+0000 7f62de400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d806d930 0x7f62d80adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.828+0000 7f62de400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62d806eee0 con 0x7f62d8161e00 2024-03-30T13:12:10.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.828+0000 7f62de400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f62d81621e0 con 0x7f62d8071fe0 2024-03-30T13:12:10.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.828+0000 7f62de400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f62d806f1c0 con 0x7f62d806d930 2024-03-30T13:12:10.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.828+0000 7f62cea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f62d8071fe0 0x7f62d806e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.828+0000 7f62cea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f62d8071fe0 0x7f62d806e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42436/0 (socket says 172.21.15.99:42436) 2024-03-30T13:12:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.828+0000 7f62cea00640 1 -- 172.21.15.99:0/4110260523 learned_addr learned my addr 172.21.15.99:0/4110260523 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.829+0000 7f62d7e00640 1 --2- 172.21.15.99:0/4110260523 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d806d930 0x7f62d80adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.829+0000 7f62cea00640 1 -- 172.21.15.99:0/4110260523 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d806d930 msgr2=0x7f62d80adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:10.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.829+0000 7f62cea00640 1 --2- 172.21.15.99:0/4110260523 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d806d930 0x7f62d80adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.829+0000 7f62cea00640 1 -- 172.21.15.99:0/4110260523 >> v1:172.21.15.181:6789/0 conn(0x7f62d8161e00 legacy=0x7f62d80718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:10.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.829+0000 7f62cea00640 1 -- 172.21.15.99:0/4110260523 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d80ad3b0 con 0x7f62d8071fe0 2024-03-30T13:12:10.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.829+0000 7f62d7e00640 1 --2- 172.21.15.99:0/4110260523 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d806d930 0x7f62d80adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:10.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.830+0000 7f62cea00640 1 --2- 172.21.15.99:0/4110260523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62d8071fe0 0x7f62d806e850 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009870 tx=0x7f62c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f723d9d6c8fc6b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.830+0000 7f62d6a00640 1 -- 172.21.15.99:0/4110260523 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0035020 con 0x7f62d8071fe0 2024-03-30T13:12:10.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.830+0000 7f62d6a00640 1 -- 172.21.15.99:0/4110260523 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c0031640 con 0x7f62d8071fe0 2024-03-30T13:12:10.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.830+0000 7f62d6a00640 1 -- 172.21.15.99:0/4110260523 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c002d040 con 0x7f62d8071fe0 2024-03-30T13:12:10.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.831+0000 7f62de400640 1 -- 172.21.15.99:0/4110260523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62d8071fe0 msgr2=0x7f62d806e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.831+0000 7f62de400640 1 --2- 172.21.15.99:0/4110260523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62d8071fe0 0x7f62d806e850 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009870 tx=0x7f62c002b8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.831+0000 7f62de400640 1 -- 172.21.15.99:0/4110260523 shutdown_connections 2024-03-30T13:12:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.831+0000 7f62de400640 1 --2- 172.21.15.99:0/4110260523 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d806d930 0x7f62d80adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.831+0000 7f62de400640 1 --2- 172.21.15.99:0/4110260523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62d8071fe0 0x7f62d806e850 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.831+0000 7f62de400640 1 -- 172.21.15.99:0/4110260523 >> 172.21.15.99:0/4110260523 conn(0x7f62d806b510 msgr2=0x7f62d806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.831+0000 7f62de400640 1 -- 172.21.15.99:0/4110260523 shutdown_connections 2024-03-30T13:12:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.831+0000 7f62de400640 1 -- 172.21.15.99:0/4110260523 wait complete. 2024-03-30T13:12:10.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.833+0000 7f62de400640 1 Processor -- start 2024-03-30T13:12:10.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.833+0000 7f62de400640 1 -- start start 2024-03-30T13:12:10.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.834+0000 7f62de400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62d806d930 0x7f62d814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.834+0000 7f62de400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d8071fe0 0x7f62d8159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.834+0000 7f62de400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62d8161e00 0x7f62d815f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.834+0000 7f62de400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f62d80ae0f0 con 0x7f62d8161e00 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.834+0000 7f62de400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f62d80b5270 con 0x7f62d806d930 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.834+0000 7f62de400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f62d80ae270 con 0x7f62d8071fe0 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.834+0000 7f62d7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62d8161e00 0x7f62d815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.834+0000 7f62d7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62d8161e00 0x7f62d815f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42438/0 (socket says 172.21.15.99:42438) 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.834+0000 7f62d7e00640 1 -- 172.21.15.99:0/3264443182 learned_addr learned my addr 172.21.15.99:0/3264443182 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.834+0000 7f62d7400640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62d806d930 0x7f62d814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62cea00640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d8071fe0 0x7f62d8159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62d7e00640 1 -- 172.21.15.99:0/3264443182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d8071fe0 msgr2=0x7f62d8159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62d7e00640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d8071fe0 0x7f62d8159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62d7e00640 1 -- 172.21.15.99:0/3264443182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62d806d930 msgr2=0x7f62d814b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62d7e00640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62d806d930 0x7f62d814b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62d7e00640 1 -- 172.21.15.99:0/3264443182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d8158e50 con 0x7f62d8161e00 2024-03-30T13:12:10.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62cea00640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d8071fe0 0x7f62d8159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:10.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62d7400640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62d806d930 0x7f62d814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:10.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62d7e00640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62d8161e00 0x7f62d815f320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f62d000c7f0 tx=0x7f62d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62cfe00640 1 -- 172.21.15.99:0/3264443182 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d0015070 con 0x7f62d8161e00 2024-03-30T13:12:10.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62cfe00640 1 -- 172.21.15.99:0/3264443182 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d0007820 con 0x7f62d8161e00 2024-03-30T13:12:10.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62de400640 1 -- 172.21.15.99:0/3264443182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d8159130 con 0x7f62d8161e00 2024-03-30T13:12:10.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62cfe00640 1 -- 172.21.15.99:0/3264443182 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d0007c50 con 0x7f62d8161e00 2024-03-30T13:12:10.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.835+0000 7f62de400640 1 -- 172.21.15.99:0/3264443182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d81596f0 con 0x7f62d8161e00 2024-03-30T13:12:10.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.836+0000 7f62de400640 1 -- 172.21.15.99:0/3264443182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d80b2ea0 con 0x7f62d8161e00 2024-03-30T13:12:10.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.837+0000 7f62cfe00640 1 -- 172.21.15.99:0/3264443182 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f62d0018070 con 0x7f62d8161e00 2024-03-30T13:12:10.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.838+0000 7f62cfe00640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f62b406c530 0x7f62b406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.838+0000 7f62cfe00640 1 -- 172.21.15.99:0/3264443182 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f62d008b8a0 con 0x7f62d8161e00 2024-03-30T13:12:10.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.839+0000 7f62d7400640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f62b406c530 0x7f62b406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.839+0000 7f62d7400640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f62b406c530 0x7f62b406e9f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f62c8007e90 tx=0x7f62c80073a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:10.843+0000 7f62cfe00640 1 -- 172.21.15.99:0/3264443182 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f62d80b2ea0 con 0x7f62d8161e00 2024-03-30T13:12:11.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.117+0000 7f62de400640 1 -- 172.21.15.99:0/3264443182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f62d80b1080 con 0x7f62d8161e00 2024-03-30T13:12:11.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.118+0000 7f62cfe00640 1 -- 172.21.15.99:0/3264443182 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1097 (secure 0 0 0) 0x7f62d80b1080 con 0x7f62d8161e00 2024-03-30T13:12:11.122 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:11.122 INFO:teuthology.orchestra.run.smithi099.stdout:{"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":110,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1711804233,"num_in_osds":8,"osd_in_since":1711804224,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":63},{"state_name":"creating+peering","count":34}],"num_pgs":97,"num_pools":3,"num_objects":16,"data_bytes":592002,"bytes_used":225529856,"bytes_avail":772868583424,"bytes_total":773094113280,"inactive_pgs_ratio":0.3505154550075531,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5121}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-03-30T13:11:53.456508+0000","services":{}},"progress_events":{}} 2024-03-30T13:12:11.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.120+0000 7f62de400640 1 -- 172.21.15.99:0/3264443182 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f62b406c530 msgr2=0x7f62b406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.120+0000 7f62de400640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f62b406c530 0x7f62b406e9f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f62c8007e90 tx=0x7f62c80073a0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.120+0000 7f62de400640 1 -- 172.21.15.99:0/3264443182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62d8161e00 msgr2=0x7f62d815f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.120+0000 7f62de400640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62d8161e00 0x7f62d815f320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f62d000c7f0 tx=0x7f62d000ccb0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.121+0000 7f62de400640 1 -- 172.21.15.99:0/3264443182 shutdown_connections 2024-03-30T13:12:11.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.121+0000 7f62de400640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f62b406c530 0x7f62b406e9f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.121+0000 7f62de400640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62d8161e00 0x7f62d815f320 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.121+0000 7f62de400640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62d8071fe0 0x7f62d8159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.121+0000 7f62de400640 1 --2- 172.21.15.99:0/3264443182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62d806d930 0x7f62d814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.121+0000 7f62de400640 1 -- 172.21.15.99:0/3264443182 >> 172.21.15.99:0/3264443182 conn(0x7f62d806b510 msgr2=0x7f62d80af030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:11.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.121+0000 7f62de400640 1 -- 172.21.15.99:0/3264443182 shutdown_connections 2024-03-30T13:12:11.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.121+0000 7f62de400640 1 -- 172.21.15.99:0/3264443182 wait complete. 2024-03-30T13:12:11.145 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-30T13:12:11.145 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:12:11.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.351+0000 7ff471e00640 1 Processor -- start 2024-03-30T13:12:11.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.351+0000 7ff471e00640 1 -- start start 2024-03-30T13:12:11.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.352+0000 7ff471e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff46c153280 0x7ff46c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.352+0000 7ff471e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff46c160660 0x7ff46c06d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.352+0000 7ff471e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff46c0ce6d0 con 0x7ff46c0ce130 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.352+0000 7ff471e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff46c0cf2e0 con 0x7ff46c153280 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.352+0000 7ff471e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff46c0ce9b0 con 0x7ff46c160660 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.353+0000 7ff470a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff46c153280 0x7ff46c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.353+0000 7ff470a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff46c153280 0x7ff46c0b4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42452/0 (socket says 172.21.15.99:42452) 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.353+0000 7ff470a00640 1 -- 172.21.15.99:0/153226610 learned_addr learned my addr 172.21.15.99:0/153226610 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.353+0000 7ff471400640 1 --2- 172.21.15.99:0/153226610 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff46c160660 0x7ff46c06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.353+0000 7ff470a00640 1 -- 172.21.15.99:0/153226610 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff46c160660 msgr2=0x7ff46c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.353+0000 7ff470a00640 1 --2- 172.21.15.99:0/153226610 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff46c160660 0x7ff46c06d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.353+0000 7ff470a00640 1 -- 172.21.15.99:0/153226610 >> v1:172.21.15.181:6789/0 conn(0x7ff46c0ce130 legacy=0x7ff46c15ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.353+0000 7ff470a00640 1 -- 172.21.15.99:0/153226610 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c0cec90 con 0x7ff46c153280 2024-03-30T13:12:11.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.355+0000 7ff470a00640 1 --2- 172.21.15.99:0/153226610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff46c153280 0x7ff46c0b4e50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff460009870 tx=0x7ff46002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db73311ce1717af9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:11.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.355+0000 7ff46b400640 1 -- 172.21.15.99:0/153226610 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460035020 con 0x7ff46c153280 2024-03-30T13:12:11.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.355+0000 7ff46b400640 1 -- 172.21.15.99:0/153226610 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff460031640 con 0x7ff46c153280 2024-03-30T13:12:11.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.355+0000 7ff46b400640 1 -- 172.21.15.99:0/153226610 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46002d040 con 0x7ff46c153280 2024-03-30T13:12:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.356+0000 7ff471e00640 1 -- 172.21.15.99:0/153226610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff46c153280 msgr2=0x7ff46c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.356+0000 7ff471e00640 1 --2- 172.21.15.99:0/153226610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff46c153280 0x7ff46c0b4e50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff460009870 tx=0x7ff46002b8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.356+0000 7ff471e00640 1 -- 172.21.15.99:0/153226610 shutdown_connections 2024-03-30T13:12:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.356+0000 7ff471e00640 1 --2- 172.21.15.99:0/153226610 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff46c160660 0x7ff46c06d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.356+0000 7ff471e00640 1 --2- 172.21.15.99:0/153226610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff46c153280 0x7ff46c0b4e50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.356+0000 7ff471e00640 1 -- 172.21.15.99:0/153226610 >> 172.21.15.99:0/153226610 conn(0x7ff46c06bb40 msgr2=0x7ff46c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.356+0000 7ff471e00640 1 -- 172.21.15.99:0/153226610 shutdown_connections 2024-03-30T13:12:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.356+0000 7ff471e00640 1 -- 172.21.15.99:0/153226610 wait complete. 2024-03-30T13:12:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.357+0000 7ff471e00640 1 Processor -- start 2024-03-30T13:12:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.358+0000 7ff471e00640 1 -- start start 2024-03-30T13:12:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.358+0000 7ff471e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff46c0ce130 0x7ff46c13f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff471e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff46c153280 0x7ff46c0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff471e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff46c160660 0x7ff46c15ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff471e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c153660 con 0x7ff46c153280 2024-03-30T13:12:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff471e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c0b5390 con 0x7ff46c160660 2024-03-30T13:12:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff471e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff46c1537e0 con 0x7ff46c0ce130 2024-03-30T13:12:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff46be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff46c153280 0x7ff46c0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff46be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff46c153280 0x7ff46c0b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42458/0 (socket says 172.21.15.99:42458) 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff46be00640 1 -- 172.21.15.99:0/2662613642 learned_addr learned my addr 172.21.15.99:0/2662613642 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff471400640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff46c160660 0x7ff46c15ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff470a00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff46c0ce130 0x7ff46c13f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff46be00640 1 -- 172.21.15.99:0/2662613642 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff46c0ce130 msgr2=0x7ff46c13f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff46be00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff46c0ce130 0x7ff46c13f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff46be00640 1 -- 172.21.15.99:0/2662613642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff46c160660 msgr2=0x7ff46c15ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff46be00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff46c160660 0x7ff46c15ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff46be00640 1 -- 172.21.15.99:0/2662613642 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c156930 con 0x7ff46c153280 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.359+0000 7ff470a00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff46c0ce130 0x7ff46c13f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.360+0000 7ff46be00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff46c153280 0x7ff46c0b1530 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c3c0 tx=0x7ff45800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.360+0000 7ff468c00640 1 -- 172.21.15.99:0/2662613642 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4580052d0 con 0x7ff46c153280 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.360+0000 7ff468c00640 1 -- 172.21.15.99:0/2662613642 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff458005490 con 0x7ff46c153280 2024-03-30T13:12:11.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.360+0000 7ff468c00640 1 -- 172.21.15.99:0/2662613642 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458007260 con 0x7ff46c153280 2024-03-30T13:12:11.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.360+0000 7ff471e00640 1 -- 172.21.15.99:0/2662613642 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46c150230 con 0x7ff46c153280 2024-03-30T13:12:11.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.360+0000 7ff471e00640 1 -- 172.21.15.99:0/2662613642 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff46c155e50 con 0x7ff46c153280 2024-03-30T13:12:11.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.361+0000 7ff471e00640 1 -- 172.21.15.99:0/2662613642 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff46c04f8f0 con 0x7ff46c153280 2024-03-30T13:12:11.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.362+0000 7ff468c00640 1 -- 172.21.15.99:0/2662613642 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff458007400 con 0x7ff46c153280 2024-03-30T13:12:11.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.363+0000 7ff468c00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff44c06c530 0x7ff44c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.363+0000 7ff468c00640 1 -- 172.21.15.99:0/2662613642 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7ff45808ab80 con 0x7ff46c153280 2024-03-30T13:12:11.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.363+0000 7ff470a00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff44c06c530 0x7ff44c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.364+0000 7ff470a00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff44c06c530 0x7ff44c06e9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff460036000 tx=0x7ff460008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:11.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.368+0000 7ff468c00640 1 -- 172.21.15.99:0/2662613642 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff4580591a0 con 0x7ff46c153280 2024-03-30T13:12:11.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.554+0000 7ff471e00640 1 -- 172.21.15.99:0/2662613642 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff46c0af580 con 0x7ff44c06c530 2024-03-30T13:12:11.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.573+0000 7ff468c00640 1 -- 172.21.15.99:0/2662613642 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7ff46c0af580 con 0x7ff44c06c530 2024-03-30T13:12:11.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:11.582 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:12:11.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 -- 172.21.15.99:0/2662613642 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff44c06c530 msgr2=0x7ff44c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff44c06c530 0x7ff44c06e9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff460036000 tx=0x7ff460008030 comp rx=0 tx=0).stop 2024-03-30T13:12:11.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 -- 172.21.15.99:0/2662613642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff46c153280 msgr2=0x7ff46c0b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff46c153280 0x7ff46c0b1530 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c3c0 tx=0x7ff45800c880 comp rx=0 tx=0).stop 2024-03-30T13:12:11.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 -- 172.21.15.99:0/2662613642 shutdown_connections 2024-03-30T13:12:11.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff44c06c530 0x7ff44c06e9f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff46c160660 0x7ff46c15ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff46c153280 0x7ff46c0b1530 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 --2- 172.21.15.99:0/2662613642 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff46c0ce130 0x7ff46c13f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 -- 172.21.15.99:0/2662613642 >> 172.21.15.99:0/2662613642 conn(0x7ff46c06bb40 msgr2=0x7ff46c0cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 -- 172.21.15.99:0/2662613642 shutdown_connections 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:11.578+0000 7ff471e00640 1 -- 172.21.15.99:0/2662613642 wait complete. 2024-03-30T13:12:11.601 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-03-30T13:12:11.461163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220408,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754312,"statfs":{"total":773094113280,"available":772868415488,"internally_reserved":0,"allocated":4333568,"data_stored":2388372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.339289"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303735+0000","last_change":"2024-03-30T13:12:05.188060+0000","last_active":"2024-03-30T13:12:06.303735+0000","last_peered":"2024-03-30T13:12:06.303735+0000","last_clean":"2024-03-30T13:12:06.303735+0000","last_became_active":"2024-03-30T13:12:05.187773+0000","last_became_peered":"2024-03-30T13:12:05.187773+0000","last_unstale":"2024-03-30T13:12:06.303735+0000","last_undegraded":"2024-03-30T13:12:06.303735+0000","last_fullsized":"2024-03-30T13:12:06.303735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:35:26.826667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184893+0000","last_change":"2024-03-30T13:12:05.197119+0000","last_active":"2024-03-30T13:12:07.184893+0000","last_peered":"2024-03-30T13:12:07.184893+0000","last_clean":"2024-03-30T13:12:07.184893+0000","last_became_active":"2024-03-30T13:12:05.189811+0000","last_became_peered":"2024-03-30T13:12:05.189811+0000","last_unstale":"2024-03-30T13:12:07.184893+0000","last_undegraded":"2024-03-30T13:12:07.184893+0000","last_fullsized":"2024-03-30T13:12:07.184893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.097214+0000","last_change":"2024-03-30T13:12:05.198180+0000","last_active":"2024-03-30T13:12:07.097214+0000","last_peered":"2024-03-30T13:12:07.097214+0000","last_clean":"2024-03-30T13:12:07.097214+0000","last_became_active":"2024-03-30T13:12:05.197863+0000","last_became_peered":"2024-03-30T13:12:05.197863+0000","last_unstale":"2024-03-30T13:12:07.097214+0000","last_undegraded":"2024-03-30T13:12:07.097214+0000","last_fullsized":"2024-03-30T13:12:07.097214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:55.107578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631004+0000","last_change":"2024-03-30T13:12:05.195748+0000","last_active":"2024-03-30T13:12:07.631004+0000","last_peered":"2024-03-30T13:12:07.631004+0000","last_clean":"2024-03-30T13:12:07.631004+0000","last_became_active":"2024-03-30T13:12:05.194975+0000","last_became_peered":"2024-03-30T13:12:05.194975+0000","last_unstale":"2024-03-30T13:12:07.631004+0000","last_undegraded":"2024-03-30T13:12:07.631004+0000","last_fullsized":"2024-03-30T13:12:07.631004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:21:53.293558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184896+0000","last_change":"2024-03-30T13:12:05.197297+0000","last_active":"2024-03-30T13:12:07.184896+0000","last_peered":"2024-03-30T13:12:07.184896+0000","last_clean":"2024-03-30T13:12:07.184896+0000","last_became_active":"2024-03-30T13:12:05.196664+0000","last_became_peered":"2024-03-30T13:12:05.196664+0000","last_unstale":"2024-03-30T13:12:07.184896+0000","last_undegraded":"2024-03-30T13:12:07.184896+0000","last_fullsized":"2024-03-30T13:12:07.184896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198172+0000","last_change":"2024-03-30T13:12:05.200209+0000","last_active":"2024-03-30T13:12:06.198172+0000","last_peered":"2024-03-30T13:12:06.198172+0000","last_clean":"2024-03-30T13:12:06.198172+0000","last_became_active":"2024-03-30T13:12:05.193470+0000","last_became_peered":"2024-03-30T13:12:05.193470+0000","last_unstale":"2024-03-30T13:12:06.198172+0000","last_undegraded":"2024-03-30T13:12:06.198172+0000","last_fullsized":"2024-03-30T13:12:06.198172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:14:38.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303060+0000","last_change":"2024-03-30T13:12:05.198790+0000","last_active":"2024-03-30T13:12:06.303060+0000","last_peered":"2024-03-30T13:12:06.303060+0000","last_clean":"2024-03-30T13:12:06.303060+0000","last_became_active":"2024-03-30T13:12:05.198464+0000","last_became_peered":"2024-03-30T13:12:05.198464+0000","last_unstale":"2024-03-30T13:12:06.303060+0000","last_undegraded":"2024-03-30T13:12:06.303060+0000","last_fullsized":"2024-03-30T13:12:06.303060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303025+0000","last_change":"2024-03-30T13:12:05.185825+0000","last_active":"2024-03-30T13:12:06.303025+0000","last_peered":"2024-03-30T13:12:06.303025+0000","last_clean":"2024-03-30T13:12:06.303025+0000","last_became_active":"2024-03-30T13:12:05.185534+0000","last_became_peered":"2024-03-30T13:12:05.185534+0000","last_unstale":"2024-03-30T13:12:06.303025+0000","last_undegraded":"2024-03-30T13:12:06.303025+0000","last_fullsized":"2024-03-30T13:12:06.303025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:19:59.448920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.097166+0000","last_change":"2024-03-30T13:12:05.199828+0000","last_active":"2024-03-30T13:12:07.097166+0000","last_peered":"2024-03-30T13:12:07.097166+0000","last_clean":"2024-03-30T13:12:07.097166+0000","last_became_active":"2024-03-30T13:12:05.199568+0000","last_became_peered":"2024-03-30T13:12:05.199568+0000","last_unstale":"2024-03-30T13:12:07.097166+0000","last_undegraded":"2024-03-30T13:12:07.097166+0000","last_fullsized":"2024-03-30T13:12:07.097166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:02.037257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631308+0000","last_change":"2024-03-30T13:12:05.193985+0000","last_active":"2024-03-30T13:12:07.631308+0000","last_peered":"2024-03-30T13:12:07.631308+0000","last_clean":"2024-03-30T13:12:07.631308+0000","last_became_active":"2024-03-30T13:12:05.193520+0000","last_became_peered":"2024-03-30T13:12:05.193520+0000","last_unstale":"2024-03-30T13:12:07.631308+0000","last_undegraded":"2024-03-30T13:12:07.631308+0000","last_fullsized":"2024-03-30T13:12:07.631308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:11.335766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195430+0000","last_change":"2024-03-30T13:12:05.203706+0000","last_active":"2024-03-30T13:12:06.195430+0000","last_peered":"2024-03-30T13:12:06.195430+0000","last_clean":"2024-03-30T13:12:06.195430+0000","last_became_active":"2024-03-30T13:12:05.203268+0000","last_became_peered":"2024-03-30T13:12:05.203268+0000","last_unstale":"2024-03-30T13:12:06.195430+0000","last_undegraded":"2024-03-30T13:12:06.195430+0000","last_fullsized":"2024-03-30T13:12:06.195430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:52:34.165774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.097123+0000","last_change":"2024-03-30T13:12:05.193165+0000","last_active":"2024-03-30T13:12:07.097123+0000","last_peered":"2024-03-30T13:12:07.097123+0000","last_clean":"2024-03-30T13:12:07.097123+0000","last_became_active":"2024-03-30T13:12:05.192925+0000","last_became_peered":"2024-03-30T13:12:05.192925+0000","last_unstale":"2024-03-30T13:12:07.097123+0000","last_undegraded":"2024-03-30T13:12:07.097123+0000","last_fullsized":"2024-03-30T13:12:07.097123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:31.333351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473411+0000","last_change":"2024-03-30T13:12:05.190953+0000","last_active":"2024-03-30T13:12:07.473411+0000","last_peered":"2024-03-30T13:12:07.473411+0000","last_clean":"2024-03-30T13:12:07.473411+0000","last_became_active":"2024-03-30T13:12:05.190117+0000","last_became_peered":"2024-03-30T13:12:05.190117+0000","last_unstale":"2024-03-30T13:12:07.473411+0000","last_undegraded":"2024-03-30T13:12:07.473411+0000","last_fullsized":"2024-03-30T13:12:07.473411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630995+0000","last_change":"2024-03-30T13:12:05.189430+0000","last_active":"2024-03-30T13:12:07.630995+0000","last_peered":"2024-03-30T13:12:07.630995+0000","last_clean":"2024-03-30T13:12:07.630995+0000","last_became_active":"2024-03-30T13:12:05.188612+0000","last_became_peered":"2024-03-30T13:12:05.188612+0000","last_unstale":"2024-03-30T13:12:07.630995+0000","last_undegraded":"2024-03-30T13:12:07.630995+0000","last_fullsized":"2024-03-30T13:12:07.630995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:35:26.826667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197383+0000","last_change":"2024-03-30T13:12:05.189650+0000","last_active":"2024-03-30T13:12:06.197383+0000","last_peered":"2024-03-30T13:12:06.197383+0000","last_clean":"2024-03-30T13:12:06.197383+0000","last_became_active":"2024-03-30T13:12:05.189365+0000","last_became_peered":"2024-03-30T13:12:05.189365+0000","last_unstale":"2024-03-30T13:12:06.197383+0000","last_undegraded":"2024-03-30T13:12:06.197383+0000","last_fullsized":"2024-03-30T13:12:06.197383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197043+0000","last_change":"2024-03-30T13:12:05.205900+0000","last_active":"2024-03-30T13:12:06.197043+0000","last_peered":"2024-03-30T13:12:06.197043+0000","last_clean":"2024-03-30T13:12:06.197043+0000","last_became_active":"2024-03-30T13:12:05.205616+0000","last_became_peered":"2024-03-30T13:12:05.205616+0000","last_unstale":"2024-03-30T13:12:06.197043+0000","last_undegraded":"2024-03-30T13:12:06.197043+0000","last_fullsized":"2024-03-30T13:12:06.197043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195491+0000","last_change":"2024-03-30T13:12:05.203942+0000","last_active":"2024-03-30T13:12:06.195491+0000","last_peered":"2024-03-30T13:12:06.195491+0000","last_clean":"2024-03-30T13:12:06.195491+0000","last_became_active":"2024-03-30T13:12:05.203417+0000","last_became_peered":"2024-03-30T13:12:05.203417+0000","last_unstale":"2024-03-30T13:12:06.195491+0000","last_undegraded":"2024-03-30T13:12:06.195491+0000","last_fullsized":"2024-03-30T13:12:06.195491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:21:23.305375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198673+0000","last_change":"2024-03-30T13:12:05.202224+0000","last_active":"2024-03-30T13:12:06.198673+0000","last_peered":"2024-03-30T13:12:06.198673+0000","last_clean":"2024-03-30T13:12:06.198673+0000","last_became_active":"2024-03-30T13:12:05.201944+0000","last_became_peered":"2024-03-30T13:12:05.201944+0000","last_unstale":"2024-03-30T13:12:06.198673+0000","last_undegraded":"2024-03-30T13:12:06.198673+0000","last_fullsized":"2024-03-30T13:12:06.198673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:58.129468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198924+0000","last_change":"2024-03-30T13:12:05.194980+0000","last_active":"2024-03-30T13:12:06.198924+0000","last_peered":"2024-03-30T13:12:06.198924+0000","last_clean":"2024-03-30T13:12:06.198924+0000","last_became_active":"2024-03-30T13:12:05.194702+0000","last_became_peered":"2024-03-30T13:12:05.194702+0000","last_unstale":"2024-03-30T13:12:06.198924+0000","last_undegraded":"2024-03-30T13:12:06.198924+0000","last_fullsized":"2024-03-30T13:12:06.198924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:09.286734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472876+0000","last_change":"2024-03-30T13:12:05.189386+0000","last_active":"2024-03-30T13:12:07.472876+0000","last_peered":"2024-03-30T13:12:07.472876+0000","last_clean":"2024-03-30T13:12:07.472876+0000","last_became_active":"2024-03-30T13:12:05.189025+0000","last_became_peered":"2024-03-30T13:12:05.189025+0000","last_unstale":"2024-03-30T13:12:07.472876+0000","last_undegraded":"2024-03-30T13:12:07.472876+0000","last_fullsized":"2024-03-30T13:12:07.472876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197964+0000","last_change":"2024-03-30T13:12:05.199742+0000","last_active":"2024-03-30T13:12:06.197964+0000","last_peered":"2024-03-30T13:12:06.197964+0000","last_clean":"2024-03-30T13:12:06.197964+0000","last_became_active":"2024-03-30T13:12:05.199481+0000","last_became_peered":"2024-03-30T13:12:05.199481+0000","last_unstale":"2024-03-30T13:12:06.197964+0000","last_undegraded":"2024-03-30T13:12:06.197964+0000","last_fullsized":"2024-03-30T13:12:06.197964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303138+0000","last_change":"2024-03-30T13:12:05.188672+0000","last_active":"2024-03-30T13:12:06.303138+0000","last_peered":"2024-03-30T13:12:06.303138+0000","last_clean":"2024-03-30T13:12:06.303138+0000","last_became_active":"2024-03-30T13:12:05.188399+0000","last_became_peered":"2024-03-30T13:12:05.188399+0000","last_unstale":"2024-03-30T13:12:06.303138+0000","last_undegraded":"2024-03-30T13:12:06.303138+0000","last_fullsized":"2024-03-30T13:12:06.303138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472492+0000","last_change":"2024-03-30T13:12:05.196711+0000","last_active":"2024-03-30T13:12:07.472492+0000","last_peered":"2024-03-30T13:12:07.472492+0000","last_clean":"2024-03-30T13:12:07.472492+0000","last_became_active":"2024-03-30T13:12:05.196491+0000","last_became_peered":"2024-03-30T13:12:05.196491+0000","last_unstale":"2024-03-30T13:12:07.472492+0000","last_undegraded":"2024-03-30T13:12:07.472492+0000","last_fullsized":"2024-03-30T13:12:07.472492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:19:59.448920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303011+0000","last_change":"2024-03-30T13:12:05.197850+0000","last_active":"2024-03-30T13:12:06.303011+0000","last_peered":"2024-03-30T13:12:06.303011+0000","last_clean":"2024-03-30T13:12:06.303011+0000","last_became_active":"2024-03-30T13:12:05.197372+0000","last_became_peered":"2024-03-30T13:12:05.197372+0000","last_unstale":"2024-03-30T13:12:06.303011+0000","last_undegraded":"2024-03-30T13:12:06.303011+0000","last_fullsized":"2024-03-30T13:12:06.303011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631777+0000","last_change":"2024-03-30T13:12:05.196765+0000","last_active":"2024-03-30T13:12:07.631777+0000","last_peered":"2024-03-30T13:12:07.631777+0000","last_clean":"2024-03-30T13:12:07.631777+0000","last_became_active":"2024-03-30T13:12:05.196494+0000","last_became_peered":"2024-03-30T13:12:05.196494+0000","last_unstale":"2024-03-30T13:12:07.631777+0000","last_undegraded":"2024-03-30T13:12:07.631777+0000","last_fullsized":"2024-03-30T13:12:07.631777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:04:04.845593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631641+0000","last_change":"2024-03-30T13:12:05.195759+0000","last_active":"2024-03-30T13:12:07.631641+0000","last_peered":"2024-03-30T13:12:07.631641+0000","last_clean":"2024-03-30T13:12:07.631641+0000","last_became_active":"2024-03-30T13:12:05.194287+0000","last_became_peered":"2024-03-30T13:12:05.194287+0000","last_unstale":"2024-03-30T13:12:07.631641+0000","last_undegraded":"2024-03-30T13:12:07.631641+0000","last_fullsized":"2024-03-30T13:12:07.631641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:42.770626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184547+0000","last_change":"2024-03-30T13:12:05.193501+0000","last_active":"2024-03-30T13:12:07.184547+0000","last_peered":"2024-03-30T13:12:07.184547+0000","last_clean":"2024-03-30T13:12:07.184547+0000","last_became_active":"2024-03-30T13:12:05.193217+0000","last_became_peered":"2024-03-30T13:12:05.193217+0000","last_unstale":"2024-03-30T13:12:07.184547+0000","last_undegraded":"2024-03-30T13:12:07.184547+0000","last_fullsized":"2024-03-30T13:12:07.184547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303734+0000","last_change":"2024-03-30T13:12:05.192324+0000","last_active":"2024-03-30T13:12:06.303734+0000","last_peered":"2024-03-30T13:12:06.303734+0000","last_clean":"2024-03-30T13:12:06.303734+0000","last_became_active":"2024-03-30T13:12:05.191434+0000","last_became_peered":"2024-03-30T13:12:05.191434+0000","last_unstale":"2024-03-30T13:12:06.303734+0000","last_undegraded":"2024-03-30T13:12:06.303734+0000","last_fullsized":"2024-03-30T13:12:06.303734+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:02.262900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197939+0000","last_change":"2024-03-30T13:12:05.189273+0000","last_active":"2024-03-30T13:12:06.197939+0000","last_peered":"2024-03-30T13:12:06.197939+0000","last_clean":"2024-03-30T13:12:06.197939+0000","last_became_active":"2024-03-30T13:12:05.188992+0000","last_became_peered":"2024-03-30T13:12:05.188992+0000","last_unstale":"2024-03-30T13:12:06.197939+0000","last_undegraded":"2024-03-30T13:12:06.197939+0000","last_fullsized":"2024-03-30T13:12:06.197939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:28.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197637+0000","last_change":"2024-03-30T13:12:05.194632+0000","last_active":"2024-03-30T13:12:06.197637+0000","last_peered":"2024-03-30T13:12:06.197637+0000","last_clean":"2024-03-30T13:12:06.197637+0000","last_became_active":"2024-03-30T13:12:05.194383+0000","last_became_peered":"2024-03-30T13:12:05.194383+0000","last_unstale":"2024-03-30T13:12:06.197637+0000","last_undegraded":"2024-03-30T13:12:06.197637+0000","last_fullsized":"2024-03-30T13:12:06.197637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303286+0000","last_change":"2024-03-30T13:12:05.206518+0000","last_active":"2024-03-30T13:12:06.303286+0000","last_peered":"2024-03-30T13:12:06.303286+0000","last_clean":"2024-03-30T13:12:06.303286+0000","last_became_active":"2024-03-30T13:12:05.205663+0000","last_became_peered":"2024-03-30T13:12:05.205663+0000","last_unstale":"2024-03-30T13:12:06.303286+0000","last_undegraded":"2024-03-30T13:12:06.303286+0000","last_fullsized":"2024-03-30T13:12:06.303286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.193939+0000","last_change":"2024-03-30T13:12:05.193656+0000","last_active":"2024-03-30T13:12:06.193939+0000","last_peered":"2024-03-30T13:12:06.193939+0000","last_clean":"2024-03-30T13:12:06.193939+0000","last_became_active":"2024-03-30T13:12:05.190500+0000","last_became_peered":"2024-03-30T13:12:05.190500+0000","last_unstale":"2024-03-30T13:12:06.193939+0000","last_undegraded":"2024-03-30T13:12:06.193939+0000","last_fullsized":"2024-03-30T13:12:06.193939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:21.440022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473000+0000","last_change":"2024-03-30T13:12:05.203814+0000","last_active":"2024-03-30T13:12:07.473000+0000","last_peered":"2024-03-30T13:12:07.473000+0000","last_clean":"2024-03-30T13:12:07.473000+0000","last_became_active":"2024-03-30T13:12:05.203408+0000","last_became_peered":"2024-03-30T13:12:05.203408+0000","last_unstale":"2024-03-30T13:12:07.473000+0000","last_undegraded":"2024-03-30T13:12:07.473000+0000","last_fullsized":"2024-03-30T13:12:07.473000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195722+0000","last_change":"2024-03-30T13:12:04.161934+0000","last_active":"2024-03-30T13:12:06.195722+0000","last_peered":"2024-03-30T13:12:06.195722+0000","last_clean":"2024-03-30T13:12:06.195722+0000","last_became_active":"2024-03-30T13:12:04.161721+0000","last_became_peered":"2024-03-30T13:12:04.161721+0000","last_unstale":"2024-03-30T13:12:06.195722+0000","last_undegraded":"2024-03-30T13:12:06.195722+0000","last_fullsized":"2024-03-30T13:12:06.195722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:21:52.288358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303797+0000","last_change":"2024-03-30T13:12:05.187153+0000","last_active":"2024-03-30T13:12:06.303797+0000","last_peered":"2024-03-30T13:12:06.303797+0000","last_clean":"2024-03-30T13:12:06.303797+0000","last_became_active":"2024-03-30T13:12:05.186830+0000","last_became_peered":"2024-03-30T13:12:05.186830+0000","last_unstale":"2024-03-30T13:12:06.303797+0000","last_undegraded":"2024-03-30T13:12:06.303797+0000","last_fullsized":"2024-03-30T13:12:06.303797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:21:53.293558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631425+0000","last_change":"2024-03-30T13:12:04.156757+0000","last_active":"2024-03-30T13:12:07.631425+0000","last_peered":"2024-03-30T13:12:07.631425+0000","last_clean":"2024-03-30T13:12:07.631425+0000","last_became_active":"2024-03-30T13:12:04.156049+0000","last_became_peered":"2024-03-30T13:12:04.156049+0000","last_unstale":"2024-03-30T13:12:07.631425+0000","last_undegraded":"2024-03-30T13:12:07.631425+0000","last_fullsized":"2024-03-30T13:12:07.631425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:54.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303891+0000","last_change":"2024-03-30T13:12:05.197460+0000","last_active":"2024-03-30T13:12:06.303891+0000","last_peered":"2024-03-30T13:12:06.303891+0000","last_clean":"2024-03-30T13:12:06.303891+0000","last_became_active":"2024-03-30T13:12:05.197167+0000","last_became_peered":"2024-03-30T13:12:05.197167+0000","last_unstale":"2024-03-30T13:12:06.303891+0000","last_undegraded":"2024-03-30T13:12:06.303891+0000","last_fullsized":"2024-03-30T13:12:06.303891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:05:21.340816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199295+0000","last_change":"2024-03-30T13:12:04.160804+0000","last_active":"2024-03-30T13:12:06.199295+0000","last_peered":"2024-03-30T13:12:06.199295+0000","last_clean":"2024-03-30T13:12:06.199295+0000","last_became_active":"2024-03-30T13:12:04.160592+0000","last_became_peered":"2024-03-30T13:12:04.160592+0000","last_unstale":"2024-03-30T13:12:06.199295+0000","last_undegraded":"2024-03-30T13:12:06.199295+0000","last_fullsized":"2024-03-30T13:12:06.199295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:48.643179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631257+0000","last_change":"2024-03-30T13:12:05.198359+0000","last_active":"2024-03-30T13:12:07.631257+0000","last_peered":"2024-03-30T13:12:07.631257+0000","last_clean":"2024-03-30T13:12:07.631257+0000","last_became_active":"2024-03-30T13:12:05.197998+0000","last_became_peered":"2024-03-30T13:12:05.197998+0000","last_unstale":"2024-03-30T13:12:07.631257+0000","last_undegraded":"2024-03-30T13:12:07.631257+0000","last_fullsized":"2024-03-30T13:12:07.631257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:38.341209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631575+0000","last_change":"2024-03-30T13:12:04.160626+0000","last_active":"2024-03-30T13:12:07.631575+0000","last_peered":"2024-03-30T13:12:07.631575+0000","last_clean":"2024-03-30T13:12:07.631575+0000","last_became_active":"2024-03-30T13:12:04.160357+0000","last_became_peered":"2024-03-30T13:12:04.160357+0000","last_unstale":"2024-03-30T13:12:07.631575+0000","last_undegraded":"2024-03-30T13:12:07.631575+0000","last_fullsized":"2024-03-30T13:12:07.631575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:06:07.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.096624+0000","last_change":"2024-03-30T13:12:05.200545+0000","last_active":"2024-03-30T13:12:07.096624+0000","last_peered":"2024-03-30T13:12:07.096624+0000","last_clean":"2024-03-30T13:12:07.096624+0000","last_became_active":"2024-03-30T13:12:05.200239+0000","last_became_peered":"2024-03-30T13:12:05.200239+0000","last_unstale":"2024-03-30T13:12:07.096624+0000","last_undegraded":"2024-03-30T13:12:07.096624+0000","last_fullsized":"2024-03-30T13:12:07.096624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:54.897607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303453+0000","last_change":"2024-03-30T13:12:04.150040+0000","last_active":"2024-03-30T13:12:06.303453+0000","last_peered":"2024-03-30T13:12:06.303453+0000","last_clean":"2024-03-30T13:12:06.303453+0000","last_became_active":"2024-03-30T13:12:04.149747+0000","last_became_peered":"2024-03-30T13:12:04.149747+0000","last_unstale":"2024-03-30T13:12:06.303453+0000","last_undegraded":"2024-03-30T13:12:06.303453+0000","last_fullsized":"2024-03-30T13:12:06.303453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:31:02.606363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303292+0000","last_change":"2024-03-30T13:12:05.205425+0000","last_active":"2024-03-30T13:12:06.303292+0000","last_peered":"2024-03-30T13:12:06.303292+0000","last_clean":"2024-03-30T13:12:06.303292+0000","last_became_active":"2024-03-30T13:12:05.204916+0000","last_became_peered":"2024-03-30T13:12:05.204916+0000","last_unstale":"2024-03-30T13:12:06.303292+0000","last_undegraded":"2024-03-30T13:12:06.303292+0000","last_fullsized":"2024-03-30T13:12:06.303292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:28.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303284+0000","last_change":"2024-03-30T13:12:04.149618+0000","last_active":"2024-03-30T13:12:06.303284+0000","last_peered":"2024-03-30T13:12:06.303284+0000","last_clean":"2024-03-30T13:12:06.303284+0000","last_became_active":"2024-03-30T13:12:04.149252+0000","last_became_peered":"2024-03-30T13:12:04.149252+0000","last_unstale":"2024-03-30T13:12:06.303284+0000","last_undegraded":"2024-03-30T13:12:06.303284+0000","last_fullsized":"2024-03-30T13:12:06.303284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:07.537097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.096393+0000","last_change":"2024-03-30T13:12:05.192119+0000","last_active":"2024-03-30T13:12:07.096393+0000","last_peered":"2024-03-30T13:12:07.096393+0000","last_clean":"2024-03-30T13:12:07.096393+0000","last_became_active":"2024-03-30T13:12:05.191809+0000","last_became_peered":"2024-03-30T13:12:05.191809+0000","last_unstale":"2024-03-30T13:12:07.096393+0000","last_undegraded":"2024-03-30T13:12:07.096393+0000","last_fullsized":"2024-03-30T13:12:07.096393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:31:03.611564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198401+0000","last_change":"2024-03-30T13:12:04.157894+0000","last_active":"2024-03-30T13:12:06.198401+0000","last_peered":"2024-03-30T13:12:06.198401+0000","last_clean":"2024-03-30T13:12:06.198401+0000","last_became_active":"2024-03-30T13:12:04.157491+0000","last_became_peered":"2024-03-30T13:12:04.157491+0000","last_unstale":"2024-03-30T13:12:06.198401+0000","last_undegraded":"2024-03-30T13:12:06.198401+0000","last_fullsized":"2024-03-30T13:12:06.198401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:34:25.438955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630535+0000","last_change":"2024-03-30T13:12:05.199546+0000","last_active":"2024-03-30T13:12:07.630535+0000","last_peered":"2024-03-30T13:12:07.630535+0000","last_clean":"2024-03-30T13:12:07.630535+0000","last_became_active":"2024-03-30T13:12:05.199239+0000","last_became_peered":"2024-03-30T13:12:05.199239+0000","last_unstale":"2024-03-30T13:12:07.630535+0000","last_undegraded":"2024-03-30T13:12:07.630535+0000","last_fullsized":"2024-03-30T13:12:07.630535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:28.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303186+0000","last_change":"2024-03-30T13:12:04.155737+0000","last_active":"2024-03-30T13:12:06.303186+0000","last_peered":"2024-03-30T13:12:06.303186+0000","last_clean":"2024-03-30T13:12:06.303186+0000","last_became_active":"2024-03-30T13:12:04.155473+0000","last_became_peered":"2024-03-30T13:12:04.155473+0000","last_unstale":"2024-03-30T13:12:06.303186+0000","last_undegraded":"2024-03-30T13:12:06.303186+0000","last_fullsized":"2024-03-30T13:12:06.303186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:30.328150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195290+0000","last_change":"2024-03-30T13:12:05.205912+0000","last_active":"2024-03-30T13:12:06.195290+0000","last_peered":"2024-03-30T13:12:06.195290+0000","last_clean":"2024-03-30T13:12:06.195290+0000","last_became_active":"2024-03-30T13:12:05.204277+0000","last_became_peered":"2024-03-30T13:12:05.204277+0000","last_unstale":"2024-03-30T13:12:06.195290+0000","last_undegraded":"2024-03-30T13:12:06.195290+0000","last_fullsized":"2024-03-30T13:12:06.195290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:49:49.633776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184977+0000","last_change":"2024-03-30T13:12:04.152194+0000","last_active":"2024-03-30T13:12:07.184977+0000","last_peered":"2024-03-30T13:12:07.184977+0000","last_clean":"2024-03-30T13:12:07.184977+0000","last_became_active":"2024-03-30T13:12:04.151844+0000","last_became_peered":"2024-03-30T13:12:04.151844+0000","last_unstale":"2024-03-30T13:12:07.184977+0000","last_undegraded":"2024-03-30T13:12:07.184977+0000","last_fullsized":"2024-03-30T13:12:07.184977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.632067+0000","last_change":"2024-03-30T13:12:05.191219+0000","last_active":"2024-03-30T13:12:07.632067+0000","last_peered":"2024-03-30T13:12:07.632067+0000","last_clean":"2024-03-30T13:12:07.632067+0000","last_became_active":"2024-03-30T13:12:05.187503+0000","last_became_peered":"2024-03-30T13:12:05.187503+0000","last_unstale":"2024-03-30T13:12:07.632067+0000","last_undegraded":"2024-03-30T13:12:07.632067+0000","last_fullsized":"2024-03-30T13:12:07.632067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:34:30.445284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184510+0000","last_change":"2024-03-30T13:12:04.151674+0000","last_active":"2024-03-30T13:12:07.184510+0000","last_peered":"2024-03-30T13:12:07.184510+0000","last_clean":"2024-03-30T13:12:07.184510+0000","last_became_active":"2024-03-30T13:12:04.151273+0000","last_became_peered":"2024-03-30T13:12:04.151273+0000","last_unstale":"2024-03-30T13:12:07.184510+0000","last_undegraded":"2024-03-30T13:12:07.184510+0000","last_fullsized":"2024-03-30T13:12:07.184510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:35:19.563529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631362+0000","last_change":"2024-03-30T13:12:05.195768+0000","last_active":"2024-03-30T13:12:07.631362+0000","last_peered":"2024-03-30T13:12:07.631362+0000","last_clean":"2024-03-30T13:12:07.631362+0000","last_became_active":"2024-03-30T13:12:05.190015+0000","last_became_peered":"2024-03-30T13:12:05.190015+0000","last_unstale":"2024-03-30T13:12:07.631362+0000","last_undegraded":"2024-03-30T13:12:07.631362+0000","last_fullsized":"2024-03-30T13:12:07.631362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:45:05.346910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195984+0000","last_change":"2024-03-30T13:12:04.158663+0000","last_active":"2024-03-30T13:12:06.195984+0000","last_peered":"2024-03-30T13:12:06.195984+0000","last_clean":"2024-03-30T13:12:06.195984+0000","last_became_active":"2024-03-30T13:12:04.154124+0000","last_became_peered":"2024-03-30T13:12:04.154124+0000","last_unstale":"2024-03-30T13:12:06.195984+0000","last_undegraded":"2024-03-30T13:12:06.195984+0000","last_fullsized":"2024-03-30T13:12:06.195984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:35:25.821466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195212+0000","last_change":"2024-03-30T13:12:05.203460+0000","last_active":"2024-03-30T13:12:06.195212+0000","last_peered":"2024-03-30T13:12:06.195212+0000","last_clean":"2024-03-30T13:12:06.195212+0000","last_became_active":"2024-03-30T13:12:05.203114+0000","last_became_peered":"2024-03-30T13:12:05.203114+0000","last_unstale":"2024-03-30T13:12:06.195212+0000","last_undegraded":"2024-03-30T13:12:06.195212+0000","last_fullsized":"2024-03-30T13:12:06.195212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:53:58.162980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472817+0000","last_change":"2024-03-30T13:12:04.157305+0000","last_active":"2024-03-30T13:12:07.472817+0000","last_peered":"2024-03-30T13:12:07.472817+0000","last_clean":"2024-03-30T13:12:07.472817+0000","last_became_active":"2024-03-30T13:12:04.156997+0000","last_became_peered":"2024-03-30T13:12:04.156997+0000","last_unstale":"2024-03-30T13:12:07.472817+0000","last_undegraded":"2024-03-30T13:12:07.472817+0000","last_fullsized":"2024-03-30T13:12:07.472817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:01.032056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472534+0000","last_change":"2024-03-30T13:12:05.195191+0000","last_active":"2024-03-30T13:12:07.472534+0000","last_peered":"2024-03-30T13:12:07.472534+0000","last_clean":"2024-03-30T13:12:07.472534+0000","last_became_active":"2024-03-30T13:12:05.194888+0000","last_became_peered":"2024-03-30T13:12:05.194888+0000","last_unstale":"2024-03-30T13:12:07.472534+0000","last_undegraded":"2024-03-30T13:12:07.472534+0000","last_fullsized":"2024-03-30T13:12:07.472534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303584+0000","last_change":"2024-03-30T13:12:04.160490+0000","last_active":"2024-03-30T13:12:06.303584+0000","last_peered":"2024-03-30T13:12:06.303584+0000","last_clean":"2024-03-30T13:12:06.303584+0000","last_became_active":"2024-03-30T13:12:04.160169+0000","last_became_peered":"2024-03-30T13:12:04.160169+0000","last_unstale":"2024-03-30T13:12:06.303584+0000","last_undegraded":"2024-03-30T13:12:06.303584+0000","last_fullsized":"2024-03-30T13:12:06.303584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:47:50.782317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631210+0000","last_change":"2024-03-30T13:12:05.201558+0000","last_active":"2024-03-30T13:12:07.631210+0000","last_peered":"2024-03-30T13:12:07.631210+0000","last_clean":"2024-03-30T13:12:07.631210+0000","last_became_active":"2024-03-30T13:12:05.198153+0000","last_became_peered":"2024-03-30T13:12:05.198153+0000","last_unstale":"2024-03-30T13:12:07.631210+0000","last_undegraded":"2024-03-30T13:12:07.631210+0000","last_fullsized":"2024-03-30T13:12:07.631210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:05:21.340816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631182+0000","last_change":"2024-03-30T13:12:04.159693+0000","last_active":"2024-03-30T13:12:07.631182+0000","last_peered":"2024-03-30T13:12:07.631182+0000","last_clean":"2024-03-30T13:12:07.631182+0000","last_became_active":"2024-03-30T13:12:04.159246+0000","last_became_peered":"2024-03-30T13:12:04.159246+0000","last_unstale":"2024-03-30T13:12:07.631182+0000","last_undegraded":"2024-03-30T13:12:07.631182+0000","last_fullsized":"2024-03-30T13:12:07.631182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:30.867699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303414+0000","last_change":"2024-03-30T13:12:05.197111+0000","last_active":"2024-03-30T13:12:06.303414+0000","last_peered":"2024-03-30T13:12:06.303414+0000","last_clean":"2024-03-30T13:12:06.303414+0000","last_became_active":"2024-03-30T13:12:05.196881+0000","last_became_peered":"2024-03-30T13:12:05.196881+0000","last_unstale":"2024-03-30T13:12:06.303414+0000","last_undegraded":"2024-03-30T13:12:06.303414+0000","last_fullsized":"2024-03-30T13:12:06.303414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630232+0000","last_change":"2024-03-30T13:12:04.152863+0000","last_active":"2024-03-30T13:12:07.630232+0000","last_peered":"2024-03-30T13:12:07.630232+0000","last_clean":"2024-03-30T13:12:07.630232+0000","last_became_active":"2024-03-30T13:12:04.152533+0000","last_became_peered":"2024-03-30T13:12:04.152533+0000","last_unstale":"2024-03-30T13:12:07.630232+0000","last_undegraded":"2024-03-30T13:12:07.630232+0000","last_fullsized":"2024-03-30T13:12:07.630232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:01.032056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.194749+0000","last_change":"2024-03-30T13:12:05.189304+0000","last_active":"2024-03-30T13:12:06.194749+0000","last_peered":"2024-03-30T13:12:06.194749+0000","last_clean":"2024-03-30T13:12:06.194749+0000","last_became_active":"2024-03-30T13:12:05.189063+0000","last_became_peered":"2024-03-30T13:12:05.189063+0000","last_unstale":"2024-03-30T13:12:06.194749+0000","last_undegraded":"2024-03-30T13:12:06.194749+0000","last_fullsized":"2024-03-30T13:12:06.194749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:21:33.848884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198210+0000","last_change":"2024-03-30T13:12:04.158169+0000","last_active":"2024-03-30T13:12:06.198210+0000","last_peered":"2024-03-30T13:12:06.198210+0000","last_clean":"2024-03-30T13:12:06.198210+0000","last_became_active":"2024-03-30T13:12:04.157877+0000","last_became_peered":"2024-03-30T13:12:04.157877+0000","last_unstale":"2024-03-30T13:12:06.198210+0000","last_undegraded":"2024-03-30T13:12:06.198210+0000","last_fullsized":"2024-03-30T13:12:06.198210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:21:40.866398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195456+0000","last_change":"2024-03-30T13:12:05.202710+0000","last_active":"2024-03-30T13:12:06.195456+0000","last_peered":"2024-03-30T13:12:06.195456+0000","last_clean":"2024-03-30T13:12:06.195456+0000","last_became_active":"2024-03-30T13:12:05.195519+0000","last_became_peered":"2024-03-30T13:12:05.195519+0000","last_unstale":"2024-03-30T13:12:06.195456+0000","last_undegraded":"2024-03-30T13:12:06.195456+0000","last_fullsized":"2024-03-30T13:12:06.195456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:30:46.985857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199102+0000","last_change":"2024-03-30T13:12:04.160389+0000","last_active":"2024-03-30T13:12:06.199102+0000","last_peered":"2024-03-30T13:12:06.199102+0000","last_clean":"2024-03-30T13:12:06.199102+0000","last_became_active":"2024-03-30T13:12:04.158808+0000","last_became_peered":"2024-03-30T13:12:04.158808+0000","last_unstale":"2024-03-30T13:12:06.199102+0000","last_undegraded":"2024-03-30T13:12:06.199102+0000","last_fullsized":"2024-03-30T13:12:06.199102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:21.807992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.097127+0000","last_change":"2024-03-30T13:12:05.202647+0000","last_active":"2024-03-30T13:12:07.097127+0000","last_peered":"2024-03-30T13:12:07.097127+0000","last_clean":"2024-03-30T13:12:07.097127+0000","last_became_active":"2024-03-30T13:12:05.202390+0000","last_became_peered":"2024-03-30T13:12:05.202390+0000","last_unstale":"2024-03-30T13:12:07.097127+0000","last_undegraded":"2024-03-30T13:12:07.097127+0000","last_fullsized":"2024-03-30T13:12:07.097127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:47:51.787518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303535+0000","last_change":"2024-03-30T13:12:04.160282+0000","last_active":"2024-03-30T13:12:06.303535+0000","last_peered":"2024-03-30T13:12:06.303535+0000","last_clean":"2024-03-30T13:12:06.303535+0000","last_became_active":"2024-03-30T13:12:04.159950+0000","last_became_peered":"2024-03-30T13:12:04.159950+0000","last_unstale":"2024-03-30T13:12:06.303535+0000","last_undegraded":"2024-03-30T13:12:06.303535+0000","last_fullsized":"2024-03-30T13:12:06.303535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:21.149888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184613+0000","last_change":"2024-03-30T13:12:05.195404+0000","last_active":"2024-03-30T13:12:07.184613+0000","last_peered":"2024-03-30T13:12:07.184613+0000","last_clean":"2024-03-30T13:12:07.184613+0000","last_became_active":"2024-03-30T13:12:05.195140+0000","last_became_peered":"2024-03-30T13:12:05.195140+0000","last_unstale":"2024-03-30T13:12:07.184613+0000","last_undegraded":"2024-03-30T13:12:07.184613+0000","last_fullsized":"2024-03-30T13:12:07.184613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195713+0000","last_change":"2024-03-30T13:12:04.164305+0000","last_active":"2024-03-30T13:12:06.195713+0000","last_peered":"2024-03-30T13:12:06.195713+0000","last_clean":"2024-03-30T13:12:06.195713+0000","last_became_active":"2024-03-30T13:12:04.163883+0000","last_became_peered":"2024-03-30T13:12:04.163883+0000","last_unstale":"2024-03-30T13:12:06.195713+0000","last_undegraded":"2024-03-30T13:12:06.195713+0000","last_fullsized":"2024-03-30T13:12:06.195713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:01.257699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198949+0000","last_change":"2024-03-30T13:12:05.203694+0000","last_active":"2024-03-30T13:12:06.198949+0000","last_peered":"2024-03-30T13:12:06.198949+0000","last_clean":"2024-03-30T13:12:06.198949+0000","last_became_active":"2024-03-30T13:12:05.203389+0000","last_became_peered":"2024-03-30T13:12:05.203389+0000","last_unstale":"2024-03-30T13:12:06.198949+0000","last_undegraded":"2024-03-30T13:12:06.198949+0000","last_fullsized":"2024-03-30T13:12:06.198949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:07.797910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198082+0000","last_change":"2024-03-30T13:12:04.156484+0000","last_active":"2024-03-30T13:12:06.198082+0000","last_peered":"2024-03-30T13:12:06.198082+0000","last_clean":"2024-03-30T13:12:06.198082+0000","last_became_active":"2024-03-30T13:12:04.156142+0000","last_became_peered":"2024-03-30T13:12:04.156142+0000","last_unstale":"2024-03-30T13:12:06.198082+0000","last_undegraded":"2024-03-30T13:12:06.198082+0000","last_fullsized":"2024-03-30T13:12:06.198082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:18.892572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472751+0000","last_change":"2024-03-30T13:12:05.189181+0000","last_active":"2024-03-30T13:12:07.472751+0000","last_peered":"2024-03-30T13:12:07.472751+0000","last_clean":"2024-03-30T13:12:07.472751+0000","last_became_active":"2024-03-30T13:12:05.188836+0000","last_became_peered":"2024-03-30T13:12:05.188836+0000","last_unstale":"2024-03-30T13:12:07.472751+0000","last_undegraded":"2024-03-30T13:12:07.472751+0000","last_fullsized":"2024-03-30T13:12:07.472751+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184602+0000","last_change":"2024-03-30T13:12:04.160445+0000","last_active":"2024-03-30T13:12:07.184602+0000","last_peered":"2024-03-30T13:12:07.184602+0000","last_clean":"2024-03-30T13:12:07.184602+0000","last_became_active":"2024-03-30T13:12:04.159088+0000","last_became_peered":"2024-03-30T13:12:04.159088+0000","last_unstale":"2024-03-30T13:12:07.184602+0000","last_undegraded":"2024-03-30T13:12:07.184602+0000","last_fullsized":"2024-03-30T13:12:07.184602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:18.892572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184485+0000","last_change":"2024-03-30T13:12:05.206205+0000","last_active":"2024-03-30T13:12:07.184485+0000","last_peered":"2024-03-30T13:12:07.184485+0000","last_clean":"2024-03-30T13:12:07.184485+0000","last_became_active":"2024-03-30T13:12:05.205165+0000","last_became_peered":"2024-03-30T13:12:05.205165+0000","last_unstale":"2024-03-30T13:12:07.184485+0000","last_undegraded":"2024-03-30T13:12:07.184485+0000","last_fullsized":"2024-03-30T13:12:07.184485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303303+0000","last_change":"2024-03-30T13:12:04.160477+0000","last_active":"2024-03-30T13:12:06.303303+0000","last_peered":"2024-03-30T13:12:06.303303+0000","last_clean":"2024-03-30T13:12:06.303303+0000","last_became_active":"2024-03-30T13:12:04.159861+0000","last_became_peered":"2024-03-30T13:12:04.159861+0000","last_unstale":"2024-03-30T13:12:06.303303+0000","last_undegraded":"2024-03-30T13:12:06.303303+0000","last_fullsized":"2024-03-30T13:12:06.303303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:53.892406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472282+0000","last_change":"2024-03-30T13:12:05.188342+0000","last_active":"2024-03-30T13:12:07.472282+0000","last_peered":"2024-03-30T13:12:07.472282+0000","last_clean":"2024-03-30T13:12:07.472282+0000","last_became_active":"2024-03-30T13:12:05.187979+0000","last_became_peered":"2024-03-30T13:12:05.187979+0000","last_unstale":"2024-03-30T13:12:07.472282+0000","last_undegraded":"2024-03-30T13:12:07.472282+0000","last_fullsized":"2024-03-30T13:12:07.472282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:21:11.680054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.096769+0000","last_change":"2024-03-30T13:12:04.153187+0000","last_active":"2024-03-30T13:12:07.096769+0000","last_peered":"2024-03-30T13:12:07.096769+0000","last_clean":"2024-03-30T13:12:07.096769+0000","last_became_active":"2024-03-30T13:12:04.151861+0000","last_became_peered":"2024-03-30T13:12:04.151861+0000","last_unstale":"2024-03-30T13:12:07.096769+0000","last_undegraded":"2024-03-30T13:12:07.096769+0000","last_fullsized":"2024-03-30T13:12:07.096769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:28.166977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.096607+0000","last_change":"2024-03-30T13:12:05.190150+0000","last_active":"2024-03-30T13:12:07.096607+0000","last_peered":"2024-03-30T13:12:07.096607+0000","last_clean":"2024-03-30T13:12:07.096607+0000","last_became_active":"2024-03-30T13:12:05.189757+0000","last_became_peered":"2024-03-30T13:12:05.189757+0000","last_unstale":"2024-03-30T13:12:07.096607+0000","last_undegraded":"2024-03-30T13:12:07.096607+0000","last_fullsized":"2024-03-30T13:12:07.096607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:08.542298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.193957+0000","last_change":"2024-03-30T13:12:04.163783+0000","last_active":"2024-03-30T13:12:06.193957+0000","last_peered":"2024-03-30T13:12:06.193957+0000","last_clean":"2024-03-30T13:12:06.193957+0000","last_became_active":"2024-03-30T13:12:04.163480+0000","last_became_peered":"2024-03-30T13:12:04.163480+0000","last_unstale":"2024-03-30T13:12:06.193957+0000","last_undegraded":"2024-03-30T13:12:06.193957+0000","last_fullsized":"2024-03-30T13:12:06.193957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:27.744995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199312+0000","last_change":"2024-03-30T13:12:05.201073+0000","last_active":"2024-03-30T13:12:06.199312+0000","last_peered":"2024-03-30T13:12:06.199312+0000","last_clean":"2024-03-30T13:12:06.199312+0000","last_became_active":"2024-03-30T13:12:05.197377+0000","last_became_peered":"2024-03-30T13:12:05.197377+0000","last_unstale":"2024-03-30T13:12:06.199312+0000","last_undegraded":"2024-03-30T13:12:06.199312+0000","last_fullsized":"2024-03-30T13:12:06.199312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:09.490280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472403+0000","last_change":"2024-03-30T13:12:04.138835+0000","last_active":"2024-03-30T13:12:07.472403+0000","last_peered":"2024-03-30T13:12:07.472403+0000","last_clean":"2024-03-30T13:12:07.472403+0000","last_became_active":"2024-03-30T13:12:04.138108+0000","last_became_peered":"2024-03-30T13:12:04.138108+0000","last_unstale":"2024-03-30T13:12:07.472403+0000","last_undegraded":"2024-03-30T13:12:07.472403+0000","last_fullsized":"2024-03-30T13:12:07.472403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:54.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195666+0000","last_change":"2024-03-30T13:12:05.206402+0000","last_active":"2024-03-30T13:12:06.195666+0000","last_peered":"2024-03-30T13:12:06.195666+0000","last_clean":"2024-03-30T13:12:06.195666+0000","last_became_active":"2024-03-30T13:12:05.206078+0000","last_became_peered":"2024-03-30T13:12:05.206078+0000","last_unstale":"2024-03-30T13:12:06.195666+0000","last_undegraded":"2024-03-30T13:12:06.195666+0000","last_fullsized":"2024-03-30T13:12:06.195666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:33:14.192356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184886+0000","last_change":"2024-03-30T13:12:04.151193+0000","last_active":"2024-03-30T13:12:07.184886+0000","last_peered":"2024-03-30T13:12:07.184886+0000","last_clean":"2024-03-30T13:12:07.184886+0000","last_became_active":"2024-03-30T13:12:04.150870+0000","last_became_peered":"2024-03-30T13:12:04.150870+0000","last_unstale":"2024-03-30T13:12:07.184886+0000","last_undegraded":"2024-03-30T13:12:07.184886+0000","last_fullsized":"2024-03-30T13:12:07.184886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:10:39.110454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199433+0000","last_change":"2024-03-30T13:12:05.195497+0000","last_active":"2024-03-30T13:12:06.199433+0000","last_peered":"2024-03-30T13:12:06.199433+0000","last_clean":"2024-03-30T13:12:06.199433+0000","last_became_active":"2024-03-30T13:12:05.194357+0000","last_became_peered":"2024-03-30T13:12:05.194357+0000","last_unstale":"2024-03-30T13:12:06.199433+0000","last_undegraded":"2024-03-30T13:12:06.199433+0000","last_fullsized":"2024-03-30T13:12:06.199433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:27:20.267950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472991+0000","last_change":"2024-03-30T13:12:04.156791+0000","last_active":"2024-03-30T13:12:07.472991+0000","last_peered":"2024-03-30T13:12:07.472991+0000","last_clean":"2024-03-30T13:12:07.472991+0000","last_became_active":"2024-03-30T13:12:04.155722+0000","last_became_peered":"2024-03-30T13:12:04.155722+0000","last_unstale":"2024-03-30T13:12:07.472991+0000","last_undegraded":"2024-03-30T13:12:07.472991+0000","last_fullsized":"2024-03-30T13:12:07.472991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:06:07.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197592+0000","last_change":"2024-03-30T13:12:05.207142+0000","last_active":"2024-03-30T13:12:06.197592+0000","last_peered":"2024-03-30T13:12:06.197592+0000","last_clean":"2024-03-30T13:12:06.197592+0000","last_became_active":"2024-03-30T13:12:05.206893+0000","last_became_peered":"2024-03-30T13:12:05.206893+0000","last_unstale":"2024-03-30T13:12:06.197592+0000","last_undegraded":"2024-03-30T13:12:06.197592+0000","last_fullsized":"2024-03-30T13:12:06.197592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473356+0000","last_change":"2024-03-30T13:12:04.145008+0000","last_active":"2024-03-30T13:12:07.473356+0000","last_peered":"2024-03-30T13:12:07.473356+0000","last_clean":"2024-03-30T13:12:07.473356+0000","last_became_active":"2024-03-30T13:12:04.144537+0000","last_became_peered":"2024-03-30T13:12:04.144537+0000","last_unstale":"2024-03-30T13:12:07.473356+0000","last_undegraded":"2024-03-30T13:12:07.473356+0000","last_fullsized":"2024-03-30T13:12:07.473356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:30.328150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631725+0000","last_change":"2024-03-30T13:12:05.198424+0000","last_active":"2024-03-30T13:12:07.631725+0000","last_peered":"2024-03-30T13:12:07.631725+0000","last_clean":"2024-03-30T13:12:07.631725+0000","last_became_active":"2024-03-30T13:12:05.197807+0000","last_became_peered":"2024-03-30T13:12:05.197807+0000","last_unstale":"2024-03-30T13:12:07.631725+0000","last_undegraded":"2024-03-30T13:12:07.631725+0000","last_fullsized":"2024-03-30T13:12:07.631725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:02.120513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472673+0000","last_change":"2024-03-30T13:12:04.156286+0000","last_active":"2024-03-30T13:12:07.472673+0000","last_peered":"2024-03-30T13:12:07.472673+0000","last_clean":"2024-03-30T13:12:07.472673+0000","last_became_active":"2024-03-30T13:12:04.155947+0000","last_became_peered":"2024-03-30T13:12:04.155947+0000","last_unstale":"2024-03-30T13:12:07.472673+0000","last_undegraded":"2024-03-30T13:12:07.472673+0000","last_fullsized":"2024-03-30T13:12:07.472673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:47:50.782317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630786+0000","last_change":"2024-03-30T13:12:05.193970+0000","last_active":"2024-03-30T13:12:07.630786+0000","last_peered":"2024-03-30T13:12:07.630786+0000","last_clean":"2024-03-30T13:12:07.630786+0000","last_became_active":"2024-03-30T13:12:05.193676+0000","last_became_peered":"2024-03-30T13:12:05.193676+0000","last_unstale":"2024-03-30T13:12:07.630786+0000","last_undegraded":"2024-03-30T13:12:07.630786+0000","last_fullsized":"2024-03-30T13:12:07.630786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:02.262900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303332+0000","last_change":"2024-03-30T13:12:04.159232+0000","last_active":"2024-03-30T13:12:06.303332+0000","last_peered":"2024-03-30T13:12:06.303332+0000","last_clean":"2024-03-30T13:12:06.303332+0000","last_became_active":"2024-03-30T13:12:04.158956+0000","last_became_peered":"2024-03-30T13:12:04.158956+0000","last_unstale":"2024-03-30T13:12:06.303332+0000","last_undegraded":"2024-03-30T13:12:06.303332+0000","last_fullsized":"2024-03-30T13:12:06.303332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:47.113754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.194804+0000","last_change":"2024-03-30T13:12:05.208137+0000","last_active":"2024-03-30T13:12:06.194804+0000","last_peered":"2024-03-30T13:12:06.194804+0000","last_clean":"2024-03-30T13:12:06.194804+0000","last_became_active":"2024-03-30T13:12:05.206254+0000","last_became_peered":"2024-03-30T13:12:05.206254+0000","last_unstale":"2024-03-30T13:12:06.194804+0000","last_undegraded":"2024-03-30T13:12:06.194804+0000","last_fullsized":"2024-03-30T13:12:06.194804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:07:30.530008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630473+0000","last_change":"2024-03-30T13:12:04.156959+0000","last_active":"2024-03-30T13:12:07.630473+0000","last_peered":"2024-03-30T13:12:07.630473+0000","last_clean":"2024-03-30T13:12:07.630473+0000","last_became_active":"2024-03-30T13:12:04.156016+0000","last_became_peered":"2024-03-30T13:12:04.156016+0000","last_unstale":"2024-03-30T13:12:07.630473+0000","last_undegraded":"2024-03-30T13:12:07.630473+0000","last_fullsized":"2024-03-30T13:12:07.630473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198047+0000","last_change":"2024-03-30T13:12:05.204500+0000","last_active":"2024-03-30T13:12:06.198047+0000","last_peered":"2024-03-30T13:12:06.198047+0000","last_clean":"2024-03-30T13:12:06.198047+0000","last_became_active":"2024-03-30T13:12:05.204192+0000","last_became_peered":"2024-03-30T13:12:05.204192+0000","last_unstale":"2024-03-30T13:12:06.198047+0000","last_undegraded":"2024-03-30T13:12:06.198047+0000","last_fullsized":"2024-03-30T13:12:06.198047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:02.262900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.196043+0000","last_change":"2024-03-30T13:12:04.164087+0000","last_active":"2024-03-30T13:12:06.196043+0000","last_peered":"2024-03-30T13:12:06.196043+0000","last_clean":"2024-03-30T13:12:06.196043+0000","last_became_active":"2024-03-30T13:12:04.163450+0000","last_became_peered":"2024-03-30T13:12:04.163450+0000","last_unstale":"2024-03-30T13:12:06.196043+0000","last_undegraded":"2024-03-30T13:12:06.196043+0000","last_fullsized":"2024-03-30T13:12:06.196043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:05:20.335615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.096473+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:12:07.096473+0000","last_peered":"2024-03-30T13:12:07.096473+0000","last_clean":"2024-03-30T13:12:07.096473+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:12:07.096473+0000","last_undegraded":"2024-03-30T13:12:07.096473+0000","last_fullsized":"2024-03-30T13:12:07.096473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476757,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":151128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476758,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":150386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476758,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":740790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476757,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":150442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":151964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":741302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":151986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":150374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:12:14.606 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:12:14.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.821+0000 7f5436000640 1 Processor -- start 2024-03-30T13:12:14.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.821+0000 7f5436000640 1 -- start start 2024-03-30T13:12:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.823+0000 7f5436000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54300ad940 0x7f543006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.823+0000 7f5436000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f543006f060 0x7f543006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.823+0000 7f5436000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5430146230 con 0x7f543015c670 2024-03-30T13:12:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.823+0000 7f5436000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f543006dfc0 con 0x7f543006f060 2024-03-30T13:12:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.823+0000 7f5436000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f543006e2a0 con 0x7f54300ad940 2024-03-30T13:12:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.823+0000 7f542f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f543015c670 0x7f54300ad230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55822/0 (socket says 172.21.15.99:55822) 2024-03-30T13:12:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.823+0000 7f542f400640 1 -- 172.21.15.99:0/2954611670 learned_addr learned my addr 172.21.15.99:0/2954611670 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:14.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.823+0000 7f542ea00640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54300ad940 0x7f543006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.823+0000 7f542fe00640 1 --2- 172.21.15.99:0/2954611670 >> v2:172.21.15.181:3300/0 conn(0x7f543006f060 0x7f543006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.823+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840255691 0 0) 0x7f5420001110 con 0x7f543015c670 2024-03-30T13:12:14.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5414003520 con 0x7f543015c670 2024-03-30T13:12:14.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 549590784 0 0) 0x7f5414003520 con 0x7f543015c670 2024-03-30T13:12:14.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54300ad940 msgr2=0x7f543006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54300ad940 0x7f543006c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 >> v2:172.21.15.181:3300/0 conn(0x7f543006f060 msgr2=0x7f543006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 --2- 172.21.15.99:0/2954611670 >> v2:172.21.15.181:3300/0 conn(0x7f543006f060 0x7f543006d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543006e580 con 0x7f543015c670 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f5420001840 con 0x7f543015c670 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 >> v1:172.21.15.99:6789/0 conn(0x7f543015c670 legacy=0x7f54300ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54300ad940 0x7f54140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5414003fe0 0x7f5414004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5414004d40 0x7f54140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f543006dfc0 con 0x7f5414003fe0 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f543006e2a0 con 0x7f5414004d40 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f541400bb80 con 0x7f54300ad940 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542fe00640 1 --2- 172.21.15.99:0/2954611670 >> v2:172.21.15.181:3300/0 conn(0x7f543006f060 0x7f543006d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.824+0000 7f542ea00640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5414003fe0 0x7f5414004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.825+0000 7f542f400640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54300ad940 0x7f54140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.825+0000 7f542fe00640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5414004d40 0x7f54140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.825+0000 7f542ea00640 1 -- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54300ad940 msgr2=0x7f54140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.825+0000 7f542ea00640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54300ad940 0x7f54140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.825+0000 7f542ea00640 1 -- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5414004d40 msgr2=0x7f54140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.825+0000 7f542ea00640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5414004d40 0x7f54140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.825+0000 7f542ea00640 1 -- 172.21.15.99:0/2954611670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5414003520 con 0x7f5414003fe0 2024-03-30T13:12:14.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.825+0000 7f542fe00640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5414004d40 0x7f54140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:14.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.826+0000 7f542ea00640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5414003fe0 0x7f5414004800 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f541c00ba30 tx=0x7f5414005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26db47af71484e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.826+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c036020 con 0x7f5414003fe0 2024-03-30T13:12:14.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.826+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f541c032640 con 0x7f5414003fe0 2024-03-30T13:12:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.826+0000 7f542e000640 1 -- 172.21.15.99:0/2954611670 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c00b600 con 0x7f5414003fe0 2024-03-30T13:12:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.827+0000 7f5436000640 1 -- 172.21.15.99:0/2954611670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5414003fe0 msgr2=0x7f5414004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.827+0000 7f5436000640 1 --2- 172.21.15.99:0/2954611670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5414003fe0 0x7f5414004800 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f541c00ba30 tx=0x7f5414005830 comp rx=0 tx=0).stop 2024-03-30T13:12:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.827+0000 7f542fe00640 1 -- 172.21.15.99:0/2954611670 reap_dead start 2024-03-30T13:12:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.827+0000 7f5436000640 1 -- 172.21.15.99:0/2954611670 shutdown_connections 2024-03-30T13:12:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.827+0000 7f5436000640 1 -- 172.21.15.99:0/2954611670 >> 172.21.15.99:0/2954611670 conn(0x7f543006b510 msgr2=0x7f543006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.827+0000 7f5436000640 1 -- 172.21.15.99:0/2954611670 shutdown_connections 2024-03-30T13:12:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.827+0000 7f5436000640 1 -- 172.21.15.99:0/2954611670 wait complete. 2024-03-30T13:12:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.829+0000 7f5436000640 1 Processor -- start 2024-03-30T13:12:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.829+0000 7f5436000640 1 -- start start 2024-03-30T13:12:14.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.830+0000 7f5436000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5414003fe0 0x7f54301f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.830+0000 7f5436000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5430153470 0x7f54300ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.830+0000 7f5436000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54300cd420 0x7f54300b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.830+0000 7f5436000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f543006c030 con 0x7f5430153470 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.830+0000 7f5436000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f543015ca50 con 0x7f54300cd420 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.830+0000 7f5436000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f543006c1b0 con 0x7f5414003fe0 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.830+0000 7f542ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5430153470 0x7f54300ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.830+0000 7f542ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5430153470 0x7f54300ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42478/0 (socket says 172.21.15.99:42478) 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.830+0000 7f542ea00640 1 -- 172.21.15.99:0/3922835465 learned_addr learned my addr 172.21.15.99:0/3922835465 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f542f400640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5414003fe0 0x7f54301f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f542fe00640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54300cd420 0x7f54300b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f542ea00640 1 -- 172.21.15.99:0/3922835465 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5414003fe0 msgr2=0x7f54301f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f542ea00640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5414003fe0 0x7f54301f4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f542ea00640 1 -- 172.21.15.99:0/3922835465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54300cd420 msgr2=0x7f54300b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f542ea00640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54300cd420 0x7f54300b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f542ea00640 1 -- 172.21.15.99:0/3922835465 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54300ccac0 con 0x7f5430153470 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f542ea00640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5430153470 0x7f54300ccee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f541c00ba30 tx=0x7f541c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f5427400640 1 -- 172.21.15.99:0/3922835465 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c041070 con 0x7f5430153470 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f5427400640 1 -- 172.21.15.99:0/3922835465 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f541c030a50 con 0x7f5430153470 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f5427400640 1 -- 172.21.15.99:0/3922835465 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c036040 con 0x7f5430153470 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f5436000640 1 -- 172.21.15.99:0/3922835465 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f543015f5d0 con 0x7f5430153470 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.831+0000 7f5436000640 1 -- 172.21.15.99:0/3922835465 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54301f48d0 con 0x7f5430153470 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.833+0000 7f5436000640 1 -- 172.21.15.99:0/3922835465 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54300b3a90 con 0x7f5430153470 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.833+0000 7f5427400640 1 -- 172.21.15.99:0/3922835465 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f541c039020 con 0x7f5430153470 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.835+0000 7f5427400640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f541006c530 0x7f541006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.835+0000 7f5427400640 1 -- 172.21.15.99:0/3922835465 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f541c0ad8d0 con 0x7f5430153470 2024-03-30T13:12:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.835+0000 7f542f400640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f541006c530 0x7f541006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.836+0000 7f542f400640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f541006c530 0x7f541006e9f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54200012f0 tx=0x7f5420000f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:14.839+0000 7f5427400640 1 -- 172.21.15.99:0/3922835465 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f541c07be50 con 0x7f5430153470 2024-03-30T13:12:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.036+0000 7f5436000640 1 -- 172.21.15.99:0/3922835465 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5430068640 con 0x7f541006c530 2024-03-30T13:12:15.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.043+0000 7f5427400640 1 -- 172.21.15.99:0/3922835465 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f5430068640 con 0x7f541006c530 2024-03-30T13:12:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:15.052 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:12:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 -- 172.21.15.99:0/3922835465 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f541006c530 msgr2=0x7f541006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f541006c530 0x7f541006e9f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54200012f0 tx=0x7f5420000f10 comp rx=0 tx=0).stop 2024-03-30T13:12:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 -- 172.21.15.99:0/3922835465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5430153470 msgr2=0x7f54300ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5430153470 0x7f54300ccee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f541c00ba30 tx=0x7f541c004730 comp rx=0 tx=0).stop 2024-03-30T13:12:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 -- 172.21.15.99:0/3922835465 shutdown_connections 2024-03-30T13:12:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f541006c530 0x7f541006e9f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54300cd420 0x7f54300b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5430153470 0x7f54300ccee0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 --2- 172.21.15.99:0/3922835465 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5414003fe0 0x7f54301f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 -- 172.21.15.99:0/3922835465 >> 172.21.15.99:0/3922835465 conn(0x7f543006b510 msgr2=0x7f54300b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 -- 172.21.15.99:0/3922835465 shutdown_connections 2024-03-30T13:12:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.048+0000 7f5436000640 1 -- 172.21.15.99:0/3922835465 wait complete. 2024-03-30T13:12:15.072 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-03-30T13:12:13.461998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220408,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754312,"statfs":{"total":773094113280,"available":772868415488,"internally_reserved":0,"allocated":4333568,"data_stored":2388372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.297923"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303735+0000","last_change":"2024-03-30T13:12:05.188060+0000","last_active":"2024-03-30T13:12:06.303735+0000","last_peered":"2024-03-30T13:12:06.303735+0000","last_clean":"2024-03-30T13:12:06.303735+0000","last_became_active":"2024-03-30T13:12:05.187773+0000","last_became_peered":"2024-03-30T13:12:05.187773+0000","last_unstale":"2024-03-30T13:12:06.303735+0000","last_undegraded":"2024-03-30T13:12:06.303735+0000","last_fullsized":"2024-03-30T13:12:06.303735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:35:26.826667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184893+0000","last_change":"2024-03-30T13:12:05.197119+0000","last_active":"2024-03-30T13:12:07.184893+0000","last_peered":"2024-03-30T13:12:07.184893+0000","last_clean":"2024-03-30T13:12:07.184893+0000","last_became_active":"2024-03-30T13:12:05.189811+0000","last_became_peered":"2024-03-30T13:12:05.189811+0000","last_unstale":"2024-03-30T13:12:07.184893+0000","last_undegraded":"2024-03-30T13:12:07.184893+0000","last_fullsized":"2024-03-30T13:12:07.184893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.097214+0000","last_change":"2024-03-30T13:12:05.198180+0000","last_active":"2024-03-30T13:12:07.097214+0000","last_peered":"2024-03-30T13:12:07.097214+0000","last_clean":"2024-03-30T13:12:07.097214+0000","last_became_active":"2024-03-30T13:12:05.197863+0000","last_became_peered":"2024-03-30T13:12:05.197863+0000","last_unstale":"2024-03-30T13:12:07.097214+0000","last_undegraded":"2024-03-30T13:12:07.097214+0000","last_fullsized":"2024-03-30T13:12:07.097214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:55.107578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631004+0000","last_change":"2024-03-30T13:12:05.195748+0000","last_active":"2024-03-30T13:12:07.631004+0000","last_peered":"2024-03-30T13:12:07.631004+0000","last_clean":"2024-03-30T13:12:07.631004+0000","last_became_active":"2024-03-30T13:12:05.194975+0000","last_became_peered":"2024-03-30T13:12:05.194975+0000","last_unstale":"2024-03-30T13:12:07.631004+0000","last_undegraded":"2024-03-30T13:12:07.631004+0000","last_fullsized":"2024-03-30T13:12:07.631004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:21:53.293558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184896+0000","last_change":"2024-03-30T13:12:05.197297+0000","last_active":"2024-03-30T13:12:07.184896+0000","last_peered":"2024-03-30T13:12:07.184896+0000","last_clean":"2024-03-30T13:12:07.184896+0000","last_became_active":"2024-03-30T13:12:05.196664+0000","last_became_peered":"2024-03-30T13:12:05.196664+0000","last_unstale":"2024-03-30T13:12:07.184896+0000","last_undegraded":"2024-03-30T13:12:07.184896+0000","last_fullsized":"2024-03-30T13:12:07.184896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198172+0000","last_change":"2024-03-30T13:12:05.200209+0000","last_active":"2024-03-30T13:12:06.198172+0000","last_peered":"2024-03-30T13:12:06.198172+0000","last_clean":"2024-03-30T13:12:06.198172+0000","last_became_active":"2024-03-30T13:12:05.193470+0000","last_became_peered":"2024-03-30T13:12:05.193470+0000","last_unstale":"2024-03-30T13:12:06.198172+0000","last_undegraded":"2024-03-30T13:12:06.198172+0000","last_fullsized":"2024-03-30T13:12:06.198172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:14:38.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303060+0000","last_change":"2024-03-30T13:12:05.198790+0000","last_active":"2024-03-30T13:12:06.303060+0000","last_peered":"2024-03-30T13:12:06.303060+0000","last_clean":"2024-03-30T13:12:06.303060+0000","last_became_active":"2024-03-30T13:12:05.198464+0000","last_became_peered":"2024-03-30T13:12:05.198464+0000","last_unstale":"2024-03-30T13:12:06.303060+0000","last_undegraded":"2024-03-30T13:12:06.303060+0000","last_fullsized":"2024-03-30T13:12:06.303060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303025+0000","last_change":"2024-03-30T13:12:05.185825+0000","last_active":"2024-03-30T13:12:06.303025+0000","last_peered":"2024-03-30T13:12:06.303025+0000","last_clean":"2024-03-30T13:12:06.303025+0000","last_became_active":"2024-03-30T13:12:05.185534+0000","last_became_peered":"2024-03-30T13:12:05.185534+0000","last_unstale":"2024-03-30T13:12:06.303025+0000","last_undegraded":"2024-03-30T13:12:06.303025+0000","last_fullsized":"2024-03-30T13:12:06.303025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:19:59.448920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.097166+0000","last_change":"2024-03-30T13:12:05.199828+0000","last_active":"2024-03-30T13:12:07.097166+0000","last_peered":"2024-03-30T13:12:07.097166+0000","last_clean":"2024-03-30T13:12:07.097166+0000","last_became_active":"2024-03-30T13:12:05.199568+0000","last_became_peered":"2024-03-30T13:12:05.199568+0000","last_unstale":"2024-03-30T13:12:07.097166+0000","last_undegraded":"2024-03-30T13:12:07.097166+0000","last_fullsized":"2024-03-30T13:12:07.097166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:02.037257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631308+0000","last_change":"2024-03-30T13:12:05.193985+0000","last_active":"2024-03-30T13:12:07.631308+0000","last_peered":"2024-03-30T13:12:07.631308+0000","last_clean":"2024-03-30T13:12:07.631308+0000","last_became_active":"2024-03-30T13:12:05.193520+0000","last_became_peered":"2024-03-30T13:12:05.193520+0000","last_unstale":"2024-03-30T13:12:07.631308+0000","last_undegraded":"2024-03-30T13:12:07.631308+0000","last_fullsized":"2024-03-30T13:12:07.631308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:11.335766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195430+0000","last_change":"2024-03-30T13:12:05.203706+0000","last_active":"2024-03-30T13:12:06.195430+0000","last_peered":"2024-03-30T13:12:06.195430+0000","last_clean":"2024-03-30T13:12:06.195430+0000","last_became_active":"2024-03-30T13:12:05.203268+0000","last_became_peered":"2024-03-30T13:12:05.203268+0000","last_unstale":"2024-03-30T13:12:06.195430+0000","last_undegraded":"2024-03-30T13:12:06.195430+0000","last_fullsized":"2024-03-30T13:12:06.195430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:52:34.165774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.097123+0000","last_change":"2024-03-30T13:12:05.193165+0000","last_active":"2024-03-30T13:12:07.097123+0000","last_peered":"2024-03-30T13:12:07.097123+0000","last_clean":"2024-03-30T13:12:07.097123+0000","last_became_active":"2024-03-30T13:12:05.192925+0000","last_became_peered":"2024-03-30T13:12:05.192925+0000","last_unstale":"2024-03-30T13:12:07.097123+0000","last_undegraded":"2024-03-30T13:12:07.097123+0000","last_fullsized":"2024-03-30T13:12:07.097123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:31.333351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473411+0000","last_change":"2024-03-30T13:12:05.190953+0000","last_active":"2024-03-30T13:12:07.473411+0000","last_peered":"2024-03-30T13:12:07.473411+0000","last_clean":"2024-03-30T13:12:07.473411+0000","last_became_active":"2024-03-30T13:12:05.190117+0000","last_became_peered":"2024-03-30T13:12:05.190117+0000","last_unstale":"2024-03-30T13:12:07.473411+0000","last_undegraded":"2024-03-30T13:12:07.473411+0000","last_fullsized":"2024-03-30T13:12:07.473411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630995+0000","last_change":"2024-03-30T13:12:05.189430+0000","last_active":"2024-03-30T13:12:07.630995+0000","last_peered":"2024-03-30T13:12:07.630995+0000","last_clean":"2024-03-30T13:12:07.630995+0000","last_became_active":"2024-03-30T13:12:05.188612+0000","last_became_peered":"2024-03-30T13:12:05.188612+0000","last_unstale":"2024-03-30T13:12:07.630995+0000","last_undegraded":"2024-03-30T13:12:07.630995+0000","last_fullsized":"2024-03-30T13:12:07.630995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:35:26.826667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197383+0000","last_change":"2024-03-30T13:12:05.189650+0000","last_active":"2024-03-30T13:12:06.197383+0000","last_peered":"2024-03-30T13:12:06.197383+0000","last_clean":"2024-03-30T13:12:06.197383+0000","last_became_active":"2024-03-30T13:12:05.189365+0000","last_became_peered":"2024-03-30T13:12:05.189365+0000","last_unstale":"2024-03-30T13:12:06.197383+0000","last_undegraded":"2024-03-30T13:12:06.197383+0000","last_fullsized":"2024-03-30T13:12:06.197383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197043+0000","last_change":"2024-03-30T13:12:05.205900+0000","last_active":"2024-03-30T13:12:06.197043+0000","last_peered":"2024-03-30T13:12:06.197043+0000","last_clean":"2024-03-30T13:12:06.197043+0000","last_became_active":"2024-03-30T13:12:05.205616+0000","last_became_peered":"2024-03-30T13:12:05.205616+0000","last_unstale":"2024-03-30T13:12:06.197043+0000","last_undegraded":"2024-03-30T13:12:06.197043+0000","last_fullsized":"2024-03-30T13:12:06.197043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195491+0000","last_change":"2024-03-30T13:12:05.203942+0000","last_active":"2024-03-30T13:12:06.195491+0000","last_peered":"2024-03-30T13:12:06.195491+0000","last_clean":"2024-03-30T13:12:06.195491+0000","last_became_active":"2024-03-30T13:12:05.203417+0000","last_became_peered":"2024-03-30T13:12:05.203417+0000","last_unstale":"2024-03-30T13:12:06.195491+0000","last_undegraded":"2024-03-30T13:12:06.195491+0000","last_fullsized":"2024-03-30T13:12:06.195491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:21:23.305375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198673+0000","last_change":"2024-03-30T13:12:05.202224+0000","last_active":"2024-03-30T13:12:06.198673+0000","last_peered":"2024-03-30T13:12:06.198673+0000","last_clean":"2024-03-30T13:12:06.198673+0000","last_became_active":"2024-03-30T13:12:05.201944+0000","last_became_peered":"2024-03-30T13:12:05.201944+0000","last_unstale":"2024-03-30T13:12:06.198673+0000","last_undegraded":"2024-03-30T13:12:06.198673+0000","last_fullsized":"2024-03-30T13:12:06.198673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:58.129468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198924+0000","last_change":"2024-03-30T13:12:05.194980+0000","last_active":"2024-03-30T13:12:06.198924+0000","last_peered":"2024-03-30T13:12:06.198924+0000","last_clean":"2024-03-30T13:12:06.198924+0000","last_became_active":"2024-03-30T13:12:05.194702+0000","last_became_peered":"2024-03-30T13:12:05.194702+0000","last_unstale":"2024-03-30T13:12:06.198924+0000","last_undegraded":"2024-03-30T13:12:06.198924+0000","last_fullsized":"2024-03-30T13:12:06.198924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:09.286734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472876+0000","last_change":"2024-03-30T13:12:05.189386+0000","last_active":"2024-03-30T13:12:07.472876+0000","last_peered":"2024-03-30T13:12:07.472876+0000","last_clean":"2024-03-30T13:12:07.472876+0000","last_became_active":"2024-03-30T13:12:05.189025+0000","last_became_peered":"2024-03-30T13:12:05.189025+0000","last_unstale":"2024-03-30T13:12:07.472876+0000","last_undegraded":"2024-03-30T13:12:07.472876+0000","last_fullsized":"2024-03-30T13:12:07.472876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197964+0000","last_change":"2024-03-30T13:12:05.199742+0000","last_active":"2024-03-30T13:12:06.197964+0000","last_peered":"2024-03-30T13:12:06.197964+0000","last_clean":"2024-03-30T13:12:06.197964+0000","last_became_active":"2024-03-30T13:12:05.199481+0000","last_became_peered":"2024-03-30T13:12:05.199481+0000","last_unstale":"2024-03-30T13:12:06.197964+0000","last_undegraded":"2024-03-30T13:12:06.197964+0000","last_fullsized":"2024-03-30T13:12:06.197964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303138+0000","last_change":"2024-03-30T13:12:05.188672+0000","last_active":"2024-03-30T13:12:06.303138+0000","last_peered":"2024-03-30T13:12:06.303138+0000","last_clean":"2024-03-30T13:12:06.303138+0000","last_became_active":"2024-03-30T13:12:05.188399+0000","last_became_peered":"2024-03-30T13:12:05.188399+0000","last_unstale":"2024-03-30T13:12:06.303138+0000","last_undegraded":"2024-03-30T13:12:06.303138+0000","last_fullsized":"2024-03-30T13:12:06.303138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472492+0000","last_change":"2024-03-30T13:12:05.196711+0000","last_active":"2024-03-30T13:12:07.472492+0000","last_peered":"2024-03-30T13:12:07.472492+0000","last_clean":"2024-03-30T13:12:07.472492+0000","last_became_active":"2024-03-30T13:12:05.196491+0000","last_became_peered":"2024-03-30T13:12:05.196491+0000","last_unstale":"2024-03-30T13:12:07.472492+0000","last_undegraded":"2024-03-30T13:12:07.472492+0000","last_fullsized":"2024-03-30T13:12:07.472492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:19:59.448920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303011+0000","last_change":"2024-03-30T13:12:05.197850+0000","last_active":"2024-03-30T13:12:06.303011+0000","last_peered":"2024-03-30T13:12:06.303011+0000","last_clean":"2024-03-30T13:12:06.303011+0000","last_became_active":"2024-03-30T13:12:05.197372+0000","last_became_peered":"2024-03-30T13:12:05.197372+0000","last_unstale":"2024-03-30T13:12:06.303011+0000","last_undegraded":"2024-03-30T13:12:06.303011+0000","last_fullsized":"2024-03-30T13:12:06.303011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631777+0000","last_change":"2024-03-30T13:12:05.196765+0000","last_active":"2024-03-30T13:12:07.631777+0000","last_peered":"2024-03-30T13:12:07.631777+0000","last_clean":"2024-03-30T13:12:07.631777+0000","last_became_active":"2024-03-30T13:12:05.196494+0000","last_became_peered":"2024-03-30T13:12:05.196494+0000","last_unstale":"2024-03-30T13:12:07.631777+0000","last_undegraded":"2024-03-30T13:12:07.631777+0000","last_fullsized":"2024-03-30T13:12:07.631777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:04:04.845593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631641+0000","last_change":"2024-03-30T13:12:05.195759+0000","last_active":"2024-03-30T13:12:07.631641+0000","last_peered":"2024-03-30T13:12:07.631641+0000","last_clean":"2024-03-30T13:12:07.631641+0000","last_became_active":"2024-03-30T13:12:05.194287+0000","last_became_peered":"2024-03-30T13:12:05.194287+0000","last_unstale":"2024-03-30T13:12:07.631641+0000","last_undegraded":"2024-03-30T13:12:07.631641+0000","last_fullsized":"2024-03-30T13:12:07.631641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:42.770626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184547+0000","last_change":"2024-03-30T13:12:05.193501+0000","last_active":"2024-03-30T13:12:07.184547+0000","last_peered":"2024-03-30T13:12:07.184547+0000","last_clean":"2024-03-30T13:12:07.184547+0000","last_became_active":"2024-03-30T13:12:05.193217+0000","last_became_peered":"2024-03-30T13:12:05.193217+0000","last_unstale":"2024-03-30T13:12:07.184547+0000","last_undegraded":"2024-03-30T13:12:07.184547+0000","last_fullsized":"2024-03-30T13:12:07.184547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303734+0000","last_change":"2024-03-30T13:12:05.192324+0000","last_active":"2024-03-30T13:12:06.303734+0000","last_peered":"2024-03-30T13:12:06.303734+0000","last_clean":"2024-03-30T13:12:06.303734+0000","last_became_active":"2024-03-30T13:12:05.191434+0000","last_became_peered":"2024-03-30T13:12:05.191434+0000","last_unstale":"2024-03-30T13:12:06.303734+0000","last_undegraded":"2024-03-30T13:12:06.303734+0000","last_fullsized":"2024-03-30T13:12:06.303734+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:02.262900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197939+0000","last_change":"2024-03-30T13:12:05.189273+0000","last_active":"2024-03-30T13:12:06.197939+0000","last_peered":"2024-03-30T13:12:06.197939+0000","last_clean":"2024-03-30T13:12:06.197939+0000","last_became_active":"2024-03-30T13:12:05.188992+0000","last_became_peered":"2024-03-30T13:12:05.188992+0000","last_unstale":"2024-03-30T13:12:06.197939+0000","last_undegraded":"2024-03-30T13:12:06.197939+0000","last_fullsized":"2024-03-30T13:12:06.197939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:28.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197637+0000","last_change":"2024-03-30T13:12:05.194632+0000","last_active":"2024-03-30T13:12:06.197637+0000","last_peered":"2024-03-30T13:12:06.197637+0000","last_clean":"2024-03-30T13:12:06.197637+0000","last_became_active":"2024-03-30T13:12:05.194383+0000","last_became_peered":"2024-03-30T13:12:05.194383+0000","last_unstale":"2024-03-30T13:12:06.197637+0000","last_undegraded":"2024-03-30T13:12:06.197637+0000","last_fullsized":"2024-03-30T13:12:06.197637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303286+0000","last_change":"2024-03-30T13:12:05.206518+0000","last_active":"2024-03-30T13:12:06.303286+0000","last_peered":"2024-03-30T13:12:06.303286+0000","last_clean":"2024-03-30T13:12:06.303286+0000","last_became_active":"2024-03-30T13:12:05.205663+0000","last_became_peered":"2024-03-30T13:12:05.205663+0000","last_unstale":"2024-03-30T13:12:06.303286+0000","last_undegraded":"2024-03-30T13:12:06.303286+0000","last_fullsized":"2024-03-30T13:12:06.303286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.193939+0000","last_change":"2024-03-30T13:12:05.193656+0000","last_active":"2024-03-30T13:12:06.193939+0000","last_peered":"2024-03-30T13:12:06.193939+0000","last_clean":"2024-03-30T13:12:06.193939+0000","last_became_active":"2024-03-30T13:12:05.190500+0000","last_became_peered":"2024-03-30T13:12:05.190500+0000","last_unstale":"2024-03-30T13:12:06.193939+0000","last_undegraded":"2024-03-30T13:12:06.193939+0000","last_fullsized":"2024-03-30T13:12:06.193939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:21.440022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473000+0000","last_change":"2024-03-30T13:12:05.203814+0000","last_active":"2024-03-30T13:12:07.473000+0000","last_peered":"2024-03-30T13:12:07.473000+0000","last_clean":"2024-03-30T13:12:07.473000+0000","last_became_active":"2024-03-30T13:12:05.203408+0000","last_became_peered":"2024-03-30T13:12:05.203408+0000","last_unstale":"2024-03-30T13:12:07.473000+0000","last_undegraded":"2024-03-30T13:12:07.473000+0000","last_fullsized":"2024-03-30T13:12:07.473000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:48.464714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195722+0000","last_change":"2024-03-30T13:12:04.161934+0000","last_active":"2024-03-30T13:12:06.195722+0000","last_peered":"2024-03-30T13:12:06.195722+0000","last_clean":"2024-03-30T13:12:06.195722+0000","last_became_active":"2024-03-30T13:12:04.161721+0000","last_became_peered":"2024-03-30T13:12:04.161721+0000","last_unstale":"2024-03-30T13:12:06.195722+0000","last_undegraded":"2024-03-30T13:12:06.195722+0000","last_fullsized":"2024-03-30T13:12:06.195722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:21:52.288358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303797+0000","last_change":"2024-03-30T13:12:05.187153+0000","last_active":"2024-03-30T13:12:06.303797+0000","last_peered":"2024-03-30T13:12:06.303797+0000","last_clean":"2024-03-30T13:12:06.303797+0000","last_became_active":"2024-03-30T13:12:05.186830+0000","last_became_peered":"2024-03-30T13:12:05.186830+0000","last_unstale":"2024-03-30T13:12:06.303797+0000","last_undegraded":"2024-03-30T13:12:06.303797+0000","last_fullsized":"2024-03-30T13:12:06.303797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:21:53.293558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631425+0000","last_change":"2024-03-30T13:12:04.156757+0000","last_active":"2024-03-30T13:12:07.631425+0000","last_peered":"2024-03-30T13:12:07.631425+0000","last_clean":"2024-03-30T13:12:07.631425+0000","last_became_active":"2024-03-30T13:12:04.156049+0000","last_became_peered":"2024-03-30T13:12:04.156049+0000","last_unstale":"2024-03-30T13:12:07.631425+0000","last_undegraded":"2024-03-30T13:12:07.631425+0000","last_fullsized":"2024-03-30T13:12:07.631425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:54.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303891+0000","last_change":"2024-03-30T13:12:05.197460+0000","last_active":"2024-03-30T13:12:06.303891+0000","last_peered":"2024-03-30T13:12:06.303891+0000","last_clean":"2024-03-30T13:12:06.303891+0000","last_became_active":"2024-03-30T13:12:05.197167+0000","last_became_peered":"2024-03-30T13:12:05.197167+0000","last_unstale":"2024-03-30T13:12:06.303891+0000","last_undegraded":"2024-03-30T13:12:06.303891+0000","last_fullsized":"2024-03-30T13:12:06.303891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:05:21.340816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199295+0000","last_change":"2024-03-30T13:12:04.160804+0000","last_active":"2024-03-30T13:12:06.199295+0000","last_peered":"2024-03-30T13:12:06.199295+0000","last_clean":"2024-03-30T13:12:06.199295+0000","last_became_active":"2024-03-30T13:12:04.160592+0000","last_became_peered":"2024-03-30T13:12:04.160592+0000","last_unstale":"2024-03-30T13:12:06.199295+0000","last_undegraded":"2024-03-30T13:12:06.199295+0000","last_fullsized":"2024-03-30T13:12:06.199295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:48.643179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631257+0000","last_change":"2024-03-30T13:12:05.198359+0000","last_active":"2024-03-30T13:12:07.631257+0000","last_peered":"2024-03-30T13:12:07.631257+0000","last_clean":"2024-03-30T13:12:07.631257+0000","last_became_active":"2024-03-30T13:12:05.197998+0000","last_became_peered":"2024-03-30T13:12:05.197998+0000","last_unstale":"2024-03-30T13:12:07.631257+0000","last_undegraded":"2024-03-30T13:12:07.631257+0000","last_fullsized":"2024-03-30T13:12:07.631257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:38.341209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631575+0000","last_change":"2024-03-30T13:12:04.160626+0000","last_active":"2024-03-30T13:12:07.631575+0000","last_peered":"2024-03-30T13:12:07.631575+0000","last_clean":"2024-03-30T13:12:07.631575+0000","last_became_active":"2024-03-30T13:12:04.160357+0000","last_became_peered":"2024-03-30T13:12:04.160357+0000","last_unstale":"2024-03-30T13:12:07.631575+0000","last_undegraded":"2024-03-30T13:12:07.631575+0000","last_fullsized":"2024-03-30T13:12:07.631575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:06:07.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.096624+0000","last_change":"2024-03-30T13:12:05.200545+0000","last_active":"2024-03-30T13:12:07.096624+0000","last_peered":"2024-03-30T13:12:07.096624+0000","last_clean":"2024-03-30T13:12:07.096624+0000","last_became_active":"2024-03-30T13:12:05.200239+0000","last_became_peered":"2024-03-30T13:12:05.200239+0000","last_unstale":"2024-03-30T13:12:07.096624+0000","last_undegraded":"2024-03-30T13:12:07.096624+0000","last_fullsized":"2024-03-30T13:12:07.096624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:54.897607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303453+0000","last_change":"2024-03-30T13:12:04.150040+0000","last_active":"2024-03-30T13:12:06.303453+0000","last_peered":"2024-03-30T13:12:06.303453+0000","last_clean":"2024-03-30T13:12:06.303453+0000","last_became_active":"2024-03-30T13:12:04.149747+0000","last_became_peered":"2024-03-30T13:12:04.149747+0000","last_unstale":"2024-03-30T13:12:06.303453+0000","last_undegraded":"2024-03-30T13:12:06.303453+0000","last_fullsized":"2024-03-30T13:12:06.303453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:31:02.606363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303292+0000","last_change":"2024-03-30T13:12:05.205425+0000","last_active":"2024-03-30T13:12:06.303292+0000","last_peered":"2024-03-30T13:12:06.303292+0000","last_clean":"2024-03-30T13:12:06.303292+0000","last_became_active":"2024-03-30T13:12:05.204916+0000","last_became_peered":"2024-03-30T13:12:05.204916+0000","last_unstale":"2024-03-30T13:12:06.303292+0000","last_undegraded":"2024-03-30T13:12:06.303292+0000","last_fullsized":"2024-03-30T13:12:06.303292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:28.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303284+0000","last_change":"2024-03-30T13:12:04.149618+0000","last_active":"2024-03-30T13:12:06.303284+0000","last_peered":"2024-03-30T13:12:06.303284+0000","last_clean":"2024-03-30T13:12:06.303284+0000","last_became_active":"2024-03-30T13:12:04.149252+0000","last_became_peered":"2024-03-30T13:12:04.149252+0000","last_unstale":"2024-03-30T13:12:06.303284+0000","last_undegraded":"2024-03-30T13:12:06.303284+0000","last_fullsized":"2024-03-30T13:12:06.303284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:07.537097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.096393+0000","last_change":"2024-03-30T13:12:05.192119+0000","last_active":"2024-03-30T13:12:07.096393+0000","last_peered":"2024-03-30T13:12:07.096393+0000","last_clean":"2024-03-30T13:12:07.096393+0000","last_became_active":"2024-03-30T13:12:05.191809+0000","last_became_peered":"2024-03-30T13:12:05.191809+0000","last_unstale":"2024-03-30T13:12:07.096393+0000","last_undegraded":"2024-03-30T13:12:07.096393+0000","last_fullsized":"2024-03-30T13:12:07.096393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:31:03.611564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198401+0000","last_change":"2024-03-30T13:12:04.157894+0000","last_active":"2024-03-30T13:12:06.198401+0000","last_peered":"2024-03-30T13:12:06.198401+0000","last_clean":"2024-03-30T13:12:06.198401+0000","last_became_active":"2024-03-30T13:12:04.157491+0000","last_became_peered":"2024-03-30T13:12:04.157491+0000","last_unstale":"2024-03-30T13:12:06.198401+0000","last_undegraded":"2024-03-30T13:12:06.198401+0000","last_fullsized":"2024-03-30T13:12:06.198401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:34:25.438955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630535+0000","last_change":"2024-03-30T13:12:05.199546+0000","last_active":"2024-03-30T13:12:07.630535+0000","last_peered":"2024-03-30T13:12:07.630535+0000","last_clean":"2024-03-30T13:12:07.630535+0000","last_became_active":"2024-03-30T13:12:05.199239+0000","last_became_peered":"2024-03-30T13:12:05.199239+0000","last_unstale":"2024-03-30T13:12:07.630535+0000","last_undegraded":"2024-03-30T13:12:07.630535+0000","last_fullsized":"2024-03-30T13:12:07.630535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:28.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303186+0000","last_change":"2024-03-30T13:12:04.155737+0000","last_active":"2024-03-30T13:12:06.303186+0000","last_peered":"2024-03-30T13:12:06.303186+0000","last_clean":"2024-03-30T13:12:06.303186+0000","last_became_active":"2024-03-30T13:12:04.155473+0000","last_became_peered":"2024-03-30T13:12:04.155473+0000","last_unstale":"2024-03-30T13:12:06.303186+0000","last_undegraded":"2024-03-30T13:12:06.303186+0000","last_fullsized":"2024-03-30T13:12:06.303186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:30.328150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195290+0000","last_change":"2024-03-30T13:12:05.205912+0000","last_active":"2024-03-30T13:12:06.195290+0000","last_peered":"2024-03-30T13:12:06.195290+0000","last_clean":"2024-03-30T13:12:06.195290+0000","last_became_active":"2024-03-30T13:12:05.204277+0000","last_became_peered":"2024-03-30T13:12:05.204277+0000","last_unstale":"2024-03-30T13:12:06.195290+0000","last_undegraded":"2024-03-30T13:12:06.195290+0000","last_fullsized":"2024-03-30T13:12:06.195290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:49:49.633776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184977+0000","last_change":"2024-03-30T13:12:04.152194+0000","last_active":"2024-03-30T13:12:07.184977+0000","last_peered":"2024-03-30T13:12:07.184977+0000","last_clean":"2024-03-30T13:12:07.184977+0000","last_became_active":"2024-03-30T13:12:04.151844+0000","last_became_peered":"2024-03-30T13:12:04.151844+0000","last_unstale":"2024-03-30T13:12:07.184977+0000","last_undegraded":"2024-03-30T13:12:07.184977+0000","last_fullsized":"2024-03-30T13:12:07.184977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.632067+0000","last_change":"2024-03-30T13:12:05.191219+0000","last_active":"2024-03-30T13:12:07.632067+0000","last_peered":"2024-03-30T13:12:07.632067+0000","last_clean":"2024-03-30T13:12:07.632067+0000","last_became_active":"2024-03-30T13:12:05.187503+0000","last_became_peered":"2024-03-30T13:12:05.187503+0000","last_unstale":"2024-03-30T13:12:07.632067+0000","last_undegraded":"2024-03-30T13:12:07.632067+0000","last_fullsized":"2024-03-30T13:12:07.632067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:34:30.445284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184510+0000","last_change":"2024-03-30T13:12:04.151674+0000","last_active":"2024-03-30T13:12:07.184510+0000","last_peered":"2024-03-30T13:12:07.184510+0000","last_clean":"2024-03-30T13:12:07.184510+0000","last_became_active":"2024-03-30T13:12:04.151273+0000","last_became_peered":"2024-03-30T13:12:04.151273+0000","last_unstale":"2024-03-30T13:12:07.184510+0000","last_undegraded":"2024-03-30T13:12:07.184510+0000","last_fullsized":"2024-03-30T13:12:07.184510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:35:19.563529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631362+0000","last_change":"2024-03-30T13:12:05.195768+0000","last_active":"2024-03-30T13:12:07.631362+0000","last_peered":"2024-03-30T13:12:07.631362+0000","last_clean":"2024-03-30T13:12:07.631362+0000","last_became_active":"2024-03-30T13:12:05.190015+0000","last_became_peered":"2024-03-30T13:12:05.190015+0000","last_unstale":"2024-03-30T13:12:07.631362+0000","last_undegraded":"2024-03-30T13:12:07.631362+0000","last_fullsized":"2024-03-30T13:12:07.631362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:45:05.346910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195984+0000","last_change":"2024-03-30T13:12:04.158663+0000","last_active":"2024-03-30T13:12:06.195984+0000","last_peered":"2024-03-30T13:12:06.195984+0000","last_clean":"2024-03-30T13:12:06.195984+0000","last_became_active":"2024-03-30T13:12:04.154124+0000","last_became_peered":"2024-03-30T13:12:04.154124+0000","last_unstale":"2024-03-30T13:12:06.195984+0000","last_undegraded":"2024-03-30T13:12:06.195984+0000","last_fullsized":"2024-03-30T13:12:06.195984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:35:25.821466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195212+0000","last_change":"2024-03-30T13:12:05.203460+0000","last_active":"2024-03-30T13:12:06.195212+0000","last_peered":"2024-03-30T13:12:06.195212+0000","last_clean":"2024-03-30T13:12:06.195212+0000","last_became_active":"2024-03-30T13:12:05.203114+0000","last_became_peered":"2024-03-30T13:12:05.203114+0000","last_unstale":"2024-03-30T13:12:06.195212+0000","last_undegraded":"2024-03-30T13:12:06.195212+0000","last_fullsized":"2024-03-30T13:12:06.195212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:53:58.162980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472817+0000","last_change":"2024-03-30T13:12:04.157305+0000","last_active":"2024-03-30T13:12:07.472817+0000","last_peered":"2024-03-30T13:12:07.472817+0000","last_clean":"2024-03-30T13:12:07.472817+0000","last_became_active":"2024-03-30T13:12:04.156997+0000","last_became_peered":"2024-03-30T13:12:04.156997+0000","last_unstale":"2024-03-30T13:12:07.472817+0000","last_undegraded":"2024-03-30T13:12:07.472817+0000","last_fullsized":"2024-03-30T13:12:07.472817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:01.032056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472534+0000","last_change":"2024-03-30T13:12:05.195191+0000","last_active":"2024-03-30T13:12:07.472534+0000","last_peered":"2024-03-30T13:12:07.472534+0000","last_clean":"2024-03-30T13:12:07.472534+0000","last_became_active":"2024-03-30T13:12:05.194888+0000","last_became_peered":"2024-03-30T13:12:05.194888+0000","last_unstale":"2024-03-30T13:12:07.472534+0000","last_undegraded":"2024-03-30T13:12:07.472534+0000","last_fullsized":"2024-03-30T13:12:07.472534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303584+0000","last_change":"2024-03-30T13:12:04.160490+0000","last_active":"2024-03-30T13:12:06.303584+0000","last_peered":"2024-03-30T13:12:06.303584+0000","last_clean":"2024-03-30T13:12:06.303584+0000","last_became_active":"2024-03-30T13:12:04.160169+0000","last_became_peered":"2024-03-30T13:12:04.160169+0000","last_unstale":"2024-03-30T13:12:06.303584+0000","last_undegraded":"2024-03-30T13:12:06.303584+0000","last_fullsized":"2024-03-30T13:12:06.303584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:47:50.782317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631210+0000","last_change":"2024-03-30T13:12:05.201558+0000","last_active":"2024-03-30T13:12:07.631210+0000","last_peered":"2024-03-30T13:12:07.631210+0000","last_clean":"2024-03-30T13:12:07.631210+0000","last_became_active":"2024-03-30T13:12:05.198153+0000","last_became_peered":"2024-03-30T13:12:05.198153+0000","last_unstale":"2024-03-30T13:12:07.631210+0000","last_undegraded":"2024-03-30T13:12:07.631210+0000","last_fullsized":"2024-03-30T13:12:07.631210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:05:21.340816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631182+0000","last_change":"2024-03-30T13:12:04.159693+0000","last_active":"2024-03-30T13:12:07.631182+0000","last_peered":"2024-03-30T13:12:07.631182+0000","last_clean":"2024-03-30T13:12:07.631182+0000","last_became_active":"2024-03-30T13:12:04.159246+0000","last_became_peered":"2024-03-30T13:12:04.159246+0000","last_unstale":"2024-03-30T13:12:07.631182+0000","last_undegraded":"2024-03-30T13:12:07.631182+0000","last_fullsized":"2024-03-30T13:12:07.631182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:30.867699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303414+0000","last_change":"2024-03-30T13:12:05.197111+0000","last_active":"2024-03-30T13:12:06.303414+0000","last_peered":"2024-03-30T13:12:06.303414+0000","last_clean":"2024-03-30T13:12:06.303414+0000","last_became_active":"2024-03-30T13:12:05.196881+0000","last_became_peered":"2024-03-30T13:12:05.196881+0000","last_unstale":"2024-03-30T13:12:06.303414+0000","last_undegraded":"2024-03-30T13:12:06.303414+0000","last_fullsized":"2024-03-30T13:12:06.303414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:03:49.991605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630232+0000","last_change":"2024-03-30T13:12:04.152863+0000","last_active":"2024-03-30T13:12:07.630232+0000","last_peered":"2024-03-30T13:12:07.630232+0000","last_clean":"2024-03-30T13:12:07.630232+0000","last_became_active":"2024-03-30T13:12:04.152533+0000","last_became_peered":"2024-03-30T13:12:04.152533+0000","last_unstale":"2024-03-30T13:12:07.630232+0000","last_undegraded":"2024-03-30T13:12:07.630232+0000","last_fullsized":"2024-03-30T13:12:07.630232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:37:01.032056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.194749+0000","last_change":"2024-03-30T13:12:05.189304+0000","last_active":"2024-03-30T13:12:06.194749+0000","last_peered":"2024-03-30T13:12:06.194749+0000","last_clean":"2024-03-30T13:12:06.194749+0000","last_became_active":"2024-03-30T13:12:05.189063+0000","last_became_peered":"2024-03-30T13:12:05.189063+0000","last_unstale":"2024-03-30T13:12:06.194749+0000","last_undegraded":"2024-03-30T13:12:06.194749+0000","last_fullsized":"2024-03-30T13:12:06.194749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:21:33.848884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198210+0000","last_change":"2024-03-30T13:12:04.158169+0000","last_active":"2024-03-30T13:12:06.198210+0000","last_peered":"2024-03-30T13:12:06.198210+0000","last_clean":"2024-03-30T13:12:06.198210+0000","last_became_active":"2024-03-30T13:12:04.157877+0000","last_became_peered":"2024-03-30T13:12:04.157877+0000","last_unstale":"2024-03-30T13:12:06.198210+0000","last_undegraded":"2024-03-30T13:12:06.198210+0000","last_fullsized":"2024-03-30T13:12:06.198210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:21:40.866398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195456+0000","last_change":"2024-03-30T13:12:05.202710+0000","last_active":"2024-03-30T13:12:06.195456+0000","last_peered":"2024-03-30T13:12:06.195456+0000","last_clean":"2024-03-30T13:12:06.195456+0000","last_became_active":"2024-03-30T13:12:05.195519+0000","last_became_peered":"2024-03-30T13:12:05.195519+0000","last_unstale":"2024-03-30T13:12:06.195456+0000","last_undegraded":"2024-03-30T13:12:06.195456+0000","last_fullsized":"2024-03-30T13:12:06.195456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:30:46.985857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199102+0000","last_change":"2024-03-30T13:12:04.160389+0000","last_active":"2024-03-30T13:12:06.199102+0000","last_peered":"2024-03-30T13:12:06.199102+0000","last_clean":"2024-03-30T13:12:06.199102+0000","last_became_active":"2024-03-30T13:12:04.158808+0000","last_became_peered":"2024-03-30T13:12:04.158808+0000","last_unstale":"2024-03-30T13:12:06.199102+0000","last_undegraded":"2024-03-30T13:12:06.199102+0000","last_fullsized":"2024-03-30T13:12:06.199102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:21.807992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.097127+0000","last_change":"2024-03-30T13:12:05.202647+0000","last_active":"2024-03-30T13:12:07.097127+0000","last_peered":"2024-03-30T13:12:07.097127+0000","last_clean":"2024-03-30T13:12:07.097127+0000","last_became_active":"2024-03-30T13:12:05.202390+0000","last_became_peered":"2024-03-30T13:12:05.202390+0000","last_unstale":"2024-03-30T13:12:07.097127+0000","last_undegraded":"2024-03-30T13:12:07.097127+0000","last_fullsized":"2024-03-30T13:12:07.097127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:47:51.787518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303535+0000","last_change":"2024-03-30T13:12:04.160282+0000","last_active":"2024-03-30T13:12:06.303535+0000","last_peered":"2024-03-30T13:12:06.303535+0000","last_clean":"2024-03-30T13:12:06.303535+0000","last_became_active":"2024-03-30T13:12:04.159950+0000","last_became_peered":"2024-03-30T13:12:04.159950+0000","last_unstale":"2024-03-30T13:12:06.303535+0000","last_undegraded":"2024-03-30T13:12:06.303535+0000","last_fullsized":"2024-03-30T13:12:06.303535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:21.149888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184613+0000","last_change":"2024-03-30T13:12:05.195404+0000","last_active":"2024-03-30T13:12:07.184613+0000","last_peered":"2024-03-30T13:12:07.184613+0000","last_clean":"2024-03-30T13:12:07.184613+0000","last_became_active":"2024-03-30T13:12:05.195140+0000","last_became_peered":"2024-03-30T13:12:05.195140+0000","last_unstale":"2024-03-30T13:12:07.184613+0000","last_undegraded":"2024-03-30T13:12:07.184613+0000","last_fullsized":"2024-03-30T13:12:07.184613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195713+0000","last_change":"2024-03-30T13:12:04.164305+0000","last_active":"2024-03-30T13:12:06.195713+0000","last_peered":"2024-03-30T13:12:06.195713+0000","last_clean":"2024-03-30T13:12:06.195713+0000","last_became_active":"2024-03-30T13:12:04.163883+0000","last_became_peered":"2024-03-30T13:12:04.163883+0000","last_unstale":"2024-03-30T13:12:06.195713+0000","last_undegraded":"2024-03-30T13:12:06.195713+0000","last_fullsized":"2024-03-30T13:12:06.195713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:01.257699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198949+0000","last_change":"2024-03-30T13:12:05.203694+0000","last_active":"2024-03-30T13:12:06.198949+0000","last_peered":"2024-03-30T13:12:06.198949+0000","last_clean":"2024-03-30T13:12:06.198949+0000","last_became_active":"2024-03-30T13:12:05.203389+0000","last_became_peered":"2024-03-30T13:12:05.203389+0000","last_unstale":"2024-03-30T13:12:06.198949+0000","last_undegraded":"2024-03-30T13:12:06.198949+0000","last_fullsized":"2024-03-30T13:12:06.198949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:07.797910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198082+0000","last_change":"2024-03-30T13:12:04.156484+0000","last_active":"2024-03-30T13:12:06.198082+0000","last_peered":"2024-03-30T13:12:06.198082+0000","last_clean":"2024-03-30T13:12:06.198082+0000","last_became_active":"2024-03-30T13:12:04.156142+0000","last_became_peered":"2024-03-30T13:12:04.156142+0000","last_unstale":"2024-03-30T13:12:06.198082+0000","last_undegraded":"2024-03-30T13:12:06.198082+0000","last_fullsized":"2024-03-30T13:12:06.198082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:18.892572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472751+0000","last_change":"2024-03-30T13:12:05.189181+0000","last_active":"2024-03-30T13:12:07.472751+0000","last_peered":"2024-03-30T13:12:07.472751+0000","last_clean":"2024-03-30T13:12:07.472751+0000","last_became_active":"2024-03-30T13:12:05.188836+0000","last_became_peered":"2024-03-30T13:12:05.188836+0000","last_unstale":"2024-03-30T13:12:07.472751+0000","last_undegraded":"2024-03-30T13:12:07.472751+0000","last_fullsized":"2024-03-30T13:12:07.472751+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:22:24.932267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184602+0000","last_change":"2024-03-30T13:12:04.160445+0000","last_active":"2024-03-30T13:12:07.184602+0000","last_peered":"2024-03-30T13:12:07.184602+0000","last_clean":"2024-03-30T13:12:07.184602+0000","last_became_active":"2024-03-30T13:12:04.159088+0000","last_became_peered":"2024-03-30T13:12:04.159088+0000","last_unstale":"2024-03-30T13:12:07.184602+0000","last_undegraded":"2024-03-30T13:12:07.184602+0000","last_fullsized":"2024-03-30T13:12:07.184602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:18.892572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184485+0000","last_change":"2024-03-30T13:12:05.206205+0000","last_active":"2024-03-30T13:12:07.184485+0000","last_peered":"2024-03-30T13:12:07.184485+0000","last_clean":"2024-03-30T13:12:07.184485+0000","last_became_active":"2024-03-30T13:12:05.205165+0000","last_became_peered":"2024-03-30T13:12:05.205165+0000","last_unstale":"2024-03-30T13:12:07.184485+0000","last_undegraded":"2024-03-30T13:12:07.184485+0000","last_fullsized":"2024-03-30T13:12:07.184485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:00.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303303+0000","last_change":"2024-03-30T13:12:04.160477+0000","last_active":"2024-03-30T13:12:06.303303+0000","last_peered":"2024-03-30T13:12:06.303303+0000","last_clean":"2024-03-30T13:12:06.303303+0000","last_became_active":"2024-03-30T13:12:04.159861+0000","last_became_peered":"2024-03-30T13:12:04.159861+0000","last_unstale":"2024-03-30T13:12:06.303303+0000","last_undegraded":"2024-03-30T13:12:06.303303+0000","last_fullsized":"2024-03-30T13:12:06.303303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:53.892406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472282+0000","last_change":"2024-03-30T13:12:05.188342+0000","last_active":"2024-03-30T13:12:07.472282+0000","last_peered":"2024-03-30T13:12:07.472282+0000","last_clean":"2024-03-30T13:12:07.472282+0000","last_became_active":"2024-03-30T13:12:05.187979+0000","last_became_peered":"2024-03-30T13:12:05.187979+0000","last_unstale":"2024-03-30T13:12:07.472282+0000","last_undegraded":"2024-03-30T13:12:07.472282+0000","last_fullsized":"2024-03-30T13:12:07.472282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:21:11.680054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.096769+0000","last_change":"2024-03-30T13:12:04.153187+0000","last_active":"2024-03-30T13:12:07.096769+0000","last_peered":"2024-03-30T13:12:07.096769+0000","last_clean":"2024-03-30T13:12:07.096769+0000","last_became_active":"2024-03-30T13:12:04.151861+0000","last_became_peered":"2024-03-30T13:12:04.151861+0000","last_unstale":"2024-03-30T13:12:07.096769+0000","last_undegraded":"2024-03-30T13:12:07.096769+0000","last_fullsized":"2024-03-30T13:12:07.096769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:28.166977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.096607+0000","last_change":"2024-03-30T13:12:05.190150+0000","last_active":"2024-03-30T13:12:07.096607+0000","last_peered":"2024-03-30T13:12:07.096607+0000","last_clean":"2024-03-30T13:12:07.096607+0000","last_became_active":"2024-03-30T13:12:05.189757+0000","last_became_peered":"2024-03-30T13:12:05.189757+0000","last_unstale":"2024-03-30T13:12:07.096607+0000","last_undegraded":"2024-03-30T13:12:07.096607+0000","last_fullsized":"2024-03-30T13:12:07.096607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:08.542298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.193957+0000","last_change":"2024-03-30T13:12:04.163783+0000","last_active":"2024-03-30T13:12:06.193957+0000","last_peered":"2024-03-30T13:12:06.193957+0000","last_clean":"2024-03-30T13:12:06.193957+0000","last_became_active":"2024-03-30T13:12:04.163480+0000","last_became_peered":"2024-03-30T13:12:04.163480+0000","last_unstale":"2024-03-30T13:12:06.193957+0000","last_undegraded":"2024-03-30T13:12:06.193957+0000","last_fullsized":"2024-03-30T13:12:06.193957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:27.744995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199312+0000","last_change":"2024-03-30T13:12:05.201073+0000","last_active":"2024-03-30T13:12:06.199312+0000","last_peered":"2024-03-30T13:12:06.199312+0000","last_clean":"2024-03-30T13:12:06.199312+0000","last_became_active":"2024-03-30T13:12:05.197377+0000","last_became_peered":"2024-03-30T13:12:05.197377+0000","last_unstale":"2024-03-30T13:12:06.199312+0000","last_undegraded":"2024-03-30T13:12:06.199312+0000","last_fullsized":"2024-03-30T13:12:06.199312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:09.490280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472403+0000","last_change":"2024-03-30T13:12:04.138835+0000","last_active":"2024-03-30T13:12:07.472403+0000","last_peered":"2024-03-30T13:12:07.472403+0000","last_clean":"2024-03-30T13:12:07.472403+0000","last_became_active":"2024-03-30T13:12:04.138108+0000","last_became_peered":"2024-03-30T13:12:04.138108+0000","last_unstale":"2024-03-30T13:12:07.472403+0000","last_undegraded":"2024-03-30T13:12:07.472403+0000","last_fullsized":"2024-03-30T13:12:07.472403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:54.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.195666+0000","last_change":"2024-03-30T13:12:05.206402+0000","last_active":"2024-03-30T13:12:06.195666+0000","last_peered":"2024-03-30T13:12:06.195666+0000","last_clean":"2024-03-30T13:12:06.195666+0000","last_became_active":"2024-03-30T13:12:05.206078+0000","last_became_peered":"2024-03-30T13:12:05.206078+0000","last_unstale":"2024-03-30T13:12:06.195666+0000","last_undegraded":"2024-03-30T13:12:06.195666+0000","last_fullsized":"2024-03-30T13:12:06.195666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:33:14.192356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.184886+0000","last_change":"2024-03-30T13:12:04.151193+0000","last_active":"2024-03-30T13:12:07.184886+0000","last_peered":"2024-03-30T13:12:07.184886+0000","last_clean":"2024-03-30T13:12:07.184886+0000","last_became_active":"2024-03-30T13:12:04.150870+0000","last_became_peered":"2024-03-30T13:12:04.150870+0000","last_unstale":"2024-03-30T13:12:07.184886+0000","last_undegraded":"2024-03-30T13:12:07.184886+0000","last_fullsized":"2024-03-30T13:12:07.184886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:10:39.110454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.199433+0000","last_change":"2024-03-30T13:12:05.195497+0000","last_active":"2024-03-30T13:12:06.199433+0000","last_peered":"2024-03-30T13:12:06.199433+0000","last_clean":"2024-03-30T13:12:06.199433+0000","last_became_active":"2024-03-30T13:12:05.194357+0000","last_became_peered":"2024-03-30T13:12:05.194357+0000","last_unstale":"2024-03-30T13:12:06.199433+0000","last_undegraded":"2024-03-30T13:12:06.199433+0000","last_fullsized":"2024-03-30T13:12:06.199433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:27:20.267950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472991+0000","last_change":"2024-03-30T13:12:04.156791+0000","last_active":"2024-03-30T13:12:07.472991+0000","last_peered":"2024-03-30T13:12:07.472991+0000","last_clean":"2024-03-30T13:12:07.472991+0000","last_became_active":"2024-03-30T13:12:04.155722+0000","last_became_peered":"2024-03-30T13:12:04.155722+0000","last_unstale":"2024-03-30T13:12:07.472991+0000","last_undegraded":"2024-03-30T13:12:07.472991+0000","last_fullsized":"2024-03-30T13:12:07.472991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:06:07.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.197592+0000","last_change":"2024-03-30T13:12:05.207142+0000","last_active":"2024-03-30T13:12:06.197592+0000","last_peered":"2024-03-30T13:12:06.197592+0000","last_clean":"2024-03-30T13:12:06.197592+0000","last_became_active":"2024-03-30T13:12:05.206893+0000","last_became_peered":"2024-03-30T13:12:05.206893+0000","last_unstale":"2024-03-30T13:12:06.197592+0000","last_undegraded":"2024-03-30T13:12:06.197592+0000","last_fullsized":"2024-03-30T13:12:06.197592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:17.640666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.473356+0000","last_change":"2024-03-30T13:12:04.145008+0000","last_active":"2024-03-30T13:12:07.473356+0000","last_peered":"2024-03-30T13:12:07.473356+0000","last_clean":"2024-03-30T13:12:07.473356+0000","last_became_active":"2024-03-30T13:12:04.144537+0000","last_became_peered":"2024-03-30T13:12:04.144537+0000","last_unstale":"2024-03-30T13:12:07.473356+0000","last_undegraded":"2024-03-30T13:12:07.473356+0000","last_fullsized":"2024-03-30T13:12:07.473356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:29:30.328150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.631725+0000","last_change":"2024-03-30T13:12:05.198424+0000","last_active":"2024-03-30T13:12:07.631725+0000","last_peered":"2024-03-30T13:12:07.631725+0000","last_clean":"2024-03-30T13:12:07.631725+0000","last_became_active":"2024-03-30T13:12:05.197807+0000","last_became_peered":"2024-03-30T13:12:05.197807+0000","last_unstale":"2024-03-30T13:12:07.631725+0000","last_undegraded":"2024-03-30T13:12:07.631725+0000","last_fullsized":"2024-03-30T13:12:07.631725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:02.120513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.472673+0000","last_change":"2024-03-30T13:12:04.156286+0000","last_active":"2024-03-30T13:12:07.472673+0000","last_peered":"2024-03-30T13:12:07.472673+0000","last_clean":"2024-03-30T13:12:07.472673+0000","last_became_active":"2024-03-30T13:12:04.155947+0000","last_became_peered":"2024-03-30T13:12:04.155947+0000","last_unstale":"2024-03-30T13:12:07.472673+0000","last_undegraded":"2024-03-30T13:12:07.472673+0000","last_fullsized":"2024-03-30T13:12:07.472673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:47:50.782317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630786+0000","last_change":"2024-03-30T13:12:05.193970+0000","last_active":"2024-03-30T13:12:07.630786+0000","last_peered":"2024-03-30T13:12:07.630786+0000","last_clean":"2024-03-30T13:12:07.630786+0000","last_became_active":"2024-03-30T13:12:05.193676+0000","last_became_peered":"2024-03-30T13:12:05.193676+0000","last_unstale":"2024-03-30T13:12:07.630786+0000","last_undegraded":"2024-03-30T13:12:07.630786+0000","last_fullsized":"2024-03-30T13:12:07.630786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:02.262900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.303332+0000","last_change":"2024-03-30T13:12:04.159232+0000","last_active":"2024-03-30T13:12:06.303332+0000","last_peered":"2024-03-30T13:12:06.303332+0000","last_clean":"2024-03-30T13:12:06.303332+0000","last_became_active":"2024-03-30T13:12:04.158956+0000","last_became_peered":"2024-03-30T13:12:04.158956+0000","last_unstale":"2024-03-30T13:12:06.303332+0000","last_undegraded":"2024-03-30T13:12:06.303332+0000","last_fullsized":"2024-03-30T13:12:06.303332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:47.113754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.194804+0000","last_change":"2024-03-30T13:12:05.208137+0000","last_active":"2024-03-30T13:12:06.194804+0000","last_peered":"2024-03-30T13:12:06.194804+0000","last_clean":"2024-03-30T13:12:06.194804+0000","last_became_active":"2024-03-30T13:12:05.206254+0000","last_became_peered":"2024-03-30T13:12:05.206254+0000","last_unstale":"2024-03-30T13:12:06.194804+0000","last_undegraded":"2024-03-30T13:12:06.194804+0000","last_fullsized":"2024-03-30T13:12:06.194804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:07:30.530008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.630473+0000","last_change":"2024-03-30T13:12:04.156959+0000","last_active":"2024-03-30T13:12:07.630473+0000","last_peered":"2024-03-30T13:12:07.630473+0000","last_clean":"2024-03-30T13:12:07.630473+0000","last_became_active":"2024-03-30T13:12:04.156016+0000","last_became_peered":"2024-03-30T13:12:04.156016+0000","last_unstale":"2024-03-30T13:12:07.630473+0000","last_undegraded":"2024-03-30T13:12:07.630473+0000","last_fullsized":"2024-03-30T13:12:07.630473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:14:39.830638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.198047+0000","last_change":"2024-03-30T13:12:05.204500+0000","last_active":"2024-03-30T13:12:06.198047+0000","last_peered":"2024-03-30T13:12:06.198047+0000","last_clean":"2024-03-30T13:12:06.198047+0000","last_became_active":"2024-03-30T13:12:05.204192+0000","last_became_peered":"2024-03-30T13:12:05.204192+0000","last_unstale":"2024-03-30T13:12:06.198047+0000","last_undegraded":"2024-03-30T13:12:06.198047+0000","last_fullsized":"2024-03-30T13:12:06.198047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:04.112860+0000","last_clean_scrub_stamp":"2024-03-30T13:12:04.112860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:43:02.262900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:06.196043+0000","last_change":"2024-03-30T13:12:04.164087+0000","last_active":"2024-03-30T13:12:06.196043+0000","last_peered":"2024-03-30T13:12:06.196043+0000","last_clean":"2024-03-30T13:12:06.196043+0000","last_became_active":"2024-03-30T13:12:04.163450+0000","last_became_peered":"2024-03-30T13:12:04.163450+0000","last_unstale":"2024-03-30T13:12:06.196043+0000","last_undegraded":"2024-03-30T13:12:06.196043+0000","last_fullsized":"2024-03-30T13:12:06.196043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:12:03.107660+0000","last_clean_scrub_stamp":"2024-03-30T13:12:03.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:05:20.335615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-30T13:12:07.096473+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:12:07.096473+0000","last_peered":"2024-03-30T13:12:07.096473+0000","last_clean":"2024-03-30T13:12:07.096473+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:12:07.096473+0000","last_undegraded":"2024-03-30T13:12:07.096473+0000","last_fullsized":"2024-03-30T13:12:07.096473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476757,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":151128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476758,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":150386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476758,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":740790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476757,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":150442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":151964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":741302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":151986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":150374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:12:15.076 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-30T13:12:15.077 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-30T13:12:15.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.332+0000 7f927ca00640 1 Processor -- start 2024-03-30T13:12:15.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.332+0000 7f927ca00640 1 -- start start 2024-03-30T13:12:15.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.333+0000 7f927ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f927815e920 0x7f92780d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.333+0000 7f927ca00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92780cfde0 0x7f92780d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.333+0000 7f927ca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92780d3780 con 0x7f92780d0f90 2024-03-30T13:12:15.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f927ca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f927815ed00 con 0x7f927815e920 2024-03-30T13:12:15.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f927ca00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f92780d21e0 con 0x7f92780cfde0 2024-03-30T13:12:15.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f9275e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f927815e920 0x7f92780d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f9276800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f92780d0f90 0x7f927806c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42906/0 (socket says 172.21.15.99:42906) 2024-03-30T13:12:15.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f9275e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f927815e920 0x7f92780d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40700/0 (socket says 172.21.15.99:40700) 2024-03-30T13:12:15.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f9276800640 1 -- 172.21.15.99:0/3132971170 learned_addr learned my addr 172.21.15.99:0/3132971170 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:15.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f9275400640 1 --2- 172.21.15.99:0/3132971170 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92780cfde0 0x7f92780d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f9275e00640 1 -- 172.21.15.99:0/3132971170 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92780cfde0 msgr2=0x7f92780d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:15.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f9275e00640 1 --2- 172.21.15.99:0/3132971170 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92780cfde0 0x7f92780d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f9275e00640 1 -- 172.21.15.99:0/3132971170 >> v1:172.21.15.99:6789/0 conn(0x7f92780d0f90 legacy=0x7f927806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f9275e00640 1 -- 172.21.15.99:0/3132971170 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92780d2480 con 0x7f927815e920 2024-03-30T13:12:15.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.334+0000 7f9274a00640 1 -- 172.21.15.99:0/3132971170 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776763239 0 0) 0x7f9270001490 con 0x7f92780d0f90 2024-03-30T13:12:15.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.335+0000 7f9275e00640 1 --2- 172.21.15.99:0/3132971170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f927815e920 0x7f92780d3240 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f92600097d0 tx=0x7f926002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbd5be08ac1208f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.336+0000 7f9274a00640 1 -- 172.21.15.99:0/3132971170 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9260035020 con 0x7f927815e920 2024-03-30T13:12:15.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.336+0000 7f9274a00640 1 -- 172.21.15.99:0/3132971170 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9260031800 con 0x7f927815e920 2024-03-30T13:12:15.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.336+0000 7f9274a00640 1 -- 172.21.15.99:0/3132971170 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9260031bd0 con 0x7f927815e920 2024-03-30T13:12:15.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.336+0000 7f927ca00640 1 -- 172.21.15.99:0/3132971170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f927815e920 msgr2=0x7f92780d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.336+0000 7f927ca00640 1 --2- 172.21.15.99:0/3132971170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f927815e920 0x7f92780d3240 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f92600097d0 tx=0x7f926002b8a0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.336+0000 7f927ca00640 1 -- 172.21.15.99:0/3132971170 shutdown_connections 2024-03-30T13:12:15.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.336+0000 7f927ca00640 1 --2- 172.21.15.99:0/3132971170 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92780cfde0 0x7f92780d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.336+0000 7f927ca00640 1 --2- 172.21.15.99:0/3132971170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f927815e920 0x7f92780d3240 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.336+0000 7f927ca00640 1 -- 172.21.15.99:0/3132971170 >> 172.21.15.99:0/3132971170 conn(0x7f927808bfc0 msgr2=0x7f92780d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:15.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.337+0000 7f927ca00640 1 -- 172.21.15.99:0/3132971170 shutdown_connections 2024-03-30T13:12:15.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.337+0000 7f927ca00640 1 -- 172.21.15.99:0/3132971170 wait complete. 2024-03-30T13:12:15.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.338+0000 7f927ca00640 1 Processor -- start 2024-03-30T13:12:15.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.338+0000 7f927ca00640 1 -- start start 2024-03-30T13:12:15.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.339+0000 7f927ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92780cfde0 0x7f92781547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.339+0000 7f927ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92780d0f90 0x7f92780cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.339+0000 7f927ca00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f927815e920 0x7f92780b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.339+0000 7f927ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f92780d2d20 con 0x7f92780d0f90 2024-03-30T13:12:15.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.339+0000 7f927ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f92780d2a40 con 0x7f92780cfde0 2024-03-30T13:12:15.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.339+0000 7f927ca00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f92780d4ef0 con 0x7f927815e920 2024-03-30T13:12:15.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.340+0000 7f9275400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92780d0f90 0x7f92780cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.340+0000 7f9275400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92780d0f90 0x7f92780cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40716/0 (socket says 172.21.15.99:40716) 2024-03-30T13:12:15.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.340+0000 7f9275400640 1 -- 172.21.15.99:0/2247047366 learned_addr learned my addr 172.21.15.99:0/2247047366 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:15.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.340+0000 7f9276800640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f927815e920 0x7f92780b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.340+0000 7f9275e00640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92780cfde0 0x7f92781547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.340+0000 7f9275400640 1 -- 172.21.15.99:0/2247047366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f927815e920 msgr2=0x7f92780b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.340+0000 7f9275400640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f927815e920 0x7f92780b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.340+0000 7f9275400640 1 -- 172.21.15.99:0/2247047366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92780cfde0 msgr2=0x7f92781547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.340+0000 7f9275400640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92780cfde0 0x7f92781547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.340+0000 7f9275400640 1 -- 172.21.15.99:0/2247047366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92780ce500 con 0x7f92780d0f90 2024-03-30T13:12:15.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.341+0000 7f9275400640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92780d0f90 0x7f92780cc0f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f926800d620 tx=0x7f926800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.341+0000 7f926e000640 1 -- 172.21.15.99:0/2247047366 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926800b620 con 0x7f92780d0f90 2024-03-30T13:12:15.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.341+0000 7f926e000640 1 -- 172.21.15.99:0/2247047366 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9268019070 con 0x7f92780d0f90 2024-03-30T13:12:15.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.341+0000 7f927ca00640 1 -- 172.21.15.99:0/2247047366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9278154d30 con 0x7f92780d0f90 2024-03-30T13:12:15.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.341+0000 7f926e000640 1 -- 172.21.15.99:0/2247047366 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926800ba00 con 0x7f92780d0f90 2024-03-30T13:12:15.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.341+0000 7f927ca00640 1 -- 172.21.15.99:0/2247047366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f927815efb0 con 0x7f92780d0f90 2024-03-30T13:12:15.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.342+0000 7f927ca00640 1 -- 172.21.15.99:0/2247047366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92780a2560 con 0x7f92780d0f90 2024-03-30T13:12:15.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.343+0000 7f926e000640 1 -- 172.21.15.99:0/2247047366 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f926800bba0 con 0x7f92780d0f90 2024-03-30T13:12:15.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.344+0000 7f926e000640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f925406c530 0x7f925406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.344+0000 7f926e000640 1 -- 172.21.15.99:0/2247047366 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f926808ba50 con 0x7f92780d0f90 2024-03-30T13:12:15.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.344+0000 7f9275e00640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f925406c530 0x7f925406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.345+0000 7f9275e00640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f925406c530 0x7f925406e9f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9260036000 tx=0x7f9260008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.349+0000 7f926e000640 1 -- 172.21.15.99:0/2247047366 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f926805a060 con 0x7f92780d0f90 2024-03-30T13:12:15.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.625+0000 7f927ca00640 1 -- 172.21.15.99:0/2247047366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f927804f9d0 con 0x7f92780d0f90 2024-03-30T13:12:15.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.629+0000 7f926e000640 1 -- 172.21.15.99:0/2247047366 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f9268059960 con 0x7f92780d0f90 2024-03-30T13:12:15.634 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-03-30T13:12:15.634 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAPDwhm6lNaEhAAeg1SFtdfeWCF8xpQ5LFMYA== 2024-03-30T13:12:15.634 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-03-30T13:12:15.634 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-03-30T13:12:15.634 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-30T13:12:15.634 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-03-30T13:12:15.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.632+0000 7f927ca00640 1 -- 172.21.15.99:0/2247047366 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f925406c530 msgr2=0x7f925406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.632+0000 7f927ca00640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f925406c530 0x7f925406e9f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9260036000 tx=0x7f9260008030 comp rx=0 tx=0).stop 2024-03-30T13:12:15.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.632+0000 7f927ca00640 1 -- 172.21.15.99:0/2247047366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92780d0f90 msgr2=0x7f92780cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.632+0000 7f927ca00640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92780d0f90 0x7f92780cc0f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f926800d620 tx=0x7f926800dae0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.632+0000 7f927ca00640 1 -- 172.21.15.99:0/2247047366 shutdown_connections 2024-03-30T13:12:15.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.632+0000 7f927ca00640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f925406c530 0x7f925406e9f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.632+0000 7f927ca00640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f927815e920 0x7f92780b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.632+0000 7f927ca00640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92780d0f90 0x7f92780cc0f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.632+0000 7f927ca00640 1 --2- 172.21.15.99:0/2247047366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92780cfde0 0x7f92781547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.632+0000 7f927ca00640 1 -- 172.21.15.99:0/2247047366 >> 172.21.15.99:0/2247047366 conn(0x7f927808bfc0 msgr2=0x7f92781568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:15.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.632+0000 7f927ca00640 1 -- 172.21.15.99:0/2247047366 shutdown_connections 2024-03-30T13:12:15.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.633+0000 7f927ca00640 1 -- 172.21.15.99:0/2247047366 wait complete. 2024-03-30T13:12:15.658 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:12:15.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.914+0000 7f7a44800640 1 Processor -- start 2024-03-30T13:12:15.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.914+0000 7f7a44800640 1 -- start start 2024-03-30T13:12:15.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.916+0000 7f7a44800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7a3c15c670 0x7f7a3c06c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.916+0000 7f7a44800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7a3c06f060 0x7f7a3c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.916+0000 7f7a44800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a3c146230 con 0x7f7a3c0ad230 2024-03-30T13:12:15.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.916+0000 7f7a44800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7a3c06dfc0 con 0x7f7a3c15c670 2024-03-30T13:12:15.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.916+0000 7f7a44800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7a3c06e2a0 con 0x7f7a3c06f060 2024-03-30T13:12:15.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.916+0000 7f7a41e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7a3c15c670 0x7f7a3c06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.916+0000 7f7a41e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7a3c15c670 0x7f7a3c06c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40730/0 (socket says 172.21.15.99:40730) 2024-03-30T13:12:15.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.916+0000 7f7a41e00640 1 -- 172.21.15.99:0/2472921079 learned_addr learned my addr 172.21.15.99:0/2472921079 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:15.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.916+0000 7f7a41400640 1 --2- 172.21.15.99:0/2472921079 >> v2:172.21.15.181:3300/0 conn(0x7f7a3c06f060 0x7f7a3c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.917+0000 7f7a41e00640 1 -- 172.21.15.99:0/2472921079 >> v2:172.21.15.181:3300/0 conn(0x7f7a3c06f060 msgr2=0x7f7a3c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:15.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.917+0000 7f7a41e00640 1 --2- 172.21.15.99:0/2472921079 >> v2:172.21.15.181:3300/0 conn(0x7f7a3c06f060 0x7f7a3c06d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.917+0000 7f7a41e00640 1 -- 172.21.15.99:0/2472921079 >> v1:172.21.15.181:6789/0 conn(0x7f7a3c0ad230 legacy=0x7f7a3c0ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:15.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.917+0000 7f7a41e00640 1 -- 172.21.15.99:0/2472921079 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3c06e580 con 0x7f7a3c15c670 2024-03-30T13:12:15.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.918+0000 7f7a41e00640 1 --2- 172.21.15.99:0/2472921079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3c15c670 0x7f7a3c06c030 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c071690 tx=0x7f7a3002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5505a08074ee57c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.918+0000 7f7a40a00640 1 -- 172.21.15.99:0/2472921079 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3002e070 con 0x7f7a3c15c670 2024-03-30T13:12:15.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.918+0000 7f7a40a00640 1 -- 172.21.15.99:0/2472921079 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a30037070 con 0x7f7a3c15c670 2024-03-30T13:12:15.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.918+0000 7f7a40a00640 1 -- 172.21.15.99:0/2472921079 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30031a00 con 0x7f7a3c15c670 2024-03-30T13:12:15.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.919+0000 7f7a44800640 1 -- 172.21.15.99:0/2472921079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3c15c670 msgr2=0x7f7a3c06c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.919+0000 7f7a44800640 1 --2- 172.21.15.99:0/2472921079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3c15c670 0x7f7a3c06c030 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c071690 tx=0x7f7a3002b880 comp rx=0 tx=0).stop 2024-03-30T13:12:15.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.919+0000 7f7a44800640 1 -- 172.21.15.99:0/2472921079 shutdown_connections 2024-03-30T13:12:15.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.919+0000 7f7a44800640 1 --2- 172.21.15.99:0/2472921079 >> v2:172.21.15.181:3300/0 conn(0x7f7a3c06f060 0x7f7a3c06d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.919+0000 7f7a44800640 1 --2- 172.21.15.99:0/2472921079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3c15c670 0x7f7a3c06c030 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.919+0000 7f7a44800640 1 -- 172.21.15.99:0/2472921079 >> 172.21.15.99:0/2472921079 conn(0x7f7a3c06b510 msgr2=0x7f7a3c06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:15.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.919+0000 7f7a44800640 1 -- 172.21.15.99:0/2472921079 shutdown_connections 2024-03-30T13:12:15.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.919+0000 7f7a44800640 1 -- 172.21.15.99:0/2472921079 wait complete. 2024-03-30T13:12:15.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.921+0000 7f7a44800640 1 Processor -- start 2024-03-30T13:12:15.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.921+0000 7f7a44800640 1 -- start start 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a44800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a3c06f060 0x7f7a3c0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a44800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3c0ad230 0x7f7a3c1f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a44800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c15c670 0x7f7a3c0b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a44800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c0b32c0 con 0x7f7a3c0ad230 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a44800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c15ca50 con 0x7f7a3c06f060 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a44800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3c0b3440 con 0x7f7a3c15c670 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a41400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3c0ad230 0x7f7a3c1f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a41400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3c0ad230 0x7f7a3c1f4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40736/0 (socket says 172.21.15.99:40736) 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a41400640 1 -- 172.21.15.99:0/2993309284 learned_addr learned my addr 172.21.15.99:0/2993309284 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a41e00640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a3c06f060 0x7f7a3c0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a41400640 1 -- 172.21.15.99:0/2993309284 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c15c670 msgr2=0x7f7a3c0b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a41400640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c15c670 0x7f7a3c0b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a41400640 1 -- 172.21.15.99:0/2993309284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a3c06f060 msgr2=0x7f7a3c0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a41400640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a3c06f060 0x7f7a3c0b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a41400640 1 -- 172.21.15.99:0/2993309284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3c15a670 con 0x7f7a3c0ad230 2024-03-30T13:12:15.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.922+0000 7f7a41e00640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a3c06f060 0x7f7a3c0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:15.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.923+0000 7f7a41400640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3c0ad230 0x7f7a3c1f4090 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00d800 tx=0x7f7a2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.923+0000 7f7a36000640 1 -- 172.21.15.99:0/2993309284 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00b6c0 con 0x7f7a3c0ad230 2024-03-30T13:12:15.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.923+0000 7f7a36000640 1 -- 172.21.15.99:0/2993309284 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a2c019070 con 0x7f7a3c0ad230 2024-03-30T13:12:15.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.923+0000 7f7a36000640 1 -- 172.21.15.99:0/2993309284 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00ba80 con 0x7f7a3c0ad230 2024-03-30T13:12:15.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.923+0000 7f7a44800640 1 -- 172.21.15.99:0/2993309284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3c15a950 con 0x7f7a3c0ad230 2024-03-30T13:12:15.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.923+0000 7f7a44800640 1 -- 172.21.15.99:0/2993309284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3c0ccbd0 con 0x7f7a3c0ad230 2024-03-30T13:12:15.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.924+0000 7f7a44800640 1 -- 172.21.15.99:0/2993309284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a3c0cc6e0 con 0x7f7a3c0ad230 2024-03-30T13:12:15.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.925+0000 7f7a36000640 1 -- 172.21.15.99:0/2993309284 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7a2c00bc20 con 0x7f7a3c0ad230 2024-03-30T13:12:15.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.927+0000 7f7a36000640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a2006c530 0x7f7a2006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.927+0000 7f7a36000640 1 -- 172.21.15.99:0/2993309284 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7a2c08bb80 con 0x7f7a3c0ad230 2024-03-30T13:12:15.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.927+0000 7f7a41e00640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a2006c530 0x7f7a2006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.927+0000 7f7a41e00640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a2006c530 0x7f7a2006e9f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a30036000 tx=0x7f7a30008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:15.931+0000 7f7a36000640 1 -- 172.21.15.99:0/2993309284 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7a2c05a1a0 con 0x7f7a3c0ad230 2024-03-30T13:12:16.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.170+0000 7f7a44800640 1 -- 172.21.15.99:0/2993309284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a3c068640 con 0x7f7a3c0ad230 2024-03-30T13:12:16.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.171+0000 7f7a36000640 1 -- 172.21.15.99:0/2993309284 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f7a2c059aa0 con 0x7f7a3c0ad230 2024-03-30T13:12:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:12:16.176 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1591088829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1591088829},{"type":"v1","addr":"172.21.15.99:6837","nonce":1591088829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5115,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/333253843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":333253843},{"type":"v1","addr":"172.21.15.99:6835","nonce":333253843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6834/859511813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":859511813},{"type":"v1","addr":"172.21.15.181:6834","nonce":859511813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:12:04.595024+0000","modified":"2024-03-30T13:12:07.691913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6835/1594018738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6833","nonce":1594018738},{"type":"v1","addr":"172.21.15.181:6835","nonce":1594018738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5121,"qdb_cluster":[5121]},"id":2}]} 2024-03-30T13:12:16.176 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-03-30T13:12:16.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.173+0000 7f7a44800640 1 -- 172.21.15.99:0/2993309284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a2006c530 msgr2=0x7f7a2006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.174+0000 7f7a44800640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a2006c530 0x7f7a2006e9f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a30036000 tx=0x7f7a30008030 comp rx=0 tx=0).stop 2024-03-30T13:12:16.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.174+0000 7f7a44800640 1 -- 172.21.15.99:0/2993309284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3c0ad230 msgr2=0x7f7a3c1f4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.174+0000 7f7a44800640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3c0ad230 0x7f7a3c1f4090 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00d800 tx=0x7f7a2c00dcc0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.174+0000 7f7a44800640 1 -- 172.21.15.99:0/2993309284 shutdown_connections 2024-03-30T13:12:16.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.174+0000 7f7a44800640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7a2006c530 0x7f7a2006e9f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.174+0000 7f7a44800640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c15c670 0x7f7a3c0b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.174+0000 7f7a44800640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3c0ad230 0x7f7a3c1f4090 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.174+0000 7f7a44800640 1 --2- 172.21.15.99:0/2993309284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a3c06f060 0x7f7a3c0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.174+0000 7f7a44800640 1 -- 172.21.15.99:0/2993309284 >> 172.21.15.99:0/2993309284 conn(0x7f7a3c06b510 msgr2=0x7f7a3c071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:16.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.174+0000 7f7a44800640 1 -- 172.21.15.99:0/2993309284 shutdown_connections 2024-03-30T13:12:16.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.174+0000 7f7a44800640 1 -- 172.21.15.99:0/2993309284 wait complete. 2024-03-30T13:12:16.600 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T13:12:04.595024+0000', 'modified': '2024-03-30T13:12:07.691913+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5121}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5121': {'gid': 5121, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.181:6835/1594018738', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6833', 'nonce': 1594018738}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1594018738}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5121, 'qdb_cluster': [5121]} 2024-03-30T13:12:16.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-30T13:12:16.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-30T13:12:16.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.815+0000 7f2079c00640 1 Processor -- start 2024-03-30T13:12:16.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.816+0000 7f2079c00640 1 -- start start 2024-03-30T13:12:16.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.817+0000 7f2079c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f207406bc20 0x7f207415f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.817+0000 7f2079c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207415f7d0 con 0x7f207415e8b0 2024-03-30T13:12:16.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.817+0000 7f2079c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207415fab0 con 0x7f207415ec90 2024-03-30T13:12:16.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.817+0000 7f2079c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f20740ceea0 con 0x7f207406bc20 2024-03-30T13:12:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.817+0000 7f2073e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f207415e8b0 0x7f20740ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42920/0 (socket says 172.21.15.99:42920) 2024-03-30T13:12:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.817+0000 7f2073e00640 1 -- 172.21.15.99:0/875028033 learned_addr learned my addr 172.21.15.99:0/875028033 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.817+0000 7f2079200640 1 --2- 172.21.15.99:0/875028033 >> v2:172.21.15.99:3300/0 conn(0x7f207406bc20 0x7f207415f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.818+0000 7f2072a00640 1 -- 172.21.15.99:0/875028033 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 861493542 0 0) 0x7f207415f7d0 con 0x7f207415e8b0 2024-03-30T13:12:16.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.818+0000 7f2072a00640 1 -- 172.21.15.99:0/875028033 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2058003520 con 0x7f207415e8b0 2024-03-30T13:12:16.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.818+0000 7f2079200640 1 -- 172.21.15.99:0/875028033 >> v1:172.21.15.181:6789/0 conn(0x7f207415ec90 legacy=0x7f207406b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.818+0000 7f2079200640 1 -- 172.21.15.99:0/875028033 >> v1:172.21.15.99:6789/0 conn(0x7f207415e8b0 legacy=0x7f20740ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.818+0000 7f2079200640 1 -- 172.21.15.99:0/875028033 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20740cdbc0 con 0x7f207406bc20 2024-03-30T13:12:16.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.819+0000 7f2079200640 1 --2- 172.21.15.99:0/875028033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f207406bc20 0x7f207415f110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f206c009d90 tx=0x7f206c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471343e6e7522547 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.819+0000 7f2072a00640 1 -- 172.21.15.99:0/875028033 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c039070 con 0x7f207406bc20 2024-03-30T13:12:16.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.819+0000 7f2072a00640 1 -- 172.21.15.99:0/875028033 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c02cc60 con 0x7f207406bc20 2024-03-30T13:12:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.819+0000 7f2072a00640 1 -- 172.21.15.99:0/875028033 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c034660 con 0x7f207406bc20 2024-03-30T13:12:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.820+0000 7f2079c00640 1 -- 172.21.15.99:0/875028033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f207406bc20 msgr2=0x7f207415f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.820+0000 7f2079c00640 1 --2- 172.21.15.99:0/875028033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f207406bc20 0x7f207415f110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f206c009d90 tx=0x7f206c02beb0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.820+0000 7f2079c00640 1 -- 172.21.15.99:0/875028033 shutdown_connections 2024-03-30T13:12:16.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.820+0000 7f2079c00640 1 --2- 172.21.15.99:0/875028033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f207406bc20 0x7f207415f110 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.820+0000 7f2079c00640 1 -- 172.21.15.99:0/875028033 >> 172.21.15.99:0/875028033 conn(0x7f207409aa30 msgr2=0x7f20740b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:16.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.820+0000 7f2079c00640 1 -- 172.21.15.99:0/875028033 shutdown_connections 2024-03-30T13:12:16.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.820+0000 7f2079c00640 1 -- 172.21.15.99:0/875028033 wait complete. 2024-03-30T13:12:16.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.822+0000 7f2079c00640 1 Processor -- start 2024-03-30T13:12:16.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.822+0000 7f2079c00640 1 -- start start 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.823+0000 7f2079c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f207406bc20 0x7f2074152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.823+0000 7f2079c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f207415e8b0 0x7f20740b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.823+0000 7f2079c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f207415ec90 0x7f2074159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.823+0000 7f2079c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f20740b0940 con 0x7f207406bc20 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.823+0000 7f2079c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f20740cdf30 con 0x7f207415e8b0 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.823+0000 7f2079c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f20740b0ac0 con 0x7f207415ec90 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.823+0000 7f2073e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f207406bc20 0x7f2074152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.823+0000 7f2073e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f207406bc20 0x7f2074152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40754/0 (socket says 172.21.15.99:40754) 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.823+0000 7f2073e00640 1 -- 172.21.15.99:0/2633194328 learned_addr learned my addr 172.21.15.99:0/2633194328 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.824+0000 7f2073e00640 1 -- 172.21.15.99:0/2633194328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f207415ec90 msgr2=0x7f2074159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.824+0000 7f2073e00640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f207415ec90 0x7f2074159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.824+0000 7f2073e00640 1 -- 172.21.15.99:0/2633194328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f207415e8b0 msgr2=0x7f20740b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.824+0000 7f2073e00640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f207415e8b0 0x7f20740b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.824+0000 7f2073e00640 1 -- 172.21.15.99:0/2633194328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20740ae480 con 0x7f207406bc20 2024-03-30T13:12:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.824+0000 7f2073e00640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f207406bc20 0x7f2074152c70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f206400c430 tx=0x7f206400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.824+0000 7f206be00640 1 -- 172.21.15.99:0/2633194328 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2064017070 con 0x7f207406bc20 2024-03-30T13:12:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.824+0000 7f206be00640 1 -- 172.21.15.99:0/2633194328 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2064005ce0 con 0x7f207406bc20 2024-03-30T13:12:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.824+0000 7f206be00640 1 -- 172.21.15.99:0/2633194328 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20640072f0 con 0x7f207406bc20 2024-03-30T13:12:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.824+0000 7f2079c00640 1 -- 172.21.15.99:0/2633194328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20740ae760 con 0x7f207406bc20 2024-03-30T13:12:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.824+0000 7f2079c00640 1 -- 172.21.15.99:0/2633194328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20740af000 con 0x7f207406bc20 2024-03-30T13:12:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.827+0000 7f206be00640 1 -- 172.21.15.99:0/2633194328 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f206401a070 con 0x7f207406bc20 2024-03-30T13:12:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.827+0000 7f206be00640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f205006c530 0x7f205006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.828+0000 7f206be00640 1 -- 172.21.15.99:0/2633194328 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f206408ab50 con 0x7f207406bc20 2024-03-30T13:12:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.828+0000 7f2073400640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f205006c530 0x7f205006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.828+0000 7f207de78740 1 Processor -- start 2024-03-30T13:12:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.828+0000 7f2073400640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f205006c530 0x7f205006e9f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f205c006fd0 tx=0x7f205c006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.828+0000 7f207de78740 1 -- start start 2024-03-30T13:12:16.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.829+0000 7f207de78740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.829+0000 7f207de78740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527fe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.829+0000 7f207de78740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1527ce9b0 0x55f1527fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.829+0000 7f207de78740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f152795c80 con 0x55f1527fb8b0 2024-03-30T13:12:16.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.829+0000 7f207de78740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f152737fa0 con 0x55f1527fb4d0 2024-03-30T13:12:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.829+0000 7f207de78740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55f1526e0560 con 0x55f1527ce9b0 2024-03-30T13:12:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.830+0000 7f2073400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527fe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.830+0000 7f2073400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527fe260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40756/0 (socket says 172.21.15.99:40756) 2024-03-30T13:12:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.830+0000 7f2073400640 1 -- 172.21.15.99:0/2560678017 learned_addr learned my addr 172.21.15.99:0/2560678017 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.830+0000 7f2073e00640 1 --2- 172.21.15.99:0/2560678017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.830+0000 7f2073400640 1 -- 172.21.15.99:0/2560678017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1527ce9b0 msgr2=0x55f1527fe7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.830+0000 7f2073400640 1 --2- 172.21.15.99:0/2560678017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1527ce9b0 0x55f1527fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.830+0000 7f2073400640 1 -- 172.21.15.99:0/2560678017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 msgr2=0x55f1527ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.830+0000 7f2073400640 1 --2- 172.21.15.99:0/2560678017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.830+0000 7f2073400640 1 -- 172.21.15.99:0/2560678017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f15244c2d0 con 0x55f1527fb8b0 2024-03-30T13:12:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.830+0000 7f2073400640 1 --2- 172.21.15.99:0/2560678017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527fe260 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f205c0137f0 tx=0x7f205c00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1281661b90e262f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f2068c00640 1 -- 172.21.15.99:0/2560678017 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c012b10 con 0x55f1527fb8b0 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f2068c00640 1 -- 172.21.15.99:0/2560678017 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c022070 con 0x55f1527fb8b0 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f2068c00640 1 -- 172.21.15.99:0/2560678017 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c01d3f0 con 0x55f1527fb8b0 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f207de78740 1 -- 172.21.15.99:0/2560678017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 msgr2=0x55f1527fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f207de78740 1 --2- 172.21.15.99:0/2560678017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527fe260 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f205c0137f0 tx=0x7f205c00e000 comp rx=0 tx=0).stop 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f207de78740 1 -- 172.21.15.99:0/2560678017 shutdown_connections 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f207de78740 1 --2- 172.21.15.99:0/2560678017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1527ce9b0 0x55f1527fe7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f207de78740 1 --2- 172.21.15.99:0/2560678017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527fe260 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f207de78740 1 --2- 172.21.15.99:0/2560678017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f207de78740 1 -- 172.21.15.99:0/2560678017 >> 172.21.15.99:0/2560678017 conn(0x55f1527d06e0 msgr2=0x55f152819260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f207de78740 1 -- 172.21.15.99:0/2560678017 shutdown_connections 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.831+0000 7f207de78740 1 -- 172.21.15.99:0/2560678017 wait complete. 2024-03-30T13:12:16.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.832+0000 7f207de78740 1 -- start start 2024-03-30T13:12:16.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.832+0000 7f207de78740 1 Processor -- start 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.833+0000 7f207de78740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ec440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.833+0000 7f207de78740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527ec980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.833+0000 7f207de78740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f152801920 0x55f152813890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.833+0000 7f207de78740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f1526f3920 con 0x55f1527fb8b0 2024-03-30T13:12:16.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.833+0000 7f207de78740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f152733f50 con 0x55f1527fb4d0 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.833+0000 7f207de78740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55f1527d2c80 con 0x55f152801920 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.833+0000 7f207de78740 10 client.0 _ll_register_callbacks cb 0x55f1526f3310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.833+0000 7f2073400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527ec980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.834+0000 7f2073400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527ec980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40768/0 (socket says 172.21.15.99:40768) 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.834+0000 7f2073400640 1 -- 172.21.15.99:0/2206868299 learned_addr learned my addr 172.21.15.99:0/2206868299 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.834+0000 7f2073e00640 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.834+0000 7f2079200640 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f152801920 0x55f152813890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.834+0000 7f2073400640 1 -- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f152801920 msgr2=0x55f152813890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.834+0000 7f2073400640 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f152801920 0x55f152813890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.834+0000 7f2073400640 1 -- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 msgr2=0x55f1527ec440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.834+0000 7f2073400640 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ec440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.834+0000 7f2073400640 1 -- 172.21.15.99:0/2206868299 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1525166b0 con 0x55f1527fb8b0 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.834+0000 7f2073400640 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527ec980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f205c01e000 tx=0x7f205c004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ce57090c32f88 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.834+0000 7f2061600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:12:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f2061600640 1 -- 172.21.15.99:0/2206868299 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c02c070 con 0x55f1527fb8b0 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f2061600640 1 -- 172.21.15.99:0/2206868299 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f205c01d940 con 0x55f1527fb8b0 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f207de78740 1 -- 172.21.15.99:0/2206868299 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f205c022070 con 0x55f1527fb8b0 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f2061600640 1 -- 172.21.15.99:0/2206868299 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f205c01db40 con 0x55f1527fb8b0 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f207de78740 10 client.5313 fetch_fsmap learned FSMap version 17 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f207de78740 1 -- 172.21.15.99:0/2206868299 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55f152801120 con 0x55f1527fb8b0 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f2061600640 1 -- 172.21.15.99:0/2206868299 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c022070 con 0x55f1527fb8b0 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f2061600640 1 -- 172.21.15.99:0/2206868299 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f205c03d080 con 0x55f1527fb8b0 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f207de78740 10 client.5313 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f207de78740 10 client.5313 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f207de78740 20 client.5313 populate_metadata read hostname 'smithi099' 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f207de78740 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f15282cca0 0x55f15282d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f207de78740 4 client.5313 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.835+0000 7f207de78740 1 -- 172.21.15.99:0/2206868299 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1527454e0 con 0x55f15282cca0 2024-03-30T13:12:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.836+0000 7f2073e00640 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f15282cca0 0x55f15282d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.837+0000 7f2073e00640 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f15282cca0 0x55f15282d080 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b7dc4bc2e086660 server_cookie=824b12a9944272b0 in_seq=0 out_seq=0 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.837+0000 7f2061600640 10 client.5313 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f2061600640 1 -- 172.21.15.99:0/2206868299 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55f1527454e0 con 0x55f15282cca0 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f2061600640 10 client.5313 handle_command_reply: tid=0 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 1 client.5313 shutdown 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 1 -- 172.21.15.99:0/2206868299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 msgr2=0x55f1527ec980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527ec980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f205c01e000 tx=0x7f205c004760 comp rx=0 tx=0).stop 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 1 -- 172.21.15.99:0/2206868299 shutdown_connections 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f152801920 0x55f152813890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1527ec980 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f15282cca0 0x55f15282d080 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 1 --2- 172.21.15.99:0/2206868299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ec440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 1 -- 172.21.15.99:0/2206868299 >> 172.21.15.99:0/2206868299 conn(0x55f1527ce9b0 msgr2=0x55f1527fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:16.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f2061600640 0 client.5313 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:16.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 1 -- 172.21.15.99:0/2206868299 shutdown_connections 2024-03-30T13:12:16.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 1 -- 172.21.15.99:0/2206868299 wait complete. 2024-03-30T13:12:16.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.839+0000 7f207de78740 20 client.5313 trim_cache size 0 max 16384 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.859+0000 7f207de78740 1 Processor -- start 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.859+0000 7f207de78740 1 -- start start 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.860+0000 7f207de78740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ec250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.860+0000 7f207de78740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1527fb8b0 0x55f15281c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.860+0000 7f207de78740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f152801920 0x55f1527ff250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.860+0000 7f207de78740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f20741ffb70 con 0x55f152801920 2024-03-30T13:12:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.860+0000 7f207de78740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f20741f7b10 con 0x55f1527fb4d0 2024-03-30T13:12:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.860+0000 7f207de78740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f20741f8160 con 0x55f1527fb8b0 2024-03-30T13:12:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2079200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f152801920 0x55f1527ff250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2079200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f152801920 0x55f1527ff250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40782/0 (socket says 172.21.15.99:40782) 2024-03-30T13:12:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2079200640 1 -- 172.21.15.99:0/3905548353 learned_addr learned my addr 172.21.15.99:0/3905548353 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2073e00640 1 --2- 172.21.15.99:0/3905548353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2073400640 1 --2- 172.21.15.99:0/3905548353 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1527fb8b0 0x55f15281c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2079200640 1 -- 172.21.15.99:0/3905548353 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1527fb8b0 msgr2=0x55f15281c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2079200640 1 --2- 172.21.15.99:0/3905548353 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1527fb8b0 0x55f15281c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2079200640 1 -- 172.21.15.99:0/3905548353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 msgr2=0x55f1527ec250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2079200640 1 --2- 172.21.15.99:0/3905548353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ec250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2079200640 1 -- 172.21.15.99:0/3905548353 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f15283d470 con 0x55f152801920 2024-03-30T13:12:16.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2073e00640 1 --2- 172.21.15.99:0/3905548353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ec250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:16.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.861+0000 7f2079200640 1 --2- 172.21.15.99:0/3905548353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f152801920 0x55f1527ff250 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f206c009d90 tx=0x7f206c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e77d3fa2051aa7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f2063e00640 1 -- 172.21.15.99:0/3905548353 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c044020 con 0x55f152801920 2024-03-30T13:12:16.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f2063e00640 1 -- 172.21.15.99:0/3905548353 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c02cc60 con 0x55f152801920 2024-03-30T13:12:16.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f2063e00640 1 -- 172.21.15.99:0/3905548353 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c039040 con 0x55f152801920 2024-03-30T13:12:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f207de78740 1 -- 172.21.15.99:0/3905548353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f152801920 msgr2=0x55f1527ff250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f207de78740 1 --2- 172.21.15.99:0/3905548353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f152801920 0x55f1527ff250 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f206c009d90 tx=0x7f206c004ab0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f207de78740 1 -- 172.21.15.99:0/3905548353 shutdown_connections 2024-03-30T13:12:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f207de78740 1 --2- 172.21.15.99:0/3905548353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f152801920 0x55f1527ff250 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f207de78740 1 --2- 172.21.15.99:0/3905548353 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1527fb8b0 0x55f15281c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f207de78740 1 --2- 172.21.15.99:0/3905548353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f1527ec250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f207de78740 1 -- 172.21.15.99:0/3905548353 >> 172.21.15.99:0/3905548353 conn(0x55f1527ce9b0 msgr2=0x55f1527eb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f207de78740 1 -- 172.21.15.99:0/3905548353 shutdown_connections 2024-03-30T13:12:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.862+0000 7f207de78740 1 -- 172.21.15.99:0/3905548353 wait complete. 2024-03-30T13:12:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.863+0000 7f207de78740 1 -- start start 2024-03-30T13:12:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.863+0000 7f207de78740 1 Processor -- start 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.864+0000 7f207de78740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f15289ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.864+0000 7f207de78740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1528116d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.864+0000 7f207de78740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f152801920 0x55f1528a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.864+0000 7f207de78740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f1528002a0 con 0x55f1527fb8b0 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.864+0000 7f207de78740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f152801400 con 0x55f1527fb4d0 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.864+0000 7f207de78740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55f152810ae0 con 0x55f152801920 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.864+0000 7f207de78740 10 client.0 _ll_register_callbacks cb 0x7f205c012cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2073400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1528116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2073400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1528116d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40798/0 (socket says 172.21.15.99:40798) 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2073400640 1 -- 172.21.15.99:0/1180219439 learned_addr learned my addr 172.21.15.99:0/1180219439 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2079200640 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f152801920 0x55f1528a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2073e00640 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f15289ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2073400640 1 -- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f152801920 msgr2=0x55f1528a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2073400640 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f152801920 0x55f1528a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2073400640 1 -- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 msgr2=0x55f15289ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2073400640 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f15289ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2073400640 1 -- 172.21.15.99:0/1180219439 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f15281ae30 con 0x55f1527fb8b0 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2073400640 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1528116d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f205c01f040 tx=0x7f205c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8583cb81093ff66 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.865+0000 7f2061600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.866+0000 7f2061600640 1 -- 172.21.15.99:0/1180219439 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c02c040 con 0x55f1527fb8b0 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.866+0000 7f2061600640 1 -- 172.21.15.99:0/1180219439 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f205c004250 con 0x55f1527fb8b0 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.866+0000 7f207de78740 1 -- 172.21.15.99:0/1180219439 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f206c02cc60 con 0x55f1527fb8b0 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.866+0000 7f2061600640 1 -- 172.21.15.99:0/1180219439 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f205c04d050 con 0x55f1527fb8b0 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.866+0000 7f207de78740 10 client.5319 fetch_fsmap learned FSMap version 17 2024-03-30T13:12:16.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.866+0000 7f207de78740 1 -- 172.21.15.99:0/1180219439 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55f1528a2040 con 0x55f1527fb8b0 2024-03-30T13:12:16.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.866+0000 7f2061600640 1 -- 172.21.15.99:0/1180219439 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c02cc60 con 0x55f1527fb8b0 2024-03-30T13:12:16.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.866+0000 7f2061600640 1 -- 172.21.15.99:0/1180219439 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f205c050020 con 0x55f1527fb8b0 2024-03-30T13:12:16.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.867+0000 7f207de78740 10 client.5319 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:12:16.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.867+0000 7f207de78740 10 client.5319 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-30T13:12:16.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.867+0000 7f207de78740 20 client.5319 populate_metadata read hostname 'smithi099' 2024-03-30T13:12:16.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.867+0000 7f207de78740 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1527ec740 0x55f1527d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.867+0000 7f207de78740 4 client.5319 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-30T13:12:16.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.867+0000 7f207de78740 1 -- 172.21.15.99:0/1180219439 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "status"}) -- 0x55f15273f830 con 0x55f1527ec740 2024-03-30T13:12:16.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.867+0000 7f2073e00640 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1527ec740 0x55f1527d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.868+0000 7f2061600640 10 client.5319 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:16.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.868+0000 7f2073e00640 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1527ec740 0x55f1527d2100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daa8145637019548 server_cookie=fe4d55e615539f1e in_seq=0 out_seq=0 2024-03-30T13:12:16.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f2061600640 1 -- 172.21.15.99:0/1180219439 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55f15273f830 con 0x55f1527ec740 2024-03-30T13:12:16.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f2061600640 10 client.5319 handle_command_reply: tid=0 2024-03-30T13:12:16.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 1 client.5319 shutdown 2024-03-30T13:12:16.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 1 -- 172.21.15.99:0/1180219439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 msgr2=0x55f1528116d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1528116d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f205c01f040 tx=0x7f205c012000 comp rx=0 tx=0).stop 2024-03-30T13:12:16.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 1 -- 172.21.15.99:0/1180219439 shutdown_connections 2024-03-30T13:12:16.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f152801920 0x55f1528a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1527fb8b0 0x55f1528116d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1527ec740 0x55f1527d2100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 1 --2- 172.21.15.99:0/1180219439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1527fb4d0 0x55f15289ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 1 -- 172.21.15.99:0/1180219439 >> 172.21.15.99:0/1180219439 conn(0x55f1527ce9b0 msgr2=0x55f152814470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f2061600640 0 client.5319 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 1 -- 172.21.15.99:0/1180219439 shutdown_connections 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 1 -- 172.21.15.99:0/1180219439 wait complete. 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.869+0000 7f207de78740 20 client.5319 trim_cache size 0 max 16384 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "e28e230a-999b-4d07-a5bd-ee507abf8d14", 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 5121, 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 11.70567262, 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 17, 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 35, 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 35, 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 20.560704640000001 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 -- 172.21.15.99:0/2633194328 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f205006c530 msgr2=0x7f205006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f205006c530 0x7f205006e9f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f205c006fd0 tx=0x7f205c006bc0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 -- 172.21.15.99:0/2633194328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f207406bc20 msgr2=0x7f2074152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f207406bc20 0x7f2074152c70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f206400c430 tx=0x7f206400c8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 -- 172.21.15.99:0/2633194328 shutdown_connections 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f205006c530 0x7f205006e9f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f207415ec90 0x7f2074159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f207415e8b0 0x7f20740b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 --2- 172.21.15.99:0/2633194328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f207406bc20 0x7f2074152c70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 -- 172.21.15.99:0/2633194328 >> 172.21.15.99:0/2633194328 conn(0x7f207409aa30 msgr2=0x7f20740cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 -- 172.21.15.99:0/2633194328 shutdown_connections 2024-03-30T13:12:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:16.870+0000 7f2079c00640 1 -- 172.21.15.99:0/2633194328 wait complete. 2024-03-30T13:12:16.893 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:12:17.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.096+0000 7f3d48e00640 1 Processor -- start 2024-03-30T13:12:17.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.097+0000 7f3d48e00640 1 -- start start 2024-03-30T13:12:17.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.098+0000 7f3d48e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440d0490 0x7f3d440d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.098+0000 7f3d48e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4415bad0 con 0x7f3d440b4cf0 2024-03-30T13:12:17.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.098+0000 7f3d48e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4415f7e0 con 0x7f3d4415b350 2024-03-30T13:12:17.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.098+0000 7f3d48e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4415c970 con 0x7f3d440d0490 2024-03-30T13:12:17.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.098+0000 7f3d39400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3d440b4cf0 0x7f3d4415c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42924/0 (socket says 172.21.15.99:42924) 2024-03-30T13:12:17.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.098+0000 7f3d39400640 1 -- 172.21.15.99:0/766110762 learned_addr learned my addr 172.21.15.99:0/766110762 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:17.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.098+0000 7f3d42800640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440d0490 0x7f3d440d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.098+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569675253 0 0) 0x7f3d4415bad0 con 0x7f3d440b4cf0 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d28003520 con 0x7f3d440b4cf0 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1776245473 0 0) 0x7f3d28003520 con 0x7f3d440b4cf0 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440d0490 msgr2=0x7f3d440d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440d0490 0x7f3d440d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 >> v1:172.21.15.181:6789/0 conn(0x7f3d4415b350 legacy=0x7f3d4415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4415fac0 con 0x7f3d440b4cf0 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f3d2c001670 con 0x7f3d440b4cf0 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d42800640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440d0490 0x7f3d440d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 >> v1:172.21.15.99:6789/0 conn(0x7f3d440b4cf0 legacy=0x7f3d4415c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d280039e0 0x7f3d28003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 0x7f3d28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440d0490 0x7f3d280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4415c970 con 0x7f3d28004800 2024-03-30T13:12:17.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2800bac0 con 0x7f3d280039e0 2024-03-30T13:12:17.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2800bcc0 con 0x7f3d440d0490 2024-03-30T13:12:17.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.099+0000 7f3d39400640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 0x7f3d28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.100+0000 7f3d41e00640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d280039e0 0x7f3d28003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.100+0000 7f3d42800640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440d0490 0x7f3d280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.100+0000 7f3d39400640 1 -- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440d0490 msgr2=0x7f3d280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:17.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.100+0000 7f3d39400640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440d0490 0x7f3d280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.100+0000 7f3d39400640 1 -- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d280039e0 msgr2=0x7f3d28003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:17.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.100+0000 7f3d39400640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d280039e0 0x7f3d28003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.100+0000 7f3d39400640 1 -- 172.21.15.99:0/766110762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d28003520 con 0x7f3d28004800 2024-03-30T13:12:17.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.100+0000 7f3d42800640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440d0490 0x7f3d280051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:17.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.101+0000 7f3d39400640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 0x7f3d28004c80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00c240 tx=0x7f3d28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188ab93494dfc180 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:17.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.101+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c007d10 con 0x7f3d28004800 2024-03-30T13:12:17.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.101+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d2c030070 con 0x7f3d28004800 2024-03-30T13:12:17.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.101+0000 7f3d41400640 1 -- 172.21.15.99:0/766110762 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c02cd60 con 0x7f3d28004800 2024-03-30T13:12:17.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.102+0000 7f3d48e00640 1 -- 172.21.15.99:0/766110762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 msgr2=0x7f3d28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.102+0000 7f3d48e00640 1 --2- 172.21.15.99:0/766110762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 0x7f3d28004c80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00c240 tx=0x7f3d28005830 comp rx=0 tx=0).stop 2024-03-30T13:12:17.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.102+0000 7f3d42800640 1 -- 172.21.15.99:0/766110762 reap_dead start 2024-03-30T13:12:17.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.102+0000 7f3d48e00640 1 -- 172.21.15.99:0/766110762 shutdown_connections 2024-03-30T13:12:17.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.102+0000 7f3d48e00640 1 -- 172.21.15.99:0/766110762 >> 172.21.15.99:0/766110762 conn(0x7f3d4406b6f0 msgr2=0x7f3d4406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:17.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.102+0000 7f3d48e00640 1 -- 172.21.15.99:0/766110762 shutdown_connections 2024-03-30T13:12:17.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.102+0000 7f3d48e00640 1 -- 172.21.15.99:0/766110762 wait complete. 2024-03-30T13:12:17.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.104+0000 7f3d48e00640 1 Processor -- start 2024-03-30T13:12:17.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.104+0000 7f3d48e00640 1 -- start start 2024-03-30T13:12:17.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d48e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 0x7f3d4414e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d48e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d440cadd0 0x7f3d440cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d48e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440b0000 0x7f3d440b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d48e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4415b730 con 0x7f3d28004800 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d48e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4415bdd0 con 0x7f3d440cadd0 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d48e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4415b8b0 con 0x7f3d440b0000 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d41e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 0x7f3d4414e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d41e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 0x7f3d4414e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40814/0 (socket says 172.21.15.99:40814) 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d41e00640 1 -- 172.21.15.99:0/1244719988 learned_addr learned my addr 172.21.15.99:0/1244719988 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d41e00640 1 -- 172.21.15.99:0/1244719988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440b0000 msgr2=0x7f3d440b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d41e00640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440b0000 0x7f3d440b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d41e00640 1 -- 172.21.15.99:0/1244719988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d440cadd0 msgr2=0x7f3d440cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d41e00640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d440cadd0 0x7f3d440cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.105+0000 7f3d41e00640 1 -- 172.21.15.99:0/1244719988 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4414eb80 con 0x7f3d28004800 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.106+0000 7f3d41e00640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 0x7f3d4414e640 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400e5b0 tx=0x7f3d3400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.106+0000 7f3d3aa00640 1 -- 172.21.15.99:0/1244719988 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d340052e0 con 0x7f3d28004800 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.106+0000 7f3d3aa00640 1 -- 172.21.15.99:0/1244719988 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d34018070 con 0x7f3d28004800 2024-03-30T13:12:17.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.106+0000 7f3d48e00640 1 -- 172.21.15.99:0/1244719988 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d440b0d30 con 0x7f3d28004800 2024-03-30T13:12:17.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.106+0000 7f3d3aa00640 1 -- 172.21.15.99:0/1244719988 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34003810 con 0x7f3d28004800 2024-03-30T13:12:17.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.106+0000 7f3d48e00640 1 -- 172.21.15.99:0/1244719988 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d440b12f0 con 0x7f3d28004800 2024-03-30T13:12:17.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.107+0000 7f3d48e00640 1 -- 172.21.15.99:0/1244719988 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d440cd4a0 con 0x7f3d28004800 2024-03-30T13:12:17.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.108+0000 7f3d3aa00640 1 -- 172.21.15.99:0/1244719988 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3d340039b0 con 0x7f3d28004800 2024-03-30T13:12:17.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.109+0000 7f3d3aa00640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3d2006c530 0x7f3d2006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.109+0000 7f3d3aa00640 1 -- 172.21.15.99:0/1244719988 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f3d3408b450 con 0x7f3d28004800 2024-03-30T13:12:17.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.109+0000 7f3d39400640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3d2006c530 0x7f3d2006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.110+0000 7f3d39400640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3d2006c530 0x7f3d2006e9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c034000 tx=0x7f3d2c039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:17.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.113+0000 7f3d3aa00640 1 -- 172.21.15.99:0/1244719988 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3d440cd4a0 con 0x7f3d28004800 2024-03-30T13:12:17.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.360+0000 7f3d48e00640 1 -- 172.21.15.99:0/1244719988 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3d44068640 con 0x7f3d28004800 2024-03-30T13:12:17.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.361+0000 7f3d3aa00640 1 -- 172.21.15.99:0/1244719988 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f3d34059940 con 0x7f3d28004800 2024-03-30T13:12:17.365 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:12:17.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.364+0000 7f3d48e00640 1 -- 172.21.15.99:0/1244719988 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3d2006c530 msgr2=0x7f3d2006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.364+0000 7f3d48e00640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3d2006c530 0x7f3d2006e9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c034000 tx=0x7f3d2c039040 comp rx=0 tx=0).stop 2024-03-30T13:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.364+0000 7f3d48e00640 1 -- 172.21.15.99:0/1244719988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 msgr2=0x7f3d4414e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.364+0000 7f3d48e00640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 0x7f3d4414e640 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400e5b0 tx=0x7f3d3400ea70 comp rx=0 tx=0).stop 2024-03-30T13:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.364+0000 7f3d48e00640 1 -- 172.21.15.99:0/1244719988 shutdown_connections 2024-03-30T13:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.364+0000 7f3d48e00640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3d2006c530 0x7f3d2006e9f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.364+0000 7f3d48e00640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d440b0000 0x7f3d440b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.364+0000 7f3d48e00640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d440cadd0 0x7f3d440cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.364+0000 7f3d48e00640 1 --2- 172.21.15.99:0/1244719988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d28004800 0x7f3d4414e640 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.364+0000 7f3d48e00640 1 -- 172.21.15.99:0/1244719988 >> 172.21.15.99:0/1244719988 conn(0x7f3d4406b6f0 msgr2=0x7f3d4406e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:17.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.365+0000 7f3d48e00640 1 -- 172.21.15.99:0/1244719988 shutdown_connections 2024-03-30T13:12:17.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17.365+0000 7f3d48e00640 1 -- 172.21.15.99:0/1244719988 wait complete. 2024-03-30T13:12:17.389 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-30T13:12:17.389 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:12:17.389 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-03-30T13:12:17.389 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-30T13:12:17.389 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T13:12:17.390 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-30T13:12:17.390 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-30T13:12:17.390 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:12:17.390 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:12:17.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:17.390 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-03-30T13:12:17.437 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:12:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:12:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:12:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-03-30T13:12:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:17.437 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-03-30T13:12:17.437 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42434sec preferred_lft 42434sec 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether d2:f7:04:94:e2:4c brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:12:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::a4f7:bff:feca:fd5f/64 scope link 2024-03-30T13:12:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:17.439 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:12:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether fa:c7:02:df:75:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:12:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::f8c7:2ff:fedf:75be/64 scope link 2024-03-30T13:12:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:17.439 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:12:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether d2:f7:04:94:e2:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:12:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::d0f7:4ff:fe94:e24c/64 scope link 2024-03-30T13:12:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:17.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:17.440 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:12:17.568 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-03-30T13:12:17.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:17.573 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-03-30T13:12:17.626 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-03-30T13:12:17.626 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:12:17.626 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:12:17.626 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:12:17.626 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:12:17.627 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:17.627 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-03-30T13:12:17.627 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:12:17.627 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:12:17.627 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:12:17.627 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-03-30T13:12:17.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:17.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:17.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:17.860 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-03-30T13:12:17.908 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T13:12:17.909 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-30T13:12:17.909 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:12:17.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:17.909 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-03-30T13:12:18.004 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:18.004 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-30T13:12:18.058 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:12:18.058 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:18.058 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:12:18.110 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:12:18.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:18.111 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:12:18.246 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:12:18.246 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:12:18.247 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-03-30T13:12:18.269 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:12:18.269 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:12:18.269 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-03-30T13:12:18.269 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:12:18.269 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:18.297 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:12:18.298 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:12:18.298 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-03-30T13:12:18.298 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:12:18.298 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:18.298 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790" 2024-03-30T13:12:18.298 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790:/ 2024-03-30T13:12:18.298 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e28e230a-999b-4d07-a5bd-ee507abf8d14" will pass to kernel 2024-03-30T13:12:18.299 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-30T13:12:18.299 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:12:18.299 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:12:18.299 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:12:18.299 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:12:18.304 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:12:18.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:18.304 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:12:18.387 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:18.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:18.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:18.522 INFO:teuthology.orchestra.run.smithi099.stdout:client4855 2024-03-30T13:12:18.523 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:12:18.523 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:18.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:12:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.828+0000 7f3e23400640 1 Processor -- start 2024-03-30T13:12:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.828+0000 7f3e23400640 1 -- start start 2024-03-30T13:12:18.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.829+0000 7f3e23400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3e1c0d0490 0x7f3e1c0d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.829+0000 7f3e23400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1c15bad0 con 0x7f3e1c0b4cf0 2024-03-30T13:12:18.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.829+0000 7f3e23400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1c15f7e0 con 0x7f3e1c15b350 2024-03-30T13:12:18.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.829+0000 7f3e23400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1c15c970 con 0x7f3e1c0d0490 2024-03-30T13:12:18.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.830+0000 7f3e21400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3e1c0d0490 0x7f3e1c0d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.830+0000 7f3e21400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3e1c0d0490 0x7f3e1c0d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40818/0 (socket says 172.21.15.99:40818) 2024-03-30T13:12:18.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.830+0000 7f3e21400640 1 -- 172.21.15.99:0/1141105839 learned_addr learned my addr 172.21.15.99:0/1141105839 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:18.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.830+0000 7f3e13e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3e1c0b4cf0 0x7f3e1c15c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42926/0 (socket says 172.21.15.99:42926) 2024-03-30T13:12:18.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.830+0000 7f3e21400640 1 -- 172.21.15.99:0/1141105839 >> v1:172.21.15.181:6789/0 conn(0x7f3e1c15b350 legacy=0x7f3e1c15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:18.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.830+0000 7f3e21400640 1 -- 172.21.15.99:0/1141105839 >> v1:172.21.15.99:6789/0 conn(0x7f3e1c0b4cf0 legacy=0x7f3e1c15c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.830+0000 7f3e21400640 1 -- 172.21.15.99:0/1141105839 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c15fac0 con 0x7f3e1c0d0490 2024-03-30T13:12:18.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.830+0000 7f3e1be00640 1 -- 172.21.15.99:0/1141105839 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704822824 0 0) 0x7f3e1c15bad0 con 0x7f3e1c0b4cf0 2024-03-30T13:12:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.831+0000 7f3e21400640 1 --2- 172.21.15.99:0/1141105839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c0d0490 0x7f3e1c0d08e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009e50 tx=0x7f3e1402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169b84e21df4682b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.832+0000 7f3e1be00640 1 -- 172.21.15.99:0/1141105839 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1402cb20 con 0x7f3e1c0d0490 2024-03-30T13:12:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.832+0000 7f3e1be00640 1 -- 172.21.15.99:0/1141105839 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1402ccc0 con 0x7f3e1c0d0490 2024-03-30T13:12:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.832+0000 7f3e1be00640 1 -- 172.21.15.99:0/1141105839 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14034610 con 0x7f3e1c0d0490 2024-03-30T13:12:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.832+0000 7f3e23400640 1 -- 172.21.15.99:0/1141105839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c0d0490 msgr2=0x7f3e1c0d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.832+0000 7f3e23400640 1 --2- 172.21.15.99:0/1141105839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c0d0490 0x7f3e1c0d08e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009e50 tx=0x7f3e1402bf80 comp rx=0 tx=0).stop 2024-03-30T13:12:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.832+0000 7f3e23400640 1 -- 172.21.15.99:0/1141105839 shutdown_connections 2024-03-30T13:12:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.832+0000 7f3e23400640 1 --2- 172.21.15.99:0/1141105839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c0d0490 0x7f3e1c0d08e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.832+0000 7f3e23400640 1 -- 172.21.15.99:0/1141105839 >> 172.21.15.99:0/1141105839 conn(0x7f3e1c06b6f0 msgr2=0x7f3e1c06bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.832+0000 7f3e23400640 1 -- 172.21.15.99:0/1141105839 shutdown_connections 2024-03-30T13:12:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.832+0000 7f3e23400640 1 -- 172.21.15.99:0/1141105839 wait complete. 2024-03-30T13:12:18.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.834+0000 7f3e23400640 1 Processor -- start 2024-03-30T13:12:18.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.834+0000 7f3e23400640 1 -- start start 2024-03-30T13:12:18.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.835+0000 7f3e23400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c0b4cf0 0x7f3e1c1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.835+0000 7f3e23400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e1c0d0490 0x7f3e1c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.835+0000 7f3e23400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c15b350 0x7f3e1c0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.835+0000 7f3e23400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c15bdd0 con 0x7f3e1c15b350 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.835+0000 7f3e23400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c0d0e20 con 0x7f3e1c0b4cf0 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.835+0000 7f3e23400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1c15b730 con 0x7f3e1c0d0490 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.835+0000 7f3e21400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c15b350 0x7f3e1c0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.836+0000 7f3e21400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c15b350 0x7f3e1c0ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40824/0 (socket says 172.21.15.99:40824) 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.836+0000 7f3e21400640 1 -- 172.21.15.99:0/2820418115 learned_addr learned my addr 172.21.15.99:0/2820418115 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.836+0000 7f3e20a00640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c0b4cf0 0x7f3e1c1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.836+0000 7f3e21400640 1 -- 172.21.15.99:0/2820418115 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e1c0d0490 msgr2=0x7f3e1c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.836+0000 7f3e21400640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e1c0d0490 0x7f3e1c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.836+0000 7f3e21400640 1 -- 172.21.15.99:0/2820418115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c0b4cf0 msgr2=0x7f3e1c1477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.836+0000 7f3e21400640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c0b4cf0 0x7f3e1c1477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.836+0000 7f3e21400640 1 -- 172.21.15.99:0/2820418115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c0ccc30 con 0x7f3e1c15b350 2024-03-30T13:12:18.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.836+0000 7f3e21400640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c15b350 0x7f3e1c0ced70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3e14036040 tx=0x7f3e14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:18.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.837+0000 7f3e19600640 1 -- 172.21.15.99:0/2820418115 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14043020 con 0x7f3e1c15b350 2024-03-30T13:12:18.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.837+0000 7f3e19600640 1 -- 172.21.15.99:0/2820418115 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1403e450 con 0x7f3e1c15b350 2024-03-30T13:12:18.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.837+0000 7f3e23400640 1 -- 172.21.15.99:0/2820418115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c0cced0 con 0x7f3e1c15b350 2024-03-30T13:12:18.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.837+0000 7f3e19600640 1 -- 172.21.15.99:0/2820418115 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14009510 con 0x7f3e1c15b350 2024-03-30T13:12:18.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.837+0000 7f3e23400640 1 -- 172.21.15.99:0/2820418115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c0cd490 con 0x7f3e1c15b350 2024-03-30T13:12:18.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.838+0000 7f3e23400640 1 -- 172.21.15.99:0/2820418115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c068640 con 0x7f3e1c15b350 2024-03-30T13:12:18.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.839+0000 7f3e19600640 1 -- 172.21.15.99:0/2820418115 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3e14005d10 con 0x7f3e1c15b350 2024-03-30T13:12:18.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.840+0000 7f3e19600640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df806c530 0x7f3df806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.840+0000 7f3e19600640 1 -- 172.21.15.99:0/2820418115 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f3e140ae4f0 con 0x7f3e1c15b350 2024-03-30T13:12:18.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.841+0000 7f3e20a00640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df806c530 0x7f3df806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.841+0000 7f3e20a00640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df806c530 0x7f3df806e9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c004ea0 tx=0x7f3e0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:18.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:18.845+0000 7f3e19600640 1 -- 172.21.15.99:0/2820418115 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3e1407c9e0 con 0x7f3e1c15b350 2024-03-30T13:12:19.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.088+0000 7f3e23400640 1 -- 172.21.15.99:0/2820418115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3e1c0af250 con 0x7f3e1c15b350 2024-03-30T13:12:19.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.089+0000 7f3e19600640 1 -- 172.21.15.99:0/2820418115 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f3e1407c2e0 con 0x7f3e1c15b350 2024-03-30T13:12:19.094 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:12:19.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 -- 172.21.15.99:0/2820418115 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df806c530 msgr2=0x7f3df806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df806c530 0x7f3df806e9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c004ea0 tx=0x7f3e0c009040 comp rx=0 tx=0).stop 2024-03-30T13:12:19.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 -- 172.21.15.99:0/2820418115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c15b350 msgr2=0x7f3e1c0ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c15b350 0x7f3e1c0ced70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3e14036040 tx=0x7f3e14004a40 comp rx=0 tx=0).stop 2024-03-30T13:12:19.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 -- 172.21.15.99:0/2820418115 shutdown_connections 2024-03-30T13:12:19.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df806c530 0x7f3df806e9f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c15b350 0x7f3e1c0ced70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e1c0d0490 0x7f3e1c0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 --2- 172.21.15.99:0/2820418115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c0b4cf0 0x7f3e1c1477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 -- 172.21.15.99:0/2820418115 >> 172.21.15.99:0/2820418115 conn(0x7f3e1c06b6f0 msgr2=0x7f3e1c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:19.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 -- 172.21.15.99:0/2820418115 shutdown_connections 2024-03-30T13:12:19.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:19.092+0000 7f3e23400640 1 -- 172.21.15.99:0/2820418115 wait complete. 2024-03-30T13:12:19.116 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-30T13:12:19.116 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:12:19.116 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-03-30T13:12:19.116 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-30T13:12:19.116 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-30T13:12:19.116 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-30T13:12:19.116 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-30T13:12:19.116 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:12:19.116 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:12:19.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:19.116 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-03-30T13:12:19.172 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:19.173 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42309sec preferred_lft 42309sec 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 06:93:ed:d4:56:3f brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::64c4:75ff:fe23:1693/64 scope link 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:12:19.174 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 06:93:ed:d4:56:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:12:19.175 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::493:edff:fed4:563f/64 scope link 2024-03-30T13:12:19.175 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:19.175 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:12:19.175 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 16:74:6c:52:1f:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:12:19.175 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::1474:6cff:fe52:1f7f/64 scope link 2024-03-30T13:12:19.175 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:19.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:19.175 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:12:19.256 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-03-30T13:12:19.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:19.261 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-03-30T13:12:19.309 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-03-30T13:12:19.309 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:12:19.310 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:12:19.310 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:12:19.310 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:12:19.310 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:19.310 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-03-30T13:12:19.310 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:12:19.310 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:12:19.310 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:12:19.310 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-03-30T13:12:19.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:12:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:19.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:12:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:19.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:19.550 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-03-30T13:12:19.594 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-30T13:12:19.595 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-30T13:12:19.595 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:12:19.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:19.595 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-03-30T13:12:19.728 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:19.728 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-30T13:12:19.778 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:12:19.778 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:19.778 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:12:19.824 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:12:19.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:19.824 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:12:20.001 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:12:20.001 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:12:20.001 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-03-30T13:12:20.022 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:12:20.023 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:12:20.023 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-03-30T13:12:20.023 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:12:20.023 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:20.048 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:12:20.048 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:12:20.048 INFO:teuthology.orchestra.run.smithi181.stdout:invalid new device string format 2024-03-30T13:12:20.048 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-03-30T13:12:20.049 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:20.049 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790" 2024-03-30T13:12:20.049 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.99:6789,172.21.15.181:6789,172.21.15.181:6790:/ 2024-03-30T13:12:20.049 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=e28e230a-999b-4d07-a5bd-ee507abf8d14" will pass to kernel 2024-03-30T13:12:20.053 INFO:teuthology.orchestra.run.smithi181.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-30T13:12:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:12:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:12:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:12:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:12:20.058 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:12:20.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:20.058 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:12:20.136 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:12:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:20.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-03-30T13:12:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:20.239 INFO:teuthology.orchestra.run.smithi181.stdout:client4655 2024-03-30T13:12:20.239 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:12:20.239 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:20.284 DEBUG:tasks.cephfs.test_uninlining:setting inline_data:1 2024-03-30T13:12:20.284 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs inline_data 1 --yes-i-really-really-mean-it 2024-03-30T13:12:20.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.508+0000 7f13e1800640 1 Processor -- start 2024-03-30T13:12:20.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.508+0000 7f13e1800640 1 -- start start 2024-03-30T13:12:20.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.510+0000 7f13e1800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f13dc0d31b0 0x7f13dc0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.510+0000 7f13e1800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13dc0d52c0 con 0x7f13dc0d4de0 2024-03-30T13:12:20.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.510+0000 7f13e1800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13dc0cf490 con 0x7f13dc15e840 2024-03-30T13:12:20.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.510+0000 7f13e1800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f13dc0cf770 con 0x7f13dc0d31b0 2024-03-30T13:12:20.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.510+0000 7f13d3400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f13dc0d4de0 0x7f13dc0d2aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42936/0 (socket says 172.21.15.99:42936) 2024-03-30T13:12:20.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.510+0000 7f13d3400640 1 -- 172.21.15.99:0/4193357471 learned_addr learned my addr 172.21.15.99:0/4193357471 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:20.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.510+0000 7f13e0e00640 1 --2- 172.21.15.99:0/4193357471 >> v2:172.21.15.99:3300/0 conn(0x7f13dc0d31b0 0x7f13dc0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.510+0000 7f13db400640 1 -- 172.21.15.99:0/4193357471 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608965239 0 0) 0x7f13dc0d52c0 con 0x7f13dc0d4de0 2024-03-30T13:12:20.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.510+0000 7f13db400640 1 -- 172.21.15.99:0/4193357471 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c0003520 con 0x7f13dc0d4de0 2024-03-30T13:12:20.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.510+0000 7f13e0e00640 1 -- 172.21.15.99:0/4193357471 >> v1:172.21.15.181:6789/0 conn(0x7f13dc15e840 legacy=0x7f13dc0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.510+0000 7f13e0e00640 1 -- 172.21.15.99:0/4193357471 >> v1:172.21.15.99:6789/0 conn(0x7f13dc0d4de0 legacy=0x7f13dc0d2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.511+0000 7f13e0e00640 1 -- 172.21.15.99:0/4193357471 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc0cfa50 con 0x7f13dc0d31b0 2024-03-30T13:12:20.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.512+0000 7f13e0e00640 1 --2- 172.21.15.99:0/4193357471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13dc0d31b0 0x7f13dc0b1090 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009d90 tx=0x7f13d402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2736c6105d301c25 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:20.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.512+0000 7f13db400640 1 -- 172.21.15.99:0/4193357471 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4039070 con 0x7f13dc0d31b0 2024-03-30T13:12:20.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.512+0000 7f13db400640 1 -- 172.21.15.99:0/4193357471 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d402cd00 con 0x7f13dc0d31b0 2024-03-30T13:12:20.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.512+0000 7f13db400640 1 -- 172.21.15.99:0/4193357471 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4034660 con 0x7f13dc0d31b0 2024-03-30T13:12:20.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.512+0000 7f13e1800640 1 -- 172.21.15.99:0/4193357471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13dc0d31b0 msgr2=0x7f13dc0b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.512+0000 7f13e1800640 1 --2- 172.21.15.99:0/4193357471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13dc0d31b0 0x7f13dc0b1090 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009d90 tx=0x7f13d402bf50 comp rx=0 tx=0).stop 2024-03-30T13:12:20.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.512+0000 7f13e1800640 1 -- 172.21.15.99:0/4193357471 shutdown_connections 2024-03-30T13:12:20.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.513+0000 7f13e1800640 1 --2- 172.21.15.99:0/4193357471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13dc0d31b0 0x7f13dc0b1090 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.513+0000 7f13e1800640 1 -- 172.21.15.99:0/4193357471 >> 172.21.15.99:0/4193357471 conn(0x7f13dc08bfc0 msgr2=0x7f13dc0d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:20.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.513+0000 7f13e1800640 1 -- 172.21.15.99:0/4193357471 shutdown_connections 2024-03-30T13:12:20.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.513+0000 7f13e1800640 1 -- 172.21.15.99:0/4193357471 wait complete. 2024-03-30T13:12:20.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.514+0000 7f13e1800640 1 Processor -- start 2024-03-30T13:12:20.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.514+0000 7f13e1800640 1 -- start start 2024-03-30T13:12:20.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.515+0000 7f13e1800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13dc0d31b0 0x7f13dc154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.515+0000 7f13e1800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13dc0d4de0 0x7f13dc0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.515+0000 7f13e1800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13dc15e840 0x7f13dc0c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.515+0000 7f13e1800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc0cf230 con 0x7f13dc0d4de0 2024-03-30T13:12:20.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.515+0000 7f13e1800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc0cf0b0 con 0x7f13dc15e840 2024-03-30T13:12:20.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.515+0000 7f13e1800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f13dc0d23c0 con 0x7f13dc0d31b0 2024-03-30T13:12:20.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.516+0000 7f13d3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13dc0d4de0 0x7f13dc0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.516+0000 7f13dbe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13dc0d31b0 0x7f13dc154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.516+0000 7f13d3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13dc0d4de0 0x7f13dc0ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40842/0 (socket says 172.21.15.99:40842) 2024-03-30T13:12:20.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.516+0000 7f13d3400640 1 -- 172.21.15.99:0/3526696779 learned_addr learned my addr 172.21.15.99:0/3526696779 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:20.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.516+0000 7f13e0e00640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13dc15e840 0x7f13dc0c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.516+0000 7f13d3400640 1 -- 172.21.15.99:0/3526696779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13dc0d31b0 msgr2=0x7f13dc154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.516+0000 7f13d3400640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13dc0d31b0 0x7f13dc154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.516+0000 7f13d3400640 1 -- 172.21.15.99:0/3526696779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13dc15e840 msgr2=0x7f13dc0c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.516+0000 7f13d3400640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13dc15e840 0x7f13dc0c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.516+0000 7f13d3400640 1 -- 172.21.15.99:0/3526696779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc0cd5e0 con 0x7f13dc0d4de0 2024-03-30T13:12:20.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.517+0000 7f13d3400640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13dc0d4de0 0x7f13dc0ccd00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f13c400c4d0 tx=0x7f13c400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:20.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.517+0000 7f13d8c00640 1 -- 172.21.15.99:0/3526696779 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4017070 con 0x7f13dc0d4de0 2024-03-30T13:12:20.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.517+0000 7f13d8c00640 1 -- 172.21.15.99:0/3526696779 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c4005ce0 con 0x7f13dc0d4de0 2024-03-30T13:12:20.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.517+0000 7f13e1800640 1 -- 172.21.15.99:0/3526696779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13dc0cd8c0 con 0x7f13dc0d4de0 2024-03-30T13:12:20.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.517+0000 7f13d8c00640 1 -- 172.21.15.99:0/3526696779 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4007270 con 0x7f13dc0d4de0 2024-03-30T13:12:20.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.517+0000 7f13e1800640 1 -- 172.21.15.99:0/3526696779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13dc0cde80 con 0x7f13dc0d4de0 2024-03-30T13:12:20.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.518+0000 7f13e1800640 1 -- 172.21.15.99:0/3526696779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13dc04f8f0 con 0x7f13dc0d4de0 2024-03-30T13:12:20.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.519+0000 7f13d8c00640 1 -- 172.21.15.99:0/3526696779 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f13c401a070 con 0x7f13dc0d4de0 2024-03-30T13:12:20.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.520+0000 7f13d8c00640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f13b806c530 0x7f13b806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.520+0000 7f13d8c00640 1 -- 172.21.15.99:0/3526696779 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f13c408aa40 con 0x7f13dc0d4de0 2024-03-30T13:12:20.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.520+0000 7f13dbe00640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f13b806c530 0x7f13b806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.521+0000 7f13dbe00640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f13b806c530 0x7f13b806e9f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0016e0 tx=0x7f13cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:20.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.525+0000 7f13d8c00640 1 -- 172.21.15.99:0/3526696779 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f13c4058970 con 0x7f13dc0d4de0 2024-03-30T13:12:20.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:20.765+0000 7f13e1800640 1 -- 172.21.15.99:0/3526696779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "1", "yes_i_really_really_mean_it": true} v 0) -- 0x7f13dc0b4fb0 con 0x7f13dc0d4de0 2024-03-30T13:12:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.268+0000 7f13d8c00640 1 -- 172.21.15.99:0/3526696779 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "1", "yes_i_really_really_mean_it": true}]=0 inline data enabled v18) ==== 165+0+0 (secure 0 0 0) 0x7f13c405cc70 con 0x7f13dc0d4de0 2024-03-30T13:12:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:inline data enabled 2024-03-30T13:12:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.272+0000 7f13e1800640 1 -- 172.21.15.99:0/3526696779 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f13b806c530 msgr2=0x7f13b806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.272+0000 7f13e1800640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f13b806c530 0x7f13b806e9f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0016e0 tx=0x7f13cc009040 comp rx=0 tx=0).stop 2024-03-30T13:12:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.272+0000 7f13e1800640 1 -- 172.21.15.99:0/3526696779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13dc0d4de0 msgr2=0x7f13dc0ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.272+0000 7f13e1800640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13dc0d4de0 0x7f13dc0ccd00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f13c400c4d0 tx=0x7f13c400c990 comp rx=0 tx=0).stop 2024-03-30T13:12:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.272+0000 7f13e1800640 1 -- 172.21.15.99:0/3526696779 shutdown_connections 2024-03-30T13:12:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.272+0000 7f13e1800640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f13b806c530 0x7f13b806e9f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.272+0000 7f13e1800640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13dc15e840 0x7f13dc0c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.272+0000 7f13e1800640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13dc0d4de0 0x7f13dc0ccd00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.272+0000 7f13e1800640 1 --2- 172.21.15.99:0/3526696779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13dc0d31b0 0x7f13dc154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.272+0000 7f13e1800640 1 -- 172.21.15.99:0/3526696779 >> 172.21.15.99:0/3526696779 conn(0x7f13dc08bfc0 msgr2=0x7f13dc0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.272+0000 7f13e1800640 1 -- 172.21.15.99:0/3526696779 shutdown_connections 2024-03-30T13:12:21.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:21.273+0000 7f13e1800640 1 -- 172.21.15.99:0/3526696779 wait complete. 2024-03-30T13:12:21.301 DEBUG:tasks.cephfs.test_uninlining:fetching tarball 2024-03-30T13:12:21.301 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && wget http://download.ceph.com/qa/linux-5.4.tar.gz 2024-03-30T13:12:21.393 INFO:teuthology.orchestra.run.smithi099.stderr:--2024-03-30 13:12:21-- http://download.ceph.com/qa/linux-5.4.tar.gz 2024-03-30T13:12:21.394 INFO:teuthology.orchestra.run.smithi099.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-03-30T13:12:21.416 INFO:teuthology.orchestra.run.smithi099.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-03-30T13:12:21.436 INFO:teuthology.orchestra.run.smithi099.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-30T13:12:21.436 INFO:teuthology.orchestra.run.smithi099.stderr:Length: 172616875 (165M) [application/octet-stream] 2024-03-30T13:12:21.446 INFO:teuthology.orchestra.run.smithi099.stderr:Saving to: ‘linux-5.4.tar.gz’ 2024-03-30T13:12:21.454 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:12:21.478 INFO:teuthology.orchestra.run.smithi099.stderr: 0K .......... .......... .......... .......... .......... 0% 1.57M 1m45s 2024-03-30T13:12:21.500 INFO:teuthology.orchestra.run.smithi099.stderr: 50K .......... .......... .......... .......... .......... 0% 2.41M 87s 2024-03-30T13:12:21.500 INFO:teuthology.orchestra.run.smithi099.stderr: 100K .......... .......... .......... .......... .......... 0% 55.1M 59s 2024-03-30T13:12:21.500 INFO:teuthology.orchestra.run.smithi099.stderr: 150K .......... .......... .......... .......... .......... 0% 74.6M 45s 2024-03-30T13:12:21.522 INFO:teuthology.orchestra.run.smithi099.stderr: 200K .......... .......... .......... .......... .......... 0% 2.49M 49s 2024-03-30T13:12:21.522 INFO:teuthology.orchestra.run.smithi099.stderr: 250K .......... .......... .......... .......... .......... 0% 66.3M 41s 2024-03-30T13:12:21.522 INFO:teuthology.orchestra.run.smithi099.stderr: 300K .......... .......... .......... .......... .......... 0% 82.8M 36s 2024-03-30T13:12:21.522 INFO:teuthology.orchestra.run.smithi099.stderr: 350K .......... .......... .......... .......... .......... 0% 56.0M 31s 2024-03-30T13:12:21.548 INFO:teuthology.orchestra.run.smithi099.stderr: 400K .......... .......... .......... .......... .......... 0% 2.68M 35s 2024-03-30T13:12:21.548 INFO:teuthology.orchestra.run.smithi099.stderr: 450K .......... .......... .......... .......... .......... 0% 73.1M 31s 2024-03-30T13:12:21.548 INFO:teuthology.orchestra.run.smithi099.stderr: 500K .......... .......... .......... .......... .......... 0% 82.5M 29s 2024-03-30T13:12:21.549 INFO:teuthology.orchestra.run.smithi099.stderr: 550K .......... .......... .......... .......... .......... 0% 82.1M 27s 2024-03-30T13:12:21.549 INFO:teuthology.orchestra.run.smithi099.stderr: 600K .......... .......... .......... .......... .......... 0% 81.5M 25s 2024-03-30T13:12:21.549 INFO:teuthology.orchestra.run.smithi099.stderr: 650K .......... .......... .......... .......... .......... 0% 73.9M 23s 2024-03-30T13:12:21.549 INFO:teuthology.orchestra.run.smithi099.stderr: 700K .......... .......... .......... .......... .......... 0% 84.3M 22s 2024-03-30T13:12:21.549 INFO:teuthology.orchestra.run.smithi099.stderr: 750K .......... .......... .......... .......... .......... 0% 83.9M 20s 2024-03-30T13:12:21.549 INFO:teuthology.orchestra.run.smithi099.stderr: 800K .......... .......... .......... .......... .......... 0% 79.3M 19s 2024-03-30T13:12:21.562 INFO:teuthology.orchestra.run.smithi099.stderr: 850K .......... .......... .......... .......... .......... 0% 3.08M 21s 2024-03-30T13:12:21.562 INFO:teuthology.orchestra.run.smithi099.stderr: 900K .......... .......... .......... .......... .......... 0% 74.9M 20s 2024-03-30T13:12:21.562 INFO:teuthology.orchestra.run.smithi099.stderr: 950K .......... .......... .......... .......... .......... 0% 77.7M 19s 2024-03-30T13:12:21.563 INFO:teuthology.orchestra.run.smithi099.stderr: 1000K .......... .......... .......... .......... .......... 0% 30.0M 19s 2024-03-30T13:12:21.566 INFO:teuthology.orchestra.run.smithi099.stderr: 1050K .......... .......... .......... .......... .......... 0% 24.9M 18s 2024-03-30T13:12:21.567 INFO:teuthology.orchestra.run.smithi099.stderr: 1100K .......... .......... .......... .......... .......... 0% 30.6M 17s 2024-03-30T13:12:21.568 INFO:teuthology.orchestra.run.smithi099.stderr: 1150K .......... .......... .......... .......... .......... 0% 31.2M 17s 2024-03-30T13:12:21.571 INFO:teuthology.orchestra.run.smithi099.stderr: 1200K .......... .......... .......... .......... .......... 0% 20.5M 17s 2024-03-30T13:12:21.573 INFO:teuthology.orchestra.run.smithi099.stderr: 1250K .......... .......... .......... .......... .......... 0% 25.2M 16s 2024-03-30T13:12:21.573 INFO:teuthology.orchestra.run.smithi099.stderr: 1300K .......... .......... .......... .......... .......... 0% 55.5M 16s 2024-03-30T13:12:21.575 INFO:teuthology.orchestra.run.smithi099.stderr: 1350K .......... .......... .......... .......... .......... 0% 25.6M 15s 2024-03-30T13:12:21.577 INFO:teuthology.orchestra.run.smithi099.stderr: 1400K .......... .......... .......... .......... .......... 0% 23.1M 15s 2024-03-30T13:12:21.581 INFO:teuthology.orchestra.run.smithi099.stderr: 1450K .......... .......... .......... .......... .......... 0% 16.9M 15s 2024-03-30T13:12:21.583 INFO:teuthology.orchestra.run.smithi099.stderr: 1500K .......... .......... .......... .......... .......... 0% 26.9M 15s 2024-03-30T13:12:21.583 INFO:teuthology.orchestra.run.smithi099.stderr: 1550K .......... .......... .......... .......... .......... 0% 41.7M 14s 2024-03-30T13:12:21.586 INFO:teuthology.orchestra.run.smithi099.stderr: 1600K .......... .......... .......... .......... .......... 0% 14.8M 14s 2024-03-30T13:12:21.591 INFO:teuthology.orchestra.run.smithi099.stderr: 1650K .......... .......... .......... .......... .......... 1% 24.1M 14s 2024-03-30T13:12:21.605 INFO:teuthology.orchestra.run.smithi099.stderr: 1700K .......... .......... .......... .......... .......... 1% 4.79M 15s 2024-03-30T13:12:21.605 INFO:teuthology.orchestra.run.smithi099.stderr: 1750K .......... .......... .......... .......... .......... 1% 22.4M 14s 2024-03-30T13:12:21.605 INFO:teuthology.orchestra.run.smithi099.stderr: 1800K .......... .......... .......... .......... .......... 1% 77.8M 14s 2024-03-30T13:12:21.605 INFO:teuthology.orchestra.run.smithi099.stderr: 1850K .......... .......... .......... .......... .......... 1% 25.1M 14s 2024-03-30T13:12:21.607 INFO:teuthology.orchestra.run.smithi099.stderr: 1900K .......... .......... .......... .......... .......... 1% 18.3M 14s 2024-03-30T13:12:21.610 INFO:teuthology.orchestra.run.smithi099.stderr: 1950K .......... .......... .......... .......... .......... 1% 16.2M 14s 2024-03-30T13:12:21.614 INFO:teuthology.orchestra.run.smithi099.stderr: 2000K .......... .......... .......... .......... .......... 1% 14.6M 13s 2024-03-30T13:12:21.614 INFO:teuthology.orchestra.run.smithi099.stderr: 2050K .......... .......... .......... .......... .......... 1% 80.0M 13s 2024-03-30T13:12:21.616 INFO:teuthology.orchestra.run.smithi099.stderr: 2100K .......... .......... .......... .......... .......... 1% 21.2M 13s 2024-03-30T13:12:21.619 INFO:teuthology.orchestra.run.smithi099.stderr: 2150K .......... .......... .......... .......... .......... 1% 15.4M 13s 2024-03-30T13:12:21.622 INFO:teuthology.orchestra.run.smithi099.stderr: 2200K .......... .......... .......... .......... .......... 1% 17.7M 13s 2024-03-30T13:12:21.623 INFO:teuthology.orchestra.run.smithi099.stderr: 2250K .......... .......... .......... .......... .......... 1% 22.7M 13s 2024-03-30T13:12:21.624 INFO:teuthology.orchestra.run.smithi099.stderr: 2300K .......... .......... .......... .......... .......... 1% 42.9M 13s 2024-03-30T13:12:21.628 INFO:teuthology.orchestra.run.smithi099.stderr: 2350K .......... .......... .......... .......... .......... 1% 15.4M 13s 2024-03-30T13:12:21.632 INFO:teuthology.orchestra.run.smithi099.stderr: 2400K .......... .......... .......... .......... .......... 1% 13.9M 13s 2024-03-30T13:12:21.635 INFO:teuthology.orchestra.run.smithi099.stderr: 2450K .......... .......... .......... .......... .......... 1% 15.7M 12s 2024-03-30T13:12:21.639 INFO:teuthology.orchestra.run.smithi099.stderr: 2500K .......... .......... .......... .......... .......... 1% 17.3M 12s 2024-03-30T13:12:21.639 INFO:teuthology.orchestra.run.smithi099.stderr: 2550K .......... .......... .......... .......... .......... 1% 44.9M 12s 2024-03-30T13:12:21.643 INFO:teuthology.orchestra.run.smithi099.stderr: 2600K .......... .......... .......... .......... .......... 1% 9.87M 12s 2024-03-30T13:12:21.645 INFO:teuthology.orchestra.run.smithi099.stderr: 2650K .......... .......... .......... .......... .......... 1% 24.6M 12s 2024-03-30T13:12:21.648 INFO:teuthology.orchestra.run.smithi099.stderr: 2700K .......... .......... .......... .......... .......... 1% 15.4M 12s 2024-03-30T13:12:21.652 INFO:teuthology.orchestra.run.smithi099.stderr: 2750K .......... .......... .......... .......... .......... 1% 14.7M 12s 2024-03-30T13:12:21.654 INFO:teuthology.orchestra.run.smithi099.stderr: 2800K .......... .......... .......... .......... .......... 1% 18.9M 12s 2024-03-30T13:12:21.661 INFO:teuthology.orchestra.run.smithi099.stderr: 2850K .......... .......... .......... .......... .......... 1% 7.39M 12s 2024-03-30T13:12:21.664 INFO:teuthology.orchestra.run.smithi099.stderr: 2900K .......... .......... .......... .......... .......... 1% 16.3M 12s 2024-03-30T13:12:21.666 INFO:teuthology.orchestra.run.smithi099.stderr: 2950K .......... .......... .......... .......... .......... 1% 21.6M 12s 2024-03-30T13:12:21.669 INFO:teuthology.orchestra.run.smithi099.stderr: 3000K .......... .......... .......... .......... .......... 1% 17.8M 12s 2024-03-30T13:12:21.670 INFO:teuthology.orchestra.run.smithi099.stderr: 3050K .......... .......... .......... .......... .......... 1% 32.2M 12s 2024-03-30T13:12:21.674 INFO:teuthology.orchestra.run.smithi099.stderr: 3100K .......... .......... .......... .......... .......... 1% 12.2M 12s 2024-03-30T13:12:21.678 INFO:teuthology.orchestra.run.smithi099.stderr: 3150K .......... .......... .......... .......... .......... 1% 14.1M 12s 2024-03-30T13:12:21.683 INFO:teuthology.orchestra.run.smithi099.stderr: 3200K .......... .......... .......... .......... .......... 1% 14.4M 12s 2024-03-30T13:12:21.685 INFO:teuthology.orchestra.run.smithi099.stderr: 3250K .......... .......... .......... .......... .......... 1% 14.3M 12s 2024-03-30T13:12:21.691 INFO:teuthology.orchestra.run.smithi099.stderr: 3300K .......... .......... .......... .......... .......... 1% 35.8M 12s 2024-03-30T13:12:21.691 INFO:teuthology.orchestra.run.smithi099.stderr: 3350K .......... .......... .......... .......... .......... 2% 15.6M 12s 2024-03-30T13:12:21.694 INFO:teuthology.orchestra.run.smithi099.stderr: 3400K .......... .......... .......... .......... .......... 2% 18.2M 12s 2024-03-30T13:12:21.694 INFO:teuthology.orchestra.run.smithi099.stderr: 3450K .......... .......... .......... .......... .......... 2% 26.9M 12s 2024-03-30T13:12:21.697 INFO:teuthology.orchestra.run.smithi099.stderr: 3500K .......... .......... .......... .......... .......... 2% 15.5M 12s 2024-03-30T13:12:21.701 INFO:teuthology.orchestra.run.smithi099.stderr: 3550K .......... .......... .......... .......... .......... 2% 13.5M 12s 2024-03-30T13:12:21.703 INFO:teuthology.orchestra.run.smithi099.stderr: 3600K .......... .......... .......... .......... .......... 2% 19.3M 12s 2024-03-30T13:12:21.707 INFO:teuthology.orchestra.run.smithi099.stderr: 3650K .......... .......... .......... .......... .......... 2% 13.3M 12s 2024-03-30T13:12:21.710 INFO:teuthology.orchestra.run.smithi099.stderr: 3700K .......... .......... .......... .......... .......... 2% 14.1M 12s 2024-03-30T13:12:21.711 INFO:teuthology.orchestra.run.smithi099.stderr: 3750K .......... .......... .......... .......... .......... 2% 32.4M 12s 2024-03-30T13:12:21.715 INFO:teuthology.orchestra.run.smithi099.stderr: 3800K .......... .......... .......... .......... .......... 2% 14.0M 11s 2024-03-30T13:12:21.719 INFO:teuthology.orchestra.run.smithi099.stderr: 3850K .......... .......... .......... .......... .......... 2% 11.6M 12s 2024-03-30T13:12:21.722 INFO:teuthology.orchestra.run.smithi099.stderr: 3900K .......... .......... .......... .......... .......... 2% 17.7M 11s 2024-03-30T13:12:21.726 INFO:teuthology.orchestra.run.smithi099.stderr: 3950K .......... .......... .......... .......... .......... 2% 13.5M 11s 2024-03-30T13:12:21.727 INFO:teuthology.orchestra.run.smithi099.stderr: 4000K .......... .......... .......... .......... .......... 2% 27.1M 11s 2024-03-30T13:12:21.732 INFO:teuthology.orchestra.run.smithi099.stderr: 4050K .......... .......... .......... .......... .......... 2% 10.6M 11s 2024-03-30T13:12:21.739 INFO:teuthology.orchestra.run.smithi099.stderr: 4100K .......... .......... .......... .......... .......... 2% 7.35M 12s 2024-03-30T13:12:21.741 INFO:teuthology.orchestra.run.smithi099.stderr: 4150K .......... .......... .......... .......... .......... 2% 20.1M 12s 2024-03-30T13:12:21.745 INFO:teuthology.orchestra.run.smithi099.stderr: 4200K .......... .......... .......... .......... .......... 2% 11.5M 12s 2024-03-30T13:12:21.749 INFO:teuthology.orchestra.run.smithi099.stderr: 4250K .......... .......... .......... .......... .......... 2% 16.5M 12s 2024-03-30T13:12:21.839 INFO:teuthology.orchestra.run.smithi099.stderr: 4300K .......... .......... .......... .......... .......... 2% 554K 15s 2024-03-30T13:12:21.844 INFO:teuthology.orchestra.run.smithi099.stderr: 4350K .......... .......... .......... .......... .......... 2% 25.3M 15s 2024-03-30T13:12:21.844 INFO:teuthology.orchestra.run.smithi099.stderr: 4400K .......... .......... .......... .......... .......... 2% 18.1M 15s 2024-03-30T13:12:21.844 INFO:teuthology.orchestra.run.smithi099.stderr: 4450K .......... .......... .......... .......... .......... 2% 78.9M 14s 2024-03-30T13:12:21.847 INFO:teuthology.orchestra.run.smithi099.stderr: 4500K .......... .......... .......... .......... .......... 2% 17.5M 14s 2024-03-30T13:12:21.852 INFO:teuthology.orchestra.run.smithi099.stderr: 4550K .......... .......... .......... .......... .......... 2% 12.8M 14s 2024-03-30T13:12:21.852 INFO:teuthology.orchestra.run.smithi099.stderr: 4600K .......... .......... .......... .......... .......... 2% 68.3M 14s 2024-03-30T13:12:21.855 INFO:teuthology.orchestra.run.smithi099.stderr: 4650K .......... .......... .......... .......... .......... 2% 13.8M 14s 2024-03-30T13:12:21.859 INFO:teuthology.orchestra.run.smithi099.stderr: 4700K .......... .......... .......... .......... .......... 2% 14.3M 14s 2024-03-30T13:12:21.861 INFO:teuthology.orchestra.run.smithi099.stderr: 4750K .......... .......... .......... .......... .......... 2% 28.0M 14s 2024-03-30T13:12:21.865 INFO:teuthology.orchestra.run.smithi099.stderr: 4800K .......... .......... .......... .......... .......... 2% 23.6M 14s 2024-03-30T13:12:21.865 INFO:teuthology.orchestra.run.smithi099.stderr: 4850K .......... .......... .......... .......... .......... 2% 42.5M 14s 2024-03-30T13:12:21.866 INFO:teuthology.orchestra.run.smithi099.stderr: 4900K .......... .......... .......... .......... .......... 2% 15.2M 14s 2024-03-30T13:12:21.911 INFO:teuthology.orchestra.run.smithi099.stderr: 4950K .......... .......... .......... .......... .......... 2% 33.3M 14s 2024-03-30T13:12:21.911 INFO:teuthology.orchestra.run.smithi099.stderr: 5000K .......... .......... .......... .......... .......... 2% 75.0M 14s 2024-03-30T13:12:21.911 INFO:teuthology.orchestra.run.smithi099.stderr: 5050K .......... .......... .......... .......... .......... 3% 45.3M 14s 2024-03-30T13:12:21.911 INFO:teuthology.orchestra.run.smithi099.stderr: 5100K .......... .......... .......... .......... .......... 3% 56.0M 13s 2024-03-30T13:12:21.911 INFO:teuthology.orchestra.run.smithi099.stderr: 5150K .......... .......... .......... .......... .......... 3% 59.5M 13s 2024-03-30T13:12:21.911 INFO:teuthology.orchestra.run.smithi099.stderr: 5200K .......... .......... .......... .......... .......... 3% 79.4M 13s 2024-03-30T13:12:21.911 INFO:teuthology.orchestra.run.smithi099.stderr: 5250K .......... .......... .......... .......... .......... 3% 69.8M 13s 2024-03-30T13:12:21.911 INFO:teuthology.orchestra.run.smithi099.stderr: 5300K .......... .......... .......... .......... .......... 3% 67.7M 13s 2024-03-30T13:12:21.911 INFO:teuthology.orchestra.run.smithi099.stderr: 5350K .......... .......... .......... .......... .......... 3% 85.5M 13s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5400K .......... .......... .......... .......... .......... 3% 80.5M 13s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5450K .......... .......... .......... .......... .......... 3% 84.8M 13s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5500K .......... .......... .......... .......... .......... 3% 75.2M 13s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5550K .......... .......... .......... .......... .......... 3% 77.4M 13s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5600K .......... .......... .......... .......... .......... 3% 45.3M 12s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5650K .......... .......... .......... .......... .......... 3% 64.3M 12s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5700K .......... .......... .......... .......... .......... 3% 66.4M 12s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5750K .......... .......... .......... .......... .......... 3% 83.2M 12s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5800K .......... .......... .......... .......... .......... 3% 84.5M 12s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5850K .......... .......... .......... .......... .......... 3% 87.4M 12s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5900K .......... .......... .......... .......... .......... 3% 71.7M 12s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 5950K .......... .......... .......... .......... .......... 3% 85.2M 12s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 6000K .......... .......... .......... .......... .......... 3% 31.2M 12s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 6050K .......... .......... .......... .......... .......... 3% 17.7M 12s 2024-03-30T13:12:21.912 INFO:teuthology.orchestra.run.smithi099.stderr: 6100K .......... .......... .......... .......... .......... 3% 12.6M 12s 2024-03-30T13:12:21.913 INFO:teuthology.orchestra.run.smithi099.stderr: 6150K .......... .......... .......... .......... .......... 3% 17.3M 12s 2024-03-30T13:12:21.913 INFO:teuthology.orchestra.run.smithi099.stderr: 6200K .......... .......... .......... .......... .......... 3% 17.5M 12s 2024-03-30T13:12:21.913 INFO:teuthology.orchestra.run.smithi099.stderr: 6250K .......... .......... .......... .......... .......... 3% 14.0M 12s 2024-03-30T13:12:21.913 INFO:teuthology.orchestra.run.smithi099.stderr: 6300K .......... .......... .......... .......... .......... 3% 25.1M 12s 2024-03-30T13:12:21.913 INFO:teuthology.orchestra.run.smithi099.stderr: 6350K .......... .......... .......... .......... .......... 3% 7.61M 12s 2024-03-30T13:12:21.913 INFO:teuthology.orchestra.run.smithi099.stderr: 6400K .......... .......... .......... .......... .......... 3% 17.7M 12s 2024-03-30T13:12:21.915 INFO:teuthology.orchestra.run.smithi099.stderr: 6450K .......... .......... .......... .......... .......... 3% 12.8M 12s 2024-03-30T13:12:21.920 INFO:teuthology.orchestra.run.smithi099.stderr: 6500K .......... .......... .......... .......... .......... 3% 8.45M 12s 2024-03-30T13:12:21.922 INFO:teuthology.orchestra.run.smithi099.stderr: 6550K .......... .......... .......... .......... .......... 3% 17.2M 12s 2024-03-30T13:12:21.928 INFO:teuthology.orchestra.run.smithi099.stderr: 6600K .......... .......... .......... .......... .......... 3% 9.50M 12s 2024-03-30T13:12:21.931 INFO:teuthology.orchestra.run.smithi099.stderr: 6650K .......... .......... .......... .......... .......... 3% 13.6M 12s 2024-03-30T13:12:21.935 INFO:teuthology.orchestra.run.smithi099.stderr: 6700K .......... .......... .......... .......... .......... 4% 12.8M 12s 2024-03-30T13:12:21.941 INFO:teuthology.orchestra.run.smithi099.stderr: 6750K .......... .......... .......... .......... .......... 4% 8.85M 12s 2024-03-30T13:12:21.944 INFO:teuthology.orchestra.run.smithi099.stderr: 6800K .......... .......... .......... .......... .......... 4% 14.7M 12s 2024-03-30T13:12:21.948 INFO:teuthology.orchestra.run.smithi099.stderr: 6850K .......... .......... .......... .......... .......... 4% 11.9M 12s 2024-03-30T13:12:21.952 INFO:teuthology.orchestra.run.smithi099.stderr: 6900K .......... .......... .......... .......... .......... 4% 13.9M 12s 2024-03-30T13:12:21.954 INFO:teuthology.orchestra.run.smithi099.stderr: 6950K .......... .......... .......... .......... .......... 4% 19.9M 12s 2024-03-30T13:12:21.958 INFO:teuthology.orchestra.run.smithi099.stderr: 7000K .......... .......... .......... .......... .......... 4% 11.2M 12s 2024-03-30T13:12:21.961 INFO:teuthology.orchestra.run.smithi099.stderr: 7050K .......... .......... .......... .......... .......... 4% 14.5M 12s 2024-03-30T13:12:21.963 INFO:teuthology.orchestra.run.smithi099.stderr: 7100K .......... .......... .......... .......... .......... 4% 26.6M 12s 2024-03-30T13:12:21.967 INFO:teuthology.orchestra.run.smithi099.stderr: 7150K .......... .......... .......... .......... .......... 4% 13.4M 12s 2024-03-30T13:12:21.971 INFO:teuthology.orchestra.run.smithi099.stderr: 7200K .......... .......... .......... .......... .......... 4% 13.5M 12s 2024-03-30T13:12:21.973 INFO:teuthology.orchestra.run.smithi099.stderr: 7250K .......... .......... .......... .......... .......... 4% 19.2M 12s 2024-03-30T13:12:21.977 INFO:teuthology.orchestra.run.smithi099.stderr: 7300K .......... .......... .......... .......... .......... 4% 13.9M 12s 2024-03-30T13:12:21.979 INFO:teuthology.orchestra.run.smithi099.stderr: 7350K .......... .......... .......... .......... .......... 4% 17.3M 12s 2024-03-30T13:12:21.983 INFO:teuthology.orchestra.run.smithi099.stderr: 7400K .......... .......... .......... .......... .......... 4% 17.6M 12s 2024-03-30T13:12:21.986 INFO:teuthology.orchestra.run.smithi099.stderr: 7450K .......... .......... .......... .......... .......... 4% 14.4M 12s 2024-03-30T13:12:21.989 INFO:teuthology.orchestra.run.smithi099.stderr: 7500K .......... .......... .......... .......... .......... 4% 16.3M 12s 2024-03-30T13:12:21.992 INFO:teuthology.orchestra.run.smithi099.stderr: 7550K .......... .......... .......... .......... .......... 4% 14.9M 12s 2024-03-30T13:12:21.995 INFO:teuthology.orchestra.run.smithi099.stderr: 7600K .......... .......... .......... .......... .......... 4% 16.6M 12s 2024-03-30T13:12:22.004 INFO:teuthology.orchestra.run.smithi099.stderr: 7650K .......... .......... .......... .......... .......... 4% 14.9M 12s 2024-03-30T13:12:22.004 INFO:teuthology.orchestra.run.smithi099.stderr: 7700K .......... .......... .......... .......... .......... 4% 12.6M 12s 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi099.stderr: 7750K .......... .......... .......... .......... .......... 4% 17.7M 12s 2024-03-30T13:12:22.009 INFO:teuthology.orchestra.run.smithi099.stderr: 7800K .......... .......... .......... .......... .......... 4% 11.1M 12s 2024-03-30T13:12:22.012 INFO:teuthology.orchestra.run.smithi099.stderr: 7850K .......... .......... .......... .......... .......... 4% 16.5M 12s 2024-03-30T13:12:22.016 INFO:teuthology.orchestra.run.smithi099.stderr: 7900K .......... .......... .......... .......... .......... 4% 14.7M 12s 2024-03-30T13:12:22.018 INFO:teuthology.orchestra.run.smithi099.stderr: 7950K .......... .......... .......... .......... .......... 4% 20.5M 11s 2024-03-30T13:12:22.022 INFO:teuthology.orchestra.run.smithi099.stderr: 8000K .......... .......... .......... .......... .......... 4% 12.0M 11s 2024-03-30T13:12:22.025 INFO:teuthology.orchestra.run.smithi099.stderr: 8050K .......... .......... .......... .......... .......... 4% 17.5M 11s 2024-03-30T13:12:22.028 INFO:teuthology.orchestra.run.smithi099.stderr: 8100K .......... .......... .......... .......... .......... 4% 14.3M 11s 2024-03-30T13:12:22.031 INFO:teuthology.orchestra.run.smithi099.stderr: 8150K .......... .......... .......... .......... .......... 4% 17.0M 11s 2024-03-30T13:12:22.034 INFO:teuthology.orchestra.run.smithi099.stderr: 8200K .......... .......... .......... .......... .......... 4% 16.8M 11s 2024-03-30T13:12:22.036 INFO:teuthology.orchestra.run.smithi099.stderr: 8250K .......... .......... .......... .......... .......... 4% 20.7M 11s 2024-03-30T13:12:22.039 INFO:teuthology.orchestra.run.smithi099.stderr: 8300K .......... .......... .......... .......... .......... 4% 17.2M 11s 2024-03-30T13:12:22.043 INFO:teuthology.orchestra.run.smithi099.stderr: 8350K .......... .......... .......... .......... .......... 4% 17.2M 11s 2024-03-30T13:12:22.045 INFO:teuthology.orchestra.run.smithi099.stderr: 8400K .......... .......... .......... .......... .......... 5% 17.2M 11s 2024-03-30T13:12:22.048 INFO:teuthology.orchestra.run.smithi099.stderr: 8450K .......... .......... .......... .......... .......... 5% 15.6M 11s 2024-03-30T13:12:22.051 INFO:teuthology.orchestra.run.smithi099.stderr: 8500K .......... .......... .......... .......... .......... 5% 18.9M 11s 2024-03-30T13:12:22.053 INFO:teuthology.orchestra.run.smithi099.stderr: 8550K .......... .......... .......... .......... .......... 5% 17.2M 11s 2024-03-30T13:12:22.056 INFO:teuthology.orchestra.run.smithi099.stderr: 8600K .......... .......... .......... .......... .......... 5% 22.3M 11s 2024-03-30T13:12:22.058 INFO:teuthology.orchestra.run.smithi099.stderr: 8650K .......... .......... .......... .......... .......... 5% 18.3M 11s 2024-03-30T13:12:22.061 INFO:teuthology.orchestra.run.smithi099.stderr: 8700K .......... .......... .......... .......... .......... 5% 17.0M 11s 2024-03-30T13:12:22.063 INFO:teuthology.orchestra.run.smithi099.stderr: 8750K .......... .......... .......... .......... .......... 5% 21.2M 11s 2024-03-30T13:12:22.066 INFO:teuthology.orchestra.run.smithi099.stderr: 8800K .......... .......... .......... .......... .......... 5% 32.2M 11s 2024-03-30T13:12:22.068 INFO:teuthology.orchestra.run.smithi099.stderr: 8850K .......... .......... .......... .......... .......... 5% 18.1M 11s 2024-03-30T13:12:22.070 INFO:teuthology.orchestra.run.smithi099.stderr: 8900K .......... .......... .......... .......... .......... 5% 25.8M 11s 2024-03-30T13:12:22.072 INFO:teuthology.orchestra.run.smithi099.stderr: 8950K .......... .......... .......... .......... .......... 5% 24.3M 11s 2024-03-30T13:12:22.074 INFO:teuthology.orchestra.run.smithi099.stderr: 9000K .......... .......... .......... .......... .......... 5% 23.6M 11s 2024-03-30T13:12:22.075 INFO:teuthology.orchestra.run.smithi099.stderr: 9050K .......... .......... .......... .......... .......... 5% 25.7M 11s 2024-03-30T13:12:22.080 INFO:teuthology.orchestra.run.smithi099.stderr: 9100K .......... .......... .......... .......... .......... 5% 14.0M 11s 2024-03-30T13:12:22.081 INFO:teuthology.orchestra.run.smithi099.stderr: 9150K .......... .......... .......... .......... .......... 5% 30.5M 11s 2024-03-30T13:12:22.083 INFO:teuthology.orchestra.run.smithi099.stderr: 9200K .......... .......... .......... .......... .......... 5% 22.1M 11s 2024-03-30T13:12:22.085 INFO:teuthology.orchestra.run.smithi099.stderr: 9250K .......... .......... .......... .......... .......... 5% 23.5M 11s 2024-03-30T13:12:22.087 INFO:teuthology.orchestra.run.smithi099.stderr: 9300K .......... .......... .......... .......... .......... 5% 26.2M 11s 2024-03-30T13:12:22.090 INFO:teuthology.orchestra.run.smithi099.stderr: 9350K .......... .......... .......... .......... .......... 5% 16.3M 11s 2024-03-30T13:12:22.092 INFO:teuthology.orchestra.run.smithi099.stderr: 9400K .......... .......... .......... .......... .......... 5% 25.9M 11s 2024-03-30T13:12:22.095 INFO:teuthology.orchestra.run.smithi099.stderr: 9450K .......... .......... .......... .......... .......... 5% 16.8M 11s 2024-03-30T13:12:22.096 INFO:teuthology.orchestra.run.smithi099.stderr: 9500K .......... .......... .......... .......... .......... 5% 29.7M 11s 2024-03-30T13:12:22.098 INFO:teuthology.orchestra.run.smithi099.stderr: 9550K .......... .......... .......... .......... .......... 5% 22.6M 11s 2024-03-30T13:12:22.101 INFO:teuthology.orchestra.run.smithi099.stderr: 9600K .......... .......... .......... .......... .......... 5% 22.9M 11s 2024-03-30T13:12:22.102 INFO:teuthology.orchestra.run.smithi099.stderr: 9650K .......... .......... .......... .......... .......... 5% 35.4M 11s 2024-03-30T13:12:22.104 INFO:teuthology.orchestra.run.smithi099.stderr: 9700K .......... .......... .......... .......... .......... 5% 21.5M 11s 2024-03-30T13:12:22.106 INFO:teuthology.orchestra.run.smithi099.stderr: 9750K .......... .......... .......... .......... .......... 5% 25.8M 11s 2024-03-30T13:12:22.108 INFO:teuthology.orchestra.run.smithi099.stderr: 9800K .......... .......... .......... .......... .......... 5% 25.0M 11s 2024-03-30T13:12:22.111 INFO:teuthology.orchestra.run.smithi099.stderr: 9850K .......... .......... .......... .......... .......... 5% 19.5M 11s 2024-03-30T13:12:22.112 INFO:teuthology.orchestra.run.smithi099.stderr: 9900K .......... .......... .......... .......... .......... 5% 29.0M 11s 2024-03-30T13:12:22.114 INFO:teuthology.orchestra.run.smithi099.stderr: 9950K .......... .......... .......... .......... .......... 5% 29.2M 11s 2024-03-30T13:12:22.117 INFO:teuthology.orchestra.run.smithi099.stderr: 10000K .......... .......... .......... .......... .......... 5% 19.9M 11s 2024-03-30T13:12:22.118 INFO:teuthology.orchestra.run.smithi099.stderr: 10050K .......... .......... .......... .......... .......... 5% 33.9M 11s 2024-03-30T13:12:22.120 INFO:teuthology.orchestra.run.smithi099.stderr: 10100K .......... .......... .......... .......... .......... 6% 24.8M 11s 2024-03-30T13:12:22.128 INFO:teuthology.orchestra.run.smithi099.stderr: 10150K .......... .......... .......... .......... .......... 6% 5.81M 11s 2024-03-30T13:12:22.144 INFO:teuthology.orchestra.run.smithi099.stderr: 10200K .......... .......... .......... .......... .......... 6% 3.07M 11s 2024-03-30T13:12:22.153 INFO:teuthology.orchestra.run.smithi099.stderr: 10250K .......... .......... .......... .......... .......... 6% 6.59M 11s 2024-03-30T13:12:22.153 INFO:teuthology.orchestra.run.smithi099.stderr: 10300K .......... .......... .......... .......... .......... 6% 62.9M 11s 2024-03-30T13:12:22.154 INFO:teuthology.orchestra.run.smithi099.stderr: 10350K .......... .......... .......... .......... .......... 6% 28.7M 11s 2024-03-30T13:12:22.156 INFO:teuthology.orchestra.run.smithi099.stderr: 10400K .......... .......... .......... .......... .......... 6% 20.7M 11s 2024-03-30T13:12:22.159 INFO:teuthology.orchestra.run.smithi099.stderr: 10450K .......... .......... .......... .......... .......... 6% 18.7M 11s 2024-03-30T13:12:22.163 INFO:teuthology.orchestra.run.smithi099.stderr: 10500K .......... .......... .......... .......... .......... 6% 12.7M 11s 2024-03-30T13:12:22.165 INFO:teuthology.orchestra.run.smithi099.stderr: 10550K .......... .......... .......... .......... .......... 6% 22.7M 11s 2024-03-30T13:12:22.169 INFO:teuthology.orchestra.run.smithi099.stderr: 10600K .......... .......... .......... .......... .......... 6% 12.2M 11s 2024-03-30T13:12:22.171 INFO:teuthology.orchestra.run.smithi099.stderr: 10650K .......... .......... .......... .......... .......... 6% 27.8M 11s 2024-03-30T13:12:22.174 INFO:teuthology.orchestra.run.smithi099.stderr: 10700K .......... .......... .......... .......... .......... 6% 16.4M 11s 2024-03-30T13:12:22.177 INFO:teuthology.orchestra.run.smithi099.stderr: 10750K .......... .......... .......... .......... .......... 6% 14.4M 11s 2024-03-30T13:12:22.180 INFO:teuthology.orchestra.run.smithi099.stderr: 10800K .......... .......... .......... .......... .......... 6% 20.5M 11s 2024-03-30T13:12:22.183 INFO:teuthology.orchestra.run.smithi099.stderr: 10850K .......... .......... .......... .......... .......... 6% 14.3M 11s 2024-03-30T13:12:22.185 INFO:teuthology.orchestra.run.smithi099.stderr: 10900K .......... .......... .......... .......... .......... 6% 23.1M 11s 2024-03-30T13:12:22.189 INFO:teuthology.orchestra.run.smithi099.stderr: 10950K .......... .......... .......... .......... .......... 6% 14.1M 11s 2024-03-30T13:12:22.192 INFO:teuthology.orchestra.run.smithi099.stderr: 11000K .......... .......... .......... .......... .......... 6% 15.4M 11s 2024-03-30T13:12:22.194 INFO:teuthology.orchestra.run.smithi099.stderr: 11050K .......... .......... .......... .......... .......... 6% 25.4M 11s 2024-03-30T13:12:22.200 INFO:teuthology.orchestra.run.smithi099.stderr: 11100K .......... .......... .......... .......... .......... 6% 7.42M 11s 2024-03-30T13:12:22.210 INFO:teuthology.orchestra.run.smithi099.stderr: 11150K .......... .......... .......... .......... .......... 6% 4.94M 11s 2024-03-30T13:12:22.215 INFO:teuthology.orchestra.run.smithi099.stderr: 11200K .......... .......... .......... .......... .......... 6% 9.41M 11s 2024-03-30T13:12:22.217 INFO:teuthology.orchestra.run.smithi099.stderr: 11250K .......... .......... .......... .......... .......... 6% 32.8M 11s 2024-03-30T13:12:22.219 INFO:teuthology.orchestra.run.smithi099.stderr: 11300K .......... .......... .......... .......... .......... 6% 27.7M 11s 2024-03-30T13:12:22.221 INFO:teuthology.orchestra.run.smithi099.stderr: 11350K .......... .......... .......... .......... .......... 6% 17.8M 11s 2024-03-30T13:12:22.224 INFO:teuthology.orchestra.run.smithi099.stderr: 11400K .......... .......... .......... .......... .......... 6% 29.8M 11s 2024-03-30T13:12:22.225 INFO:teuthology.orchestra.run.smithi099.stderr: 11450K .......... .......... .......... .......... .......... 6% 25.5M 11s 2024-03-30T13:12:22.227 INFO:teuthology.orchestra.run.smithi099.stderr: 11500K .......... .......... .......... .......... .......... 6% 33.8M 11s 2024-03-30T13:12:22.229 INFO:teuthology.orchestra.run.smithi099.stderr: 11550K .......... .......... .......... .......... .......... 6% 18.1M 11s 2024-03-30T13:12:22.231 INFO:teuthology.orchestra.run.smithi099.stderr: 11600K .......... .......... .......... .......... .......... 6% 29.0M 11s 2024-03-30T13:12:22.232 INFO:teuthology.orchestra.run.smithi099.stderr: 11650K .......... .......... .......... .......... .......... 6% 32.8M 11s 2024-03-30T13:12:22.234 INFO:teuthology.orchestra.run.smithi099.stderr: 11700K .......... .......... .......... .......... .......... 6% 22.1M 11s 2024-03-30T13:12:22.237 INFO:teuthology.orchestra.run.smithi099.stderr: 11750K .......... .......... .......... .......... .......... 7% 25.3M 10s 2024-03-30T13:12:22.239 INFO:teuthology.orchestra.run.smithi099.stderr: 11800K .......... .......... .......... .......... .......... 7% 20.4M 10s 2024-03-30T13:12:22.240 INFO:teuthology.orchestra.run.smithi099.stderr: 11850K .......... .......... .......... .......... .......... 7% 26.7M 10s 2024-03-30T13:12:22.243 INFO:teuthology.orchestra.run.smithi099.stderr: 11900K .......... .......... .......... .......... .......... 7% 18.9M 10s 2024-03-30T13:12:22.246 INFO:teuthology.orchestra.run.smithi099.stderr: 11950K .......... .......... .......... .......... .......... 7% 19.5M 10s 2024-03-30T13:12:22.247 INFO:teuthology.orchestra.run.smithi099.stderr: 12000K .......... .......... .......... .......... .......... 7% 28.3M 10s 2024-03-30T13:12:22.252 INFO:teuthology.orchestra.run.smithi099.stderr: 12050K .......... .......... .......... .......... .......... 7% 11.3M 10s 2024-03-30T13:12:22.259 INFO:teuthology.orchestra.run.smithi099.stderr: 12100K .......... .......... .......... .......... .......... 7% 6.58M 10s 2024-03-30T13:12:22.269 INFO:teuthology.orchestra.run.smithi099.stderr: 12150K .......... .......... .......... .......... .......... 7% 17.2M 10s 2024-03-30T13:12:22.269 INFO:teuthology.orchestra.run.smithi099.stderr: 12200K .......... .......... .......... .......... .......... 7% 9.56M 10s 2024-03-30T13:12:22.270 INFO:teuthology.orchestra.run.smithi099.stderr: 12250K .......... .......... .......... .......... .......... 7% 16.1M 10s 2024-03-30T13:12:22.272 INFO:teuthology.orchestra.run.smithi099.stderr: 12300K .......... .......... .......... .......... .......... 7% 23.6M 10s 2024-03-30T13:12:22.275 INFO:teuthology.orchestra.run.smithi099.stderr: 12350K .......... .......... .......... .......... .......... 7% 15.9M 10s 2024-03-30T13:12:22.282 INFO:teuthology.orchestra.run.smithi099.stderr: 12400K .......... .......... .......... .......... .......... 7% 18.3M 10s 2024-03-30T13:12:22.283 INFO:teuthology.orchestra.run.smithi099.stderr: 12450K .......... .......... .......... .......... .......... 7% 18.7M 10s 2024-03-30T13:12:22.283 INFO:teuthology.orchestra.run.smithi099.stderr: 12500K .......... .......... .......... .......... .......... 7% 16.3M 10s 2024-03-30T13:12:22.287 INFO:teuthology.orchestra.run.smithi099.stderr: 12550K .......... .......... .......... .......... .......... 7% 13.9M 10s 2024-03-30T13:12:22.289 INFO:teuthology.orchestra.run.smithi099.stderr: 12600K .......... .......... .......... .......... .......... 7% 21.1M 10s 2024-03-30T13:12:22.292 INFO:teuthology.orchestra.run.smithi099.stderr: 12650K .......... .......... .......... .......... .......... 7% 17.3M 10s 2024-03-30T13:12:22.295 INFO:teuthology.orchestra.run.smithi099.stderr: 12700K .......... .......... .......... .......... .......... 7% 18.2M 10s 2024-03-30T13:12:22.298 INFO:teuthology.orchestra.run.smithi099.stderr: 12750K .......... .......... .......... .......... .......... 7% 21.7M 10s 2024-03-30T13:12:22.301 INFO:teuthology.orchestra.run.smithi099.stderr: 12800K .......... .......... .......... .......... .......... 7% 16.5M 10s 2024-03-30T13:12:22.304 INFO:teuthology.orchestra.run.smithi099.stderr: 12850K .......... .......... .......... .......... .......... 7% 17.8M 10s 2024-03-30T13:12:22.305 INFO:teuthology.orchestra.run.smithi099.stderr: 12900K .......... .......... .......... .......... .......... 7% 23.2M 10s 2024-03-30T13:12:22.308 INFO:teuthology.orchestra.run.smithi099.stderr: 12950K .......... .......... .......... .......... .......... 7% 17.1M 10s 2024-03-30T13:12:22.311 INFO:teuthology.orchestra.run.smithi099.stderr: 13000K .......... .......... .......... .......... .......... 7% 19.6M 10s 2024-03-30T13:12:22.318 INFO:teuthology.orchestra.run.smithi099.stderr: 13050K .......... .......... .......... .......... .......... 7% 6.55M 10s 2024-03-30T13:12:22.321 INFO:teuthology.orchestra.run.smithi099.stderr: 13100K .......... .......... .......... .......... .......... 7% 15.3M 10s 2024-03-30T13:12:22.324 INFO:teuthology.orchestra.run.smithi099.stderr: 13150K .......... .......... .......... .......... .......... 7% 15.8M 10s 2024-03-30T13:12:22.328 INFO:teuthology.orchestra.run.smithi099.stderr: 13200K .......... .......... .......... .......... .......... 7% 11.8M 10s 2024-03-30T13:12:22.331 INFO:teuthology.orchestra.run.smithi099.stderr: 13250K .......... .......... .......... .......... .......... 7% 15.4M 10s 2024-03-30T13:12:22.339 INFO:teuthology.orchestra.run.smithi099.stderr: 13300K .......... .......... .......... .......... .......... 7% 10.4M 10s 2024-03-30T13:12:22.339 INFO:teuthology.orchestra.run.smithi099.stderr: 13350K .......... .......... .......... .......... .......... 7% 20.5M 10s 2024-03-30T13:12:22.342 INFO:teuthology.orchestra.run.smithi099.stderr: 13400K .......... .......... .......... .......... .......... 7% 14.7M 10s 2024-03-30T13:12:22.344 INFO:teuthology.orchestra.run.smithi099.stderr: 13450K .......... .......... .......... .......... .......... 8% 16.7M 10s 2024-03-30T13:12:22.348 INFO:teuthology.orchestra.run.smithi099.stderr: 13500K .......... .......... .......... .......... .......... 8% 14.4M 10s 2024-03-30T13:12:22.352 INFO:teuthology.orchestra.run.smithi099.stderr: 13550K .......... .......... .......... .......... .......... 8% 12.7M 10s 2024-03-30T13:12:22.355 INFO:teuthology.orchestra.run.smithi099.stderr: 13600K .......... .......... .......... .......... .......... 8% 14.2M 10s 2024-03-30T13:12:22.359 INFO:teuthology.orchestra.run.smithi099.stderr: 13650K .......... .......... .......... .......... .......... 8% 19.6M 10s 2024-03-30T13:12:22.361 INFO:teuthology.orchestra.run.smithi099.stderr: 13700K .......... .......... .......... .......... .......... 8% 14.6M 10s 2024-03-30T13:12:22.363 INFO:teuthology.orchestra.run.smithi099.stderr: 13750K .......... .......... .......... .......... .......... 8% 20.2M 10s 2024-03-30T13:12:22.367 INFO:teuthology.orchestra.run.smithi099.stderr: 13800K .......... .......... .......... .......... .......... 8% 14.1M 10s 2024-03-30T13:12:22.371 INFO:teuthology.orchestra.run.smithi099.stderr: 13850K .......... .......... .......... .......... .......... 8% 14.0M 10s 2024-03-30T13:12:22.375 INFO:teuthology.orchestra.run.smithi099.stderr: 13900K .......... .......... .......... .......... .......... 8% 17.2M 10s 2024-03-30T13:12:22.376 INFO:teuthology.orchestra.run.smithi099.stderr: 13950K .......... .......... .......... .......... .......... 8% 16.0M 10s 2024-03-30T13:12:22.382 INFO:teuthology.orchestra.run.smithi099.stderr: 14000K .......... .......... .......... .......... .......... 8% 16.0M 10s 2024-03-30T13:12:22.384 INFO:teuthology.orchestra.run.smithi099.stderr: 14050K .......... .......... .......... .......... .......... 8% 9.92M 10s 2024-03-30T13:12:22.389 INFO:teuthology.orchestra.run.smithi099.stderr: 14100K .......... .......... .......... .......... .......... 8% 17.4M 10s 2024-03-30T13:12:22.390 INFO:teuthology.orchestra.run.smithi099.stderr: 14150K .......... .......... .......... .......... .......... 8% 14.5M 10s 2024-03-30T13:12:22.393 INFO:teuthology.orchestra.run.smithi099.stderr: 14200K .......... .......... .......... .......... .......... 8% 20.1M 10s 2024-03-30T13:12:22.398 INFO:teuthology.orchestra.run.smithi099.stderr: 14250K .......... .......... .......... .......... .......... 8% 9.72M 10s 2024-03-30T13:12:22.401 INFO:teuthology.orchestra.run.smithi099.stderr: 14300K .......... .......... .......... .......... .......... 8% 16.1M 10s 2024-03-30T13:12:22.403 INFO:teuthology.orchestra.run.smithi099.stderr: 14350K .......... .......... .......... .......... .......... 8% 18.7M 10s 2024-03-30T13:12:22.408 INFO:teuthology.orchestra.run.smithi099.stderr: 14400K .......... .......... .......... .......... .......... 8% 11.4M 10s 2024-03-30T13:12:22.411 INFO:teuthology.orchestra.run.smithi099.stderr: 14450K .......... .......... .......... .......... .......... 8% 14.0M 10s 2024-03-30T13:12:22.415 INFO:teuthology.orchestra.run.smithi099.stderr: 14500K .......... .......... .......... .......... .......... 8% 12.9M 10s 2024-03-30T13:12:22.421 INFO:teuthology.orchestra.run.smithi099.stderr: 14550K .......... .......... .......... .......... .......... 8% 15.6M 10s 2024-03-30T13:12:22.421 INFO:teuthology.orchestra.run.smithi099.stderr: 14600K .......... .......... .......... .......... .......... 8% 14.4M 10s 2024-03-30T13:12:22.425 INFO:teuthology.orchestra.run.smithi099.stderr: 14650K .......... .......... .......... .......... .......... 8% 13.2M 10s 2024-03-30T13:12:22.428 INFO:teuthology.orchestra.run.smithi099.stderr: 14700K .......... .......... .......... .......... .......... 8% 15.5M 10s 2024-03-30T13:12:22.432 INFO:teuthology.orchestra.run.smithi099.stderr: 14750K .......... .......... .......... .......... .......... 8% 14.0M 10s 2024-03-30T13:12:22.434 INFO:teuthology.orchestra.run.smithi099.stderr: 14800K .......... .......... .......... .......... .......... 8% 18.0M 10s 2024-03-30T13:12:22.437 INFO:teuthology.orchestra.run.smithi099.stderr: 14850K .......... .......... .......... .......... .......... 8% 21.3M 10s 2024-03-30T13:12:22.441 INFO:teuthology.orchestra.run.smithi099.stderr: 14900K .......... .......... .......... .......... .......... 8% 11.8M 10s 2024-03-30T13:12:22.444 INFO:teuthology.orchestra.run.smithi099.stderr: 14950K .......... .......... .......... .......... .......... 8% 14.6M 10s 2024-03-30T13:12:22.448 INFO:teuthology.orchestra.run.smithi099.stderr: 15000K .......... .......... .......... .......... .......... 8% 14.4M 10s 2024-03-30T13:12:22.451 INFO:teuthology.orchestra.run.smithi099.stderr: 15050K .......... .......... .......... .......... .......... 8% 16.7M 10s 2024-03-30T13:12:22.453 INFO:teuthology.orchestra.run.smithi099.stderr: 15100K .......... .......... .......... .......... .......... 8% 20.2M 10s 2024-03-30T13:12:22.457 INFO:teuthology.orchestra.run.smithi099.stderr: 15150K .......... .......... .......... .......... .......... 9% 11.2M 10s 2024-03-30T13:12:22.460 INFO:teuthology.orchestra.run.smithi099.stderr: 15200K .......... .......... .......... .......... .......... 9% 16.4M 10s 2024-03-30T13:12:22.465 INFO:teuthology.orchestra.run.smithi099.stderr: 15250K .......... .......... .......... .......... .......... 9% 10.7M 10s 2024-03-30T13:12:22.468 INFO:teuthology.orchestra.run.smithi099.stderr: 15300K .......... .......... .......... .......... .......... 9% 18.6M 10s 2024-03-30T13:12:22.471 INFO:teuthology.orchestra.run.smithi099.stderr: 15350K .......... .......... .......... .......... .......... 9% 17.2M 10s 2024-03-30T13:12:22.474 INFO:teuthology.orchestra.run.smithi099.stderr: 15400K .......... .......... .......... .......... .......... 9% 13.7M 10s 2024-03-30T13:12:22.477 INFO:teuthology.orchestra.run.smithi099.stderr: 15450K .......... .......... .......... .......... .......... 9% 16.0M 10s 2024-03-30T13:12:22.482 INFO:teuthology.orchestra.run.smithi099.stderr: 15500K .......... .......... .......... .......... .......... 9% 12.7M 10s 2024-03-30T13:12:22.485 INFO:teuthology.orchestra.run.smithi099.stderr: 15550K .......... .......... .......... .......... .......... 9% 14.1M 10s 2024-03-30T13:12:22.487 INFO:teuthology.orchestra.run.smithi099.stderr: 15600K .......... .......... .......... .......... .......... 9% 18.3M 10s 2024-03-30T13:12:22.492 INFO:teuthology.orchestra.run.smithi099.stderr: 15650K .......... .......... .......... .......... .......... 9% 10.8M 10s 2024-03-30T13:12:22.494 INFO:teuthology.orchestra.run.smithi099.stderr: 15700K .......... .......... .......... .......... .......... 9% 21.3M 10s 2024-03-30T13:12:22.497 INFO:teuthology.orchestra.run.smithi099.stderr: 15750K .......... .......... .......... .......... .......... 9% 15.0M 10s 2024-03-30T13:12:22.500 INFO:teuthology.orchestra.run.smithi099.stderr: 15800K .......... .......... .......... .......... .......... 9% 16.1M 10s 2024-03-30T13:12:22.506 INFO:teuthology.orchestra.run.smithi099.stderr: 15850K .......... .......... .......... .......... .......... 9% 13.4M 10s 2024-03-30T13:12:22.508 INFO:teuthology.orchestra.run.smithi099.stderr: 15900K .......... .......... .......... .......... .......... 9% 12.6M 10s 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi099.stderr: 15950K .......... .......... .......... .......... .......... 9% 18.4M 10s 2024-03-30T13:12:22.514 INFO:teuthology.orchestra.run.smithi099.stderr: 16000K .......... .......... .......... .......... .......... 9% 12.1M 10s 2024-03-30T13:12:22.518 INFO:teuthology.orchestra.run.smithi099.stderr: 16050K .......... .......... .......... .......... .......... 9% 15.1M 10s 2024-03-30T13:12:22.523 INFO:teuthology.orchestra.run.smithi099.stderr: 16100K .......... .......... .......... .......... .......... 9% 12.8M 10s 2024-03-30T13:12:22.526 INFO:teuthology.orchestra.run.smithi099.stderr: 16150K .......... .......... .......... .......... .......... 9% 11.4M 10s 2024-03-30T13:12:22.528 INFO:teuthology.orchestra.run.smithi099.stderr: 16200K .......... .......... .......... .......... .......... 9% 17.4M 10s 2024-03-30T13:12:22.532 INFO:teuthology.orchestra.run.smithi099.stderr: 16250K .......... .......... .......... .......... .......... 9% 16.2M 10s 2024-03-30T13:12:22.535 INFO:teuthology.orchestra.run.smithi099.stderr: 16300K .......... .......... .......... .......... .......... 9% 15.3M 10s 2024-03-30T13:12:22.539 INFO:teuthology.orchestra.run.smithi099.stderr: 16350K .......... .......... .......... .......... .......... 9% 11.0M 10s 2024-03-30T13:12:22.542 INFO:teuthology.orchestra.run.smithi099.stderr: 16400K .......... .......... .......... .......... .......... 9% 17.5M 10s 2024-03-30T13:12:22.546 INFO:teuthology.orchestra.run.smithi099.stderr: 16450K .......... .......... .......... .......... .......... 9% 13.1M 10s 2024-03-30T13:12:22.549 INFO:teuthology.orchestra.run.smithi099.stderr: 16500K .......... .......... .......... .......... .......... 9% 16.0M 10s 2024-03-30T13:12:22.552 INFO:teuthology.orchestra.run.smithi099.stderr: 16550K .......... .......... .......... .......... .......... 9% 16.5M 10s 2024-03-30T13:12:22.555 INFO:teuthology.orchestra.run.smithi099.stderr: 16600K .......... .......... .......... .......... .......... 9% 13.2M 10s 2024-03-30T13:12:22.558 INFO:teuthology.orchestra.run.smithi099.stderr: 16650K .......... .......... .......... .......... .......... 9% 16.1M 10s 2024-03-30T13:12:22.561 INFO:teuthology.orchestra.run.smithi099.stderr: 16700K .......... .......... .......... .......... .......... 9% 18.1M 10s 2024-03-30T13:12:22.565 INFO:teuthology.orchestra.run.smithi099.stderr: 16750K .......... .......... .......... .......... .......... 9% 12.5M 10s 2024-03-30T13:12:22.568 INFO:teuthology.orchestra.run.smithi099.stderr: 16800K .......... .......... .......... .......... .......... 9% 15.5M 10s 2024-03-30T13:12:22.572 INFO:teuthology.orchestra.run.smithi099.stderr: 16850K .......... .......... .......... .......... .......... 10% 13.7M 10s 2024-03-30T13:12:22.575 INFO:teuthology.orchestra.run.smithi099.stderr: 16900K .......... .......... .......... .......... .......... 10% 16.2M 10s 2024-03-30T13:12:22.578 INFO:teuthology.orchestra.run.smithi099.stderr: 16950K .......... .......... .......... .......... .......... 10% 17.2M 10s 2024-03-30T13:12:22.581 INFO:teuthology.orchestra.run.smithi099.stderr: 17000K .......... .......... .......... .......... .......... 10% 12.9M 10s 2024-03-30T13:12:22.584 INFO:teuthology.orchestra.run.smithi099.stderr: 17050K .......... .......... .......... .......... .......... 10% 17.6M 10s 2024-03-30T13:12:22.589 INFO:teuthology.orchestra.run.smithi099.stderr: 17100K .......... .......... .......... .......... .......... 10% 10.1M 10s 2024-03-30T13:12:22.593 INFO:teuthology.orchestra.run.smithi099.stderr: 17150K .......... .......... .......... .......... .......... 10% 14.4M 10s 2024-03-30T13:12:22.595 INFO:teuthology.orchestra.run.smithi099.stderr: 17200K .......... .......... .......... .......... .......... 10% 15.3M 10s 2024-03-30T13:12:22.599 INFO:teuthology.orchestra.run.smithi099.stderr: 17250K .......... .......... .......... .......... .......... 10% 12.9M 10s 2024-03-30T13:12:22.603 INFO:teuthology.orchestra.run.smithi099.stderr: 17300K .......... .......... .......... .......... .......... 10% 14.5M 10s 2024-03-30T13:12:22.607 INFO:teuthology.orchestra.run.smithi099.stderr: 17350K .......... .......... .......... .......... .......... 10% 12.5M 10s 2024-03-30T13:12:22.610 INFO:teuthology.orchestra.run.smithi099.stderr: 17400K .......... .......... .......... .......... .......... 10% 16.2M 10s 2024-03-30T13:12:22.615 INFO:teuthology.orchestra.run.smithi099.stderr: 17450K .......... .......... .......... .......... .......... 10% 14.3M 10s 2024-03-30T13:12:22.616 INFO:teuthology.orchestra.run.smithi099.stderr: 17500K .......... .......... .......... .......... .......... 10% 16.4M 10s 2024-03-30T13:12:22.621 INFO:teuthology.orchestra.run.smithi099.stderr: 17550K .......... .......... .......... .......... .......... 10% 9.89M 10s 2024-03-30T13:12:22.623 INFO:teuthology.orchestra.run.smithi099.stderr: 17600K .......... .......... .......... .......... .......... 10% 19.8M 10s 2024-03-30T13:12:22.627 INFO:teuthology.orchestra.run.smithi099.stderr: 17650K .......... .......... .......... .......... .......... 10% 13.2M 10s 2024-03-30T13:12:22.630 INFO:teuthology.orchestra.run.smithi099.stderr: 17700K .......... .......... .......... .......... .......... 10% 20.3M 10s 2024-03-30T13:12:22.633 INFO:teuthology.orchestra.run.smithi099.stderr: 17750K .......... .......... .......... .......... .......... 10% 13.0M 10s 2024-03-30T13:12:22.636 INFO:teuthology.orchestra.run.smithi099.stderr: 17800K .......... .......... .......... .......... .......... 10% 17.3M 10s 2024-03-30T13:12:22.639 INFO:teuthology.orchestra.run.smithi099.stderr: 17850K .......... .......... .......... .......... .......... 10% 15.6M 10s 2024-03-30T13:12:22.642 INFO:teuthology.orchestra.run.smithi099.stderr: 17900K .......... .......... .......... .......... .......... 10% 20.4M 10s 2024-03-30T13:12:22.645 INFO:teuthology.orchestra.run.smithi099.stderr: 17950K .......... .......... .......... .......... .......... 10% 14.1M 10s 2024-03-30T13:12:22.650 INFO:teuthology.orchestra.run.smithi099.stderr: 18000K .......... .......... .......... .......... .......... 10% 10.9M 10s 2024-03-30T13:12:22.653 INFO:teuthology.orchestra.run.smithi099.stderr: 18050K .......... .......... .......... .......... .......... 10% 19.1M 10s 2024-03-30T13:12:22.656 INFO:teuthology.orchestra.run.smithi099.stderr: 18100K .......... .......... .......... .......... .......... 10% 13.2M 10s 2024-03-30T13:12:22.659 INFO:teuthology.orchestra.run.smithi099.stderr: 18150K .......... .......... .......... .......... .......... 10% 15.3M 10s 2024-03-30T13:12:22.662 INFO:teuthology.orchestra.run.smithi099.stderr: 18200K .......... .......... .......... .......... .......... 10% 14.7M 10s 2024-03-30T13:12:22.666 INFO:teuthology.orchestra.run.smithi099.stderr: 18250K .......... .......... .......... .......... .......... 10% 12.6M 10s 2024-03-30T13:12:22.671 INFO:teuthology.orchestra.run.smithi099.stderr: 18300K .......... .......... .......... .......... .......... 10% 11.1M 10s 2024-03-30T13:12:22.674 INFO:teuthology.orchestra.run.smithi099.stderr: 18350K .......... .......... .......... .......... .......... 10% 15.3M 10s 2024-03-30T13:12:22.677 INFO:teuthology.orchestra.run.smithi099.stderr: 18400K .......... .......... .......... .......... .......... 10% 15.1M 10s 2024-03-30T13:12:22.681 INFO:teuthology.orchestra.run.smithi099.stderr: 18450K .......... .......... .......... .......... .......... 10% 12.0M 10s 2024-03-30T13:12:22.685 INFO:teuthology.orchestra.run.smithi099.stderr: 18500K .......... .......... .......... .......... .......... 11% 15.6M 10s 2024-03-30T13:12:22.690 INFO:teuthology.orchestra.run.smithi099.stderr: 18550K .......... .......... .......... .......... .......... 11% 10.1M 10s 2024-03-30T13:12:22.691 INFO:teuthology.orchestra.run.smithi099.stderr: 18600K .......... .......... .......... .......... .......... 11% 20.8M 10s 2024-03-30T13:12:22.694 INFO:teuthology.orchestra.run.smithi099.stderr: 18650K .......... .......... .......... .......... .......... 11% 18.8M 10s 2024-03-30T13:12:22.698 INFO:teuthology.orchestra.run.smithi099.stderr: 18700K .......... .......... .......... .......... .......... 11% 13.0M 10s 2024-03-30T13:12:22.702 INFO:teuthology.orchestra.run.smithi099.stderr: 18750K .......... .......... .......... .......... .......... 11% 16.9M 10s 2024-03-30T13:12:22.705 INFO:teuthology.orchestra.run.smithi099.stderr: 18800K .......... .......... .......... .......... .......... 11% 11.4M 10s 2024-03-30T13:12:22.709 INFO:teuthology.orchestra.run.smithi099.stderr: 18850K .......... .......... .......... .......... .......... 11% 15.2M 10s 2024-03-30T13:12:22.712 INFO:teuthology.orchestra.run.smithi099.stderr: 18900K .......... .......... .......... .......... .......... 11% 14.1M 10s 2024-03-30T13:12:22.716 INFO:teuthology.orchestra.run.smithi099.stderr: 18950K .......... .......... .......... .......... .......... 11% 19.0M 10s 2024-03-30T13:12:22.719 INFO:teuthology.orchestra.run.smithi099.stderr: 19000K .......... .......... .......... .......... .......... 11% 13.0M 10s 2024-03-30T13:12:22.720 INFO:teuthology.orchestra.run.smithi099.stderr: 19050K .......... .......... .......... .......... .......... 11% 19.9M 10s 2024-03-30T13:12:22.724 INFO:teuthology.orchestra.run.smithi099.stderr: 19100K .......... .......... .......... .......... .......... 11% 15.9M 10s 2024-03-30T13:12:22.726 INFO:teuthology.orchestra.run.smithi099.stderr: 19150K .......... .......... .......... .......... .......... 11% 21.5M 10s 2024-03-30T13:12:22.731 INFO:teuthology.orchestra.run.smithi099.stderr: 19200K .......... .......... .......... .......... .......... 11% 11.3M 10s 2024-03-30T13:12:22.733 INFO:teuthology.orchestra.run.smithi099.stderr: 19250K .......... .......... .......... .......... .......... 11% 16.4M 10s 2024-03-30T13:12:22.737 INFO:teuthology.orchestra.run.smithi099.stderr: 19300K .......... .......... .......... .......... .......... 11% 11.7M 10s 2024-03-30T13:12:22.741 INFO:teuthology.orchestra.run.smithi099.stderr: 19350K .......... .......... .......... .......... .......... 11% 14.2M 10s 2024-03-30T13:12:22.745 INFO:teuthology.orchestra.run.smithi099.stderr: 19400K .......... .......... .......... .......... .......... 11% 14.9M 10s 2024-03-30T13:12:22.748 INFO:teuthology.orchestra.run.smithi099.stderr: 19450K .......... .......... .......... .......... .......... 11% 11.0M 10s 2024-03-30T13:12:22.752 INFO:teuthology.orchestra.run.smithi099.stderr: 19500K .......... .......... .......... .......... .......... 11% 18.3M 10s 2024-03-30T13:12:22.755 INFO:teuthology.orchestra.run.smithi099.stderr: 19550K .......... .......... .......... .......... .......... 11% 11.5M 10s 2024-03-30T13:12:22.759 INFO:teuthology.orchestra.run.smithi099.stderr: 19600K .......... .......... .......... .......... .......... 11% 16.9M 10s 2024-03-30T13:12:22.760 INFO:teuthology.orchestra.run.smithi099.stderr: 19650K .......... .......... .......... .......... .......... 11% 22.0M 10s 2024-03-30T13:12:22.766 INFO:teuthology.orchestra.run.smithi099.stderr: 19700K .......... .......... .......... .......... .......... 11% 9.43M 10s 2024-03-30T13:12:22.770 INFO:teuthology.orchestra.run.smithi099.stderr: 19750K .......... .......... .......... .......... .......... 11% 12.0M 10s 2024-03-30T13:12:22.774 INFO:teuthology.orchestra.run.smithi099.stderr: 19800K .......... .......... .......... .......... .......... 11% 12.8M 10s 2024-03-30T13:12:22.776 INFO:teuthology.orchestra.run.smithi099.stderr: 19850K .......... .......... .......... .......... .......... 11% 19.6M 10s 2024-03-30T13:12:22.779 INFO:teuthology.orchestra.run.smithi099.stderr: 19900K .......... .......... .......... .......... .......... 11% 16.3M 10s 2024-03-30T13:12:22.782 INFO:teuthology.orchestra.run.smithi099.stderr: 19950K .......... .......... .......... .......... .......... 11% 15.3M 10s 2024-03-30T13:12:22.786 INFO:teuthology.orchestra.run.smithi099.stderr: 20000K .......... .......... .......... .......... .......... 11% 15.0M 10s 2024-03-30T13:12:22.788 INFO:teuthology.orchestra.run.smithi099.stderr: 20050K .......... .......... .......... .......... .......... 11% 20.1M 10s 2024-03-30T13:12:22.792 INFO:teuthology.orchestra.run.smithi099.stderr: 20100K .......... .......... .......... .......... .......... 11% 13.2M 10s 2024-03-30T13:12:22.795 INFO:teuthology.orchestra.run.smithi099.stderr: 20150K .......... .......... .......... .......... .......... 11% 15.1M 10s 2024-03-30T13:12:22.799 INFO:teuthology.orchestra.run.smithi099.stderr: 20200K .......... .......... .......... .......... .......... 12% 12.5M 10s 2024-03-30T13:12:22.802 INFO:teuthology.orchestra.run.smithi099.stderr: 20250K .......... .......... .......... .......... .......... 12% 15.0M 10s 2024-03-30T13:12:22.805 INFO:teuthology.orchestra.run.smithi099.stderr: 20300K .......... .......... .......... .......... .......... 12% 18.1M 10s 2024-03-30T13:12:22.808 INFO:teuthology.orchestra.run.smithi099.stderr: 20350K .......... .......... .......... .......... .......... 12% 15.0M 10s 2024-03-30T13:12:22.810 INFO:teuthology.orchestra.run.smithi099.stderr: 20400K .......... .......... .......... .......... .......... 12% 20.0M 10s 2024-03-30T13:12:22.814 INFO:teuthology.orchestra.run.smithi099.stderr: 20450K .......... .......... .......... .......... .......... 12% 12.1M 10s 2024-03-30T13:12:22.818 INFO:teuthology.orchestra.run.smithi099.stderr: 20500K .......... .......... .......... .......... .......... 12% 11.8M 10s 2024-03-30T13:12:22.822 INFO:teuthology.orchestra.run.smithi099.stderr: 20550K .......... .......... .......... .......... .......... 12% 15.5M 10s 2024-03-30T13:12:22.824 INFO:teuthology.orchestra.run.smithi099.stderr: 20600K .......... .......... .......... .......... .......... 12% 18.5M 10s 2024-03-30T13:12:22.827 INFO:teuthology.orchestra.run.smithi099.stderr: 20650K .......... .......... .......... .......... .......... 12% 14.8M 10s 2024-03-30T13:12:22.833 INFO:teuthology.orchestra.run.smithi099.stderr: 20700K .......... .......... .......... .......... .......... 12% 9.86M 10s 2024-03-30T13:12:22.837 INFO:teuthology.orchestra.run.smithi099.stderr: 20750K .......... .......... .......... .......... .......... 12% 11.4M 10s 2024-03-30T13:12:22.840 INFO:teuthology.orchestra.run.smithi099.stderr: 20800K .......... .......... .......... .......... .......... 12% 13.4M 10s 2024-03-30T13:12:22.844 INFO:teuthology.orchestra.run.smithi099.stderr: 20850K .......... .......... .......... .......... .......... 12% 15.2M 10s 2024-03-30T13:12:22.848 INFO:teuthology.orchestra.run.smithi099.stderr: 20900K .......... .......... .......... .......... .......... 12% 11.2M 10s 2024-03-30T13:12:22.851 INFO:teuthology.orchestra.run.smithi099.stderr: 20950K .......... .......... .......... .......... .......... 12% 19.1M 10s 2024-03-30T13:12:22.854 INFO:teuthology.orchestra.run.smithi099.stderr: 21000K .......... .......... .......... .......... .......... 12% 12.7M 10s 2024-03-30T13:12:22.857 INFO:teuthology.orchestra.run.smithi099.stderr: 21050K .......... .......... .......... .......... .......... 12% 17.5M 10s 2024-03-30T13:12:22.861 INFO:teuthology.orchestra.run.smithi099.stderr: 21100K .......... .......... .......... .......... .......... 12% 14.0M 10s 2024-03-30T13:12:22.865 INFO:teuthology.orchestra.run.smithi099.stderr: 21150K .......... .......... .......... .......... .......... 12% 12.7M 10s 2024-03-30T13:12:22.867 INFO:teuthology.orchestra.run.smithi099.stderr: 21200K .......... .......... .......... .......... .......... 12% 20.7M 10s 2024-03-30T13:12:22.870 INFO:teuthology.orchestra.run.smithi099.stderr: 21250K .......... .......... .......... .......... .......... 12% 15.5M 10s 2024-03-30T13:12:22.873 INFO:teuthology.orchestra.run.smithi099.stderr: 21300K .......... .......... .......... .......... .......... 12% 18.3M 10s 2024-03-30T13:12:22.876 INFO:teuthology.orchestra.run.smithi099.stderr: 21350K .......... .......... .......... .......... .......... 12% 16.1M 10s 2024-03-30T13:12:22.880 INFO:teuthology.orchestra.run.smithi099.stderr: 21400K .......... .......... .......... .......... .......... 12% 11.7M 10s 2024-03-30T13:12:22.883 INFO:teuthology.orchestra.run.smithi099.stderr: 21450K .......... .......... .......... .......... .......... 12% 16.9M 10s 2024-03-30T13:12:22.887 INFO:teuthology.orchestra.run.smithi099.stderr: 21500K .......... .......... .......... .......... .......... 12% 13.5M 10s 2024-03-30T13:12:22.889 INFO:teuthology.orchestra.run.smithi099.stderr: 21550K .......... .......... .......... .......... .......... 12% 18.6M 10s 2024-03-30T13:12:22.893 INFO:teuthology.orchestra.run.smithi099.stderr: 21600K .......... .......... .......... .......... .......... 12% 13.0M 10s 2024-03-30T13:12:22.897 INFO:teuthology.orchestra.run.smithi099.stderr: 21650K .......... .......... .......... .......... .......... 12% 13.0M 10s 2024-03-30T13:12:22.899 INFO:teuthology.orchestra.run.smithi099.stderr: 21700K .......... .......... .......... .......... .......... 12% 18.7M 10s 2024-03-30T13:12:22.903 INFO:teuthology.orchestra.run.smithi099.stderr: 21750K .......... .......... .......... .......... .......... 12% 13.6M 10s 2024-03-30T13:12:22.907 INFO:teuthology.orchestra.run.smithi099.stderr: 21800K .......... .......... .......... .......... .......... 12% 11.8M 10s 2024-03-30T13:12:22.910 INFO:teuthology.orchestra.run.smithi099.stderr: 21850K .......... .......... .......... .......... .......... 12% 15.8M 10s 2024-03-30T13:12:22.914 INFO:teuthology.orchestra.run.smithi099.stderr: 21900K .......... .......... .......... .......... .......... 13% 12.0M 10s 2024-03-30T13:12:22.918 INFO:teuthology.orchestra.run.smithi099.stderr: 21950K .......... .......... .......... .......... .......... 13% 11.5M 10s 2024-03-30T13:12:22.921 INFO:teuthology.orchestra.run.smithi099.stderr: 22000K .......... .......... .......... .......... .......... 13% 16.1M 10s 2024-03-30T13:12:22.925 INFO:teuthology.orchestra.run.smithi099.stderr: 22050K .......... .......... .......... .......... .......... 13% 13.7M 10s 2024-03-30T13:12:22.929 INFO:teuthology.orchestra.run.smithi099.stderr: 22100K .......... .......... .......... .......... .......... 13% 15.4M 10s 2024-03-30T13:12:22.932 INFO:teuthology.orchestra.run.smithi099.stderr: 22150K .......... .......... .......... .......... .......... 13% 11.5M 10s 2024-03-30T13:12:22.936 INFO:teuthology.orchestra.run.smithi099.stderr: 22200K .......... .......... .......... .......... .......... 13% 13.4M 10s 2024-03-30T13:12:22.939 INFO:teuthology.orchestra.run.smithi099.stderr: 22250K .......... .......... .......... .......... .......... 13% 16.0M 10s 2024-03-30T13:12:22.943 INFO:teuthology.orchestra.run.smithi099.stderr: 22300K .......... .......... .......... .......... .......... 13% 13.1M 10s 2024-03-30T13:12:22.946 INFO:teuthology.orchestra.run.smithi099.stderr: 22350K .......... .......... .......... .......... .......... 13% 18.7M 10s 2024-03-30T13:12:22.949 INFO:teuthology.orchestra.run.smithi099.stderr: 22400K .......... .......... .......... .......... .......... 13% 12.9M 10s 2024-03-30T13:12:22.952 INFO:teuthology.orchestra.run.smithi099.stderr: 22450K .......... .......... .......... .......... .......... 13% 17.9M 10s 2024-03-30T13:12:22.955 INFO:teuthology.orchestra.run.smithi099.stderr: 22500K .......... .......... .......... .......... .......... 13% 14.3M 10s 2024-03-30T13:12:22.959 INFO:teuthology.orchestra.run.smithi099.stderr: 22550K .......... .......... .......... .......... .......... 13% 15.9M 10s 2024-03-30T13:12:22.963 INFO:teuthology.orchestra.run.smithi099.stderr: 22600K .......... .......... .......... .......... .......... 13% 11.1M 10s 2024-03-30T13:12:22.965 INFO:teuthology.orchestra.run.smithi099.stderr: 22650K .......... .......... .......... .......... .......... 13% 22.2M 10s 2024-03-30T13:12:22.968 INFO:teuthology.orchestra.run.smithi099.stderr: 22700K .......... .......... .......... .......... .......... 13% 14.2M 10s 2024-03-30T13:12:22.972 INFO:teuthology.orchestra.run.smithi099.stderr: 22750K .......... .......... .......... .......... .......... 13% 14.1M 10s 2024-03-30T13:12:22.976 INFO:teuthology.orchestra.run.smithi099.stderr: 22800K .......... .......... .......... .......... .......... 13% 12.7M 10s 2024-03-30T13:12:22.978 INFO:teuthology.orchestra.run.smithi099.stderr: 22850K .......... .......... .......... .......... .......... 13% 18.3M 10s 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi099.stderr: 22900K .......... .......... .......... .......... .......... 13% 12.8M 10s 2024-03-30T13:12:22.986 INFO:teuthology.orchestra.run.smithi099.stderr: 22950K .......... .......... .......... .......... .......... 13% 14.9M 10s 2024-03-30T13:12:22.989 INFO:teuthology.orchestra.run.smithi099.stderr: 23000K .......... .......... .......... .......... .......... 13% 14.5M 10s 2024-03-30T13:12:22.993 INFO:teuthology.orchestra.run.smithi099.stderr: 23050K .......... .......... .......... .......... .......... 13% 13.1M 10s 2024-03-30T13:12:22.995 INFO:teuthology.orchestra.run.smithi099.stderr: 23100K .......... .......... .......... .......... .......... 13% 18.3M 10s 2024-03-30T13:12:23.000 INFO:teuthology.orchestra.run.smithi099.stderr: 23150K .......... .......... .......... .......... .......... 13% 11.4M 10s 2024-03-30T13:12:23.003 INFO:teuthology.orchestra.run.smithi099.stderr: 23200K .......... .......... .......... .......... .......... 13% 15.2M 10s 2024-03-30T13:12:23.006 INFO:teuthology.orchestra.run.smithi099.stderr: 23250K .......... .......... .......... .......... .......... 13% 13.8M 10s 2024-03-30T13:12:23.011 INFO:teuthology.orchestra.run.smithi099.stderr: 23300K .......... .......... .......... .......... .......... 13% 12.0M 10s 2024-03-30T13:12:23.015 INFO:teuthology.orchestra.run.smithi099.stderr: 23350K .......... .......... .......... .......... .......... 13% 12.0M 10s 2024-03-30T13:12:23.017 INFO:teuthology.orchestra.run.smithi099.stderr: 23400K .......... .......... .......... .......... .......... 13% 20.8M 10s 2024-03-30T13:12:23.022 INFO:teuthology.orchestra.run.smithi099.stderr: 23450K .......... .......... .......... .......... .......... 13% 10.7M 10s 2024-03-30T13:12:23.024 INFO:teuthology.orchestra.run.smithi099.stderr: 23500K .......... .......... .......... .......... .......... 13% 18.7M 10s 2024-03-30T13:12:23.028 INFO:teuthology.orchestra.run.smithi099.stderr: 23550K .......... .......... .......... .......... .......... 14% 11.8M 10s 2024-03-30T13:12:23.031 INFO:teuthology.orchestra.run.smithi099.stderr: 23600K .......... .......... .......... .......... .......... 14% 18.6M 10s 2024-03-30T13:12:23.034 INFO:teuthology.orchestra.run.smithi099.stderr: 23650K .......... .......... .......... .......... .......... 14% 14.5M 10s 2024-03-30T13:12:23.037 INFO:teuthology.orchestra.run.smithi099.stderr: 23700K .......... .......... .......... .......... .......... 14% 17.3M 10s 2024-03-30T13:12:23.041 INFO:teuthology.orchestra.run.smithi099.stderr: 23750K .......... .......... .......... .......... .......... 14% 16.9M 10s 2024-03-30T13:12:23.044 INFO:teuthology.orchestra.run.smithi099.stderr: 23800K .......... .......... .......... .......... .......... 14% 14.8M 10s 2024-03-30T13:12:23.047 INFO:teuthology.orchestra.run.smithi099.stderr: 23850K .......... .......... .......... .......... .......... 14% 11.8M 10s 2024-03-30T13:12:23.051 INFO:teuthology.orchestra.run.smithi099.stderr: 23900K .......... .......... .......... .......... .......... 14% 14.7M 10s 2024-03-30T13:12:23.054 INFO:teuthology.orchestra.run.smithi099.stderr: 23950K .......... .......... .......... .......... .......... 14% 16.1M 10s 2024-03-30T13:12:23.057 INFO:teuthology.orchestra.run.smithi099.stderr: 24000K .......... .......... .......... .......... .......... 14% 15.1M 10s 2024-03-30T13:12:23.062 INFO:teuthology.orchestra.run.smithi099.stderr: 24050K .......... .......... .......... .......... .......... 14% 10.3M 10s 2024-03-30T13:12:23.065 INFO:teuthology.orchestra.run.smithi099.stderr: 24100K .......... .......... .......... .......... .......... 14% 15.6M 10s 2024-03-30T13:12:23.067 INFO:teuthology.orchestra.run.smithi099.stderr: 24150K .......... .......... .......... .......... .......... 14% 20.1M 10s 2024-03-30T13:12:23.071 INFO:teuthology.orchestra.run.smithi099.stderr: 24200K .......... .......... .......... .......... .......... 14% 14.2M 10s 2024-03-30T13:12:23.075 INFO:teuthology.orchestra.run.smithi099.stderr: 24250K .......... .......... .......... .......... .......... 14% 14.4M 10s 2024-03-30T13:12:23.080 INFO:teuthology.orchestra.run.smithi099.stderr: 24300K .......... .......... .......... .......... .......... 14% 11.2M 10s 2024-03-30T13:12:23.083 INFO:teuthology.orchestra.run.smithi099.stderr: 24350K .......... .......... .......... .......... .......... 14% 13.6M 10s 2024-03-30T13:12:23.085 INFO:teuthology.orchestra.run.smithi099.stderr: 24400K .......... .......... .......... .......... .......... 14% 15.7M 10s 2024-03-30T13:12:23.088 INFO:teuthology.orchestra.run.smithi099.stderr: 24450K .......... .......... .......... .......... .......... 14% 16.4M 10s 2024-03-30T13:12:23.093 INFO:teuthology.orchestra.run.smithi099.stderr: 24500K .......... .......... .......... .......... .......... 14% 9.98M 10s 2024-03-30T13:12:23.096 INFO:teuthology.orchestra.run.smithi099.stderr: 24550K .......... .......... .......... .......... .......... 14% 18.6M 10s 2024-03-30T13:12:23.099 INFO:teuthology.orchestra.run.smithi099.stderr: 24600K .......... .......... .......... .......... .......... 14% 12.9M 10s 2024-03-30T13:12:23.102 INFO:teuthology.orchestra.run.smithi099.stderr: 24650K .......... .......... .......... .......... .......... 14% 18.1M 10s 2024-03-30T13:12:23.106 INFO:teuthology.orchestra.run.smithi099.stderr: 24700K .......... .......... .......... .......... .......... 14% 13.3M 10s 2024-03-30T13:12:23.110 INFO:teuthology.orchestra.run.smithi099.stderr: 24750K .......... .......... .......... .......... .......... 14% 11.1M 10s 2024-03-30T13:12:23.113 INFO:teuthology.orchestra.run.smithi099.stderr: 24800K .......... .......... .......... .......... .......... 14% 16.5M 10s 2024-03-30T13:12:23.116 INFO:teuthology.orchestra.run.smithi099.stderr: 24850K .......... .......... .......... .......... .......... 14% 15.3M 10s 2024-03-30T13:12:23.120 INFO:teuthology.orchestra.run.smithi099.stderr: 24900K .......... .......... .......... .......... .......... 14% 13.8M 10s 2024-03-30T13:12:23.123 INFO:teuthology.orchestra.run.smithi099.stderr: 24950K .......... .......... .......... .......... .......... 14% 16.1M 10s 2024-03-30T13:12:23.126 INFO:teuthology.orchestra.run.smithi099.stderr: 25000K .......... .......... .......... .......... .......... 14% 15.2M 10s 2024-03-30T13:12:23.130 INFO:teuthology.orchestra.run.smithi099.stderr: 25050K .......... .......... .......... .......... .......... 14% 13.3M 10s 2024-03-30T13:12:23.133 INFO:teuthology.orchestra.run.smithi099.stderr: 25100K .......... .......... .......... .......... .......... 14% 17.2M 10s 2024-03-30T13:12:23.136 INFO:teuthology.orchestra.run.smithi099.stderr: 25150K .......... .......... .......... .......... .......... 14% 14.5M 10s 2024-03-30T13:12:23.138 INFO:teuthology.orchestra.run.smithi099.stderr: 25200K .......... .......... .......... .......... .......... 14% 19.1M 10s 2024-03-30T13:12:23.143 INFO:teuthology.orchestra.run.smithi099.stderr: 25250K .......... .......... .......... .......... .......... 15% 10.2M 10s 2024-03-30T13:12:23.146 INFO:teuthology.orchestra.run.smithi099.stderr: 25300K .......... .......... .......... .......... .......... 15% 18.6M 10s 2024-03-30T13:12:23.151 INFO:teuthology.orchestra.run.smithi099.stderr: 25350K .......... .......... .......... .......... .......... 15% 11.3M 10s 2024-03-30T13:12:23.153 INFO:teuthology.orchestra.run.smithi099.stderr: 25400K .......... .......... .......... .......... .......... 15% 17.4M 10s 2024-03-30T13:12:23.156 INFO:teuthology.orchestra.run.smithi099.stderr: 25450K .......... .......... .......... .......... .......... 15% 14.6M 10s 2024-03-30T13:12:23.161 INFO:teuthology.orchestra.run.smithi099.stderr: 25500K .......... .......... .......... .......... .......... 15% 10.7M 10s 2024-03-30T13:12:23.165 INFO:teuthology.orchestra.run.smithi099.stderr: 25550K .......... .......... .......... .......... .......... 15% 14.1M 10s 2024-03-30T13:12:23.167 INFO:teuthology.orchestra.run.smithi099.stderr: 25600K .......... .......... .......... .......... .......... 15% 22.6M 10s 2024-03-30T13:12:23.171 INFO:teuthology.orchestra.run.smithi099.stderr: 25650K .......... .......... .......... .......... .......... 15% 12.5M 10s 2024-03-30T13:12:23.174 INFO:teuthology.orchestra.run.smithi099.stderr: 25700K .......... .......... .......... .......... .......... 15% 17.9M 10s 2024-03-30T13:12:23.178 INFO:teuthology.orchestra.run.smithi099.stderr: 25750K .......... .......... .......... .......... .......... 15% 10.8M 10s 2024-03-30T13:12:23.181 INFO:teuthology.orchestra.run.smithi099.stderr: 25800K .......... .......... .......... .......... .......... 15% 18.0M 10s 2024-03-30T13:12:23.184 INFO:teuthology.orchestra.run.smithi099.stderr: 25850K .......... .......... .......... .......... .......... 15% 13.5M 10s 2024-03-30T13:12:23.187 INFO:teuthology.orchestra.run.smithi099.stderr: 25900K .......... .......... .......... .......... .......... 15% 14.7M 10s 2024-03-30T13:12:23.192 INFO:teuthology.orchestra.run.smithi099.stderr: 25950K .......... .......... .......... .......... .......... 15% 14.7M 10s 2024-03-30T13:12:23.195 INFO:teuthology.orchestra.run.smithi099.stderr: 26000K .......... .......... .......... .......... .......... 15% 11.7M 10s 2024-03-30T13:12:23.199 INFO:teuthology.orchestra.run.smithi099.stderr: 26050K .......... .......... .......... .......... .......... 15% 14.1M 10s 2024-03-30T13:12:23.202 INFO:teuthology.orchestra.run.smithi099.stderr: 26100K .......... .......... .......... .......... .......... 15% 13.2M 10s 2024-03-30T13:12:23.205 INFO:teuthology.orchestra.run.smithi099.stderr: 26150K .......... .......... .......... .......... .......... 15% 16.0M 10s 2024-03-30T13:12:23.209 INFO:teuthology.orchestra.run.smithi099.stderr: 26200K .......... .......... .......... .......... .......... 15% 13.3M 10s 2024-03-30T13:12:23.211 INFO:teuthology.orchestra.run.smithi099.stderr: 26250K .......... .......... .......... .......... .......... 15% 18.7M 10s 2024-03-30T13:12:23.215 INFO:teuthology.orchestra.run.smithi099.stderr: 26300K .......... .......... .......... .......... .......... 15% 13.3M 10s 2024-03-30T13:12:23.218 INFO:teuthology.orchestra.run.smithi099.stderr: 26350K .......... .......... .......... .......... .......... 15% 16.3M 10s 2024-03-30T13:12:23.221 INFO:teuthology.orchestra.run.smithi099.stderr: 26400K .......... .......... .......... .......... .......... 15% 15.1M 10s 2024-03-30T13:12:23.225 INFO:teuthology.orchestra.run.smithi099.stderr: 26450K .......... .......... .......... .......... .......... 15% 15.0M 10s 2024-03-30T13:12:23.230 INFO:teuthology.orchestra.run.smithi099.stderr: 26500K .......... .......... .......... .......... .......... 15% 11.9M 10s 2024-03-30T13:12:23.232 INFO:teuthology.orchestra.run.smithi099.stderr: 26550K .......... .......... .......... .......... .......... 15% 15.2M 10s 2024-03-30T13:12:23.236 INFO:teuthology.orchestra.run.smithi099.stderr: 26600K .......... .......... .......... .......... .......... 15% 12.1M 10s 2024-03-30T13:12:23.239 INFO:teuthology.orchestra.run.smithi099.stderr: 26650K .......... .......... .......... .......... .......... 15% 17.1M 10s 2024-03-30T13:12:23.242 INFO:teuthology.orchestra.run.smithi099.stderr: 26700K .......... .......... .......... .......... .......... 15% 13.3M 10s 2024-03-30T13:12:23.246 INFO:teuthology.orchestra.run.smithi099.stderr: 26750K .......... .......... .......... .......... .......... 15% 15.7M 10s 2024-03-30T13:12:23.249 INFO:teuthology.orchestra.run.smithi099.stderr: 26800K .......... .......... .......... .......... .......... 15% 14.4M 10s 2024-03-30T13:12:23.253 INFO:teuthology.orchestra.run.smithi099.stderr: 26850K .......... .......... .......... .......... .......... 15% 13.2M 10s 2024-03-30T13:12:23.255 INFO:teuthology.orchestra.run.smithi099.stderr: 26900K .......... .......... .......... .......... .......... 15% 17.6M 10s 2024-03-30T13:12:23.260 INFO:teuthology.orchestra.run.smithi099.stderr: 26950K .......... .......... .......... .......... .......... 16% 10.3M 10s 2024-03-30T13:12:23.264 INFO:teuthology.orchestra.run.smithi099.stderr: 27000K .......... .......... .......... .......... .......... 16% 14.4M 10s 2024-03-30T13:12:23.267 INFO:teuthology.orchestra.run.smithi099.stderr: 27050K .......... .......... .......... .......... .......... 16% 14.4M 10s 2024-03-30T13:12:23.270 INFO:teuthology.orchestra.run.smithi099.stderr: 27100K .......... .......... .......... .......... .......... 16% 14.5M 10s 2024-03-30T13:12:23.273 INFO:teuthology.orchestra.run.smithi099.stderr: 27150K .......... .......... .......... .......... .......... 16% 15.2M 9s 2024-03-30T13:12:23.279 INFO:teuthology.orchestra.run.smithi099.stderr: 27200K .......... .......... .......... .......... .......... 16% 10.7M 10s 2024-03-30T13:12:23.281 INFO:teuthology.orchestra.run.smithi099.stderr: 27250K .......... .......... .......... .......... .......... 16% 16.3M 9s 2024-03-30T13:12:23.284 INFO:teuthology.orchestra.run.smithi099.stderr: 27300K .......... .......... .......... .......... .......... 16% 18.9M 9s 2024-03-30T13:12:23.288 INFO:teuthology.orchestra.run.smithi099.stderr: 27350K .......... .......... .......... .......... .......... 16% 13.0M 9s 2024-03-30T13:12:23.292 INFO:teuthology.orchestra.run.smithi099.stderr: 27400K .......... .......... .......... .......... .......... 16% 14.5M 9s 2024-03-30T13:12:23.296 INFO:teuthology.orchestra.run.smithi099.stderr: 27450K .......... .......... .......... .......... .......... 16% 12.0M 9s 2024-03-30T13:12:23.299 INFO:teuthology.orchestra.run.smithi099.stderr: 27500K .......... .......... .......... .......... .......... 16% 16.2M 9s 2024-03-30T13:12:23.301 INFO:teuthology.orchestra.run.smithi099.stderr: 27550K .......... .......... .......... .......... .......... 16% 16.5M 9s 2024-03-30T13:12:23.304 INFO:teuthology.orchestra.run.smithi099.stderr: 27600K .......... .......... .......... .......... .......... 16% 16.2M 9s 2024-03-30T13:12:23.309 INFO:teuthology.orchestra.run.smithi099.stderr: 27650K .......... .......... .......... .......... .......... 16% 14.8M 9s 2024-03-30T13:12:23.311 INFO:teuthology.orchestra.run.smithi099.stderr: 27700K .......... .......... .......... .......... .......... 16% 14.3M 9s 2024-03-30T13:12:23.314 INFO:teuthology.orchestra.run.smithi099.stderr: 27750K .......... .......... .......... .......... .......... 16% 14.6M 9s 2024-03-30T13:12:23.318 INFO:teuthology.orchestra.run.smithi099.stderr: 27800K .......... .......... .......... .......... .......... 16% 16.2M 9s 2024-03-30T13:12:23.321 INFO:teuthology.orchestra.run.smithi099.stderr: 27850K .......... .......... .......... .......... .......... 16% 14.8M 9s 2024-03-30T13:12:23.325 INFO:teuthology.orchestra.run.smithi099.stderr: 27900K .......... .......... .......... .......... .......... 16% 10.5M 9s 2024-03-30T13:12:23.328 INFO:teuthology.orchestra.run.smithi099.stderr: 27950K .......... .......... .......... .......... .......... 16% 14.0M 9s 2024-03-30T13:12:23.332 INFO:teuthology.orchestra.run.smithi099.stderr: 28000K .......... .......... .......... .......... .......... 16% 13.6M 9s 2024-03-30T13:12:23.335 INFO:teuthology.orchestra.run.smithi099.stderr: 28050K .......... .......... .......... .......... .......... 16% 18.1M 9s 2024-03-30T13:12:23.338 INFO:teuthology.orchestra.run.smithi099.stderr: 28100K .......... .......... .......... .......... .......... 16% 14.1M 9s 2024-03-30T13:12:23.343 INFO:teuthology.orchestra.run.smithi099.stderr: 28150K .......... .......... .......... .......... .......... 16% 11.3M 9s 2024-03-30T13:12:23.346 INFO:teuthology.orchestra.run.smithi099.stderr: 28200K .......... .......... .......... .......... .......... 16% 14.9M 9s 2024-03-30T13:12:23.349 INFO:teuthology.orchestra.run.smithi099.stderr: 28250K .......... .......... .......... .......... .......... 16% 13.0M 9s 2024-03-30T13:12:23.352 INFO:teuthology.orchestra.run.smithi099.stderr: 28300K .......... .......... .......... .......... .......... 16% 16.1M 9s 2024-03-30T13:12:23.356 INFO:teuthology.orchestra.run.smithi099.stderr: 28350K .......... .......... .......... .......... .......... 16% 13.2M 9s 2024-03-30T13:12:23.360 INFO:teuthology.orchestra.run.smithi099.stderr: 28400K .......... .......... .......... .......... .......... 16% 13.1M 9s 2024-03-30T13:12:23.364 INFO:teuthology.orchestra.run.smithi099.stderr: 28450K .......... .......... .......... .......... .......... 16% 12.3M 9s 2024-03-30T13:12:23.367 INFO:teuthology.orchestra.run.smithi099.stderr: 28500K .......... .......... .......... .......... .......... 16% 14.3M 9s 2024-03-30T13:12:23.370 INFO:teuthology.orchestra.run.smithi099.stderr: 28550K .......... .......... .......... .......... .......... 16% 17.1M 9s 2024-03-30T13:12:23.373 INFO:teuthology.orchestra.run.smithi099.stderr: 28600K .......... .......... .......... .......... .......... 16% 18.0M 9s 2024-03-30T13:12:23.378 INFO:teuthology.orchestra.run.smithi099.stderr: 28650K .......... .......... .......... .......... .......... 17% 10.3M 9s 2024-03-30T13:12:23.381 INFO:teuthology.orchestra.run.smithi099.stderr: 28700K .......... .......... .......... .......... .......... 17% 16.3M 9s 2024-03-30T13:12:23.383 INFO:teuthology.orchestra.run.smithi099.stderr: 28750K .......... .......... .......... .......... .......... 17% 17.6M 9s 2024-03-30T13:12:23.387 INFO:teuthology.orchestra.run.smithi099.stderr: 28800K .......... .......... .......... .......... .......... 17% 13.2M 9s 2024-03-30T13:12:23.390 INFO:teuthology.orchestra.run.smithi099.stderr: 28850K .......... .......... .......... .......... .......... 17% 17.1M 9s 2024-03-30T13:12:23.394 INFO:teuthology.orchestra.run.smithi099.stderr: 28900K .......... .......... .......... .......... .......... 17% 12.4M 9s 2024-03-30T13:12:23.397 INFO:teuthology.orchestra.run.smithi099.stderr: 28950K .......... .......... .......... .......... .......... 17% 17.3M 9s 2024-03-30T13:12:23.400 INFO:teuthology.orchestra.run.smithi099.stderr: 29000K .......... .......... .......... .......... .......... 17% 14.1M 9s 2024-03-30T13:12:23.404 INFO:teuthology.orchestra.run.smithi099.stderr: 29050K .......... .......... .......... .......... .......... 17% 12.9M 9s 2024-03-30T13:12:23.408 INFO:teuthology.orchestra.run.smithi099.stderr: 29100K .......... .......... .......... .......... .......... 17% 14.9M 9s 2024-03-30T13:12:23.411 INFO:teuthology.orchestra.run.smithi099.stderr: 29150K .......... .......... .......... .......... .......... 17% 12.7M 9s 2024-03-30T13:12:23.415 INFO:teuthology.orchestra.run.smithi099.stderr: 29200K .......... .......... .......... .......... .......... 17% 12.6M 9s 2024-03-30T13:12:23.418 INFO:teuthology.orchestra.run.smithi099.stderr: 29250K .......... .......... .......... .......... .......... 17% 17.1M 9s 2024-03-30T13:12:23.422 INFO:teuthology.orchestra.run.smithi099.stderr: 29300K .......... .......... .......... .......... .......... 17% 12.5M 9s 2024-03-30T13:12:23.426 INFO:teuthology.orchestra.run.smithi099.stderr: 29350K .......... .......... .......... .......... .......... 17% 12.9M 9s 2024-03-30T13:12:23.429 INFO:teuthology.orchestra.run.smithi099.stderr: 29400K .......... .......... .......... .......... .......... 17% 13.5M 9s 2024-03-30T13:12:23.435 INFO:teuthology.orchestra.run.smithi099.stderr: 29450K .......... .......... .......... .......... .......... 17% 16.6M 9s 2024-03-30T13:12:23.436 INFO:teuthology.orchestra.run.smithi099.stderr: 29500K .......... .......... .......... .......... .......... 17% 13.0M 9s 2024-03-30T13:12:23.440 INFO:teuthology.orchestra.run.smithi099.stderr: 29550K .......... .......... .......... .......... .......... 17% 15.3M 9s 2024-03-30T13:12:23.443 INFO:teuthology.orchestra.run.smithi099.stderr: 29600K .......... .......... .......... .......... .......... 17% 11.7M 9s 2024-03-30T13:12:23.446 INFO:teuthology.orchestra.run.smithi099.stderr: 29650K .......... .......... .......... .......... .......... 17% 15.0M 9s 2024-03-30T13:12:23.450 INFO:teuthology.orchestra.run.smithi099.stderr: 29700K .......... .......... .......... .......... .......... 17% 13.8M 9s 2024-03-30T13:12:23.453 INFO:teuthology.orchestra.run.smithi099.stderr: 29750K .......... .......... .......... .......... .......... 17% 14.6M 9s 2024-03-30T13:12:23.457 INFO:teuthology.orchestra.run.smithi099.stderr: 29800K .......... .......... .......... .......... .......... 17% 12.1M 9s 2024-03-30T13:12:23.460 INFO:teuthology.orchestra.run.smithi099.stderr: 29850K .......... .......... .......... .......... .......... 17% 16.8M 9s 2024-03-30T13:12:23.463 INFO:teuthology.orchestra.run.smithi099.stderr: 29900K .......... .......... .......... .......... .......... 17% 15.6M 9s 2024-03-30T13:12:23.467 INFO:teuthology.orchestra.run.smithi099.stderr: 29950K .......... .......... .......... .......... .......... 17% 13.4M 9s 2024-03-30T13:12:23.470 INFO:teuthology.orchestra.run.smithi099.stderr: 30000K .......... .......... .......... .......... .......... 17% 14.7M 9s 2024-03-30T13:12:23.474 INFO:teuthology.orchestra.run.smithi099.stderr: 30050K .......... .......... .......... .......... .......... 17% 14.0M 9s 2024-03-30T13:12:23.477 INFO:teuthology.orchestra.run.smithi099.stderr: 30100K .......... .......... .......... .......... .......... 17% 16.5M 9s 2024-03-30T13:12:23.480 INFO:teuthology.orchestra.run.smithi099.stderr: 30150K .......... .......... .......... .......... .......... 17% 16.0M 9s 2024-03-30T13:12:23.483 INFO:teuthology.orchestra.run.smithi099.stderr: 30200K .......... .......... .......... .......... .......... 17% 14.6M 9s 2024-03-30T13:12:23.485 INFO:teuthology.orchestra.run.smithi099.stderr: 30250K .......... .......... .......... .......... .......... 17% 20.8M 9s 2024-03-30T13:12:23.490 INFO:teuthology.orchestra.run.smithi099.stderr: 30300K .......... .......... .......... .......... .......... 18% 11.6M 9s 2024-03-30T13:12:23.493 INFO:teuthology.orchestra.run.smithi099.stderr: 30350K .......... .......... .......... .......... .......... 18% 14.9M 9s 2024-03-30T13:12:23.497 INFO:teuthology.orchestra.run.smithi099.stderr: 30400K .......... .......... .......... .......... .......... 18% 13.8M 9s 2024-03-30T13:12:23.500 INFO:teuthology.orchestra.run.smithi099.stderr: 30450K .......... .......... .......... .......... .......... 18% 13.3M 9s 2024-03-30T13:12:23.504 INFO:teuthology.orchestra.run.smithi099.stderr: 30500K .......... .......... .......... .......... .......... 18% 11.5M 9s 2024-03-30T13:12:23.509 INFO:teuthology.orchestra.run.smithi099.stderr: 30550K .......... .......... .......... .......... .......... 18% 12.2M 9s 2024-03-30T13:12:23.511 INFO:teuthology.orchestra.run.smithi099.stderr: 30600K .......... .......... .......... .......... .......... 18% 18.7M 9s 2024-03-30T13:12:23.515 INFO:teuthology.orchestra.run.smithi099.stderr: 30650K .......... .......... .......... .......... .......... 18% 14.3M 9s 2024-03-30T13:12:23.518 INFO:teuthology.orchestra.run.smithi099.stderr: 30700K .......... .......... .......... .......... .......... 18% 13.5M 9s 2024-03-30T13:12:23.521 INFO:teuthology.orchestra.run.smithi099.stderr: 30750K .......... .......... .......... .......... .......... 18% 17.1M 9s 2024-03-30T13:12:23.526 INFO:teuthology.orchestra.run.smithi099.stderr: 30800K .......... .......... .......... .......... .......... 18% 9.04M 9s 2024-03-30T13:12:23.529 INFO:teuthology.orchestra.run.smithi099.stderr: 30850K .......... .......... .......... .......... .......... 18% 20.1M 9s 2024-03-30T13:12:23.532 INFO:teuthology.orchestra.run.smithi099.stderr: 30900K .......... .......... .......... .......... .......... 18% 13.8M 9s 2024-03-30T13:12:23.535 INFO:teuthology.orchestra.run.smithi099.stderr: 30950K .......... .......... .......... .......... .......... 18% 14.9M 9s 2024-03-30T13:12:23.540 INFO:teuthology.orchestra.run.smithi099.stderr: 31000K .......... .......... .......... .......... .......... 18% 18.1M 9s 2024-03-30T13:12:23.543 INFO:teuthology.orchestra.run.smithi099.stderr: 31050K .......... .......... .......... .......... .......... 18% 10.9M 9s 2024-03-30T13:12:23.546 INFO:teuthology.orchestra.run.smithi099.stderr: 31100K .......... .......... .......... .......... .......... 18% 15.1M 9s 2024-03-30T13:12:23.557 INFO:teuthology.orchestra.run.smithi099.stderr: 31150K .......... .......... .......... .......... .......... 18% 14.6M 9s 2024-03-30T13:12:23.557 INFO:teuthology.orchestra.run.smithi099.stderr: 31200K .......... .......... .......... .......... .......... 18% 17.9M 9s 2024-03-30T13:12:23.557 INFO:teuthology.orchestra.run.smithi099.stderr: 31250K .......... .......... .......... .......... .......... 18% 13.9M 9s 2024-03-30T13:12:23.560 INFO:teuthology.orchestra.run.smithi099.stderr: 31300K .......... .......... .......... .......... .......... 18% 12.2M 9s 2024-03-30T13:12:23.562 INFO:teuthology.orchestra.run.smithi099.stderr: 31350K .......... .......... .......... .......... .......... 18% 18.4M 9s 2024-03-30T13:12:23.566 INFO:teuthology.orchestra.run.smithi099.stderr: 31400K .......... .......... .......... .......... .......... 18% 13.6M 9s 2024-03-30T13:12:23.569 INFO:teuthology.orchestra.run.smithi099.stderr: 31450K .......... .......... .......... .......... .......... 18% 16.4M 9s 2024-03-30T13:12:23.573 INFO:teuthology.orchestra.run.smithi099.stderr: 31500K .......... .......... .......... .......... .......... 18% 11.7M 9s 2024-03-30T13:12:23.576 INFO:teuthology.orchestra.run.smithi099.stderr: 31550K .......... .......... .......... .......... .......... 18% 17.0M 9s 2024-03-30T13:12:23.580 INFO:teuthology.orchestra.run.smithi099.stderr: 31600K .......... .......... .......... .......... .......... 18% 12.8M 9s 2024-03-30T13:12:23.583 INFO:teuthology.orchestra.run.smithi099.stderr: 31650K .......... .......... .......... .......... .......... 18% 13.9M 9s 2024-03-30T13:12:23.586 INFO:teuthology.orchestra.run.smithi099.stderr: 31700K .......... .......... .......... .......... .......... 18% 16.9M 9s 2024-03-30T13:12:23.591 INFO:teuthology.orchestra.run.smithi099.stderr: 31750K .......... .......... .......... .......... .......... 18% 10.5M 9s 2024-03-30T13:12:23.594 INFO:teuthology.orchestra.run.smithi099.stderr: 31800K .......... .......... .......... .......... .......... 18% 13.5M 9s 2024-03-30T13:12:23.597 INFO:teuthology.orchestra.run.smithi099.stderr: 31850K .......... .......... .......... .......... .......... 18% 20.8M 9s 2024-03-30T13:12:23.601 INFO:teuthology.orchestra.run.smithi099.stderr: 31900K .......... .......... .......... .......... .......... 18% 11.6M 9s 2024-03-30T13:12:23.604 INFO:teuthology.orchestra.run.smithi099.stderr: 31950K .......... .......... .......... .......... .......... 18% 15.1M 9s 2024-03-30T13:12:23.609 INFO:teuthology.orchestra.run.smithi099.stderr: 32000K .......... .......... .......... .......... .......... 19% 11.1M 9s 2024-03-30T13:12:23.612 INFO:teuthology.orchestra.run.smithi099.stderr: 32050K .......... .......... .......... .......... .......... 19% 14.9M 9s 2024-03-30T13:12:23.615 INFO:teuthology.orchestra.run.smithi099.stderr: 32100K .......... .......... .......... .......... .......... 19% 16.0M 9s 2024-03-30T13:12:23.618 INFO:teuthology.orchestra.run.smithi099.stderr: 32150K .......... .......... .......... .......... .......... 19% 13.8M 9s 2024-03-30T13:12:23.621 INFO:teuthology.orchestra.run.smithi099.stderr: 32200K .......... .......... .......... .......... .......... 19% 17.9M 9s 2024-03-30T13:12:23.626 INFO:teuthology.orchestra.run.smithi099.stderr: 32250K .......... .......... .......... .......... .......... 19% 11.1M 9s 2024-03-30T13:12:23.629 INFO:teuthology.orchestra.run.smithi099.stderr: 32300K .......... .......... .......... .......... .......... 19% 18.3M 9s 2024-03-30T13:12:23.632 INFO:teuthology.orchestra.run.smithi099.stderr: 32350K .......... .......... .......... .......... .......... 19% 13.3M 9s 2024-03-30T13:12:23.636 INFO:teuthology.orchestra.run.smithi099.stderr: 32400K .......... .......... .......... .......... .......... 19% 12.6M 9s 2024-03-30T13:12:23.638 INFO:teuthology.orchestra.run.smithi099.stderr: 32450K .......... .......... .......... .......... .......... 19% 18.7M 9s 2024-03-30T13:12:23.643 INFO:teuthology.orchestra.run.smithi099.stderr: 32500K .......... .......... .......... .......... .......... 19% 11.6M 9s 2024-03-30T13:12:23.646 INFO:teuthology.orchestra.run.smithi099.stderr: 32550K .......... .......... .......... .......... .......... 19% 14.8M 9s 2024-03-30T13:12:23.649 INFO:teuthology.orchestra.run.smithi099.stderr: 32600K .......... .......... .......... .......... .......... 19% 16.2M 9s 2024-03-30T13:12:23.652 INFO:teuthology.orchestra.run.smithi099.stderr: 32650K .......... .......... .......... .......... .......... 19% 15.5M 9s 2024-03-30T13:12:23.657 INFO:teuthology.orchestra.run.smithi099.stderr: 32700K .......... .......... .......... .......... .......... 19% 14.7M 9s 2024-03-30T13:12:23.660 INFO:teuthology.orchestra.run.smithi099.stderr: 32750K .......... .......... .......... .......... .......... 19% 11.9M 9s 2024-03-30T13:12:23.663 INFO:teuthology.orchestra.run.smithi099.stderr: 32800K .......... .......... .......... .......... .......... 19% 14.8M 9s 2024-03-30T13:12:23.666 INFO:teuthology.orchestra.run.smithi099.stderr: 32850K .......... .......... .......... .......... .......... 19% 16.6M 9s 2024-03-30T13:12:23.670 INFO:teuthology.orchestra.run.smithi099.stderr: 32900K .......... .......... .......... .......... .......... 19% 12.7M 9s 2024-03-30T13:12:23.674 INFO:teuthology.orchestra.run.smithi099.stderr: 32950K .......... .......... .......... .......... .......... 19% 12.5M 9s 2024-03-30T13:12:23.678 INFO:teuthology.orchestra.run.smithi099.stderr: 33000K .......... .......... .......... .......... .......... 19% 18.4M 9s 2024-03-30T13:12:23.680 INFO:teuthology.orchestra.run.smithi099.stderr: 33050K .......... .......... .......... .......... .......... 19% 13.1M 9s 2024-03-30T13:12:23.684 INFO:teuthology.orchestra.run.smithi099.stderr: 33100K .......... .......... .......... .......... .......... 19% 12.3M 9s 2024-03-30T13:12:23.687 INFO:teuthology.orchestra.run.smithi099.stderr: 33150K .......... .......... .......... .......... .......... 19% 14.2M 9s 2024-03-30T13:12:23.691 INFO:teuthology.orchestra.run.smithi099.stderr: 33200K .......... .......... .......... .......... .......... 19% 12.8M 9s 2024-03-30T13:12:23.695 INFO:teuthology.orchestra.run.smithi099.stderr: 33250K .......... .......... .......... .......... .......... 19% 14.4M 9s 2024-03-30T13:12:23.698 INFO:teuthology.orchestra.run.smithi099.stderr: 33300K .......... .......... .......... .......... .......... 19% 16.3M 9s 2024-03-30T13:12:23.701 INFO:teuthology.orchestra.run.smithi099.stderr: 33350K .......... .......... .......... .......... .......... 19% 14.1M 9s 2024-03-30T13:12:23.704 INFO:teuthology.orchestra.run.smithi099.stderr: 33400K .......... .......... .......... .......... .......... 19% 19.0M 9s 2024-03-30T13:12:23.709 INFO:teuthology.orchestra.run.smithi099.stderr: 33450K .......... .......... .......... .......... .......... 19% 9.14M 9s 2024-03-30T13:12:23.712 INFO:teuthology.orchestra.run.smithi099.stderr: 33500K .......... .......... .......... .......... .......... 19% 15.1M 9s 2024-03-30T13:12:23.715 INFO:teuthology.orchestra.run.smithi099.stderr: 33550K .......... .......... .......... .......... .......... 19% 15.5M 9s 2024-03-30T13:12:23.718 INFO:teuthology.orchestra.run.smithi099.stderr: 33600K .......... .......... .......... .......... .......... 19% 16.4M 9s 2024-03-30T13:12:23.722 INFO:teuthology.orchestra.run.smithi099.stderr: 33650K .......... .......... .......... .......... .......... 19% 14.3M 9s 2024-03-30T13:12:23.726 INFO:teuthology.orchestra.run.smithi099.stderr: 33700K .......... .......... .......... .......... .......... 20% 11.5M 9s 2024-03-30T13:12:23.729 INFO:teuthology.orchestra.run.smithi099.stderr: 33750K .......... .......... .......... .......... .......... 20% 17.8M 9s 2024-03-30T13:12:23.733 INFO:teuthology.orchestra.run.smithi099.stderr: 33800K .......... .......... .......... .......... .......... 20% 12.3M 9s 2024-03-30T13:12:23.735 INFO:teuthology.orchestra.run.smithi099.stderr: 33850K .......... .......... .......... .......... .......... 20% 16.6M 9s 2024-03-30T13:12:23.740 INFO:teuthology.orchestra.run.smithi099.stderr: 33900K .......... .......... .......... .......... .......... 20% 14.9M 9s 2024-03-30T13:12:23.743 INFO:teuthology.orchestra.run.smithi099.stderr: 33950K .......... .......... .......... .......... .......... 20% 11.8M 9s 2024-03-30T13:12:23.746 INFO:teuthology.orchestra.run.smithi099.stderr: 34000K .......... .......... .......... .......... .......... 20% 15.0M 9s 2024-03-30T13:12:23.749 INFO:teuthology.orchestra.run.smithi099.stderr: 34050K .......... .......... .......... .......... .......... 20% 18.7M 9s 2024-03-30T13:12:23.753 INFO:teuthology.orchestra.run.smithi099.stderr: 34100K .......... .......... .......... .......... .......... 20% 13.3M 9s 2024-03-30T13:12:23.757 INFO:teuthology.orchestra.run.smithi099.stderr: 34150K .......... .......... .......... .......... .......... 20% 15.6M 9s 2024-03-30T13:12:23.760 INFO:teuthology.orchestra.run.smithi099.stderr: 34200K .......... .......... .......... .......... .......... 20% 11.2M 9s 2024-03-30T13:12:23.763 INFO:teuthology.orchestra.run.smithi099.stderr: 34250K .......... .......... .......... .......... .......... 20% 14.7M 9s 2024-03-30T13:12:23.767 INFO:teuthology.orchestra.run.smithi099.stderr: 34300K .......... .......... .......... .......... .......... 20% 13.3M 9s 2024-03-30T13:12:23.770 INFO:teuthology.orchestra.run.smithi099.stderr: 34350K .......... .......... .......... .......... .......... 20% 14.7M 9s 2024-03-30T13:12:23.774 INFO:teuthology.orchestra.run.smithi099.stderr: 34400K .......... .......... .......... .......... .......... 20% 12.3M 9s 2024-03-30T13:12:23.778 INFO:teuthology.orchestra.run.smithi099.stderr: 34450K .......... .......... .......... .......... .......... 20% 14.0M 9s 2024-03-30T13:12:23.780 INFO:teuthology.orchestra.run.smithi099.stderr: 34500K .......... .......... .......... .......... .......... 20% 21.3M 9s 2024-03-30T13:12:23.785 INFO:teuthology.orchestra.run.smithi099.stderr: 34550K .......... .......... .......... .......... .......... 20% 11.0M 9s 2024-03-30T13:12:23.789 INFO:teuthology.orchestra.run.smithi099.stderr: 34600K .......... .......... .......... .......... .......... 20% 15.0M 9s 2024-03-30T13:12:23.792 INFO:teuthology.orchestra.run.smithi099.stderr: 34650K .......... .......... .......... .......... .......... 20% 11.8M 9s 2024-03-30T13:12:23.795 INFO:teuthology.orchestra.run.smithi099.stderr: 34700K .......... .......... .......... .......... .......... 20% 16.3M 9s 2024-03-30T13:12:23.799 INFO:teuthology.orchestra.run.smithi099.stderr: 34750K .......... .......... .......... .......... .......... 20% 13.1M 9s 2024-03-30T13:12:23.802 INFO:teuthology.orchestra.run.smithi099.stderr: 34800K .......... .......... .......... .......... .......... 20% 14.5M 9s 2024-03-30T13:12:23.806 INFO:teuthology.orchestra.run.smithi099.stderr: 34850K .......... .......... .......... .......... .......... 20% 16.1M 9s 2024-03-30T13:12:23.809 INFO:teuthology.orchestra.run.smithi099.stderr: 34900K .......... .......... .......... .......... .......... 20% 11.5M 9s 2024-03-30T13:12:23.813 INFO:teuthology.orchestra.run.smithi099.stderr: 34950K .......... .......... .......... .......... .......... 20% 14.6M 9s 2024-03-30T13:12:23.816 INFO:teuthology.orchestra.run.smithi099.stderr: 35000K .......... .......... .......... .......... .......... 20% 12.8M 9s 2024-03-30T13:12:23.820 INFO:teuthology.orchestra.run.smithi099.stderr: 35050K .......... .......... .......... .......... .......... 20% 15.9M 9s 2024-03-30T13:12:23.824 INFO:teuthology.orchestra.run.smithi099.stderr: 35100K .......... .......... .......... .......... .......... 20% 11.5M 9s 2024-03-30T13:12:23.826 INFO:teuthology.orchestra.run.smithi099.stderr: 35150K .......... .......... .......... .......... .......... 20% 21.1M 9s 2024-03-30T13:12:23.830 INFO:teuthology.orchestra.run.smithi099.stderr: 35200K .......... .......... .......... .......... .......... 20% 13.5M 9s 2024-03-30T13:12:23.833 INFO:teuthology.orchestra.run.smithi099.stderr: 35250K .......... .......... .......... .......... .......... 20% 15.2M 9s 2024-03-30T13:12:23.836 INFO:teuthology.orchestra.run.smithi099.stderr: 35300K .......... .......... .......... .......... .......... 20% 14.8M 9s 2024-03-30T13:12:23.843 INFO:teuthology.orchestra.run.smithi099.stderr: 35350K .......... .......... .......... .......... .......... 21% 11.7M 9s 2024-03-30T13:12:23.844 INFO:teuthology.orchestra.run.smithi099.stderr: 35400K .......... .......... .......... .......... .......... 21% 14.4M 9s 2024-03-30T13:12:23.847 INFO:teuthology.orchestra.run.smithi099.stderr: 35450K .......... .......... .......... .......... .......... 21% 16.1M 9s 2024-03-30T13:12:23.850 INFO:teuthology.orchestra.run.smithi099.stderr: 35500K .......... .......... .......... .......... .......... 21% 16.8M 9s 2024-03-30T13:12:23.854 INFO:teuthology.orchestra.run.smithi099.stderr: 35550K .......... .......... .......... .......... .......... 21% 13.1M 9s 2024-03-30T13:12:23.857 INFO:teuthology.orchestra.run.smithi099.stderr: 35600K .......... .......... .......... .......... .......... 21% 15.6M 9s 2024-03-30T13:12:23.860 INFO:teuthology.orchestra.run.smithi099.stderr: 35650K .......... .......... .......... .......... .......... 21% 14.7M 9s 2024-03-30T13:12:23.864 INFO:teuthology.orchestra.run.smithi099.stderr: 35700K .......... .......... .......... .......... .......... 21% 13.8M 9s 2024-03-30T13:12:23.867 INFO:teuthology.orchestra.run.smithi099.stderr: 35750K .......... .......... .......... .......... .......... 21% 12.3M 9s 2024-03-30T13:12:23.871 INFO:teuthology.orchestra.run.smithi099.stderr: 35800K .......... .......... .......... .......... .......... 21% 17.0M 9s 2024-03-30T13:12:23.874 INFO:teuthology.orchestra.run.smithi099.stderr: 35850K .......... .......... .......... .......... .......... 21% 13.0M 9s 2024-03-30T13:12:23.878 INFO:teuthology.orchestra.run.smithi099.stderr: 35900K .......... .......... .......... .......... .......... 21% 12.5M 9s 2024-03-30T13:12:23.882 INFO:teuthology.orchestra.run.smithi099.stderr: 35950K .......... .......... .......... .......... .......... 21% 14.1M 9s 2024-03-30T13:12:23.886 INFO:teuthology.orchestra.run.smithi099.stderr: 36000K .......... .......... .......... .......... .......... 21% 11.7M 9s 2024-03-30T13:12:23.888 INFO:teuthology.orchestra.run.smithi099.stderr: 36050K .......... .......... .......... .......... .......... 21% 22.1M 9s 2024-03-30T13:12:23.893 INFO:teuthology.orchestra.run.smithi099.stderr: 36100K .......... .......... .......... .......... .......... 21% 10.4M 9s 2024-03-30T13:12:23.896 INFO:teuthology.orchestra.run.smithi099.stderr: 36150K .......... .......... .......... .......... .......... 21% 16.8M 9s 2024-03-30T13:12:23.899 INFO:teuthology.orchestra.run.smithi099.stderr: 36200K .......... .......... .......... .......... .......... 21% 13.3M 9s 2024-03-30T13:12:23.902 INFO:teuthology.orchestra.run.smithi099.stderr: 36250K .......... .......... .......... .......... .......... 21% 15.9M 9s 2024-03-30T13:12:23.906 INFO:teuthology.orchestra.run.smithi099.stderr: 36300K .......... .......... .......... .......... .......... 21% 15.1M 9s 2024-03-30T13:12:23.910 INFO:teuthology.orchestra.run.smithi099.stderr: 36350K .......... .......... .......... .......... .......... 21% 10.9M 9s 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi099.stderr: 36400K .......... .......... .......... .......... .......... 21% 17.0M 9s 2024-03-30T13:12:23.917 INFO:teuthology.orchestra.run.smithi099.stderr: 36450K .......... .......... .......... .......... .......... 21% 12.5M 9s 2024-03-30T13:12:23.919 INFO:teuthology.orchestra.run.smithi099.stderr: 36500K .......... .......... .......... .......... .......... 21% 19.5M 9s 2024-03-30T13:12:23.923 INFO:teuthology.orchestra.run.smithi099.stderr: 36550K .......... .......... .......... .......... .......... 21% 14.5M 9s 2024-03-30T13:12:23.927 INFO:teuthology.orchestra.run.smithi099.stderr: 36600K .......... .......... .......... .......... .......... 21% 11.9M 9s 2024-03-30T13:12:23.930 INFO:teuthology.orchestra.run.smithi099.stderr: 36650K .......... .......... .......... .......... .......... 21% 15.5M 9s 2024-03-30T13:12:23.933 INFO:teuthology.orchestra.run.smithi099.stderr: 36700K .......... .......... .......... .......... .......... 21% 15.7M 9s 2024-03-30T13:12:23.936 INFO:teuthology.orchestra.run.smithi099.stderr: 36750K .......... .......... .......... .......... .......... 21% 17.7M 9s 2024-03-30T13:12:23.940 INFO:teuthology.orchestra.run.smithi099.stderr: 36800K .......... .......... .......... .......... .......... 21% 10.4M 9s 2024-03-30T13:12:23.943 INFO:teuthology.orchestra.run.smithi099.stderr: 36850K .......... .......... .......... .......... .......... 21% 15.7M 9s 2024-03-30T13:12:23.947 INFO:teuthology.orchestra.run.smithi099.stderr: 36900K .......... .......... .......... .......... .......... 21% 14.3M 9s 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi099.stderr: 36950K .......... .......... .......... .......... .......... 21% 17.7M 9s 2024-03-30T13:12:23.954 INFO:teuthology.orchestra.run.smithi099.stderr: 37000K .......... .......... .......... .......... .......... 21% 11.6M 9s 2024-03-30T13:12:23.958 INFO:teuthology.orchestra.run.smithi099.stderr: 37050K .......... .......... .......... .......... .......... 22% 13.5M 9s 2024-03-30T13:12:23.962 INFO:teuthology.orchestra.run.smithi099.stderr: 37100K .......... .......... .......... .......... .......... 22% 12.0M 9s 2024-03-30T13:12:23.964 INFO:teuthology.orchestra.run.smithi099.stderr: 37150K .......... .......... .......... .......... .......... 22% 21.4M 9s 2024-03-30T13:12:23.968 INFO:teuthology.orchestra.run.smithi099.stderr: 37200K .......... .......... .......... .......... .......... 22% 11.2M 9s 2024-03-30T13:12:23.971 INFO:teuthology.orchestra.run.smithi099.stderr: 37250K .......... .......... .......... .......... .......... 22% 14.6M 9s 2024-03-30T13:12:23.976 INFO:teuthology.orchestra.run.smithi099.stderr: 37300K .......... .......... .......... .......... .......... 22% 11.2M 9s 2024-03-30T13:12:23.979 INFO:teuthology.orchestra.run.smithi099.stderr: 37350K .......... .......... .......... .......... .......... 22% 15.9M 9s 2024-03-30T13:12:23.982 INFO:teuthology.orchestra.run.smithi099.stderr: 37400K .......... .......... .......... .......... .......... 22% 17.4M 9s 2024-03-30T13:12:23.986 INFO:teuthology.orchestra.run.smithi099.stderr: 37450K .......... .......... .......... .......... .......... 22% 13.4M 9s 2024-03-30T13:12:23.988 INFO:teuthology.orchestra.run.smithi099.stderr: 37500K .......... .......... .......... .......... .......... 22% 20.1M 9s 2024-03-30T13:12:23.994 INFO:teuthology.orchestra.run.smithi099.stderr: 37550K .......... .......... .......... .......... .......... 22% 8.58M 9s 2024-03-30T13:12:23.997 INFO:teuthology.orchestra.run.smithi099.stderr: 37600K .......... .......... .......... .......... .......... 22% 16.5M 9s 2024-03-30T13:12:24.000 INFO:teuthology.orchestra.run.smithi099.stderr: 37650K .......... .......... .......... .......... .......... 22% 15.1M 9s 2024-03-30T13:12:24.003 INFO:teuthology.orchestra.run.smithi099.stderr: 37700K .......... .......... .......... .......... .......... 22% 13.0M 9s 2024-03-30T13:12:24.006 INFO:teuthology.orchestra.run.smithi099.stderr: 37750K .......... .......... .......... .......... .......... 22% 16.4M 9s 2024-03-30T13:12:24.011 INFO:teuthology.orchestra.run.smithi099.stderr: 37800K .......... .......... .......... .......... .......... 22% 12.1M 9s 2024-03-30T13:12:24.014 INFO:teuthology.orchestra.run.smithi099.stderr: 37850K .......... .......... .......... .......... .......... 22% 15.9M 9s 2024-03-30T13:12:24.017 INFO:teuthology.orchestra.run.smithi099.stderr: 37900K .......... .......... .......... .......... .......... 22% 14.0M 9s 2024-03-30T13:12:24.020 INFO:teuthology.orchestra.run.smithi099.stderr: 37950K .......... .......... .......... .......... .......... 22% 17.2M 9s 2024-03-30T13:12:24.024 INFO:teuthology.orchestra.run.smithi099.stderr: 38000K .......... .......... .......... .......... .......... 22% 16.2M 9s 2024-03-30T13:12:24.027 INFO:teuthology.orchestra.run.smithi099.stderr: 38050K .......... .......... .......... .......... .......... 22% 13.1M 9s 2024-03-30T13:12:24.030 INFO:teuthology.orchestra.run.smithi099.stderr: 38100K .......... .......... .......... .......... .......... 22% 13.5M 9s 2024-03-30T13:12:24.034 INFO:teuthology.orchestra.run.smithi099.stderr: 38150K .......... .......... .......... .......... .......... 22% 14.5M 9s 2024-03-30T13:12:24.038 INFO:teuthology.orchestra.run.smithi099.stderr: 38200K .......... .......... .......... .......... .......... 22% 12.4M 9s 2024-03-30T13:12:24.041 INFO:teuthology.orchestra.run.smithi099.stderr: 38250K .......... .......... .......... .......... .......... 22% 13.9M 9s 2024-03-30T13:12:24.047 INFO:teuthology.orchestra.run.smithi099.stderr: 38300K .......... .......... .......... .......... .......... 22% 14.0M 9s 2024-03-30T13:12:24.049 INFO:teuthology.orchestra.run.smithi099.stderr: 38350K .......... .......... .......... .......... .......... 22% 12.4M 9s 2024-03-30T13:12:24.051 INFO:teuthology.orchestra.run.smithi099.stderr: 38400K .......... .......... .......... .......... .......... 22% 20.8M 9s 2024-03-30T13:12:24.055 INFO:teuthology.orchestra.run.smithi099.stderr: 38450K .......... .......... .......... .......... .......... 22% 11.5M 9s 2024-03-30T13:12:24.060 INFO:teuthology.orchestra.run.smithi099.stderr: 38500K .......... .......... .......... .......... .......... 22% 11.7M 9s 2024-03-30T13:12:24.062 INFO:teuthology.orchestra.run.smithi099.stderr: 38550K .......... .......... .......... .......... .......... 22% 18.7M 9s 2024-03-30T13:12:24.065 INFO:teuthology.orchestra.run.smithi099.stderr: 38600K .......... .......... .......... .......... .......... 22% 15.6M 9s 2024-03-30T13:12:24.068 INFO:teuthology.orchestra.run.smithi099.stderr: 38650K .......... .......... .......... .......... .......... 22% 16.3M 9s 2024-03-30T13:12:24.074 INFO:teuthology.orchestra.run.smithi099.stderr: 38700K .......... .......... .......... .......... .......... 22% 9.89M 9s 2024-03-30T13:12:24.076 INFO:teuthology.orchestra.run.smithi099.stderr: 38750K .......... .......... .......... .......... .......... 23% 16.4M 9s 2024-03-30T13:12:24.079 INFO:teuthology.orchestra.run.smithi099.stderr: 38800K .......... .......... .......... .......... .......... 23% 17.2M 9s 2024-03-30T13:12:24.082 INFO:teuthology.orchestra.run.smithi099.stderr: 38850K .......... .......... .......... .......... .......... 23% 14.5M 9s 2024-03-30T13:12:24.086 INFO:teuthology.orchestra.run.smithi099.stderr: 38900K .......... .......... .......... .......... .......... 23% 11.6M 9s 2024-03-30T13:12:24.090 INFO:teuthology.orchestra.run.smithi099.stderr: 38950K .......... .......... .......... .......... .......... 23% 15.1M 9s 2024-03-30T13:12:24.093 INFO:teuthology.orchestra.run.smithi099.stderr: 39000K .......... .......... .......... .......... .......... 23% 13.9M 9s 2024-03-30T13:12:24.097 INFO:teuthology.orchestra.run.smithi099.stderr: 39050K .......... .......... .......... .......... .......... 23% 12.7M 9s 2024-03-30T13:12:24.100 INFO:teuthology.orchestra.run.smithi099.stderr: 39100K .......... .......... .......... .......... .......... 23% 15.9M 9s 2024-03-30T13:12:24.103 INFO:teuthology.orchestra.run.smithi099.stderr: 39150K .......... .......... .......... .......... .......... 23% 16.6M 9s 2024-03-30T13:12:24.106 INFO:teuthology.orchestra.run.smithi099.stderr: 39200K .......... .......... .......... .......... .......... 23% 14.6M 9s 2024-03-30T13:12:24.111 INFO:teuthology.orchestra.run.smithi099.stderr: 39250K .......... .......... .......... .......... .......... 23% 9.65M 9s 2024-03-30T13:12:24.114 INFO:teuthology.orchestra.run.smithi099.stderr: 39300K .......... .......... .......... .......... .......... 23% 16.4M 9s 2024-03-30T13:12:24.117 INFO:teuthology.orchestra.run.smithi099.stderr: 39350K .......... .......... .......... .......... .......... 23% 17.6M 9s 2024-03-30T13:12:24.120 INFO:teuthology.orchestra.run.smithi099.stderr: 39400K .......... .......... .......... .......... .......... 23% 15.4M 9s 2024-03-30T13:12:24.125 INFO:teuthology.orchestra.run.smithi099.stderr: 39450K .......... .......... .......... .......... .......... 23% 14.4M 9s 2024-03-30T13:12:24.128 INFO:teuthology.orchestra.run.smithi099.stderr: 39500K .......... .......... .......... .......... .......... 23% 11.6M 9s 2024-03-30T13:12:24.132 INFO:teuthology.orchestra.run.smithi099.stderr: 39550K .......... .......... .......... .......... .......... 23% 11.9M 9s 2024-03-30T13:12:24.134 INFO:teuthology.orchestra.run.smithi099.stderr: 39600K .......... .......... .......... .......... .......... 23% 18.5M 9s 2024-03-30T13:12:24.138 INFO:teuthology.orchestra.run.smithi099.stderr: 39650K .......... .......... .......... .......... .......... 23% 14.8M 9s 2024-03-30T13:12:24.142 INFO:teuthology.orchestra.run.smithi099.stderr: 39700K .......... .......... .......... .......... .......... 23% 13.4M 9s 2024-03-30T13:12:24.145 INFO:teuthology.orchestra.run.smithi099.stderr: 39750K .......... .......... .......... .......... .......... 23% 13.9M 9s 2024-03-30T13:12:24.151 INFO:teuthology.orchestra.run.smithi099.stderr: 39800K .......... .......... .......... .......... .......... 23% 9.54M 9s 2024-03-30T13:12:24.152 INFO:teuthology.orchestra.run.smithi099.stderr: 39850K .......... .......... .......... .......... .......... 23% 25.5M 9s 2024-03-30T13:12:24.156 INFO:teuthology.orchestra.run.smithi099.stderr: 39900K .......... .......... .......... .......... .......... 23% 16.1M 9s 2024-03-30T13:12:24.159 INFO:teuthology.orchestra.run.smithi099.stderr: 39950K .......... .......... .......... .......... .......... 23% 11.5M 9s 2024-03-30T13:12:24.162 INFO:teuthology.orchestra.run.smithi099.stderr: 40000K .......... .......... .......... .......... .......... 23% 18.6M 9s 2024-03-30T13:12:24.166 INFO:teuthology.orchestra.run.smithi099.stderr: 40050K .......... .......... .......... .......... .......... 23% 11.1M 9s 2024-03-30T13:12:24.169 INFO:teuthology.orchestra.run.smithi099.stderr: 40100K .......... .......... .......... .......... .......... 23% 21.2M 9s 2024-03-30T13:12:24.173 INFO:teuthology.orchestra.run.smithi099.stderr: 40150K .......... .......... .......... .......... .......... 23% 16.6M 9s 2024-03-30T13:12:24.176 INFO:teuthology.orchestra.run.smithi099.stderr: 40200K .......... .......... .......... .......... .......... 23% 11.0M 9s 2024-03-30T13:12:24.180 INFO:teuthology.orchestra.run.smithi099.stderr: 40250K .......... .......... .......... .......... .......... 23% 12.3M 9s 2024-03-30T13:12:24.183 INFO:teuthology.orchestra.run.smithi099.stderr: 40300K .......... .......... .......... .......... .......... 23% 14.1M 9s 2024-03-30T13:12:24.186 INFO:teuthology.orchestra.run.smithi099.stderr: 40350K .......... .......... .......... .......... .......... 23% 18.2M 9s 2024-03-30T13:12:24.192 INFO:teuthology.orchestra.run.smithi099.stderr: 40400K .......... .......... .......... .......... .......... 23% 9.03M 9s 2024-03-30T13:12:24.195 INFO:teuthology.orchestra.run.smithi099.stderr: 40450K .......... .......... .......... .......... .......... 24% 17.0M 9s 2024-03-30T13:12:24.198 INFO:teuthology.orchestra.run.smithi099.stderr: 40500K .......... .......... .......... .......... .......... 24% 15.3M 9s 2024-03-30T13:12:24.201 INFO:teuthology.orchestra.run.smithi099.stderr: 40550K .......... .......... .......... .......... .......... 24% 14.7M 9s 2024-03-30T13:12:24.204 INFO:teuthology.orchestra.run.smithi099.stderr: 40600K .......... .......... .......... .......... .......... 24% 14.2M 9s 2024-03-30T13:12:24.209 INFO:teuthology.orchestra.run.smithi099.stderr: 40650K .......... .......... .......... .......... .......... 24% 11.4M 9s 2024-03-30T13:12:24.212 INFO:teuthology.orchestra.run.smithi099.stderr: 40700K .......... .......... .......... .......... .......... 24% 15.1M 9s 2024-03-30T13:12:24.216 INFO:teuthology.orchestra.run.smithi099.stderr: 40750K .......... .......... .......... .......... .......... 24% 15.0M 9s 2024-03-30T13:12:24.218 INFO:teuthology.orchestra.run.smithi099.stderr: 40800K .......... .......... .......... .......... .......... 24% 14.9M 9s 2024-03-30T13:12:24.221 INFO:teuthology.orchestra.run.smithi099.stderr: 40850K .......... .......... .......... .......... .......... 24% 17.1M 9s 2024-03-30T13:12:24.226 INFO:teuthology.orchestra.run.smithi099.stderr: 40900K .......... .......... .......... .......... .......... 24% 11.2M 9s 2024-03-30T13:12:24.229 INFO:teuthology.orchestra.run.smithi099.stderr: 40950K .......... .......... .......... .......... .......... 24% 15.2M 9s 2024-03-30T13:12:24.232 INFO:teuthology.orchestra.run.smithi099.stderr: 41000K .......... .......... .......... .......... .......... 24% 14.8M 9s 2024-03-30T13:12:24.235 INFO:teuthology.orchestra.run.smithi099.stderr: 41050K .......... .......... .......... .......... .......... 24% 13.8M 9s 2024-03-30T13:12:24.238 INFO:teuthology.orchestra.run.smithi099.stderr: 41100K .......... .......... .......... .......... .......... 24% 15.8M 9s 2024-03-30T13:12:24.243 INFO:teuthology.orchestra.run.smithi099.stderr: 41150K .......... .......... .......... .......... .......... 24% 10.8M 9s 2024-03-30T13:12:24.246 INFO:teuthology.orchestra.run.smithi099.stderr: 41200K .......... .......... .......... .......... .......... 24% 19.7M 9s 2024-03-30T13:12:24.250 INFO:teuthology.orchestra.run.smithi099.stderr: 41250K .......... .......... .......... .......... .......... 24% 13.4M 9s 2024-03-30T13:12:24.253 INFO:teuthology.orchestra.run.smithi099.stderr: 41300K .......... .......... .......... .......... .......... 24% 13.2M 9s 2024-03-30T13:12:24.362 INFO:teuthology.orchestra.run.smithi099.stderr: 41350K .......... .......... .......... .......... .......... 24% 569K 9s 2024-03-30T13:12:24.362 INFO:teuthology.orchestra.run.smithi099.stderr: 41400K .......... .......... .......... .......... .......... 24% 58.5M 9s 2024-03-30T13:12:24.362 INFO:teuthology.orchestra.run.smithi099.stderr: 41450K .......... .......... .......... .......... .......... 24% 60.1M 9s 2024-03-30T13:12:24.362 INFO:teuthology.orchestra.run.smithi099.stderr: 41500K .......... .......... .......... .......... .......... 24% 75.7M 9s 2024-03-30T13:12:24.362 INFO:teuthology.orchestra.run.smithi099.stderr: 41550K .......... .......... .......... .......... .......... 24% 61.9M 9s 2024-03-30T13:12:24.362 INFO:teuthology.orchestra.run.smithi099.stderr: 41600K .......... .......... .......... .......... .......... 24% 65.5M 9s 2024-03-30T13:12:24.362 INFO:teuthology.orchestra.run.smithi099.stderr: 41650K .......... .......... .......... .......... .......... 24% 66.0M 9s 2024-03-30T13:12:24.362 INFO:teuthology.orchestra.run.smithi099.stderr: 41700K .......... .......... .......... .......... .......... 24% 62.2M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 41750K .......... .......... .......... .......... .......... 24% 64.0M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 41800K .......... .......... .......... .......... .......... 24% 71.1M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 41850K .......... .......... .......... .......... .......... 24% 60.7M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 41900K .......... .......... .......... .......... .......... 24% 68.5M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 41950K .......... .......... .......... .......... .......... 24% 74.7M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 42000K .......... .......... .......... .......... .......... 24% 70.3M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 42050K .......... .......... .......... .......... .......... 24% 59.2M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 42100K .......... .......... .......... .......... .......... 25% 67.0M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 42150K .......... .......... .......... .......... .......... 25% 62.6M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 42200K .......... .......... .......... .......... .......... 25% 71.6M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 42250K .......... .......... .......... .......... .......... 25% 55.8M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 42300K .......... .......... .......... .......... .......... 25% 67.8M 9s 2024-03-30T13:12:24.363 INFO:teuthology.orchestra.run.smithi099.stderr: 42350K .......... .......... .......... .......... .......... 25% 66.8M 9s 2024-03-30T13:12:24.364 INFO:teuthology.orchestra.run.smithi099.stderr: 42400K .......... .......... .......... .......... .......... 25% 72.9M 9s 2024-03-30T13:12:24.425 INFO:teuthology.orchestra.run.smithi099.stderr: 42450K .......... .......... .......... .......... .......... 25% 1.04M 9s 2024-03-30T13:12:24.425 INFO:teuthology.orchestra.run.smithi099.stderr: 42500K .......... .......... .......... .......... .......... 25% 64.1M 9s 2024-03-30T13:12:24.425 INFO:teuthology.orchestra.run.smithi099.stderr: 42550K .......... .......... .......... .......... .......... 25% 55.8M 9s 2024-03-30T13:12:24.425 INFO:teuthology.orchestra.run.smithi099.stderr: 42600K .......... .......... .......... .......... .......... 25% 72.7M 9s 2024-03-30T13:12:24.425 INFO:teuthology.orchestra.run.smithi099.stderr: 42650K .......... .......... .......... .......... .......... 25% 64.9M 9s 2024-03-30T13:12:24.425 INFO:teuthology.orchestra.run.smithi099.stderr: 42700K .......... .......... .......... .......... .......... 25% 53.1M 9s 2024-03-30T13:12:24.425 INFO:teuthology.orchestra.run.smithi099.stderr: 42750K .......... .......... .......... .......... .......... 25% 66.3M 9s 2024-03-30T13:12:24.425 INFO:teuthology.orchestra.run.smithi099.stderr: 42800K .......... .......... .......... .......... .......... 25% 60.5M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 42850K .......... .......... .......... .......... .......... 25% 76.8M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 42900K .......... .......... .......... .......... .......... 25% 66.0M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 42950K .......... .......... .......... .......... .......... 25% 58.4M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 43000K .......... .......... .......... .......... .......... 25% 74.8M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 43050K .......... .......... .......... .......... .......... 25% 70.0M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 43100K .......... .......... .......... .......... .......... 25% 68.0M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 43150K .......... .......... .......... .......... .......... 25% 75.2M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 43200K .......... .......... .......... .......... .......... 25% 75.6M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 43250K .......... .......... .......... .......... .......... 25% 66.1M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 43300K .......... .......... .......... .......... .......... 25% 62.3M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 43350K .......... .......... .......... .......... .......... 25% 69.5M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 43400K .......... .......... .......... .......... .......... 25% 74.9M 9s 2024-03-30T13:12:24.426 INFO:teuthology.orchestra.run.smithi099.stderr: 43450K .......... .......... .......... .......... .......... 25% 79.3M 9s 2024-03-30T13:12:24.427 INFO:teuthology.orchestra.run.smithi099.stderr: 43500K .......... .......... .......... .......... .......... 25% 24.7M 9s 2024-03-30T13:12:24.427 INFO:teuthology.orchestra.run.smithi099.stderr: 43550K .......... .......... .......... .......... .......... 25% 12.2M 9s 2024-03-30T13:12:24.428 INFO:teuthology.orchestra.run.smithi099.stderr: 43600K .......... .......... .......... .......... .......... 25% 16.2M 9s 2024-03-30T13:12:24.432 INFO:teuthology.orchestra.run.smithi099.stderr: 43650K .......... .......... .......... .......... .......... 25% 10.8M 9s 2024-03-30T13:12:24.435 INFO:teuthology.orchestra.run.smithi099.stderr: 43700K .......... .......... .......... .......... .......... 25% 19.6M 9s 2024-03-30T13:12:24.438 INFO:teuthology.orchestra.run.smithi099.stderr: 43750K .......... .......... .......... .......... .......... 25% 13.3M 9s 2024-03-30T13:12:24.443 INFO:teuthology.orchestra.run.smithi099.stderr: 43800K .......... .......... .......... .......... .......... 26% 10.7M 9s 2024-03-30T13:12:24.446 INFO:teuthology.orchestra.run.smithi099.stderr: 43850K .......... .......... .......... .......... .......... 26% 15.5M 9s 2024-03-30T13:12:24.450 INFO:teuthology.orchestra.run.smithi099.stderr: 43900K .......... .......... .......... .......... .......... 26% 12.0M 9s 2024-03-30T13:12:24.458 INFO:teuthology.orchestra.run.smithi099.stderr: 43950K .......... .......... .......... .......... .......... 26% 19.4M 9s 2024-03-30T13:12:24.458 INFO:teuthology.orchestra.run.smithi099.stderr: 44000K .......... .......... .......... .......... .......... 26% 13.2M 9s 2024-03-30T13:12:24.460 INFO:teuthology.orchestra.run.smithi099.stderr: 44050K .......... .......... .......... .......... .......... 26% 13.2M 9s 2024-03-30T13:12:24.463 INFO:teuthology.orchestra.run.smithi099.stderr: 44100K .......... .......... .......... .......... .......... 26% 16.9M 9s 2024-03-30T13:12:24.466 INFO:teuthology.orchestra.run.smithi099.stderr: 44150K .......... .......... .......... .......... .......... 26% 15.7M 8s 2024-03-30T13:12:24.469 INFO:teuthology.orchestra.run.smithi099.stderr: 44200K .......... .......... .......... .......... .......... 26% 15.3M 8s 2024-03-30T13:12:24.473 INFO:teuthology.orchestra.run.smithi099.stderr: 44250K .......... .......... .......... .......... .......... 26% 13.4M 8s 2024-03-30T13:12:24.476 INFO:teuthology.orchestra.run.smithi099.stderr: 44300K .......... .......... .......... .......... .......... 26% 14.5M 8s 2024-03-30T13:12:24.480 INFO:teuthology.orchestra.run.smithi099.stderr: 44350K .......... .......... .......... .......... .......... 26% 16.4M 8s 2024-03-30T13:12:24.482 INFO:teuthology.orchestra.run.smithi099.stderr: 44400K .......... .......... .......... .......... .......... 26% 15.1M 8s 2024-03-30T13:12:24.485 INFO:teuthology.orchestra.run.smithi099.stderr: 44450K .......... .......... .......... .......... .......... 26% 16.1M 8s 2024-03-30T13:12:24.489 INFO:teuthology.orchestra.run.smithi099.stderr: 44500K .......... .......... .......... .......... .......... 26% 13.7M 8s 2024-03-30T13:12:24.493 INFO:teuthology.orchestra.run.smithi099.stderr: 44550K .......... .......... .......... .......... .......... 26% 15.6M 8s 2024-03-30T13:12:24.496 INFO:teuthology.orchestra.run.smithi099.stderr: 44600K .......... .......... .......... .......... .......... 26% 14.6M 8s 2024-03-30T13:12:24.500 INFO:teuthology.orchestra.run.smithi099.stderr: 44650K .......... .......... .......... .......... .......... 26% 13.3M 8s 2024-03-30T13:12:24.502 INFO:teuthology.orchestra.run.smithi099.stderr: 44700K .......... .......... .......... .......... .......... 26% 16.8M 8s 2024-03-30T13:12:24.507 INFO:teuthology.orchestra.run.smithi099.stderr: 44750K .......... .......... .......... .......... .......... 26% 12.8M 8s 2024-03-30T13:12:24.509 INFO:teuthology.orchestra.run.smithi099.stderr: 44800K .......... .......... .......... .......... .......... 26% 15.2M 8s 2024-03-30T13:12:24.512 INFO:teuthology.orchestra.run.smithi099.stderr: 44850K .......... .......... .......... .......... .......... 26% 15.9M 8s 2024-03-30T13:12:24.516 INFO:teuthology.orchestra.run.smithi099.stderr: 44900K .......... .......... .......... .......... .......... 26% 14.6M 8s 2024-03-30T13:12:24.518 INFO:teuthology.orchestra.run.smithi099.stderr: 44950K .......... .......... .......... .......... .......... 26% 18.6M 8s 2024-03-30T13:12:24.522 INFO:teuthology.orchestra.run.smithi099.stderr: 45000K .......... .......... .......... .......... .......... 26% 13.8M 8s 2024-03-30T13:12:24.526 INFO:teuthology.orchestra.run.smithi099.stderr: 45050K .......... .......... .......... .......... .......... 26% 12.0M 8s 2024-03-30T13:12:24.529 INFO:teuthology.orchestra.run.smithi099.stderr: 45100K .......... .......... .......... .......... .......... 26% 15.4M 8s 2024-03-30T13:12:24.531 INFO:teuthology.orchestra.run.smithi099.stderr: 45150K .......... .......... .......... .......... .......... 26% 23.8M 8s 2024-03-30T13:12:24.535 INFO:teuthology.orchestra.run.smithi099.stderr: 45200K .......... .......... .......... .......... .......... 26% 15.4M 8s 2024-03-30T13:12:24.538 INFO:teuthology.orchestra.run.smithi099.stderr: 45250K .......... .......... .......... .......... .......... 26% 12.5M 8s 2024-03-30T13:12:24.542 INFO:teuthology.orchestra.run.smithi099.stderr: 45300K .......... .......... .......... .......... .......... 26% 14.1M 8s 2024-03-30T13:12:24.544 INFO:teuthology.orchestra.run.smithi099.stderr: 45350K .......... .......... .......... .......... .......... 26% 21.4M 8s 2024-03-30T13:12:24.547 INFO:teuthology.orchestra.run.smithi099.stderr: 45400K .......... .......... .......... .......... .......... 26% 17.6M 8s 2024-03-30T13:12:24.552 INFO:teuthology.orchestra.run.smithi099.stderr: 45450K .......... .......... .......... .......... .......... 26% 13.7M 8s 2024-03-30T13:12:24.554 INFO:teuthology.orchestra.run.smithi099.stderr: 45500K .......... .......... .......... .......... .......... 27% 15.8M 8s 2024-03-30T13:12:24.557 INFO:teuthology.orchestra.run.smithi099.stderr: 45550K .......... .......... .......... .......... .......... 27% 14.3M 8s 2024-03-30T13:12:24.561 INFO:teuthology.orchestra.run.smithi099.stderr: 45600K .......... .......... .......... .......... .......... 27% 11.8M 8s 2024-03-30T13:12:24.564 INFO:teuthology.orchestra.run.smithi099.stderr: 45650K .......... .......... .......... .......... .......... 27% 14.4M 8s 2024-03-30T13:12:24.570 INFO:teuthology.orchestra.run.smithi099.stderr: 45700K .......... .......... .......... .......... .......... 27% 11.5M 8s 2024-03-30T13:12:24.571 INFO:teuthology.orchestra.run.smithi099.stderr: 45750K .......... .......... .......... .......... .......... 27% 18.5M 8s 2024-03-30T13:12:24.575 INFO:teuthology.orchestra.run.smithi099.stderr: 45800K .......... .......... .......... .......... .......... 27% 12.6M 8s 2024-03-30T13:12:24.578 INFO:teuthology.orchestra.run.smithi099.stderr: 45850K .......... .......... .......... .......... .......... 27% 14.4M 8s 2024-03-30T13:12:24.582 INFO:teuthology.orchestra.run.smithi099.stderr: 45900K .......... .......... .......... .......... .......... 27% 12.9M 8s 2024-03-30T13:12:24.587 INFO:teuthology.orchestra.run.smithi099.stderr: 45950K .......... .......... .......... .......... .......... 27% 12.7M 8s 2024-03-30T13:12:24.589 INFO:teuthology.orchestra.run.smithi099.stderr: 46000K .......... .......... .......... .......... .......... 27% 19.0M 8s 2024-03-30T13:12:24.593 INFO:teuthology.orchestra.run.smithi099.stderr: 46050K .......... .......... .......... .......... .......... 27% 11.5M 8s 2024-03-30T13:12:24.597 INFO:teuthology.orchestra.run.smithi099.stderr: 46100K .......... .......... .......... .......... .......... 27% 13.2M 8s 2024-03-30T13:12:24.600 INFO:teuthology.orchestra.run.smithi099.stderr: 46150K .......... .......... .......... .......... .......... 27% 13.5M 8s 2024-03-30T13:12:24.604 INFO:teuthology.orchestra.run.smithi099.stderr: 46200K .......... .......... .......... .......... .......... 27% 14.1M 8s 2024-03-30T13:12:24.606 INFO:teuthology.orchestra.run.smithi099.stderr: 46250K .......... .......... .......... .......... .......... 27% 17.8M 8s 2024-03-30T13:12:24.610 INFO:teuthology.orchestra.run.smithi099.stderr: 46300K .......... .......... .......... .......... .......... 27% 12.8M 8s 2024-03-30T13:12:24.613 INFO:teuthology.orchestra.run.smithi099.stderr: 46350K .......... .......... .......... .......... .......... 27% 15.2M 8s 2024-03-30T13:12:24.617 INFO:teuthology.orchestra.run.smithi099.stderr: 46400K .......... .......... .......... .......... .......... 27% 13.1M 8s 2024-03-30T13:12:24.621 INFO:teuthology.orchestra.run.smithi099.stderr: 46450K .......... .......... .......... .......... .......... 27% 11.2M 8s 2024-03-30T13:12:24.625 INFO:teuthology.orchestra.run.smithi099.stderr: 46500K .......... .......... .......... .......... .......... 27% 14.9M 8s 2024-03-30T13:12:24.629 INFO:teuthology.orchestra.run.smithi099.stderr: 46550K .......... .......... .......... .......... .......... 27% 12.4M 8s 2024-03-30T13:12:24.631 INFO:teuthology.orchestra.run.smithi099.stderr: 46600K .......... .......... .......... .......... .......... 27% 17.2M 8s 2024-03-30T13:12:24.635 INFO:teuthology.orchestra.run.smithi099.stderr: 46650K .......... .......... .......... .......... .......... 27% 13.4M 8s 2024-03-30T13:12:24.639 INFO:teuthology.orchestra.run.smithi099.stderr: 46700K .......... .......... .......... .......... .......... 27% 12.9M 8s 2024-03-30T13:12:24.641 INFO:teuthology.orchestra.run.smithi099.stderr: 46750K .......... .......... .......... .......... .......... 27% 20.8M 8s 2024-03-30T13:12:24.645 INFO:teuthology.orchestra.run.smithi099.stderr: 46800K .......... .......... .......... .......... .......... 27% 13.2M 8s 2024-03-30T13:12:24.648 INFO:teuthology.orchestra.run.smithi099.stderr: 46850K .......... .......... .......... .......... .......... 27% 14.0M 8s 2024-03-30T13:12:24.652 INFO:teuthology.orchestra.run.smithi099.stderr: 46900K .......... .......... .......... .......... .......... 27% 15.5M 8s 2024-03-30T13:12:24.660 INFO:teuthology.orchestra.run.smithi099.stderr: 46950K .......... .......... .......... .......... .......... 27% 11.7M 8s 2024-03-30T13:12:24.660 INFO:teuthology.orchestra.run.smithi099.stderr: 47000K .......... .......... .......... .......... .......... 27% 28.5M 8s 2024-03-30T13:12:24.661 INFO:teuthology.orchestra.run.smithi099.stderr: 47050K .......... .......... .......... .......... .......... 27% 12.6M 8s 2024-03-30T13:12:24.664 INFO:teuthology.orchestra.run.smithi099.stderr: 47100K .......... .......... .......... .......... .......... 27% 14.8M 8s 2024-03-30T13:12:24.671 INFO:teuthology.orchestra.run.smithi099.stderr: 47150K .......... .......... .......... .......... .......... 28% 13.2M 8s 2024-03-30T13:12:24.672 INFO:teuthology.orchestra.run.smithi099.stderr: 47200K .......... .......... .......... .......... .......... 28% 14.5M 8s 2024-03-30T13:12:24.674 INFO:teuthology.orchestra.run.smithi099.stderr: 47250K .......... .......... .......... .......... .......... 28% 18.7M 8s 2024-03-30T13:12:24.677 INFO:teuthology.orchestra.run.smithi099.stderr: 47300K .......... .......... .......... .......... .......... 28% 15.1M 8s 2024-03-30T13:12:24.681 INFO:teuthology.orchestra.run.smithi099.stderr: 47350K .......... .......... .......... .......... .......... 28% 16.5M 8s 2024-03-30T13:12:24.684 INFO:teuthology.orchestra.run.smithi099.stderr: 47400K .......... .......... .......... .......... .......... 28% 13.3M 8s 2024-03-30T13:12:24.689 INFO:teuthology.orchestra.run.smithi099.stderr: 47450K .......... .......... .......... .......... .......... 28% 10.6M 8s 2024-03-30T13:12:24.691 INFO:teuthology.orchestra.run.smithi099.stderr: 47500K .......... .......... .......... .......... .......... 28% 19.4M 8s 2024-03-30T13:12:24.694 INFO:teuthology.orchestra.run.smithi099.stderr: 47550K .......... .......... .......... .......... .......... 28% 15.0M 8s 2024-03-30T13:12:24.698 INFO:teuthology.orchestra.run.smithi099.stderr: 47600K .......... .......... .......... .......... .......... 28% 16.1M 8s 2024-03-30T13:12:24.702 INFO:teuthology.orchestra.run.smithi099.stderr: 47650K .......... .......... .......... .......... .......... 28% 11.0M 8s 2024-03-30T13:12:24.705 INFO:teuthology.orchestra.run.smithi099.stderr: 47700K .......... .......... .......... .......... .......... 28% 17.5M 8s 2024-03-30T13:12:24.708 INFO:teuthology.orchestra.run.smithi099.stderr: 47750K .......... .......... .......... .......... .......... 28% 13.9M 8s 2024-03-30T13:12:24.712 INFO:teuthology.orchestra.run.smithi099.stderr: 47800K .......... .......... .......... .......... .......... 28% 13.9M 8s 2024-03-30T13:12:24.715 INFO:teuthology.orchestra.run.smithi099.stderr: 47850K .......... .......... .......... .......... .......... 28% 15.6M 8s 2024-03-30T13:12:24.719 INFO:teuthology.orchestra.run.smithi099.stderr: 47900K .......... .......... .......... .......... .......... 28% 12.6M 8s 2024-03-30T13:12:24.722 INFO:teuthology.orchestra.run.smithi099.stderr: 47950K .......... .......... .......... .......... .......... 28% 14.8M 8s 2024-03-30T13:12:24.725 INFO:teuthology.orchestra.run.smithi099.stderr: 48000K .......... .......... .......... .......... .......... 28% 15.8M 8s 2024-03-30T13:12:24.729 INFO:teuthology.orchestra.run.smithi099.stderr: 48050K .......... .......... .......... .......... .......... 28% 12.9M 8s 2024-03-30T13:12:24.732 INFO:teuthology.orchestra.run.smithi099.stderr: 48100K .......... .......... .......... .......... .......... 28% 16.0M 8s 2024-03-30T13:12:24.736 INFO:teuthology.orchestra.run.smithi099.stderr: 48150K .......... .......... .......... .......... .......... 28% 11.4M 8s 2024-03-30T13:12:24.739 INFO:teuthology.orchestra.run.smithi099.stderr: 48200K .......... .......... .......... .......... .......... 28% 15.4M 8s 2024-03-30T13:12:24.743 INFO:teuthology.orchestra.run.smithi099.stderr: 48250K .......... .......... .......... .......... .......... 28% 12.9M 8s 2024-03-30T13:12:24.747 INFO:teuthology.orchestra.run.smithi099.stderr: 48300K .......... .......... .......... .......... .......... 28% 14.2M 8s 2024-03-30T13:12:24.749 INFO:teuthology.orchestra.run.smithi099.stderr: 48350K .......... .......... .......... .......... .......... 28% 16.6M 8s 2024-03-30T13:12:24.754 INFO:teuthology.orchestra.run.smithi099.stderr: 48400K .......... .......... .......... .......... .......... 28% 10.0M 8s 2024-03-30T13:12:24.757 INFO:teuthology.orchestra.run.smithi099.stderr: 48450K .......... .......... .......... .......... .......... 28% 17.9M 8s 2024-03-30T13:12:24.760 INFO:teuthology.orchestra.run.smithi099.stderr: 48500K .......... .......... .......... .......... .......... 28% 14.1M 8s 2024-03-30T13:12:24.764 INFO:teuthology.orchestra.run.smithi099.stderr: 48550K .......... .......... .......... .......... .......... 28% 14.3M 8s 2024-03-30T13:12:24.767 INFO:teuthology.orchestra.run.smithi099.stderr: 48600K .......... .......... .......... .......... .......... 28% 18.5M 8s 2024-03-30T13:12:24.770 INFO:teuthology.orchestra.run.smithi099.stderr: 48650K .......... .......... .......... .......... .......... 28% 12.7M 8s 2024-03-30T13:12:24.774 INFO:teuthology.orchestra.run.smithi099.stderr: 48700K .......... .......... .......... .......... .......... 28% 15.0M 8s 2024-03-30T13:12:24.777 INFO:teuthology.orchestra.run.smithi099.stderr: 48750K .......... .......... .......... .......... .......... 28% 14.6M 8s 2024-03-30T13:12:24.780 INFO:teuthology.orchestra.run.smithi099.stderr: 48800K .......... .......... .......... .......... .......... 28% 15.3M 8s 2024-03-30T13:12:24.785 INFO:teuthology.orchestra.run.smithi099.stderr: 48850K .......... .......... .......... .......... .......... 29% 11.3M 8s 2024-03-30T13:12:24.787 INFO:teuthology.orchestra.run.smithi099.stderr: 48900K .......... .......... .......... .......... .......... 29% 22.7M 8s 2024-03-30T13:12:24.789 INFO:teuthology.orchestra.run.smithi099.stderr: 48950K .......... .......... .......... .......... .......... 29% 18.6M 8s 2024-03-30T13:12:24.791 INFO:teuthology.orchestra.run.smithi099.stderr: 49000K .......... .......... .......... .......... .......... 29% 23.2M 8s 2024-03-30T13:12:24.794 INFO:teuthology.orchestra.run.smithi099.stderr: 49050K .......... .......... .......... .......... .......... 29% 18.8M 8s 2024-03-30T13:12:24.797 INFO:teuthology.orchestra.run.smithi099.stderr: 49100K .......... .......... .......... .......... .......... 29% 17.5M 8s 2024-03-30T13:12:24.799 INFO:teuthology.orchestra.run.smithi099.stderr: 49150K .......... .......... .......... .......... .......... 29% 22.4M 8s 2024-03-30T13:12:24.801 INFO:teuthology.orchestra.run.smithi099.stderr: 49200K .......... .......... .......... .......... .......... 29% 24.1M 8s 2024-03-30T13:12:24.803 INFO:teuthology.orchestra.run.smithi099.stderr: 49250K .......... .......... .......... .......... .......... 29% 20.3M 8s 2024-03-30T13:12:24.814 INFO:teuthology.orchestra.run.smithi099.stderr: 49300K .......... .......... .......... .......... .......... 29% 4.53M 8s 2024-03-30T13:12:24.817 INFO:teuthology.orchestra.run.smithi099.stderr: 49350K .......... .......... .......... .......... .......... 29% 20.2M 8s 2024-03-30T13:12:24.822 INFO:teuthology.orchestra.run.smithi099.stderr: 49400K .......... .......... .......... .......... .......... 29% 9.69M 8s 2024-03-30T13:12:24.825 INFO:teuthology.orchestra.run.smithi099.stderr: 49450K .......... .......... .......... .......... .......... 29% 15.0M 8s 2024-03-30T13:12:24.828 INFO:teuthology.orchestra.run.smithi099.stderr: 49500K .......... .......... .......... .......... .......... 29% 16.0M 8s 2024-03-30T13:12:24.831 INFO:teuthology.orchestra.run.smithi099.stderr: 49550K .......... .......... .......... .......... .......... 29% 16.0M 8s 2024-03-30T13:12:24.836 INFO:teuthology.orchestra.run.smithi099.stderr: 49600K .......... .......... .......... .......... .......... 29% 10.8M 8s 2024-03-30T13:12:24.839 INFO:teuthology.orchestra.run.smithi099.stderr: 49650K .......... .......... .......... .......... .......... 29% 16.0M 8s 2024-03-30T13:12:24.841 INFO:teuthology.orchestra.run.smithi099.stderr: 49700K .......... .......... .......... .......... .......... 29% 16.7M 8s 2024-03-30T13:12:24.844 INFO:teuthology.orchestra.run.smithi099.stderr: 49750K .......... .......... .......... .......... .......... 29% 16.9M 8s 2024-03-30T13:12:24.847 INFO:teuthology.orchestra.run.smithi099.stderr: 49800K .......... .......... .......... .......... .......... 29% 15.8M 8s 2024-03-30T13:12:24.851 INFO:teuthology.orchestra.run.smithi099.stderr: 49850K .......... .......... .......... .......... .......... 29% 14.1M 8s 2024-03-30T13:12:24.854 INFO:teuthology.orchestra.run.smithi099.stderr: 49900K .......... .......... .......... .......... .......... 29% 18.8M 8s 2024-03-30T13:12:24.856 INFO:teuthology.orchestra.run.smithi099.stderr: 49950K .......... .......... .......... .......... .......... 29% 16.5M 8s 2024-03-30T13:12:24.863 INFO:teuthology.orchestra.run.smithi099.stderr: 50000K .......... .......... .......... .......... .......... 29% 18.9M 8s 2024-03-30T13:12:24.864 INFO:teuthology.orchestra.run.smithi099.stderr: 50050K .......... .......... .......... .......... .......... 29% 17.1M 8s 2024-03-30T13:12:24.865 INFO:teuthology.orchestra.run.smithi099.stderr: 50100K .......... .......... .......... .......... .......... 29% 13.0M 8s 2024-03-30T13:12:24.874 INFO:teuthology.orchestra.run.smithi099.stderr: 50150K .......... .......... .......... .......... .......... 29% 5.79M 8s 2024-03-30T13:12:24.878 INFO:teuthology.orchestra.run.smithi099.stderr: 50200K .......... .......... .......... .......... .......... 29% 11.5M 8s 2024-03-30T13:12:24.881 INFO:teuthology.orchestra.run.smithi099.stderr: 50250K .......... .......... .......... .......... .......... 29% 19.3M 8s 2024-03-30T13:12:24.883 INFO:teuthology.orchestra.run.smithi099.stderr: 50300K .......... .......... .......... .......... .......... 29% 17.5M 8s 2024-03-30T13:12:24.888 INFO:teuthology.orchestra.run.smithi099.stderr: 50350K .......... .......... .......... .......... .......... 29% 11.8M 8s 2024-03-30T13:12:24.891 INFO:teuthology.orchestra.run.smithi099.stderr: 50400K .......... .......... .......... .......... .......... 29% 17.9M 8s 2024-03-30T13:12:24.894 INFO:teuthology.orchestra.run.smithi099.stderr: 50450K .......... .......... .......... .......... .......... 29% 14.2M 8s 2024-03-30T13:12:24.898 INFO:teuthology.orchestra.run.smithi099.stderr: 50500K .......... .......... .......... .......... .......... 29% 14.2M 8s 2024-03-30T13:12:24.900 INFO:teuthology.orchestra.run.smithi099.stderr: 50550K .......... .......... .......... .......... .......... 30% 16.0M 8s 2024-03-30T13:12:24.904 INFO:teuthology.orchestra.run.smithi099.stderr: 50600K .......... .......... .......... .......... .......... 30% 14.0M 8s 2024-03-30T13:12:24.907 INFO:teuthology.orchestra.run.smithi099.stderr: 50650K .......... .......... .......... .......... .......... 30% 14.8M 8s 2024-03-30T13:12:24.910 INFO:teuthology.orchestra.run.smithi099.stderr: 50700K .......... .......... .......... .......... .......... 30% 20.2M 8s 2024-03-30T13:12:24.913 INFO:teuthology.orchestra.run.smithi099.stderr: 50750K .......... .......... .......... .......... .......... 30% 13.3M 8s 2024-03-30T13:12:24.915 INFO:teuthology.orchestra.run.smithi099.stderr: 50800K .......... .......... .......... .......... .......... 30% 22.9M 8s 2024-03-30T13:12:24.919 INFO:teuthology.orchestra.run.smithi099.stderr: 50850K .......... .......... .......... .......... .......... 30% 13.5M 8s 2024-03-30T13:12:24.922 INFO:teuthology.orchestra.run.smithi099.stderr: 50900K .......... .......... .......... .......... .......... 30% 20.8M 8s 2024-03-30T13:12:24.924 INFO:teuthology.orchestra.run.smithi099.stderr: 50950K .......... .......... .......... .......... .......... 30% 20.5M 8s 2024-03-30T13:12:24.926 INFO:teuthology.orchestra.run.smithi099.stderr: 51000K .......... .......... .......... .......... .......... 30% 19.2M 8s 2024-03-30T13:12:24.929 INFO:teuthology.orchestra.run.smithi099.stderr: 51050K .......... .......... .......... .......... .......... 30% 17.1M 8s 2024-03-30T13:12:24.932 INFO:teuthology.orchestra.run.smithi099.stderr: 51100K .......... .......... .......... .......... .......... 30% 14.6M 8s 2024-03-30T13:12:24.938 INFO:teuthology.orchestra.run.smithi099.stderr: 51150K .......... .......... .......... .......... .......... 30% 10.4M 8s 2024-03-30T13:12:24.940 INFO:teuthology.orchestra.run.smithi099.stderr: 51200K .......... .......... .......... .......... .......... 30% 14.8M 8s 2024-03-30T13:12:24.945 INFO:teuthology.orchestra.run.smithi099.stderr: 51250K .......... .......... .......... .......... .......... 30% 11.9M 8s 2024-03-30T13:12:24.948 INFO:teuthology.orchestra.run.smithi099.stderr: 51300K .......... .......... .......... .......... .......... 30% 13.6M 8s 2024-03-30T13:12:24.951 INFO:teuthology.orchestra.run.smithi099.stderr: 51350K .......... .......... .......... .......... .......... 30% 17.2M 8s 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi099.stderr: 51400K .......... .......... .......... .......... .......... 30% 18.0M 8s 2024-03-30T13:12:24.957 INFO:teuthology.orchestra.run.smithi099.stderr: 51450K .......... .......... .......... .......... .......... 30% 13.9M 8s 2024-03-30T13:12:24.962 INFO:teuthology.orchestra.run.smithi099.stderr: 51500K .......... .......... .......... .......... .......... 30% 11.5M 8s 2024-03-30T13:12:24.964 INFO:teuthology.orchestra.run.smithi099.stderr: 51550K .......... .......... .......... .......... .......... 30% 18.6M 8s 2024-03-30T13:12:24.968 INFO:teuthology.orchestra.run.smithi099.stderr: 51600K .......... .......... .......... .......... .......... 30% 14.6M 8s 2024-03-30T13:12:24.970 INFO:teuthology.orchestra.run.smithi099.stderr: 51650K .......... .......... .......... .......... .......... 30% 20.2M 8s 2024-03-30T13:12:24.974 INFO:teuthology.orchestra.run.smithi099.stderr: 51700K .......... .......... .......... .......... .......... 30% 12.4M 8s 2024-03-30T13:12:24.978 INFO:teuthology.orchestra.run.smithi099.stderr: 51750K .......... .......... .......... .......... .......... 30% 13.0M 8s 2024-03-30T13:12:24.981 INFO:teuthology.orchestra.run.smithi099.stderr: 51800K .......... .......... .......... .......... .......... 30% 17.7M 8s 2024-03-30T13:12:24.984 INFO:teuthology.orchestra.run.smithi099.stderr: 51850K .......... .......... .......... .......... .......... 30% 13.4M 8s 2024-03-30T13:12:24.987 INFO:teuthology.orchestra.run.smithi099.stderr: 51900K .......... .......... .......... .......... .......... 30% 19.1M 8s 2024-03-30T13:12:24.990 INFO:teuthology.orchestra.run.smithi099.stderr: 51950K .......... .......... .......... .......... .......... 30% 14.7M 8s 2024-03-30T13:12:24.995 INFO:teuthology.orchestra.run.smithi099.stderr: 52000K .......... .......... .......... .......... .......... 30% 10.3M 8s 2024-03-30T13:12:24.999 INFO:teuthology.orchestra.run.smithi099.stderr: 52050K .......... .......... .......... .......... .......... 30% 11.9M 8s 2024-03-30T13:12:25.005 INFO:teuthology.orchestra.run.smithi099.stderr: 52100K .......... .......... .......... .......... .......... 30% 8.40M 8s 2024-03-30T13:12:25.007 INFO:teuthology.orchestra.run.smithi099.stderr: 52150K .......... .......... .......... .......... .......... 30% 20.9M 8s 2024-03-30T13:12:25.010 INFO:teuthology.orchestra.run.smithi099.stderr: 52200K .......... .......... .......... .......... .......... 30% 13.7M 8s 2024-03-30T13:12:25.015 INFO:teuthology.orchestra.run.smithi099.stderr: 52250K .......... .......... .......... .......... .......... 31% 10.9M 8s 2024-03-30T13:12:25.018 INFO:teuthology.orchestra.run.smithi099.stderr: 52300K .......... .......... .......... .......... .......... 31% 16.0M 8s 2024-03-30T13:12:25.023 INFO:teuthology.orchestra.run.smithi099.stderr: 52350K .......... .......... .......... .......... .......... 31% 10.5M 8s 2024-03-30T13:12:25.025 INFO:teuthology.orchestra.run.smithi099.stderr: 52400K .......... .......... .......... .......... .......... 31% 19.3M 8s 2024-03-30T13:12:25.028 INFO:teuthology.orchestra.run.smithi099.stderr: 52450K .......... .......... .......... .......... .......... 31% 16.3M 8s 2024-03-30T13:12:25.032 INFO:teuthology.orchestra.run.smithi099.stderr: 52500K .......... .......... .......... .......... .......... 31% 13.2M 8s 2024-03-30T13:12:25.035 INFO:teuthology.orchestra.run.smithi099.stderr: 52550K .......... .......... .......... .......... .......... 31% 13.8M 8s 2024-03-30T13:12:25.039 INFO:teuthology.orchestra.run.smithi099.stderr: 52600K .......... .......... .......... .......... .......... 31% 13.8M 8s 2024-03-30T13:12:25.042 INFO:teuthology.orchestra.run.smithi099.stderr: 52650K .......... .......... .......... .......... .......... 31% 15.5M 8s 2024-03-30T13:12:25.045 INFO:teuthology.orchestra.run.smithi099.stderr: 52700K .......... .......... .......... .......... .......... 31% 18.8M 8s 2024-03-30T13:12:25.049 INFO:teuthology.orchestra.run.smithi099.stderr: 52750K .......... .......... .......... .......... .......... 31% 13.1M 8s 2024-03-30T13:12:25.051 INFO:teuthology.orchestra.run.smithi099.stderr: 52800K .......... .......... .......... .......... .......... 31% 18.3M 8s 2024-03-30T13:12:25.054 INFO:teuthology.orchestra.run.smithi099.stderr: 52850K .......... .......... .......... .......... .......... 31% 15.5M 8s 2024-03-30T13:12:25.056 INFO:teuthology.orchestra.run.smithi099.stderr: 52900K .......... .......... .......... .......... .......... 31% 21.3M 8s 2024-03-30T13:12:25.063 INFO:teuthology.orchestra.run.smithi099.stderr: 52950K .......... .......... .......... .......... .......... 31% 13.5M 8s 2024-03-30T13:12:25.064 INFO:teuthology.orchestra.run.smithi099.stderr: 53000K .......... .......... .......... .......... .......... 31% 17.8M 8s 2024-03-30T13:12:25.067 INFO:teuthology.orchestra.run.smithi099.stderr: 53050K .......... .......... .......... .......... .......... 31% 11.1M 8s 2024-03-30T13:12:25.071 INFO:teuthology.orchestra.run.smithi099.stderr: 53100K .......... .......... .......... .......... .......... 31% 13.4M 8s 2024-03-30T13:12:25.074 INFO:teuthology.orchestra.run.smithi099.stderr: 53150K .......... .......... .......... .......... .......... 31% 15.7M 8s 2024-03-30T13:12:25.079 INFO:teuthology.orchestra.run.smithi099.stderr: 53200K .......... .......... .......... .......... .......... 31% 9.48M 8s 2024-03-30T13:12:25.083 INFO:teuthology.orchestra.run.smithi099.stderr: 53250K .......... .......... .......... .......... .......... 31% 13.1M 8s 2024-03-30T13:12:25.086 INFO:teuthology.orchestra.run.smithi099.stderr: 53300K .......... .......... .......... .......... .......... 31% 16.1M 8s 2024-03-30T13:12:25.089 INFO:teuthology.orchestra.run.smithi099.stderr: 53350K .......... .......... .......... .......... .......... 31% 14.5M 8s 2024-03-30T13:12:25.092 INFO:teuthology.orchestra.run.smithi099.stderr: 53400K .......... .......... .......... .......... .......... 31% 16.2M 8s 2024-03-30T13:12:25.096 INFO:teuthology.orchestra.run.smithi099.stderr: 53450K .......... .......... .......... .......... .......... 31% 11.9M 8s 2024-03-30T13:12:25.099 INFO:teuthology.orchestra.run.smithi099.stderr: 53500K .......... .......... .......... .......... .......... 31% 16.2M 8s 2024-03-30T13:12:25.102 INFO:teuthology.orchestra.run.smithi099.stderr: 53550K .......... .......... .......... .......... .......... 31% 19.6M 8s 2024-03-30T13:12:25.107 INFO:teuthology.orchestra.run.smithi099.stderr: 53600K .......... .......... .......... .......... .......... 31% 12.3M 8s 2024-03-30T13:12:25.110 INFO:teuthology.orchestra.run.smithi099.stderr: 53650K .......... .......... .......... .......... .......... 31% 23.9M 8s 2024-03-30T13:12:25.112 INFO:teuthology.orchestra.run.smithi099.stderr: 53700K .......... .......... .......... .......... .......... 31% 12.4M 8s 2024-03-30T13:12:25.115 INFO:teuthology.orchestra.run.smithi099.stderr: 53750K .......... .......... .......... .......... .......... 31% 16.6M 8s 2024-03-30T13:12:25.117 INFO:teuthology.orchestra.run.smithi099.stderr: 53800K .......... .......... .......... .......... .......... 31% 19.8M 8s 2024-03-30T13:12:25.121 INFO:teuthology.orchestra.run.smithi099.stderr: 53850K .......... .......... .......... .......... .......... 31% 13.2M 8s 2024-03-30T13:12:25.125 INFO:teuthology.orchestra.run.smithi099.stderr: 53900K .......... .......... .......... .......... .......... 32% 11.7M 8s 2024-03-30T13:12:25.129 INFO:teuthology.orchestra.run.smithi099.stderr: 53950K .......... .......... .......... .......... .......... 32% 11.8M 8s 2024-03-30T13:12:25.133 INFO:teuthology.orchestra.run.smithi099.stderr: 54000K .......... .......... .......... .......... .......... 32% 12.9M 8s 2024-03-30T13:12:25.137 INFO:teuthology.orchestra.run.smithi099.stderr: 54050K .......... .......... .......... .......... .......... 32% 12.9M 8s 2024-03-30T13:12:25.142 INFO:teuthology.orchestra.run.smithi099.stderr: 54100K .......... .......... .......... .......... .......... 32% 10.3M 8s 2024-03-30T13:12:25.144 INFO:teuthology.orchestra.run.smithi099.stderr: 54150K .......... .......... .......... .......... .......... 32% 17.6M 8s 2024-03-30T13:12:25.151 INFO:teuthology.orchestra.run.smithi099.stderr: 54200K .......... .......... .......... .......... .......... 32% 7.35M 8s 2024-03-30T13:12:25.153 INFO:teuthology.orchestra.run.smithi099.stderr: 54250K .......... .......... .......... .......... .......... 32% 30.5M 8s 2024-03-30T13:12:25.155 INFO:teuthology.orchestra.run.smithi099.stderr: 54300K .......... .......... .......... .......... .......... 32% 19.3M 8s 2024-03-30T13:12:25.160 INFO:teuthology.orchestra.run.smithi099.stderr: 54350K .......... .......... .......... .......... .......... 32% 14.7M 8s 2024-03-30T13:12:25.163 INFO:teuthology.orchestra.run.smithi099.stderr: 54400K .......... .......... .......... .......... .......... 32% 11.4M 8s 2024-03-30T13:12:25.166 INFO:teuthology.orchestra.run.smithi099.stderr: 54450K .......... .......... .......... .......... .......... 32% 16.7M 8s 2024-03-30T13:12:25.169 INFO:teuthology.orchestra.run.smithi099.stderr: 54500K .......... .......... .......... .......... .......... 32% 16.8M 8s 2024-03-30T13:12:25.172 INFO:teuthology.orchestra.run.smithi099.stderr: 54550K .......... .......... .......... .......... .......... 32% 14.3M 8s 2024-03-30T13:12:25.175 INFO:teuthology.orchestra.run.smithi099.stderr: 54600K .......... .......... .......... .......... .......... 32% 15.4M 8s 2024-03-30T13:12:25.179 INFO:teuthology.orchestra.run.smithi099.stderr: 54650K .......... .......... .......... .......... .......... 32% 15.0M 8s 2024-03-30T13:12:25.181 INFO:teuthology.orchestra.run.smithi099.stderr: 54700K .......... .......... .......... .......... .......... 32% 20.3M 8s 2024-03-30T13:12:25.185 INFO:teuthology.orchestra.run.smithi099.stderr: 54750K .......... .......... .......... .......... .......... 32% 12.6M 8s 2024-03-30T13:12:25.187 INFO:teuthology.orchestra.run.smithi099.stderr: 54800K .......... .......... .......... .......... .......... 32% 17.3M 8s 2024-03-30T13:12:25.191 INFO:teuthology.orchestra.run.smithi099.stderr: 54850K .......... .......... .......... .......... .......... 32% 21.3M 8s 2024-03-30T13:12:25.194 INFO:teuthology.orchestra.run.smithi099.stderr: 54900K .......... .......... .......... .......... .......... 32% 11.9M 8s 2024-03-30T13:12:25.198 INFO:teuthology.orchestra.run.smithi099.stderr: 54950K .......... .......... .......... .......... .......... 32% 13.3M 8s 2024-03-30T13:12:25.201 INFO:teuthology.orchestra.run.smithi099.stderr: 55000K .......... .......... .......... .......... .......... 32% 15.2M 8s 2024-03-30T13:12:25.206 INFO:teuthology.orchestra.run.smithi099.stderr: 55050K .......... .......... .......... .......... .......... 32% 9.41M 8s 2024-03-30T13:12:25.210 INFO:teuthology.orchestra.run.smithi099.stderr: 55100K .......... .......... .......... .......... .......... 32% 25.8M 8s 2024-03-30T13:12:25.212 INFO:teuthology.orchestra.run.smithi099.stderr: 55150K .......... .......... .......... .......... .......... 32% 11.8M 8s 2024-03-30T13:12:25.216 INFO:teuthology.orchestra.run.smithi099.stderr: 55200K .......... .......... .......... .......... .......... 32% 12.7M 8s 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi099.stderr: 55250K .......... .......... .......... .......... .......... 32% 16.0M 8s 2024-03-30T13:12:25.222 INFO:teuthology.orchestra.run.smithi099.stderr: 55300K .......... .......... .......... .......... .......... 32% 13.9M 8s 2024-03-30T13:12:25.227 INFO:teuthology.orchestra.run.smithi099.stderr: 55350K .......... .......... .......... .......... .......... 32% 13.5M 8s 2024-03-30T13:12:25.230 INFO:teuthology.orchestra.run.smithi099.stderr: 55400K .......... .......... .......... .......... .......... 32% 11.7M 8s 2024-03-30T13:12:25.233 INFO:teuthology.orchestra.run.smithi099.stderr: 55450K .......... .......... .......... .......... .......... 32% 16.8M 8s 2024-03-30T13:12:25.236 INFO:teuthology.orchestra.run.smithi099.stderr: 55500K .......... .......... .......... .......... .......... 32% 16.5M 8s 2024-03-30T13:12:25.239 INFO:teuthology.orchestra.run.smithi099.stderr: 55550K .......... .......... .......... .......... .......... 32% 18.1M 8s 2024-03-30T13:12:25.243 INFO:teuthology.orchestra.run.smithi099.stderr: 55600K .......... .......... .......... .......... .......... 33% 12.3M 8s 2024-03-30T13:12:25.247 INFO:teuthology.orchestra.run.smithi099.stderr: 55650K .......... .......... .......... .......... .......... 33% 12.1M 8s 2024-03-30T13:12:25.248 INFO:teuthology.orchestra.run.smithi099.stderr: 55700K .......... .......... .......... .......... .......... 33% 29.0M 8s 2024-03-30T13:12:25.252 INFO:teuthology.orchestra.run.smithi099.stderr: 55750K .......... .......... .......... .......... .......... 33% 14.5M 8s 2024-03-30T13:12:25.256 INFO:teuthology.orchestra.run.smithi099.stderr: 55800K .......... .......... .......... .......... .......... 33% 21.0M 8s 2024-03-30T13:12:25.259 INFO:teuthology.orchestra.run.smithi099.stderr: 55850K .......... .......... .......... .......... .......... 33% 11.2M 8s 2024-03-30T13:12:25.264 INFO:teuthology.orchestra.run.smithi099.stderr: 55900K .......... .......... .......... .......... .......... 33% 9.08M 8s 2024-03-30T13:12:25.271 INFO:teuthology.orchestra.run.smithi099.stderr: 55950K .......... .......... .......... .......... .......... 33% 18.6M 8s 2024-03-30T13:12:25.271 INFO:teuthology.orchestra.run.smithi099.stderr: 56000K .......... .......... .......... .......... .......... 33% 13.5M 8s 2024-03-30T13:12:25.274 INFO:teuthology.orchestra.run.smithi099.stderr: 56050K .......... .......... .......... .......... .......... 33% 11.5M 8s 2024-03-30T13:12:25.277 INFO:teuthology.orchestra.run.smithi099.stderr: 56100K .......... .......... .......... .......... .......... 33% 19.7M 8s 2024-03-30T13:12:25.282 INFO:teuthology.orchestra.run.smithi099.stderr: 56150K .......... .......... .......... .......... .......... 33% 11.2M 8s 2024-03-30T13:12:25.285 INFO:teuthology.orchestra.run.smithi099.stderr: 56200K .......... .......... .......... .......... .......... 33% 13.1M 8s 2024-03-30T13:12:25.288 INFO:teuthology.orchestra.run.smithi099.stderr: 56250K .......... .......... .......... .......... .......... 33% 13.9M 8s 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi099.stderr: 56300K .......... .......... .......... .......... .......... 33% 13.8M 8s 2024-03-30T13:12:25.295 INFO:teuthology.orchestra.run.smithi099.stderr: 56350K .......... .......... .......... .......... .......... 33% 15.3M 8s 2024-03-30T13:12:25.298 INFO:teuthology.orchestra.run.smithi099.stderr: 56400K .......... .......... .......... .......... .......... 33% 16.8M 8s 2024-03-30T13:12:25.301 INFO:teuthology.orchestra.run.smithi099.stderr: 56450K .......... .......... .......... .......... .......... 33% 15.1M 8s 2024-03-30T13:12:25.305 INFO:teuthology.orchestra.run.smithi099.stderr: 56500K .......... .......... .......... .......... .......... 33% 13.1M 8s 2024-03-30T13:12:25.308 INFO:teuthology.orchestra.run.smithi099.stderr: 56550K .......... .......... .......... .......... .......... 33% 14.9M 8s 2024-03-30T13:12:25.312 INFO:teuthology.orchestra.run.smithi099.stderr: 56600K .......... .......... .......... .......... .......... 33% 14.8M 8s 2024-03-30T13:12:25.314 INFO:teuthology.orchestra.run.smithi099.stderr: 56650K .......... .......... .......... .......... .......... 33% 17.7M 8s 2024-03-30T13:12:25.318 INFO:teuthology.orchestra.run.smithi099.stderr: 56700K .......... .......... .......... .......... .......... 33% 13.9M 8s 2024-03-30T13:12:25.322 INFO:teuthology.orchestra.run.smithi099.stderr: 56750K .......... .......... .......... .......... .......... 33% 12.1M 8s 2024-03-30T13:12:25.326 INFO:teuthology.orchestra.run.smithi099.stderr: 56800K .......... .......... .......... .......... .......... 33% 14.7M 8s 2024-03-30T13:12:25.328 INFO:teuthology.orchestra.run.smithi099.stderr: 56850K .......... .......... .......... .......... .......... 33% 19.2M 8s 2024-03-30T13:12:25.332 INFO:teuthology.orchestra.run.smithi099.stderr: 56900K .......... .......... .......... .......... .......... 33% 13.3M 8s 2024-03-30T13:12:25.335 INFO:teuthology.orchestra.run.smithi099.stderr: 56950K .......... .......... .......... .......... .......... 33% 14.0M 8s 2024-03-30T13:12:25.338 INFO:teuthology.orchestra.run.smithi099.stderr: 57000K .......... .......... .......... .......... .......... 33% 14.4M 8s 2024-03-30T13:12:25.343 INFO:teuthology.orchestra.run.smithi099.stderr: 57050K .......... .......... .......... .......... .......... 33% 11.3M 8s 2024-03-30T13:12:25.346 INFO:teuthology.orchestra.run.smithi099.stderr: 57100K .......... .......... .......... .......... .......... 33% 15.1M 8s 2024-03-30T13:12:25.349 INFO:teuthology.orchestra.run.smithi099.stderr: 57150K .......... .......... .......... .......... .......... 33% 16.8M 8s 2024-03-30T13:12:25.352 INFO:teuthology.orchestra.run.smithi099.stderr: 57200K .......... .......... .......... .......... .......... 33% 13.3M 8s 2024-03-30T13:12:25.357 INFO:teuthology.orchestra.run.smithi099.stderr: 57250K .......... .......... .......... .......... .......... 33% 14.7M 8s 2024-03-30T13:12:25.360 INFO:teuthology.orchestra.run.smithi099.stderr: 57300K .......... .......... .......... .......... .......... 34% 12.6M 8s 2024-03-30T13:12:25.363 INFO:teuthology.orchestra.run.smithi099.stderr: 57350K .......... .......... .......... .......... .......... 34% 13.4M 8s 2024-03-30T13:12:25.367 INFO:teuthology.orchestra.run.smithi099.stderr: 57400K .......... .......... .......... .......... .......... 34% 14.3M 8s 2024-03-30T13:12:25.370 INFO:teuthology.orchestra.run.smithi099.stderr: 57450K .......... .......... .......... .......... .......... 34% 14.8M 8s 2024-03-30T13:12:25.374 INFO:teuthology.orchestra.run.smithi099.stderr: 57500K .......... .......... .......... .......... .......... 34% 18.4M 8s 2024-03-30T13:12:25.377 INFO:teuthology.orchestra.run.smithi099.stderr: 57550K .......... .......... .......... .......... .......... 34% 10.8M 8s 2024-03-30T13:12:25.381 INFO:teuthology.orchestra.run.smithi099.stderr: 57600K .......... .......... .......... .......... .......... 34% 15.2M 8s 2024-03-30T13:12:25.382 INFO:teuthology.orchestra.run.smithi099.stderr: 57650K .......... .......... .......... .......... .......... 34% 22.4M 8s 2024-03-30T13:12:25.386 INFO:teuthology.orchestra.run.smithi099.stderr: 57700K .......... .......... .......... .......... .......... 34% 14.5M 8s 2024-03-30T13:12:25.390 INFO:teuthology.orchestra.run.smithi099.stderr: 57750K .......... .......... .......... .......... .......... 34% 12.5M 8s 2024-03-30T13:12:25.394 INFO:teuthology.orchestra.run.smithi099.stderr: 57800K .......... .......... .......... .......... .......... 34% 12.7M 8s 2024-03-30T13:12:25.397 INFO:teuthology.orchestra.run.smithi099.stderr: 57850K .......... .......... .......... .......... .......... 34% 13.6M 8s 2024-03-30T13:12:25.400 INFO:teuthology.orchestra.run.smithi099.stderr: 57900K .......... .......... .......... .......... .......... 34% 17.2M 8s 2024-03-30T13:12:25.404 INFO:teuthology.orchestra.run.smithi099.stderr: 57950K .......... .......... .......... .......... .......... 34% 11.9M 8s 2024-03-30T13:12:25.409 INFO:teuthology.orchestra.run.smithi099.stderr: 58000K .......... .......... .......... .......... .......... 34% 12.7M 8s 2024-03-30T13:12:25.411 INFO:teuthology.orchestra.run.smithi099.stderr: 58050K .......... .......... .......... .......... .......... 34% 15.5M 8s 2024-03-30T13:12:25.415 INFO:teuthology.orchestra.run.smithi099.stderr: 58100K .......... .......... .......... .......... .......... 34% 15.0M 8s 2024-03-30T13:12:25.418 INFO:teuthology.orchestra.run.smithi099.stderr: 58150K .......... .......... .......... .......... .......... 34% 14.4M 8s 2024-03-30T13:12:25.421 INFO:teuthology.orchestra.run.smithi099.stderr: 58200K .......... .......... .......... .......... .......... 34% 14.3M 8s 2024-03-30T13:12:25.425 INFO:teuthology.orchestra.run.smithi099.stderr: 58250K .......... .......... .......... .......... .......... 34% 12.5M 8s 2024-03-30T13:12:25.429 INFO:teuthology.orchestra.run.smithi099.stderr: 58300K .......... .......... .......... .......... .......... 34% 14.1M 8s 2024-03-30T13:12:25.431 INFO:teuthology.orchestra.run.smithi099.stderr: 58350K .......... .......... .......... .......... .......... 34% 22.3M 8s 2024-03-30T13:12:25.436 INFO:teuthology.orchestra.run.smithi099.stderr: 58400K .......... .......... .......... .......... .......... 34% 9.97M 8s 2024-03-30T13:12:25.438 INFO:teuthology.orchestra.run.smithi099.stderr: 58450K .......... .......... .......... .......... .......... 34% 21.7M 8s 2024-03-30T13:12:25.442 INFO:teuthology.orchestra.run.smithi099.stderr: 58500K .......... .......... .......... .......... .......... 34% 13.9M 8s 2024-03-30T13:12:25.445 INFO:teuthology.orchestra.run.smithi099.stderr: 58550K .......... .......... .......... .......... .......... 34% 13.4M 8s 2024-03-30T13:12:25.449 INFO:teuthology.orchestra.run.smithi099.stderr: 58600K .......... .......... .......... .......... .......... 34% 14.1M 8s 2024-03-30T13:12:25.452 INFO:teuthology.orchestra.run.smithi099.stderr: 58650K .......... .......... .......... .......... .......... 34% 15.0M 7s 2024-03-30T13:12:25.455 INFO:teuthology.orchestra.run.smithi099.stderr: 58700K .......... .......... .......... .......... .......... 34% 14.0M 7s 2024-03-30T13:12:25.459 INFO:teuthology.orchestra.run.smithi099.stderr: 58750K .......... .......... .......... .......... .......... 34% 12.7M 7s 2024-03-30T13:12:25.462 INFO:teuthology.orchestra.run.smithi099.stderr: 58800K .......... .......... .......... .......... .......... 34% 15.5M 7s 2024-03-30T13:12:25.466 INFO:teuthology.orchestra.run.smithi099.stderr: 58850K .......... .......... .......... .......... .......... 34% 15.8M 7s 2024-03-30T13:12:25.469 INFO:teuthology.orchestra.run.smithi099.stderr: 58900K .......... .......... .......... .......... .......... 34% 13.8M 7s 2024-03-30T13:12:25.473 INFO:teuthology.orchestra.run.smithi099.stderr: 58950K .......... .......... .......... .......... .......... 35% 16.0M 7s 2024-03-30T13:12:25.476 INFO:teuthology.orchestra.run.smithi099.stderr: 59000K .......... .......... .......... .......... .......... 35% 11.7M 7s 2024-03-30T13:12:25.480 INFO:teuthology.orchestra.run.smithi099.stderr: 59050K .......... .......... .......... .......... .......... 35% 16.1M 7s 2024-03-30T13:12:25.482 INFO:teuthology.orchestra.run.smithi099.stderr: 59100K .......... .......... .......... .......... .......... 35% 16.4M 7s 2024-03-30T13:12:25.486 INFO:teuthology.orchestra.run.smithi099.stderr: 59150K .......... .......... .......... .......... .......... 35% 13.0M 7s 2024-03-30T13:12:25.490 INFO:teuthology.orchestra.run.smithi099.stderr: 59200K .......... .......... .......... .......... .......... 35% 12.8M 7s 2024-03-30T13:12:25.493 INFO:teuthology.orchestra.run.smithi099.stderr: 59250K .......... .......... .......... .......... .......... 35% 15.9M 7s 2024-03-30T13:12:25.496 INFO:teuthology.orchestra.run.smithi099.stderr: 59300K .......... .......... .......... .......... .......... 35% 16.7M 7s 2024-03-30T13:12:25.499 INFO:teuthology.orchestra.run.smithi099.stderr: 59350K .......... .......... .......... .......... .......... 35% 13.0M 7s 2024-03-30T13:12:25.503 INFO:teuthology.orchestra.run.smithi099.stderr: 59400K .......... .......... .......... .......... .......... 35% 12.7M 7s 2024-03-30T13:12:25.507 INFO:teuthology.orchestra.run.smithi099.stderr: 59450K .......... .......... .......... .......... .......... 35% 12.9M 7s 2024-03-30T13:12:25.511 INFO:teuthology.orchestra.run.smithi099.stderr: 59500K .......... .......... .......... .......... .......... 35% 14.4M 7s 2024-03-30T13:12:25.514 INFO:teuthology.orchestra.run.smithi099.stderr: 59550K .......... .......... .......... .......... .......... 35% 13.9M 7s 2024-03-30T13:12:25.517 INFO:teuthology.orchestra.run.smithi099.stderr: 59600K .......... .......... .......... .......... .......... 35% 17.1M 7s 2024-03-30T13:12:25.520 INFO:teuthology.orchestra.run.smithi099.stderr: 59650K .......... .......... .......... .......... .......... 35% 15.7M 7s 2024-03-30T13:12:25.525 INFO:teuthology.orchestra.run.smithi099.stderr: 59700K .......... .......... .......... .......... .......... 35% 11.4M 7s 2024-03-30T13:12:25.527 INFO:teuthology.orchestra.run.smithi099.stderr: 59750K .......... .......... .......... .......... .......... 35% 16.4M 7s 2024-03-30T13:12:25.531 INFO:teuthology.orchestra.run.smithi099.stderr: 59800K .......... .......... .......... .......... .......... 35% 13.8M 7s 2024-03-30T13:12:25.534 INFO:teuthology.orchestra.run.smithi099.stderr: 59850K .......... .......... .......... .......... .......... 35% 15.8M 7s 2024-03-30T13:12:25.538 INFO:teuthology.orchestra.run.smithi099.stderr: 59900K .......... .......... .......... .......... .......... 35% 11.2M 7s 2024-03-30T13:12:25.542 INFO:teuthology.orchestra.run.smithi099.stderr: 59950K .......... .......... .......... .......... .......... 35% 14.4M 7s 2024-03-30T13:12:25.545 INFO:teuthology.orchestra.run.smithi099.stderr: 60000K .......... .......... .......... .......... .......... 35% 15.1M 7s 2024-03-30T13:12:25.548 INFO:teuthology.orchestra.run.smithi099.stderr: 60050K .......... .......... .......... .......... .......... 35% 16.0M 7s 2024-03-30T13:12:25.550 INFO:teuthology.orchestra.run.smithi099.stderr: 60100K .......... .......... .......... .......... .......... 35% 21.9M 7s 2024-03-30T13:12:25.553 INFO:teuthology.orchestra.run.smithi099.stderr: 60150K .......... .......... .......... .......... .......... 35% 15.8M 7s 2024-03-30T13:12:25.557 INFO:teuthology.orchestra.run.smithi099.stderr: 60200K .......... .......... .......... .......... .......... 35% 12.3M 7s 2024-03-30T13:12:25.560 INFO:teuthology.orchestra.run.smithi099.stderr: 60250K .......... .......... .......... .......... .......... 35% 18.0M 7s 2024-03-30T13:12:25.562 INFO:teuthology.orchestra.run.smithi099.stderr: 60300K .......... .......... .......... .......... .......... 35% 21.2M 7s 2024-03-30T13:12:25.565 INFO:teuthology.orchestra.run.smithi099.stderr: 60350K .......... .......... .......... .......... .......... 35% 16.8M 7s 2024-03-30T13:12:25.570 INFO:teuthology.orchestra.run.smithi099.stderr: 60400K .......... .......... .......... .......... .......... 35% 15.2M 7s 2024-03-30T13:12:25.573 INFO:teuthology.orchestra.run.smithi099.stderr: 60450K .......... .......... .......... .......... .......... 35% 11.5M 7s 2024-03-30T13:12:25.576 INFO:teuthology.orchestra.run.smithi099.stderr: 60500K .......... .......... .......... .......... .......... 35% 14.8M 7s 2024-03-30T13:12:25.582 INFO:teuthology.orchestra.run.smithi099.stderr: 60550K .......... .......... .......... .......... .......... 35% 8.03M 7s 2024-03-30T13:12:25.585 INFO:teuthology.orchestra.run.smithi099.stderr: 60600K .......... .......... .......... .......... .......... 35% 13.7M 7s 2024-03-30T13:12:25.590 INFO:teuthology.orchestra.run.smithi099.stderr: 60650K .......... .......... .......... .......... .......... 36% 14.4M 7s 2024-03-30T13:12:25.593 INFO:teuthology.orchestra.run.smithi099.stderr: 60700K .......... .......... .......... .......... .......... 36% 11.6M 7s 2024-03-30T13:12:25.596 INFO:teuthology.orchestra.run.smithi099.stderr: 60750K .......... .......... .......... .......... .......... 36% 16.0M 7s 2024-03-30T13:12:25.600 INFO:teuthology.orchestra.run.smithi099.stderr: 60800K .......... .......... .......... .......... .......... 36% 13.4M 7s 2024-03-30T13:12:25.604 INFO:teuthology.orchestra.run.smithi099.stderr: 60850K .......... .......... .......... .......... .......... 36% 18.0M 7s 2024-03-30T13:12:25.606 INFO:teuthology.orchestra.run.smithi099.stderr: 60900K .......... .......... .......... .......... .......... 36% 13.2M 7s 2024-03-30T13:12:25.610 INFO:teuthology.orchestra.run.smithi099.stderr: 60950K .......... .......... .......... .......... .......... 36% 16.7M 7s 2024-03-30T13:12:25.613 INFO:teuthology.orchestra.run.smithi099.stderr: 61000K .......... .......... .......... .......... .......... 36% 14.0M 7s 2024-03-30T13:12:25.616 INFO:teuthology.orchestra.run.smithi099.stderr: 61050K .......... .......... .......... .......... .......... 36% 13.9M 7s 2024-03-30T13:12:25.620 INFO:teuthology.orchestra.run.smithi099.stderr: 61100K .......... .......... .......... .......... .......... 36% 17.8M 7s 2024-03-30T13:12:25.624 INFO:teuthology.orchestra.run.smithi099.stderr: 61150K .......... .......... .......... .......... .......... 36% 14.1M 7s 2024-03-30T13:12:25.625 INFO:teuthology.orchestra.run.smithi099.stderr: 61200K .......... .......... .......... .......... .......... 36% 18.2M 7s 2024-03-30T13:12:25.628 INFO:teuthology.orchestra.run.smithi099.stderr: 61250K .......... .......... .......... .......... .......... 36% 19.1M 7s 2024-03-30T13:12:25.631 INFO:teuthology.orchestra.run.smithi099.stderr: 61300K .......... .......... .......... .......... .......... 36% 14.1M 7s 2024-03-30T13:12:25.635 INFO:teuthology.orchestra.run.smithi099.stderr: 61350K .......... .......... .......... .......... .......... 36% 14.5M 7s 2024-03-30T13:12:25.639 INFO:teuthology.orchestra.run.smithi099.stderr: 61400K .......... .......... .......... .......... .......... 36% 12.1M 7s 2024-03-30T13:12:25.642 INFO:teuthology.orchestra.run.smithi099.stderr: 61450K .......... .......... .......... .......... .......... 36% 14.2M 7s 2024-03-30T13:12:25.645 INFO:teuthology.orchestra.run.smithi099.stderr: 61500K .......... .......... .......... .......... .......... 36% 16.1M 7s 2024-03-30T13:12:25.648 INFO:teuthology.orchestra.run.smithi099.stderr: 61550K .......... .......... .......... .......... .......... 36% 16.2M 7s 2024-03-30T13:12:25.654 INFO:teuthology.orchestra.run.smithi099.stderr: 61600K .......... .......... .......... .......... .......... 36% 8.23M 7s 2024-03-30T13:12:25.658 INFO:teuthology.orchestra.run.smithi099.stderr: 61650K .......... .......... .......... .......... .......... 36% 13.2M 7s 2024-03-30T13:12:25.661 INFO:teuthology.orchestra.run.smithi099.stderr: 61700K .......... .......... .......... .......... .......... 36% 14.1M 7s 2024-03-30T13:12:25.665 INFO:teuthology.orchestra.run.smithi099.stderr: 61750K .......... .......... .......... .......... .......... 36% 13.5M 7s 2024-03-30T13:12:25.668 INFO:teuthology.orchestra.run.smithi099.stderr: 61800K .......... .......... .......... .......... .......... 36% 14.9M 7s 2024-03-30T13:12:25.673 INFO:teuthology.orchestra.run.smithi099.stderr: 61850K .......... .......... .......... .......... .......... 36% 12.4M 7s 2024-03-30T13:12:25.679 INFO:teuthology.orchestra.run.smithi099.stderr: 61900K .......... .......... .......... .......... .......... 36% 16.2M 7s 2024-03-30T13:12:25.679 INFO:teuthology.orchestra.run.smithi099.stderr: 61950K .......... .......... .......... .......... .......... 36% 18.8M 7s 2024-03-30T13:12:25.680 INFO:teuthology.orchestra.run.smithi099.stderr: 62000K .......... .......... .......... .......... .......... 36% 16.6M 7s 2024-03-30T13:12:25.683 INFO:teuthology.orchestra.run.smithi099.stderr: 62050K .......... .......... .......... .......... .......... 36% 20.4M 7s 2024-03-30T13:12:25.687 INFO:teuthology.orchestra.run.smithi099.stderr: 62100K .......... .......... .......... .......... .......... 36% 11.2M 7s 2024-03-30T13:12:25.691 INFO:teuthology.orchestra.run.smithi099.stderr: 62150K .......... .......... .......... .......... .......... 36% 13.1M 7s 2024-03-30T13:12:25.695 INFO:teuthology.orchestra.run.smithi099.stderr: 62200K .......... .......... .......... .......... .......... 36% 14.6M 7s 2024-03-30T13:12:25.698 INFO:teuthology.orchestra.run.smithi099.stderr: 62250K .......... .......... .......... .......... .......... 36% 12.2M 7s 2024-03-30T13:12:25.702 INFO:teuthology.orchestra.run.smithi099.stderr: 62300K .......... .......... .......... .......... .......... 36% 14.1M 7s 2024-03-30T13:12:25.706 INFO:teuthology.orchestra.run.smithi099.stderr: 62350K .......... .......... .......... .......... .......... 37% 12.8M 7s 2024-03-30T13:12:25.708 INFO:teuthology.orchestra.run.smithi099.stderr: 62400K .......... .......... .......... .......... .......... 37% 22.1M 7s 2024-03-30T13:12:25.710 INFO:teuthology.orchestra.run.smithi099.stderr: 62450K .......... .......... .......... .......... .......... 37% 17.4M 7s 2024-03-30T13:12:25.714 INFO:teuthology.orchestra.run.smithi099.stderr: 62500K .......... .......... .......... .......... .......... 37% 13.6M 7s 2024-03-30T13:12:25.718 INFO:teuthology.orchestra.run.smithi099.stderr: 62550K .......... .......... .......... .......... .......... 37% 13.1M 7s 2024-03-30T13:12:25.721 INFO:teuthology.orchestra.run.smithi099.stderr: 62600K .......... .......... .......... .......... .......... 37% 14.7M 7s 2024-03-30T13:12:25.725 INFO:teuthology.orchestra.run.smithi099.stderr: 62650K .......... .......... .......... .......... .......... 37% 14.4M 7s 2024-03-30T13:12:25.730 INFO:teuthology.orchestra.run.smithi099.stderr: 62700K .......... .......... .......... .......... .......... 37% 9.25M 7s 2024-03-30T13:12:25.733 INFO:teuthology.orchestra.run.smithi099.stderr: 62750K .......... .......... .......... .......... .......... 37% 14.4M 7s 2024-03-30T13:12:25.737 INFO:teuthology.orchestra.run.smithi099.stderr: 62800K .......... .......... .......... .......... .......... 37% 15.2M 7s 2024-03-30T13:12:25.740 INFO:teuthology.orchestra.run.smithi099.stderr: 62850K .......... .......... .......... .......... .......... 37% 16.9M 7s 2024-03-30T13:12:25.741 INFO:teuthology.orchestra.run.smithi099.stderr: 62900K .......... .......... .......... .......... .......... 37% 22.7M 7s 2024-03-30T13:12:25.745 INFO:teuthology.orchestra.run.smithi099.stderr: 62950K .......... .......... .......... .......... .......... 37% 16.3M 7s 2024-03-30T13:12:25.749 INFO:teuthology.orchestra.run.smithi099.stderr: 63000K .......... .......... .......... .......... .......... 37% 11.5M 7s 2024-03-30T13:12:25.754 INFO:teuthology.orchestra.run.smithi099.stderr: 63050K .......... .......... .......... .......... .......... 37% 10.6M 7s 2024-03-30T13:12:25.756 INFO:teuthology.orchestra.run.smithi099.stderr: 63100K .......... .......... .......... .......... .......... 37% 20.7M 7s 2024-03-30T13:12:25.758 INFO:teuthology.orchestra.run.smithi099.stderr: 63150K .......... .......... .......... .......... .......... 37% 19.9M 7s 2024-03-30T13:12:25.762 INFO:teuthology.orchestra.run.smithi099.stderr: 63200K .......... .......... .......... .......... .......... 37% 13.0M 7s 2024-03-30T13:12:25.765 INFO:teuthology.orchestra.run.smithi099.stderr: 63250K .......... .......... .......... .......... .......... 37% 16.6M 7s 2024-03-30T13:12:25.770 INFO:teuthology.orchestra.run.smithi099.stderr: 63300K .......... .......... .......... .......... .......... 37% 10.9M 7s 2024-03-30T13:12:25.772 INFO:teuthology.orchestra.run.smithi099.stderr: 63350K .......... .......... .......... .......... .......... 37% 16.0M 7s 2024-03-30T13:12:25.777 INFO:teuthology.orchestra.run.smithi099.stderr: 63400K .......... .......... .......... .......... .......... 37% 12.2M 7s 2024-03-30T13:12:25.780 INFO:teuthology.orchestra.run.smithi099.stderr: 63450K .......... .......... .......... .......... .......... 37% 12.4M 7s 2024-03-30T13:12:25.783 INFO:teuthology.orchestra.run.smithi099.stderr: 63500K .......... .......... .......... .......... .......... 37% 18.0M 7s 2024-03-30T13:12:25.787 INFO:teuthology.orchestra.run.smithi099.stderr: 63550K .......... .......... .......... .......... .......... 37% 13.2M 7s 2024-03-30T13:12:25.789 INFO:teuthology.orchestra.run.smithi099.stderr: 63600K .......... .......... .......... .......... .......... 37% 17.8M 7s 2024-03-30T13:12:25.793 INFO:teuthology.orchestra.run.smithi099.stderr: 63650K .......... .......... .......... .......... .......... 37% 14.5M 7s 2024-03-30T13:12:25.796 INFO:teuthology.orchestra.run.smithi099.stderr: 63700K .......... .......... .......... .......... .......... 37% 15.8M 7s 2024-03-30T13:12:25.799 INFO:teuthology.orchestra.run.smithi099.stderr: 63750K .......... .......... .......... .......... .......... 37% 17.0M 7s 2024-03-30T13:12:25.802 INFO:teuthology.orchestra.run.smithi099.stderr: 63800K .......... .......... .......... .......... .......... 37% 15.3M 7s 2024-03-30T13:12:25.804 INFO:teuthology.orchestra.run.smithi099.stderr: 63850K .......... .......... .......... .......... .......... 37% 20.0M 7s 2024-03-30T13:12:25.808 INFO:teuthology.orchestra.run.smithi099.stderr: 63900K .......... .......... .......... .......... .......... 37% 13.3M 7s 2024-03-30T13:12:25.813 INFO:teuthology.orchestra.run.smithi099.stderr: 63950K .......... .......... .......... .......... .......... 37% 11.2M 7s 2024-03-30T13:12:25.816 INFO:teuthology.orchestra.run.smithi099.stderr: 64000K .......... .......... .......... .......... .......... 37% 12.4M 7s 2024-03-30T13:12:25.820 INFO:teuthology.orchestra.run.smithi099.stderr: 64050K .......... .......... .......... .......... .......... 38% 15.3M 7s 2024-03-30T13:12:25.823 INFO:teuthology.orchestra.run.smithi099.stderr: 64100K .......... .......... .......... .......... .......... 38% 18.0M 7s 2024-03-30T13:12:25.826 INFO:teuthology.orchestra.run.smithi099.stderr: 64150K .......... .......... .......... .......... .......... 38% 15.5M 7s 2024-03-30T13:12:25.830 INFO:teuthology.orchestra.run.smithi099.stderr: 64200K .......... .......... .......... .......... .......... 38% 11.0M 7s 2024-03-30T13:12:25.834 INFO:teuthology.orchestra.run.smithi099.stderr: 64250K .......... .......... .......... .......... .......... 38% 15.7M 7s 2024-03-30T13:12:25.837 INFO:teuthology.orchestra.run.smithi099.stderr: 64300K .......... .......... .......... .......... .......... 38% 12.6M 7s 2024-03-30T13:12:25.840 INFO:teuthology.orchestra.run.smithi099.stderr: 64350K .......... .......... .......... .......... .......... 38% 15.5M 7s 2024-03-30T13:12:25.843 INFO:teuthology.orchestra.run.smithi099.stderr: 64400K .......... .......... .......... .......... .......... 38% 15.6M 7s 2024-03-30T13:12:25.846 INFO:teuthology.orchestra.run.smithi099.stderr: 64450K .......... .......... .......... .......... .......... 38% 15.9M 7s 2024-03-30T13:12:25.850 INFO:teuthology.orchestra.run.smithi099.stderr: 64500K .......... .......... .......... .......... .......... 38% 14.9M 7s 2024-03-30T13:12:25.853 INFO:teuthology.orchestra.run.smithi099.stderr: 64550K .......... .......... .......... .......... .......... 38% 15.0M 7s 2024-03-30T13:12:25.856 INFO:teuthology.orchestra.run.smithi099.stderr: 64600K .......... .......... .......... .......... .......... 38% 15.9M 7s 2024-03-30T13:12:25.860 INFO:teuthology.orchestra.run.smithi099.stderr: 64650K .......... .......... .......... .......... .......... 38% 11.2M 7s 2024-03-30T13:12:25.864 INFO:teuthology.orchestra.run.smithi099.stderr: 64700K .......... .......... .......... .......... .......... 38% 14.1M 7s 2024-03-30T13:12:25.866 INFO:teuthology.orchestra.run.smithi099.stderr: 64750K .......... .......... .......... .......... .......... 38% 20.5M 7s 2024-03-30T13:12:25.870 INFO:teuthology.orchestra.run.smithi099.stderr: 64800K .......... .......... .......... .......... .......... 38% 12.0M 7s 2024-03-30T13:12:25.875 INFO:teuthology.orchestra.run.smithi099.stderr: 64850K .......... .......... .......... .......... .......... 38% 12.4M 7s 2024-03-30T13:12:25.878 INFO:teuthology.orchestra.run.smithi099.stderr: 64900K .......... .......... .......... .......... .......... 38% 14.4M 7s 2024-03-30T13:12:25.883 INFO:teuthology.orchestra.run.smithi099.stderr: 64950K .......... .......... .......... .......... .......... 38% 20.0M 7s 2024-03-30T13:12:25.883 INFO:teuthology.orchestra.run.smithi099.stderr: 65000K .......... .......... .......... .......... .......... 38% 18.7M 7s 2024-03-30T13:12:25.886 INFO:teuthology.orchestra.run.smithi099.stderr: 65050K .......... .......... .......... .......... .......... 38% 15.8M 7s 2024-03-30T13:12:25.889 INFO:teuthology.orchestra.run.smithi099.stderr: 65100K .......... .......... .......... .......... .......... 38% 14.1M 7s 2024-03-30T13:12:25.892 INFO:teuthology.orchestra.run.smithi099.stderr: 65150K .......... .......... .......... .......... .......... 38% 15.7M 7s 2024-03-30T13:12:25.895 INFO:teuthology.orchestra.run.smithi099.stderr: 65200K .......... .......... .......... .......... .......... 38% 15.8M 7s 2024-03-30T13:12:25.900 INFO:teuthology.orchestra.run.smithi099.stderr: 65250K .......... .......... .......... .......... .......... 38% 10.2M 7s 2024-03-30T13:12:25.903 INFO:teuthology.orchestra.run.smithi099.stderr: 65300K .......... .......... .......... .......... .......... 38% 14.5M 7s 2024-03-30T13:12:25.907 INFO:teuthology.orchestra.run.smithi099.stderr: 65350K .......... .......... .......... .......... .......... 38% 12.1M 7s 2024-03-30T13:12:25.911 INFO:teuthology.orchestra.run.smithi099.stderr: 65400K .......... .......... .......... .......... .......... 38% 14.0M 7s 2024-03-30T13:12:25.914 INFO:teuthology.orchestra.run.smithi099.stderr: 65450K .......... .......... .......... .......... .......... 38% 14.0M 7s 2024-03-30T13:12:25.918 INFO:teuthology.orchestra.run.smithi099.stderr: 65500K .......... .......... .......... .......... .......... 38% 18.0M 7s 2024-03-30T13:12:25.922 INFO:teuthology.orchestra.run.smithi099.stderr: 65550K .......... .......... .......... .......... .......... 38% 10.2M 7s 2024-03-30T13:12:25.925 INFO:teuthology.orchestra.run.smithi099.stderr: 65600K .......... .......... .......... .......... .......... 38% 16.2M 7s 2024-03-30T13:12:25.927 INFO:teuthology.orchestra.run.smithi099.stderr: 65650K .......... .......... .......... .......... .......... 38% 22.6M 7s 2024-03-30T13:12:25.932 INFO:teuthology.orchestra.run.smithi099.stderr: 65700K .......... .......... .......... .......... .......... 39% 13.5M 7s 2024-03-30T13:12:25.934 INFO:teuthology.orchestra.run.smithi099.stderr: 65750K .......... .......... .......... .......... .......... 39% 14.8M 7s 2024-03-30T13:12:25.940 INFO:teuthology.orchestra.run.smithi099.stderr: 65800K .......... .......... .......... .......... .......... 39% 8.92M 7s 2024-03-30T13:12:25.942 INFO:teuthology.orchestra.run.smithi099.stderr: 65850K .......... .......... .......... .......... .......... 39% 16.3M 7s 2024-03-30T13:12:25.945 INFO:teuthology.orchestra.run.smithi099.stderr: 65900K .......... .......... .......... .......... .......... 39% 17.7M 7s 2024-03-30T13:12:25.948 INFO:teuthology.orchestra.run.smithi099.stderr: 65950K .......... .......... .......... .......... .......... 39% 15.8M 7s 2024-03-30T13:12:25.952 INFO:teuthology.orchestra.run.smithi099.stderr: 66000K .......... .......... .......... .......... .......... 39% 14.2M 7s 2024-03-30T13:12:25.954 INFO:teuthology.orchestra.run.smithi099.stderr: 66050K .......... .......... .......... .......... .......... 39% 22.8M 7s 2024-03-30T13:12:25.957 INFO:teuthology.orchestra.run.smithi099.stderr: 66100K .......... .......... .......... .......... .......... 39% 16.6M 7s 2024-03-30T13:12:25.962 INFO:teuthology.orchestra.run.smithi099.stderr: 66150K .......... .......... .......... .......... .......... 39% 12.2M 7s 2024-03-30T13:12:25.964 INFO:teuthology.orchestra.run.smithi099.stderr: 66200K .......... .......... .......... .......... .......... 39% 15.0M 7s 2024-03-30T13:12:25.967 INFO:teuthology.orchestra.run.smithi099.stderr: 66250K .......... .......... .......... .......... .......... 39% 15.1M 7s 2024-03-30T13:12:25.972 INFO:teuthology.orchestra.run.smithi099.stderr: 66300K .......... .......... .......... .......... .......... 39% 11.8M 7s 2024-03-30T13:12:25.975 INFO:teuthology.orchestra.run.smithi099.stderr: 66350K .......... .......... .......... .......... .......... 39% 16.9M 7s 2024-03-30T13:12:25.978 INFO:teuthology.orchestra.run.smithi099.stderr: 66400K .......... .......... .......... .......... .......... 39% 19.8M 7s 2024-03-30T13:12:25.982 INFO:teuthology.orchestra.run.smithi099.stderr: 66450K .......... .......... .......... .......... .......... 39% 9.53M 7s 2024-03-30T13:12:25.986 INFO:teuthology.orchestra.run.smithi099.stderr: 66500K .......... .......... .......... .......... .......... 39% 14.1M 7s 2024-03-30T13:12:25.988 INFO:teuthology.orchestra.run.smithi099.stderr: 66550K .......... .......... .......... .......... .......... 39% 16.4M 7s 2024-03-30T13:12:25.992 INFO:teuthology.orchestra.run.smithi099.stderr: 66600K .......... .......... .......... .......... .......... 39% 13.1M 7s 2024-03-30T13:12:25.997 INFO:teuthology.orchestra.run.smithi099.stderr: 66650K .......... .......... .......... .......... .......... 39% 12.2M 7s 2024-03-30T13:12:25.999 INFO:teuthology.orchestra.run.smithi099.stderr: 66700K .......... .......... .......... .......... .......... 39% 15.8M 7s 2024-03-30T13:12:26.002 INFO:teuthology.orchestra.run.smithi099.stderr: 66750K .......... .......... .......... .......... .......... 39% 21.6M 7s 2024-03-30T13:12:26.004 INFO:teuthology.orchestra.run.smithi099.stderr: 66800K .......... .......... .......... .......... .......... 39% 16.1M 7s 2024-03-30T13:12:26.007 INFO:teuthology.orchestra.run.smithi099.stderr: 66850K .......... .......... .......... .......... .......... 39% 19.6M 7s 2024-03-30T13:12:26.011 INFO:teuthology.orchestra.run.smithi099.stderr: 66900K .......... .......... .......... .......... .......... 39% 12.1M 7s 2024-03-30T13:12:26.013 INFO:teuthology.orchestra.run.smithi099.stderr: 66950K .......... .......... .......... .......... .......... 39% 20.7M 7s 2024-03-30T13:12:26.016 INFO:teuthology.orchestra.run.smithi099.stderr: 67000K .......... .......... .......... .......... .......... 39% 16.2M 7s 2024-03-30T13:12:26.024 INFO:teuthology.orchestra.run.smithi099.stderr: 67050K .......... .......... .......... .......... .......... 39% 6.70M 7s 2024-03-30T13:12:26.026 INFO:teuthology.orchestra.run.smithi099.stderr: 67100K .......... .......... .......... .......... .......... 39% 20.5M 7s 2024-03-30T13:12:26.030 INFO:teuthology.orchestra.run.smithi099.stderr: 67150K .......... .......... .......... .......... .......... 39% 12.6M 7s 2024-03-30T13:12:26.033 INFO:teuthology.orchestra.run.smithi099.stderr: 67200K .......... .......... .......... .......... .......... 39% 16.5M 7s 2024-03-30T13:12:26.037 INFO:teuthology.orchestra.run.smithi099.stderr: 67250K .......... .......... .......... .......... .......... 39% 13.3M 7s 2024-03-30T13:12:26.040 INFO:teuthology.orchestra.run.smithi099.stderr: 67300K .......... .......... .......... .......... .......... 39% 15.8M 7s 2024-03-30T13:12:26.042 INFO:teuthology.orchestra.run.smithi099.stderr: 67350K .......... .......... .......... .......... .......... 39% 20.1M 7s 2024-03-30T13:12:26.046 INFO:teuthology.orchestra.run.smithi099.stderr: 67400K .......... .......... .......... .......... .......... 40% 14.4M 7s 2024-03-30T13:12:26.050 INFO:teuthology.orchestra.run.smithi099.stderr: 67450K .......... .......... .......... .......... .......... 40% 12.8M 7s 2024-03-30T13:12:26.053 INFO:teuthology.orchestra.run.smithi099.stderr: 67500K .......... .......... .......... .......... .......... 40% 13.2M 7s 2024-03-30T13:12:26.057 INFO:teuthology.orchestra.run.smithi099.stderr: 67550K .......... .......... .......... .......... .......... 40% 12.9M 7s 2024-03-30T13:12:26.061 INFO:teuthology.orchestra.run.smithi099.stderr: 67600K .......... .......... .......... .......... .......... 40% 13.6M 7s 2024-03-30T13:12:26.063 INFO:teuthology.orchestra.run.smithi099.stderr: 67650K .......... .......... .......... .......... .......... 40% 19.2M 7s 2024-03-30T13:12:26.066 INFO:teuthology.orchestra.run.smithi099.stderr: 67700K .......... .......... .......... .......... .......... 40% 15.3M 7s 2024-03-30T13:12:26.071 INFO:teuthology.orchestra.run.smithi099.stderr: 67750K .......... .......... .......... .......... .......... 40% 11.5M 7s 2024-03-30T13:12:26.074 INFO:teuthology.orchestra.run.smithi099.stderr: 67800K .......... .......... .......... .......... .......... 40% 13.3M 7s 2024-03-30T13:12:26.076 INFO:teuthology.orchestra.run.smithi099.stderr: 67850K .......... .......... .......... .......... .......... 40% 22.1M 7s 2024-03-30T13:12:26.080 INFO:teuthology.orchestra.run.smithi099.stderr: 67900K .......... .......... .......... .......... .......... 40% 14.0M 7s 2024-03-30T13:12:26.088 INFO:teuthology.orchestra.run.smithi099.stderr: 67950K .......... .......... .......... .......... .......... 40% 12.3M 7s 2024-03-30T13:12:26.088 INFO:teuthology.orchestra.run.smithi099.stderr: 68000K .......... .......... .......... .......... .......... 40% 16.3M 7s 2024-03-30T13:12:26.089 INFO:teuthology.orchestra.run.smithi099.stderr: 68050K .......... .......... .......... .......... .......... 40% 23.9M 7s 2024-03-30T13:12:26.095 INFO:teuthology.orchestra.run.smithi099.stderr: 68100K .......... .......... .......... .......... .......... 40% 9.53M 7s 2024-03-30T13:12:26.099 INFO:teuthology.orchestra.run.smithi099.stderr: 68150K .......... .......... .......... .......... .......... 40% 9.94M 7s 2024-03-30T13:12:26.102 INFO:teuthology.orchestra.run.smithi099.stderr: 68200K .......... .......... .......... .......... .......... 40% 17.4M 7s 2024-03-30T13:12:26.105 INFO:teuthology.orchestra.run.smithi099.stderr: 68250K .......... .......... .......... .......... .......... 40% 15.9M 7s 2024-03-30T13:12:26.107 INFO:teuthology.orchestra.run.smithi099.stderr: 68300K .......... .......... .......... .......... .......... 40% 21.5M 7s 2024-03-30T13:12:26.112 INFO:teuthology.orchestra.run.smithi099.stderr: 68350K .......... .......... .......... .......... .......... 40% 9.54M 7s 2024-03-30T13:12:26.116 INFO:teuthology.orchestra.run.smithi099.stderr: 68400K .......... .......... .......... .......... .......... 40% 13.5M 7s 2024-03-30T13:12:26.119 INFO:teuthology.orchestra.run.smithi099.stderr: 68450K .......... .......... .......... .......... .......... 40% 14.8M 7s 2024-03-30T13:12:26.123 INFO:teuthology.orchestra.run.smithi099.stderr: 68500K .......... .......... .......... .......... .......... 40% 12.1M 7s 2024-03-30T13:12:26.125 INFO:teuthology.orchestra.run.smithi099.stderr: 68550K .......... .......... .......... .......... .......... 40% 25.3M 7s 2024-03-30T13:12:26.131 INFO:teuthology.orchestra.run.smithi099.stderr: 68600K .......... .......... .......... .......... .......... 40% 12.1M 7s 2024-03-30T13:12:26.132 INFO:teuthology.orchestra.run.smithi099.stderr: 68650K .......... .......... .......... .......... .......... 40% 14.4M 7s 2024-03-30T13:12:26.138 INFO:teuthology.orchestra.run.smithi099.stderr: 68700K .......... .......... .......... .......... .......... 40% 13.2M 7s 2024-03-30T13:12:26.139 INFO:teuthology.orchestra.run.smithi099.stderr: 68750K .......... .......... .......... .......... .......... 40% 18.4M 7s 2024-03-30T13:12:26.141 INFO:teuthology.orchestra.run.smithi099.stderr: 68800K .......... .......... .......... .......... .......... 40% 23.9M 7s 2024-03-30T13:12:26.150 INFO:teuthology.orchestra.run.smithi099.stderr: 68850K .......... .......... .......... .......... .......... 40% 5.66M 7s 2024-03-30T13:12:26.151 INFO:teuthology.orchestra.run.smithi099.stderr: 68900K .......... .......... .......... .......... .......... 40% 70.7M 7s 2024-03-30T13:12:26.152 INFO:teuthology.orchestra.run.smithi099.stderr: 68950K .......... .......... .......... .......... .......... 40% 24.8M 7s 2024-03-30T13:12:26.156 INFO:teuthology.orchestra.run.smithi099.stderr: 69000K .......... .......... .......... .......... .......... 40% 14.6M 7s 2024-03-30T13:12:26.160 INFO:teuthology.orchestra.run.smithi099.stderr: 69050K .......... .......... .......... .......... .......... 40% 12.5M 7s 2024-03-30T13:12:26.162 INFO:teuthology.orchestra.run.smithi099.stderr: 69100K .......... .......... .......... .......... .......... 41% 17.0M 7s 2024-03-30T13:12:26.165 INFO:teuthology.orchestra.run.smithi099.stderr: 69150K .......... .......... .......... .......... .......... 41% 15.6M 7s 2024-03-30T13:12:26.169 INFO:teuthology.orchestra.run.smithi099.stderr: 69200K .......... .......... .......... .......... .......... 41% 17.3M 7s 2024-03-30T13:12:26.173 INFO:teuthology.orchestra.run.smithi099.stderr: 69250K .......... .......... .......... .......... .......... 41% 9.29M 7s 2024-03-30T13:12:26.179 INFO:teuthology.orchestra.run.smithi099.stderr: 69300K .......... .......... .......... .......... .......... 41% 14.7M 7s 2024-03-30T13:12:26.181 INFO:teuthology.orchestra.run.smithi099.stderr: 69350K .......... .......... .......... .......... .......... 41% 12.6M 7s 2024-03-30T13:12:26.185 INFO:teuthology.orchestra.run.smithi099.stderr: 69400K .......... .......... .......... .......... .......... 41% 13.6M 7s 2024-03-30T13:12:26.187 INFO:teuthology.orchestra.run.smithi099.stderr: 69450K .......... .......... .......... .......... .......... 41% 18.2M 7s 2024-03-30T13:12:26.191 INFO:teuthology.orchestra.run.smithi099.stderr: 69500K .......... .......... .......... .......... .......... 41% 12.6M 7s 2024-03-30T13:12:26.195 INFO:teuthology.orchestra.run.smithi099.stderr: 69550K .......... .......... .......... .......... .......... 41% 19.2M 7s 2024-03-30T13:12:26.198 INFO:teuthology.orchestra.run.smithi099.stderr: 69600K .......... .......... .......... .......... .......... 41% 11.1M 7s 2024-03-30T13:12:26.201 INFO:teuthology.orchestra.run.smithi099.stderr: 69650K .......... .......... .......... .......... .......... 41% 15.4M 7s 2024-03-30T13:12:26.204 INFO:teuthology.orchestra.run.smithi099.stderr: 69700K .......... .......... .......... .......... .......... 41% 18.6M 7s 2024-03-30T13:12:26.207 INFO:teuthology.orchestra.run.smithi099.stderr: 69750K .......... .......... .......... .......... .......... 41% 13.4M 7s 2024-03-30T13:12:26.212 INFO:teuthology.orchestra.run.smithi099.stderr: 69800K .......... .......... .......... .......... .......... 41% 10.5M 7s 2024-03-30T13:12:26.214 INFO:teuthology.orchestra.run.smithi099.stderr: 69850K .......... .......... .......... .......... .......... 41% 22.2M 7s 2024-03-30T13:12:26.218 INFO:teuthology.orchestra.run.smithi099.stderr: 69900K .......... .......... .......... .......... .......... 41% 14.7M 7s 2024-03-30T13:12:26.221 INFO:teuthology.orchestra.run.smithi099.stderr: 69950K .......... .......... .......... .......... .......... 41% 14.9M 7s 2024-03-30T13:12:26.224 INFO:teuthology.orchestra.run.smithi099.stderr: 70000K .......... .......... .......... .......... .......... 41% 13.3M 7s 2024-03-30T13:12:26.228 INFO:teuthology.orchestra.run.smithi099.stderr: 70050K .......... .......... .......... .......... .......... 41% 12.0M 7s 2024-03-30T13:12:26.231 INFO:teuthology.orchestra.run.smithi099.stderr: 70100K .......... .......... .......... .......... .......... 41% 18.1M 7s 2024-03-30T13:12:26.235 INFO:teuthology.orchestra.run.smithi099.stderr: 70150K .......... .......... .......... .......... .......... 41% 13.2M 7s 2024-03-30T13:12:26.237 INFO:teuthology.orchestra.run.smithi099.stderr: 70200K .......... .......... .......... .......... .......... 41% 18.0M 7s 2024-03-30T13:12:26.241 INFO:teuthology.orchestra.run.smithi099.stderr: 70250K .......... .......... .......... .......... .......... 41% 15.3M 7s 2024-03-30T13:12:26.245 INFO:teuthology.orchestra.run.smithi099.stderr: 70300K .......... .......... .......... .......... .......... 41% 10.5M 7s 2024-03-30T13:12:26.248 INFO:teuthology.orchestra.run.smithi099.stderr: 70350K .......... .......... .......... .......... .......... 41% 15.6M 7s 2024-03-30T13:12:26.252 INFO:teuthology.orchestra.run.smithi099.stderr: 70400K .......... .......... .......... .......... .......... 41% 13.0M 7s 2024-03-30T13:12:26.256 INFO:teuthology.orchestra.run.smithi099.stderr: 70450K .......... .......... .......... .......... .......... 41% 13.3M 7s 2024-03-30T13:12:26.260 INFO:teuthology.orchestra.run.smithi099.stderr: 70500K .......... .......... .......... .......... .......... 41% 12.5M 7s 2024-03-30T13:12:26.264 INFO:teuthology.orchestra.run.smithi099.stderr: 70550K .......... .......... .......... .......... .......... 41% 13.0M 7s 2024-03-30T13:12:26.266 INFO:teuthology.orchestra.run.smithi099.stderr: 70600K .......... .......... .......... .......... .......... 41% 18.4M 7s 2024-03-30T13:12:26.270 INFO:teuthology.orchestra.run.smithi099.stderr: 70650K .......... .......... .......... .......... .......... 41% 13.7M 7s 2024-03-30T13:12:26.273 INFO:teuthology.orchestra.run.smithi099.stderr: 70700K .......... .......... .......... .......... .......... 41% 15.6M 7s 2024-03-30T13:12:26.276 INFO:teuthology.orchestra.run.smithi099.stderr: 70750K .......... .......... .......... .......... .......... 42% 16.9M 7s 2024-03-30T13:12:26.279 INFO:teuthology.orchestra.run.smithi099.stderr: 70800K .......... .......... .......... .......... .......... 42% 13.1M 7s 2024-03-30T13:12:26.283 INFO:teuthology.orchestra.run.smithi099.stderr: 70850K .......... .......... .......... .......... .......... 42% 14.3M 7s 2024-03-30T13:12:26.291 INFO:teuthology.orchestra.run.smithi099.stderr: 70900K .......... .......... .......... .......... .......... 42% 12.2M 7s 2024-03-30T13:12:26.292 INFO:teuthology.orchestra.run.smithi099.stderr: 70950K .......... .......... .......... .......... .......... 42% 16.3M 7s 2024-03-30T13:12:26.293 INFO:teuthology.orchestra.run.smithi099.stderr: 71000K .......... .......... .......... .......... .......... 42% 16.4M 7s 2024-03-30T13:12:26.297 INFO:teuthology.orchestra.run.smithi099.stderr: 71050K .......... .......... .......... .......... .......... 42% 13.3M 7s 2024-03-30T13:12:26.300 INFO:teuthology.orchestra.run.smithi099.stderr: 71100K .......... .......... .......... .......... .......... 42% 14.8M 7s 2024-03-30T13:12:26.303 INFO:teuthology.orchestra.run.smithi099.stderr: 71150K .......... .......... .......... .......... .......... 42% 15.1M 7s 2024-03-30T13:12:26.305 INFO:teuthology.orchestra.run.smithi099.stderr: 71200K .......... .......... .......... .......... .......... 42% 20.0M 7s 2024-03-30T13:12:26.310 INFO:teuthology.orchestra.run.smithi099.stderr: 71250K .......... .......... .......... .......... .......... 42% 14.1M 7s 2024-03-30T13:12:26.313 INFO:teuthology.orchestra.run.smithi099.stderr: 71300K .......... .......... .......... .......... .......... 42% 13.1M 7s 2024-03-30T13:12:26.316 INFO:teuthology.orchestra.run.smithi099.stderr: 71350K .......... .......... .......... .......... .......... 42% 15.4M 7s 2024-03-30T13:12:26.320 INFO:teuthology.orchestra.run.smithi099.stderr: 71400K .......... .......... .......... .......... .......... 42% 12.0M 7s 2024-03-30T13:12:26.325 INFO:teuthology.orchestra.run.smithi099.stderr: 71450K .......... .......... .......... .......... .......... 42% 11.8M 7s 2024-03-30T13:12:26.329 INFO:teuthology.orchestra.run.smithi099.stderr: 71500K .......... .......... .......... .......... .......... 42% 11.4M 7s 2024-03-30T13:12:26.332 INFO:teuthology.orchestra.run.smithi099.stderr: 71550K .......... .......... .......... .......... .......... 42% 13.1M 7s 2024-03-30T13:12:26.335 INFO:teuthology.orchestra.run.smithi099.stderr: 71600K .......... .......... .......... .......... .......... 42% 15.8M 7s 2024-03-30T13:12:26.339 INFO:teuthology.orchestra.run.smithi099.stderr: 71650K .......... .......... .......... .......... .......... 42% 13.6M 7s 2024-03-30T13:12:26.342 INFO:teuthology.orchestra.run.smithi099.stderr: 71700K .......... .......... .......... .......... .......... 42% 19.5M 7s 2024-03-30T13:12:26.345 INFO:teuthology.orchestra.run.smithi099.stderr: 71750K .......... .......... .......... .......... .......... 42% 11.8M 7s 2024-03-30T13:12:26.350 INFO:teuthology.orchestra.run.smithi099.stderr: 71800K .......... .......... .......... .......... .......... 42% 14.4M 7s 2024-03-30T13:12:26.351 INFO:teuthology.orchestra.run.smithi099.stderr: 71850K .......... .......... .......... .......... .......... 42% 17.9M 7s 2024-03-30T13:12:26.355 INFO:teuthology.orchestra.run.smithi099.stderr: 71900K .......... .......... .......... .......... .......... 42% 13.5M 7s 2024-03-30T13:12:26.359 INFO:teuthology.orchestra.run.smithi099.stderr: 71950K .......... .......... .......... .......... .......... 42% 12.3M 7s 2024-03-30T13:12:26.362 INFO:teuthology.orchestra.run.smithi099.stderr: 72000K .......... .......... .......... .......... .......... 42% 16.8M 7s 2024-03-30T13:12:26.367 INFO:teuthology.orchestra.run.smithi099.stderr: 72050K .......... .......... .......... .......... .......... 42% 11.3M 7s 2024-03-30T13:12:26.369 INFO:teuthology.orchestra.run.smithi099.stderr: 72100K .......... .......... .......... .......... .......... 42% 22.9M 7s 2024-03-30T13:12:26.371 INFO:teuthology.orchestra.run.smithi099.stderr: 72150K .......... .......... .......... .......... .......... 42% 17.8M 7s 2024-03-30T13:12:26.375 INFO:teuthology.orchestra.run.smithi099.stderr: 72200K .......... .......... .......... .......... .......... 42% 13.3M 7s 2024-03-30T13:12:26.378 INFO:teuthology.orchestra.run.smithi099.stderr: 72250K .......... .......... .......... .......... .......... 42% 14.1M 7s 2024-03-30T13:12:26.382 INFO:teuthology.orchestra.run.smithi099.stderr: 72300K .......... .......... .......... .......... .......... 42% 14.0M 7s 2024-03-30T13:12:26.385 INFO:teuthology.orchestra.run.smithi099.stderr: 72350K .......... .......... .......... .......... .......... 42% 14.1M 7s 2024-03-30T13:12:26.389 INFO:teuthology.orchestra.run.smithi099.stderr: 72400K .......... .......... .......... .......... .......... 42% 14.2M 7s 2024-03-30T13:12:26.392 INFO:teuthology.orchestra.run.smithi099.stderr: 72450K .......... .......... .......... .......... .......... 43% 16.4M 7s 2024-03-30T13:12:26.396 INFO:teuthology.orchestra.run.smithi099.stderr: 72500K .......... .......... .......... .......... .......... 43% 12.0M 7s 2024-03-30T13:12:26.403 INFO:teuthology.orchestra.run.smithi099.stderr: 72550K .......... .......... .......... .......... .......... 43% 10.1M 7s 2024-03-30T13:12:26.403 INFO:teuthology.orchestra.run.smithi099.stderr: 72600K .......... .......... .......... .......... .......... 43% 22.1M 7s 2024-03-30T13:12:26.407 INFO:teuthology.orchestra.run.smithi099.stderr: 72650K .......... .......... .......... .......... .......... 43% 12.0M 7s 2024-03-30T13:12:26.411 INFO:teuthology.orchestra.run.smithi099.stderr: 72700K .......... .......... .......... .......... .......... 43% 12.1M 7s 2024-03-30T13:12:26.414 INFO:teuthology.orchestra.run.smithi099.stderr: 72750K .......... .......... .......... .......... .......... 43% 16.2M 7s 2024-03-30T13:12:26.417 INFO:teuthology.orchestra.run.smithi099.stderr: 72800K .......... .......... .......... .......... .......... 43% 16.3M 7s 2024-03-30T13:12:26.420 INFO:teuthology.orchestra.run.smithi099.stderr: 72850K .......... .......... .......... .......... .......... 43% 14.9M 7s 2024-03-30T13:12:26.423 INFO:teuthology.orchestra.run.smithi099.stderr: 72900K .......... .......... .......... .......... .......... 43% 14.8M 7s 2024-03-30T13:12:26.428 INFO:teuthology.orchestra.run.smithi099.stderr: 72950K .......... .......... .......... .......... .......... 43% 11.8M 7s 2024-03-30T13:12:26.431 INFO:teuthology.orchestra.run.smithi099.stderr: 73000K .......... .......... .......... .......... .......... 43% 16.8M 7s 2024-03-30T13:12:26.434 INFO:teuthology.orchestra.run.smithi099.stderr: 73050K .......... .......... .......... .......... .......... 43% 14.5M 7s 2024-03-30T13:12:26.436 INFO:teuthology.orchestra.run.smithi099.stderr: 73100K .......... .......... .......... .......... .......... 43% 22.4M 7s 2024-03-30T13:12:26.442 INFO:teuthology.orchestra.run.smithi099.stderr: 73150K .......... .......... .......... .......... .......... 43% 13.3M 7s 2024-03-30T13:12:26.445 INFO:teuthology.orchestra.run.smithi099.stderr: 73200K .......... .......... .......... .......... .......... 43% 10.5M 7s 2024-03-30T13:12:26.448 INFO:teuthology.orchestra.run.smithi099.stderr: 73250K .......... .......... .......... .......... .......... 43% 15.1M 7s 2024-03-30T13:12:26.450 INFO:teuthology.orchestra.run.smithi099.stderr: 73300K .......... .......... .......... .......... .......... 43% 19.0M 6s 2024-03-30T13:12:26.454 INFO:teuthology.orchestra.run.smithi099.stderr: 73350K .......... .......... .......... .......... .......... 43% 12.7M 6s 2024-03-30T13:12:26.458 INFO:teuthology.orchestra.run.smithi099.stderr: 73400K .......... .......... .......... .......... .......... 43% 13.3M 6s 2024-03-30T13:12:26.461 INFO:teuthology.orchestra.run.smithi099.stderr: 73450K .......... .......... .......... .......... .......... 43% 17.5M 6s 2024-03-30T13:12:26.464 INFO:teuthology.orchestra.run.smithi099.stderr: 73500K .......... .......... .......... .......... .......... 43% 15.6M 6s 2024-03-30T13:12:26.467 INFO:teuthology.orchestra.run.smithi099.stderr: 73550K .......... .......... .......... .......... .......... 43% 13.1M 6s 2024-03-30T13:12:26.472 INFO:teuthology.orchestra.run.smithi099.stderr: 73600K .......... .......... .......... .......... .......... 43% 10.1M 6s 2024-03-30T13:12:26.476 INFO:teuthology.orchestra.run.smithi099.stderr: 73650K .......... .......... .......... .......... .......... 43% 13.0M 6s 2024-03-30T13:12:26.480 INFO:teuthology.orchestra.run.smithi099.stderr: 73700K .......... .......... .......... .......... .......... 43% 14.4M 6s 2024-03-30T13:12:26.482 INFO:teuthology.orchestra.run.smithi099.stderr: 73750K .......... .......... .......... .......... .......... 43% 18.5M 6s 2024-03-30T13:12:26.486 INFO:teuthology.orchestra.run.smithi099.stderr: 73800K .......... .......... .......... .......... .......... 43% 13.2M 6s 2024-03-30T13:12:26.489 INFO:teuthology.orchestra.run.smithi099.stderr: 73850K .......... .......... .......... .......... .......... 43% 14.6M 6s 2024-03-30T13:12:26.496 INFO:teuthology.orchestra.run.smithi099.stderr: 73900K .......... .......... .......... .......... .......... 43% 11.2M 6s 2024-03-30T13:12:26.497 INFO:teuthology.orchestra.run.smithi099.stderr: 73950K .......... .......... .......... .......... .......... 43% 15.8M 6s 2024-03-30T13:12:26.499 INFO:teuthology.orchestra.run.smithi099.stderr: 74000K .......... .......... .......... .......... .......... 43% 20.0M 6s 2024-03-30T13:12:26.503 INFO:teuthology.orchestra.run.smithi099.stderr: 74050K .......... .......... .......... .......... .......... 43% 14.3M 6s 2024-03-30T13:12:26.506 INFO:teuthology.orchestra.run.smithi099.stderr: 74100K .......... .......... .......... .......... .......... 43% 13.9M 6s 2024-03-30T13:12:26.510 INFO:teuthology.orchestra.run.smithi099.stderr: 74150K .......... .......... .......... .......... .......... 44% 11.4M 6s 2024-03-30T13:12:26.513 INFO:teuthology.orchestra.run.smithi099.stderr: 74200K .......... .......... .......... .......... .......... 44% 21.0M 6s 2024-03-30T13:12:26.516 INFO:teuthology.orchestra.run.smithi099.stderr: 74250K .......... .......... .......... .......... .......... 44% 13.6M 6s 2024-03-30T13:12:26.519 INFO:teuthology.orchestra.run.smithi099.stderr: 74300K .......... .......... .......... .......... .......... 44% 19.4M 6s 2024-03-30T13:12:26.523 INFO:teuthology.orchestra.run.smithi099.stderr: 74350K .......... .......... .......... .......... .......... 44% 11.3M 6s 2024-03-30T13:12:26.527 INFO:teuthology.orchestra.run.smithi099.stderr: 74400K .......... .......... .......... .......... .......... 44% 13.3M 6s 2024-03-30T13:12:26.530 INFO:teuthology.orchestra.run.smithi099.stderr: 74450K .......... .......... .......... .......... .......... 44% 17.0M 6s 2024-03-30T13:12:26.533 INFO:teuthology.orchestra.run.smithi099.stderr: 74500K .......... .......... .......... .......... .......... 44% 14.1M 6s 2024-03-30T13:12:26.536 INFO:teuthology.orchestra.run.smithi099.stderr: 74550K .......... .......... .......... .......... .......... 44% 13.6M 6s 2024-03-30T13:12:26.540 INFO:teuthology.orchestra.run.smithi099.stderr: 74600K .......... .......... .......... .......... .......... 44% 16.1M 6s 2024-03-30T13:12:26.544 INFO:teuthology.orchestra.run.smithi099.stderr: 74650K .......... .......... .......... .......... .......... 44% 11.7M 6s 2024-03-30T13:12:26.548 INFO:teuthology.orchestra.run.smithi099.stderr: 74700K .......... .......... .......... .......... .......... 44% 12.3M 6s 2024-03-30T13:12:26.551 INFO:teuthology.orchestra.run.smithi099.stderr: 74750K .......... .......... .......... .......... .......... 44% 15.5M 6s 2024-03-30T13:12:26.554 INFO:teuthology.orchestra.run.smithi099.stderr: 74800K .......... .......... .......... .......... .......... 44% 13.8M 6s 2024-03-30T13:12:26.559 INFO:teuthology.orchestra.run.smithi099.stderr: 74850K .......... .......... .......... .......... .......... 44% 14.2M 6s 2024-03-30T13:12:26.562 INFO:teuthology.orchestra.run.smithi099.stderr: 74900K .......... .......... .......... .......... .......... 44% 12.9M 6s 2024-03-30T13:12:26.565 INFO:teuthology.orchestra.run.smithi099.stderr: 74950K .......... .......... .......... .......... .......... 44% 15.5M 6s 2024-03-30T13:12:26.569 INFO:teuthology.orchestra.run.smithi099.stderr: 75000K .......... .......... .......... .......... .......... 44% 12.0M 6s 2024-03-30T13:12:26.573 INFO:teuthology.orchestra.run.smithi099.stderr: 75050K .......... .......... .......... .......... .......... 44% 14.4M 6s 2024-03-30T13:12:26.575 INFO:teuthology.orchestra.run.smithi099.stderr: 75100K .......... .......... .......... .......... .......... 44% 16.4M 6s 2024-03-30T13:12:26.579 INFO:teuthology.orchestra.run.smithi099.stderr: 75150K .......... .......... .......... .......... .......... 44% 17.4M 6s 2024-03-30T13:12:26.582 INFO:teuthology.orchestra.run.smithi099.stderr: 75200K .......... .......... .......... .......... .......... 44% 13.3M 6s 2024-03-30T13:12:26.585 INFO:teuthology.orchestra.run.smithi099.stderr: 75250K .......... .......... .......... .......... .......... 44% 15.0M 6s 2024-03-30T13:12:26.588 INFO:teuthology.orchestra.run.smithi099.stderr: 75300K .......... .......... .......... .......... .......... 44% 13.6M 6s 2024-03-30T13:12:26.592 INFO:teuthology.orchestra.run.smithi099.stderr: 75350K .......... .......... .......... .......... .......... 44% 14.5M 6s 2024-03-30T13:12:26.595 INFO:teuthology.orchestra.run.smithi099.stderr: 75400K .......... .......... .......... .......... .......... 44% 14.0M 6s 2024-03-30T13:12:26.599 INFO:teuthology.orchestra.run.smithi099.stderr: 75450K .......... .......... .......... .......... .......... 44% 13.7M 6s 2024-03-30T13:12:26.602 INFO:teuthology.orchestra.run.smithi099.stderr: 75500K .......... .......... .......... .......... .......... 44% 14.1M 6s 2024-03-30T13:12:26.606 INFO:teuthology.orchestra.run.smithi099.stderr: 75550K .......... .......... .......... .......... .......... 44% 16.0M 6s 2024-03-30T13:12:26.609 INFO:teuthology.orchestra.run.smithi099.stderr: 75600K .......... .......... .......... .......... .......... 44% 14.2M 6s 2024-03-30T13:12:26.613 INFO:teuthology.orchestra.run.smithi099.stderr: 75650K .......... .......... .......... .......... .......... 44% 13.4M 6s 2024-03-30T13:12:26.616 INFO:teuthology.orchestra.run.smithi099.stderr: 75700K .......... .......... .......... .......... .......... 44% 13.6M 6s 2024-03-30T13:12:26.619 INFO:teuthology.orchestra.run.smithi099.stderr: 75750K .......... .......... .......... .......... .......... 44% 14.6M 6s 2024-03-30T13:12:26.623 INFO:teuthology.orchestra.run.smithi099.stderr: 75800K .......... .......... .......... .......... .......... 44% 14.5M 6s 2024-03-30T13:12:26.626 INFO:teuthology.orchestra.run.smithi099.stderr: 75850K .......... .......... .......... .......... .......... 45% 16.2M 6s 2024-03-30T13:12:26.630 INFO:teuthology.orchestra.run.smithi099.stderr: 75900K .......... .......... .......... .......... .......... 45% 11.8M 6s 2024-03-30T13:12:26.634 INFO:teuthology.orchestra.run.smithi099.stderr: 75950K .......... .......... .......... .......... .......... 45% 12.4M 6s 2024-03-30T13:12:26.638 INFO:teuthology.orchestra.run.smithi099.stderr: 76000K .......... .......... .......... .......... .......... 45% 17.5M 6s 2024-03-30T13:12:26.640 INFO:teuthology.orchestra.run.smithi099.stderr: 76050K .......... .......... .......... .......... .......... 45% 14.8M 6s 2024-03-30T13:12:26.644 INFO:teuthology.orchestra.run.smithi099.stderr: 76100K .......... .......... .......... .......... .......... 45% 12.1M 6s 2024-03-30T13:12:26.648 INFO:teuthology.orchestra.run.smithi099.stderr: 76150K .......... .......... .......... .......... .......... 45% 12.3M 6s 2024-03-30T13:12:26.651 INFO:teuthology.orchestra.run.smithi099.stderr: 76200K .......... .......... .......... .......... .......... 45% 19.3M 6s 2024-03-30T13:12:26.654 INFO:teuthology.orchestra.run.smithi099.stderr: 76250K .......... .......... .......... .......... .......... 45% 14.3M 6s 2024-03-30T13:12:26.658 INFO:teuthology.orchestra.run.smithi099.stderr: 76300K .......... .......... .......... .......... .......... 45% 21.2M 6s 2024-03-30T13:12:26.662 INFO:teuthology.orchestra.run.smithi099.stderr: 76350K .......... .......... .......... .......... .......... 45% 9.37M 6s 2024-03-30T13:12:26.665 INFO:teuthology.orchestra.run.smithi099.stderr: 76400K .......... .......... .......... .......... .......... 45% 15.9M 6s 2024-03-30T13:12:26.668 INFO:teuthology.orchestra.run.smithi099.stderr: 76450K .......... .......... .......... .......... .......... 45% 16.3M 6s 2024-03-30T13:12:26.670 INFO:teuthology.orchestra.run.smithi099.stderr: 76500K .......... .......... .......... .......... .......... 45% 17.0M 6s 2024-03-30T13:12:26.675 INFO:teuthology.orchestra.run.smithi099.stderr: 76550K .......... .......... .......... .......... .......... 45% 11.1M 6s 2024-03-30T13:12:26.679 INFO:teuthology.orchestra.run.smithi099.stderr: 76600K .......... .......... .......... .......... .......... 45% 13.2M 6s 2024-03-30T13:12:26.682 INFO:teuthology.orchestra.run.smithi099.stderr: 76650K .......... .......... .......... .......... .......... 45% 15.8M 6s 2024-03-30T13:12:26.685 INFO:teuthology.orchestra.run.smithi099.stderr: 76700K .......... .......... .......... .......... .......... 45% 17.2M 6s 2024-03-30T13:12:26.689 INFO:teuthology.orchestra.run.smithi099.stderr: 76750K .......... .......... .......... .......... .......... 45% 15.5M 6s 2024-03-30T13:12:26.693 INFO:teuthology.orchestra.run.smithi099.stderr: 76800K .......... .......... .......... .......... .......... 45% 10.7M 6s 2024-03-30T13:12:26.700 INFO:teuthology.orchestra.run.smithi099.stderr: 76850K .......... .......... .......... .......... .......... 45% 16.8M 6s 2024-03-30T13:12:26.700 INFO:teuthology.orchestra.run.smithi099.stderr: 76900K .......... .......... .......... .......... .......... 45% 14.1M 6s 2024-03-30T13:12:26.702 INFO:teuthology.orchestra.run.smithi099.stderr: 76950K .......... .......... .......... .......... .......... 45% 15.6M 6s 2024-03-30T13:12:26.706 INFO:teuthology.orchestra.run.smithi099.stderr: 77000K .......... .......... .......... .......... .......... 45% 15.6M 6s 2024-03-30T13:12:26.710 INFO:teuthology.orchestra.run.smithi099.stderr: 77050K .......... .......... .......... .......... .......... 45% 10.2M 6s 2024-03-30T13:12:26.714 INFO:teuthology.orchestra.run.smithi099.stderr: 77100K .......... .......... .......... .......... .......... 45% 12.9M 6s 2024-03-30T13:12:26.717 INFO:teuthology.orchestra.run.smithi099.stderr: 77150K .......... .......... .......... .......... .......... 45% 18.2M 6s 2024-03-30T13:12:26.719 INFO:teuthology.orchestra.run.smithi099.stderr: 77200K .......... .......... .......... .......... .......... 45% 15.0M 6s 2024-03-30T13:12:26.724 INFO:teuthology.orchestra.run.smithi099.stderr: 77250K .......... .......... .......... .......... .......... 45% 11.4M 6s 2024-03-30T13:12:26.727 INFO:teuthology.orchestra.run.smithi099.stderr: 77300K .......... .......... .......... .......... .......... 45% 13.3M 6s 2024-03-30T13:12:26.731 INFO:teuthology.orchestra.run.smithi099.stderr: 77350K .......... .......... .......... .......... .......... 45% 14.5M 6s 2024-03-30T13:12:26.733 INFO:teuthology.orchestra.run.smithi099.stderr: 77400K .......... .......... .......... .......... .......... 45% 19.2M 6s 2024-03-30T13:12:26.737 INFO:teuthology.orchestra.run.smithi099.stderr: 77450K .......... .......... .......... .......... .......... 45% 12.7M 6s 2024-03-30T13:12:26.741 INFO:teuthology.orchestra.run.smithi099.stderr: 77500K .......... .......... .......... .......... .......... 46% 12.6M 6s 2024-03-30T13:12:26.744 INFO:teuthology.orchestra.run.smithi099.stderr: 77550K .......... .......... .......... .......... .......... 46% 15.5M 6s 2024-03-30T13:12:26.747 INFO:teuthology.orchestra.run.smithi099.stderr: 77600K .......... .......... .......... .......... .......... 46% 17.8M 6s 2024-03-30T13:12:26.750 INFO:teuthology.orchestra.run.smithi099.stderr: 77650K .......... .......... .......... .......... .......... 46% 14.8M 6s 2024-03-30T13:12:26.754 INFO:teuthology.orchestra.run.smithi099.stderr: 77700K .......... .......... .......... .......... .......... 46% 13.9M 6s 2024-03-30T13:12:26.758 INFO:teuthology.orchestra.run.smithi099.stderr: 77750K .......... .......... .......... .......... .......... 46% 11.0M 6s 2024-03-30T13:12:26.761 INFO:teuthology.orchestra.run.smithi099.stderr: 77800K .......... .......... .......... .......... .......... 46% 16.2M 6s 2024-03-30T13:12:26.769 INFO:teuthology.orchestra.run.smithi099.stderr: 77850K .......... .......... .......... .......... .......... 46% 15.4M 6s 2024-03-30T13:12:26.769 INFO:teuthology.orchestra.run.smithi099.stderr: 77900K .......... .......... .......... .......... .......... 46% 17.2M 6s 2024-03-30T13:12:26.771 INFO:teuthology.orchestra.run.smithi099.stderr: 77950K .......... .......... .......... .......... .......... 46% 14.7M 6s 2024-03-30T13:12:26.781 INFO:teuthology.orchestra.run.smithi099.stderr: 78000K .......... .......... .......... .......... .......... 46% 7.64M 6s 2024-03-30T13:12:26.781 INFO:teuthology.orchestra.run.smithi099.stderr: 78050K .......... .......... .......... .......... .......... 46% 16.6M 6s 2024-03-30T13:12:26.781 INFO:teuthology.orchestra.run.smithi099.stderr: 78100K .......... .......... .......... .......... .......... 46% 46.0M 6s 2024-03-30T13:12:26.784 INFO:teuthology.orchestra.run.smithi099.stderr: 78150K .......... .......... .......... .......... .......... 46% 13.2M 6s 2024-03-30T13:12:26.789 INFO:teuthology.orchestra.run.smithi099.stderr: 78200K .......... .......... .......... .......... .......... 46% 12.9M 6s 2024-03-30T13:12:26.792 INFO:teuthology.orchestra.run.smithi099.stderr: 78250K .......... .......... .......... .......... .......... 46% 12.0M 6s 2024-03-30T13:12:26.795 INFO:teuthology.orchestra.run.smithi099.stderr: 78300K .......... .......... .......... .......... .......... 46% 16.4M 6s 2024-03-30T13:12:26.799 INFO:teuthology.orchestra.run.smithi099.stderr: 78350K .......... .......... .......... .......... .......... 46% 14.6M 6s 2024-03-30T13:12:26.802 INFO:teuthology.orchestra.run.smithi099.stderr: 78400K .......... .......... .......... .......... .......... 46% 14.3M 6s 2024-03-30T13:12:26.806 INFO:teuthology.orchestra.run.smithi099.stderr: 78450K .......... .......... .......... .......... .......... 46% 16.9M 6s 2024-03-30T13:12:26.810 INFO:teuthology.orchestra.run.smithi099.stderr: 78500K .......... .......... .......... .......... .......... 46% 10.9M 6s 2024-03-30T13:12:26.816 INFO:teuthology.orchestra.run.smithi099.stderr: 78550K .......... .......... .......... .......... .......... 46% 19.0M 6s 2024-03-30T13:12:26.816 INFO:teuthology.orchestra.run.smithi099.stderr: 78600K .......... .......... .......... .......... .......... 46% 12.8M 6s 2024-03-30T13:12:26.820 INFO:teuthology.orchestra.run.smithi099.stderr: 78650K .......... .......... .......... .......... .......... 46% 15.1M 6s 2024-03-30T13:12:26.822 INFO:teuthology.orchestra.run.smithi099.stderr: 78700K .......... .......... .......... .......... .......... 46% 14.0M 6s 2024-03-30T13:12:26.826 INFO:teuthology.orchestra.run.smithi099.stderr: 78750K .......... .......... .......... .......... .......... 46% 14.1M 6s 2024-03-30T13:12:26.830 INFO:teuthology.orchestra.run.smithi099.stderr: 78800K .......... .......... .......... .......... .......... 46% 11.9M 6s 2024-03-30T13:12:26.832 INFO:teuthology.orchestra.run.smithi099.stderr: 78850K .......... .......... .......... .......... .......... 46% 30.6M 6s 2024-03-30T13:12:26.836 INFO:teuthology.orchestra.run.smithi099.stderr: 78900K .......... .......... .......... .......... .......... 46% 11.0M 6s 2024-03-30T13:12:26.840 INFO:teuthology.orchestra.run.smithi099.stderr: 78950K .......... .......... .......... .......... .......... 46% 11.9M 6s 2024-03-30T13:12:26.843 INFO:teuthology.orchestra.run.smithi099.stderr: 79000K .......... .......... .......... .......... .......... 46% 17.5M 6s 2024-03-30T13:12:26.846 INFO:teuthology.orchestra.run.smithi099.stderr: 79050K .......... .......... .......... .......... .......... 46% 18.2M 6s 2024-03-30T13:12:26.851 INFO:teuthology.orchestra.run.smithi099.stderr: 79100K .......... .......... .......... .......... .......... 46% 13.2M 6s 2024-03-30T13:12:26.856 INFO:teuthology.orchestra.run.smithi099.stderr: 79150K .......... .......... .......... .......... .......... 46% 7.63M 6s 2024-03-30T13:12:26.859 INFO:teuthology.orchestra.run.smithi099.stderr: 79200K .......... .......... .......... .......... .......... 47% 39.0M 6s 2024-03-30T13:12:26.860 INFO:teuthology.orchestra.run.smithi099.stderr: 79250K .......... .......... .......... .......... .......... 47% 15.6M 6s 2024-03-30T13:12:26.864 INFO:teuthology.orchestra.run.smithi099.stderr: 79300K .......... .......... .......... .......... .......... 47% 14.0M 6s 2024-03-30T13:12:26.868 INFO:teuthology.orchestra.run.smithi099.stderr: 79350K .......... .......... .......... .......... .......... 47% 16.0M 6s 2024-03-30T13:12:26.871 INFO:teuthology.orchestra.run.smithi099.stderr: 79400K .......... .......... .......... .......... .......... 47% 11.4M 6s 2024-03-30T13:12:26.876 INFO:teuthology.orchestra.run.smithi099.stderr: 79450K .......... .......... .......... .......... .......... 47% 12.8M 6s 2024-03-30T13:12:26.879 INFO:teuthology.orchestra.run.smithi099.stderr: 79500K .......... .......... .......... .......... .......... 47% 12.6M 6s 2024-03-30T13:12:26.881 INFO:teuthology.orchestra.run.smithi099.stderr: 79550K .......... .......... .......... .......... .......... 47% 22.2M 6s 2024-03-30T13:12:26.885 INFO:teuthology.orchestra.run.smithi099.stderr: 79600K .......... .......... .......... .......... .......... 47% 13.7M 6s 2024-03-30T13:12:26.889 INFO:teuthology.orchestra.run.smithi099.stderr: 79650K .......... .......... .......... .......... .......... 47% 12.5M 6s 2024-03-30T13:12:26.893 INFO:teuthology.orchestra.run.smithi099.stderr: 79700K .......... .......... .......... .......... .......... 47% 11.9M 6s 2024-03-30T13:12:26.895 INFO:teuthology.orchestra.run.smithi099.stderr: 79750K .......... .......... .......... .......... .......... 47% 20.6M 6s 2024-03-30T13:12:26.898 INFO:teuthology.orchestra.run.smithi099.stderr: 79800K .......... .......... .......... .......... .......... 47% 15.7M 6s 2024-03-30T13:12:26.902 INFO:teuthology.orchestra.run.smithi099.stderr: 79850K .......... .......... .......... .......... .......... 47% 11.8M 6s 2024-03-30T13:12:26.905 INFO:teuthology.orchestra.run.smithi099.stderr: 79900K .......... .......... .......... .......... .......... 47% 16.2M 6s 2024-03-30T13:12:26.908 INFO:teuthology.orchestra.run.smithi099.stderr: 79950K .......... .......... .......... .......... .......... 47% 16.1M 6s 2024-03-30T13:12:26.912 INFO:teuthology.orchestra.run.smithi099.stderr: 80000K .......... .......... .......... .......... .......... 47% 12.5M 6s 2024-03-30T13:12:26.915 INFO:teuthology.orchestra.run.smithi099.stderr: 80050K .......... .......... .......... .......... .......... 47% 17.1M 6s 2024-03-30T13:12:26.919 INFO:teuthology.orchestra.run.smithi099.stderr: 80100K .......... .......... .......... .......... .......... 47% 12.2M 6s 2024-03-30T13:12:26.922 INFO:teuthology.orchestra.run.smithi099.stderr: 80150K .......... .......... .......... .......... .......... 47% 20.3M 6s 2024-03-30T13:12:26.925 INFO:teuthology.orchestra.run.smithi099.stderr: 80200K .......... .......... .......... .......... .......... 47% 12.6M 6s 2024-03-30T13:12:26.928 INFO:teuthology.orchestra.run.smithi099.stderr: 80250K .......... .......... .......... .......... .......... 47% 15.2M 6s 2024-03-30T13:12:26.932 INFO:teuthology.orchestra.run.smithi099.stderr: 80300K .......... .......... .......... .......... .......... 47% 14.5M 6s 2024-03-30T13:12:26.937 INFO:teuthology.orchestra.run.smithi099.stderr: 80350K .......... .......... .......... .......... .......... 47% 11.0M 6s 2024-03-30T13:12:26.940 INFO:teuthology.orchestra.run.smithi099.stderr: 80400K .......... .......... .......... .......... .......... 47% 13.1M 6s 2024-03-30T13:12:26.943 INFO:teuthology.orchestra.run.smithi099.stderr: 80450K .......... .......... .......... .......... .......... 47% 18.6M 6s 2024-03-30T13:12:26.946 INFO:teuthology.orchestra.run.smithi099.stderr: 80500K .......... .......... .......... .......... .......... 47% 15.6M 6s 2024-03-30T13:12:26.950 INFO:teuthology.orchestra.run.smithi099.stderr: 80550K .......... .......... .......... .......... .......... 47% 11.5M 6s 2024-03-30T13:12:26.954 INFO:teuthology.orchestra.run.smithi099.stderr: 80600K .......... .......... .......... .......... .......... 47% 13.3M 6s 2024-03-30T13:12:26.957 INFO:teuthology.orchestra.run.smithi099.stderr: 80650K .......... .......... .......... .......... .......... 47% 13.2M 6s 2024-03-30T13:12:26.960 INFO:teuthology.orchestra.run.smithi099.stderr: 80700K .......... .......... .......... .......... .......... 47% 16.9M 6s 2024-03-30T13:12:26.964 INFO:teuthology.orchestra.run.smithi099.stderr: 80750K .......... .......... .......... .......... .......... 47% 11.6M 6s 2024-03-30T13:12:26.967 INFO:teuthology.orchestra.run.smithi099.stderr: 80800K .......... .......... .......... .......... .......... 47% 19.4M 6s 2024-03-30T13:12:26.970 INFO:teuthology.orchestra.run.smithi099.stderr: 80850K .......... .......... .......... .......... .......... 47% 14.7M 6s 2024-03-30T13:12:26.974 INFO:teuthology.orchestra.run.smithi099.stderr: 80900K .......... .......... .......... .......... .......... 48% 14.5M 6s 2024-03-30T13:12:26.977 INFO:teuthology.orchestra.run.smithi099.stderr: 80950K .......... .......... .......... .......... .......... 48% 13.1M 6s 2024-03-30T13:12:26.981 INFO:teuthology.orchestra.run.smithi099.stderr: 81000K .......... .......... .......... .......... .......... 48% 15.0M 6s 2024-03-30T13:12:26.983 INFO:teuthology.orchestra.run.smithi099.stderr: 81050K .......... .......... .......... .......... .......... 48% 18.6M 6s 2024-03-30T13:12:26.987 INFO:teuthology.orchestra.run.smithi099.stderr: 81100K .......... .......... .......... .......... .......... 48% 13.4M 6s 2024-03-30T13:12:26.991 INFO:teuthology.orchestra.run.smithi099.stderr: 81150K .......... .......... .......... .......... .......... 48% 12.5M 6s 2024-03-30T13:12:26.994 INFO:teuthology.orchestra.run.smithi099.stderr: 81200K .......... .......... .......... .......... .......... 48% 16.7M 6s 2024-03-30T13:12:26.997 INFO:teuthology.orchestra.run.smithi099.stderr: 81250K .......... .......... .......... .......... .......... 48% 13.1M 6s 2024-03-30T13:12:27.001 INFO:teuthology.orchestra.run.smithi099.stderr: 81300K .......... .......... .......... .......... .......... 48% 15.6M 6s 2024-03-30T13:12:27.004 INFO:teuthology.orchestra.run.smithi099.stderr: 81350K .......... .......... .......... .......... .......... 48% 13.5M 6s 2024-03-30T13:12:27.008 INFO:teuthology.orchestra.run.smithi099.stderr: 81400K .......... .......... .......... .......... .......... 48% 13.8M 6s 2024-03-30T13:12:27.011 INFO:teuthology.orchestra.run.smithi099.stderr: 81450K .......... .......... .......... .......... .......... 48% 15.1M 6s 2024-03-30T13:12:27.016 INFO:teuthology.orchestra.run.smithi099.stderr: 81500K .......... .......... .......... .......... .......... 48% 9.56M 6s 2024-03-30T13:12:27.018 INFO:teuthology.orchestra.run.smithi099.stderr: 81550K .......... .......... .......... .......... .......... 48% 20.3M 6s 2024-03-30T13:12:27.022 INFO:teuthology.orchestra.run.smithi099.stderr: 81600K .......... .......... .......... .......... .......... 48% 13.8M 6s 2024-03-30T13:12:27.026 INFO:teuthology.orchestra.run.smithi099.stderr: 81650K .......... .......... .......... .......... .......... 48% 14.7M 6s 2024-03-30T13:12:27.030 INFO:teuthology.orchestra.run.smithi099.stderr: 81700K .......... .......... .......... .......... .......... 48% 10.9M 6s 2024-03-30T13:12:27.032 INFO:teuthology.orchestra.run.smithi099.stderr: 81750K .......... .......... .......... .......... .......... 48% 17.8M 6s 2024-03-30T13:12:27.035 INFO:teuthology.orchestra.run.smithi099.stderr: 81800K .......... .......... .......... .......... .......... 48% 19.3M 6s 2024-03-30T13:12:27.039 INFO:teuthology.orchestra.run.smithi099.stderr: 81850K .......... .......... .......... .......... .......... 48% 11.5M 6s 2024-03-30T13:12:27.043 INFO:teuthology.orchestra.run.smithi099.stderr: 81900K .......... .......... .......... .......... .......... 48% 13.2M 6s 2024-03-30T13:12:27.046 INFO:teuthology.orchestra.run.smithi099.stderr: 81950K .......... .......... .......... .......... .......... 48% 14.6M 6s 2024-03-30T13:12:27.049 INFO:teuthology.orchestra.run.smithi099.stderr: 82000K .......... .......... .......... .......... .......... 48% 16.6M 6s 2024-03-30T13:12:27.053 INFO:teuthology.orchestra.run.smithi099.stderr: 82050K .......... .......... .......... .......... .......... 48% 18.2M 6s 2024-03-30T13:12:27.056 INFO:teuthology.orchestra.run.smithi099.stderr: 82100K .......... .......... .......... .......... .......... 48% 11.2M 6s 2024-03-30T13:12:27.060 INFO:teuthology.orchestra.run.smithi099.stderr: 82150K .......... .......... .......... .......... .......... 48% 14.9M 6s 2024-03-30T13:12:27.063 INFO:teuthology.orchestra.run.smithi099.stderr: 82200K .......... .......... .......... .......... .......... 48% 14.1M 6s 2024-03-30T13:12:27.066 INFO:teuthology.orchestra.run.smithi099.stderr: 82250K .......... .......... .......... .......... .......... 48% 17.3M 6s 2024-03-30T13:12:27.071 INFO:teuthology.orchestra.run.smithi099.stderr: 82300K .......... .......... .......... .......... .......... 48% 10.7M 6s 2024-03-30T13:12:27.079 INFO:teuthology.orchestra.run.smithi099.stderr: 82350K .......... .......... .......... .......... .......... 48% 13.4M 6s 2024-03-30T13:12:27.079 INFO:teuthology.orchestra.run.smithi099.stderr: 82400K .......... .......... .......... .......... .......... 48% 17.9M 6s 2024-03-30T13:12:27.080 INFO:teuthology.orchestra.run.smithi099.stderr: 82450K .......... .......... .......... .......... .......... 48% 13.9M 6s 2024-03-30T13:12:27.083 INFO:teuthology.orchestra.run.smithi099.stderr: 82500K .......... .......... .......... .......... .......... 48% 15.6M 6s 2024-03-30T13:12:27.087 INFO:teuthology.orchestra.run.smithi099.stderr: 82550K .......... .......... .......... .......... .......... 49% 12.2M 6s 2024-03-30T13:12:27.090 INFO:teuthology.orchestra.run.smithi099.stderr: 82600K .......... .......... .......... .......... .......... 49% 19.7M 6s 2024-03-30T13:12:27.095 INFO:teuthology.orchestra.run.smithi099.stderr: 82650K .......... .......... .......... .......... .......... 49% 10.0M 6s 2024-03-30T13:12:27.099 INFO:teuthology.orchestra.run.smithi099.stderr: 82700K .......... .......... .......... .......... .......... 49% 13.9M 6s 2024-03-30T13:12:27.101 INFO:teuthology.orchestra.run.smithi099.stderr: 82750K .......... .......... .......... .......... .......... 49% 19.3M 6s 2024-03-30T13:12:27.105 INFO:teuthology.orchestra.run.smithi099.stderr: 82800K .......... .......... .......... .......... .......... 49% 11.8M 6s 2024-03-30T13:12:27.109 INFO:teuthology.orchestra.run.smithi099.stderr: 82850K .......... .......... .......... .......... .......... 49% 12.4M 6s 2024-03-30T13:12:27.112 INFO:teuthology.orchestra.run.smithi099.stderr: 82900K .......... .......... .......... .......... .......... 49% 17.1M 6s 2024-03-30T13:12:27.115 INFO:teuthology.orchestra.run.smithi099.stderr: 82950K .......... .......... .......... .......... .......... 49% 14.3M 6s 2024-03-30T13:12:27.118 INFO:teuthology.orchestra.run.smithi099.stderr: 83000K .......... .......... .......... .......... .......... 49% 15.0M 6s 2024-03-30T13:12:27.122 INFO:teuthology.orchestra.run.smithi099.stderr: 83050K .......... .......... .......... .......... .......... 49% 12.9M 6s 2024-03-30T13:12:27.125 INFO:teuthology.orchestra.run.smithi099.stderr: 83100K .......... .......... .......... .......... .......... 49% 15.3M 6s 2024-03-30T13:12:27.129 INFO:teuthology.orchestra.run.smithi099.stderr: 83150K .......... .......... .......... .......... .......... 49% 15.1M 6s 2024-03-30T13:12:27.131 INFO:teuthology.orchestra.run.smithi099.stderr: 83200K .......... .......... .......... .......... .......... 49% 17.1M 6s 2024-03-30T13:12:27.135 INFO:teuthology.orchestra.run.smithi099.stderr: 83250K .......... .......... .......... .......... .......... 49% 13.6M 6s 2024-03-30T13:12:27.140 INFO:teuthology.orchestra.run.smithi099.stderr: 83300K .......... .......... .......... .......... .......... 49% 11.1M 6s 2024-03-30T13:12:27.143 INFO:teuthology.orchestra.run.smithi099.stderr: 83350K .......... .......... .......... .......... .......... 49% 16.3M 6s 2024-03-30T13:12:27.149 INFO:teuthology.orchestra.run.smithi099.stderr: 83400K .......... .......... .......... .......... .......... 49% 14.0M 6s 2024-03-30T13:12:27.153 INFO:teuthology.orchestra.run.smithi099.stderr: 83450K .......... .......... .......... .......... .......... 49% 9.07M 6s 2024-03-30T13:12:27.154 INFO:teuthology.orchestra.run.smithi099.stderr: 83500K .......... .......... .......... .......... .......... 49% 55.4M 6s 2024-03-30T13:12:27.157 INFO:teuthology.orchestra.run.smithi099.stderr: 83550K .......... .......... .......... .......... .......... 49% 10.6M 6s 2024-03-30T13:12:27.160 INFO:teuthology.orchestra.run.smithi099.stderr: 83600K .......... .......... .......... .......... .......... 49% 13.9M 6s 2024-03-30T13:12:27.164 INFO:teuthology.orchestra.run.smithi099.stderr: 83650K .......... .......... .......... .......... .......... 49% 15.3M 6s 2024-03-30T13:12:27.166 INFO:teuthology.orchestra.run.smithi099.stderr: 83700K .......... .......... .......... .......... .......... 49% 20.7M 6s 2024-03-30T13:12:27.170 INFO:teuthology.orchestra.run.smithi099.stderr: 83750K .......... .......... .......... .......... .......... 49% 14.2M 6s 2024-03-30T13:12:27.175 INFO:teuthology.orchestra.run.smithi099.stderr: 83800K .......... .......... .......... .......... .......... 49% 9.73M 6s 2024-03-30T13:12:27.178 INFO:teuthology.orchestra.run.smithi099.stderr: 83850K .......... .......... .......... .......... .......... 49% 16.0M 6s 2024-03-30T13:12:27.181 INFO:teuthology.orchestra.run.smithi099.stderr: 83900K .......... .......... .......... .......... .......... 49% 14.6M 6s 2024-03-30T13:12:27.184 INFO:teuthology.orchestra.run.smithi099.stderr: 83950K .......... .......... .......... .......... .......... 49% 16.4M 6s 2024-03-30T13:12:27.189 INFO:teuthology.orchestra.run.smithi099.stderr: 84000K .......... .......... .......... .......... .......... 49% 10.0M 6s 2024-03-30T13:12:27.191 INFO:teuthology.orchestra.run.smithi099.stderr: 84050K .......... .......... .......... .......... .......... 49% 18.8M 6s 2024-03-30T13:12:27.194 INFO:teuthology.orchestra.run.smithi099.stderr: 84100K .......... .......... .......... .......... .......... 49% 15.4M 6s 2024-03-30T13:12:27.198 INFO:teuthology.orchestra.run.smithi099.stderr: 84150K .......... .......... .......... .......... .......... 49% 14.3M 6s 2024-03-30T13:12:27.201 INFO:teuthology.orchestra.run.smithi099.stderr: 84200K .......... .......... .......... .......... .......... 49% 15.4M 6s 2024-03-30T13:12:27.206 INFO:teuthology.orchestra.run.smithi099.stderr: 84250K .......... .......... .......... .......... .......... 50% 11.2M 6s 2024-03-30T13:12:27.208 INFO:teuthology.orchestra.run.smithi099.stderr: 84300K .......... .......... .......... .......... .......... 50% 17.9M 6s 2024-03-30T13:12:27.213 INFO:teuthology.orchestra.run.smithi099.stderr: 84350K .......... .......... .......... .......... .......... 50% 11.6M 6s 2024-03-30T13:12:27.220 INFO:teuthology.orchestra.run.smithi099.stderr: 84400K .......... .......... .......... .......... .......... 50% 17.8M 6s 2024-03-30T13:12:27.220 INFO:teuthology.orchestra.run.smithi099.stderr: 84450K .......... .......... .......... .......... .......... 50% 16.5M 6s 2024-03-30T13:12:27.223 INFO:teuthology.orchestra.run.smithi099.stderr: 84500K .......... .......... .......... .......... .......... 50% 10.7M 6s 2024-03-30T13:12:27.226 INFO:teuthology.orchestra.run.smithi099.stderr: 84550K .......... .......... .......... .......... .......... 50% 14.3M 6s 2024-03-30T13:12:27.229 INFO:teuthology.orchestra.run.smithi099.stderr: 84600K .......... .......... .......... .......... .......... 50% 18.4M 6s 2024-03-30T13:12:27.232 INFO:teuthology.orchestra.run.smithi099.stderr: 84650K .......... .......... .......... .......... .......... 50% 13.7M 6s 2024-03-30T13:12:27.235 INFO:teuthology.orchestra.run.smithi099.stderr: 84700K .......... .......... .......... .......... .......... 50% 16.6M 6s 2024-03-30T13:12:27.240 INFO:teuthology.orchestra.run.smithi099.stderr: 84750K .......... .......... .......... .......... .......... 50% 10.1M 6s 2024-03-30T13:12:27.243 INFO:teuthology.orchestra.run.smithi099.stderr: 84800K .......... .......... .......... .......... .......... 50% 17.2M 6s 2024-03-30T13:12:27.246 INFO:teuthology.orchestra.run.smithi099.stderr: 84850K .......... .......... .......... .......... .......... 50% 15.7M 6s 2024-03-30T13:12:27.249 INFO:teuthology.orchestra.run.smithi099.stderr: 84900K .......... .......... .......... .......... .......... 50% 15.7M 6s 2024-03-30T13:12:27.254 INFO:teuthology.orchestra.run.smithi099.stderr: 84950K .......... .......... .......... .......... .......... 50% 11.5M 6s 2024-03-30T13:12:27.257 INFO:teuthology.orchestra.run.smithi099.stderr: 85000K .......... .......... .......... .......... .......... 50% 12.4M 6s 2024-03-30T13:12:27.260 INFO:teuthology.orchestra.run.smithi099.stderr: 85050K .......... .......... .......... .......... .......... 50% 17.1M 6s 2024-03-30T13:12:27.263 INFO:teuthology.orchestra.run.smithi099.stderr: 85100K .......... .......... .......... .......... .......... 50% 16.8M 6s 2024-03-30T13:12:27.267 INFO:teuthology.orchestra.run.smithi099.stderr: 85150K .......... .......... .......... .......... .......... 50% 11.5M 6s 2024-03-30T13:12:27.271 INFO:teuthology.orchestra.run.smithi099.stderr: 85200K .......... .......... .......... .......... .......... 50% 15.7M 6s 2024-03-30T13:12:27.274 INFO:teuthology.orchestra.run.smithi099.stderr: 85250K .......... .......... .......... .......... .......... 50% 13.6M 6s 2024-03-30T13:12:27.278 INFO:teuthology.orchestra.run.smithi099.stderr: 85300K .......... .......... .......... .......... .......... 50% 12.3M 6s 2024-03-30T13:12:27.280 INFO:teuthology.orchestra.run.smithi099.stderr: 85350K .......... .......... .......... .......... .......... 50% 22.8M 6s 2024-03-30T13:12:27.284 INFO:teuthology.orchestra.run.smithi099.stderr: 85400K .......... .......... .......... .......... .......... 50% 12.7M 6s 2024-03-30T13:12:27.288 INFO:teuthology.orchestra.run.smithi099.stderr: 85450K .......... .......... .......... .......... .......... 50% 12.1M 6s 2024-03-30T13:12:27.291 INFO:teuthology.orchestra.run.smithi099.stderr: 85500K .......... .......... .......... .......... .......... 50% 15.6M 6s 2024-03-30T13:12:27.295 INFO:teuthology.orchestra.run.smithi099.stderr: 85550K .......... .......... .......... .......... .......... 50% 14.6M 6s 2024-03-30T13:12:27.297 INFO:teuthology.orchestra.run.smithi099.stderr: 85600K .......... .......... .......... .......... .......... 50% 18.4M 6s 2024-03-30T13:12:27.302 INFO:teuthology.orchestra.run.smithi099.stderr: 85650K .......... .......... .......... .......... .......... 50% 15.5M 6s 2024-03-30T13:12:27.306 INFO:teuthology.orchestra.run.smithi099.stderr: 85700K .......... .......... .......... .......... .......... 50% 9.31M 6s 2024-03-30T13:12:27.308 INFO:teuthology.orchestra.run.smithi099.stderr: 85750K .......... .......... .......... .......... .......... 50% 21.2M 6s 2024-03-30T13:12:27.311 INFO:teuthology.orchestra.run.smithi099.stderr: 85800K .......... .......... .......... .......... .......... 50% 14.3M 6s 2024-03-30T13:12:27.316 INFO:teuthology.orchestra.run.smithi099.stderr: 85850K .......... .......... .......... .......... .......... 50% 14.9M 6s 2024-03-30T13:12:27.320 INFO:teuthology.orchestra.run.smithi099.stderr: 85900K .......... .......... .......... .......... .......... 50% 12.6M 6s 2024-03-30T13:12:27.323 INFO:teuthology.orchestra.run.smithi099.stderr: 85950K .......... .......... .......... .......... .......... 51% 12.4M 6s 2024-03-30T13:12:27.325 INFO:teuthology.orchestra.run.smithi099.stderr: 86000K .......... .......... .......... .......... .......... 51% 17.2M 6s 2024-03-30T13:12:27.329 INFO:teuthology.orchestra.run.smithi099.stderr: 86050K .......... .......... .......... .......... .......... 51% 14.4M 6s 2024-03-30T13:12:27.333 INFO:teuthology.orchestra.run.smithi099.stderr: 86100K .......... .......... .......... .......... .......... 51% 11.6M 6s 2024-03-30T13:12:27.337 INFO:teuthology.orchestra.run.smithi099.stderr: 86150K .......... .......... .......... .......... .......... 51% 11.5M 6s 2024-03-30T13:12:27.340 INFO:teuthology.orchestra.run.smithi099.stderr: 86200K .......... .......... .......... .......... .......... 51% 17.0M 6s 2024-03-30T13:12:27.343 INFO:teuthology.orchestra.run.smithi099.stderr: 86250K .......... .......... .......... .......... .......... 51% 16.3M 6s 2024-03-30T13:12:27.347 INFO:teuthology.orchestra.run.smithi099.stderr: 86300K .......... .......... .......... .......... .......... 51% 11.5M 6s 2024-03-30T13:12:27.349 INFO:teuthology.orchestra.run.smithi099.stderr: 86350K .......... .......... .......... .......... .......... 51% 22.1M 6s 2024-03-30T13:12:27.353 INFO:teuthology.orchestra.run.smithi099.stderr: 86400K .......... .......... .......... .......... .......... 51% 13.7M 6s 2024-03-30T13:12:27.356 INFO:teuthology.orchestra.run.smithi099.stderr: 86450K .......... .......... .......... .......... .......... 51% 14.1M 6s 2024-03-30T13:12:27.361 INFO:teuthology.orchestra.run.smithi099.stderr: 86500K .......... .......... .......... .......... .......... 51% 12.6M 6s 2024-03-30T13:12:27.363 INFO:teuthology.orchestra.run.smithi099.stderr: 86550K .......... .......... .......... .......... .......... 51% 15.9M 6s 2024-03-30T13:12:27.367 INFO:teuthology.orchestra.run.smithi099.stderr: 86600K .......... .......... .......... .......... .......... 51% 13.1M 6s 2024-03-30T13:12:27.370 INFO:teuthology.orchestra.run.smithi099.stderr: 86650K .......... .......... .......... .......... .......... 51% 15.6M 6s 2024-03-30T13:12:27.374 INFO:teuthology.orchestra.run.smithi099.stderr: 86700K .......... .......... .......... .......... .......... 51% 13.0M 6s 2024-03-30T13:12:27.377 INFO:teuthology.orchestra.run.smithi099.stderr: 86750K .......... .......... .......... .......... .......... 51% 14.9M 6s 2024-03-30T13:12:27.380 INFO:teuthology.orchestra.run.smithi099.stderr: 86800K .......... .......... .......... .......... .......... 51% 17.7M 6s 2024-03-30T13:12:27.384 INFO:teuthology.orchestra.run.smithi099.stderr: 86850K .......... .......... .......... .......... .......... 51% 11.9M 6s 2024-03-30T13:12:27.388 INFO:teuthology.orchestra.run.smithi099.stderr: 86900K .......... .......... .......... .......... .......... 51% 13.9M 6s 2024-03-30T13:12:27.391 INFO:teuthology.orchestra.run.smithi099.stderr: 86950K .......... .......... .......... .......... .......... 51% 14.8M 6s 2024-03-30T13:12:27.394 INFO:teuthology.orchestra.run.smithi099.stderr: 87000K .......... .......... .......... .......... .......... 51% 16.1M 6s 2024-03-30T13:12:27.398 INFO:teuthology.orchestra.run.smithi099.stderr: 87050K .......... .......... .......... .......... .......... 51% 12.0M 6s 2024-03-30T13:12:27.402 INFO:teuthology.orchestra.run.smithi099.stderr: 87100K .......... .......... .......... .......... .......... 51% 14.3M 6s 2024-03-30T13:12:27.404 INFO:teuthology.orchestra.run.smithi099.stderr: 87150K .......... .......... .......... .......... .......... 51% 16.9M 6s 2024-03-30T13:12:27.408 INFO:teuthology.orchestra.run.smithi099.stderr: 87200K .......... .......... .......... .......... .......... 51% 13.2M 6s 2024-03-30T13:12:27.412 INFO:teuthology.orchestra.run.smithi099.stderr: 87250K .......... .......... .......... .......... .......... 51% 11.3M 6s 2024-03-30T13:12:27.414 INFO:teuthology.orchestra.run.smithi099.stderr: 87300K .......... .......... .......... .......... .......... 51% 21.7M 6s 2024-03-30T13:12:27.419 INFO:teuthology.orchestra.run.smithi099.stderr: 87350K .......... .......... .......... .......... .......... 51% 12.8M 6s 2024-03-30T13:12:27.422 INFO:teuthology.orchestra.run.smithi099.stderr: 87400K .......... .......... .......... .......... .......... 51% 13.4M 6s 2024-03-30T13:12:27.425 INFO:teuthology.orchestra.run.smithi099.stderr: 87450K .......... .......... .......... .......... .......... 51% 13.8M 6s 2024-03-30T13:12:27.429 INFO:teuthology.orchestra.run.smithi099.stderr: 87500K .......... .......... .......... .......... .......... 51% 13.7M 6s 2024-03-30T13:12:27.432 INFO:teuthology.orchestra.run.smithi099.stderr: 87550K .......... .......... .......... .......... .......... 51% 14.7M 6s 2024-03-30T13:12:27.436 INFO:teuthology.orchestra.run.smithi099.stderr: 87600K .......... .......... .......... .......... .......... 51% 12.2M 6s 2024-03-30T13:12:27.439 INFO:teuthology.orchestra.run.smithi099.stderr: 87650K .......... .......... .......... .......... .......... 52% 18.2M 6s 2024-03-30T13:12:27.443 INFO:teuthology.orchestra.run.smithi099.stderr: 87700K .......... .......... .......... .......... .......... 52% 13.2M 6s 2024-03-30T13:12:27.446 INFO:teuthology.orchestra.run.smithi099.stderr: 87750K .......... .......... .......... .......... .......... 52% 15.5M 6s 2024-03-30T13:12:27.449 INFO:teuthology.orchestra.run.smithi099.stderr: 87800K .......... .......... .......... .......... .......... 52% 13.5M 6s 2024-03-30T13:12:27.453 INFO:teuthology.orchestra.run.smithi099.stderr: 87850K .......... .......... .......... .......... .......... 52% 13.5M 6s 2024-03-30T13:12:27.456 INFO:teuthology.orchestra.run.smithi099.stderr: 87900K .......... .......... .......... .......... .......... 52% 16.4M 6s 2024-03-30T13:12:27.459 INFO:teuthology.orchestra.run.smithi099.stderr: 87950K .......... .......... .......... .......... .......... 52% 15.1M 6s 2024-03-30T13:12:27.464 INFO:teuthology.orchestra.run.smithi099.stderr: 88000K .......... .......... .......... .......... .......... 52% 12.0M 6s 2024-03-30T13:12:27.466 INFO:teuthology.orchestra.run.smithi099.stderr: 88050K .......... .......... .......... .......... .......... 52% 18.9M 5s 2024-03-30T13:12:27.470 INFO:teuthology.orchestra.run.smithi099.stderr: 88100K .......... .......... .......... .......... .......... 52% 13.7M 5s 2024-03-30T13:12:27.473 INFO:teuthology.orchestra.run.smithi099.stderr: 88150K .......... .......... .......... .......... .......... 52% 15.2M 5s 2024-03-30T13:12:27.477 INFO:teuthology.orchestra.run.smithi099.stderr: 88200K .......... .......... .......... .......... .......... 52% 11.4M 5s 2024-03-30T13:12:27.480 INFO:teuthology.orchestra.run.smithi099.stderr: 88250K .......... .......... .......... .......... .......... 52% 17.4M 5s 2024-03-30T13:12:27.483 INFO:teuthology.orchestra.run.smithi099.stderr: 88300K .......... .......... .......... .......... .......... 52% 13.2M 5s 2024-03-30T13:12:27.487 INFO:teuthology.orchestra.run.smithi099.stderr: 88350K .......... .......... .......... .......... .......... 52% 14.0M 5s 2024-03-30T13:12:27.490 INFO:teuthology.orchestra.run.smithi099.stderr: 88400K .......... .......... .......... .......... .......... 52% 15.0M 5s 2024-03-30T13:12:27.495 INFO:teuthology.orchestra.run.smithi099.stderr: 88450K .......... .......... .......... .......... .......... 52% 12.0M 5s 2024-03-30T13:12:27.498 INFO:teuthology.orchestra.run.smithi099.stderr: 88500K .......... .......... .......... .......... .......... 52% 13.4M 5s 2024-03-30T13:12:27.501 INFO:teuthology.orchestra.run.smithi099.stderr: 88550K .......... .......... .......... .......... .......... 52% 17.0M 5s 2024-03-30T13:12:27.505 INFO:teuthology.orchestra.run.smithi099.stderr: 88600K .......... .......... .......... .......... .......... 52% 12.7M 5s 2024-03-30T13:12:27.508 INFO:teuthology.orchestra.run.smithi099.stderr: 88650K .......... .......... .......... .......... .......... 52% 13.5M 5s 2024-03-30T13:12:27.512 INFO:teuthology.orchestra.run.smithi099.stderr: 88700K .......... .......... .......... .......... .......... 52% 14.0M 5s 2024-03-30T13:12:27.519 INFO:teuthology.orchestra.run.smithi099.stderr: 88750K .......... .......... .......... .......... .......... 52% 15.4M 5s 2024-03-30T13:12:27.520 INFO:teuthology.orchestra.run.smithi099.stderr: 88800K .......... .......... .......... .......... .......... 52% 15.4M 5s 2024-03-30T13:12:27.523 INFO:teuthology.orchestra.run.smithi099.stderr: 88850K .......... .......... .......... .......... .......... 52% 11.2M 5s 2024-03-30T13:12:27.526 INFO:teuthology.orchestra.run.smithi099.stderr: 88900K .......... .......... .......... .......... .......... 52% 16.9M 5s 2024-03-30T13:12:27.529 INFO:teuthology.orchestra.run.smithi099.stderr: 88950K .......... .......... .......... .......... .......... 52% 13.7M 5s 2024-03-30T13:12:27.533 INFO:teuthology.orchestra.run.smithi099.stderr: 89000K .......... .......... .......... .......... .......... 52% 15.9M 5s 2024-03-30T13:12:27.536 INFO:teuthology.orchestra.run.smithi099.stderr: 89050K .......... .......... .......... .......... .......... 52% 15.5M 5s 2024-03-30T13:12:27.542 INFO:teuthology.orchestra.run.smithi099.stderr: 89100K .......... .......... .......... .......... .......... 52% 10.9M 5s 2024-03-30T13:12:27.543 INFO:teuthology.orchestra.run.smithi099.stderr: 89150K .......... .......... .......... .......... .......... 52% 16.0M 5s 2024-03-30T13:12:27.546 INFO:teuthology.orchestra.run.smithi099.stderr: 89200K .......... .......... .......... .......... .......... 52% 15.6M 5s 2024-03-30T13:12:27.550 INFO:teuthology.orchestra.run.smithi099.stderr: 89250K .......... .......... .......... .......... .......... 52% 15.1M 5s 2024-03-30T13:12:27.553 INFO:teuthology.orchestra.run.smithi099.stderr: 89300K .......... .......... .......... .......... .......... 53% 13.5M 5s 2024-03-30T13:12:27.558 INFO:teuthology.orchestra.run.smithi099.stderr: 89350K .......... .......... .......... .......... .......... 53% 10.6M 5s 2024-03-30T13:12:27.560 INFO:teuthology.orchestra.run.smithi099.stderr: 89400K .......... .......... .......... .......... .......... 53% 17.8M 5s 2024-03-30T13:12:27.563 INFO:teuthology.orchestra.run.smithi099.stderr: 89450K .......... .......... .......... .......... .......... 53% 14.7M 5s 2024-03-30T13:12:27.566 INFO:teuthology.orchestra.run.smithi099.stderr: 89500K .......... .......... .......... .......... .......... 53% 16.2M 5s 2024-03-30T13:12:27.571 INFO:teuthology.orchestra.run.smithi099.stderr: 89550K .......... .......... .......... .......... .......... 53% 11.6M 5s 2024-03-30T13:12:27.575 INFO:teuthology.orchestra.run.smithi099.stderr: 89600K .......... .......... .......... .......... .......... 53% 12.8M 5s 2024-03-30T13:12:27.578 INFO:teuthology.orchestra.run.smithi099.stderr: 89650K .......... .......... .......... .......... .......... 53% 16.6M 5s 2024-03-30T13:12:27.581 INFO:teuthology.orchestra.run.smithi099.stderr: 89700K .......... .......... .......... .......... .......... 53% 13.9M 5s 2024-03-30T13:12:27.584 INFO:teuthology.orchestra.run.smithi099.stderr: 89750K .......... .......... .......... .......... .......... 53% 15.9M 5s 2024-03-30T13:12:27.589 INFO:teuthology.orchestra.run.smithi099.stderr: 89800K .......... .......... .......... .......... .......... 53% 10.3M 5s 2024-03-30T13:12:27.592 INFO:teuthology.orchestra.run.smithi099.stderr: 89850K .......... .......... .......... .......... .......... 53% 17.3M 5s 2024-03-30T13:12:27.594 INFO:teuthology.orchestra.run.smithi099.stderr: 89900K .......... .......... .......... .......... .......... 53% 17.2M 5s 2024-03-30T13:12:27.598 INFO:teuthology.orchestra.run.smithi099.stderr: 89950K .......... .......... .......... .......... .......... 53% 13.2M 5s 2024-03-30T13:12:27.601 INFO:teuthology.orchestra.run.smithi099.stderr: 90000K .......... .......... .......... .......... .......... 53% 18.1M 5s 2024-03-30T13:12:27.605 INFO:teuthology.orchestra.run.smithi099.stderr: 90050K .......... .......... .......... .......... .......... 53% 11.6M 5s 2024-03-30T13:12:27.608 INFO:teuthology.orchestra.run.smithi099.stderr: 90100K .......... .......... .......... .......... .......... 53% 14.6M 5s 2024-03-30T13:12:27.612 INFO:teuthology.orchestra.run.smithi099.stderr: 90150K .......... .......... .......... .......... .......... 53% 16.3M 5s 2024-03-30T13:12:27.615 INFO:teuthology.orchestra.run.smithi099.stderr: 90200K .......... .......... .......... .......... .......... 53% 14.0M 5s 2024-03-30T13:12:27.619 INFO:teuthology.orchestra.run.smithi099.stderr: 90250K .......... .......... .......... .......... .......... 53% 13.1M 5s 2024-03-30T13:12:27.623 INFO:teuthology.orchestra.run.smithi099.stderr: 90300K .......... .......... .......... .......... .......... 53% 11.5M 5s 2024-03-30T13:12:27.626 INFO:teuthology.orchestra.run.smithi099.stderr: 90350K .......... .......... .......... .......... .......... 53% 16.3M 5s 2024-03-30T13:12:27.629 INFO:teuthology.orchestra.run.smithi099.stderr: 90400K .......... .......... .......... .......... .......... 53% 17.0M 5s 2024-03-30T13:12:27.633 INFO:teuthology.orchestra.run.smithi099.stderr: 90450K .......... .......... .......... .......... .......... 53% 12.6M 5s 2024-03-30T13:12:27.636 INFO:teuthology.orchestra.run.smithi099.stderr: 90500K .......... .......... .......... .......... .......... 53% 18.3M 5s 2024-03-30T13:12:27.640 INFO:teuthology.orchestra.run.smithi099.stderr: 90550K .......... .......... .......... .......... .......... 53% 10.1M 5s 2024-03-30T13:12:27.644 INFO:teuthology.orchestra.run.smithi099.stderr: 90600K .......... .......... .......... .......... .......... 53% 15.8M 5s 2024-03-30T13:12:27.647 INFO:teuthology.orchestra.run.smithi099.stderr: 90650K .......... .......... .......... .......... .......... 53% 14.9M 5s 2024-03-30T13:12:27.650 INFO:teuthology.orchestra.run.smithi099.stderr: 90700K .......... .......... .......... .......... .......... 53% 14.6M 5s 2024-03-30T13:12:27.655 INFO:teuthology.orchestra.run.smithi099.stderr: 90750K .......... .......... .......... .......... .......... 53% 10.4M 5s 2024-03-30T13:12:27.658 INFO:teuthology.orchestra.run.smithi099.stderr: 90800K .......... .......... .......... .......... .......... 53% 15.5M 5s 2024-03-30T13:12:27.661 INFO:teuthology.orchestra.run.smithi099.stderr: 90850K .......... .......... .......... .......... .......... 53% 16.7M 5s 2024-03-30T13:12:27.665 INFO:teuthology.orchestra.run.smithi099.stderr: 90900K .......... .......... .......... .......... .......... 53% 14.1M 5s 2024-03-30T13:12:27.667 INFO:teuthology.orchestra.run.smithi099.stderr: 90950K .......... .......... .......... .......... .......... 53% 15.4M 5s 2024-03-30T13:12:27.671 INFO:teuthology.orchestra.run.smithi099.stderr: 91000K .......... .......... .......... .......... .......... 54% 12.0M 5s 2024-03-30T13:12:27.675 INFO:teuthology.orchestra.run.smithi099.stderr: 91050K .......... .......... .......... .......... .......... 54% 15.3M 5s 2024-03-30T13:12:27.678 INFO:teuthology.orchestra.run.smithi099.stderr: 91100K .......... .......... .......... .......... .......... 54% 15.1M 5s 2024-03-30T13:12:27.681 INFO:teuthology.orchestra.run.smithi099.stderr: 91150K .......... .......... .......... .......... .......... 54% 15.4M 5s 2024-03-30T13:12:27.683 INFO:teuthology.orchestra.run.smithi099.stderr: 91200K .......... .......... .......... .......... .......... 54% 17.5M 5s 2024-03-30T13:12:27.688 INFO:teuthology.orchestra.run.smithi099.stderr: 91250K .......... .......... .......... .......... .......... 54% 11.0M 5s 2024-03-30T13:12:27.691 INFO:teuthology.orchestra.run.smithi099.stderr: 91300K .......... .......... .......... .......... .......... 54% 15.0M 5s 2024-03-30T13:12:27.695 INFO:teuthology.orchestra.run.smithi099.stderr: 91350K .......... .......... .......... .......... .......... 54% 13.8M 5s 2024-03-30T13:12:27.698 INFO:teuthology.orchestra.run.smithi099.stderr: 91400K .......... .......... .......... .......... .......... 54% 16.8M 5s 2024-03-30T13:12:27.701 INFO:teuthology.orchestra.run.smithi099.stderr: 91450K .......... .......... .......... .......... .......... 54% 14.2M 5s 2024-03-30T13:12:27.706 INFO:teuthology.orchestra.run.smithi099.stderr: 91500K .......... .......... .......... .......... .......... 54% 11.4M 5s 2024-03-30T13:12:27.709 INFO:teuthology.orchestra.run.smithi099.stderr: 91550K .......... .......... .......... .......... .......... 54% 15.5M 5s 2024-03-30T13:12:27.712 INFO:teuthology.orchestra.run.smithi099.stderr: 91600K .......... .......... .......... .......... .......... 54% 15.3M 5s 2024-03-30T13:12:27.718 INFO:teuthology.orchestra.run.smithi099.stderr: 91650K .......... .......... .......... .......... .......... 54% 16.1M 5s 2024-03-30T13:12:27.719 INFO:teuthology.orchestra.run.smithi099.stderr: 91700K .......... .......... .......... .......... .......... 54% 11.4M 5s 2024-03-30T13:12:27.723 INFO:teuthology.orchestra.run.smithi099.stderr: 91750K .......... .......... .......... .......... .......... 54% 12.6M 5s 2024-03-30T13:12:27.726 INFO:teuthology.orchestra.run.smithi099.stderr: 91800K .......... .......... .......... .......... .......... 54% 17.4M 5s 2024-03-30T13:12:27.729 INFO:teuthology.orchestra.run.smithi099.stderr: 91850K .......... .......... .......... .......... .......... 54% 13.9M 5s 2024-03-30T13:12:27.733 INFO:teuthology.orchestra.run.smithi099.stderr: 91900K .......... .......... .......... .......... .......... 54% 14.8M 5s 2024-03-30T13:12:27.737 INFO:teuthology.orchestra.run.smithi099.stderr: 91950K .......... .......... .......... .......... .......... 54% 14.3M 5s 2024-03-30T13:12:27.740 INFO:teuthology.orchestra.run.smithi099.stderr: 92000K .......... .......... .......... .......... .......... 54% 13.6M 5s 2024-03-30T13:12:27.743 INFO:teuthology.orchestra.run.smithi099.stderr: 92050K .......... .......... .......... .......... .......... 54% 14.3M 5s 2024-03-30T13:12:27.746 INFO:teuthology.orchestra.run.smithi099.stderr: 92100K .......... .......... .......... .......... .......... 54% 16.0M 5s 2024-03-30T13:12:27.750 INFO:teuthology.orchestra.run.smithi099.stderr: 92150K .......... .......... .......... .......... .......... 54% 13.4M 5s 2024-03-30T13:12:27.754 INFO:teuthology.orchestra.run.smithi099.stderr: 92200K .......... .......... .......... .......... .......... 54% 15.3M 5s 2024-03-30T13:12:27.757 INFO:teuthology.orchestra.run.smithi099.stderr: 92250K .......... .......... .......... .......... .......... 54% 11.9M 5s 2024-03-30T13:12:27.760 INFO:teuthology.orchestra.run.smithi099.stderr: 92300K .......... .......... .......... .......... .......... 54% 14.4M 5s 2024-03-30T13:12:27.763 INFO:teuthology.orchestra.run.smithi099.stderr: 92350K .......... .......... .......... .......... .......... 54% 17.4M 5s 2024-03-30T13:12:27.769 INFO:teuthology.orchestra.run.smithi099.stderr: 92400K .......... .......... .......... .......... .......... 54% 13.3M 5s 2024-03-30T13:12:27.771 INFO:teuthology.orchestra.run.smithi099.stderr: 92450K .......... .......... .......... .......... .......... 54% 11.5M 5s 2024-03-30T13:12:27.775 INFO:teuthology.orchestra.run.smithi099.stderr: 92500K .......... .......... .......... .......... .......... 54% 13.6M 5s 2024-03-30T13:12:27.778 INFO:teuthology.orchestra.run.smithi099.stderr: 92550K .......... .......... .......... .......... .......... 54% 17.7M 5s 2024-03-30T13:12:27.781 INFO:teuthology.orchestra.run.smithi099.stderr: 92600K .......... .......... .......... .......... .......... 54% 15.6M 5s 2024-03-30T13:12:27.786 INFO:teuthology.orchestra.run.smithi099.stderr: 92650K .......... .......... .......... .......... .......... 54% 12.6M 5s 2024-03-30T13:12:27.789 INFO:teuthology.orchestra.run.smithi099.stderr: 92700K .......... .......... .......... .......... .......... 55% 11.8M 5s 2024-03-30T13:12:27.792 INFO:teuthology.orchestra.run.smithi099.stderr: 92750K .......... .......... .......... .......... .......... 55% 18.2M 5s 2024-03-30T13:12:27.795 INFO:teuthology.orchestra.run.smithi099.stderr: 92800K .......... .......... .......... .......... .......... 55% 12.8M 5s 2024-03-30T13:12:27.799 INFO:teuthology.orchestra.run.smithi099.stderr: 92850K .......... .......... .......... .......... .......... 55% 14.0M 5s 2024-03-30T13:12:27.803 INFO:teuthology.orchestra.run.smithi099.stderr: 92900K .......... .......... .......... .......... .......... 55% 11.8M 5s 2024-03-30T13:12:27.806 INFO:teuthology.orchestra.run.smithi099.stderr: 92950K .......... .......... .......... .......... .......... 55% 16.4M 5s 2024-03-30T13:12:27.809 INFO:teuthology.orchestra.run.smithi099.stderr: 93000K .......... .......... .......... .......... .......... 55% 16.0M 5s 2024-03-30T13:12:27.812 INFO:teuthology.orchestra.run.smithi099.stderr: 93050K .......... .......... .......... .......... .......... 55% 14.6M 5s 2024-03-30T13:12:27.816 INFO:teuthology.orchestra.run.smithi099.stderr: 93100K .......... .......... .......... .......... .......... 55% 13.4M 5s 2024-03-30T13:12:27.820 INFO:teuthology.orchestra.run.smithi099.stderr: 93150K .......... .......... .......... .......... .......... 55% 12.8M 5s 2024-03-30T13:12:27.823 INFO:teuthology.orchestra.run.smithi099.stderr: 93200K .......... .......... .......... .......... .......... 55% 16.8M 5s 2024-03-30T13:12:27.827 INFO:teuthology.orchestra.run.smithi099.stderr: 93250K .......... .......... .......... .......... .......... 55% 13.3M 5s 2024-03-30T13:12:27.828 INFO:teuthology.orchestra.run.smithi099.stderr: 93300K .......... .......... .......... .......... .......... 55% 21.3M 5s 2024-03-30T13:12:27.833 INFO:teuthology.orchestra.run.smithi099.stderr: 93350K .......... .......... .......... .......... .......... 55% 11.7M 5s 2024-03-30T13:12:27.837 INFO:teuthology.orchestra.run.smithi099.stderr: 93400K .......... .......... .......... .......... .......... 55% 11.5M 5s 2024-03-30T13:12:27.841 INFO:teuthology.orchestra.run.smithi099.stderr: 93450K .......... .......... .......... .......... .......... 55% 13.1M 5s 2024-03-30T13:12:27.843 INFO:teuthology.orchestra.run.smithi099.stderr: 93500K .......... .......... .......... .......... .......... 55% 17.8M 5s 2024-03-30T13:12:27.847 INFO:teuthology.orchestra.run.smithi099.stderr: 93550K .......... .......... .......... .......... .......... 55% 14.5M 5s 2024-03-30T13:12:27.849 INFO:teuthology.orchestra.run.smithi099.stderr: 93600K .......... .......... .......... .......... .......... 55% 19.5M 5s 2024-03-30T13:12:27.853 INFO:teuthology.orchestra.run.smithi099.stderr: 93650K .......... .......... .......... .......... .......... 55% 11.7M 5s 2024-03-30T13:12:27.857 INFO:teuthology.orchestra.run.smithi099.stderr: 93700K .......... .......... .......... .......... .......... 55% 14.9M 5s 2024-03-30T13:12:27.861 INFO:teuthology.orchestra.run.smithi099.stderr: 93750K .......... .......... .......... .......... .......... 55% 12.8M 5s 2024-03-30T13:12:27.864 INFO:teuthology.orchestra.run.smithi099.stderr: 93800K .......... .......... .......... .......... .......... 55% 13.5M 5s 2024-03-30T13:12:27.867 INFO:teuthology.orchestra.run.smithi099.stderr: 93850K .......... .......... .......... .......... .......... 55% 16.0M 5s 2024-03-30T13:12:27.871 INFO:teuthology.orchestra.run.smithi099.stderr: 93900K .......... .......... .......... .......... .......... 55% 12.3M 5s 2024-03-30T13:12:27.875 INFO:teuthology.orchestra.run.smithi099.stderr: 93950K .......... .......... .......... .......... .......... 55% 14.3M 5s 2024-03-30T13:12:27.878 INFO:teuthology.orchestra.run.smithi099.stderr: 94000K .......... .......... .......... .......... .......... 55% 16.3M 5s 2024-03-30T13:12:27.881 INFO:teuthology.orchestra.run.smithi099.stderr: 94050K .......... .......... .......... .......... .......... 55% 14.1M 5s 2024-03-30T13:12:27.885 INFO:teuthology.orchestra.run.smithi099.stderr: 94100K .......... .......... .......... .......... .......... 55% 17.3M 5s 2024-03-30T13:12:27.888 INFO:teuthology.orchestra.run.smithi099.stderr: 94150K .......... .......... .......... .......... .......... 55% 12.4M 5s 2024-03-30T13:12:27.891 INFO:teuthology.orchestra.run.smithi099.stderr: 94200K .......... .......... .......... .......... .......... 55% 16.3M 5s 2024-03-30T13:12:27.893 INFO:teuthology.orchestra.run.smithi099.stderr: 94250K .......... .......... .......... .......... .......... 55% 20.6M 5s 2024-03-30T13:12:27.895 INFO:teuthology.orchestra.run.smithi099.stderr: 94300K .......... .......... .......... .......... .......... 55% 22.0M 5s 2024-03-30T13:12:27.900 INFO:teuthology.orchestra.run.smithi099.stderr: 94350K .......... .......... .......... .......... .......... 56% 13.3M 5s 2024-03-30T13:12:27.903 INFO:teuthology.orchestra.run.smithi099.stderr: 94400K .......... .......... .......... .......... .......... 56% 12.2M 5s 2024-03-30T13:12:27.907 INFO:teuthology.orchestra.run.smithi099.stderr: 94450K .......... .......... .......... .......... .......... 56% 15.0M 5s 2024-03-30T13:12:27.910 INFO:teuthology.orchestra.run.smithi099.stderr: 94500K .......... .......... .......... .......... .......... 56% 12.0M 5s 2024-03-30T13:12:27.914 INFO:teuthology.orchestra.run.smithi099.stderr: 94550K .......... .......... .......... .......... .......... 56% 15.1M 5s 2024-03-30T13:12:27.917 INFO:teuthology.orchestra.run.smithi099.stderr: 94600K .......... .......... .......... .......... .......... 56% 13.1M 5s 2024-03-30T13:12:27.924 INFO:teuthology.orchestra.run.smithi099.stderr: 94650K .......... .......... .......... .......... .......... 56% 17.4M 5s 2024-03-30T13:12:27.924 INFO:teuthology.orchestra.run.smithi099.stderr: 94700K .......... .......... .......... .......... .......... 56% 12.5M 5s 2024-03-30T13:12:27.928 INFO:teuthology.orchestra.run.smithi099.stderr: 94750K .......... .......... .......... .......... .......... 56% 13.2M 5s 2024-03-30T13:12:27.931 INFO:teuthology.orchestra.run.smithi099.stderr: 94800K .......... .......... .......... .......... .......... 56% 15.8M 5s 2024-03-30T13:12:27.935 INFO:teuthology.orchestra.run.smithi099.stderr: 94850K .......... .......... .......... .......... .......... 56% 11.2M 5s 2024-03-30T13:12:27.938 INFO:teuthology.orchestra.run.smithi099.stderr: 94900K .......... .......... .......... .......... .......... 56% 16.3M 5s 2024-03-30T13:12:27.942 INFO:teuthology.orchestra.run.smithi099.stderr: 94950K .......... .......... .......... .......... .......... 56% 13.5M 5s 2024-03-30T13:12:27.948 INFO:teuthology.orchestra.run.smithi099.stderr: 95000K .......... .......... .......... .......... .......... 56% 8.96M 5s 2024-03-30T13:12:27.950 INFO:teuthology.orchestra.run.smithi099.stderr: 95050K .......... .......... .......... .......... .......... 56% 17.3M 5s 2024-03-30T13:12:27.954 INFO:teuthology.orchestra.run.smithi099.stderr: 95100K .......... .......... .......... .......... .......... 56% 12.6M 5s 2024-03-30T13:12:27.957 INFO:teuthology.orchestra.run.smithi099.stderr: 95150K .......... .......... .......... .......... .......... 56% 15.9M 5s 2024-03-30T13:12:27.959 INFO:teuthology.orchestra.run.smithi099.stderr: 95200K .......... .......... .......... .......... .......... 56% 21.2M 5s 2024-03-30T13:12:27.962 INFO:teuthology.orchestra.run.smithi099.stderr: 95250K .......... .......... .......... .......... .......... 56% 15.4M 5s 2024-03-30T13:12:27.966 INFO:teuthology.orchestra.run.smithi099.stderr: 95300K .......... .......... .......... .......... .......... 56% 13.1M 5s 2024-03-30T13:12:27.970 INFO:teuthology.orchestra.run.smithi099.stderr: 95350K .......... .......... .......... .......... .......... 56% 13.5M 5s 2024-03-30T13:12:27.973 INFO:teuthology.orchestra.run.smithi099.stderr: 95400K .......... .......... .......... .......... .......... 56% 15.8M 5s 2024-03-30T13:12:27.976 INFO:teuthology.orchestra.run.smithi099.stderr: 95450K .......... .......... .......... .......... .......... 56% 18.5M 5s 2024-03-30T13:12:27.979 INFO:teuthology.orchestra.run.smithi099.stderr: 95500K .......... .......... .......... .......... .......... 56% 15.9M 5s 2024-03-30T13:12:27.981 INFO:teuthology.orchestra.run.smithi099.stderr: 95550K .......... .......... .......... .......... .......... 56% 17.2M 5s 2024-03-30T13:12:27.986 INFO:teuthology.orchestra.run.smithi099.stderr: 95600K .......... .......... .......... .......... .......... 56% 11.8M 5s 2024-03-30T13:12:27.989 INFO:teuthology.orchestra.run.smithi099.stderr: 95650K .......... .......... .......... .......... .......... 56% 13.4M 5s 2024-03-30T13:12:27.993 INFO:teuthology.orchestra.run.smithi099.stderr: 95700K .......... .......... .......... .......... .......... 56% 12.5M 5s 2024-03-30T13:12:27.996 INFO:teuthology.orchestra.run.smithi099.stderr: 95750K .......... .......... .......... .......... .......... 56% 16.1M 5s 2024-03-30T13:12:27.999 INFO:teuthology.orchestra.run.smithi099.stderr: 95800K .......... .......... .......... .......... .......... 56% 17.6M 5s 2024-03-30T13:12:28.002 INFO:teuthology.orchestra.run.smithi099.stderr: 95850K .......... .......... .......... .......... .......... 56% 14.4M 5s 2024-03-30T13:12:28.005 INFO:teuthology.orchestra.run.smithi099.stderr: 95900K .......... .......... .......... .......... .......... 56% 15.9M 5s 2024-03-30T13:12:28.010 INFO:teuthology.orchestra.run.smithi099.stderr: 95950K .......... .......... .......... .......... .......... 56% 10.2M 5s 2024-03-30T13:12:28.015 INFO:teuthology.orchestra.run.smithi099.stderr: 96000K .......... .......... .......... .......... .......... 56% 14.9M 5s 2024-03-30T13:12:28.019 INFO:teuthology.orchestra.run.smithi099.stderr: 96050K .......... .......... .......... .......... .......... 57% 9.88M 5s 2024-03-30T13:12:28.021 INFO:teuthology.orchestra.run.smithi099.stderr: 96100K .......... .......... .......... .......... .......... 57% 19.0M 5s 2024-03-30T13:12:28.025 INFO:teuthology.orchestra.run.smithi099.stderr: 96150K .......... .......... .......... .......... .......... 57% 13.3M 5s 2024-03-30T13:12:28.029 INFO:teuthology.orchestra.run.smithi099.stderr: 96200K .......... .......... .......... .......... .......... 57% 11.4M 5s 2024-03-30T13:12:28.033 INFO:teuthology.orchestra.run.smithi099.stderr: 96250K .......... .......... .......... .......... .......... 57% 14.0M 5s 2024-03-30T13:12:28.036 INFO:teuthology.orchestra.run.smithi099.stderr: 96300K .......... .......... .......... .......... .......... 57% 13.2M 5s 2024-03-30T13:12:28.039 INFO:teuthology.orchestra.run.smithi099.stderr: 96350K .......... .......... .......... .......... .......... 57% 18.2M 5s 2024-03-30T13:12:28.042 INFO:teuthology.orchestra.run.smithi099.stderr: 96400K .......... .......... .......... .......... .......... 57% 14.9M 5s 2024-03-30T13:12:28.045 INFO:teuthology.orchestra.run.smithi099.stderr: 96450K .......... .......... .......... .......... .......... 57% 17.7M 5s 2024-03-30T13:12:28.049 INFO:teuthology.orchestra.run.smithi099.stderr: 96500K .......... .......... .......... .......... .......... 57% 12.4M 5s 2024-03-30T13:12:28.053 INFO:teuthology.orchestra.run.smithi099.stderr: 96550K .......... .......... .......... .......... .......... 57% 14.1M 5s 2024-03-30T13:12:28.056 INFO:teuthology.orchestra.run.smithi099.stderr: 96600K .......... .......... .......... .......... .......... 57% 13.5M 5s 2024-03-30T13:12:28.059 INFO:teuthology.orchestra.run.smithi099.stderr: 96650K .......... .......... .......... .......... .......... 57% 16.4M 5s 2024-03-30T13:12:28.062 INFO:teuthology.orchestra.run.smithi099.stderr: 96700K .......... .......... .......... .......... .......... 57% 16.5M 5s 2024-03-30T13:12:28.065 INFO:teuthology.orchestra.run.smithi099.stderr: 96750K .......... .......... .......... .......... .......... 57% 15.6M 5s 2024-03-30T13:12:28.070 INFO:teuthology.orchestra.run.smithi099.stderr: 96800K .......... .......... .......... .......... .......... 57% 12.6M 5s 2024-03-30T13:12:28.072 INFO:teuthology.orchestra.run.smithi099.stderr: 96850K .......... .......... .......... .......... .......... 57% 13.9M 5s 2024-03-30T13:12:28.075 INFO:teuthology.orchestra.run.smithi099.stderr: 96900K .......... .......... .......... .......... .......... 57% 16.9M 5s 2024-03-30T13:12:28.079 INFO:teuthology.orchestra.run.smithi099.stderr: 96950K .......... .......... .......... .......... .......... 57% 13.7M 5s 2024-03-30T13:12:28.082 INFO:teuthology.orchestra.run.smithi099.stderr: 97000K .......... .......... .......... .......... .......... 57% 16.8M 5s 2024-03-30T13:12:28.085 INFO:teuthology.orchestra.run.smithi099.stderr: 97050K .......... .......... .......... .......... .......... 57% 15.2M 5s 2024-03-30T13:12:28.088 INFO:teuthology.orchestra.run.smithi099.stderr: 97100K .......... .......... .......... .......... .......... 57% 16.5M 5s 2024-03-30T13:12:28.091 INFO:teuthology.orchestra.run.smithi099.stderr: 97150K .......... .......... .......... .......... .......... 57% 13.4M 5s 2024-03-30T13:12:28.095 INFO:teuthology.orchestra.run.smithi099.stderr: 97200K .......... .......... .......... .......... .......... 57% 14.8M 5s 2024-03-30T13:12:28.099 INFO:teuthology.orchestra.run.smithi099.stderr: 97250K .......... .......... .......... .......... .......... 57% 13.0M 5s 2024-03-30T13:12:28.102 INFO:teuthology.orchestra.run.smithi099.stderr: 97300K .......... .......... .......... .......... .......... 57% 15.1M 5s 2024-03-30T13:12:28.106 INFO:teuthology.orchestra.run.smithi099.stderr: 97350K .......... .......... .......... .......... .......... 57% 12.8M 5s 2024-03-30T13:12:28.110 INFO:teuthology.orchestra.run.smithi099.stderr: 97400K .......... .......... .......... .......... .......... 57% 12.8M 5s 2024-03-30T13:12:28.113 INFO:teuthology.orchestra.run.smithi099.stderr: 97450K .......... .......... .......... .......... .......... 57% 11.7M 5s 2024-03-30T13:12:28.118 INFO:teuthology.orchestra.run.smithi099.stderr: 97500K .......... .......... .......... .......... .......... 57% 11.1M 5s 2024-03-30T13:12:28.126 INFO:teuthology.orchestra.run.smithi099.stderr: 97550K .......... .......... .......... .......... .......... 57% 12.2M 5s 2024-03-30T13:12:28.127 INFO:teuthology.orchestra.run.smithi099.stderr: 97600K .......... .......... .......... .......... .......... 57% 14.2M 5s 2024-03-30T13:12:28.129 INFO:teuthology.orchestra.run.smithi099.stderr: 97650K .......... .......... .......... .......... .......... 57% 14.4M 5s 2024-03-30T13:12:28.132 INFO:teuthology.orchestra.run.smithi099.stderr: 97700K .......... .......... .......... .......... .......... 57% 23.3M 5s 2024-03-30T13:12:28.135 INFO:teuthology.orchestra.run.smithi099.stderr: 97750K .......... .......... .......... .......... .......... 58% 12.4M 5s 2024-03-30T13:12:28.139 INFO:teuthology.orchestra.run.smithi099.stderr: 97800K .......... .......... .......... .......... .......... 58% 13.6M 5s 2024-03-30T13:12:28.143 INFO:teuthology.orchestra.run.smithi099.stderr: 97850K .......... .......... .......... .......... .......... 58% 17.4M 5s 2024-03-30T13:12:28.144 INFO:teuthology.orchestra.run.smithi099.stderr: 97900K .......... .......... .......... .......... .......... 58% 17.6M 5s 2024-03-30T13:12:28.150 INFO:teuthology.orchestra.run.smithi099.stderr: 97950K .......... .......... .......... .......... .......... 58% 9.75M 5s 2024-03-30T13:12:28.151 INFO:teuthology.orchestra.run.smithi099.stderr: 98000K .......... .......... .......... .......... .......... 58% 35.5M 5s 2024-03-30T13:12:28.155 INFO:teuthology.orchestra.run.smithi099.stderr: 98050K .......... .......... .......... .......... .......... 58% 11.0M 5s 2024-03-30T13:12:28.158 INFO:teuthology.orchestra.run.smithi099.stderr: 98100K .......... .......... .......... .......... .......... 58% 14.8M 5s 2024-03-30T13:12:28.161 INFO:teuthology.orchestra.run.smithi099.stderr: 98150K .......... .......... .......... .......... .......... 58% 18.7M 5s 2024-03-30T13:12:28.164 INFO:teuthology.orchestra.run.smithi099.stderr: 98200K .......... .......... .......... .......... .......... 58% 14.7M 5s 2024-03-30T13:12:28.166 INFO:teuthology.orchestra.run.smithi099.stderr: 98250K .......... .......... .......... .......... .......... 58% 22.6M 5s 2024-03-30T13:12:28.171 INFO:teuthology.orchestra.run.smithi099.stderr: 98300K .......... .......... .......... .......... .......... 58% 11.5M 5s 2024-03-30T13:12:28.174 INFO:teuthology.orchestra.run.smithi099.stderr: 98350K .......... .......... .......... .......... .......... 58% 14.0M 5s 2024-03-30T13:12:28.178 INFO:teuthology.orchestra.run.smithi099.stderr: 98400K .......... .......... .......... .......... .......... 58% 12.6M 5s 2024-03-30T13:12:28.182 INFO:teuthology.orchestra.run.smithi099.stderr: 98450K .......... .......... .......... .......... .......... 58% 12.2M 5s 2024-03-30T13:12:28.185 INFO:teuthology.orchestra.run.smithi099.stderr: 98500K .......... .......... .......... .......... .......... 58% 17.6M 5s 2024-03-30T13:12:28.190 INFO:teuthology.orchestra.run.smithi099.stderr: 98550K .......... .......... .......... .......... .......... 58% 9.54M 5s 2024-03-30T13:12:28.193 INFO:teuthology.orchestra.run.smithi099.stderr: 98600K .......... .......... .......... .......... .......... 58% 14.2M 5s 2024-03-30T13:12:28.197 INFO:teuthology.orchestra.run.smithi099.stderr: 98650K .......... .......... .......... .......... .......... 58% 12.3M 5s 2024-03-30T13:12:28.201 INFO:teuthology.orchestra.run.smithi099.stderr: 98700K .......... .......... .......... .......... .......... 58% 13.1M 5s 2024-03-30T13:12:28.204 INFO:teuthology.orchestra.run.smithi099.stderr: 98750K .......... .......... .......... .......... .......... 58% 16.8M 5s 2024-03-30T13:12:28.207 INFO:teuthology.orchestra.run.smithi099.stderr: 98800K .......... .......... .......... .......... .......... 58% 17.9M 5s 2024-03-30T13:12:28.209 INFO:teuthology.orchestra.run.smithi099.stderr: 98850K .......... .......... .......... .......... .......... 58% 17.3M 5s 2024-03-30T13:12:28.215 INFO:teuthology.orchestra.run.smithi099.stderr: 98900K .......... .......... .......... .......... .......... 58% 11.7M 5s 2024-03-30T13:12:28.216 INFO:teuthology.orchestra.run.smithi099.stderr: 98950K .......... .......... .......... .......... .......... 58% 20.2M 5s 2024-03-30T13:12:28.219 INFO:teuthology.orchestra.run.smithi099.stderr: 99000K .......... .......... .......... .......... .......... 58% 16.8M 5s 2024-03-30T13:12:28.223 INFO:teuthology.orchestra.run.smithi099.stderr: 99050K .......... .......... .......... .......... .......... 58% 13.0M 5s 2024-03-30T13:12:28.225 INFO:teuthology.orchestra.run.smithi099.stderr: 99100K .......... .......... .......... .......... .......... 58% 19.7M 5s 2024-03-30T13:12:28.229 INFO:teuthology.orchestra.run.smithi099.stderr: 99150K .......... .......... .......... .......... .......... 58% 13.3M 5s 2024-03-30T13:12:28.232 INFO:teuthology.orchestra.run.smithi099.stderr: 99200K .......... .......... .......... .......... .......... 58% 17.2M 5s 2024-03-30T13:12:28.234 INFO:teuthology.orchestra.run.smithi099.stderr: 99250K .......... .......... .......... .......... .......... 58% 17.4M 5s 2024-03-30T13:12:28.238 INFO:teuthology.orchestra.run.smithi099.stderr: 99300K .......... .......... .......... .......... .......... 58% 14.5M 5s 2024-03-30T13:12:28.241 INFO:teuthology.orchestra.run.smithi099.stderr: 99350K .......... .......... .......... .......... .......... 58% 18.6M 5s 2024-03-30T13:12:28.245 INFO:teuthology.orchestra.run.smithi099.stderr: 99400K .......... .......... .......... .......... .......... 58% 15.8M 5s 2024-03-30T13:12:28.248 INFO:teuthology.orchestra.run.smithi099.stderr: 99450K .......... .......... .......... .......... .......... 59% 12.6M 5s 2024-03-30T13:12:28.252 INFO:teuthology.orchestra.run.smithi099.stderr: 99500K .......... .......... .......... .......... .......... 59% 11.4M 5s 2024-03-30T13:12:28.256 INFO:teuthology.orchestra.run.smithi099.stderr: 99550K .......... .......... .......... .......... .......... 59% 11.2M 5s 2024-03-30T13:12:28.259 INFO:teuthology.orchestra.run.smithi099.stderr: 99600K .......... .......... .......... .......... .......... 59% 13.6M 5s 2024-03-30T13:12:28.265 INFO:teuthology.orchestra.run.smithi099.stderr: 99650K .......... .......... .......... .......... .......... 59% 9.24M 5s 2024-03-30T13:12:28.269 INFO:teuthology.orchestra.run.smithi099.stderr: 99700K .......... .......... .......... .......... .......... 59% 11.3M 5s 2024-03-30T13:12:28.272 INFO:teuthology.orchestra.run.smithi099.stderr: 99750K .......... .......... .......... .......... .......... 59% 17.7M 5s 2024-03-30T13:12:28.276 INFO:teuthology.orchestra.run.smithi099.stderr: 99800K .......... .......... .......... .......... .......... 59% 13.2M 5s 2024-03-30T13:12:28.279 INFO:teuthology.orchestra.run.smithi099.stderr: 99850K .......... .......... .......... .......... .......... 59% 12.9M 5s 2024-03-30T13:12:28.283 INFO:teuthology.orchestra.run.smithi099.stderr: 99900K .......... .......... .......... .......... .......... 59% 15.1M 5s 2024-03-30T13:12:28.286 INFO:teuthology.orchestra.run.smithi099.stderr: 99950K .......... .......... .......... .......... .......... 59% 16.8M 5s 2024-03-30T13:12:28.289 INFO:teuthology.orchestra.run.smithi099.stderr:100000K .......... .......... .......... .......... .......... 59% 15.7M 5s 2024-03-30T13:12:28.292 INFO:teuthology.orchestra.run.smithi099.stderr:100050K .......... .......... .......... .......... .......... 59% 16.7M 5s 2024-03-30T13:12:28.295 INFO:teuthology.orchestra.run.smithi099.stderr:100100K .......... .......... .......... .......... .......... 59% 14.7M 5s 2024-03-30T13:12:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:100150K .......... .......... .......... .......... .......... 59% 16.9M 5s 2024-03-30T13:12:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:100200K .......... .......... .......... .......... .......... 59% 18.4M 5s 2024-03-30T13:12:28.303 INFO:teuthology.orchestra.run.smithi099.stderr:100250K .......... .......... .......... .......... .......... 59% 19.8M 5s 2024-03-30T13:12:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:100300K .......... .......... .......... .......... .......... 59% 15.3M 5s 2024-03-30T13:12:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:100350K .......... .......... .......... .......... .......... 59% 17.9M 5s 2024-03-30T13:12:28.313 INFO:teuthology.orchestra.run.smithi099.stderr:100400K .......... .......... .......... .......... .......... 59% 13.1M 5s 2024-03-30T13:12:28.316 INFO:teuthology.orchestra.run.smithi099.stderr:100450K .......... .......... .......... .......... .......... 59% 13.6M 5s 2024-03-30T13:12:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:100500K .......... .......... .......... .......... .......... 59% 14.3M 5s 2024-03-30T13:12:28.323 INFO:teuthology.orchestra.run.smithi099.stderr:100550K .......... .......... .......... .......... .......... 59% 13.9M 5s 2024-03-30T13:12:28.327 INFO:teuthology.orchestra.run.smithi099.stderr:100600K .......... .......... .......... .......... .......... 59% 14.6M 5s 2024-03-30T13:12:28.336 INFO:teuthology.orchestra.run.smithi099.stderr:100650K .......... .......... .......... .......... .......... 59% 9.33M 5s 2024-03-30T13:12:28.336 INFO:teuthology.orchestra.run.smithi099.stderr:100700K .......... .......... .......... .......... .......... 59% 13.1M 5s 2024-03-30T13:12:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:100750K .......... .......... .......... .......... .......... 59% 14.4M 5s 2024-03-30T13:12:28.344 INFO:teuthology.orchestra.run.smithi099.stderr:100800K .......... .......... .......... .......... .......... 59% 9.67M 5s 2024-03-30T13:12:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:100850K .......... .......... .......... .......... .......... 59% 12.3M 5s 2024-03-30T13:12:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:100900K .......... .......... .......... .......... .......... 59% 11.6M 5s 2024-03-30T13:12:28.355 INFO:teuthology.orchestra.run.smithi099.stderr:100950K .......... .......... .......... .......... .......... 59% 14.8M 5s 2024-03-30T13:12:28.358 INFO:teuthology.orchestra.run.smithi099.stderr:101000K .......... .......... .......... .......... .......... 59% 17.0M 5s 2024-03-30T13:12:28.362 INFO:teuthology.orchestra.run.smithi099.stderr:101050K .......... .......... .......... .......... .......... 59% 14.5M 5s 2024-03-30T13:12:28.366 INFO:teuthology.orchestra.run.smithi099.stderr:101100K .......... .......... .......... .......... .......... 60% 14.2M 5s 2024-03-30T13:12:28.368 INFO:teuthology.orchestra.run.smithi099.stderr:101150K .......... .......... .......... .......... .......... 60% 15.3M 5s 2024-03-30T13:12:28.372 INFO:teuthology.orchestra.run.smithi099.stderr:101200K .......... .......... .......... .......... .......... 60% 15.6M 5s 2024-03-30T13:12:28.374 INFO:teuthology.orchestra.run.smithi099.stderr:101250K .......... .......... .......... .......... .......... 60% 19.2M 5s 2024-03-30T13:12:28.376 INFO:teuthology.orchestra.run.smithi099.stderr:101300K .......... .......... .......... .......... .......... 60% 20.1M 5s 2024-03-30T13:12:28.381 INFO:teuthology.orchestra.run.smithi099.stderr:101350K .......... .......... .......... .......... .......... 60% 11.5M 5s 2024-03-30T13:12:28.383 INFO:teuthology.orchestra.run.smithi099.stderr:101400K .......... .......... .......... .......... .......... 60% 17.7M 5s 2024-03-30T13:12:28.387 INFO:teuthology.orchestra.run.smithi099.stderr:101450K .......... .......... .......... .......... .......... 60% 14.2M 5s 2024-03-30T13:12:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:101500K .......... .......... .......... .......... .......... 60% 18.4M 5s 2024-03-30T13:12:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:101550K .......... .......... .......... .......... .......... 60% 16.0M 5s 2024-03-30T13:12:28.397 INFO:teuthology.orchestra.run.smithi099.stderr:101600K .......... .......... .......... .......... .......... 60% 10.5M 5s 2024-03-30T13:12:28.400 INFO:teuthology.orchestra.run.smithi099.stderr:101650K .......... .......... .......... .......... .......... 60% 16.4M 5s 2024-03-30T13:12:28.403 INFO:teuthology.orchestra.run.smithi099.stderr:101700K .......... .......... .......... .......... .......... 60% 15.6M 5s 2024-03-30T13:12:28.407 INFO:teuthology.orchestra.run.smithi099.stderr:101750K .......... .......... .......... .......... .......... 60% 14.6M 5s 2024-03-30T13:12:28.411 INFO:teuthology.orchestra.run.smithi099.stderr:101800K .......... .......... .......... .......... .......... 60% 11.0M 5s 2024-03-30T13:12:28.416 INFO:teuthology.orchestra.run.smithi099.stderr:101850K .......... .......... .......... .......... .......... 60% 11.2M 5s 2024-03-30T13:12:28.419 INFO:teuthology.orchestra.run.smithi099.stderr:101900K .......... .......... .......... .......... .......... 60% 14.7M 5s 2024-03-30T13:12:28.424 INFO:teuthology.orchestra.run.smithi099.stderr:101950K .......... .......... .......... .......... .......... 60% 10.2M 5s 2024-03-30T13:12:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:102000K .......... .......... .......... .......... .......... 60% 14.7M 5s 2024-03-30T13:12:28.431 INFO:teuthology.orchestra.run.smithi099.stderr:102050K .......... .......... .......... .......... .......... 60% 12.1M 5s 2024-03-30T13:12:28.435 INFO:teuthology.orchestra.run.smithi099.stderr:102100K .......... .......... .......... .......... .......... 60% 14.0M 5s 2024-03-30T13:12:28.438 INFO:teuthology.orchestra.run.smithi099.stderr:102150K .......... .......... .......... .......... .......... 60% 14.5M 5s 2024-03-30T13:12:28.441 INFO:teuthology.orchestra.run.smithi099.stderr:102200K .......... .......... .......... .......... .......... 60% 15.7M 5s 2024-03-30T13:12:28.443 INFO:teuthology.orchestra.run.smithi099.stderr:102250K .......... .......... .......... .......... .......... 60% 21.3M 5s 2024-03-30T13:12:28.446 INFO:teuthology.orchestra.run.smithi099.stderr:102300K .......... .......... .......... .......... .......... 60% 15.5M 5s 2024-03-30T13:12:28.450 INFO:teuthology.orchestra.run.smithi099.stderr:102350K .......... .......... .......... .......... .......... 60% 12.2M 5s 2024-03-30T13:12:28.453 INFO:teuthology.orchestra.run.smithi099.stderr:102400K .......... .......... .......... .......... .......... 60% 16.9M 5s 2024-03-30T13:12:28.456 INFO:teuthology.orchestra.run.smithi099.stderr:102450K .......... .......... .......... .......... .......... 60% 18.1M 5s 2024-03-30T13:12:28.458 INFO:teuthology.orchestra.run.smithi099.stderr:102500K .......... .......... .......... .......... .......... 60% 18.9M 5s 2024-03-30T13:12:28.463 INFO:teuthology.orchestra.run.smithi099.stderr:102550K .......... .......... .......... .......... .......... 60% 12.0M 5s 2024-03-30T13:12:28.466 INFO:teuthology.orchestra.run.smithi099.stderr:102600K .......... .......... .......... .......... .......... 60% 15.1M 5s 2024-03-30T13:12:28.469 INFO:teuthology.orchestra.run.smithi099.stderr:102650K .......... .......... .......... .......... .......... 60% 16.3M 5s 2024-03-30T13:12:28.472 INFO:teuthology.orchestra.run.smithi099.stderr:102700K .......... .......... .......... .......... .......... 60% 14.1M 5s 2024-03-30T13:12:28.477 INFO:teuthology.orchestra.run.smithi099.stderr:102750K .......... .......... .......... .......... .......... 60% 11.1M 4s 2024-03-30T13:12:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:102800K .......... .......... .......... .......... .......... 61% 12.9M 4s 2024-03-30T13:12:28.483 INFO:teuthology.orchestra.run.smithi099.stderr:102850K .......... .......... .......... .......... .......... 61% 18.0M 4s 2024-03-30T13:12:28.487 INFO:teuthology.orchestra.run.smithi099.stderr:102900K .......... .......... .......... .......... .......... 61% 12.2M 4s 2024-03-30T13:12:28.492 INFO:teuthology.orchestra.run.smithi099.stderr:102950K .......... .......... .......... .......... .......... 61% 10.8M 4s 2024-03-30T13:12:28.496 INFO:teuthology.orchestra.run.smithi099.stderr:103000K .......... .......... .......... .......... .......... 61% 15.8M 4s 2024-03-30T13:12:28.499 INFO:teuthology.orchestra.run.smithi099.stderr:103050K .......... .......... .......... .......... .......... 61% 11.3M 4s 2024-03-30T13:12:28.503 INFO:teuthology.orchestra.run.smithi099.stderr:103100K .......... .......... .......... .......... .......... 61% 12.1M 4s 2024-03-30T13:12:28.506 INFO:teuthology.orchestra.run.smithi099.stderr:103150K .......... .......... .......... .......... .......... 61% 19.2M 4s 2024-03-30T13:12:28.509 INFO:teuthology.orchestra.run.smithi099.stderr:103200K .......... .......... .......... .......... .......... 61% 14.4M 4s 2024-03-30T13:12:28.513 INFO:teuthology.orchestra.run.smithi099.stderr:103250K .......... .......... .......... .......... .......... 61% 17.2M 4s 2024-03-30T13:12:28.517 INFO:teuthology.orchestra.run.smithi099.stderr:103300K .......... .......... .......... .......... .......... 61% 9.62M 4s 2024-03-30T13:12:28.520 INFO:teuthology.orchestra.run.smithi099.stderr:103350K .......... .......... .......... .......... .......... 61% 15.5M 4s 2024-03-30T13:12:28.524 INFO:teuthology.orchestra.run.smithi099.stderr:103400K .......... .......... .......... .......... .......... 61% 12.7M 4s 2024-03-30T13:12:28.526 INFO:teuthology.orchestra.run.smithi099.stderr:103450K .......... .......... .......... .......... .......... 61% 19.4M 4s 2024-03-30T13:12:28.531 INFO:teuthology.orchestra.run.smithi099.stderr:103500K .......... .......... .......... .......... .......... 61% 11.2M 4s 2024-03-30T13:12:28.534 INFO:teuthology.orchestra.run.smithi099.stderr:103550K .......... .......... .......... .......... .......... 61% 16.5M 4s 2024-03-30T13:12:28.537 INFO:teuthology.orchestra.run.smithi099.stderr:103600K .......... .......... .......... .......... .......... 61% 16.4M 4s 2024-03-30T13:12:28.539 INFO:teuthology.orchestra.run.smithi099.stderr:103650K .......... .......... .......... .......... .......... 61% 17.0M 4s 2024-03-30T13:12:28.542 INFO:teuthology.orchestra.run.smithi099.stderr:103700K .......... .......... .......... .......... .......... 61% 16.4M 4s 2024-03-30T13:12:28.547 INFO:teuthology.orchestra.run.smithi099.stderr:103750K .......... .......... .......... .......... .......... 61% 12.3M 4s 2024-03-30T13:12:28.550 INFO:teuthology.orchestra.run.smithi099.stderr:103800K .......... .......... .......... .......... .......... 61% 16.6M 4s 2024-03-30T13:12:28.555 INFO:teuthology.orchestra.run.smithi099.stderr:103850K .......... .......... .......... .......... .......... 61% 13.7M 4s 2024-03-30T13:12:28.556 INFO:teuthology.orchestra.run.smithi099.stderr:103900K .......... .......... .......... .......... .......... 61% 16.2M 4s 2024-03-30T13:12:28.560 INFO:teuthology.orchestra.run.smithi099.stderr:103950K .......... .......... .......... .......... .......... 61% 13.6M 4s 2024-03-30T13:12:28.564 INFO:teuthology.orchestra.run.smithi099.stderr:104000K .......... .......... .......... .......... .......... 61% 12.3M 4s 2024-03-30T13:12:28.567 INFO:teuthology.orchestra.run.smithi099.stderr:104050K .......... .......... .......... .......... .......... 61% 13.3M 4s 2024-03-30T13:12:28.571 INFO:teuthology.orchestra.run.smithi099.stderr:104100K .......... .......... .......... .......... .......... 61% 14.1M 4s 2024-03-30T13:12:28.574 INFO:teuthology.orchestra.run.smithi099.stderr:104150K .......... .......... .......... .......... .......... 61% 14.5M 4s 2024-03-30T13:12:28.577 INFO:teuthology.orchestra.run.smithi099.stderr:104200K .......... .......... .......... .......... .......... 61% 14.5M 4s 2024-03-30T13:12:28.582 INFO:teuthology.orchestra.run.smithi099.stderr:104250K .......... .......... .......... .......... .......... 61% 11.9M 4s 2024-03-30T13:12:28.586 INFO:teuthology.orchestra.run.smithi099.stderr:104300K .......... .......... .......... .......... .......... 61% 12.3M 4s 2024-03-30T13:12:28.590 INFO:teuthology.orchestra.run.smithi099.stderr:104350K .......... .......... .......... .......... .......... 61% 12.7M 4s 2024-03-30T13:12:28.592 INFO:teuthology.orchestra.run.smithi099.stderr:104400K .......... .......... .......... .......... .......... 61% 20.0M 4s 2024-03-30T13:12:28.596 INFO:teuthology.orchestra.run.smithi099.stderr:104450K .......... .......... .......... .......... .......... 61% 16.8M 4s 2024-03-30T13:12:28.598 INFO:teuthology.orchestra.run.smithi099.stderr:104500K .......... .......... .......... .......... .......... 62% 13.8M 4s 2024-03-30T13:12:28.601 INFO:teuthology.orchestra.run.smithi099.stderr:104550K .......... .......... .......... .......... .......... 62% 17.1M 4s 2024-03-30T13:12:28.604 INFO:teuthology.orchestra.run.smithi099.stderr:104600K .......... .......... .......... .......... .......... 62% 14.7M 4s 2024-03-30T13:12:28.608 INFO:teuthology.orchestra.run.smithi099.stderr:104650K .......... .......... .......... .......... .......... 62% 14.7M 4s 2024-03-30T13:12:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:104700K .......... .......... .......... .......... .......... 62% 15.0M 4s 2024-03-30T13:12:28.614 INFO:teuthology.orchestra.run.smithi099.stderr:104750K .......... .......... .......... .......... .......... 62% 15.0M 4s 2024-03-30T13:12:28.618 INFO:teuthology.orchestra.run.smithi099.stderr:104800K .......... .......... .......... .......... .......... 62% 15.2M 4s 2024-03-30T13:12:28.623 INFO:teuthology.orchestra.run.smithi099.stderr:104850K .......... .......... .......... .......... .......... 62% 9.77M 4s 2024-03-30T13:12:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:104900K .......... .......... .......... .......... .......... 62% 14.8M 4s 2024-03-30T13:12:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:104950K .......... .......... .......... .......... .......... 62% 13.9M 4s 2024-03-30T13:12:28.633 INFO:teuthology.orchestra.run.smithi099.stderr:105000K .......... .......... .......... .......... .......... 62% 14.8M 4s 2024-03-30T13:12:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:105050K .......... .......... .......... .......... .......... 62% 16.3M 4s 2024-03-30T13:12:28.640 INFO:teuthology.orchestra.run.smithi099.stderr:105100K .......... .......... .......... .......... .......... 62% 12.4M 4s 2024-03-30T13:12:28.642 INFO:teuthology.orchestra.run.smithi099.stderr:105150K .......... .......... .......... .......... .......... 62% 21.1M 4s 2024-03-30T13:12:28.647 INFO:teuthology.orchestra.run.smithi099.stderr:105200K .......... .......... .......... .......... .......... 62% 11.6M 4s 2024-03-30T13:12:28.649 INFO:teuthology.orchestra.run.smithi099.stderr:105250K .......... .......... .......... .......... .......... 62% 15.3M 4s 2024-03-30T13:12:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:105300K .......... .......... .......... .......... .......... 62% 16.3M 4s 2024-03-30T13:12:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:105350K .......... .......... .......... .......... .......... 62% 18.7M 4s 2024-03-30T13:12:28.657 INFO:teuthology.orchestra.run.smithi099.stderr:105400K .......... .......... .......... .......... .......... 62% 19.2M 4s 2024-03-30T13:12:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:105450K .......... .......... .......... .......... .......... 62% 13.3M 4s 2024-03-30T13:12:28.665 INFO:teuthology.orchestra.run.smithi099.stderr:105500K .......... .......... .......... .......... .......... 62% 12.6M 4s 2024-03-30T13:12:28.669 INFO:teuthology.orchestra.run.smithi099.stderr:105550K .......... .......... .......... .......... .......... 62% 11.5M 4s 2024-03-30T13:12:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:105600K .......... .......... .......... .......... .......... 62% 9.59M 4s 2024-03-30T13:12:28.677 INFO:teuthology.orchestra.run.smithi099.stderr:105650K .......... .......... .......... .......... .......... 62% 17.8M 4s 2024-03-30T13:12:28.682 INFO:teuthology.orchestra.run.smithi099.stderr:105700K .......... .......... .......... .......... .......... 62% 13.9M 4s 2024-03-30T13:12:28.684 INFO:teuthology.orchestra.run.smithi099.stderr:105750K .......... .......... .......... .......... .......... 62% 17.8M 4s 2024-03-30T13:12:28.688 INFO:teuthology.orchestra.run.smithi099.stderr:105800K .......... .......... .......... .......... .......... 62% 9.98M 4s 2024-03-30T13:12:28.693 INFO:teuthology.orchestra.run.smithi099.stderr:105850K .......... .......... .......... .......... .......... 62% 14.9M 4s 2024-03-30T13:12:28.695 INFO:teuthology.orchestra.run.smithi099.stderr:105900K .......... .......... .......... .......... .......... 62% 19.9M 4s 2024-03-30T13:12:28.698 INFO:teuthology.orchestra.run.smithi099.stderr:105950K .......... .......... .......... .......... .......... 62% 13.4M 4s 2024-03-30T13:12:28.702 INFO:teuthology.orchestra.run.smithi099.stderr:106000K .......... .......... .......... .......... .......... 62% 11.4M 4s 2024-03-30T13:12:28.706 INFO:teuthology.orchestra.run.smithi099.stderr:106050K .......... .......... .......... .......... .......... 62% 13.2M 4s 2024-03-30T13:12:28.708 INFO:teuthology.orchestra.run.smithi099.stderr:106100K .......... .......... .......... .......... .......... 62% 17.6M 4s 2024-03-30T13:12:28.713 INFO:teuthology.orchestra.run.smithi099.stderr:106150K .......... .......... .......... .......... .......... 63% 15.0M 4s 2024-03-30T13:12:28.716 INFO:teuthology.orchestra.run.smithi099.stderr:106200K .......... .......... .......... .......... .......... 63% 13.4M 4s 2024-03-30T13:12:28.718 INFO:teuthology.orchestra.run.smithi099.stderr:106250K .......... .......... .......... .......... .......... 63% 17.3M 4s 2024-03-30T13:12:28.721 INFO:teuthology.orchestra.run.smithi099.stderr:106300K .......... .......... .......... .......... .......... 63% 16.1M 4s 2024-03-30T13:12:28.724 INFO:teuthology.orchestra.run.smithi099.stderr:106350K .......... .......... .......... .......... .......... 63% 17.2M 4s 2024-03-30T13:12:28.727 INFO:teuthology.orchestra.run.smithi099.stderr:106400K .......... .......... .......... .......... .......... 63% 15.8M 4s 2024-03-30T13:12:28.731 INFO:teuthology.orchestra.run.smithi099.stderr:106450K .......... .......... .......... .......... .......... 63% 13.9M 4s 2024-03-30T13:12:28.734 INFO:teuthology.orchestra.run.smithi099.stderr:106500K .......... .......... .......... .......... .......... 63% 15.4M 4s 2024-03-30T13:12:28.738 INFO:teuthology.orchestra.run.smithi099.stderr:106550K .......... .......... .......... .......... .......... 63% 11.2M 4s 2024-03-30T13:12:28.742 INFO:teuthology.orchestra.run.smithi099.stderr:106600K .......... .......... .......... .......... .......... 63% 12.8M 4s 2024-03-30T13:12:28.747 INFO:teuthology.orchestra.run.smithi099.stderr:106650K .......... .......... .......... .......... .......... 63% 11.5M 4s 2024-03-30T13:12:28.749 INFO:teuthology.orchestra.run.smithi099.stderr:106700K .......... .......... .......... .......... .......... 63% 21.1M 4s 2024-03-30T13:12:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:106750K .......... .......... .......... .......... .......... 63% 8.62M 4s 2024-03-30T13:12:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:106800K .......... .......... .......... .......... .......... 63% 13.2M 4s 2024-03-30T13:12:28.761 INFO:teuthology.orchestra.run.smithi099.stderr:106850K .......... .......... .......... .......... .......... 63% 15.0M 4s 2024-03-30T13:12:28.764 INFO:teuthology.orchestra.run.smithi099.stderr:106900K .......... .......... .......... .......... .......... 63% 16.6M 4s 2024-03-30T13:12:28.768 INFO:teuthology.orchestra.run.smithi099.stderr:106950K .......... .......... .......... .......... .......... 63% 12.5M 4s 2024-03-30T13:12:28.771 INFO:teuthology.orchestra.run.smithi099.stderr:107000K .......... .......... .......... .......... .......... 63% 14.2M 4s 2024-03-30T13:12:28.774 INFO:teuthology.orchestra.run.smithi099.stderr:107050K .......... .......... .......... .......... .......... 63% 18.2M 4s 2024-03-30T13:12:28.777 INFO:teuthology.orchestra.run.smithi099.stderr:107100K .......... .......... .......... .......... .......... 63% 17.4M 4s 2024-03-30T13:12:28.781 INFO:teuthology.orchestra.run.smithi099.stderr:107150K .......... .......... .......... .......... .......... 63% 13.9M 4s 2024-03-30T13:12:28.783 INFO:teuthology.orchestra.run.smithi099.stderr:107200K .......... .......... .......... .......... .......... 63% 19.6M 4s 2024-03-30T13:12:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:107250K .......... .......... .......... .......... .......... 63% 14.9M 4s 2024-03-30T13:12:28.789 INFO:teuthology.orchestra.run.smithi099.stderr:107300K .......... .......... .......... .......... .......... 63% 15.8M 4s 2024-03-30T13:12:28.792 INFO:teuthology.orchestra.run.smithi099.stderr:107350K .......... .......... .......... .......... .......... 63% 16.5M 4s 2024-03-30T13:12:28.797 INFO:teuthology.orchestra.run.smithi099.stderr:107400K .......... .......... .......... .......... .......... 63% 13.1M 4s 2024-03-30T13:12:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:107450K .......... .......... .......... .......... .......... 63% 16.4M 4s 2024-03-30T13:12:28.803 INFO:teuthology.orchestra.run.smithi099.stderr:107500K .......... .......... .......... .......... .......... 63% 13.4M 4s 2024-03-30T13:12:28.806 INFO:teuthology.orchestra.run.smithi099.stderr:107550K .......... .......... .......... .......... .......... 63% 19.0M 4s 2024-03-30T13:12:28.808 INFO:teuthology.orchestra.run.smithi099.stderr:107600K .......... .......... .......... .......... .......... 63% 22.2M 4s 2024-03-30T13:12:28.812 INFO:teuthology.orchestra.run.smithi099.stderr:107650K .......... .......... .......... .......... .......... 63% 15.7M 4s 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi099.stderr:107700K .......... .......... .......... .......... .......... 63% 9.57M 4s 2024-03-30T13:12:28.820 INFO:teuthology.orchestra.run.smithi099.stderr:107750K .......... .......... .......... .......... .......... 63% 11.1M 4s 2024-03-30T13:12:28.823 INFO:teuthology.orchestra.run.smithi099.stderr:107800K .......... .......... .......... .......... .......... 63% 16.0M 4s 2024-03-30T13:12:28.829 INFO:teuthology.orchestra.run.smithi099.stderr:107850K .......... .......... .......... .......... .......... 64% 9.78M 4s 2024-03-30T13:12:28.833 INFO:teuthology.orchestra.run.smithi099.stderr:107900K .......... .......... .......... .......... .......... 64% 9.81M 4s 2024-03-30T13:12:28.838 INFO:teuthology.orchestra.run.smithi099.stderr:107950K .......... .......... .......... .......... .......... 64% 10.2M 4s 2024-03-30T13:12:28.841 INFO:teuthology.orchestra.run.smithi099.stderr:108000K .......... .......... .......... .......... .......... 64% 17.0M 4s 2024-03-30T13:12:28.843 INFO:teuthology.orchestra.run.smithi099.stderr:108050K .......... .......... .......... .......... .......... 64% 17.8M 4s 2024-03-30T13:12:28.847 INFO:teuthology.orchestra.run.smithi099.stderr:108100K .......... .......... .......... .......... .......... 64% 15.6M 4s 2024-03-30T13:12:28.850 INFO:teuthology.orchestra.run.smithi099.stderr:108150K .......... .......... .......... .......... .......... 64% 13.9M 4s 2024-03-30T13:12:28.854 INFO:teuthology.orchestra.run.smithi099.stderr:108200K .......... .......... .......... .......... .......... 64% 14.2M 4s 2024-03-30T13:12:28.856 INFO:teuthology.orchestra.run.smithi099.stderr:108250K .......... .......... .......... .......... .......... 64% 19.2M 4s 2024-03-30T13:12:28.859 INFO:teuthology.orchestra.run.smithi099.stderr:108300K .......... .......... .......... .......... .......... 64% 18.0M 4s 2024-03-30T13:12:28.862 INFO:teuthology.orchestra.run.smithi099.stderr:108350K .......... .......... .......... .......... .......... 64% 16.2M 4s 2024-03-30T13:12:28.864 INFO:teuthology.orchestra.run.smithi099.stderr:108400K .......... .......... .......... .......... .......... 64% 19.3M 4s 2024-03-30T13:12:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:108450K .......... .......... .......... .......... .......... 64% 15.0M 4s 2024-03-30T13:12:28.871 INFO:teuthology.orchestra.run.smithi099.stderr:108500K .......... .......... .......... .......... .......... 64% 14.3M 4s 2024-03-30T13:12:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:108550K .......... .......... .......... .......... .......... 64% 16.0M 4s 2024-03-30T13:12:28.877 INFO:teuthology.orchestra.run.smithi099.stderr:108600K .......... .......... .......... .......... .......... 64% 22.0M 4s 2024-03-30T13:12:28.881 INFO:teuthology.orchestra.run.smithi099.stderr:108650K .......... .......... .......... .......... .......... 64% 11.4M 4s 2024-03-30T13:12:28.884 INFO:teuthology.orchestra.run.smithi099.stderr:108700K .......... .......... .......... .......... .......... 64% 12.5M 4s 2024-03-30T13:12:28.889 INFO:teuthology.orchestra.run.smithi099.stderr:108750K .......... .......... .......... .......... .......... 64% 18.6M 4s 2024-03-30T13:12:28.892 INFO:teuthology.orchestra.run.smithi099.stderr:108800K .......... .......... .......... .......... .......... 64% 9.93M 4s 2024-03-30T13:12:28.895 INFO:teuthology.orchestra.run.smithi099.stderr:108850K .......... .......... .......... .......... .......... 64% 15.2M 4s 2024-03-30T13:12:28.900 INFO:teuthology.orchestra.run.smithi099.stderr:108900K .......... .......... .......... .......... .......... 64% 10.3M 4s 2024-03-30T13:12:28.904 INFO:teuthology.orchestra.run.smithi099.stderr:108950K .......... .......... .......... .......... .......... 64% 11.1M 4s 2024-03-30T13:12:28.909 INFO:teuthology.orchestra.run.smithi099.stderr:109000K .......... .......... .......... .......... .......... 64% 11.3M 4s 2024-03-30T13:12:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:109050K .......... .......... .......... .......... .......... 64% 15.2M 4s 2024-03-30T13:12:28.916 INFO:teuthology.orchestra.run.smithi099.stderr:109100K .......... .......... .......... .......... .......... 64% 11.9M 4s 2024-03-30T13:12:28.920 INFO:teuthology.orchestra.run.smithi099.stderr:109150K .......... .......... .......... .......... .......... 64% 11.5M 4s 2024-03-30T13:12:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:109200K .......... .......... .......... .......... .......... 64% 14.7M 4s 2024-03-30T13:12:28.926 INFO:teuthology.orchestra.run.smithi099.stderr:109250K .......... .......... .......... .......... .......... 64% 17.8M 4s 2024-03-30T13:12:28.930 INFO:teuthology.orchestra.run.smithi099.stderr:109300K .......... .......... .......... .......... .......... 64% 14.6M 4s 2024-03-30T13:12:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:109350K .......... .......... .......... .......... .......... 64% 16.7M 4s 2024-03-30T13:12:28.936 INFO:teuthology.orchestra.run.smithi099.stderr:109400K .......... .......... .......... .......... .......... 64% 16.2M 4s 2024-03-30T13:12:28.939 INFO:teuthology.orchestra.run.smithi099.stderr:109450K .......... .......... .......... .......... .......... 64% 15.5M 4s 2024-03-30T13:12:28.942 INFO:teuthology.orchestra.run.smithi099.stderr:109500K .......... .......... .......... .......... .......... 64% 16.9M 4s 2024-03-30T13:12:28.947 INFO:teuthology.orchestra.run.smithi099.stderr:109550K .......... .......... .......... .......... .......... 65% 14.2M 4s 2024-03-30T13:12:28.949 INFO:teuthology.orchestra.run.smithi099.stderr:109600K .......... .......... .......... .......... .......... 65% 17.6M 4s 2024-03-30T13:12:28.951 INFO:teuthology.orchestra.run.smithi099.stderr:109650K .......... .......... .......... .......... .......... 65% 15.5M 4s 2024-03-30T13:12:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:109700K .......... .......... .......... .......... .......... 65% 14.0M 4s 2024-03-30T13:12:28.958 INFO:teuthology.orchestra.run.smithi099.stderr:109750K .......... .......... .......... .......... .......... 65% 15.7M 4s 2024-03-30T13:12:28.962 INFO:teuthology.orchestra.run.smithi099.stderr:109800K .......... .......... .......... .......... .......... 65% 10.5M 4s 2024-03-30T13:12:28.965 INFO:teuthology.orchestra.run.smithi099.stderr:109850K .......... .......... .......... .......... .......... 65% 16.8M 4s 2024-03-30T13:12:28.968 INFO:teuthology.orchestra.run.smithi099.stderr:109900K .......... .......... .......... .......... .......... 65% 15.4M 4s 2024-03-30T13:12:28.972 INFO:teuthology.orchestra.run.smithi099.stderr:109950K .......... .......... .......... .......... .......... 65% 13.8M 4s 2024-03-30T13:12:28.977 INFO:teuthology.orchestra.run.smithi099.stderr:110000K .......... .......... .......... .......... .......... 65% 12.5M 4s 2024-03-30T13:12:28.980 INFO:teuthology.orchestra.run.smithi099.stderr:110050K .......... .......... .......... .......... .......... 65% 11.0M 4s 2024-03-30T13:12:28.983 INFO:teuthology.orchestra.run.smithi099.stderr:110100K .......... .......... .......... .......... .......... 65% 18.5M 4s 2024-03-30T13:12:28.987 INFO:teuthology.orchestra.run.smithi099.stderr:110150K .......... .......... .......... .......... .......... 65% 12.8M 4s 2024-03-30T13:12:28.990 INFO:teuthology.orchestra.run.smithi099.stderr:110200K .......... .......... .......... .......... .......... 65% 17.6M 4s 2024-03-30T13:12:28.993 INFO:teuthology.orchestra.run.smithi099.stderr:110250K .......... .......... .......... .......... .......... 65% 13.5M 4s 2024-03-30T13:12:28.996 INFO:teuthology.orchestra.run.smithi099.stderr:110300K .......... .......... .......... .......... .......... 65% 17.5M 4s 2024-03-30T13:12:29.001 INFO:teuthology.orchestra.run.smithi099.stderr:110350K .......... .......... .......... .......... .......... 65% 10.6M 4s 2024-03-30T13:12:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:110400K .......... .......... .......... .......... .......... 65% 9.78M 4s 2024-03-30T13:12:29.009 INFO:teuthology.orchestra.run.smithi099.stderr:110450K .......... .......... .......... .......... .......... 65% 15.7M 4s 2024-03-30T13:12:29.012 INFO:teuthology.orchestra.run.smithi099.stderr:110500K .......... .......... .......... .......... .......... 65% 12.9M 4s 2024-03-30T13:12:29.015 INFO:teuthology.orchestra.run.smithi099.stderr:110550K .......... .......... .......... .......... .......... 65% 21.0M 4s 2024-03-30T13:12:29.017 INFO:teuthology.orchestra.run.smithi099.stderr:110600K .......... .......... .......... .......... .......... 65% 18.7M 4s 2024-03-30T13:12:29.022 INFO:teuthology.orchestra.run.smithi099.stderr:110650K .......... .......... .......... .......... .......... 65% 13.4M 4s 2024-03-30T13:12:29.024 INFO:teuthology.orchestra.run.smithi099.stderr:110700K .......... .......... .......... .......... .......... 65% 17.4M 4s 2024-03-30T13:12:29.027 INFO:teuthology.orchestra.run.smithi099.stderr:110750K .......... .......... .......... .......... .......... 65% 13.4M 4s 2024-03-30T13:12:29.031 INFO:teuthology.orchestra.run.smithi099.stderr:110800K .......... .......... .......... .......... .......... 65% 16.7M 4s 2024-03-30T13:12:29.033 INFO:teuthology.orchestra.run.smithi099.stderr:110850K .......... .......... .......... .......... .......... 65% 16.3M 4s 2024-03-30T13:12:29.036 INFO:teuthology.orchestra.run.smithi099.stderr:110900K .......... .......... .......... .......... .......... 65% 15.2M 4s 2024-03-30T13:12:29.039 INFO:teuthology.orchestra.run.smithi099.stderr:110950K .......... .......... .......... .......... .......... 65% 16.8M 4s 2024-03-30T13:12:29.045 INFO:teuthology.orchestra.run.smithi099.stderr:111000K .......... .......... .......... .......... .......... 65% 10.5M 4s 2024-03-30T13:12:29.050 INFO:teuthology.orchestra.run.smithi099.stderr:111050K .......... .......... .......... .......... .......... 65% 10.9M 4s 2024-03-30T13:12:29.052 INFO:teuthology.orchestra.run.smithi099.stderr:111100K .......... .......... .......... .......... .......... 65% 16.6M 4s 2024-03-30T13:12:29.055 INFO:teuthology.orchestra.run.smithi099.stderr:111150K .......... .......... .......... .......... .......... 65% 16.7M 4s 2024-03-30T13:12:29.058 INFO:teuthology.orchestra.run.smithi099.stderr:111200K .......... .......... .......... .......... .......... 65% 13.3M 4s 2024-03-30T13:12:29.062 INFO:teuthology.orchestra.run.smithi099.stderr:111250K .......... .......... .......... .......... .......... 66% 13.1M 4s 2024-03-30T13:12:29.066 INFO:teuthology.orchestra.run.smithi099.stderr:111300K .......... .......... .......... .......... .......... 66% 13.4M 4s 2024-03-30T13:12:29.069 INFO:teuthology.orchestra.run.smithi099.stderr:111350K .......... .......... .......... .......... .......... 66% 13.2M 4s 2024-03-30T13:12:29.073 INFO:teuthology.orchestra.run.smithi099.stderr:111400K .......... .......... .......... .......... .......... 66% 13.2M 4s 2024-03-30T13:12:29.077 INFO:teuthology.orchestra.run.smithi099.stderr:111450K .......... .......... .......... .......... .......... 66% 15.9M 4s 2024-03-30T13:12:29.080 INFO:teuthology.orchestra.run.smithi099.stderr:111500K .......... .......... .......... .......... .......... 66% 12.3M 4s 2024-03-30T13:12:29.084 INFO:teuthology.orchestra.run.smithi099.stderr:111550K .......... .......... .......... .......... .......... 66% 11.9M 4s 2024-03-30T13:12:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:111600K .......... .......... .......... .......... .......... 66% 12.5M 4s 2024-03-30T13:12:29.092 INFO:teuthology.orchestra.run.smithi099.stderr:111650K .......... .......... .......... .......... .......... 66% 13.4M 4s 2024-03-30T13:12:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:111700K .......... .......... .......... .......... .......... 66% 17.0M 4s 2024-03-30T13:12:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:111750K .......... .......... .......... .......... .......... 66% 13.8M 4s 2024-03-30T13:12:29.101 INFO:teuthology.orchestra.run.smithi099.stderr:111800K .......... .......... .......... .......... .......... 66% 14.6M 4s 2024-03-30T13:12:29.104 INFO:teuthology.orchestra.run.smithi099.stderr:111850K .......... .......... .......... .......... .......... 66% 20.6M 4s 2024-03-30T13:12:29.107 INFO:teuthology.orchestra.run.smithi099.stderr:111900K .......... .......... .......... .......... .......... 66% 14.7M 4s 2024-03-30T13:12:29.111 INFO:teuthology.orchestra.run.smithi099.stderr:111950K .......... .......... .......... .......... .......... 66% 11.4M 4s 2024-03-30T13:12:29.115 INFO:teuthology.orchestra.run.smithi099.stderr:112000K .......... .......... .......... .......... .......... 66% 15.2M 4s 2024-03-30T13:12:29.118 INFO:teuthology.orchestra.run.smithi099.stderr:112050K .......... .......... .......... .......... .......... 66% 14.8M 4s 2024-03-30T13:12:29.120 INFO:teuthology.orchestra.run.smithi099.stderr:112100K .......... .......... .......... .......... .......... 66% 25.4M 4s 2024-03-30T13:12:29.124 INFO:teuthology.orchestra.run.smithi099.stderr:112150K .......... .......... .......... .......... .......... 66% 11.5M 4s 2024-03-30T13:12:29.127 INFO:teuthology.orchestra.run.smithi099.stderr:112200K .......... .......... .......... .......... .......... 66% 14.8M 4s 2024-03-30T13:12:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:112250K .......... .......... .......... .......... .......... 66% 13.5M 4s 2024-03-30T13:12:29.134 INFO:teuthology.orchestra.run.smithi099.stderr:112300K .......... .......... .......... .......... .......... 66% 15.4M 4s 2024-03-30T13:12:29.138 INFO:teuthology.orchestra.run.smithi099.stderr:112350K .......... .......... .......... .......... .......... 66% 12.3M 4s 2024-03-30T13:12:29.142 INFO:teuthology.orchestra.run.smithi099.stderr:112400K .......... .......... .......... .......... .......... 66% 12.8M 4s 2024-03-30T13:12:29.151 INFO:teuthology.orchestra.run.smithi099.stderr:112450K .......... .......... .......... .......... .......... 66% 6.11M 4s 2024-03-30T13:12:29.151 INFO:teuthology.orchestra.run.smithi099.stderr:112500K .......... .......... .......... .......... .......... 66% 59.2M 4s 2024-03-30T13:12:29.152 INFO:teuthology.orchestra.run.smithi099.stderr:112550K .......... .......... .......... .......... .......... 66% 33.1M 4s 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:112600K .......... .......... .......... .......... .......... 66% 14.5M 4s 2024-03-30T13:12:29.160 INFO:teuthology.orchestra.run.smithi099.stderr:112650K .......... .......... .......... .......... .......... 66% 12.7M 4s 2024-03-30T13:12:29.163 INFO:teuthology.orchestra.run.smithi099.stderr:112700K .......... .......... .......... .......... .......... 66% 12.3M 4s 2024-03-30T13:12:29.167 INFO:teuthology.orchestra.run.smithi099.stderr:112750K .......... .......... .......... .......... .......... 66% 12.0M 4s 2024-03-30T13:12:29.171 INFO:teuthology.orchestra.run.smithi099.stderr:112800K .......... .......... .......... .......... .......... 66% 13.5M 4s 2024-03-30T13:12:29.175 INFO:teuthology.orchestra.run.smithi099.stderr:112850K .......... .......... .......... .......... .......... 66% 13.1M 4s 2024-03-30T13:12:29.179 INFO:teuthology.orchestra.run.smithi099.stderr:112900K .......... .......... .......... .......... .......... 67% 14.8M 4s 2024-03-30T13:12:29.182 INFO:teuthology.orchestra.run.smithi099.stderr:112950K .......... .......... .......... .......... .......... 67% 12.6M 4s 2024-03-30T13:12:29.186 INFO:teuthology.orchestra.run.smithi099.stderr:113000K .......... .......... .......... .......... .......... 67% 15.3M 4s 2024-03-30T13:12:29.188 INFO:teuthology.orchestra.run.smithi099.stderr:113050K .......... .......... .......... .......... .......... 67% 17.0M 4s 2024-03-30T13:12:29.191 INFO:teuthology.orchestra.run.smithi099.stderr:113100K .......... .......... .......... .......... .......... 67% 20.5M 4s 2024-03-30T13:12:29.194 INFO:teuthology.orchestra.run.smithi099.stderr:113150K .......... .......... .......... .......... .......... 67% 15.7M 4s 2024-03-30T13:12:29.199 INFO:teuthology.orchestra.run.smithi099.stderr:113200K .......... .......... .......... .......... .......... 67% 11.1M 4s 2024-03-30T13:12:29.201 INFO:teuthology.orchestra.run.smithi099.stderr:113250K .......... .......... .......... .......... .......... 67% 18.9M 4s 2024-03-30T13:12:29.203 INFO:teuthology.orchestra.run.smithi099.stderr:113300K .......... .......... .......... .......... .......... 67% 19.7M 4s 2024-03-30T13:12:29.208 INFO:teuthology.orchestra.run.smithi099.stderr:113350K .......... .......... .......... .......... .......... 67% 11.2M 4s 2024-03-30T13:12:29.212 INFO:teuthology.orchestra.run.smithi099.stderr:113400K .......... .......... .......... .......... .......... 67% 11.0M 4s 2024-03-30T13:12:29.217 INFO:teuthology.orchestra.run.smithi099.stderr:113450K .......... .......... .......... .......... .......... 67% 12.1M 4s 2024-03-30T13:12:29.218 INFO:teuthology.orchestra.run.smithi099.stderr:113500K .......... .......... .......... .......... .......... 67% 20.4M 4s 2024-03-30T13:12:29.222 INFO:teuthology.orchestra.run.smithi099.stderr:113550K .......... .......... .......... .......... .......... 67% 11.4M 4s 2024-03-30T13:12:29.226 INFO:teuthology.orchestra.run.smithi099.stderr:113600K .......... .......... .......... .......... .......... 67% 15.6M 4s 2024-03-30T13:12:29.229 INFO:teuthology.orchestra.run.smithi099.stderr:113650K .......... .......... .......... .......... .......... 67% 12.6M 4s 2024-03-30T13:12:29.233 INFO:teuthology.orchestra.run.smithi099.stderr:113700K .......... .......... .......... .......... .......... 67% 15.8M 4s 2024-03-30T13:12:29.236 INFO:teuthology.orchestra.run.smithi099.stderr:113750K .......... .......... .......... .......... .......... 67% 14.4M 4s 2024-03-30T13:12:29.240 INFO:teuthology.orchestra.run.smithi099.stderr:113800K .......... .......... .......... .......... .......... 67% 12.4M 4s 2024-03-30T13:12:29.245 INFO:teuthology.orchestra.run.smithi099.stderr:113850K .......... .......... .......... .......... .......... 67% 10.7M 4s 2024-03-30T13:12:29.248 INFO:teuthology.orchestra.run.smithi099.stderr:113900K .......... .......... .......... .......... .......... 67% 13.9M 4s 2024-03-30T13:12:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:113950K .......... .......... .......... .......... .......... 67% 12.9M 4s 2024-03-30T13:12:29.255 INFO:teuthology.orchestra.run.smithi099.stderr:114000K .......... .......... .......... .......... .......... 67% 14.7M 4s 2024-03-30T13:12:29.258 INFO:teuthology.orchestra.run.smithi099.stderr:114050K .......... .......... .......... .......... .......... 67% 14.8M 4s 2024-03-30T13:12:29.262 INFO:teuthology.orchestra.run.smithi099.stderr:114100K .......... .......... .......... .......... .......... 67% 13.4M 4s 2024-03-30T13:12:29.265 INFO:teuthology.orchestra.run.smithi099.stderr:114150K .......... .......... .......... .......... .......... 67% 15.7M 4s 2024-03-30T13:12:29.268 INFO:teuthology.orchestra.run.smithi099.stderr:114200K .......... .......... .......... .......... .......... 67% 15.7M 4s 2024-03-30T13:12:29.271 INFO:teuthology.orchestra.run.smithi099.stderr:114250K .......... .......... .......... .......... .......... 67% 17.0M 4s 2024-03-30T13:12:29.275 INFO:teuthology.orchestra.run.smithi099.stderr:114300K .......... .......... .......... .......... .......... 67% 12.4M 4s 2024-03-30T13:12:29.279 INFO:teuthology.orchestra.run.smithi099.stderr:114350K .......... .......... .......... .......... .......... 67% 13.5M 4s 2024-03-30T13:12:29.282 INFO:teuthology.orchestra.run.smithi099.stderr:114400K .......... .......... .......... .......... .......... 67% 12.9M 4s 2024-03-30T13:12:29.285 INFO:teuthology.orchestra.run.smithi099.stderr:114450K .......... .......... .......... .......... .......... 67% 23.5M 4s 2024-03-30T13:12:29.288 INFO:teuthology.orchestra.run.smithi099.stderr:114500K .......... .......... .......... .......... .......... 67% 13.6M 4s 2024-03-30T13:12:29.292 INFO:teuthology.orchestra.run.smithi099.stderr:114550K .......... .......... .......... .......... .......... 67% 13.7M 4s 2024-03-30T13:12:29.296 INFO:teuthology.orchestra.run.smithi099.stderr:114600K .......... .......... .......... .......... .......... 68% 13.0M 4s 2024-03-30T13:12:29.299 INFO:teuthology.orchestra.run.smithi099.stderr:114650K .......... .......... .......... .......... .......... 68% 14.7M 4s 2024-03-30T13:12:29.303 INFO:teuthology.orchestra.run.smithi099.stderr:114700K .......... .......... .......... .......... .......... 68% 12.4M 4s 2024-03-30T13:12:29.306 INFO:teuthology.orchestra.run.smithi099.stderr:114750K .......... .......... .......... .......... .......... 68% 14.3M 4s 2024-03-30T13:12:29.309 INFO:teuthology.orchestra.run.smithi099.stderr:114800K .......... .......... .......... .......... .......... 68% 15.9M 4s 2024-03-30T13:12:29.314 INFO:teuthology.orchestra.run.smithi099.stderr:114850K .......... .......... .......... .......... .......... 68% 11.0M 4s 2024-03-30T13:12:29.317 INFO:teuthology.orchestra.run.smithi099.stderr:114900K .......... .......... .......... .......... .......... 68% 13.6M 4s 2024-03-30T13:12:29.321 INFO:teuthology.orchestra.run.smithi099.stderr:114950K .......... .......... .......... .......... .......... 68% 12.8M 4s 2024-03-30T13:12:29.324 INFO:teuthology.orchestra.run.smithi099.stderr:115000K .......... .......... .......... .......... .......... 68% 15.4M 4s 2024-03-30T13:12:29.328 INFO:teuthology.orchestra.run.smithi099.stderr:115050K .......... .......... .......... .......... .......... 68% 14.2M 4s 2024-03-30T13:12:29.333 INFO:teuthology.orchestra.run.smithi099.stderr:115100K .......... .......... .......... .......... .......... 68% 10.4M 4s 2024-03-30T13:12:29.335 INFO:teuthology.orchestra.run.smithi099.stderr:115150K .......... .......... .......... .......... .......... 68% 15.8M 4s 2024-03-30T13:12:29.339 INFO:teuthology.orchestra.run.smithi099.stderr:115200K .......... .......... .......... .......... .......... 68% 14.1M 4s 2024-03-30T13:12:29.342 INFO:teuthology.orchestra.run.smithi099.stderr:115250K .......... .......... .......... .......... .......... 68% 18.7M 4s 2024-03-30T13:12:29.345 INFO:teuthology.orchestra.run.smithi099.stderr:115300K .......... .......... .......... .......... .......... 68% 12.9M 4s 2024-03-30T13:12:29.349 INFO:teuthology.orchestra.run.smithi099.stderr:115350K .......... .......... .......... .......... .......... 68% 13.9M 4s 2024-03-30T13:12:29.352 INFO:teuthology.orchestra.run.smithi099.stderr:115400K .......... .......... .......... .......... .......... 68% 15.1M 4s 2024-03-30T13:12:29.355 INFO:teuthology.orchestra.run.smithi099.stderr:115450K .......... .......... .......... .......... .......... 68% 14.6M 4s 2024-03-30T13:12:29.358 INFO:teuthology.orchestra.run.smithi099.stderr:115500K .......... .......... .......... .......... .......... 68% 19.2M 4s 2024-03-30T13:12:29.362 INFO:teuthology.orchestra.run.smithi099.stderr:115550K .......... .......... .......... .......... .......... 68% 11.6M 4s 2024-03-30T13:12:29.364 INFO:teuthology.orchestra.run.smithi099.stderr:115600K .......... .......... .......... .......... .......... 68% 21.1M 4s 2024-03-30T13:12:29.367 INFO:teuthology.orchestra.run.smithi099.stderr:115650K .......... .......... .......... .......... .......... 68% 16.6M 4s 2024-03-30T13:12:29.372 INFO:teuthology.orchestra.run.smithi099.stderr:115700K .......... .......... .......... .......... .......... 68% 12.0M 4s 2024-03-30T13:12:29.375 INFO:teuthology.orchestra.run.smithi099.stderr:115750K .......... .......... .......... .......... .......... 68% 16.2M 4s 2024-03-30T13:12:29.380 INFO:teuthology.orchestra.run.smithi099.stderr:115800K .......... .......... .......... .......... .......... 68% 10.8M 4s 2024-03-30T13:12:29.382 INFO:teuthology.orchestra.run.smithi099.stderr:115850K .......... .......... .......... .......... .......... 68% 17.1M 4s 2024-03-30T13:12:29.386 INFO:teuthology.orchestra.run.smithi099.stderr:115900K .......... .......... .......... .......... .......... 68% 11.1M 4s 2024-03-30T13:12:29.390 INFO:teuthology.orchestra.run.smithi099.stderr:115950K .......... .......... .......... .......... .......... 68% 12.2M 4s 2024-03-30T13:12:29.393 INFO:teuthology.orchestra.run.smithi099.stderr:116000K .......... .......... .......... .......... .......... 68% 15.5M 4s 2024-03-30T13:12:29.397 INFO:teuthology.orchestra.run.smithi099.stderr:116050K .......... .......... .......... .......... .......... 68% 12.7M 4s 2024-03-30T13:12:29.400 INFO:teuthology.orchestra.run.smithi099.stderr:116100K .......... .......... .......... .......... .......... 68% 17.2M 4s 2024-03-30T13:12:29.404 INFO:teuthology.orchestra.run.smithi099.stderr:116150K .......... .......... .......... .......... .......... 68% 11.3M 4s 2024-03-30T13:12:29.408 INFO:teuthology.orchestra.run.smithi099.stderr:116200K .......... .......... .......... .......... .......... 68% 15.9M 4s 2024-03-30T13:12:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:116250K .......... .......... .......... .......... .......... 68% 13.0M 4s 2024-03-30T13:12:29.416 INFO:teuthology.orchestra.run.smithi099.stderr:116300K .......... .......... .......... .......... .......... 69% 12.6M 4s 2024-03-30T13:12:29.419 INFO:teuthology.orchestra.run.smithi099.stderr:116350K .......... .......... .......... .......... .......... 69% 13.6M 4s 2024-03-30T13:12:29.421 INFO:teuthology.orchestra.run.smithi099.stderr:116400K .......... .......... .......... .......... .......... 69% 19.2M 4s 2024-03-30T13:12:29.425 INFO:teuthology.orchestra.run.smithi099.stderr:116450K .......... .......... .......... .......... .......... 69% 13.4M 4s 2024-03-30T13:12:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:116500K .......... .......... .......... .......... .......... 69% 13.9M 4s 2024-03-30T13:12:29.432 INFO:teuthology.orchestra.run.smithi099.stderr:116550K .......... .......... .......... .......... .......... 69% 12.7M 4s 2024-03-30T13:12:29.435 INFO:teuthology.orchestra.run.smithi099.stderr:116600K .......... .......... .......... .......... .......... 69% 16.9M 4s 2024-03-30T13:12:29.437 INFO:teuthology.orchestra.run.smithi099.stderr:116650K .......... .......... .......... .......... .......... 69% 22.5M 4s 2024-03-30T13:12:29.442 INFO:teuthology.orchestra.run.smithi099.stderr:116700K .......... .......... .......... .......... .......... 69% 11.2M 4s 2024-03-30T13:12:29.445 INFO:teuthology.orchestra.run.smithi099.stderr:116750K .......... .......... .......... .......... .......... 69% 19.1M 4s 2024-03-30T13:12:29.448 INFO:teuthology.orchestra.run.smithi099.stderr:116800K .......... .......... .......... .......... .......... 69% 11.8M 4s 2024-03-30T13:12:29.451 INFO:teuthology.orchestra.run.smithi099.stderr:116850K .......... .......... .......... .......... .......... 69% 18.6M 4s 2024-03-30T13:12:29.454 INFO:teuthology.orchestra.run.smithi099.stderr:116900K .......... .......... .......... .......... .......... 69% 12.9M 4s 2024-03-30T13:12:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:116950K .......... .......... .......... .......... .......... 69% 12.6M 4s 2024-03-30T13:12:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:117000K .......... .......... .......... .......... .......... 69% 11.2M 4s 2024-03-30T13:12:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:117050K .......... .......... .......... .......... .......... 69% 16.8M 4s 2024-03-30T13:12:29.469 INFO:teuthology.orchestra.run.smithi099.stderr:117100K .......... .......... .......... .......... .......... 69% 14.4M 4s 2024-03-30T13:12:29.472 INFO:teuthology.orchestra.run.smithi099.stderr:117150K .......... .......... .......... .......... .......... 69% 15.3M 4s 2024-03-30T13:12:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:117200K .......... .......... .......... .......... .......... 69% 10.3M 4s 2024-03-30T13:12:29.482 INFO:teuthology.orchestra.run.smithi099.stderr:117250K .......... .......... .......... .......... .......... 69% 11.4M 4s 2024-03-30T13:12:29.484 INFO:teuthology.orchestra.run.smithi099.stderr:117300K .......... .......... .......... .......... .......... 69% 21.2M 4s 2024-03-30T13:12:29.487 INFO:teuthology.orchestra.run.smithi099.stderr:117350K .......... .......... .......... .......... .......... 69% 14.3M 4s 2024-03-30T13:12:29.490 INFO:teuthology.orchestra.run.smithi099.stderr:117400K .......... .......... .......... .......... .......... 69% 18.6M 4s 2024-03-30T13:12:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:117450K .......... .......... .......... .......... .......... 69% 11.4M 3s 2024-03-30T13:12:29.500 INFO:teuthology.orchestra.run.smithi099.stderr:117500K .......... .......... .......... .......... .......... 69% 9.17M 3s 2024-03-30T13:12:29.502 INFO:teuthology.orchestra.run.smithi099.stderr:117550K .......... .......... .......... .......... .......... 69% 17.0M 3s 2024-03-30T13:12:29.505 INFO:teuthology.orchestra.run.smithi099.stderr:117600K .......... .......... .......... .......... .......... 69% 17.4M 3s 2024-03-30T13:12:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:117650K .......... .......... .......... .......... .......... 69% 14.8M 3s 2024-03-30T13:12:29.512 INFO:teuthology.orchestra.run.smithi099.stderr:117700K .......... .......... .......... .......... .......... 69% 14.1M 3s 2024-03-30T13:12:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:117750K .......... .......... .......... .......... .......... 69% 13.3M 3s 2024-03-30T13:12:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:117800K .......... .......... .......... .......... .......... 69% 16.3M 3s 2024-03-30T13:12:29.521 INFO:teuthology.orchestra.run.smithi099.stderr:117850K .......... .......... .......... .......... .......... 69% 18.6M 3s 2024-03-30T13:12:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:117900K .......... .......... .......... .......... .......... 69% 16.0M 3s 2024-03-30T13:12:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:117950K .......... .......... .......... .......... .......... 70% 12.6M 3s 2024-03-30T13:12:29.532 INFO:teuthology.orchestra.run.smithi099.stderr:118000K .......... .......... .......... .......... .......... 70% 12.9M 3s 2024-03-30T13:12:29.535 INFO:teuthology.orchestra.run.smithi099.stderr:118050K .......... .......... .......... .......... .......... 70% 14.8M 3s 2024-03-30T13:12:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:118100K .......... .......... .......... .......... .......... 70% 12.1M 3s 2024-03-30T13:12:29.541 INFO:teuthology.orchestra.run.smithi099.stderr:118150K .......... .......... .......... .......... .......... 70% 22.1M 3s 2024-03-30T13:12:29.547 INFO:teuthology.orchestra.run.smithi099.stderr:118200K .......... .......... .......... .......... .......... 70% 10.9M 3s 2024-03-30T13:12:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:118250K .......... .......... .......... .......... .......... 70% 10.6M 3s 2024-03-30T13:12:29.553 INFO:teuthology.orchestra.run.smithi099.stderr:118300K .......... .......... .......... .......... .......... 70% 16.3M 3s 2024-03-30T13:12:29.555 INFO:teuthology.orchestra.run.smithi099.stderr:118350K .......... .......... .......... .......... .......... 70% 20.9M 3s 2024-03-30T13:12:29.561 INFO:teuthology.orchestra.run.smithi099.stderr:118400K .......... .......... .......... .......... .......... 70% 10.4M 3s 2024-03-30T13:12:29.565 INFO:teuthology.orchestra.run.smithi099.stderr:118450K .......... .......... .......... .......... .......... 70% 15.8M 3s 2024-03-30T13:12:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:118500K .......... .......... .......... .......... .......... 70% 10.4M 3s 2024-03-30T13:12:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:118550K .......... .......... .......... .......... .......... 70% 17.9M 3s 2024-03-30T13:12:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:118600K .......... .......... .......... .......... .......... 70% 16.7M 3s 2024-03-30T13:12:29.578 INFO:teuthology.orchestra.run.smithi099.stderr:118650K .......... .......... .......... .......... .......... 70% 17.9M 3s 2024-03-30T13:12:29.582 INFO:teuthology.orchestra.run.smithi099.stderr:118700K .......... .......... .......... .......... .......... 70% 9.00M 3s 2024-03-30T13:12:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:118750K .......... .......... .......... .......... .......... 70% 11.4M 3s 2024-03-30T13:12:29.590 INFO:teuthology.orchestra.run.smithi099.stderr:118800K .......... .......... .......... .......... .......... 70% 15.3M 3s 2024-03-30T13:12:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:118850K .......... .......... .......... .......... .......... 70% 18.1M 3s 2024-03-30T13:12:29.596 INFO:teuthology.orchestra.run.smithi099.stderr:118900K .......... .......... .......... .......... .......... 70% 19.2M 3s 2024-03-30T13:12:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:118950K .......... .......... .......... .......... .......... 70% 11.5M 3s 2024-03-30T13:12:29.602 INFO:teuthology.orchestra.run.smithi099.stderr:119000K .......... .......... .......... .......... .......... 70% 15.4M 3s 2024-03-30T13:12:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:119050K .......... .......... .......... .......... .......... 70% 15.1M 3s 2024-03-30T13:12:29.608 INFO:teuthology.orchestra.run.smithi099.stderr:119100K .......... .......... .......... .......... .......... 70% 17.7M 3s 2024-03-30T13:12:29.612 INFO:teuthology.orchestra.run.smithi099.stderr:119150K .......... .......... .......... .......... .......... 70% 11.2M 3s 2024-03-30T13:12:29.615 INFO:teuthology.orchestra.run.smithi099.stderr:119200K .......... .......... .......... .......... .......... 70% 19.0M 3s 2024-03-30T13:12:29.619 INFO:teuthology.orchestra.run.smithi099.stderr:119250K .......... .......... .......... .......... .......... 70% 13.2M 3s 2024-03-30T13:12:29.623 INFO:teuthology.orchestra.run.smithi099.stderr:119300K .......... .......... .......... .......... .......... 70% 13.0M 3s 2024-03-30T13:12:29.625 INFO:teuthology.orchestra.run.smithi099.stderr:119350K .......... .......... .......... .......... .......... 70% 17.0M 3s 2024-03-30T13:12:29.630 INFO:teuthology.orchestra.run.smithi099.stderr:119400K .......... .......... .......... .......... .......... 70% 10.7M 3s 2024-03-30T13:12:29.633 INFO:teuthology.orchestra.run.smithi099.stderr:119450K .......... .......... .......... .......... .......... 70% 13.8M 3s 2024-03-30T13:12:29.637 INFO:teuthology.orchestra.run.smithi099.stderr:119500K .......... .......... .......... .......... .......... 70% 13.2M 3s 2024-03-30T13:12:29.640 INFO:teuthology.orchestra.run.smithi099.stderr:119550K .......... .......... .......... .......... .......... 70% 16.0M 3s 2024-03-30T13:12:29.644 INFO:teuthology.orchestra.run.smithi099.stderr:119600K .......... .......... .......... .......... .......... 70% 14.3M 3s 2024-03-30T13:12:29.647 INFO:teuthology.orchestra.run.smithi099.stderr:119650K .......... .......... .......... .......... .......... 71% 14.2M 3s 2024-03-30T13:12:29.651 INFO:teuthology.orchestra.run.smithi099.stderr:119700K .......... .......... .......... .......... .......... 71% 11.5M 3s 2024-03-30T13:12:29.655 INFO:teuthology.orchestra.run.smithi099.stderr:119750K .......... .......... .......... .......... .......... 71% 13.6M 3s 2024-03-30T13:12:29.657 INFO:teuthology.orchestra.run.smithi099.stderr:119800K .......... .......... .......... .......... .......... 71% 19.9M 3s 2024-03-30T13:12:29.660 INFO:teuthology.orchestra.run.smithi099.stderr:119850K .......... .......... .......... .......... .......... 71% 17.2M 3s 2024-03-30T13:12:29.665 INFO:teuthology.orchestra.run.smithi099.stderr:119900K .......... .......... .......... .......... .......... 71% 9.66M 3s 2024-03-30T13:12:29.669 INFO:teuthology.orchestra.run.smithi099.stderr:119950K .......... .......... .......... .......... .......... 71% 13.9M 3s 2024-03-30T13:12:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:120000K .......... .......... .......... .......... .......... 71% 18.0M 3s 2024-03-30T13:12:29.675 INFO:teuthology.orchestra.run.smithi099.stderr:120050K .......... .......... .......... .......... .......... 71% 11.7M 3s 2024-03-30T13:12:29.678 INFO:teuthology.orchestra.run.smithi099.stderr:120100K .......... .......... .......... .......... .......... 71% 18.8M 3s 2024-03-30T13:12:29.682 INFO:teuthology.orchestra.run.smithi099.stderr:120150K .......... .......... .......... .......... .......... 71% 12.7M 3s 2024-03-30T13:12:29.684 INFO:teuthology.orchestra.run.smithi099.stderr:120200K .......... .......... .......... .......... .......... 71% 20.6M 3s 2024-03-30T13:12:29.689 INFO:teuthology.orchestra.run.smithi099.stderr:120250K .......... .......... .......... .......... .......... 71% 11.3M 3s 2024-03-30T13:12:29.692 INFO:teuthology.orchestra.run.smithi099.stderr:120300K .......... .......... .......... .......... .......... 71% 20.3M 3s 2024-03-30T13:12:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:120350K .......... .......... .......... .......... .......... 71% 13.7M 3s 2024-03-30T13:12:29.699 INFO:teuthology.orchestra.run.smithi099.stderr:120400K .......... .......... .......... .......... .......... 71% 12.4M 3s 2024-03-30T13:12:29.702 INFO:teuthology.orchestra.run.smithi099.stderr:120450K .......... .......... .......... .......... .......... 71% 13.7M 3s 2024-03-30T13:12:29.706 INFO:teuthology.orchestra.run.smithi099.stderr:120500K .......... .......... .......... .......... .......... 71% 12.6M 3s 2024-03-30T13:12:29.710 INFO:teuthology.orchestra.run.smithi099.stderr:120550K .......... .......... .......... .......... .......... 71% 13.9M 3s 2024-03-30T13:12:29.714 INFO:teuthology.orchestra.run.smithi099.stderr:120600K .......... .......... .......... .......... .......... 71% 20.7M 3s 2024-03-30T13:12:29.717 INFO:teuthology.orchestra.run.smithi099.stderr:120650K .......... .......... .......... .......... .......... 71% 9.78M 3s 2024-03-30T13:12:29.720 INFO:teuthology.orchestra.run.smithi099.stderr:120700K .......... .......... .......... .......... .......... 71% 17.8M 3s 2024-03-30T13:12:29.724 INFO:teuthology.orchestra.run.smithi099.stderr:120750K .......... .......... .......... .......... .......... 71% 11.0M 3s 2024-03-30T13:12:29.727 INFO:teuthology.orchestra.run.smithi099.stderr:120800K .......... .......... .......... .......... .......... 71% 16.4M 3s 2024-03-30T13:12:29.732 INFO:teuthology.orchestra.run.smithi099.stderr:120850K .......... .......... .......... .......... .......... 71% 10.5M 3s 2024-03-30T13:12:29.735 INFO:teuthology.orchestra.run.smithi099.stderr:120900K .......... .......... .......... .......... .......... 71% 16.0M 3s 2024-03-30T13:12:29.737 INFO:teuthology.orchestra.run.smithi099.stderr:120950K .......... .......... .......... .......... .......... 71% 18.0M 3s 2024-03-30T13:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:121000K .......... .......... .......... .......... .......... 71% 13.5M 3s 2024-03-30T13:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:121050K .......... .......... .......... .......... .......... 71% 16.1M 3s 2024-03-30T13:12:29.749 INFO:teuthology.orchestra.run.smithi099.stderr:121100K .......... .......... .......... .......... .......... 71% 9.78M 3s 2024-03-30T13:12:29.752 INFO:teuthology.orchestra.run.smithi099.stderr:121150K .......... .......... .......... .......... .......... 71% 16.4M 3s 2024-03-30T13:12:29.755 INFO:teuthology.orchestra.run.smithi099.stderr:121200K .......... .......... .......... .......... .......... 71% 16.4M 3s 2024-03-30T13:12:29.759 INFO:teuthology.orchestra.run.smithi099.stderr:121250K .......... .......... .......... .......... .......... 71% 11.4M 3s 2024-03-30T13:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:121300K .......... .......... .......... .......... .......... 71% 19.8M 3s 2024-03-30T13:12:29.765 INFO:teuthology.orchestra.run.smithi099.stderr:121350K .......... .......... .......... .......... .......... 72% 13.4M 3s 2024-03-30T13:12:29.769 INFO:teuthology.orchestra.run.smithi099.stderr:121400K .......... .......... .......... .......... .......... 72% 16.3M 3s 2024-03-30T13:12:29.772 INFO:teuthology.orchestra.run.smithi099.stderr:121450K .......... .......... .......... .......... .......... 72% 14.8M 3s 2024-03-30T13:12:29.776 INFO:teuthology.orchestra.run.smithi099.stderr:121500K .......... .......... .......... .......... .......... 72% 13.1M 3s 2024-03-30T13:12:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:121550K .......... .......... .......... .......... .......... 72% 15.5M 3s 2024-03-30T13:12:29.783 INFO:teuthology.orchestra.run.smithi099.stderr:121600K .......... .......... .......... .......... .......... 72% 10.8M 3s 2024-03-30T13:12:29.786 INFO:teuthology.orchestra.run.smithi099.stderr:121650K .......... .......... .......... .......... .......... 72% 15.9M 3s 2024-03-30T13:12:29.789 INFO:teuthology.orchestra.run.smithi099.stderr:121700K .......... .......... .......... .......... .......... 72% 20.3M 3s 2024-03-30T13:12:29.793 INFO:teuthology.orchestra.run.smithi099.stderr:121750K .......... .......... .......... .......... .......... 72% 10.7M 3s 2024-03-30T13:12:29.798 INFO:teuthology.orchestra.run.smithi099.stderr:121800K .......... .......... .......... .......... .......... 72% 16.1M 3s 2024-03-30T13:12:29.800 INFO:teuthology.orchestra.run.smithi099.stderr:121850K .......... .......... .......... .......... .......... 72% 13.0M 3s 2024-03-30T13:12:29.802 INFO:teuthology.orchestra.run.smithi099.stderr:121900K .......... .......... .......... .......... .......... 72% 29.1M 3s 2024-03-30T13:12:29.805 INFO:teuthology.orchestra.run.smithi099.stderr:121950K .......... .......... .......... .......... .......... 72% 20.7M 3s 2024-03-30T13:12:29.807 INFO:teuthology.orchestra.run.smithi099.stderr:122000K .......... .......... .......... .......... .......... 72% 18.7M 3s 2024-03-30T13:12:29.810 INFO:teuthology.orchestra.run.smithi099.stderr:122050K .......... .......... .......... .......... .......... 72% 22.6M 3s 2024-03-30T13:12:29.811 INFO:teuthology.orchestra.run.smithi099.stderr:122100K .......... .......... .......... .......... .......... 72% 19.2M 3s 2024-03-30T13:12:29.813 INFO:teuthology.orchestra.run.smithi099.stderr:122150K .......... .......... .......... .......... .......... 72% 25.3M 3s 2024-03-30T13:12:29.815 INFO:teuthology.orchestra.run.smithi099.stderr:122200K .......... .......... .......... .......... .......... 72% 23.4M 3s 2024-03-30T13:12:29.818 INFO:teuthology.orchestra.run.smithi099.stderr:122250K .......... .......... .......... .......... .......... 72% 17.4M 3s 2024-03-30T13:12:29.832 INFO:teuthology.orchestra.run.smithi099.stderr:122300K .......... .......... .......... .......... .......... 72% 3.68M 3s 2024-03-30T13:12:29.836 INFO:teuthology.orchestra.run.smithi099.stderr:122350K .......... .......... .......... .......... .......... 72% 11.6M 3s 2024-03-30T13:12:29.839 INFO:teuthology.orchestra.run.smithi099.stderr:122400K .......... .......... .......... .......... .......... 72% 15.9M 3s 2024-03-30T13:12:29.842 INFO:teuthology.orchestra.run.smithi099.stderr:122450K .......... .......... .......... .......... .......... 72% 14.9M 3s 2024-03-30T13:12:29.846 INFO:teuthology.orchestra.run.smithi099.stderr:122500K .......... .......... .......... .......... .......... 72% 12.5M 3s 2024-03-30T13:12:29.850 INFO:teuthology.orchestra.run.smithi099.stderr:122550K .......... .......... .......... .......... .......... 72% 12.6M 3s 2024-03-30T13:12:29.853 INFO:teuthology.orchestra.run.smithi099.stderr:122600K .......... .......... .......... .......... .......... 72% 18.4M 3s 2024-03-30T13:12:29.856 INFO:teuthology.orchestra.run.smithi099.stderr:122650K .......... .......... .......... .......... .......... 72% 15.2M 3s 2024-03-30T13:12:29.858 INFO:teuthology.orchestra.run.smithi099.stderr:122700K .......... .......... .......... .......... .......... 72% 18.5M 3s 2024-03-30T13:12:29.863 INFO:teuthology.orchestra.run.smithi099.stderr:122750K .......... .......... .......... .......... .......... 72% 11.6M 3s 2024-03-30T13:12:29.868 INFO:teuthology.orchestra.run.smithi099.stderr:122800K .......... .......... .......... .......... .......... 72% 10.3M 3s 2024-03-30T13:12:29.870 INFO:teuthology.orchestra.run.smithi099.stderr:122850K .......... .......... .......... .......... .......... 72% 21.7M 3s 2024-03-30T13:12:29.872 INFO:teuthology.orchestra.run.smithi099.stderr:122900K .......... .......... .......... .......... .......... 72% 19.8M 3s 2024-03-30T13:12:29.875 INFO:teuthology.orchestra.run.smithi099.stderr:122950K .......... .......... .......... .......... .......... 72% 18.8M 3s 2024-03-30T13:12:29.878 INFO:teuthology.orchestra.run.smithi099.stderr:123000K .......... .......... .......... .......... .......... 72% 14.4M 3s 2024-03-30T13:12:29.881 INFO:teuthology.orchestra.run.smithi099.stderr:123050K .......... .......... .......... .......... .......... 73% 16.7M 3s 2024-03-30T13:12:29.884 INFO:teuthology.orchestra.run.smithi099.stderr:123100K .......... .......... .......... .......... .......... 73% 15.7M 3s 2024-03-30T13:12:29.887 INFO:teuthology.orchestra.run.smithi099.stderr:123150K .......... .......... .......... .......... .......... 73% 17.1M 3s 2024-03-30T13:12:29.889 INFO:teuthology.orchestra.run.smithi099.stderr:123200K .......... .......... .......... .......... .......... 73% 19.6M 3s 2024-03-30T13:12:29.900 INFO:teuthology.orchestra.run.smithi099.stderr:123250K .......... .......... .......... .......... .......... 73% 4.76M 3s 2024-03-30T13:12:29.905 INFO:teuthology.orchestra.run.smithi099.stderr:123300K .......... .......... .......... .......... .......... 73% 10.0M 3s 2024-03-30T13:12:29.907 INFO:teuthology.orchestra.run.smithi099.stderr:123350K .......... .......... .......... .......... .......... 73% 22.3M 3s 2024-03-30T13:12:29.912 INFO:teuthology.orchestra.run.smithi099.stderr:123400K .......... .......... .......... .......... .......... 73% 19.3M 3s 2024-03-30T13:12:29.912 INFO:teuthology.orchestra.run.smithi099.stderr:123450K .......... .......... .......... .......... .......... 73% 18.4M 3s 2024-03-30T13:12:29.916 INFO:teuthology.orchestra.run.smithi099.stderr:123500K .......... .......... .......... .......... .......... 73% 10.7M 3s 2024-03-30T13:12:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:123550K .......... .......... .......... .......... .......... 73% 15.1M 3s 2024-03-30T13:12:29.923 INFO:teuthology.orchestra.run.smithi099.stderr:123600K .......... .......... .......... .......... .......... 73% 16.6M 3s 2024-03-30T13:12:29.926 INFO:teuthology.orchestra.run.smithi099.stderr:123650K .......... .......... .......... .......... .......... 73% 14.8M 3s 2024-03-30T13:12:29.929 INFO:teuthology.orchestra.run.smithi099.stderr:123700K .......... .......... .......... .......... .......... 73% 15.9M 3s 2024-03-30T13:12:29.933 INFO:teuthology.orchestra.run.smithi099.stderr:123750K .......... .......... .......... .......... .......... 73% 16.6M 3s 2024-03-30T13:12:29.936 INFO:teuthology.orchestra.run.smithi099.stderr:123800K .......... .......... .......... .......... .......... 73% 11.5M 3s 2024-03-30T13:12:29.939 INFO:teuthology.orchestra.run.smithi099.stderr:123850K .......... .......... .......... .......... .......... 73% 15.7M 3s 2024-03-30T13:12:29.942 INFO:teuthology.orchestra.run.smithi099.stderr:123900K .......... .......... .......... .......... .......... 73% 18.8M 3s 2024-03-30T13:12:29.950 INFO:teuthology.orchestra.run.smithi099.stderr:123950K .......... .......... .......... .......... .......... 73% 23.4M 3s 2024-03-30T13:12:29.951 INFO:teuthology.orchestra.run.smithi099.stderr:124000K .......... .......... .......... .......... .......... 73% 19.4M 3s 2024-03-30T13:12:29.951 INFO:teuthology.orchestra.run.smithi099.stderr:124050K .......... .......... .......... .......... .......... 73% 19.7M 3s 2024-03-30T13:12:29.952 INFO:teuthology.orchestra.run.smithi099.stderr:124100K .......... .......... .......... .......... .......... 73% 20.7M 3s 2024-03-30T13:12:29.953 INFO:teuthology.orchestra.run.smithi099.stderr:124150K .......... .......... .......... .......... .......... 73% 33.1M 3s 2024-03-30T13:12:29.955 INFO:teuthology.orchestra.run.smithi099.stderr:124200K .......... .......... .......... .......... .......... 73% 20.7M 3s 2024-03-30T13:12:29.961 INFO:teuthology.orchestra.run.smithi099.stderr:124250K .......... .......... .......... .......... .......... 73% 8.21M 3s 2024-03-30T13:12:29.965 INFO:teuthology.orchestra.run.smithi099.stderr:124300K .......... .......... .......... .......... .......... 73% 11.7M 3s 2024-03-30T13:12:29.969 INFO:teuthology.orchestra.run.smithi099.stderr:124350K .......... .......... .......... .......... .......... 73% 12.8M 3s 2024-03-30T13:12:29.973 INFO:teuthology.orchestra.run.smithi099.stderr:124400K .......... .......... .......... .......... .......... 73% 11.9M 3s 2024-03-30T13:12:29.978 INFO:teuthology.orchestra.run.smithi099.stderr:124450K .......... .......... .......... .......... .......... 73% 10.2M 3s 2024-03-30T13:12:29.981 INFO:teuthology.orchestra.run.smithi099.stderr:124500K .......... .......... .......... .......... .......... 73% 15.3M 3s 2024-03-30T13:12:29.984 INFO:teuthology.orchestra.run.smithi099.stderr:124550K .......... .......... .......... .......... .......... 73% 16.2M 3s 2024-03-30T13:12:29.987 INFO:teuthology.orchestra.run.smithi099.stderr:124600K .......... .......... .......... .......... .......... 73% 14.5M 3s 2024-03-30T13:12:29.990 INFO:teuthology.orchestra.run.smithi099.stderr:124650K .......... .......... .......... .......... .......... 73% 17.9M 3s 2024-03-30T13:12:29.995 INFO:teuthology.orchestra.run.smithi099.stderr:124700K .......... .......... .......... .......... .......... 74% 11.4M 3s 2024-03-30T13:12:29.998 INFO:teuthology.orchestra.run.smithi099.stderr:124750K .......... .......... .......... .......... .......... 74% 16.6M 3s 2024-03-30T13:12:30.000 INFO:teuthology.orchestra.run.smithi099.stderr:124800K .......... .......... .......... .......... .......... 74% 17.4M 3s 2024-03-30T13:12:30.007 INFO:teuthology.orchestra.run.smithi099.stderr:124850K .......... .......... .......... .......... .......... 74% 14.4M 3s 2024-03-30T13:12:30.007 INFO:teuthology.orchestra.run.smithi099.stderr:124900K .......... .......... .......... .......... .......... 74% 16.6M 3s 2024-03-30T13:12:30.012 INFO:teuthology.orchestra.run.smithi099.stderr:124950K .......... .......... .......... .......... .......... 74% 15.7M 3s 2024-03-30T13:12:30.013 INFO:teuthology.orchestra.run.smithi099.stderr:125000K .......... .......... .......... .......... .......... 74% 14.7M 3s 2024-03-30T13:12:30.016 INFO:teuthology.orchestra.run.smithi099.stderr:125050K .......... .......... .......... .......... .......... 74% 19.2M 3s 2024-03-30T13:12:30.018 INFO:teuthology.orchestra.run.smithi099.stderr:125100K .......... .......... .......... .......... .......... 74% 21.0M 3s 2024-03-30T13:12:30.021 INFO:teuthology.orchestra.run.smithi099.stderr:125150K .......... .......... .......... .......... .......... 74% 16.4M 3s 2024-03-30T13:12:30.026 INFO:teuthology.orchestra.run.smithi099.stderr:125200K .......... .......... .......... .......... .......... 74% 9.53M 3s 2024-03-30T13:12:30.030 INFO:teuthology.orchestra.run.smithi099.stderr:125250K .......... .......... .......... .......... .......... 74% 13.8M 3s 2024-03-30T13:12:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:125300K .......... .......... .......... .......... .......... 74% 10.5M 3s 2024-03-30T13:12:30.037 INFO:teuthology.orchestra.run.smithi099.stderr:125350K .......... .......... .......... .......... .......... 74% 15.7M 3s 2024-03-30T13:12:30.041 INFO:teuthology.orchestra.run.smithi099.stderr:125400K .......... .......... .......... .......... .......... 74% 11.6M 3s 2024-03-30T13:12:30.048 INFO:teuthology.orchestra.run.smithi099.stderr:125450K .......... .......... .......... .......... .......... 74% 9.93M 3s 2024-03-30T13:12:30.050 INFO:teuthology.orchestra.run.smithi099.stderr:125500K .......... .......... .......... .......... .......... 74% 13.4M 3s 2024-03-30T13:12:30.055 INFO:teuthology.orchestra.run.smithi099.stderr:125550K .......... .......... .......... .......... .......... 74% 12.0M 3s 2024-03-30T13:12:30.058 INFO:teuthology.orchestra.run.smithi099.stderr:125600K .......... .......... .......... .......... .......... 74% 16.5M 3s 2024-03-30T13:12:30.061 INFO:teuthology.orchestra.run.smithi099.stderr:125650K .......... .......... .......... .......... .......... 74% 12.4M 3s 2024-03-30T13:12:30.065 INFO:teuthology.orchestra.run.smithi099.stderr:125700K .......... .......... .......... .......... .......... 74% 13.5M 3s 2024-03-30T13:12:30.068 INFO:teuthology.orchestra.run.smithi099.stderr:125750K .......... .......... .......... .......... .......... 74% 13.6M 3s 2024-03-30T13:12:30.071 INFO:teuthology.orchestra.run.smithi099.stderr:125800K .......... .......... .......... .......... .......... 74% 16.2M 3s 2024-03-30T13:12:30.074 INFO:teuthology.orchestra.run.smithi099.stderr:125850K .......... .......... .......... .......... .......... 74% 19.2M 3s 2024-03-30T13:12:30.077 INFO:teuthology.orchestra.run.smithi099.stderr:125900K .......... .......... .......... .......... .......... 74% 14.8M 3s 2024-03-30T13:12:30.081 INFO:teuthology.orchestra.run.smithi099.stderr:125950K .......... .......... .......... .......... .......... 74% 12.2M 3s 2024-03-30T13:12:30.084 INFO:teuthology.orchestra.run.smithi099.stderr:126000K .......... .......... .......... .......... .......... 74% 19.1M 3s 2024-03-30T13:12:30.089 INFO:teuthology.orchestra.run.smithi099.stderr:126050K .......... .......... .......... .......... .......... 74% 12.4M 3s 2024-03-30T13:12:30.091 INFO:teuthology.orchestra.run.smithi099.stderr:126100K .......... .......... .......... .......... .......... 74% 20.6M 3s 2024-03-30T13:12:30.094 INFO:teuthology.orchestra.run.smithi099.stderr:126150K .......... .......... .......... .......... .......... 74% 13.8M 3s 2024-03-30T13:12:30.097 INFO:teuthology.orchestra.run.smithi099.stderr:126200K .......... .......... .......... .......... .......... 74% 15.8M 3s 2024-03-30T13:12:30.099 INFO:teuthology.orchestra.run.smithi099.stderr:126250K .......... .......... .......... .......... .......... 74% 18.5M 3s 2024-03-30T13:12:30.102 INFO:teuthology.orchestra.run.smithi099.stderr:126300K .......... .......... .......... .......... .......... 74% 15.5M 3s 2024-03-30T13:12:30.106 INFO:teuthology.orchestra.run.smithi099.stderr:126350K .......... .......... .......... .......... .......... 74% 14.0M 3s 2024-03-30T13:12:30.111 INFO:teuthology.orchestra.run.smithi099.stderr:126400K .......... .......... .......... .......... .......... 75% 9.34M 3s 2024-03-30T13:12:30.116 INFO:teuthology.orchestra.run.smithi099.stderr:126450K .......... .......... .......... .......... .......... 75% 10.7M 3s 2024-03-30T13:12:30.118 INFO:teuthology.orchestra.run.smithi099.stderr:126500K .......... .......... .......... .......... .......... 75% 18.1M 3s 2024-03-30T13:12:30.122 INFO:teuthology.orchestra.run.smithi099.stderr:126550K .......... .......... .......... .......... .......... 75% 13.0M 3s 2024-03-30T13:12:30.125 INFO:teuthology.orchestra.run.smithi099.stderr:126600K .......... .......... .......... .......... .......... 75% 14.4M 3s 2024-03-30T13:12:30.131 INFO:teuthology.orchestra.run.smithi099.stderr:126650K .......... .......... .......... .......... .......... 75% 9.03M 3s 2024-03-30T13:12:30.134 INFO:teuthology.orchestra.run.smithi099.stderr:126700K .......... .......... .......... .......... .......... 75% 17.6M 3s 2024-03-30T13:12:30.138 INFO:teuthology.orchestra.run.smithi099.stderr:126750K .......... .......... .......... .......... .......... 75% 12.6M 3s 2024-03-30T13:12:30.141 INFO:teuthology.orchestra.run.smithi099.stderr:126800K .......... .......... .......... .......... .......... 75% 14.3M 3s 2024-03-30T13:12:30.144 INFO:teuthology.orchestra.run.smithi099.stderr:126850K .......... .......... .......... .......... .......... 75% 14.5M 3s 2024-03-30T13:12:30.149 INFO:teuthology.orchestra.run.smithi099.stderr:126900K .......... .......... .......... .......... .......... 75% 10.8M 3s 2024-03-30T13:12:30.153 INFO:teuthology.orchestra.run.smithi099.stderr:126950K .......... .......... .......... .......... .......... 75% 14.0M 3s 2024-03-30T13:12:30.155 INFO:teuthology.orchestra.run.smithi099.stderr:127000K .......... .......... .......... .......... .......... 75% 19.9M 3s 2024-03-30T13:12:30.158 INFO:teuthology.orchestra.run.smithi099.stderr:127050K .......... .......... .......... .......... .......... 75% 19.6M 3s 2024-03-30T13:12:30.161 INFO:teuthology.orchestra.run.smithi099.stderr:127100K .......... .......... .......... .......... .......... 75% 15.9M 3s 2024-03-30T13:12:30.164 INFO:teuthology.orchestra.run.smithi099.stderr:127150K .......... .......... .......... .......... .......... 75% 14.3M 3s 2024-03-30T13:12:30.166 INFO:teuthology.orchestra.run.smithi099.stderr:127200K .......... .......... .......... .......... .......... 75% 18.4M 3s 2024-03-30T13:12:30.170 INFO:teuthology.orchestra.run.smithi099.stderr:127250K .......... .......... .......... .......... .......... 75% 14.4M 3s 2024-03-30T13:12:30.173 INFO:teuthology.orchestra.run.smithi099.stderr:127300K .......... .......... .......... .......... .......... 75% 15.6M 3s 2024-03-30T13:12:30.177 INFO:teuthology.orchestra.run.smithi099.stderr:127350K .......... .......... .......... .......... .......... 75% 17.7M 3s 2024-03-30T13:12:30.183 INFO:teuthology.orchestra.run.smithi099.stderr:127400K .......... .......... .......... .......... .......... 75% 8.37M 3s 2024-03-30T13:12:30.185 INFO:teuthology.orchestra.run.smithi099.stderr:127450K .......... .......... .......... .......... .......... 75% 14.9M 3s 2024-03-30T13:12:30.188 INFO:teuthology.orchestra.run.smithi099.stderr:127500K .......... .......... .......... .......... .......... 75% 17.3M 3s 2024-03-30T13:12:30.192 INFO:teuthology.orchestra.run.smithi099.stderr:127550K .......... .......... .......... .......... .......... 75% 11.4M 3s 2024-03-30T13:12:30.197 INFO:teuthology.orchestra.run.smithi099.stderr:127600K .......... .......... .......... .......... .......... 75% 9.97M 3s 2024-03-30T13:12:30.200 INFO:teuthology.orchestra.run.smithi099.stderr:127650K .......... .......... .......... .......... .......... 75% 15.7M 3s 2024-03-30T13:12:30.204 INFO:teuthology.orchestra.run.smithi099.stderr:127700K .......... .......... .......... .......... .......... 75% 13.8M 3s 2024-03-30T13:12:30.208 INFO:teuthology.orchestra.run.smithi099.stderr:127750K .......... .......... .......... .......... .......... 75% 12.8M 3s 2024-03-30T13:12:30.210 INFO:teuthology.orchestra.run.smithi099.stderr:127800K .......... .......... .......... .......... .......... 75% 15.7M 3s 2024-03-30T13:12:30.215 INFO:teuthology.orchestra.run.smithi099.stderr:127850K .......... .......... .......... .......... .......... 75% 10.3M 3s 2024-03-30T13:12:30.218 INFO:teuthology.orchestra.run.smithi099.stderr:127900K .......... .......... .......... .......... .......... 75% 17.5M 3s 2024-03-30T13:12:30.222 INFO:teuthology.orchestra.run.smithi099.stderr:127950K .......... .......... .......... .......... .......... 75% 12.9M 3s 2024-03-30T13:12:30.225 INFO:teuthology.orchestra.run.smithi099.stderr:128000K .......... .......... .......... .......... .......... 75% 18.7M 3s 2024-03-30T13:12:30.228 INFO:teuthology.orchestra.run.smithi099.stderr:128050K .......... .......... .......... .......... .......... 75% 13.8M 3s 2024-03-30T13:12:30.232 INFO:teuthology.orchestra.run.smithi099.stderr:128100K .......... .......... .......... .......... .......... 76% 11.5M 3s 2024-03-30T13:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:128150K .......... .......... .......... .......... .......... 76% 15.6M 3s 2024-03-30T13:12:30.238 INFO:teuthology.orchestra.run.smithi099.stderr:128200K .......... .......... .......... .......... .......... 76% 17.8M 3s 2024-03-30T13:12:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:128250K .......... .......... .......... .......... .......... 76% 19.5M 3s 2024-03-30T13:12:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:128300K .......... .......... .......... .......... .......... 76% 24.8M 3s 2024-03-30T13:12:30.248 INFO:teuthology.orchestra.run.smithi099.stderr:128350K .......... .......... .......... .......... .......... 76% 9.60M 3s 2024-03-30T13:12:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:128400K .......... .......... .......... .......... .......... 76% 14.3M 3s 2024-03-30T13:12:30.254 INFO:teuthology.orchestra.run.smithi099.stderr:128450K .......... .......... .......... .......... .......... 76% 14.2M 3s 2024-03-30T13:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:128500K .......... .......... .......... .......... .......... 76% 15.4M 3s 2024-03-30T13:12:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:128550K .......... .......... .......... .......... .......... 76% 14.1M 3s 2024-03-30T13:12:30.266 INFO:teuthology.orchestra.run.smithi099.stderr:128600K .......... .......... .......... .......... .......... 76% 10.1M 3s 2024-03-30T13:12:30.269 INFO:teuthology.orchestra.run.smithi099.stderr:128650K .......... .......... .......... .......... .......... 76% 17.7M 3s 2024-03-30T13:12:30.272 INFO:teuthology.orchestra.run.smithi099.stderr:128700K .......... .......... .......... .......... .......... 76% 13.0M 3s 2024-03-30T13:12:30.276 INFO:teuthology.orchestra.run.smithi099.stderr:128750K .......... .......... .......... .......... .......... 76% 14.4M 3s 2024-03-30T13:12:30.281 INFO:teuthology.orchestra.run.smithi099.stderr:128800K .......... .......... .......... .......... .......... 76% 15.7M 3s 2024-03-30T13:12:30.284 INFO:teuthology.orchestra.run.smithi099.stderr:128850K .......... .......... .......... .......... .......... 76% 10.3M 3s 2024-03-30T13:12:30.287 INFO:teuthology.orchestra.run.smithi099.stderr:128900K .......... .......... .......... .......... .......... 76% 13.4M 3s 2024-03-30T13:12:30.291 INFO:teuthology.orchestra.run.smithi099.stderr:128950K .......... .......... .......... .......... .......... 76% 12.8M 3s 2024-03-30T13:12:30.294 INFO:teuthology.orchestra.run.smithi099.stderr:129000K .......... .......... .......... .......... .......... 76% 17.6M 3s 2024-03-30T13:12:30.298 INFO:teuthology.orchestra.run.smithi099.stderr:129050K .......... .......... .......... .......... .......... 76% 15.9M 3s 2024-03-30T13:12:30.301 INFO:teuthology.orchestra.run.smithi099.stderr:129100K .......... .......... .......... .......... .......... 76% 11.0M 3s 2024-03-30T13:12:30.305 INFO:teuthology.orchestra.run.smithi099.stderr:129150K .......... .......... .......... .......... .......... 76% 15.3M 3s 2024-03-30T13:12:30.308 INFO:teuthology.orchestra.run.smithi099.stderr:129200K .......... .......... .......... .......... .......... 76% 14.9M 3s 2024-03-30T13:12:30.311 INFO:teuthology.orchestra.run.smithi099.stderr:129250K .......... .......... .......... .......... .......... 76% 18.8M 3s 2024-03-30T13:12:30.315 INFO:teuthology.orchestra.run.smithi099.stderr:129300K .......... .......... .......... .......... .......... 76% 12.0M 3s 2024-03-30T13:12:30.318 INFO:teuthology.orchestra.run.smithi099.stderr:129350K .......... .......... .......... .......... .......... 76% 14.6M 3s 2024-03-30T13:12:30.322 INFO:teuthology.orchestra.run.smithi099.stderr:129400K .......... .......... .......... .......... .......... 76% 12.2M 3s 2024-03-30T13:12:30.324 INFO:teuthology.orchestra.run.smithi099.stderr:129450K .......... .......... .......... .......... .......... 76% 18.3M 3s 2024-03-30T13:12:30.329 INFO:teuthology.orchestra.run.smithi099.stderr:129500K .......... .......... .......... .......... .......... 76% 15.6M 3s 2024-03-30T13:12:30.333 INFO:teuthology.orchestra.run.smithi099.stderr:129550K .......... .......... .......... .......... .......... 76% 9.74M 3s 2024-03-30T13:12:30.336 INFO:teuthology.orchestra.run.smithi099.stderr:129600K .......... .......... .......... .......... .......... 76% 15.8M 3s 2024-03-30T13:12:30.339 INFO:teuthology.orchestra.run.smithi099.stderr:129650K .......... .......... .......... .......... .......... 76% 15.4M 3s 2024-03-30T13:12:30.342 INFO:teuthology.orchestra.run.smithi099.stderr:129700K .......... .......... .......... .......... .......... 76% 15.2M 3s 2024-03-30T13:12:30.347 INFO:teuthology.orchestra.run.smithi099.stderr:129750K .......... .......... .......... .......... .......... 77% 9.88M 3s 2024-03-30T13:12:30.350 INFO:teuthology.orchestra.run.smithi099.stderr:129800K .......... .......... .......... .......... .......... 77% 16.6M 3s 2024-03-30T13:12:30.353 INFO:teuthology.orchestra.run.smithi099.stderr:129850K .......... .......... .......... .......... .......... 77% 16.9M 3s 2024-03-30T13:12:30.357 INFO:teuthology.orchestra.run.smithi099.stderr:129900K .......... .......... .......... .......... .......... 77% 11.5M 3s 2024-03-30T13:12:30.360 INFO:teuthology.orchestra.run.smithi099.stderr:129950K .......... .......... .......... .......... .......... 77% 15.1M 3s 2024-03-30T13:12:30.365 INFO:teuthology.orchestra.run.smithi099.stderr:130000K .......... .......... .......... .......... .......... 77% 10.9M 3s 2024-03-30T13:12:30.368 INFO:teuthology.orchestra.run.smithi099.stderr:130050K .......... .......... .......... .......... .......... 77% 15.9M 3s 2024-03-30T13:12:30.371 INFO:teuthology.orchestra.run.smithi099.stderr:130100K .......... .......... .......... .......... .......... 77% 17.0M 3s 2024-03-30T13:12:30.374 INFO:teuthology.orchestra.run.smithi099.stderr:130150K .......... .......... .......... .......... .......... 77% 14.5M 3s 2024-03-30T13:12:30.377 INFO:teuthology.orchestra.run.smithi099.stderr:130200K .......... .......... .......... .......... .......... 77% 15.4M 3s 2024-03-30T13:12:30.381 INFO:teuthology.orchestra.run.smithi099.stderr:130250K .......... .......... .......... .......... .......... 77% 13.8M 3s 2024-03-30T13:12:30.384 INFO:teuthology.orchestra.run.smithi099.stderr:130300K .......... .......... .......... .......... .......... 77% 17.4M 3s 2024-03-30T13:12:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:130350K .......... .......... .......... .......... .......... 77% 10.1M 3s 2024-03-30T13:12:30.392 INFO:teuthology.orchestra.run.smithi099.stderr:130400K .......... .......... .......... .......... .......... 77% 15.5M 3s 2024-03-30T13:12:30.394 INFO:teuthology.orchestra.run.smithi099.stderr:130450K .......... .......... .......... .......... .......... 77% 17.5M 3s 2024-03-30T13:12:30.399 INFO:teuthology.orchestra.run.smithi099.stderr:130500K .......... .......... .......... .......... .......... 77% 10.3M 3s 2024-03-30T13:12:30.403 INFO:teuthology.orchestra.run.smithi099.stderr:130550K .......... .......... .......... .......... .......... 77% 12.5M 3s 2024-03-30T13:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:130600K .......... .......... .......... .......... .......... 77% 15.2M 3s 2024-03-30T13:12:30.409 INFO:teuthology.orchestra.run.smithi099.stderr:130650K .......... .......... .......... .......... .......... 77% 17.3M 3s 2024-03-30T13:12:30.413 INFO:teuthology.orchestra.run.smithi099.stderr:130700K .......... .......... .......... .......... .......... 77% 15.1M 3s 2024-03-30T13:12:30.417 INFO:teuthology.orchestra.run.smithi099.stderr:130750K .......... .......... .......... .......... .......... 77% 10.6M 3s 2024-03-30T13:12:30.420 INFO:teuthology.orchestra.run.smithi099.stderr:130800K .......... .......... .......... .......... .......... 77% 14.4M 3s 2024-03-30T13:12:30.423 INFO:teuthology.orchestra.run.smithi099.stderr:130850K .......... .......... .......... .......... .......... 77% 18.1M 3s 2024-03-30T13:12:30.427 INFO:teuthology.orchestra.run.smithi099.stderr:130900K .......... .......... .......... .......... .......... 77% 12.3M 3s 2024-03-30T13:12:30.431 INFO:teuthology.orchestra.run.smithi099.stderr:130950K .......... .......... .......... .......... .......... 77% 13.4M 3s 2024-03-30T13:12:30.435 INFO:teuthology.orchestra.run.smithi099.stderr:131000K .......... .......... .......... .......... .......... 77% 12.7M 3s 2024-03-30T13:12:30.437 INFO:teuthology.orchestra.run.smithi099.stderr:131050K .......... .......... .......... .......... .......... 77% 18.8M 3s 2024-03-30T13:12:30.441 INFO:teuthology.orchestra.run.smithi099.stderr:131100K .......... .......... .......... .......... .......... 77% 11.7M 3s 2024-03-30T13:12:30.444 INFO:teuthology.orchestra.run.smithi099.stderr:131150K .......... .......... .......... .......... .......... 77% 16.0M 3s 2024-03-30T13:12:30.449 INFO:teuthology.orchestra.run.smithi099.stderr:131200K .......... .......... .......... .......... .......... 77% 12.7M 3s 2024-03-30T13:12:30.451 INFO:teuthology.orchestra.run.smithi099.stderr:131250K .......... .......... .......... .......... .......... 77% 20.0M 3s 2024-03-30T13:12:30.455 INFO:teuthology.orchestra.run.smithi099.stderr:131300K .......... .......... .......... .......... .......... 77% 12.6M 3s 2024-03-30T13:12:30.458 INFO:teuthology.orchestra.run.smithi099.stderr:131350K .......... .......... .......... .......... .......... 77% 14.6M 3s 2024-03-30T13:12:30.461 INFO:teuthology.orchestra.run.smithi099.stderr:131400K .......... .......... .......... .......... .......... 77% 13.8M 3s 2024-03-30T13:12:30.465 INFO:teuthology.orchestra.run.smithi099.stderr:131450K .......... .......... .......... .......... .......... 78% 13.7M 3s 2024-03-30T13:12:30.469 INFO:teuthology.orchestra.run.smithi099.stderr:131500K .......... .......... .......... .......... .......... 78% 12.6M 3s 2024-03-30T13:12:30.473 INFO:teuthology.orchestra.run.smithi099.stderr:131550K .......... .......... .......... .......... .......... 78% 11.7M 3s 2024-03-30T13:12:30.477 INFO:teuthology.orchestra.run.smithi099.stderr:131600K .......... .......... .......... .......... .......... 78% 13.7M 3s 2024-03-30T13:12:30.479 INFO:teuthology.orchestra.run.smithi099.stderr:131650K .......... .......... .......... .......... .......... 78% 17.8M 3s 2024-03-30T13:12:30.484 INFO:teuthology.orchestra.run.smithi099.stderr:131700K .......... .......... .......... .......... .......... 78% 10.5M 3s 2024-03-30T13:12:30.488 INFO:teuthology.orchestra.run.smithi099.stderr:131750K .......... .......... .......... .......... .......... 78% 13.9M 3s 2024-03-30T13:12:30.491 INFO:teuthology.orchestra.run.smithi099.stderr:131800K .......... .......... .......... .......... .......... 78% 14.6M 3s 2024-03-30T13:12:30.493 INFO:teuthology.orchestra.run.smithi099.stderr:131850K .......... .......... .......... .......... .......... 78% 17.9M 3s 2024-03-30T13:12:30.497 INFO:teuthology.orchestra.run.smithi099.stderr:131900K .......... .......... .......... .......... .......... 78% 14.3M 3s 2024-03-30T13:12:30.502 INFO:teuthology.orchestra.run.smithi099.stderr:131950K .......... .......... .......... .......... .......... 78% 11.5M 3s 2024-03-30T13:12:30.505 INFO:teuthology.orchestra.run.smithi099.stderr:132000K .......... .......... .......... .......... .......... 78% 14.9M 3s 2024-03-30T13:12:30.507 INFO:teuthology.orchestra.run.smithi099.stderr:132050K .......... .......... .......... .......... .......... 78% 16.5M 3s 2024-03-30T13:12:30.511 INFO:teuthology.orchestra.run.smithi099.stderr:132100K .......... .......... .......... .......... .......... 78% 15.5M 2s 2024-03-30T13:12:30.513 INFO:teuthology.orchestra.run.smithi099.stderr:132150K .......... .......... .......... .......... .......... 78% 21.4M 2s 2024-03-30T13:12:30.517 INFO:teuthology.orchestra.run.smithi099.stderr:132200K .......... .......... .......... .......... .......... 78% 12.2M 2s 2024-03-30T13:12:30.522 INFO:teuthology.orchestra.run.smithi099.stderr:132250K .......... .......... .......... .......... .......... 78% 11.6M 2s 2024-03-30T13:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:132300K .......... .......... .......... .......... .......... 78% 13.5M 2s 2024-03-30T13:12:30.529 INFO:teuthology.orchestra.run.smithi099.stderr:132350K .......... .......... .......... .......... .......... 78% 15.1M 2s 2024-03-30T13:12:30.532 INFO:teuthology.orchestra.run.smithi099.stderr:132400K .......... .......... .......... .......... .......... 78% 16.7M 2s 2024-03-30T13:12:30.534 INFO:teuthology.orchestra.run.smithi099.stderr:132450K .......... .......... .......... .......... .......... 78% 13.8M 2s 2024-03-30T13:12:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:132500K .......... .......... .......... .......... .......... 78% 18.4M 2s 2024-03-30T13:12:30.543 INFO:teuthology.orchestra.run.smithi099.stderr:132550K .......... .......... .......... .......... .......... 78% 9.19M 2s 2024-03-30T13:12:30.545 INFO:teuthology.orchestra.run.smithi099.stderr:132600K .......... .......... .......... .......... .......... 78% 16.3M 2s 2024-03-30T13:12:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:132650K .......... .......... .......... .......... .......... 78% 14.3M 2s 2024-03-30T13:12:30.554 INFO:teuthology.orchestra.run.smithi099.stderr:132700K .......... .......... .......... .......... .......... 78% 9.62M 2s 2024-03-30T13:12:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:132750K .......... .......... .......... .......... .......... 78% 12.4M 2s 2024-03-30T13:12:30.561 INFO:teuthology.orchestra.run.smithi099.stderr:132800K .......... .......... .......... .......... .......... 78% 16.4M 2s 2024-03-30T13:12:30.565 INFO:teuthology.orchestra.run.smithi099.stderr:132850K .......... .......... .......... .......... .......... 78% 12.1M 2s 2024-03-30T13:12:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:132900K .......... .......... .......... .......... .......... 78% 12.0M 2s 2024-03-30T13:12:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:132950K .......... .......... .......... .......... .......... 78% 16.1M 2s 2024-03-30T13:12:30.575 INFO:teuthology.orchestra.run.smithi099.stderr:133000K .......... .......... .......... .......... .......... 78% 15.9M 2s 2024-03-30T13:12:30.577 INFO:teuthology.orchestra.run.smithi099.stderr:133050K .......... .......... .......... .......... .......... 78% 18.5M 2s 2024-03-30T13:12:30.581 INFO:teuthology.orchestra.run.smithi099.stderr:133100K .......... .......... .......... .......... .......... 78% 16.2M 2s 2024-03-30T13:12:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:133150K .......... .......... .......... .......... .......... 79% 11.6M 2s 2024-03-30T13:12:30.588 INFO:teuthology.orchestra.run.smithi099.stderr:133200K .......... .......... .......... .......... .......... 79% 19.5M 2s 2024-03-30T13:12:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:133250K .......... .......... .......... .......... .......... 79% 13.6M 2s 2024-03-30T13:12:30.594 INFO:teuthology.orchestra.run.smithi099.stderr:133300K .......... .......... .......... .......... .......... 79% 16.4M 2s 2024-03-30T13:12:30.598 INFO:teuthology.orchestra.run.smithi099.stderr:133350K .......... .......... .......... .......... .......... 79% 13.9M 2s 2024-03-30T13:12:30.601 INFO:teuthology.orchestra.run.smithi099.stderr:133400K .......... .......... .......... .......... .......... 79% 14.9M 2s 2024-03-30T13:12:30.605 INFO:teuthology.orchestra.run.smithi099.stderr:133450K .......... .......... .......... .......... .......... 79% 12.7M 2s 2024-03-30T13:12:30.609 INFO:teuthology.orchestra.run.smithi099.stderr:133500K .......... .......... .......... .......... .......... 79% 11.0M 2s 2024-03-30T13:12:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:133550K .......... .......... .......... .......... .......... 79% 15.7M 2s 2024-03-30T13:12:30.615 INFO:teuthology.orchestra.run.smithi099.stderr:133600K .......... .......... .......... .......... .......... 79% 14.9M 2s 2024-03-30T13:12:30.619 INFO:teuthology.orchestra.run.smithi099.stderr:133650K .......... .......... .......... .......... .......... 79% 12.7M 2s 2024-03-30T13:12:30.624 INFO:teuthology.orchestra.run.smithi099.stderr:133700K .......... .......... .......... .......... .......... 79% 10.9M 2s 2024-03-30T13:12:30.627 INFO:teuthology.orchestra.run.smithi099.stderr:133750K .......... .......... .......... .......... .......... 79% 13.7M 2s 2024-03-30T13:12:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:133800K .......... .......... .......... .......... .......... 79% 14.1M 2s 2024-03-30T13:12:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:133850K .......... .......... .......... .......... .......... 79% 14.1M 2s 2024-03-30T13:12:30.639 INFO:teuthology.orchestra.run.smithi099.stderr:133900K .......... .......... .......... .......... .......... 79% 10.3M 2s 2024-03-30T13:12:30.643 INFO:teuthology.orchestra.run.smithi099.stderr:133950K .......... .......... .......... .......... .......... 79% 13.5M 2s 2024-03-30T13:12:30.645 INFO:teuthology.orchestra.run.smithi099.stderr:134000K .......... .......... .......... .......... .......... 79% 15.9M 2s 2024-03-30T13:12:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:134050K .......... .......... .......... .......... .......... 79% 16.3M 2s 2024-03-30T13:12:30.652 INFO:teuthology.orchestra.run.smithi099.stderr:134100K .......... .......... .......... .......... .......... 79% 18.0M 2s 2024-03-30T13:12:30.656 INFO:teuthology.orchestra.run.smithi099.stderr:134150K .......... .......... .......... .......... .......... 79% 11.7M 2s 2024-03-30T13:12:30.659 INFO:teuthology.orchestra.run.smithi099.stderr:134200K .......... .......... .......... .......... .......... 79% 13.9M 2s 2024-03-30T13:12:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:134250K .......... .......... .......... .......... .......... 79% 18.5M 2s 2024-03-30T13:12:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:134300K .......... .......... .......... .......... .......... 79% 16.2M 2s 2024-03-30T13:12:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:134350K .......... .......... .......... .......... .......... 79% 12.8M 2s 2024-03-30T13:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:134400K .......... .......... .......... .......... .......... 79% 17.4M 2s 2024-03-30T13:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:134450K .......... .......... .......... .......... .......... 79% 14.3M 2s 2024-03-30T13:12:30.678 INFO:teuthology.orchestra.run.smithi099.stderr:134500K .......... .......... .......... .......... .......... 79% 14.0M 2s 2024-03-30T13:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:134550K .......... .......... .......... .......... .......... 79% 15.4M 2s 2024-03-30T13:12:30.685 INFO:teuthology.orchestra.run.smithi099.stderr:134600K .......... .......... .......... .......... .......... 79% 13.0M 2s 2024-03-30T13:12:30.689 INFO:teuthology.orchestra.run.smithi099.stderr:134650K .......... .......... .......... .......... .......... 79% 14.2M 2s 2024-03-30T13:12:30.693 INFO:teuthology.orchestra.run.smithi099.stderr:134700K .......... .......... .......... .......... .......... 79% 12.5M 2s 2024-03-30T13:12:30.696 INFO:teuthology.orchestra.run.smithi099.stderr:134750K .......... .......... .......... .......... .......... 79% 14.6M 2s 2024-03-30T13:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:134800K .......... .......... .......... .......... .......... 79% 10.9M 2s 2024-03-30T13:12:30.704 INFO:teuthology.orchestra.run.smithi099.stderr:134850K .......... .......... .......... .......... .......... 80% 13.1M 2s 2024-03-30T13:12:30.709 INFO:teuthology.orchestra.run.smithi099.stderr:134900K .......... .......... .......... .......... .......... 80% 10.3M 2s 2024-03-30T13:12:30.712 INFO:teuthology.orchestra.run.smithi099.stderr:134950K .......... .......... .......... .......... .......... 80% 15.6M 2s 2024-03-30T13:12:30.715 INFO:teuthology.orchestra.run.smithi099.stderr:135000K .......... .......... .......... .......... .......... 80% 14.7M 2s 2024-03-30T13:12:30.719 INFO:teuthology.orchestra.run.smithi099.stderr:135050K .......... .......... .......... .......... .......... 80% 13.6M 2s 2024-03-30T13:12:30.723 INFO:teuthology.orchestra.run.smithi099.stderr:135100K .......... .......... .......... .......... .......... 80% 11.0M 2s 2024-03-30T13:12:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:135150K .......... .......... .......... .......... .......... 80% 18.0M 2s 2024-03-30T13:12:30.729 INFO:teuthology.orchestra.run.smithi099.stderr:135200K .......... .......... .......... .......... .......... 80% 14.2M 2s 2024-03-30T13:12:30.732 INFO:teuthology.orchestra.run.smithi099.stderr:135250K .......... .......... .......... .......... .......... 80% 20.5M 2s 2024-03-30T13:12:30.736 INFO:teuthology.orchestra.run.smithi099.stderr:135300K .......... .......... .......... .......... .......... 80% 12.1M 2s 2024-03-30T13:12:30.739 INFO:teuthology.orchestra.run.smithi099.stderr:135350K .......... .......... .......... .......... .......... 80% 15.4M 2s 2024-03-30T13:12:30.743 INFO:teuthology.orchestra.run.smithi099.stderr:135400K .......... .......... .......... .......... .......... 80% 13.4M 2s 2024-03-30T13:12:30.745 INFO:teuthology.orchestra.run.smithi099.stderr:135450K .......... .......... .......... .......... .......... 80% 16.9M 2s 2024-03-30T13:12:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:135500K .......... .......... .......... .......... .......... 80% 15.9M 2s 2024-03-30T13:12:30.752 INFO:teuthology.orchestra.run.smithi099.stderr:135550K .......... .......... .......... .......... .......... 80% 12.6M 2s 2024-03-30T13:12:30.755 INFO:teuthology.orchestra.run.smithi099.stderr:135600K .......... .......... .......... .......... .......... 80% 18.6M 2s 2024-03-30T13:12:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:135650K .......... .......... .......... .......... .......... 80% 12.6M 2s 2024-03-30T13:12:30.763 INFO:teuthology.orchestra.run.smithi099.stderr:135700K .......... .......... .......... .......... .......... 80% 11.7M 2s 2024-03-30T13:12:30.766 INFO:teuthology.orchestra.run.smithi099.stderr:135750K .......... .......... .......... .......... .......... 80% 17.8M 2s 2024-03-30T13:12:30.770 INFO:teuthology.orchestra.run.smithi099.stderr:135800K .......... .......... .......... .......... .......... 80% 12.1M 2s 2024-03-30T13:12:30.774 INFO:teuthology.orchestra.run.smithi099.stderr:135850K .......... .......... .......... .......... .......... 80% 12.0M 2s 2024-03-30T13:12:30.778 INFO:teuthology.orchestra.run.smithi099.stderr:135900K .......... .......... .......... .......... .......... 80% 13.8M 2s 2024-03-30T13:12:30.781 INFO:teuthology.orchestra.run.smithi099.stderr:135950K .......... .......... .......... .......... .......... 80% 14.2M 2s 2024-03-30T13:12:30.785 INFO:teuthology.orchestra.run.smithi099.stderr:136000K .......... .......... .......... .......... .......... 80% 16.6M 2s 2024-03-30T13:12:30.790 INFO:teuthology.orchestra.run.smithi099.stderr:136050K .......... .......... .......... .......... .......... 80% 8.50M 2s 2024-03-30T13:12:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:136100K .......... .......... .......... .......... .......... 80% 15.2M 2s 2024-03-30T13:12:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:136150K .......... .......... .......... .......... .......... 80% 15.1M 2s 2024-03-30T13:12:30.799 INFO:teuthology.orchestra.run.smithi099.stderr:136200K .......... .......... .......... .......... .......... 80% 16.6M 2s 2024-03-30T13:12:30.803 INFO:teuthology.orchestra.run.smithi099.stderr:136250K .......... .......... .......... .......... .......... 80% 16.6M 2s 2024-03-30T13:12:30.806 INFO:teuthology.orchestra.run.smithi099.stderr:136300K .......... .......... .......... .......... .......... 80% 11.9M 2s 2024-03-30T13:12:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:136350K .......... .......... .......... .......... .......... 80% 15.8M 2s 2024-03-30T13:12:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:136400K .......... .......... .......... .......... .......... 80% 14.2M 2s 2024-03-30T13:12:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:136450K .......... .......... .......... .......... .......... 80% 22.2M 2s 2024-03-30T13:12:30.820 INFO:teuthology.orchestra.run.smithi099.stderr:136500K .......... .......... .......... .......... .......... 81% 10.6M 2s 2024-03-30T13:12:30.823 INFO:teuthology.orchestra.run.smithi099.stderr:136550K .......... .......... .......... .......... .......... 81% 13.3M 2s 2024-03-30T13:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:136600K .......... .......... .......... .......... .......... 81% 15.8M 2s 2024-03-30T13:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:136650K .......... .......... .......... .......... .......... 81% 14.4M 2s 2024-03-30T13:12:30.833 INFO:teuthology.orchestra.run.smithi099.stderr:136700K .......... .......... .......... .......... .......... 81% 14.3M 2s 2024-03-30T13:12:30.837 INFO:teuthology.orchestra.run.smithi099.stderr:136750K .......... .......... .......... .......... .......... 81% 13.1M 2s 2024-03-30T13:12:30.841 INFO:teuthology.orchestra.run.smithi099.stderr:136800K .......... .......... .......... .......... .......... 81% 11.9M 2s 2024-03-30T13:12:30.844 INFO:teuthology.orchestra.run.smithi099.stderr:136850K .......... .......... .......... .......... .......... 81% 13.4M 2s 2024-03-30T13:12:30.848 INFO:teuthology.orchestra.run.smithi099.stderr:136900K .......... .......... .......... .......... .......... 81% 16.1M 2s 2024-03-30T13:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:136950K .......... .......... .......... .......... .......... 81% 18.1M 2s 2024-03-30T13:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:137000K .......... .......... .......... .......... .......... 81% 12.6M 2s 2024-03-30T13:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:137050K .......... .......... .......... .......... .......... 81% 9.38M 2s 2024-03-30T13:12:30.862 INFO:teuthology.orchestra.run.smithi099.stderr:137100K .......... .......... .......... .......... .......... 81% 18.2M 2s 2024-03-30T13:12:30.862 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:30.871 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:30.872 INFO:teuthology.orchestra.run.smithi099.stderr:137150K .......... .......... .......... .......... .......... 81% 17.4M 2s 2024-03-30T13:12:30.872 INFO:teuthology.orchestra.run.smithi099.stderr:137200K .......... .......... .......... .......... .......... 81% 13.2M 2s 2024-03-30T13:12:30.873 INFO:teuthology.orchestra.run.smithi099.stderr:137250K .......... .......... .......... .......... .......... 81% 11.0M 2s 2024-03-30T13:12:30.877 INFO:teuthology.orchestra.run.smithi099.stderr:137300K .......... .......... .......... .......... .......... 81% 12.8M 2s 2024-03-30T13:12:30.880 INFO:teuthology.orchestra.run.smithi099.stderr:137350K .......... .......... .......... .......... .......... 81% 15.5M 2s 2024-03-30T13:12:30.882 INFO:teuthology.orchestra.run.smithi099.stderr:137400K .......... .......... .......... .......... .......... 81% 18.8M 2s 2024-03-30T13:12:30.887 INFO:teuthology.orchestra.run.smithi099.stderr:137450K .......... .......... .......... .......... .......... 81% 11.4M 2s 2024-03-30T13:12:30.890 INFO:teuthology.orchestra.run.smithi099.stderr:137500K .......... .......... .......... .......... .......... 81% 15.9M 2s 2024-03-30T13:12:30.893 INFO:teuthology.orchestra.run.smithi099.stderr:137550K .......... .......... .......... .......... .......... 81% 15.4M 2s 2024-03-30T13:12:30.897 INFO:teuthology.orchestra.run.smithi099.stderr:137600K .......... .......... .......... .......... .......... 81% 14.3M 2s 2024-03-30T13:12:30.899 INFO:teuthology.orchestra.run.smithi099.stderr:137650K .......... .......... .......... .......... .......... 81% 17.1M 2s 2024-03-30T13:12:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:137700K .......... .......... .......... .......... .......... 81% 11.9M 2s 2024-03-30T13:12:30.908 INFO:teuthology.orchestra.run.smithi099.stderr:137750K .......... .......... .......... .......... .......... 81% 11.0M 2s 2024-03-30T13:12:30.911 INFO:teuthology.orchestra.run.smithi099.stderr:137800K .......... .......... .......... .......... .......... 81% 14.5M 2s 2024-03-30T13:12:30.914 INFO:teuthology.orchestra.run.smithi099.stderr:137850K .......... .......... .......... .......... .......... 81% 16.6M 2s 2024-03-30T13:12:30.917 INFO:teuthology.orchestra.run.smithi099.stderr:137900K .......... .......... .......... .......... .......... 81% 15.6M 2s 2024-03-30T13:12:30.921 INFO:teuthology.orchestra.run.smithi099.stderr:137950K .......... .......... .......... .......... .......... 81% 19.3M 2s 2024-03-30T13:12:30.924 INFO:teuthology.orchestra.run.smithi099.stderr:138000K .......... .......... .......... .......... .......... 81% 13.0M 2s 2024-03-30T13:12:30.927 INFO:teuthology.orchestra.run.smithi099.stderr:138050K .......... .......... .......... .......... .......... 81% 13.2M 2s 2024-03-30T13:12:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:138100K .......... .......... .......... .......... .......... 81% 18.8M 2s 2024-03-30T13:12:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:138150K .......... .......... .......... .......... .......... 81% 16.2M 2s 2024-03-30T13:12:30.939 INFO:teuthology.orchestra.run.smithi099.stderr:138200K .......... .......... .......... .......... .......... 82% 8.69M 2s 2024-03-30T13:12:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:138250K .......... .......... .......... .......... .......... 82% 11.3M 2s 2024-03-30T13:12:30.947 INFO:teuthology.orchestra.run.smithi099.stderr:138300K .......... .......... .......... .......... .......... 82% 11.7M 2s 2024-03-30T13:12:30.949 INFO:teuthology.orchestra.run.smithi099.stderr:138350K .......... .......... .......... .......... .......... 82% 21.4M 2s 2024-03-30T13:12:30.952 INFO:teuthology.orchestra.run.smithi099.stderr:138400K .......... .......... .......... .......... .......... 82% 15.0M 2s 2024-03-30T13:12:30.958 INFO:teuthology.orchestra.run.smithi099.stderr:138450K .......... .......... .......... .......... .......... 82% 10.2M 2s 2024-03-30T13:12:30.961 INFO:teuthology.orchestra.run.smithi099.stderr:138500K .......... .......... .......... .......... .......... 82% 13.1M 2s 2024-03-30T13:12:30.964 INFO:teuthology.orchestra.run.smithi099.stderr:138550K .......... .......... .......... .......... .......... 82% 16.6M 2s 2024-03-30T13:12:30.967 INFO:teuthology.orchestra.run.smithi099.stderr:138600K .......... .......... .......... .......... .......... 82% 17.2M 2s 2024-03-30T13:12:30.970 INFO:teuthology.orchestra.run.smithi099.stderr:138650K .......... .......... .......... .......... .......... 82% 13.5M 2s 2024-03-30T13:12:30.976 INFO:teuthology.orchestra.run.smithi099.stderr:138700K .......... .......... .......... .......... .......... 82% 9.54M 2s 2024-03-30T13:12:30.979 INFO:teuthology.orchestra.run.smithi099.stderr:138750K .......... .......... .......... .......... .......... 82% 17.1M 2s 2024-03-30T13:12:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:138800K .......... .......... .......... .......... .......... 82% 14.4M 2s 2024-03-30T13:12:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:138850K .......... .......... .......... .......... .......... 82% 19.2M 2s 2024-03-30T13:12:30.989 INFO:teuthology.orchestra.run.smithi099.stderr:138900K .......... .......... .......... .......... .......... 82% 12.2M 2s 2024-03-30T13:12:30.992 INFO:teuthology.orchestra.run.smithi099.stderr:138950K .......... .......... .......... .......... .......... 82% 13.0M 2s 2024-03-30T13:12:30.995 INFO:teuthology.orchestra.run.smithi099.stderr:139000K .......... .......... .......... .......... .......... 82% 15.0M 2s 2024-03-30T13:12:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:139050K .......... .......... .......... .......... .......... 82% 14.6M 2s 2024-03-30T13:12:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:139100K .......... .......... .......... .......... .......... 82% 22.0M 2s 2024-03-30T13:12:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:139150K .......... .......... .......... .......... .......... 82% 15.3M 2s 2024-03-30T13:12:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:139200K .......... .......... .......... .......... .......... 82% 12.6M 2s 2024-03-30T13:12:31.012 INFO:teuthology.orchestra.run.smithi099.stderr:139250K .......... .......... .......... .......... .......... 82% 13.8M 2s 2024-03-30T13:12:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:139300K .......... .......... .......... .......... .......... 82% 15.4M 2s 2024-03-30T13:12:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:139350K .......... .......... .......... .......... .......... 82% 15.2M 2s 2024-03-30T13:12:31.022 INFO:teuthology.orchestra.run.smithi099.stderr:139400K .......... .......... .......... .......... .......... 82% 13.1M 2s 2024-03-30T13:12:31.027 INFO:teuthology.orchestra.run.smithi099.stderr:139450K .......... .......... .......... .......... .......... 82% 9.14M 2s 2024-03-30T13:12:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:139500K .......... .......... .......... .......... .......... 82% 12.5M 2s 2024-03-30T13:12:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:139550K .......... .......... .......... .......... .......... 82% 15.4M 2s 2024-03-30T13:12:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:139600K .......... .......... .......... .......... .......... 82% 20.0M 2s 2024-03-30T13:12:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:139650K .......... .......... .......... .......... .......... 82% 9.34M 2s 2024-03-30T13:12:31.047 INFO:teuthology.orchestra.run.smithi099.stderr:139700K .......... .......... .......... .......... .......... 82% 13.7M 2s 2024-03-30T13:12:31.050 INFO:teuthology.orchestra.run.smithi099.stderr:139750K .......... .......... .......... .......... .......... 82% 11.4M 2s 2024-03-30T13:12:31.053 INFO:teuthology.orchestra.run.smithi099.stderr:139800K .......... .......... .......... .......... .......... 82% 20.4M 2s 2024-03-30T13:12:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:139850K .......... .......... .......... .......... .......... 82% 13.4M 2s 2024-03-30T13:12:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:139900K .......... .......... .......... .......... .......... 83% 11.3M 2s 2024-03-30T13:12:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:139950K .......... .......... .......... .......... .......... 83% 14.5M 2s 2024-03-30T13:12:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:140000K .......... .......... .......... .......... .......... 83% 15.2M 2s 2024-03-30T13:12:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:140050K .......... .......... .......... .......... .......... 83% 20.1M 2s 2024-03-30T13:12:31.074 INFO:teuthology.orchestra.run.smithi099.stderr:140100K .......... .......... .......... .......... .......... 83% 10.2M 2s 2024-03-30T13:12:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:140150K .......... .......... .......... .......... .......... 83% 14.6M 2s 2024-03-30T13:12:31.080 INFO:teuthology.orchestra.run.smithi099.stderr:140200K .......... .......... .......... .......... .......... 83% 17.5M 2s 2024-03-30T13:12:31.084 INFO:teuthology.orchestra.run.smithi099.stderr:140250K .......... .......... .......... .......... .......... 83% 13.8M 2s 2024-03-30T13:12:31.089 INFO:teuthology.orchestra.run.smithi099.stderr:140300K .......... .......... .......... .......... .......... 83% 18.6M 2s 2024-03-30T13:12:31.089 INFO:teuthology.orchestra.run.smithi099.stderr:140350K .......... .......... .......... .......... .......... 83% 16.1M 2s 2024-03-30T13:12:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:140400K .......... .......... .......... .......... .......... 83% 14.6M 2s 2024-03-30T13:12:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:140450K .......... .......... .......... .......... .......... 83% 13.7M 2s 2024-03-30T13:12:31.101 INFO:teuthology.orchestra.run.smithi099.stderr:140500K .......... .......... .......... .......... .......... 83% 11.8M 2s 2024-03-30T13:12:31.103 INFO:teuthology.orchestra.run.smithi099.stderr:140550K .......... .......... .......... .......... .......... 83% 17.4M 2s 2024-03-30T13:12:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:140600K .......... .......... .......... .......... .......... 83% 13.0M 2s 2024-03-30T13:12:31.112 INFO:teuthology.orchestra.run.smithi099.stderr:140650K .......... .......... .......... .......... .......... 83% 10.2M 2s 2024-03-30T13:12:31.116 INFO:teuthology.orchestra.run.smithi099.stderr:140700K .......... .......... .......... .......... .......... 83% 12.3M 2s 2024-03-30T13:12:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:140750K .......... .......... .......... .......... .......... 83% 15.2M 2s 2024-03-30T13:12:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:140800K .......... .......... .......... .......... .......... 83% 15.3M 2s 2024-03-30T13:12:31.127 INFO:teuthology.orchestra.run.smithi099.stderr:140850K .......... .......... .......... .......... .......... 83% 9.54M 2s 2024-03-30T13:12:31.131 INFO:teuthology.orchestra.run.smithi099.stderr:140900K .......... .......... .......... .......... .......... 83% 12.4M 2s 2024-03-30T13:12:31.137 INFO:teuthology.orchestra.run.smithi099.stderr:140950K .......... .......... .......... .......... .......... 83% 17.1M 2s 2024-03-30T13:12:31.138 INFO:teuthology.orchestra.run.smithi099.stderr:141000K .......... .......... .......... .......... .......... 83% 15.4M 2s 2024-03-30T13:12:31.140 INFO:teuthology.orchestra.run.smithi099.stderr:141050K .......... .......... .......... .......... .......... 83% 15.6M 2s 2024-03-30T13:12:31.151 INFO:teuthology.orchestra.run.smithi099.stderr:141100K .......... .......... .......... .......... .......... 83% 5.58M 2s 2024-03-30T13:12:31.151 INFO:teuthology.orchestra.run.smithi099.stderr:141150K .......... .......... .......... .......... .......... 83% 67.2M 2s 2024-03-30T13:12:31.151 INFO:teuthology.orchestra.run.smithi099.stderr:141200K .......... .......... .......... .......... .......... 83% 30.4M 2s 2024-03-30T13:12:31.154 INFO:teuthology.orchestra.run.smithi099.stderr:141250K .......... .......... .......... .......... .......... 83% 16.7M 2s 2024-03-30T13:12:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:141300K .......... .......... .......... .......... .......... 83% 17.8M 2s 2024-03-30T13:12:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:141350K .......... .......... .......... .......... .......... 83% 11.3M 2s 2024-03-30T13:12:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:141400K .......... .......... .......... .......... .......... 83% 14.7M 2s 2024-03-30T13:12:31.167 INFO:teuthology.orchestra.run.smithi099.stderr:141450K .......... .......... .......... .......... .......... 83% 16.7M 2s 2024-03-30T13:12:31.170 INFO:teuthology.orchestra.run.smithi099.stderr:141500K .......... .......... .......... .......... .......... 83% 18.3M 2s 2024-03-30T13:12:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:141550K .......... .......... .......... .......... .......... 84% 13.7M 2s 2024-03-30T13:12:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:141600K .......... .......... .......... .......... .......... 84% 11.4M 2s 2024-03-30T13:12:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:141650K .......... .......... .......... .......... .......... 84% 12.5M 2s 2024-03-30T13:12:31.185 INFO:teuthology.orchestra.run.smithi099.stderr:141700K .......... .......... .......... .......... .......... 84% 15.0M 2s 2024-03-30T13:12:31.188 INFO:teuthology.orchestra.run.smithi099.stderr:141750K .......... .......... .......... .......... .......... 84% 14.9M 2s 2024-03-30T13:12:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:141800K .......... .......... .......... .......... .......... 84% 9.12M 2s 2024-03-30T13:12:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:141850K .......... .......... .......... .......... .......... 84% 12.6M 2s 2024-03-30T13:12:31.201 INFO:teuthology.orchestra.run.smithi099.stderr:141900K .......... .......... .......... .......... .......... 84% 14.5M 2s 2024-03-30T13:12:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:141950K .......... .......... .......... .......... .......... 84% 17.7M 2s 2024-03-30T13:12:31.207 INFO:teuthology.orchestra.run.smithi099.stderr:142000K .......... .......... .......... .......... .......... 84% 16.5M 2s 2024-03-30T13:12:31.211 INFO:teuthology.orchestra.run.smithi099.stderr:142050K .......... .......... .......... .......... .......... 84% 13.3M 2s 2024-03-30T13:12:31.215 INFO:teuthology.orchestra.run.smithi099.stderr:142100K .......... .......... .......... .......... .......... 84% 11.4M 2s 2024-03-30T13:12:31.216 INFO:teuthology.orchestra.run.smithi099.stderr:142150K .......... .......... .......... .......... .......... 84% 27.5M 2s 2024-03-30T13:12:31.220 INFO:teuthology.orchestra.run.smithi099.stderr:142200K .......... .......... .......... .......... .......... 84% 17.7M 2s 2024-03-30T13:12:31.222 INFO:teuthology.orchestra.run.smithi099.stderr:142250K .......... .......... .......... .......... .......... 84% 15.6M 2s 2024-03-30T13:12:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:142300K .......... .......... .......... .......... .......... 84% 10.5M 2s 2024-03-30T13:12:31.230 INFO:teuthology.orchestra.run.smithi099.stderr:142350K .......... .......... .......... .......... .......... 84% 14.5M 2s 2024-03-30T13:12:31.233 INFO:teuthology.orchestra.run.smithi099.stderr:142400K .......... .......... .......... .......... .......... 84% 19.6M 2s 2024-03-30T13:12:31.236 INFO:teuthology.orchestra.run.smithi099.stderr:142450K .......... .......... .......... .......... .......... 84% 14.7M 2s 2024-03-30T13:12:31.240 INFO:teuthology.orchestra.run.smithi099.stderr:142500K .......... .......... .......... .......... .......... 84% 13.3M 2s 2024-03-30T13:12:31.244 INFO:teuthology.orchestra.run.smithi099.stderr:142550K .......... .......... .......... .......... .......... 84% 11.0M 2s 2024-03-30T13:12:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:142600K .......... .......... .......... .......... .......... 84% 17.1M 2s 2024-03-30T13:12:31.251 INFO:teuthology.orchestra.run.smithi099.stderr:142650K .......... .......... .......... .......... .......... 84% 14.9M 2s 2024-03-30T13:12:31.253 INFO:teuthology.orchestra.run.smithi099.stderr:142700K .......... .......... .......... .......... .......... 84% 15.7M 2s 2024-03-30T13:12:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:142750K .......... .......... .......... .......... .......... 84% 15.8M 2s 2024-03-30T13:12:31.261 INFO:teuthology.orchestra.run.smithi099.stderr:142800K .......... .......... .......... .......... .......... 84% 11.2M 2s 2024-03-30T13:12:31.264 INFO:teuthology.orchestra.run.smithi099.stderr:142850K .......... .......... .......... .......... .......... 84% 14.9M 2s 2024-03-30T13:12:31.267 INFO:teuthology.orchestra.run.smithi099.stderr:142900K .......... .......... .......... .......... .......... 84% 16.4M 2s 2024-03-30T13:12:31.270 INFO:teuthology.orchestra.run.smithi099.stderr:142950K .......... .......... .......... .......... .......... 84% 16.6M 2s 2024-03-30T13:12:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:143000K .......... .......... .......... .......... .......... 84% 14.0M 2s 2024-03-30T13:12:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:143050K .......... .......... .......... .......... .......... 84% 10.3M 2s 2024-03-30T13:12:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:143100K .......... .......... .......... .......... .......... 84% 11.3M 2s 2024-03-30T13:12:31.286 INFO:teuthology.orchestra.run.smithi099.stderr:143150K .......... .......... .......... .......... .......... 84% 15.8M 2s 2024-03-30T13:12:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:143200K .......... .......... .......... .......... .......... 84% 13.7M 2s 2024-03-30T13:12:31.294 INFO:teuthology.orchestra.run.smithi099.stderr:143250K .......... .......... .......... .......... .......... 85% 11.0M 2s 2024-03-30T13:12:31.297 INFO:teuthology.orchestra.run.smithi099.stderr:143300K .......... .......... .......... .......... .......... 85% 15.3M 2s 2024-03-30T13:12:31.301 INFO:teuthology.orchestra.run.smithi099.stderr:143350K .......... .......... .......... .......... .......... 85% 15.8M 2s 2024-03-30T13:12:31.302 INFO:teuthology.orchestra.run.smithi099.stderr:143400K .......... .......... .......... .......... .......... 85% 25.7M 2s 2024-03-30T13:12:31.306 INFO:teuthology.orchestra.run.smithi099.stderr:143450K .......... .......... .......... .......... .......... 85% 14.8M 2s 2024-03-30T13:12:31.309 INFO:teuthology.orchestra.run.smithi099.stderr:143500K .......... .......... .......... .......... .......... 85% 13.6M 2s 2024-03-30T13:12:31.312 INFO:teuthology.orchestra.run.smithi099.stderr:143550K .......... .......... .......... .......... .......... 85% 14.5M 2s 2024-03-30T13:12:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:143600K .......... .......... .......... .......... .......... 85% 16.7M 2s 2024-03-30T13:12:31.319 INFO:teuthology.orchestra.run.smithi099.stderr:143650K .......... .......... .......... .......... .......... 85% 13.8M 2s 2024-03-30T13:12:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:143700K .......... .......... .......... .......... .......... 85% 17.1M 2s 2024-03-30T13:12:31.326 INFO:teuthology.orchestra.run.smithi099.stderr:143750K .......... .......... .......... .......... .......... 85% 11.3M 2s 2024-03-30T13:12:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:143800K .......... .......... .......... .......... .......... 85% 19.2M 2s 2024-03-30T13:12:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:143850K .......... .......... .......... .......... .......... 85% 10.9M 2s 2024-03-30T13:12:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:143900K .......... .......... .......... .......... .......... 85% 17.7M 2s 2024-03-30T13:12:31.341 INFO:teuthology.orchestra.run.smithi099.stderr:143950K .......... .......... .......... .......... .......... 85% 9.39M 2s 2024-03-30T13:12:31.344 INFO:teuthology.orchestra.run.smithi099.stderr:144000K .......... .......... .......... .......... .......... 85% 13.9M 2s 2024-03-30T13:12:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:144050K .......... .......... .......... .......... .......... 85% 11.9M 2s 2024-03-30T13:12:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:144100K .......... .......... .......... .......... .......... 85% 17.0M 2s 2024-03-30T13:12:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:144150K .......... .......... .......... .......... .......... 85% 12.2M 2s 2024-03-30T13:12:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:144200K .......... .......... .......... .......... .......... 85% 13.7M 2s 2024-03-30T13:12:31.365 INFO:teuthology.orchestra.run.smithi099.stderr:144250K .......... .......... .......... .......... .......... 85% 8.57M 2s 2024-03-30T13:12:31.368 INFO:teuthology.orchestra.run.smithi099.stderr:144300K .......... .......... .......... .......... .......... 85% 14.4M 2s 2024-03-30T13:12:31.371 INFO:teuthology.orchestra.run.smithi099.stderr:144350K .......... .......... .......... .......... .......... 85% 19.6M 2s 2024-03-30T13:12:31.375 INFO:teuthology.orchestra.run.smithi099.stderr:144400K .......... .......... .......... .......... .......... 85% 12.9M 2s 2024-03-30T13:12:31.379 INFO:teuthology.orchestra.run.smithi099.stderr:144450K .......... .......... .......... .......... .......... 85% 17.4M 2s 2024-03-30T13:12:31.382 INFO:teuthology.orchestra.run.smithi099.stderr:144500K .......... .......... .......... .......... .......... 85% 10.5M 2s 2024-03-30T13:12:31.385 INFO:teuthology.orchestra.run.smithi099.stderr:144550K .......... .......... .......... .......... .......... 85% 15.1M 2s 2024-03-30T13:12:31.387 INFO:teuthology.orchestra.run.smithi099.stderr:144600K .......... .......... .......... .......... .......... 85% 19.7M 2s 2024-03-30T13:12:31.391 INFO:teuthology.orchestra.run.smithi099.stderr:144650K .......... .......... .......... .......... .......... 85% 25.3M 2s 2024-03-30T13:12:31.393 INFO:teuthology.orchestra.run.smithi099.stderr:144700K .......... .......... .......... .......... .......... 85% 17.1M 2s 2024-03-30T13:12:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:144750K .......... .......... .......... .......... .......... 85% 13.5M 2s 2024-03-30T13:12:31.398 INFO:teuthology.orchestra.run.smithi099.stderr:144800K .......... .......... .......... .......... .......... 85% 19.3M 2s 2024-03-30T13:12:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:144850K .......... .......... .......... .......... .......... 85% 14.0M 2s 2024-03-30T13:12:31.406 INFO:teuthology.orchestra.run.smithi099.stderr:144900K .......... .......... .......... .......... .......... 85% 13.1M 2s 2024-03-30T13:12:31.411 INFO:teuthology.orchestra.run.smithi099.stderr:144950K .......... .......... .......... .......... .......... 86% 9.82M 2s 2024-03-30T13:12:31.415 INFO:teuthology.orchestra.run.smithi099.stderr:145000K .......... .......... .......... .......... .......... 86% 12.5M 2s 2024-03-30T13:12:31.418 INFO:teuthology.orchestra.run.smithi099.stderr:145050K .......... .......... .......... .......... .......... 86% 13.7M 2s 2024-03-30T13:12:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:145100K .......... .......... .......... .......... .......... 86% 11.5M 2s 2024-03-30T13:12:31.427 INFO:teuthology.orchestra.run.smithi099.stderr:145150K .......... .......... .......... .......... .......... 86% 14.3M 2s 2024-03-30T13:12:31.430 INFO:teuthology.orchestra.run.smithi099.stderr:145200K .......... .......... .......... .......... .......... 86% 10.4M 2s 2024-03-30T13:12:31.434 INFO:teuthology.orchestra.run.smithi099.stderr:145250K .......... .......... .......... .......... .......... 86% 15.1M 2s 2024-03-30T13:12:31.437 INFO:teuthology.orchestra.run.smithi099.stderr:145300K .......... .......... .......... .......... .......... 86% 16.1M 2s 2024-03-30T13:12:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:145350K .......... .......... .......... .......... .......... 86% 12.4M 2s 2024-03-30T13:12:31.445 INFO:teuthology.orchestra.run.smithi099.stderr:145400K .......... .......... .......... .......... .......... 86% 10.7M 2s 2024-03-30T13:12:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:145450K .......... .......... .......... .......... .......... 86% 12.1M 2s 2024-03-30T13:12:31.452 INFO:teuthology.orchestra.run.smithi099.stderr:145500K .......... .......... .......... .......... .......... 86% 17.5M 2s 2024-03-30T13:12:31.455 INFO:teuthology.orchestra.run.smithi099.stderr:145550K .......... .......... .......... .......... .......... 86% 16.5M 2s 2024-03-30T13:12:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:145600K .......... .......... .......... .......... .......... 86% 14.4M 2s 2024-03-30T13:12:31.462 INFO:teuthology.orchestra.run.smithi099.stderr:145650K .......... .......... .......... .......... .......... 86% 12.8M 2s 2024-03-30T13:12:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:145700K .......... .......... .......... .......... .......... 86% 17.4M 2s 2024-03-30T13:12:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:145750K .......... .......... .......... .......... .......... 86% 15.1M 2s 2024-03-30T13:12:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:145800K .......... .......... .......... .......... .......... 86% 17.1M 2s 2024-03-30T13:12:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:145850K .......... .......... .......... .......... .......... 86% 15.8M 2s 2024-03-30T13:12:31.479 INFO:teuthology.orchestra.run.smithi099.stderr:145900K .......... .......... .......... .......... .......... 86% 11.3M 2s 2024-03-30T13:12:31.480 INFO:teuthology.orchestra.run.smithi099.stderr:145950K .......... .......... .......... .......... .......... 86% 26.7M 2s 2024-03-30T13:12:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:146000K .......... .......... .......... .......... .......... 86% 14.6M 2s 2024-03-30T13:12:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:146050K .......... .......... .......... .......... .......... 86% 9.90M 2s 2024-03-30T13:12:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:146100K .......... .......... .......... .......... .......... 86% 14.4M 2s 2024-03-30T13:12:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:146150K .......... .......... .......... .......... .......... 86% 12.2M 2s 2024-03-30T13:12:31.501 INFO:teuthology.orchestra.run.smithi099.stderr:146200K .......... .......... .......... .......... .......... 86% 11.2M 2s 2024-03-30T13:12:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:146250K .......... .......... .......... .......... .......... 86% 14.1M 2s 2024-03-30T13:12:31.508 INFO:teuthology.orchestra.run.smithi099.stderr:146300K .......... .......... .......... .......... .......... 86% 11.3M 2s 2024-03-30T13:12:31.512 INFO:teuthology.orchestra.run.smithi099.stderr:146350K .......... .......... .......... .......... .......... 86% 12.9M 2s 2024-03-30T13:12:31.516 INFO:teuthology.orchestra.run.smithi099.stderr:146400K .......... .......... .......... .......... .......... 86% 12.7M 2s 2024-03-30T13:12:31.520 INFO:teuthology.orchestra.run.smithi099.stderr:146450K .......... .......... .......... .......... .......... 86% 13.4M 2s 2024-03-30T13:12:31.522 INFO:teuthology.orchestra.run.smithi099.stderr:146500K .......... .......... .......... .......... .......... 86% 18.5M 2s 2024-03-30T13:12:31.525 INFO:teuthology.orchestra.run.smithi099.stderr:146550K .......... .......... .......... .......... .......... 86% 14.5M 2s 2024-03-30T13:12:31.530 INFO:teuthology.orchestra.run.smithi099.stderr:146600K .......... .......... .......... .......... .......... 86% 13.4M 2s 2024-03-30T13:12:31.534 INFO:teuthology.orchestra.run.smithi099.stderr:146650K .......... .......... .......... .......... .......... 87% 10.9M 2s 2024-03-30T13:12:31.537 INFO:teuthology.orchestra.run.smithi099.stderr:146700K .......... .......... .......... .......... .......... 87% 15.9M 2s 2024-03-30T13:12:31.540 INFO:teuthology.orchestra.run.smithi099.stderr:146750K .......... .......... .......... .......... .......... 87% 17.1M 1s 2024-03-30T13:12:31.544 INFO:teuthology.orchestra.run.smithi099.stderr:146800K .......... .......... .......... .......... .......... 87% 12.6M 1s 2024-03-30T13:12:31.548 INFO:teuthology.orchestra.run.smithi099.stderr:146850K .......... .......... .......... .......... .......... 87% 12.3M 1s 2024-03-30T13:12:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:146900K .......... .......... .......... .......... .......... 87% 17.4M 1s 2024-03-30T13:12:31.553 INFO:teuthology.orchestra.run.smithi099.stderr:146950K .......... .......... .......... .......... .......... 87% 20.7M 1s 2024-03-30T13:12:31.556 INFO:teuthology.orchestra.run.smithi099.stderr:147000K .......... .......... .......... .......... .......... 87% 13.5M 1s 2024-03-30T13:12:31.560 INFO:teuthology.orchestra.run.smithi099.stderr:147050K .......... .......... .......... .......... .......... 87% 13.3M 1s 2024-03-30T13:12:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:147100K .......... .......... .......... .......... .......... 87% 12.4M 1s 2024-03-30T13:12:31.567 INFO:teuthology.orchestra.run.smithi099.stderr:147150K .......... .......... .......... .......... .......... 87% 16.3M 1s 2024-03-30T13:12:31.570 INFO:teuthology.orchestra.run.smithi099.stderr:147200K .......... .......... .......... .......... .......... 87% 15.4M 1s 2024-03-30T13:12:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:147250K .......... .......... .......... .......... .......... 87% 10.3M 1s 2024-03-30T13:12:31.577 INFO:teuthology.orchestra.run.smithi099.stderr:147300K .......... .......... .......... .......... .......... 87% 16.7M 1s 2024-03-30T13:12:31.584 INFO:teuthology.orchestra.run.smithi099.stderr:147350K .......... .......... .......... .......... .......... 87% 8.94M 1s 2024-03-30T13:12:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:147400K .......... .......... .......... .......... .......... 87% 18.1M 1s 2024-03-30T13:12:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:147450K .......... .......... .......... .......... .......... 87% 16.6M 1s 2024-03-30T13:12:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:147500K .......... .......... .......... .......... .......... 87% 15.0M 1s 2024-03-30T13:12:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:147550K .......... .......... .......... .......... .......... 87% 14.4M 1s 2024-03-30T13:12:31.599 INFO:teuthology.orchestra.run.smithi099.stderr:147600K .......... .......... .......... .......... .......... 87% 12.3M 1s 2024-03-30T13:12:31.602 INFO:teuthology.orchestra.run.smithi099.stderr:147650K .......... .......... .......... .......... .......... 87% 18.7M 1s 2024-03-30T13:12:31.607 INFO:teuthology.orchestra.run.smithi099.stderr:147700K .......... .......... .......... .......... .......... 87% 9.49M 1s 2024-03-30T13:12:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:147750K .......... .......... .......... .......... .......... 87% 15.7M 1s 2024-03-30T13:12:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:147800K .......... .......... .......... .......... .......... 87% 11.5M 1s 2024-03-30T13:12:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:147850K .......... .......... .......... .......... .......... 87% 12.3M 1s 2024-03-30T13:12:31.622 INFO:teuthology.orchestra.run.smithi099.stderr:147900K .......... .......... .......... .......... .......... 87% 14.2M 1s 2024-03-30T13:12:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:147950K .......... .......... .......... .......... .......... 87% 15.8M 1s 2024-03-30T13:12:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:148000K .......... .......... .......... .......... .......... 87% 17.5M 1s 2024-03-30T13:12:31.632 INFO:teuthology.orchestra.run.smithi099.stderr:148050K .......... .......... .......... .......... .......... 87% 13.5M 1s 2024-03-30T13:12:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:148100K .......... .......... .......... .......... .......... 87% 16.5M 1s 2024-03-30T13:12:31.638 INFO:teuthology.orchestra.run.smithi099.stderr:148150K .......... .......... .......... .......... .......... 87% 12.9M 1s 2024-03-30T13:12:31.642 INFO:teuthology.orchestra.run.smithi099.stderr:148200K .......... .......... .......... .......... .......... 87% 13.2M 1s 2024-03-30T13:12:31.647 INFO:teuthology.orchestra.run.smithi099.stderr:148250K .......... .......... .......... .......... .......... 87% 10.3M 1s 2024-03-30T13:12:31.649 INFO:teuthology.orchestra.run.smithi099.stderr:148300K .......... .......... .......... .......... .......... 88% 23.0M 1s 2024-03-30T13:12:31.653 INFO:teuthology.orchestra.run.smithi099.stderr:148350K .......... .......... .......... .......... .......... 88% 13.0M 1s 2024-03-30T13:12:31.656 INFO:teuthology.orchestra.run.smithi099.stderr:148400K .......... .......... .......... .......... .......... 88% 13.7M 1s 2024-03-30T13:12:31.659 INFO:teuthology.orchestra.run.smithi099.stderr:148450K .......... .......... .......... .......... .......... 88% 14.0M 1s 2024-03-30T13:12:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:148500K .......... .......... .......... .......... .......... 88% 15.1M 1s 2024-03-30T13:12:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:148550K .......... .......... .......... .......... .......... 88% 11.5M 1s 2024-03-30T13:12:31.671 INFO:teuthology.orchestra.run.smithi099.stderr:148600K .......... .......... .......... .......... .......... 88% 14.6M 1s 2024-03-30T13:12:31.674 INFO:teuthology.orchestra.run.smithi099.stderr:148650K .......... .......... .......... .......... .......... 88% 14.3M 1s 2024-03-30T13:12:31.676 INFO:teuthology.orchestra.run.smithi099.stderr:148700K .......... .......... .......... .......... .......... 88% 18.0M 1s 2024-03-30T13:12:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:148750K .......... .......... .......... .......... .......... 88% 15.0M 1s 2024-03-30T13:12:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:148800K .......... .......... .......... .......... .......... 88% 10.2M 1s 2024-03-30T13:12:31.689 INFO:teuthology.orchestra.run.smithi099.stderr:148850K .......... .......... .......... .......... .......... 88% 11.9M 1s 2024-03-30T13:12:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:148900K .......... .......... .......... .......... .......... 88% 12.5M 1s 2024-03-30T13:12:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:148950K .......... .......... .......... .......... .......... 88% 16.5M 1s 2024-03-30T13:12:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:149000K .......... .......... .......... .......... .......... 88% 12.6M 1s 2024-03-30T13:12:31.703 INFO:teuthology.orchestra.run.smithi099.stderr:149050K .......... .......... .......... .......... .......... 88% 16.5M 1s 2024-03-30T13:12:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:149100K .......... .......... .......... .......... .......... 88% 17.1M 1s 2024-03-30T13:12:31.709 INFO:teuthology.orchestra.run.smithi099.stderr:149150K .......... .......... .......... .......... .......... 88% 11.8M 1s 2024-03-30T13:12:31.713 INFO:teuthology.orchestra.run.smithi099.stderr:149200K .......... .......... .......... .......... .......... 88% 13.1M 1s 2024-03-30T13:12:31.717 INFO:teuthology.orchestra.run.smithi099.stderr:149250K .......... .......... .......... .......... .......... 88% 13.9M 1s 2024-03-30T13:12:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:149300K .......... .......... .......... .......... .......... 88% 13.7M 1s 2024-03-30T13:12:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:149350K .......... .......... .......... .......... .......... 88% 17.3M 1s 2024-03-30T13:12:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:149400K .......... .......... .......... .......... .......... 88% 10.9M 1s 2024-03-30T13:12:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:149450K .......... .......... .......... .......... .......... 88% 16.3M 1s 2024-03-30T13:12:31.733 INFO:teuthology.orchestra.run.smithi099.stderr:149500K .......... .......... .......... .......... .......... 88% 16.1M 1s 2024-03-30T13:12:31.738 INFO:teuthology.orchestra.run.smithi099.stderr:149550K .......... .......... .......... .......... .......... 88% 11.0M 1s 2024-03-30T13:12:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:149600K .......... .......... .......... .......... .......... 88% 14.2M 1s 2024-03-30T13:12:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:149650K .......... .......... .......... .......... .......... 88% 14.4M 1s 2024-03-30T13:12:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:149700K .......... .......... .......... .......... .......... 88% 19.2M 1s 2024-03-30T13:12:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:149750K .......... .......... .......... .......... .......... 88% 15.1M 1s 2024-03-30T13:12:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:149800K .......... .......... .......... .......... .......... 88% 15.2M 1s 2024-03-30T13:12:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:149850K .......... .......... .......... .......... .......... 88% 12.5M 1s 2024-03-30T13:12:31.761 INFO:teuthology.orchestra.run.smithi099.stderr:149900K .......... .......... .......... .......... .......... 88% 13.5M 1s 2024-03-30T13:12:31.765 INFO:teuthology.orchestra.run.smithi099.stderr:149950K .......... .......... .......... .......... .......... 88% 11.6M 1s 2024-03-30T13:12:31.769 INFO:teuthology.orchestra.run.smithi099.stderr:150000K .......... .......... .......... .......... .......... 89% 13.6M 1s 2024-03-30T13:12:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:150050K .......... .......... .......... .......... .......... 89% 11.9M 1s 2024-03-30T13:12:31.777 INFO:teuthology.orchestra.run.smithi099.stderr:150100K .......... .......... .......... .......... .......... 89% 10.8M 1s 2024-03-30T13:12:31.781 INFO:teuthology.orchestra.run.smithi099.stderr:150150K .......... .......... .......... .......... .......... 89% 11.7M 1s 2024-03-30T13:12:31.786 INFO:teuthology.orchestra.run.smithi099.stderr:150200K .......... .......... .......... .......... .......... 89% 16.1M 1s 2024-03-30T13:12:31.789 INFO:teuthology.orchestra.run.smithi099.stderr:150250K .......... .......... .......... .......... .......... 89% 12.3M 1s 2024-03-30T13:12:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:150300K .......... .......... .......... .......... .......... 89% 17.1M 1s 2024-03-30T13:12:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:150350K .......... .......... .......... .......... .......... 89% 14.1M 1s 2024-03-30T13:12:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:150400K .......... .......... .......... .......... .......... 89% 11.7M 1s 2024-03-30T13:12:31.802 INFO:teuthology.orchestra.run.smithi099.stderr:150450K .......... .......... .......... .......... .......... 89% 18.6M 1s 2024-03-30T13:12:31.808 INFO:teuthology.orchestra.run.smithi099.stderr:150500K .......... .......... .......... .......... .......... 89% 13.8M 1s 2024-03-30T13:12:31.809 INFO:teuthology.orchestra.run.smithi099.stderr:150550K .......... .......... .......... .......... .......... 89% 14.5M 1s 2024-03-30T13:12:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:150600K .......... .......... .......... .......... .......... 89% 13.6M 1s 2024-03-30T13:12:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:150650K .......... .......... .......... .......... .......... 89% 16.9M 1s 2024-03-30T13:12:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:150700K .......... .......... .......... .......... .......... 89% 12.1M 1s 2024-03-30T13:12:31.822 INFO:teuthology.orchestra.run.smithi099.stderr:150750K .......... .......... .......... .......... .......... 89% 15.1M 1s 2024-03-30T13:12:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:150800K .......... .......... .......... .......... .......... 89% 18.3M 1s 2024-03-30T13:12:31.829 INFO:teuthology.orchestra.run.smithi099.stderr:150850K .......... .......... .......... .......... .......... 89% 12.7M 1s 2024-03-30T13:12:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:150900K .......... .......... .......... .......... .......... 89% 13.2M 1s 2024-03-30T13:12:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:150950K .......... .......... .......... .......... .......... 89% 13.3M 1s 2024-03-30T13:12:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:151000K .......... .......... .......... .......... .......... 89% 13.1M 1s 2024-03-30T13:12:31.843 INFO:teuthology.orchestra.run.smithi099.stderr:151050K .......... .......... .......... .......... .......... 89% 14.8M 1s 2024-03-30T13:12:31.849 INFO:teuthology.orchestra.run.smithi099.stderr:151100K .......... .......... .......... .......... .......... 89% 8.70M 1s 2024-03-30T13:12:31.852 INFO:teuthology.orchestra.run.smithi099.stderr:151150K .......... .......... .......... .......... .......... 89% 14.9M 1s 2024-03-30T13:12:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:151200K .......... .......... .......... .......... .......... 89% 10.6M 1s 2024-03-30T13:12:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:151250K .......... .......... .......... .......... .......... 89% 16.6M 1s 2024-03-30T13:12:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:151300K .......... .......... .......... .......... .......... 89% 10.3M 1s 2024-03-30T13:12:31.868 INFO:teuthology.orchestra.run.smithi099.stderr:151350K .......... .......... .......... .......... .......... 89% 14.6M 1s 2024-03-30T13:12:31.871 INFO:teuthology.orchestra.run.smithi099.stderr:151400K .......... .......... .......... .......... .......... 89% 17.4M 1s 2024-03-30T13:12:31.875 INFO:teuthology.orchestra.run.smithi099.stderr:151450K .......... .......... .......... .......... .......... 89% 12.0M 1s 2024-03-30T13:12:31.878 INFO:teuthology.orchestra.run.smithi099.stderr:151500K .......... .......... .......... .......... .......... 89% 25.5M 1s 2024-03-30T13:12:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:151550K .......... .......... .......... .......... .......... 89% 11.3M 1s 2024-03-30T13:12:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:151600K .......... .......... .......... .......... .......... 89% 14.5M 1s 2024-03-30T13:12:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:151650K .......... .......... .......... .......... .......... 89% 16.8M 1s 2024-03-30T13:12:31.891 INFO:teuthology.orchestra.run.smithi099.stderr:151700K .......... .......... .......... .......... .......... 90% 12.1M 1s 2024-03-30T13:12:31.894 INFO:teuthology.orchestra.run.smithi099.stderr:151750K .......... .......... .......... .......... .......... 90% 18.2M 1s 2024-03-30T13:12:31.898 INFO:teuthology.orchestra.run.smithi099.stderr:151800K .......... .......... .......... .......... .......... 90% 13.9M 1s 2024-03-30T13:12:31.901 INFO:teuthology.orchestra.run.smithi099.stderr:151850K .......... .......... .......... .......... .......... 90% 13.1M 1s 2024-03-30T13:12:31.905 INFO:teuthology.orchestra.run.smithi099.stderr:151900K .......... .......... .......... .......... .......... 90% 14.9M 1s 2024-03-30T13:12:31.908 INFO:teuthology.orchestra.run.smithi099.stderr:151950K .......... .......... .......... .......... .......... 90% 14.1M 1s 2024-03-30T13:12:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:152000K .......... .......... .......... .......... .......... 90% 13.5M 1s 2024-03-30T13:12:31.915 INFO:teuthology.orchestra.run.smithi099.stderr:152050K .......... .......... .......... .......... .......... 90% 13.0M 1s 2024-03-30T13:12:31.919 INFO:teuthology.orchestra.run.smithi099.stderr:152100K .......... .......... .......... .......... .......... 90% 14.3M 1s 2024-03-30T13:12:31.923 INFO:teuthology.orchestra.run.smithi099.stderr:152150K .......... .......... .......... .......... .......... 90% 11.9M 1s 2024-03-30T13:12:31.926 INFO:teuthology.orchestra.run.smithi099.stderr:152200K .......... .......... .......... .......... .......... 90% 16.2M 1s 2024-03-30T13:12:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:152250K .......... .......... .......... .......... .......... 90% 10.5M 1s 2024-03-30T13:12:31.934 INFO:teuthology.orchestra.run.smithi099.stderr:152300K .......... .......... .......... .......... .......... 90% 12.6M 1s 2024-03-30T13:12:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:152350K .......... .......... .......... .......... .......... 90% 14.0M 1s 2024-03-30T13:12:31.942 INFO:teuthology.orchestra.run.smithi099.stderr:152400K .......... .......... .......... .......... .......... 90% 11.2M 1s 2024-03-30T13:12:31.946 INFO:teuthology.orchestra.run.smithi099.stderr:152450K .......... .......... .......... .......... .......... 90% 14.3M 1s 2024-03-30T13:12:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:152500K .......... .......... .......... .......... .......... 90% 15.5M 1s 2024-03-30T13:12:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:152550K .......... .......... .......... .......... .......... 90% 11.0M 1s 2024-03-30T13:12:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:152600K .......... .......... .......... .......... .......... 90% 18.0M 1s 2024-03-30T13:12:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:152650K .......... .......... .......... .......... .......... 90% 16.2M 1s 2024-03-30T13:12:31.961 INFO:teuthology.orchestra.run.smithi099.stderr:152700K .......... .......... .......... .......... .......... 90% 19.6M 1s 2024-03-30T13:12:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:152750K .......... .......... .......... .......... .......... 90% 14.0M 1s 2024-03-30T13:12:31.970 INFO:teuthology.orchestra.run.smithi099.stderr:152800K .......... .......... .......... .......... .......... 90% 11.8M 1s 2024-03-30T13:12:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:152850K .......... .......... .......... .......... .......... 90% 15.0M 1s 2024-03-30T13:12:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:152900K .......... .......... .......... .......... .......... 90% 13.9M 1s 2024-03-30T13:12:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:152950K .......... .......... .......... .......... .......... 90% 15.3M 1s 2024-03-30T13:12:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:153000K .......... .......... .......... .......... .......... 90% 12.7M 1s 2024-03-30T13:12:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:153050K .......... .......... .......... .......... .......... 90% 13.7M 1s 2024-03-30T13:12:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:153100K .......... .......... .......... .......... .......... 90% 13.6M 1s 2024-03-30T13:12:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:153150K .......... .......... .......... .......... .......... 90% 12.7M 1s 2024-03-30T13:12:31.999 INFO:teuthology.orchestra.run.smithi099.stderr:153200K .......... .......... .......... .......... .......... 90% 12.2M 1s 2024-03-30T13:12:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:153250K .......... .......... .......... .......... .......... 90% 15.3M 1s 2024-03-30T13:12:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:153300K .......... .......... .......... .......... .......... 90% 12.4M 1s 2024-03-30T13:12:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:153350K .......... .......... .......... .......... .......... 91% 13.0M 1s 2024-03-30T13:12:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:153400K .......... .......... .......... .......... .......... 91% 12.1M 1s 2024-03-30T13:12:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:153450K .......... .......... .......... .......... .......... 91% 14.3M 1s 2024-03-30T13:12:32.020 INFO:teuthology.orchestra.run.smithi099.stderr:153500K .......... .......... .......... .......... .......... 91% 11.2M 1s 2024-03-30T13:12:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:153550K .......... .......... .......... .......... .......... 91% 13.3M 1s 2024-03-30T13:12:32.029 INFO:teuthology.orchestra.run.smithi099.stderr:153600K .......... .......... .......... .......... .......... 91% 17.1M 1s 2024-03-30T13:12:32.031 INFO:teuthology.orchestra.run.smithi099.stderr:153650K .......... .......... .......... .......... .......... 91% 12.9M 1s 2024-03-30T13:12:32.034 INFO:teuthology.orchestra.run.smithi099.stderr:153700K .......... .......... .......... .......... .......... 91% 13.6M 1s 2024-03-30T13:12:32.038 INFO:teuthology.orchestra.run.smithi099.stderr:153750K .......... .......... .......... .......... .......... 91% 14.9M 1s 2024-03-30T13:12:32.041 INFO:teuthology.orchestra.run.smithi099.stderr:153800K .......... .......... .......... .......... .......... 91% 13.6M 1s 2024-03-30T13:12:32.045 INFO:teuthology.orchestra.run.smithi099.stderr:153850K .......... .......... .......... .......... .......... 91% 14.8M 1s 2024-03-30T13:12:32.048 INFO:teuthology.orchestra.run.smithi099.stderr:153900K .......... .......... .......... .......... .......... 91% 15.4M 1s 2024-03-30T13:12:32.052 INFO:teuthology.orchestra.run.smithi099.stderr:153950K .......... .......... .......... .......... .......... 91% 11.2M 1s 2024-03-30T13:12:32.054 INFO:teuthology.orchestra.run.smithi099.stderr:154000K .......... .......... .......... .......... .......... 91% 24.1M 1s 2024-03-30T13:12:32.059 INFO:teuthology.orchestra.run.smithi099.stderr:154050K .......... .......... .......... .......... .......... 91% 11.1M 1s 2024-03-30T13:12:32.062 INFO:teuthology.orchestra.run.smithi099.stderr:154100K .......... .......... .......... .......... .......... 91% 16.8M 1s 2024-03-30T13:12:32.065 INFO:teuthology.orchestra.run.smithi099.stderr:154150K .......... .......... .......... .......... .......... 91% 15.7M 1s 2024-03-30T13:12:32.069 INFO:teuthology.orchestra.run.smithi099.stderr:154200K .......... .......... .......... .......... .......... 91% 10.9M 1s 2024-03-30T13:12:32.073 INFO:teuthology.orchestra.run.smithi099.stderr:154250K .......... .......... .......... .......... .......... 91% 12.3M 1s 2024-03-30T13:12:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:154300K .......... .......... .......... .......... .......... 91% 12.4M 1s 2024-03-30T13:12:32.081 INFO:teuthology.orchestra.run.smithi099.stderr:154350K .......... .......... .......... .......... .......... 91% 13.2M 1s 2024-03-30T13:12:32.084 INFO:teuthology.orchestra.run.smithi099.stderr:154400K .......... .......... .......... .......... .......... 91% 15.5M 1s 2024-03-30T13:12:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:154450K .......... .......... .......... .......... .......... 91% 11.1M 1s 2024-03-30T13:12:32.091 INFO:teuthology.orchestra.run.smithi099.stderr:154500K .......... .......... .......... .......... .......... 91% 17.5M 1s 2024-03-30T13:12:32.094 INFO:teuthology.orchestra.run.smithi099.stderr:154550K .......... .......... .......... .......... .......... 91% 14.3M 1s 2024-03-30T13:12:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:154600K .......... .......... .......... .......... .......... 91% 11.1M 1s 2024-03-30T13:12:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:154650K .......... .......... .......... .......... .......... 91% 14.1M 1s 2024-03-30T13:12:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:154700K .......... .......... .......... .......... .......... 91% 14.9M 1s 2024-03-30T13:12:32.108 INFO:teuthology.orchestra.run.smithi099.stderr:154750K .......... .......... .......... .......... .......... 91% 17.4M 1s 2024-03-30T13:12:32.113 INFO:teuthology.orchestra.run.smithi099.stderr:154800K .......... .......... .......... .......... .......... 91% 10.9M 1s 2024-03-30T13:12:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:154850K .......... .......... .......... .......... .......... 91% 13.4M 1s 2024-03-30T13:12:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:154900K .......... .......... .......... .......... .......... 91% 14.4M 1s 2024-03-30T13:12:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:154950K .......... .......... .......... .......... .......... 91% 12.3M 1s 2024-03-30T13:12:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:155000K .......... .......... .......... .......... .......... 91% 13.8M 1s 2024-03-30T13:12:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:155050K .......... .......... .......... .......... .......... 92% 18.2M 1s 2024-03-30T13:12:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:155100K .......... .......... .......... .......... .......... 92% 12.6M 1s 2024-03-30T13:12:32.139 INFO:teuthology.orchestra.run.smithi099.stderr:155150K .......... .......... .......... .......... .......... 92% 20.4M 1s 2024-03-30T13:12:32.141 INFO:teuthology.orchestra.run.smithi099.stderr:155200K .......... .......... .......... .......... .......... 92% 9.70M 1s 2024-03-30T13:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:155250K .......... .......... .......... .......... .......... 92% 6.98M 1s 2024-03-30T13:12:32.150 INFO:teuthology.orchestra.run.smithi099.stderr:155300K .......... .......... .......... .......... .......... 92% 37.5M 1s 2024-03-30T13:12:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:155350K .......... .......... .......... .......... .......... 92% 24.9M 1s 2024-03-30T13:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:155400K .......... .......... .......... .......... .......... 92% 12.8M 1s 2024-03-30T13:12:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:155450K .......... .......... .......... .......... .......... 92% 11.2M 1s 2024-03-30T13:12:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:155500K .......... .......... .......... .......... .......... 92% 15.5M 1s 2024-03-30T13:12:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:155550K .......... .......... .......... .......... .......... 92% 12.1M 1s 2024-03-30T13:12:32.170 INFO:teuthology.orchestra.run.smithi099.stderr:155600K .......... .......... .......... .......... .......... 92% 16.3M 1s 2024-03-30T13:12:32.175 INFO:teuthology.orchestra.run.smithi099.stderr:155650K .......... .......... .......... .......... .......... 92% 13.6M 1s 2024-03-30T13:12:32.177 INFO:teuthology.orchestra.run.smithi099.stderr:155700K .......... .......... .......... .......... .......... 92% 14.4M 1s 2024-03-30T13:12:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:155750K .......... .......... .......... .......... .......... 92% 15.3M 1s 2024-03-30T13:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:155800K .......... .......... .......... .......... .......... 92% 11.6M 1s 2024-03-30T13:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:155850K .......... .......... .......... .......... .......... 92% 15.3M 1s 2024-03-30T13:12:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:155900K .......... .......... .......... .......... .......... 92% 10.4M 1s 2024-03-30T13:12:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:155950K .......... .......... .......... .......... .......... 92% 24.0M 1s 2024-03-30T13:12:32.200 INFO:teuthology.orchestra.run.smithi099.stderr:156000K .......... .......... .......... .......... .......... 92% 8.63M 1s 2024-03-30T13:12:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:156050K .......... .......... .......... .......... .......... 92% 23.9M 1s 2024-03-30T13:12:32.206 INFO:teuthology.orchestra.run.smithi099.stderr:156100K .......... .......... .......... .......... .......... 92% 11.6M 1s 2024-03-30T13:12:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:156150K .......... .......... .......... .......... .......... 92% 12.1M 1s 2024-03-30T13:12:32.214 INFO:teuthology.orchestra.run.smithi099.stderr:156200K .......... .......... .......... .......... .......... 92% 15.5M 1s 2024-03-30T13:12:32.218 INFO:teuthology.orchestra.run.smithi099.stderr:156250K .......... .......... .......... .......... .......... 92% 10.4M 1s 2024-03-30T13:12:32.221 INFO:teuthology.orchestra.run.smithi099.stderr:156300K .......... .......... .......... .......... .......... 92% 19.4M 1s 2024-03-30T13:12:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:156350K .......... .......... .......... .......... .......... 92% 14.0M 1s 2024-03-30T13:12:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:156400K .......... .......... .......... .......... .......... 92% 15.2M 1s 2024-03-30T13:12:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:156450K .......... .......... .......... .......... .......... 92% 15.8M 1s 2024-03-30T13:12:32.235 INFO:teuthology.orchestra.run.smithi099.stderr:156500K .......... .......... .......... .......... .......... 92% 11.6M 1s 2024-03-30T13:12:32.238 INFO:teuthology.orchestra.run.smithi099.stderr:156550K .......... .......... .......... .......... .......... 92% 13.9M 1s 2024-03-30T13:12:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:156600K .......... .......... .......... .......... .......... 92% 12.6M 1s 2024-03-30T13:12:32.245 INFO:teuthology.orchestra.run.smithi099.stderr:156650K .......... .......... .......... .......... .......... 92% 13.3M 1s 2024-03-30T13:12:32.249 INFO:teuthology.orchestra.run.smithi099.stderr:156700K .......... .......... .......... .......... .......... 92% 14.2M 1s 2024-03-30T13:12:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:156750K .......... .......... .......... .......... .......... 93% 16.1M 1s 2024-03-30T13:12:32.255 INFO:teuthology.orchestra.run.smithi099.stderr:156800K .......... .......... .......... .......... .......... 93% 14.8M 1s 2024-03-30T13:12:32.258 INFO:teuthology.orchestra.run.smithi099.stderr:156850K .......... .......... .......... .......... .......... 93% 16.5M 1s 2024-03-30T13:12:32.263 INFO:teuthology.orchestra.run.smithi099.stderr:156900K .......... .......... .......... .......... .......... 93% 11.5M 1s 2024-03-30T13:12:32.267 INFO:teuthology.orchestra.run.smithi099.stderr:156950K .......... .......... .......... .......... .......... 93% 19.3M 1s 2024-03-30T13:12:32.270 INFO:teuthology.orchestra.run.smithi099.stderr:157000K .......... .......... .......... .......... .......... 93% 9.77M 1s 2024-03-30T13:12:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:157050K .......... .......... .......... .......... .......... 93% 17.5M 1s 2024-03-30T13:12:32.276 INFO:teuthology.orchestra.run.smithi099.stderr:157100K .......... .......... .......... .......... .......... 93% 13.7M 1s 2024-03-30T13:12:32.281 INFO:teuthology.orchestra.run.smithi099.stderr:157150K .......... .......... .......... .......... .......... 93% 12.4M 1s 2024-03-30T13:12:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:157200K .......... .......... .......... .......... .......... 93% 17.7M 1s 2024-03-30T13:12:32.288 INFO:teuthology.orchestra.run.smithi099.stderr:157250K .......... .......... .......... .......... .......... 93% 10.2M 1s 2024-03-30T13:12:32.292 INFO:teuthology.orchestra.run.smithi099.stderr:157300K .......... .......... .......... .......... .......... 93% 13.4M 1s 2024-03-30T13:12:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:157350K .......... .......... .......... .......... .......... 93% 10.1M 1s 2024-03-30T13:12:32.304 INFO:teuthology.orchestra.run.smithi099.stderr:157400K .......... .......... .......... .......... .......... 93% 14.1M 1s 2024-03-30T13:12:32.305 INFO:teuthology.orchestra.run.smithi099.stderr:157450K .......... .......... .......... .......... .......... 93% 11.7M 1s 2024-03-30T13:12:32.307 INFO:teuthology.orchestra.run.smithi099.stderr:157500K .......... .......... .......... .......... .......... 93% 21.3M 1s 2024-03-30T13:12:32.310 INFO:teuthology.orchestra.run.smithi099.stderr:157550K .......... .......... .......... .......... .......... 93% 17.5M 1s 2024-03-30T13:12:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:157600K .......... .......... .......... .......... .......... 93% 12.4M 1s 2024-03-30T13:12:32.316 INFO:teuthology.orchestra.run.smithi099.stderr:157650K .......... .......... .......... .......... .......... 93% 17.5M 1s 2024-03-30T13:12:32.320 INFO:teuthology.orchestra.run.smithi099.stderr:157700K .......... .......... .......... .......... .......... 93% 11.5M 1s 2024-03-30T13:12:32.322 INFO:teuthology.orchestra.run.smithi099.stderr:157750K .......... .......... .......... .......... .......... 93% 21.8M 1s 2024-03-30T13:12:32.325 INFO:teuthology.orchestra.run.smithi099.stderr:157800K .......... .......... .......... .......... .......... 93% 18.9M 1s 2024-03-30T13:12:32.331 INFO:teuthology.orchestra.run.smithi099.stderr:157850K .......... .......... .......... .......... .......... 93% 8.26M 1s 2024-03-30T13:12:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:157900K .......... .......... .......... .......... .......... 93% 14.5M 1s 2024-03-30T13:12:32.339 INFO:teuthology.orchestra.run.smithi099.stderr:157950K .......... .......... .......... .......... .......... 93% 10.0M 1s 2024-03-30T13:12:32.342 INFO:teuthology.orchestra.run.smithi099.stderr:158000K .......... .......... .......... .......... .......... 93% 17.0M 1s 2024-03-30T13:12:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:158050K .......... .......... .......... .......... .......... 93% 14.0M 1s 2024-03-30T13:12:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:158100K .......... .......... .......... .......... .......... 93% 14.6M 1s 2024-03-30T13:12:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:158150K .......... .......... .......... .......... .......... 93% 18.7M 1s 2024-03-30T13:12:32.356 INFO:teuthology.orchestra.run.smithi099.stderr:158200K .......... .......... .......... .......... .......... 93% 10.6M 1s 2024-03-30T13:12:32.359 INFO:teuthology.orchestra.run.smithi099.stderr:158250K .......... .......... .......... .......... .......... 93% 14.5M 1s 2024-03-30T13:12:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:158300K .......... .......... .......... .......... .......... 93% 13.3M 1s 2024-03-30T13:12:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:158350K .......... .......... .......... .......... .......... 93% 11.8M 1s 2024-03-30T13:12:32.371 INFO:teuthology.orchestra.run.smithi099.stderr:158400K .......... .......... .......... .......... .......... 93% 14.1M 1s 2024-03-30T13:12:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:158450K .......... .......... .......... .......... .......... 94% 10.4M 1s 2024-03-30T13:12:32.378 INFO:teuthology.orchestra.run.smithi099.stderr:158500K .......... .......... .......... .......... .......... 94% 15.6M 1s 2024-03-30T13:12:32.383 INFO:teuthology.orchestra.run.smithi099.stderr:158550K .......... .......... .......... .......... .......... 94% 11.1M 1s 2024-03-30T13:12:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:158600K .......... .......... .......... .......... .......... 94% 18.4M 1s 2024-03-30T13:12:32.390 INFO:teuthology.orchestra.run.smithi099.stderr:158650K .......... .......... .......... .......... .......... 94% 15.8M 1s 2024-03-30T13:12:32.392 INFO:teuthology.orchestra.run.smithi099.stderr:158700K .......... .......... .......... .......... .......... 94% 13.4M 1s 2024-03-30T13:12:32.395 INFO:teuthology.orchestra.run.smithi099.stderr:158750K .......... .......... .......... .......... .......... 94% 18.9M 1s 2024-03-30T13:12:32.397 INFO:teuthology.orchestra.run.smithi099.stderr:158800K .......... .......... .......... .......... .......... 94% 18.9M 1s 2024-03-30T13:12:32.402 INFO:teuthology.orchestra.run.smithi099.stderr:158850K .......... .......... .......... .......... .......... 94% 11.0M 1s 2024-03-30T13:12:32.406 INFO:teuthology.orchestra.run.smithi099.stderr:158900K .......... .......... .......... .......... .......... 94% 15.4M 1s 2024-03-30T13:12:32.409 INFO:teuthology.orchestra.run.smithi099.stderr:158950K .......... .......... .......... .......... .......... 94% 12.0M 1s 2024-03-30T13:12:32.412 INFO:teuthology.orchestra.run.smithi099.stderr:159000K .......... .......... .......... .......... .......... 94% 18.0M 1s 2024-03-30T13:12:32.416 INFO:teuthology.orchestra.run.smithi099.stderr:159050K .......... .......... .......... .......... .......... 94% 10.1M 1s 2024-03-30T13:12:32.423 INFO:teuthology.orchestra.run.smithi099.stderr:159100K .......... .......... .......... .......... .......... 94% 8.76M 1s 2024-03-30T13:12:32.425 INFO:teuthology.orchestra.run.smithi099.stderr:159150K .......... .......... .......... .......... .......... 94% 15.5M 1s 2024-03-30T13:12:32.430 INFO:teuthology.orchestra.run.smithi099.stderr:159200K .......... .......... .......... .......... .......... 94% 12.3M 1s 2024-03-30T13:12:32.432 INFO:teuthology.orchestra.run.smithi099.stderr:159250K .......... .......... .......... .......... .......... 94% 16.6M 1s 2024-03-30T13:12:32.437 INFO:teuthology.orchestra.run.smithi099.stderr:159300K .......... .......... .......... .......... .......... 94% 14.6M 1s 2024-03-30T13:12:32.440 INFO:teuthology.orchestra.run.smithi099.stderr:159350K .......... .......... .......... .......... .......... 94% 13.7M 1s 2024-03-30T13:12:32.443 INFO:teuthology.orchestra.run.smithi099.stderr:159400K .......... .......... .......... .......... .......... 94% 15.5M 1s 2024-03-30T13:12:32.446 INFO:teuthology.orchestra.run.smithi099.stderr:159450K .......... .......... .......... .......... .......... 94% 12.5M 1s 2024-03-30T13:12:32.450 INFO:teuthology.orchestra.run.smithi099.stderr:159500K .......... .......... .......... .......... .......... 94% 14.0M 1s 2024-03-30T13:12:32.453 INFO:teuthology.orchestra.run.smithi099.stderr:159550K .......... .......... .......... .......... .......... 94% 15.0M 1s 2024-03-30T13:12:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:159600K .......... .......... .......... .......... .......... 94% 14.0M 1s 2024-03-30T13:12:32.459 INFO:teuthology.orchestra.run.smithi099.stderr:159650K .......... .......... .......... .......... .......... 94% 16.8M 1s 2024-03-30T13:12:32.462 INFO:teuthology.orchestra.run.smithi099.stderr:159700K .......... .......... .......... .......... .......... 94% 18.3M 1s 2024-03-30T13:12:32.465 INFO:teuthology.orchestra.run.smithi099.stderr:159750K .......... .......... .......... .......... .......... 94% 18.1M 1s 2024-03-30T13:12:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:159800K .......... .......... .......... .......... .......... 94% 14.3M 1s 2024-03-30T13:12:32.476 INFO:teuthology.orchestra.run.smithi099.stderr:159850K .......... .......... .......... .......... .......... 94% 6.34M 1s 2024-03-30T13:12:32.478 INFO:teuthology.orchestra.run.smithi099.stderr:159900K .......... .......... .......... .......... .......... 94% 20.4M 1s 2024-03-30T13:12:32.481 INFO:teuthology.orchestra.run.smithi099.stderr:159950K .......... .......... .......... .......... .......... 94% 15.1M 1s 2024-03-30T13:12:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:160000K .......... .......... .......... .......... .......... 94% 13.2M 1s 2024-03-30T13:12:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:160050K .......... .......... .......... .......... .......... 94% 15.9M 1s 2024-03-30T13:12:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:160100K .......... .......... .......... .......... .......... 95% 12.5M 1s 2024-03-30T13:12:32.496 INFO:teuthology.orchestra.run.smithi099.stderr:160150K .......... .......... .......... .......... .......... 95% 14.2M 1s 2024-03-30T13:12:32.499 INFO:teuthology.orchestra.run.smithi099.stderr:160200K .......... .......... .......... .......... .......... 95% 11.9M 1s 2024-03-30T13:12:32.505 INFO:teuthology.orchestra.run.smithi099.stderr:160250K .......... .......... .......... .......... .......... 95% 8.82M 1s 2024-03-30T13:12:32.508 INFO:teuthology.orchestra.run.smithi099.stderr:160300K .......... .......... .......... .......... .......... 95% 17.3M 1s 2024-03-30T13:12:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:160350K .......... .......... .......... .......... .......... 95% 12.9M 1s 2024-03-30T13:12:32.516 INFO:teuthology.orchestra.run.smithi099.stderr:160400K .......... .......... .......... .......... .......... 95% 13.4M 1s 2024-03-30T13:12:32.519 INFO:teuthology.orchestra.run.smithi099.stderr:160450K .......... .......... .......... .......... .......... 95% 15.7M 1s 2024-03-30T13:12:32.523 INFO:teuthology.orchestra.run.smithi099.stderr:160500K .......... .......... .......... .......... .......... 95% 15.6M 1s 2024-03-30T13:12:32.525 INFO:teuthology.orchestra.run.smithi099.stderr:160550K .......... .......... .......... .......... .......... 95% 13.6M 1s 2024-03-30T13:12:32.528 INFO:teuthology.orchestra.run.smithi099.stderr:160600K .......... .......... .......... .......... .......... 95% 15.6M 1s 2024-03-30T13:12:32.532 INFO:teuthology.orchestra.run.smithi099.stderr:160650K .......... .......... .......... .......... .......... 95% 14.2M 1s 2024-03-30T13:12:32.535 INFO:teuthology.orchestra.run.smithi099.stderr:160700K .......... .......... .......... .......... .......... 95% 18.7M 1s 2024-03-30T13:12:32.538 INFO:teuthology.orchestra.run.smithi099.stderr:160750K .......... .......... .......... .......... .......... 95% 19.1M 1s 2024-03-30T13:12:32.543 INFO:teuthology.orchestra.run.smithi099.stderr:160800K .......... .......... .......... .......... .......... 95% 14.7M 1s 2024-03-30T13:12:32.546 INFO:teuthology.orchestra.run.smithi099.stderr:160850K .......... .......... .......... .......... .......... 95% 9.36M 1s 2024-03-30T13:12:32.548 INFO:teuthology.orchestra.run.smithi099.stderr:160900K .......... .......... .......... .......... .......... 95% 17.4M 1s 2024-03-30T13:12:32.552 INFO:teuthology.orchestra.run.smithi099.stderr:160950K .......... .......... .......... .......... .......... 95% 13.3M 1s 2024-03-30T13:12:32.556 INFO:teuthology.orchestra.run.smithi099.stderr:161000K .......... .......... .......... .......... .......... 95% 12.4M 1s 2024-03-30T13:12:32.564 INFO:teuthology.orchestra.run.smithi099.stderr:161050K .......... .......... .......... .......... .......... 95% 7.80M 1s 2024-03-30T13:12:32.566 INFO:teuthology.orchestra.run.smithi099.stderr:161100K .......... .......... .......... .......... .......... 95% 18.4M 1s 2024-03-30T13:12:32.568 INFO:teuthology.orchestra.run.smithi099.stderr:161150K .......... .......... .......... .......... .......... 95% 14.9M 1s 2024-03-30T13:12:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:161200K .......... .......... .......... .......... .......... 95% 13.6M 1s 2024-03-30T13:12:32.575 INFO:teuthology.orchestra.run.smithi099.stderr:161250K .......... .......... .......... .......... .......... 95% 16.3M 1s 2024-03-30T13:12:32.579 INFO:teuthology.orchestra.run.smithi099.stderr:161300K .......... .......... .......... .......... .......... 95% 11.6M 0s 2024-03-30T13:12:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:161350K .......... .......... .......... .......... .......... 95% 17.3M 0s 2024-03-30T13:12:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:161400K .......... .......... .......... .......... .......... 95% 14.1M 0s 2024-03-30T13:12:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:161450K .......... .......... .......... .......... .......... 95% 17.7M 0s 2024-03-30T13:12:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:161500K .......... .......... .......... .......... .......... 95% 16.9M 0s 2024-03-30T13:12:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:161550K .......... .......... .......... .......... .......... 95% 10.1M 0s 2024-03-30T13:12:32.599 INFO:teuthology.orchestra.run.smithi099.stderr:161600K .......... .......... .......... .......... .......... 95% 15.7M 0s 2024-03-30T13:12:32.603 INFO:teuthology.orchestra.run.smithi099.stderr:161650K .......... .......... .......... .......... .......... 95% 14.5M 0s 2024-03-30T13:12:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:161700K .......... .......... .......... .......... .......... 95% 16.0M 0s 2024-03-30T13:12:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:161750K .......... .......... .......... .......... .......... 95% 14.1M 0s 2024-03-30T13:12:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:161800K .......... .......... .......... .......... .......... 96% 10.8M 0s 2024-03-30T13:12:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:161850K .......... .......... .......... .......... .......... 96% 22.2M 0s 2024-03-30T13:12:32.619 INFO:teuthology.orchestra.run.smithi099.stderr:161900K .......... .......... .......... .......... .......... 96% 15.7M 0s 2024-03-30T13:12:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:161950K .......... .......... .......... .......... .......... 96% 9.40M 0s 2024-03-30T13:12:32.627 INFO:teuthology.orchestra.run.smithi099.stderr:162000K .......... .......... .......... .......... .......... 96% 16.0M 0s 2024-03-30T13:12:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:162050K .......... .......... .......... .......... .......... 96% 10.3M 0s 2024-03-30T13:12:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:162100K .......... .......... .......... .......... .......... 96% 13.0M 0s 2024-03-30T13:12:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:162150K .......... .......... .......... .......... .......... 96% 17.7M 0s 2024-03-30T13:12:32.643 INFO:teuthology.orchestra.run.smithi099.stderr:162200K .......... .......... .......... .......... .......... 96% 14.4M 0s 2024-03-30T13:12:32.646 INFO:teuthology.orchestra.run.smithi099.stderr:162250K .......... .......... .......... .......... .......... 96% 14.6M 0s 2024-03-30T13:12:32.650 INFO:teuthology.orchestra.run.smithi099.stderr:162300K .......... .......... .......... .......... .......... 96% 9.19M 0s 2024-03-30T13:12:32.654 INFO:teuthology.orchestra.run.smithi099.stderr:162350K .......... .......... .......... .......... .......... 96% 12.0M 0s 2024-03-30T13:12:32.658 INFO:teuthology.orchestra.run.smithi099.stderr:162400K .......... .......... .......... .......... .......... 96% 13.5M 0s 2024-03-30T13:12:32.661 INFO:teuthology.orchestra.run.smithi099.stderr:162450K .......... .......... .......... .......... .......... 96% 17.3M 0s 2024-03-30T13:12:32.665 INFO:teuthology.orchestra.run.smithi099.stderr:162500K .......... .......... .......... .......... .......... 96% 16.0M 0s 2024-03-30T13:12:32.668 INFO:teuthology.orchestra.run.smithi099.stderr:162550K .......... .......... .......... .......... .......... 96% 11.5M 0s 2024-03-30T13:12:32.672 INFO:teuthology.orchestra.run.smithi099.stderr:162600K .......... .......... .......... .......... .......... 96% 13.7M 0s 2024-03-30T13:12:32.674 INFO:teuthology.orchestra.run.smithi099.stderr:162650K .......... .......... .......... .......... .......... 96% 20.6M 0s 2024-03-30T13:12:32.677 INFO:teuthology.orchestra.run.smithi099.stderr:162700K .......... .......... .......... .......... .......... 96% 13.5M 0s 2024-03-30T13:12:32.681 INFO:teuthology.orchestra.run.smithi099.stderr:162750K .......... .......... .......... .......... .......... 96% 14.6M 0s 2024-03-30T13:12:32.685 INFO:teuthology.orchestra.run.smithi099.stderr:162800K .......... .......... .......... .......... .......... 96% 11.9M 0s 2024-03-30T13:12:32.688 INFO:teuthology.orchestra.run.smithi099.stderr:162850K .......... .......... .......... .......... .......... 96% 17.9M 0s 2024-03-30T13:12:32.690 INFO:teuthology.orchestra.run.smithi099.stderr:162900K .......... .......... .......... .......... .......... 96% 17.4M 0s 2024-03-30T13:12:32.695 INFO:teuthology.orchestra.run.smithi099.stderr:162950K .......... .......... .......... .......... .......... 96% 10.1M 0s 2024-03-30T13:12:32.700 INFO:teuthology.orchestra.run.smithi099.stderr:163000K .......... .......... .......... .......... .......... 96% 10.4M 0s 2024-03-30T13:12:32.703 INFO:teuthology.orchestra.run.smithi099.stderr:163050K .......... .......... .......... .......... .......... 96% 15.0M 0s 2024-03-30T13:12:32.707 INFO:teuthology.orchestra.run.smithi099.stderr:163100K .......... .......... .......... .......... .......... 96% 14.1M 0s 2024-03-30T13:12:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:163150K .......... .......... .......... .......... .......... 96% 12.7M 0s 2024-03-30T13:12:32.714 INFO:teuthology.orchestra.run.smithi099.stderr:163200K .......... .......... .......... .......... .......... 96% 18.2M 0s 2024-03-30T13:12:32.718 INFO:teuthology.orchestra.run.smithi099.stderr:163250K .......... .......... .......... .......... .......... 96% 11.5M 0s 2024-03-30T13:12:32.722 INFO:teuthology.orchestra.run.smithi099.stderr:163300K .......... .......... .......... .......... .......... 96% 10.7M 0s 2024-03-30T13:12:32.726 INFO:teuthology.orchestra.run.smithi099.stderr:163350K .......... .......... .......... .......... .......... 96% 14.1M 0s 2024-03-30T13:12:32.728 INFO:teuthology.orchestra.run.smithi099.stderr:163400K .......... .......... .......... .......... .......... 96% 16.8M 0s 2024-03-30T13:12:32.732 INFO:teuthology.orchestra.run.smithi099.stderr:163450K .......... .......... .......... .......... .......... 96% 15.2M 0s 2024-03-30T13:12:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:163500K .......... .......... .......... .......... .......... 97% 16.2M 0s 2024-03-30T13:12:32.739 INFO:teuthology.orchestra.run.smithi099.stderr:163550K .......... .......... .......... .......... .......... 97% 11.4M 0s 2024-03-30T13:12:32.742 INFO:teuthology.orchestra.run.smithi099.stderr:163600K .......... .......... .......... .......... .......... 97% 13.7M 0s 2024-03-30T13:12:32.748 INFO:teuthology.orchestra.run.smithi099.stderr:163650K .......... .......... .......... .......... .......... 97% 8.27M 0s 2024-03-30T13:12:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:163700K .......... .......... .......... .......... .......... 97% 14.3M 0s 2024-03-30T13:12:32.756 INFO:teuthology.orchestra.run.smithi099.stderr:163750K .......... .......... .......... .......... .......... 97% 12.9M 0s 2024-03-30T13:12:32.759 INFO:teuthology.orchestra.run.smithi099.stderr:163800K .......... .......... .......... .......... .......... 97% 12.9M 0s 2024-03-30T13:12:32.762 INFO:teuthology.orchestra.run.smithi099.stderr:163850K .......... .......... .......... .......... .......... 97% 22.3M 0s 2024-03-30T13:12:32.765 INFO:teuthology.orchestra.run.smithi099.stderr:163900K .......... .......... .......... .......... .......... 97% 13.9M 0s 2024-03-30T13:12:32.769 INFO:teuthology.orchestra.run.smithi099.stderr:163950K .......... .......... .......... .......... .......... 97% 12.2M 0s 2024-03-30T13:12:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:164000K .......... .......... .......... .......... .......... 97% 12.4M 0s 2024-03-30T13:12:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:164050K .......... .......... .......... .......... .......... 97% 16.8M 0s 2024-03-30T13:12:32.780 INFO:teuthology.orchestra.run.smithi099.stderr:164100K .......... .......... .......... .......... .......... 97% 13.0M 0s 2024-03-30T13:12:32.782 INFO:teuthology.orchestra.run.smithi099.stderr:164150K .......... .......... .......... .......... .......... 97% 16.7M 0s 2024-03-30T13:12:32.788 INFO:teuthology.orchestra.run.smithi099.stderr:164200K .......... .......... .......... .......... .......... 97% 13.0M 0s 2024-03-30T13:12:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:164250K .......... .......... .......... .......... .......... 97% 12.5M 0s 2024-03-30T13:12:32.795 INFO:teuthology.orchestra.run.smithi099.stderr:164300K .......... .......... .......... .......... .......... 97% 10.8M 0s 2024-03-30T13:12:32.797 INFO:teuthology.orchestra.run.smithi099.stderr:164350K .......... .......... .......... .......... .......... 97% 18.0M 0s 2024-03-30T13:12:32.801 INFO:teuthology.orchestra.run.smithi099.stderr:164400K .......... .......... .......... .......... .......... 97% 14.7M 0s 2024-03-30T13:12:32.804 INFO:teuthology.orchestra.run.smithi099.stderr:164450K .......... .......... .......... .......... .......... 97% 16.1M 0s 2024-03-30T13:12:32.807 INFO:teuthology.orchestra.run.smithi099.stderr:164500K .......... .......... .......... .......... .......... 97% 16.3M 0s 2024-03-30T13:12:32.812 INFO:teuthology.orchestra.run.smithi099.stderr:164550K .......... .......... .......... .......... .......... 97% 9.73M 0s 2024-03-30T13:12:32.814 INFO:teuthology.orchestra.run.smithi099.stderr:164600K .......... .......... .......... .......... .......... 97% 23.0M 0s 2024-03-30T13:12:32.818 INFO:teuthology.orchestra.run.smithi099.stderr:164650K .......... .......... .......... .......... .......... 97% 12.3M 0s 2024-03-30T13:12:32.821 INFO:teuthology.orchestra.run.smithi099.stderr:164700K .......... .......... .......... .......... .......... 97% 13.7M 0s 2024-03-30T13:12:32.826 INFO:teuthology.orchestra.run.smithi099.stderr:164750K .......... .......... .......... .......... .......... 97% 11.2M 0s 2024-03-30T13:12:32.831 INFO:teuthology.orchestra.run.smithi099.stderr:164800K .......... .......... .......... .......... .......... 97% 9.52M 0s 2024-03-30T13:12:32.835 INFO:teuthology.orchestra.run.smithi099.stderr:164850K .......... .......... .......... .......... .......... 97% 13.4M 0s 2024-03-30T13:12:32.839 INFO:teuthology.orchestra.run.smithi099.stderr:164900K .......... .......... .......... .......... .......... 97% 12.5M 0s 2024-03-30T13:12:32.842 INFO:teuthology.orchestra.run.smithi099.stderr:164950K .......... .......... .......... .......... .......... 97% 12.9M 0s 2024-03-30T13:12:32.846 INFO:teuthology.orchestra.run.smithi099.stderr:165000K .......... .......... .......... .......... .......... 97% 15.2M 0s 2024-03-30T13:12:32.849 INFO:teuthology.orchestra.run.smithi099.stderr:165050K .......... .......... .......... .......... .......... 97% 16.2M 0s 2024-03-30T13:12:32.856 INFO:teuthology.orchestra.run.smithi099.stderr:165100K .......... .......... .......... .......... .......... 97% 13.1M 0s 2024-03-30T13:12:32.856 INFO:teuthology.orchestra.run.smithi099.stderr:165150K .......... .......... .......... .......... .......... 98% 12.7M 0s 2024-03-30T13:12:32.859 INFO:teuthology.orchestra.run.smithi099.stderr:165200K .......... .......... .......... .......... .......... 98% 14.7M 0s 2024-03-30T13:12:32.863 INFO:teuthology.orchestra.run.smithi099.stderr:165250K .......... .......... .......... .......... .......... 98% 13.9M 0s 2024-03-30T13:12:32.867 INFO:teuthology.orchestra.run.smithi099.stderr:165300K .......... .......... .......... .......... .......... 98% 11.3M 0s 2024-03-30T13:12:32.870 INFO:teuthology.orchestra.run.smithi099.stderr:165350K .......... .......... .......... .......... .......... 98% 18.6M 0s 2024-03-30T13:12:32.876 INFO:teuthology.orchestra.run.smithi099.stderr:165400K .......... .......... .......... .......... .......... 98% 14.3M 0s 2024-03-30T13:12:32.877 INFO:teuthology.orchestra.run.smithi099.stderr:165450K .......... .......... .......... .......... .......... 98% 19.2M 0s 2024-03-30T13:12:32.881 INFO:teuthology.orchestra.run.smithi099.stderr:165500K .......... .......... .......... .......... .......... 98% 10.2M 0s 2024-03-30T13:12:32.885 INFO:teuthology.orchestra.run.smithi099.stderr:165550K .......... .......... .......... .......... .......... 98% 12.4M 0s 2024-03-30T13:12:32.888 INFO:teuthology.orchestra.run.smithi099.stderr:165600K .......... .......... .......... .......... .......... 98% 15.2M 0s 2024-03-30T13:12:32.892 INFO:teuthology.orchestra.run.smithi099.stderr:165650K .......... .......... .......... .......... .......... 98% 15.3M 0s 2024-03-30T13:12:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:165700K .......... .......... .......... .......... .......... 98% 14.6M 0s 2024-03-30T13:12:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:165750K .......... .......... .......... .......... .......... 98% 16.8M 0s 2024-03-30T13:12:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:165800K .......... .......... .......... .......... .......... 98% 11.5M 0s 2024-03-30T13:12:32.906 INFO:teuthology.orchestra.run.smithi099.stderr:165850K .......... .......... .......... .......... .......... 98% 14.6M 0s 2024-03-30T13:12:32.909 INFO:teuthology.orchestra.run.smithi099.stderr:165900K .......... .......... .......... .......... .......... 98% 12.3M 0s 2024-03-30T13:12:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:165950K .......... .......... .......... .......... .......... 98% 12.1M 0s 2024-03-30T13:12:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:166000K .......... .......... .......... .......... .......... 98% 13.8M 0s 2024-03-30T13:12:32.921 INFO:teuthology.orchestra.run.smithi099.stderr:166050K .......... .......... .......... .......... .......... 98% 12.7M 0s 2024-03-30T13:12:32.926 INFO:teuthology.orchestra.run.smithi099.stderr:166100K .......... .......... .......... .......... .......... 98% 12.5M 0s 2024-03-30T13:12:32.930 INFO:teuthology.orchestra.run.smithi099.stderr:166150K .......... .......... .......... .......... .......... 98% 9.63M 0s 2024-03-30T13:12:32.932 INFO:teuthology.orchestra.run.smithi099.stderr:166200K .......... .......... .......... .......... .......... 98% 15.6M 0s 2024-03-30T13:12:32.936 INFO:teuthology.orchestra.run.smithi099.stderr:166250K .......... .......... .......... .......... .......... 98% 13.2M 0s 2024-03-30T13:12:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:166300K .......... .......... .......... .......... .......... 98% 15.0M 0s 2024-03-30T13:12:32.943 INFO:teuthology.orchestra.run.smithi099.stderr:166350K .......... .......... .......... .......... .......... 98% 15.4M 0s 2024-03-30T13:12:32.945 INFO:teuthology.orchestra.run.smithi099.stderr:166400K .......... .......... .......... .......... .......... 98% 20.3M 0s 2024-03-30T13:12:32.948 INFO:teuthology.orchestra.run.smithi099.stderr:166450K .......... .......... .......... .......... .......... 98% 17.2M 0s 2024-03-30T13:12:32.951 INFO:teuthology.orchestra.run.smithi099.stderr:166500K .......... .......... .......... .......... .......... 98% 14.4M 0s 2024-03-30T13:12:32.958 INFO:teuthology.orchestra.run.smithi099.stderr:166550K .......... .......... .......... .......... .......... 98% 11.8M 0s 2024-03-30T13:12:32.963 INFO:teuthology.orchestra.run.smithi099.stderr:166600K .......... .......... .......... .......... .......... 98% 12.3M 0s 2024-03-30T13:12:32.963 INFO:teuthology.orchestra.run.smithi099.stderr:166650K .......... .......... .......... .......... .......... 98% 17.6M 0s 2024-03-30T13:12:32.965 INFO:teuthology.orchestra.run.smithi099.stderr:166700K .......... .......... .......... .......... .......... 98% 15.6M 0s 2024-03-30T13:12:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:166750K .......... .......... .......... .......... .......... 98% 15.5M 0s 2024-03-30T13:12:32.971 INFO:teuthology.orchestra.run.smithi099.stderr:166800K .......... .......... .......... .......... .......... 98% 15.3M 0s 2024-03-30T13:12:32.975 INFO:teuthology.orchestra.run.smithi099.stderr:166850K .......... .......... .......... .......... .......... 99% 13.8M 0s 2024-03-30T13:12:32.978 INFO:teuthology.orchestra.run.smithi099.stderr:166900K .......... .......... .......... .......... .......... 99% 17.9M 0s 2024-03-30T13:12:32.982 INFO:teuthology.orchestra.run.smithi099.stderr:166950K .......... .......... .......... .......... .......... 99% 16.0M 0s 2024-03-30T13:12:32.985 INFO:teuthology.orchestra.run.smithi099.stderr:167000K .......... .......... .......... .......... .......... 99% 13.9M 0s 2024-03-30T13:12:32.987 INFO:teuthology.orchestra.run.smithi099.stderr:167050K .......... .......... .......... .......... .......... 99% 15.7M 0s 2024-03-30T13:12:32.992 INFO:teuthology.orchestra.run.smithi099.stderr:167100K .......... .......... .......... .......... .......... 99% 9.74M 0s 2024-03-30T13:12:32.996 INFO:teuthology.orchestra.run.smithi099.stderr:167150K .......... .......... .......... .......... .......... 99% 13.9M 0s 2024-03-30T13:12:32.999 INFO:teuthology.orchestra.run.smithi099.stderr:167200K .......... .......... .......... .......... .......... 99% 14.6M 0s 2024-03-30T13:12:33.003 INFO:teuthology.orchestra.run.smithi099.stderr:167250K .......... .......... .......... .......... .......... 99% 13.3M 0s 2024-03-30T13:12:33.008 INFO:teuthology.orchestra.run.smithi099.stderr:167300K .......... .......... .......... .......... .......... 99% 12.8M 0s 2024-03-30T13:12:33.010 INFO:teuthology.orchestra.run.smithi099.stderr:167350K .......... .......... .......... .......... .......... 99% 16.8M 0s 2024-03-30T13:12:33.013 INFO:teuthology.orchestra.run.smithi099.stderr:167400K .......... .......... .......... .......... .......... 99% 15.2M 0s 2024-03-30T13:12:33.016 INFO:teuthology.orchestra.run.smithi099.stderr:167450K .......... .......... .......... .......... .......... 99% 15.6M 0s 2024-03-30T13:12:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:167500K .......... .......... .......... .......... .......... 99% 12.2M 0s 2024-03-30T13:12:33.025 INFO:teuthology.orchestra.run.smithi099.stderr:167550K .......... .......... .......... .......... .......... 99% 13.9M 0s 2024-03-30T13:12:33.027 INFO:teuthology.orchestra.run.smithi099.stderr:167600K .......... .......... .......... .......... .......... 99% 14.1M 0s 2024-03-30T13:12:33.030 INFO:teuthology.orchestra.run.smithi099.stderr:167650K .......... .......... .......... .......... .......... 99% 15.7M 0s 2024-03-30T13:12:33.034 INFO:teuthology.orchestra.run.smithi099.stderr:167700K .......... .......... .......... .......... .......... 99% 13.4M 0s 2024-03-30T13:12:33.036 INFO:teuthology.orchestra.run.smithi099.stderr:167750K .......... .......... .......... .......... .......... 99% 17.4M 0s 2024-03-30T13:12:33.041 INFO:teuthology.orchestra.run.smithi099.stderr:167800K .......... .......... .......... .......... .......... 99% 12.0M 0s 2024-03-30T13:12:33.045 INFO:teuthology.orchestra.run.smithi099.stderr:167850K .......... .......... .......... .......... .......... 99% 12.1M 0s 2024-03-30T13:12:33.048 INFO:teuthology.orchestra.run.smithi099.stderr:167900K .......... .......... .......... .......... .......... 99% 16.1M 0s 2024-03-30T13:12:33.051 INFO:teuthology.orchestra.run.smithi099.stderr:167950K .......... .......... .......... .......... .......... 99% 13.0M 0s 2024-03-30T13:12:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:168000K .......... .......... .......... .......... .......... 99% 13.3M 0s 2024-03-30T13:12:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:168050K .......... .......... .......... .......... .......... 99% 13.4M 0s 2024-03-30T13:12:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:168100K .......... .......... .......... .......... .......... 99% 21.9M 0s 2024-03-30T13:12:33.064 INFO:teuthology.orchestra.run.smithi099.stderr:168150K .......... .......... .......... .......... .......... 99% 16.7M 0s 2024-03-30T13:12:33.066 INFO:teuthology.orchestra.run.smithi099.stderr:168200K .......... .......... .......... .......... .......... 99% 19.4M 0s 2024-03-30T13:12:33.070 INFO:teuthology.orchestra.run.smithi099.stderr:168250K .......... .......... .......... .......... .......... 99% 13.2M 0s 2024-03-30T13:12:33.074 INFO:teuthology.orchestra.run.smithi099.stderr:168300K .......... .......... .......... .......... .......... 99% 11.7M 0s 2024-03-30T13:12:33.078 INFO:teuthology.orchestra.run.smithi099.stderr:168350K .......... .......... .......... .......... .......... 99% 15.4M 0s 2024-03-30T13:12:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:168400K .......... .......... .......... .......... .......... 99% 12.4M 0s 2024-03-30T13:12:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:168450K .......... .......... .......... .......... .......... 99% 15.9M 0s 2024-03-30T13:12:33.087 INFO:teuthology.orchestra.run.smithi099.stderr:168500K .......... .......... .......... .......... .......... 99% 15.6M 0s 2024-03-30T13:12:33.089 INFO:teuthology.orchestra.run.smithi099.stderr:168550K .......... .......... . 100% 17.0M=12s 2024-03-30T13:12:33.089 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:12:33.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30 13:12:33 (14.1 MB/s) - ‘linux-5.4.tar.gz’ saved [172616875/172616875] 2024-03-30T13:12:33.089 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:12:33.092 INFO:tasks.cephfs.test_uninlining:Running Data Uninlining test with: without clearing cache, without unmount client, without mount.open_background, without multimds, without snapshots 2024-03-30T13:12:33.093 DEBUG:tasks.cephfs.test_uninlining:setting max_mds:1 2024-03-30T13:12:33.093 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-03-30T13:12:33.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.351+0000 7f9feb600640 1 Processor -- start 2024-03-30T13:12:33.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.352+0000 7f9feb600640 1 -- start start 2024-03-30T13:12:33.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.353+0000 7f9feb600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fe40b4340 0x7f9fe40b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:33.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.353+0000 7f9feb600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe415b850 0x7f9fe40b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:33.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.353+0000 7f9feb600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9fe40b4720 0x7f9fe40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:33.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.353+0000 7f9feb600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe40b5c40 con 0x7f9fe40b4340 2024-03-30T13:12:33.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.353+0000 7f9feb600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe40b50c0 con 0x7f9fe40b4720 2024-03-30T13:12:33.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.353+0000 7f9feb600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe40b53a0 con 0x7f9fe415b850 2024-03-30T13:12:33.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.353+0000 7f9fe8c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fe40b4340 0x7f9fe40b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:33.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.354+0000 7f9fe8c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fe40b4340 0x7f9fe40b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53138/0 (socket says 172.21.15.99:53138) 2024-03-30T13:12:33.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.354+0000 7f9fe8c00640 1 -- 172.21.15.99:0/577070982 learned_addr learned my addr 172.21.15.99:0/577070982 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:33.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.354+0000 7f9fdbe00640 1 --2- 172.21.15.99:0/577070982 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe415b850 0x7f9fe40b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:33.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.354+0000 7f9fe9600640 1 --2- 172.21.15.99:0/577070982 >> v2:172.21.15.181:3300/0 conn(0x7f9fe40b4720 0x7f9fe40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:33.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.354+0000 7f9fe8c00640 1 -- 172.21.15.99:0/577070982 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe415b850 msgr2=0x7f9fe40b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:33.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.354+0000 7f9fe8c00640 1 --2- 172.21.15.99:0/577070982 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe415b850 0x7f9fe40b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:33.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.354+0000 7f9fe8c00640 1 -- 172.21.15.99:0/577070982 >> v2:172.21.15.181:3300/0 conn(0x7f9fe40b4720 msgr2=0x7f9fe40ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:33.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.354+0000 7f9fe8c00640 1 --2- 172.21.15.99:0/577070982 >> v2:172.21.15.181:3300/0 conn(0x7f9fe40b4720 0x7f9fe40ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:33.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.354+0000 7f9fe8c00640 1 -- 172.21.15.99:0/577070982 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe40b5680 con 0x7f9fe40b4340 2024-03-30T13:12:33.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.356+0000 7f9fe8c00640 1 --2- 172.21.15.99:0/577070982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe40b4340 0x7f9fe40b3750 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40b69f0 tx=0x7f9fcc02da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42077168e55a58c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:33.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.356+0000 7f9fe3e00640 1 -- 172.21.15.99:0/577070982 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc031820 con 0x7f9fe40b4340 2024-03-30T13:12:33.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.356+0000 7f9fe3e00640 1 -- 172.21.15.99:0/577070982 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc0319c0 con 0x7f9fe40b4340 2024-03-30T13:12:33.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.356+0000 7f9fe3e00640 1 -- 172.21.15.99:0/577070982 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc031d90 con 0x7f9fe40b4340 2024-03-30T13:12:33.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.357+0000 7f9feb600640 1 -- 172.21.15.99:0/577070982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe40b4340 msgr2=0x7f9fe40b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:33.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.357+0000 7f9feb600640 1 --2- 172.21.15.99:0/577070982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe40b4340 0x7f9fe40b3750 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40b69f0 tx=0x7f9fcc02da00 comp rx=0 tx=0).stop 2024-03-30T13:12:33.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.357+0000 7f9feb600640 1 -- 172.21.15.99:0/577070982 shutdown_connections 2024-03-30T13:12:33.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.357+0000 7f9feb600640 1 --2- 172.21.15.99:0/577070982 >> v2:172.21.15.181:3300/0 conn(0x7f9fe40b4720 0x7f9fe40ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:33.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.357+0000 7f9feb600640 1 --2- 172.21.15.99:0/577070982 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe415b850 0x7f9fe40b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:33.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.357+0000 7f9feb600640 1 --2- 172.21.15.99:0/577070982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe40b4340 0x7f9fe40b3750 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:33.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.357+0000 7f9feb600640 1 -- 172.21.15.99:0/577070982 >> 172.21.15.99:0/577070982 conn(0x7f9fe4072e40 msgr2=0x7f9fe40b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:33.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.357+0000 7f9feb600640 1 -- 172.21.15.99:0/577070982 shutdown_connections 2024-03-30T13:12:33.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.357+0000 7f9feb600640 1 -- 172.21.15.99:0/577070982 wait complete. 2024-03-30T13:12:33.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.359+0000 7f9feb600640 1 Processor -- start 2024-03-30T13:12:33.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.359+0000 7f9feb600640 1 -- start start 2024-03-30T13:12:33.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.360+0000 7f9feb600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe40b4340 0x7f9fe40cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:33.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.360+0000 7f9feb600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe40b4720 0x7f9fe415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:33.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.360+0000 7f9feb600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe4150480 0x7f9fe415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:33.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.360+0000 7f9feb600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe40b4d50 con 0x7f9fe4150480 2024-03-30T13:12:33.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.360+0000 7f9feb600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe40b4bd0 con 0x7f9fe40b4340 2024-03-30T13:12:33.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.360+0000 7f9feb600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe40aee20 con 0x7f9fe40b4720 2024-03-30T13:12:33.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.360+0000 7f9fe9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe4150480 0x7f9fe415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:33.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.360+0000 7f9fe9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe4150480 0x7f9fe415c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53150/0 (socket says 172.21.15.99:53150) 2024-03-30T13:12:33.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.360+0000 7f9fe9600640 1 -- 172.21.15.99:0/585330868 learned_addr learned my addr 172.21.15.99:0/585330868 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:33.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9fe8c00640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe40b4340 0x7f9fe40cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:33.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9fdbe00640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe40b4720 0x7f9fe415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:33.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9fe9600640 1 -- 172.21.15.99:0/585330868 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe40b4720 msgr2=0x7f9fe415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:33.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9fe9600640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe40b4720 0x7f9fe415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:33.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9fe9600640 1 -- 172.21.15.99:0/585330868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe40b4340 msgr2=0x7f9fe40cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:33.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9fe9600640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe40b4340 0x7f9fe40cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:33.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9fe9600640 1 -- 172.21.15.99:0/585330868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe40cdce0 con 0x7f9fe4150480 2024-03-30T13:12:33.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9fe9600640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe4150480 0x7f9fe415c630 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc007e60 tx=0x7f9fdc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:33.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9fe1600640 1 -- 172.21.15.99:0/585330868 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc014620 con 0x7f9fe4150480 2024-03-30T13:12:33.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9fe1600640 1 -- 172.21.15.99:0/585330868 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fdc019070 con 0x7f9fe4150480 2024-03-30T13:12:33.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9fe1600640 1 -- 172.21.15.99:0/585330868 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc014a20 con 0x7f9fe4150480 2024-03-30T13:12:33.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.361+0000 7f9feb600640 1 -- 172.21.15.99:0/585330868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe40cdfc0 con 0x7f9fe4150480 2024-03-30T13:12:33.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.362+0000 7f9feb600640 1 -- 172.21.15.99:0/585330868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe40ce580 con 0x7f9fe4150480 2024-03-30T13:12:33.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.363+0000 7f9feb600640 1 -- 172.21.15.99:0/585330868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe409f6a0 con 0x7f9fe4150480 2024-03-30T13:12:33.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.363+0000 7f9fe1600640 1 -- 172.21.15.99:0/585330868 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9fdc014bc0 con 0x7f9fe4150480 2024-03-30T13:12:33.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.364+0000 7f9fe1600640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fc006c530 0x7f9fc006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:33.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.364+0000 7f9fe1600640 1 -- 172.21.15.99:0/585330868 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f9fdc08bfd0 con 0x7f9fe4150480 2024-03-30T13:12:33.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.365+0000 7f9fe8c00640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fc006c530 0x7f9fc006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:33.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.365+0000 7f9fe8c00640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fc006c530 0x7f9fc006e9f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc038000 tx=0x7f9fcc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:33.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.369+0000 7f9fe1600640 1 -- 172.21.15.99:0/585330868 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9fdc05a560 con 0x7f9fe4150480 2024-03-30T13:12:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:33.607+0000 7f9feb600640 1 -- 172.21.15.99:0/585330868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f9fe40b1440 con 0x7f9fe4150480 2024-03-30T13:12:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.362+0000 7f9fe1600640 1 -- 172.21.15.99:0/585330868 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f9fdc059e60 con 0x7f9fe4150480 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.365+0000 7f9feb600640 1 -- 172.21.15.99:0/585330868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fc006c530 msgr2=0x7f9fc006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.365+0000 7f9feb600640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fc006c530 0x7f9fc006e9f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc038000 tx=0x7f9fcc03b040 comp rx=0 tx=0).stop 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.365+0000 7f9feb600640 1 -- 172.21.15.99:0/585330868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe4150480 msgr2=0x7f9fe415c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.365+0000 7f9feb600640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe4150480 0x7f9fe415c630 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc007e60 tx=0x7f9fdc00e4b0 comp rx=0 tx=0).stop 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.365+0000 7f9feb600640 1 -- 172.21.15.99:0/585330868 shutdown_connections 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.365+0000 7f9feb600640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f9fc006c530 0x7f9fc006e9f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.365+0000 7f9feb600640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe4150480 0x7f9fe415c630 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.365+0000 7f9feb600640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe40b4720 0x7f9fe415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.365+0000 7f9feb600640 1 --2- 172.21.15.99:0/585330868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe40b4340 0x7f9fe40cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.365+0000 7f9feb600640 1 -- 172.21.15.99:0/585330868 >> 172.21.15.99:0/585330868 conn(0x7f9fe4072e40 msgr2=0x7f9fe40d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.366+0000 7f9feb600640 1 -- 172.21.15.99:0/585330868 shutdown_connections 2024-03-30T13:12:34.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:34.366+0000 7f9feb600640 1 -- 172.21.15.99:0/585330868 wait complete. 2024-03-30T13:12:34.390 DEBUG:tasks.cephfs.test_uninlining:getting client_max_inline_size 2024-03-30T13:12:34.390 DEBUG:tasks.cephfs.test_uninlining:got client_max_inline_size:4096 2024-03-30T13:12:34.390 DEBUG:tasks.cephfs.test_uninlining:extracting tarball 2024-03-30T13:12:34.390 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && tar -x -z -f linux-5.4.tar.gz linux-5.4/fs/ceph linux-5.4/fs/orangefs linux-5.4/fs/ext2 2024-03-30T13:12:39.625 DEBUG:tasks.cephfs.test_uninlining:fetching dir list 2024-03-30T13:12:39.625 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -mindepth 2 -maxdepth 2 -type d 2024-03-30T13:12:39.735 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph 2024-03-30T13:12:39.736 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2 2024-03-30T13:12:39.736 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs 2024-03-30T13:12:39.736 DEBUG:tasks.cephfs.test_uninlining:distributing dir pins 2024-03-30T13:12:39.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:39.736 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ceph) 2024-03-30T13:12:39.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:39.806 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ext2) 2024-03-30T13:12:39.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:39.861 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/orangefs) 2024-03-30T13:12:39.912 DEBUG:tasks.cephfs.test_uninlining:listing files with size <= 4096 2024-03-30T13:12:39.912 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -type f -size -4097c 2024-03-30T13:12:39.991 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:12:39.991 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/Makefile 2024-03-30T13:12:39.991 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:12:39.991 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/io.h 2024-03-30T13:12:39.991 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:12:39.991 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:12:39.991 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:12:39.991 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:12:39.991 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/Makefile 2024-03-30T13:12:39.991 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/acl.h 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:12:39.992 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:12:39.993 INFO:tasks.cephfs.test_uninlining:Found 23 inlined files 2024-03-30T13:12:39.993 DEBUG:tasks.cephfs.test_uninlining:starting scrub 2024-03-30T13:12:39.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:39.993 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive 2024-03-30T13:12:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.206+0000 7f6dca200640 1 Processor -- start 2024-03-30T13:12:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.206+0000 7f6dca200640 1 -- start start 2024-03-30T13:12:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.207+0000 7f6dca200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6dc4156ba0 0x7f6dc415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.207+0000 7f6dca200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6dc406d860 0x7f6dc406dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.207+0000 7f6dca200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6dc40d0490 0x7f6dc40d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.207+0000 7f6dca200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc415db70 con 0x7f6dc40d0490 2024-03-30T13:12:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.207+0000 7f6dca200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc406e300 con 0x7f6dc4156ba0 2024-03-30T13:12:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.207+0000 7f6dca200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc406e5e0 con 0x7f6dc406d860 2024-03-30T13:12:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.208+0000 7f6dc3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6dc40d0490 0x7f6dc40d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.208+0000 7f6dc3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6dc40d0490 0x7f6dc40d0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52450/0 (socket says 172.21.15.99:52450) 2024-03-30T13:12:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.208+0000 7f6dc3e00640 1 -- 172.21.15.99:0/843283001 learned_addr learned my addr 172.21.15.99:0/843283001 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:40.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.208+0000 7f6dbbe00640 1 --2- 172.21.15.99:0/843283001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6dc406d860 0x7f6dc406dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.208+0000 7f6dc3400640 1 --2- 172.21.15.99:0/843283001 >> v2:172.21.15.181:3300/0 conn(0x7f6dc4156ba0 0x7f6dc415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.208+0000 7f6dc3e00640 1 -- 172.21.15.99:0/843283001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6dc406d860 msgr2=0x7f6dc406dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.208+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/843283001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6dc406d860 0x7f6dc406dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.208+0000 7f6dc3e00640 1 -- 172.21.15.99:0/843283001 >> v2:172.21.15.181:3300/0 conn(0x7f6dc4156ba0 msgr2=0x7f6dc415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.208+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/843283001 >> v2:172.21.15.181:3300/0 conn(0x7f6dc4156ba0 0x7f6dc415d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.208+0000 7f6dc3e00640 1 -- 172.21.15.99:0/843283001 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc415ce50 con 0x7f6dc40d0490 2024-03-30T13:12:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.209+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/843283001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc40d0490 0x7f6dc40d0940 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40b5400 tx=0x7f6dbc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f18c65e2aad1af6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.209+0000 7f6dc2a00640 1 -- 172.21.15.99:0/843283001 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc02c9e0 con 0x7f6dc40d0490 2024-03-30T13:12:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.209+0000 7f6dc2a00640 1 -- 172.21.15.99:0/843283001 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc02cb80 con 0x7f6dc40d0490 2024-03-30T13:12:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.209+0000 7f6dc2a00640 1 -- 172.21.15.99:0/843283001 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0343f0 con 0x7f6dc40d0490 2024-03-30T13:12:40.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.210+0000 7f6dca200640 1 -- 172.21.15.99:0/843283001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc40d0490 msgr2=0x7f6dc40d0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.210+0000 7f6dca200640 1 --2- 172.21.15.99:0/843283001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc40d0490 0x7f6dc40d0940 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40b5400 tx=0x7f6dbc02be40 comp rx=0 tx=0).stop 2024-03-30T13:12:40.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.210+0000 7f6dca200640 1 -- 172.21.15.99:0/843283001 shutdown_connections 2024-03-30T13:12:40.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.210+0000 7f6dca200640 1 --2- 172.21.15.99:0/843283001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc40d0490 0x7f6dc40d0940 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.210+0000 7f6dca200640 1 --2- 172.21.15.99:0/843283001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6dc406d860 0x7f6dc406dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.210+0000 7f6dca200640 1 --2- 172.21.15.99:0/843283001 >> v2:172.21.15.181:3300/0 conn(0x7f6dc4156ba0 0x7f6dc415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.210+0000 7f6dca200640 1 -- 172.21.15.99:0/843283001 >> 172.21.15.99:0/843283001 conn(0x7f6dc406b6f0 msgr2=0x7f6dc406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.210+0000 7f6dca200640 1 -- 172.21.15.99:0/843283001 shutdown_connections 2024-03-30T13:12:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.210+0000 7f6dca200640 1 -- 172.21.15.99:0/843283001 wait complete. 2024-03-30T13:12:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.212+0000 7f6dca200640 1 Processor -- start 2024-03-30T13:12:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.212+0000 7f6dca200640 1 -- start start 2024-03-30T13:12:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.213+0000 7f6dca200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6dc406d860 0x7f6dc40b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.213+0000 7f6dca200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc40d0490 0x7f6dc41539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.213+0000 7f6dca200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dc4156ba0 0x7f6dc414b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.213+0000 7f6dca200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc40ad3d0 con 0x7f6dc40d0490 2024-03-30T13:12:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.213+0000 7f6dca200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc415cb40 con 0x7f6dc4156ba0 2024-03-30T13:12:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.213+0000 7f6dca200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc4156f80 con 0x7f6dc406d860 2024-03-30T13:12:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.213+0000 7f6dbbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc40d0490 0x7f6dc41539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.213+0000 7f6dbbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc40d0490 0x7f6dc41539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52458/0 (socket says 172.21.15.99:52458) 2024-03-30T13:12:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.213+0000 7f6dbbe00640 1 -- 172.21.15.99:0/201272953 learned_addr learned my addr 172.21.15.99:0/201272953 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.214+0000 7f6dbbe00640 1 -- 172.21.15.99:0/201272953 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6dc406d860 msgr2=0x7f6dc40b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.214+0000 7f6dbbe00640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6dc406d860 0x7f6dc40b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.214+0000 7f6dbbe00640 1 -- 172.21.15.99:0/201272953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dc4156ba0 msgr2=0x7f6dc414b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.214+0000 7f6dbbe00640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dc4156ba0 0x7f6dc414b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.214+0000 7f6dbbe00640 1 -- 172.21.15.99:0/201272953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc41f2370 con 0x7f6dc40d0490 2024-03-30T13:12:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.214+0000 7f6dbbe00640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc40d0490 0x7f6dc41539f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00c7f0 tx=0x7f6dac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.214+0000 7f6dbb400640 1 -- 172.21.15.99:0/201272953 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac015070 con 0x7f6dc40d0490 2024-03-30T13:12:40.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.214+0000 7f6dbb400640 1 -- 172.21.15.99:0/201272953 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dac004220 con 0x7f6dc40d0490 2024-03-30T13:12:40.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.214+0000 7f6dbb400640 1 -- 172.21.15.99:0/201272953 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac007620 con 0x7f6dc40d0490 2024-03-30T13:12:40.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.214+0000 7f6dca200640 1 -- 172.21.15.99:0/201272953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc41f2650 con 0x7f6dc40d0490 2024-03-30T13:12:40.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.214+0000 7f6dca200640 1 -- 172.21.15.99:0/201272953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc40b3b10 con 0x7f6dc40d0490 2024-03-30T13:12:40.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.217+0000 7f6dbb400640 1 -- 172.21.15.99:0/201272953 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6dac0079d0 con 0x7f6dc40d0490 2024-03-30T13:12:40.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.218+0000 7f6dbb400640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6da006c530 0x7f6da006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.218+0000 7f6dccf8a740 1 Processor -- start 2024-03-30T13:12:40.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.218+0000 7f6dbb400640 1 -- 172.21.15.99:0/201272953 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f6dac08bbe0 con 0x7f6dc40d0490 2024-03-30T13:12:40.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.218+0000 7f6dc3400640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6da006c530 0x7f6da006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.218+0000 7f6dccf8a740 1 -- start start 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.219+0000 7f6dc3400640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6da006c530 0x7f6da006e9f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6db400a810 tx=0x7f6db4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.219+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5565671aa7d0 0x5565671a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.219+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aabb0 0x556567161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.219+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55656718a110 0x556567162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.219+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5565670c6350 con 0x55656718a110 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.219+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55656706e530 con 0x5565671aabb0 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.219+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5565670c2300 con 0x5565671aa7d0 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.219+0000 7f6dc3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55656718a110 0x556567162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.220+0000 7f6dc3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55656718a110 0x556567162340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52474/0 (socket says 172.21.15.99:52474) 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.220+0000 7f6dc3e00640 1 -- 172.21.15.99:0/2329934086 learned_addr learned my addr 172.21.15.99:0/2329934086 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.220+0000 7f6dc3400640 1 --2- 172.21.15.99:0/2329934086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5565671aa7d0 0x5565671a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.220+0000 7f6dbbe00640 1 --2- 172.21.15.99:0/2329934086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aabb0 0x556567161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.220+0000 7f6dc3e00640 1 -- 172.21.15.99:0/2329934086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5565671aa7d0 msgr2=0x5565671a8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.220+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/2329934086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5565671aa7d0 0x5565671a8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.220+0000 7f6dc3e00640 1 -- 172.21.15.99:0/2329934086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aabb0 msgr2=0x556567161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.220+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/2329934086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aabb0 0x556567161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.220+0000 7f6dc3e00640 1 -- 172.21.15.99:0/2329934086 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565670851d0 con 0x55656718a110 2024-03-30T13:12:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.220+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/2329934086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55656718a110 0x556567162340 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009f10 tx=0x7f6dbc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5eab7a0f1eb7b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6db3400640 1 -- 172.21.15.99:0/2329934086 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc009510 con 0x55656718a110 2024-03-30T13:12:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6db3400640 1 -- 172.21.15.99:0/2329934086 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc02c7e0 con 0x55656718a110 2024-03-30T13:12:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6db3400640 1 -- 172.21.15.99:0/2329934086 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc02c9f0 con 0x55656718a110 2024-03-30T13:12:40.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2329934086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55656718a110 msgr2=0x556567162340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/2329934086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55656718a110 0x556567162340 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009f10 tx=0x7f6dbc02e070 comp rx=0 tx=0).stop 2024-03-30T13:12:40.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2329934086 shutdown_connections 2024-03-30T13:12:40.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/2329934086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55656718a110 0x556567162340 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/2329934086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aabb0 0x556567161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/2329934086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5565671aa7d0 0x5565671a8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2329934086 >> 172.21.15.99:0/2329934086 conn(0x55656715ef60 msgr2=0x5565671a7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2329934086 shutdown_connections 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.221+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2329934086 wait complete. 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.222+0000 7f6dccf8a740 1 -- start start 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.222+0000 7f6dccf8a740 1 Processor -- start 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.223+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 0x556567183a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.223+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5565671aabb0 0x556567180c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.223+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556567187a50 0x556567187ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.223+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55656715d590 con 0x556567187a50 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.223+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5565670818f0 con 0x5565671aa7d0 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.223+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x556567161390 con 0x5565671aabb0 2024-03-30T13:12:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.223+0000 7f6dccf8a740 10 client.0 _ll_register_callbacks cb 0x5565670860c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dc3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556567187a50 0x556567187ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dc3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556567187a50 0x556567187ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52490/0 (socket says 172.21.15.99:52490) 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dc3e00640 1 -- 172.21.15.99:0/2553716763 learned_addr learned my addr 172.21.15.99:0/2553716763 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dbbe00640 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5565671aabb0 0x556567180c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dc3400640 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 0x556567183a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dc3e00640 1 -- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5565671aabb0 msgr2=0x556567180c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5565671aabb0 0x556567180c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dc3e00640 1 -- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 msgr2=0x556567183a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 0x556567183a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dc3e00640 1 -- 172.21.15.99:0/2553716763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556566ea67b0 con 0x556567187a50 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dbbe00640 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5565671aabb0 0x556567180c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dc3400640 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 0x556567183a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556567187a50 0x556567187ed0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55656715fef0 tx=0x7f6dbc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adb8f24fdb8a314 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.224+0000 7f6da7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:12:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6da7e00640 1 -- 172.21.15.99:0/2553716763 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc04e030 con 0x556567187a50 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6da7e00640 1 -- 172.21.15.99:0/2553716763 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f6dbc044050 con 0x556567187a50 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2553716763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dbc02c7e0 con 0x556567187a50 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6da7e00640 1 -- 172.21.15.99:0/2553716763 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6dbc057050 con 0x556567187a50 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6dccf8a740 10 client.5361 fetch_fsmap learned FSMap version 19 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2553716763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556566f06f40 con 0x556567187a50 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6da7e00640 1 -- 172.21.15.99:0/2553716763 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc02c7e0 con 0x556567187a50 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6da7e00640 1 -- 172.21.15.99:0/2553716763 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f6dbc05a020 con 0x556567187a50 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6dccf8a740 10 client.5361 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6dccf8a740 10 client.5361 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6dccf8a740 20 client.5361 populate_metadata read hostname 'smithi099' 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5565671800e0 0x5565671c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6dccf8a740 4 client.5361 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.225+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2553716763 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565670d3890 con 0x5565671800e0 2024-03-30T13:12:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.226+0000 7f6dc3400640 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5565671800e0 0x5565671c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.227+0000 7f6da7e00640 10 client.5361 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.227+0000 7f6dc3400640 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5565671800e0 0x5565671c9230 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=710b2586616e6894 server_cookie=3398ae5c8b5c7476 in_seq=0 out_seq=0 2024-03-30T13:12:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.230+0000 7f6da7e00640 1 -- 172.21.15.99:0/2553716763 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5565670d3890 con 0x5565671800e0 2024-03-30T13:12:40.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.230+0000 7f6da7e00640 10 client.5361 handle_command_reply: tid=0 2024-03-30T13:12:40.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.230+0000 7f6dccf8a740 1 client.5361 shutdown 2024-03-30T13:12:40.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2553716763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556567187a50 msgr2=0x556567187ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556567187a50 0x556567187ed0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55656715fef0 tx=0x7f6dbc004ab0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2553716763 shutdown_connections 2024-03-30T13:12:40.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556567187a50 0x556567187ed0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5565671aabb0 0x556567180c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5565671800e0 0x5565671c9230 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/2553716763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 0x556567183a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6da7e00640 0 client.5361 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:40.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2553716763 >> 172.21.15.99:0/2553716763 conn(0x55656718a110 msgr2=0x5565671a9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2553716763 shutdown_connections 2024-03-30T13:12:40.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6dccf8a740 1 -- 172.21.15.99:0/2553716763 wait complete. 2024-03-30T13:12:40.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.231+0000 7f6dccf8a740 20 client.5361 trim_cache size 0 max 16384 2024-03-30T13:12:40.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.251+0000 7f6dccf8a740 1 Processor -- start 2024-03-30T13:12:40.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.251+0000 7f6dccf8a740 1 -- start start 2024-03-30T13:12:40.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.251+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556567187a50 0x556567158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.251+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 0x5565671a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.251+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.251+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc41fc930 con 0x5565671aabb0 2024-03-30T13:12:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.251+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc4072e20 con 0x5565671aa7d0 2024-03-30T13:12:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.251+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc4148c00 con 0x556567187a50 2024-03-30T13:12:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.252+0000 7f6dc3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.252+0000 7f6dc3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52496/0 (socket says 172.21.15.99:52496) 2024-03-30T13:12:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.252+0000 7f6dc3e00640 1 -- 172.21.15.99:0/3176237886 learned_addr learned my addr 172.21.15.99:0/3176237886 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.252+0000 7f6dc3e00640 1 -- 172.21.15.99:0/3176237886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556567187a50 msgr2=0x556567158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.252+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/3176237886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556567187a50 0x556567158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.252+0000 7f6dc3e00640 1 -- 172.21.15.99:0/3176237886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 msgr2=0x5565671a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.252+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/3176237886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 0x5565671a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.252+0000 7f6dc3e00640 1 -- 172.21.15.99:0/3176237886 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556566d9a0a0 con 0x5565671aabb0 2024-03-30T13:12:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.252+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/3176237886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a9e30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00c030 tx=0x7f6dbc047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bd16014ced9368 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6db2a00640 1 -- 172.21.15.99:0/3176237886 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc02c7e0 con 0x5565671aabb0 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6db2a00640 1 -- 172.21.15.99:0/3176237886 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc02c980 con 0x5565671aabb0 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6db2a00640 1 -- 172.21.15.99:0/3176237886 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc02cb30 con 0x5565671aabb0 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6dccf8a740 1 -- 172.21.15.99:0/3176237886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 msgr2=0x5565671a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/3176237886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a9e30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00c030 tx=0x7f6dbc047000 comp rx=0 tx=0).stop 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6dccf8a740 1 -- 172.21.15.99:0/3176237886 shutdown_connections 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/3176237886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a9e30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/3176237886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 0x5565671a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/3176237886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556567187a50 0x556567158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6dccf8a740 1 -- 172.21.15.99:0/3176237886 >> 172.21.15.99:0/3176237886 conn(0x55656718a110 msgr2=0x556567183890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6dccf8a740 1 -- 172.21.15.99:0/3176237886 shutdown_connections 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.253+0000 7f6dccf8a740 1 -- 172.21.15.99:0/3176237886 wait complete. 2024-03-30T13:12:40.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.254+0000 7f6dccf8a740 1 -- start start 2024-03-30T13:12:40.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.254+0000 7f6dccf8a740 1 Processor -- start 2024-03-30T13:12:40.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.255+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556567187a50 0x5565671be110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.255+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 0x5565671ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.255+0000 7f6dccf8a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.255+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55656715ed00 con 0x5565671aabb0 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.255+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc414e150 con 0x5565671aa7d0 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.255+0000 7f6dccf8a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x556567187e30 con 0x556567187a50 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.255+0000 7f6dccf8a740 10 client.0 _ll_register_callbacks cb 0x7f6dbc009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.255+0000 7f6dc3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6dc3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52500/0 (socket says 172.21.15.99:52500) 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6dc3e00640 1 -- 172.21.15.99:0/1423884741 learned_addr learned my addr 172.21.15.99:0/1423884741 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6dc3e00640 1 -- 172.21.15.99:0/1423884741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556567187a50 msgr2=0x5565671be110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/1423884741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556567187a50 0x5565671be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6dc3e00640 1 -- 172.21.15.99:0/1423884741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 msgr2=0x5565671ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/1423884741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 0x5565671ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6dc3e00640 1 -- 172.21.15.99:0/1423884741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565671beff0 con 0x5565671aabb0 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6dc3e00640 1 --2- 172.21.15.99:0/1423884741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a58a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009be0 tx=0x7f6dbc03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3989b79a1e6993 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6da7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6da7e00640 1 -- 172.21.15.99:0/1423884741 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc04e040 con 0x5565671aabb0 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6da7e00640 1 -- 172.21.15.99:0/1423884741 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f6dbc040b30 con 0x5565671aabb0 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6dccf8a740 1 -- 172.21.15.99:0/1423884741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dbc02c980 con 0x5565671aabb0 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6da7e00640 1 -- 172.21.15.99:0/1423884741 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6dbc02c7e0 con 0x5565671aabb0 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.256+0000 7f6dccf8a740 10 client.5367 fetch_fsmap learned FSMap version 19 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.257+0000 7f6dccf8a740 1 -- 172.21.15.99:0/1423884741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5565671630f0 con 0x5565671aabb0 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.257+0000 7f6da7e00640 1 -- 172.21.15.99:0/1423884741 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc02c980 con 0x5565671aabb0 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.257+0000 7f6da7e00640 1 -- 172.21.15.99:0/1423884741 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f6dbc05a070 con 0x5565671aabb0 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.257+0000 7f6dccf8a740 10 client.5367 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.257+0000 7f6dccf8a740 10 client.5367 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:12:40.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.257+0000 7f6dccf8a740 20 client.5367 populate_metadata read hostname 'smithi099' 2024-03-30T13:12:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.257+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/1423884741 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556567181740 0x5565671a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.257+0000 7f6dccf8a740 4 client.5367 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-03-30T13:12:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.257+0000 7f6dccf8a740 1 -- 172.21.15.99:0/1423884741 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x55656715e2d0 con 0x556567181740 2024-03-30T13:12:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.258+0000 7f6dc3400640 1 --2- 172.21.15.99:0/1423884741 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556567181740 0x5565671a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.258+0000 7f6dc3400640 1 --2- 172.21.15.99:0/1423884741 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556567181740 0x5565671a5de0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da046fd7ca874c8f server_cookie=2d65abfca6669e5a in_seq=0 out_seq=0 2024-03-30T13:12:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.258+0000 7f6da7e00640 10 client.5367 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:40.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.261+0000 7f6da7e00640 1 -- 172.21.15.99:0/1423884741 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55656715e2d0 con 0x556567181740 2024-03-30T13:12:40.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.261+0000 7f6da7e00640 10 client.5367 handle_command_reply: tid=0 2024-03-30T13:12:40.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.261+0000 7f6dccf8a740 1 client.5367 shutdown 2024-03-30T13:12:40.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.261+0000 7f6dccf8a740 1 -- 172.21.15.99:0/1423884741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 msgr2=0x5565671a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.261+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/1423884741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a58a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009be0 tx=0x7f6dbc03f000 comp rx=0 tx=0).stop 2024-03-30T13:12:40.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dccf8a740 1 -- 172.21.15.99:0/1423884741 shutdown_connections 2024-03-30T13:12:40.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/1423884741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565671aabb0 0x5565671a58a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/1423884741 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556567181740 0x5565671a5de0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/1423884741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5565671aa7d0 0x5565671ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dccf8a740 1 --2- 172.21.15.99:0/1423884741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556567187a50 0x5565671be110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6da7e00640 0 client.5367 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:40.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dccf8a740 1 -- 172.21.15.99:0/1423884741 >> 172.21.15.99:0/1423884741 conn(0x55656718a110 msgr2=0x556567186dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dccf8a740 1 -- 172.21.15.99:0/1423884741 shutdown_connections 2024-03-30T13:12:40.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dccf8a740 1 -- 172.21.15.99:0/1423884741 wait complete. 2024-03-30T13:12:40.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dccf8a740 20 client.5367 trim_cache size 0 max 16384 2024-03-30T13:12:40.267 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:12:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-03-30T13:12:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "bb44bba3-62df-4f2b-ba9b-e831e668d773", 2024-03-30T13:12:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-03-30T13:12:40.268 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dca200640 1 -- 172.21.15.99:0/201272953 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6da006c530 msgr2=0x7f6da006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dca200640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6da006c530 0x7f6da006e9f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6db400a810 tx=0x7f6db4008040 comp rx=0 tx=0).stop 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dca200640 1 -- 172.21.15.99:0/201272953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc40d0490 msgr2=0x7f6dc41539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.262+0000 7f6dca200640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc40d0490 0x7f6dc41539f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00c7f0 tx=0x7f6dac00ccb0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.263+0000 7f6dca200640 1 -- 172.21.15.99:0/201272953 shutdown_connections 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.263+0000 7f6dca200640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6da006c530 0x7f6da006e9f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.263+0000 7f6dca200640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dc4156ba0 0x7f6dc414b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.263+0000 7f6dca200640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc40d0490 0x7f6dc41539f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.263+0000 7f6dca200640 1 --2- 172.21.15.99:0/201272953 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6dc406d860 0x7f6dc40b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.263+0000 7f6dca200640 1 -- 172.21.15.99:0/201272953 >> 172.21.15.99:0/201272953 conn(0x7f6dc406b6f0 msgr2=0x7f6dc40afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.263+0000 7f6dca200640 1 -- 172.21.15.99:0/201272953 shutdown_connections 2024-03-30T13:12:40.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.263+0000 7f6dca200640 1 -- 172.21.15.99:0/201272953 wait complete. 2024-03-30T13:12:40.283 DEBUG:tasks.cephfs.test_uninlining:scrub start response: {'return_code': 0, 'scrub_tag': 'bb44bba3-62df-4f2b-ba9b-e831e668d773', 'mode': 'asynchronous'} 2024-03-30T13:12:40.283 DEBUG:tasks.cephfs.test_uninlining:waiting for scrub to complete 2024-03-30T13:12:40.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:40.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:12:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.505+0000 7fc2cac00640 1 Processor -- start 2024-03-30T13:12:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.505+0000 7fc2cac00640 1 -- start start 2024-03-30T13:12:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.506+0000 7fc2cac00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2c4160340 0x7fc2c40cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.506+0000 7fc2cac00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2c40cd5b0 0x7fc2c40cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.506+0000 7fc2cac00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2c4160820 con 0x7fc2c415c730 2024-03-30T13:12:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.506+0000 7fc2cac00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc2c4160b00 con 0x7fc2c4160340 2024-03-30T13:12:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.506+0000 7fc2cac00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc2c4160de0 con 0x7fc2c40cd5b0 2024-03-30T13:12:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.507+0000 7fc2c3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2c4160340 0x7fc2c40cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.507+0000 7fc2c3e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc2c415c730 0x7fc2c40cef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:47394/0 (socket says 172.21.15.99:47394) 2024-03-30T13:12:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.507+0000 7fc2c3e00640 1 -- 172.21.15.99:0/1521229933 learned_addr learned my addr 172.21.15.99:0/1521229933 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:12:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.507+0000 7fc2c8c00640 1 --2- 172.21.15.99:0/1521229933 >> v2:172.21.15.181:3300/0 conn(0x7fc2c40cd5b0 0x7fc2c40cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.507+0000 7fc2c3400640 1 -- 172.21.15.99:0/1521229933 >> v2:172.21.15.181:3300/0 conn(0x7fc2c40cd5b0 msgr2=0x7fc2c40cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.507+0000 7fc2c3400640 1 --2- 172.21.15.99:0/1521229933 >> v2:172.21.15.181:3300/0 conn(0x7fc2c40cd5b0 0x7fc2c40cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.507+0000 7fc2c3400640 1 -- 172.21.15.99:0/1521229933 >> v1:172.21.15.181:6789/0 conn(0x7fc2c415c730 legacy=0x7fc2c40cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.507+0000 7fc2c3400640 1 -- 172.21.15.99:0/1521229933 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c41610c0 con 0x7fc2c4160340 2024-03-30T13:12:40.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.507+0000 7fc2c2a00640 1 -- 172.21.15.99:0/1521229933 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507801976 0 0) 0x7fc2c4160820 con 0x7fc2c415c730 2024-03-30T13:12:40.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.508+0000 7fc2c3400640 1 --2- 172.21.15.99:0/1521229933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c4160340 0x7fc2c40cf660 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40b72b0 tx=0x7fc2b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724f8000397cff25 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.509+0000 7fc2c2a00640 1 -- 172.21.15.99:0/1521229933 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00315a0 con 0x7fc2c4160340 2024-03-30T13:12:40.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.509+0000 7fc2c2a00640 1 -- 172.21.15.99:0/1521229933 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b0037070 con 0x7fc2c4160340 2024-03-30T13:12:40.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.509+0000 7fc2c2a00640 1 -- 172.21.15.99:0/1521229933 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0031960 con 0x7fc2c4160340 2024-03-30T13:12:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.510+0000 7fc2cac00640 1 -- 172.21.15.99:0/1521229933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c4160340 msgr2=0x7fc2c40cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.510+0000 7fc2cac00640 1 --2- 172.21.15.99:0/1521229933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c4160340 0x7fc2c40cf660 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40b72b0 tx=0x7fc2b002b840 comp rx=0 tx=0).stop 2024-03-30T13:12:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.510+0000 7fc2cac00640 1 -- 172.21.15.99:0/1521229933 shutdown_connections 2024-03-30T13:12:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.510+0000 7fc2cac00640 1 --2- 172.21.15.99:0/1521229933 >> v2:172.21.15.181:3300/0 conn(0x7fc2c40cd5b0 0x7fc2c40cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.510+0000 7fc2cac00640 1 --2- 172.21.15.99:0/1521229933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c4160340 0x7fc2c40cf660 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.510+0000 7fc2cac00640 1 -- 172.21.15.99:0/1521229933 >> 172.21.15.99:0/1521229933 conn(0x7fc2c40b2ed0 msgr2=0x7fc2c40b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.510+0000 7fc2cac00640 1 -- 172.21.15.99:0/1521229933 shutdown_connections 2024-03-30T13:12:40.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.510+0000 7fc2cac00640 1 -- 172.21.15.99:0/1521229933 wait complete. 2024-03-30T13:12:40.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.512+0000 7fc2cac00640 1 Processor -- start 2024-03-30T13:12:40.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.512+0000 7fc2cac00640 1 -- start start 2024-03-30T13:12:40.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.513+0000 7fc2cac00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2c40cd5b0 0x7fc2c41f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.513+0000 7fc2cac00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c415c730 0x7fc2c40b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.513+0000 7fc2cac00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c4160340 0x7fc2c40b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.513+0000 7fc2cac00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c40d0390 con 0x7fc2c415c730 2024-03-30T13:12:40.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.513+0000 7fc2cac00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c40cd020 con 0x7fc2c4160340 2024-03-30T13:12:40.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.513+0000 7fc2cac00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c40d0510 con 0x7fc2c40cd5b0 2024-03-30T13:12:40.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c415c730 0x7fc2c40b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c8c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c4160340 0x7fc2c40b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c3e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2c40cd5b0 0x7fc2c41f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c8c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c4160340 0x7fc2c40b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41770/0 (socket says 172.21.15.99:41770) 2024-03-30T13:12:40.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c8c00640 1 -- 172.21.15.99:0/3939182133 learned_addr learned my addr 172.21.15.99:0/3939182133 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:40.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c3e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2c40cd5b0 0x7fc2c41f7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:43146/0 (socket says 172.21.15.99:43146) 2024-03-30T13:12:40.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c415c730 0x7fc2c40b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52520/0 (socket says 172.21.15.99:52520) 2024-03-30T13:12:40.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c3400640 1 -- 172.21.15.99:0/3939182133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2c40cd5b0 msgr2=0x7fc2c41f7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c3400640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2c40cd5b0 0x7fc2c41f7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c3400640 1 -- 172.21.15.99:0/3939182133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c4160340 msgr2=0x7fc2c40b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c3400640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c4160340 0x7fc2c40b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c3400640 1 -- 172.21.15.99:0/3939182133 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c40b62e0 con 0x7fc2c415c730 2024-03-30T13:12:40.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.514+0000 7fc2c8c00640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c4160340 0x7fc2c40b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:40.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.515+0000 7fc2c3400640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c415c730 0x7fc2c40b3ec0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0033000 tx=0x7fc2b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.515+0000 7fc2bbe00640 1 -- 172.21.15.99:0/3939182133 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0032630 con 0x7fc2c415c730 2024-03-30T13:12:40.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.515+0000 7fc2bbe00640 1 -- 172.21.15.99:0/3939182133 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b00327d0 con 0x7fc2c415c730 2024-03-30T13:12:40.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.515+0000 7fc2bbe00640 1 -- 172.21.15.99:0/3939182133 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0032ba0 con 0x7fc2c415c730 2024-03-30T13:12:40.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.515+0000 7fc2cac00640 1 -- 172.21.15.99:0/3939182133 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c40c68b0 con 0x7fc2c415c730 2024-03-30T13:12:40.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.516+0000 7fc2cac00640 1 -- 172.21.15.99:0/3939182133 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c40c6e70 con 0x7fc2c415c730 2024-03-30T13:12:40.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.519+0000 7fc2bbe00640 1 -- 172.21.15.99:0/3939182133 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc2b003b3f0 con 0x7fc2c415c730 2024-03-30T13:12:40.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.520+0000 7fc2bbe00640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc2a406c530 0x7fc2a406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.520+0000 7fc2bbe00640 1 -- 172.21.15.99:0/3939182133 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc2b002f030 con 0x7fc2c415c730 2024-03-30T13:12:40.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.520+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc2a406c530 0x7fc2a406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.520+0000 7fc2cd817740 1 Processor -- start 2024-03-30T13:12:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.521+0000 7fc2cd817740 1 -- start start 2024-03-30T13:12:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.521+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc2a406c530 0x7fc2a406e9f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4007fd0 tx=0x7fc2b4007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac5c0 0x555aa8d7f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac9a0 0x555aa8daf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8d7faa0 0x555aa8daf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2cd817740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555aa8cea6d0 con 0x555aa8d7faa0 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2cd817740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555aa8c92770 con 0x555aa8dac5c0 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2cd817740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555aa8ce6680 con 0x555aa8dac9a0 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2c8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8d7faa0 0x555aa8daf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2c8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8d7faa0 0x555aa8daf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52528/0 (socket says 172.21.15.99:52528) 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2c8c00640 1 -- 172.21.15.99:0/988044458 learned_addr learned my addr 172.21.15.99:0/988044458 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/988044458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac5c0 0x555aa8d7f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2c3400640 1 --2- 172.21.15.99:0/988044458 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac9a0 0x555aa8daf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2c8c00640 1 -- 172.21.15.99:0/988044458 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac9a0 msgr2=0x555aa8daf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2c8c00640 1 --2- 172.21.15.99:0/988044458 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac9a0 0x555aa8daf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2c8c00640 1 -- 172.21.15.99:0/988044458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac5c0 msgr2=0x555aa8d7f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2c8c00640 1 --2- 172.21.15.99:0/988044458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac5c0 0x555aa8d7f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.522+0000 7fc2c8c00640 1 -- 172.21.15.99:0/988044458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa8ac87d0 con 0x555aa8d7faa0 2024-03-30T13:12:40.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.523+0000 7fc2c8c00640 1 --2- 172.21.15.99:0/988044458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8d7faa0 0x555aa8daf890 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00e840 tx=0x7fc2bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e736217b8c871e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.523+0000 7fc2afe00640 1 -- 172.21.15.99:0/988044458 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc01b020 con 0x555aa8d7faa0 2024-03-30T13:12:40.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.523+0000 7fc2afe00640 1 -- 172.21.15.99:0/988044458 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2bc007c40 con 0x555aa8d7faa0 2024-03-30T13:12:40.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.523+0000 7fc2afe00640 1 -- 172.21.15.99:0/988044458 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00ee80 con 0x555aa8d7faa0 2024-03-30T13:12:40.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.524+0000 7fc2cd817740 1 -- 172.21.15.99:0/988044458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8d7faa0 msgr2=0x555aa8daf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.524+0000 7fc2cd817740 1 --2- 172.21.15.99:0/988044458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8d7faa0 0x555aa8daf890 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00e840 tx=0x7fc2bc009750 comp rx=0 tx=0).stop 2024-03-30T13:12:40.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.524+0000 7fc2cd817740 1 -- 172.21.15.99:0/988044458 shutdown_connections 2024-03-30T13:12:40.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.524+0000 7fc2cd817740 1 --2- 172.21.15.99:0/988044458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8d7faa0 0x555aa8daf890 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.524+0000 7fc2cd817740 1 --2- 172.21.15.99:0/988044458 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac9a0 0x555aa8daf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.524+0000 7fc2cd817740 1 --2- 172.21.15.99:0/988044458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac5c0 0x555aa8d7f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.524+0000 7fc2cd817740 1 -- 172.21.15.99:0/988044458 >> 172.21.15.99:0/988044458 conn(0x555aa8d817d0 msgr2=0x555aa8dca350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.525+0000 7fc2cd817740 1 -- 172.21.15.99:0/988044458 shutdown_connections 2024-03-30T13:12:40.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.525+0000 7fc2cd817740 1 -- 172.21.15.99:0/988044458 wait complete. 2024-03-30T13:12:40.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.526+0000 7fc2cd817740 1 -- start start 2024-03-30T13:12:40.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.526+0000 7fc2cd817740 1 Processor -- start 2024-03-30T13:12:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.527+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8dac5c0 0x555aa8d9f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.527+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac9a0 0x555aa8db4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.527+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8db5d40 0x555aa8db61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.527+0000 7fc2cd817740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555aa8d83e70 con 0x555aa8dac5c0 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.527+0000 7fc2cd817740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555aa8ca5aa0 con 0x555aa8db5d40 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.527+0000 7fc2cd817740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555aa8d866b0 con 0x555aa8dac9a0 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.527+0000 7fc2cd817740 10 client.0 _ll_register_callbacks cb 0x555aa8ca5490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8dac5c0 0x555aa8d9f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8dac5c0 0x555aa8d9f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52540/0 (socket says 172.21.15.99:52540) 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c3e00640 1 -- 172.21.15.99:0/3690339919 learned_addr learned my addr 172.21.15.99:0/3690339919 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c8c00640 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8db5d40 0x555aa8db61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c3400640 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac9a0 0x555aa8db4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c3e00640 1 -- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac9a0 msgr2=0x555aa8db4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac9a0 0x555aa8db4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c3e00640 1 -- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8db5d40 msgr2=0x555aa8db61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8db5d40 0x555aa8db61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c3e00640 1 -- 172.21.15.99:0/3690339919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aa89fe3f0 con 0x555aa8dac5c0 2024-03-30T13:12:40.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c3400640 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac9a0 0x555aa8db4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:40.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8dac5c0 0x555aa8d9f870 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40136d0 tx=0x7fc2b4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0ebe53e7a9c7c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.528+0000 7fc2acc00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:12:40.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.529+0000 7fc2acc00640 1 -- 172.21.15.99:0/3690339919 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4020700 con 0x555aa8dac5c0 2024-03-30T13:12:40.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.529+0000 7fc2acc00640 1 -- 172.21.15.99:0/3690339919 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc2b40208a0 con 0x555aa8dac5c0 2024-03-30T13:12:40.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.529+0000 7fc2cd817740 1 -- 172.21.15.99:0/3690339919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2bc007c40 con 0x555aa8dac5c0 2024-03-30T13:12:40.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.529+0000 7fc2acc00640 1 -- 172.21.15.99:0/3690339919 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc2b4020aa0 con 0x555aa8dac5c0 2024-03-30T13:12:40.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.529+0000 7fc2cd817740 10 client.5379 fetch_fsmap learned FSMap version 19 2024-03-30T13:12:40.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.529+0000 7fc2cd817740 1 -- 172.21.15.99:0/3690339919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x555aa89be0f0 con 0x555aa8dac5c0 2024-03-30T13:12:40.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.530+0000 7fc2acc00640 1 -- 172.21.15.99:0/3690339919 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2bc007c40 con 0x555aa8dac5c0 2024-03-30T13:12:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.530+0000 7fc2acc00640 1 -- 172.21.15.99:0/3690339919 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc2b4020c40 con 0x555aa8dac5c0 2024-03-30T13:12:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.530+0000 7fc2cd817740 10 client.5379 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:12:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.530+0000 7fc2cd817740 10 client.5379 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:12:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.530+0000 7fc2cd817740 20 client.5379 populate_metadata read hostname 'smithi099' 2024-03-30T13:12:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.530+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555aa8ddab50 0x555aa8ddafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.530+0000 7fc2cd817740 4 client.5379 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:12:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.530+0000 7fc2cd817740 1 -- 172.21.15.99:0/3690339919 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555aa8cf7c10 con 0x555aa8ddab50 2024-03-30T13:12:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.530+0000 7fc2c3400640 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555aa8ddab50 0x555aa8ddafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.531+0000 7fc2c3400640 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555aa8ddab50 0x555aa8ddafa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee38136d8e2a6ca4 server_cookie=4b5762bffecc1f61 in_seq=0 out_seq=0 2024-03-30T13:12:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.531+0000 7fc2acc00640 10 client.5379 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:40.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.531+0000 7fc2acc00640 1 -- 172.21.15.99:0/3690339919 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x555aa8cf7c10 con 0x555aa8ddab50 2024-03-30T13:12:40.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.531+0000 7fc2acc00640 10 client.5379 handle_command_reply: tid=0 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 1 client.5379 shutdown 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 1 -- 172.21.15.99:0/3690339919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8dac5c0 msgr2=0x555aa8d9f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8dac5c0 0x555aa8d9f870 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40136d0 tx=0x7fc2b4000ed0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 1 -- 172.21.15.99:0/3690339919 shutdown_connections 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555aa8ddab50 0x555aa8ddafa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8db5d40 0x555aa8db61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac9a0 0x555aa8db4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2acc00640 0 client.5379 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3690339919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8dac5c0 0x555aa8d9f870 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 1 -- 172.21.15.99:0/3690339919 >> 172.21.15.99:0/3690339919 conn(0x555aa8d7faa0 msgr2=0x555aa8d83470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 1 -- 172.21.15.99:0/3690339919 shutdown_connections 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 1 -- 172.21.15.99:0/3690339919 wait complete. 2024-03-30T13:12:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.532+0000 7fc2cd817740 20 client.5379 trim_cache size 0 max 16384 2024-03-30T13:12:40.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.552+0000 7fc2cd817740 1 Processor -- start 2024-03-30T13:12:40.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.552+0000 7fc2cd817740 1 -- start start 2024-03-30T13:12:40.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac5c0 0x555aa8d832b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac9a0 0x555aa8daee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2cd817740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c4200d60 con 0x555aa8db5d40 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2cd817740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c41ffd60 con 0x555aa8dac9a0 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2cd817740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c41ff0f0 con 0x555aa8dac5c0 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2c8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2c3e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac5c0 0x555aa8d832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2c8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52554/0 (socket says 172.21.15.99:52554) 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2c8c00640 1 -- 172.21.15.99:0/367451617 learned_addr learned my addr 172.21.15.99:0/367451617 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2c3400640 1 --2- 172.21.15.99:0/367451617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac9a0 0x555aa8daee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2c3e00640 1 -- 172.21.15.99:0/367451617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac9a0 msgr2=0x555aa8daee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/367451617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac9a0 0x555aa8daee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2c3e00640 1 -- 172.21.15.99:0/367451617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 msgr2=0x555aa8daf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/367451617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.553+0000 7fc2c3e00640 1 -- 172.21.15.99:0/367451617 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa8cc8500 con 0x555aa8dac5c0 2024-03-30T13:12:40.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.554+0000 7fc2c3400640 1 --2- 172.21.15.99:0/367451617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac9a0 0x555aa8daee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.554+0000 7fc2c8c00640 1 --2- 172.21.15.99:0/367451617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.554+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/367451617 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac5c0 0x555aa8d832b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4001650 tx=0x7fc2b4021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81ea484170b47697 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.554+0000 7fc2af400640 1 -- 172.21.15.99:0/367451617 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4020c40 con 0x555aa8dac5c0 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.554+0000 7fc2af400640 1 -- 172.21.15.99:0/367451617 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b4026070 con 0x555aa8dac5c0 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.554+0000 7fc2af400640 1 -- 172.21.15.99:0/367451617 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4020de0 con 0x555aa8dac5c0 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.555+0000 7fc2cd817740 1 -- 172.21.15.99:0/367451617 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac5c0 msgr2=0x555aa8d832b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.555+0000 7fc2cd817740 1 --2- 172.21.15.99:0/367451617 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac5c0 0x555aa8d832b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4001650 tx=0x7fc2b4021000 comp rx=0 tx=0).stop 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.555+0000 7fc2cd817740 1 -- 172.21.15.99:0/367451617 shutdown_connections 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.555+0000 7fc2cd817740 1 --2- 172.21.15.99:0/367451617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.555+0000 7fc2cd817740 1 --2- 172.21.15.99:0/367451617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac9a0 0x555aa8daee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.555+0000 7fc2cd817740 1 --2- 172.21.15.99:0/367451617 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac5c0 0x555aa8d832b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.555+0000 7fc2cd817740 1 -- 172.21.15.99:0/367451617 >> 172.21.15.99:0/367451617 conn(0x555aa8d7faa0 msgr2=0x555aa8dee290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.555+0000 7fc2cd817740 1 -- 172.21.15.99:0/367451617 shutdown_connections 2024-03-30T13:12:40.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.555+0000 7fc2cd817740 1 -- 172.21.15.99:0/367451617 wait complete. 2024-03-30T13:12:40.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.556+0000 7fc2cd817740 1 -- start start 2024-03-30T13:12:40.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.556+0000 7fc2cd817740 1 Processor -- start 2024-03-30T13:12:40.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac5c0 0x555aa8dedc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac9a0 0x555aa8daf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2cd817740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2cd817740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c41ff710 con 0x555aa8db5d40 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2cd817740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555aa8dda4e0 con 0x555aa8dac9a0 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2cd817740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555aa8e46710 con 0x555aa8dac5c0 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2cd817740 10 client.0 _ll_register_callbacks cb 0x7fc2b4004e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2c8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2c8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52556/0 (socket says 172.21.15.99:52556) 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2c8c00640 1 -- 172.21.15.99:0/3551772716 learned_addr learned my addr 172.21.15.99:0/3551772716 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac5c0 0x555aa8dedc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.557+0000 7fc2c3400640 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac9a0 0x555aa8daf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2c8c00640 1 -- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac5c0 msgr2=0x555aa8dedc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2c8c00640 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac5c0 0x555aa8dedc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2c8c00640 1 -- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac9a0 msgr2=0x555aa8daf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2c8c00640 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac9a0 0x555aa8daf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2c8c00640 1 -- 172.21.15.99:0/3551772716 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aa8dafb90 con 0x555aa8db5d40 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2c8c00640 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daaae0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc003bc0 tx=0x7fc2bc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcf116bffc5ab65 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2acc00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2acc00640 1 -- 172.21.15.99:0/3551772716 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc02e060 con 0x555aa8db5d40 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2cd817740 1 -- 172.21.15.99:0/3551772716 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b4026070 con 0x555aa8db5d40 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2acc00640 1 -- 172.21.15.99:0/3551772716 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc2bc017670 con 0x555aa8db5d40 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2acc00640 1 -- 172.21.15.99:0/3551772716 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc2bc034050 con 0x555aa8db5d40 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2cd817740 10 client.5385 fetch_fsmap learned FSMap version 19 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.558+0000 7fc2cd817740 1 -- 172.21.15.99:0/3551772716 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x555aa8daeeb0 con 0x555aa8db5d40 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.559+0000 7fc2acc00640 1 -- 172.21.15.99:0/3551772716 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b4026070 con 0x555aa8db5d40 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.559+0000 7fc2acc00640 1 -- 172.21.15.99:0/3551772716 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc2bc037020 con 0x555aa8db5d40 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.559+0000 7fc2cd817740 10 client.5385 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.559+0000 7fc2cd817740 10 client.5385 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:12:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.559+0000 7fc2cd817740 20 client.5385 populate_metadata read hostname 'smithi099' 2024-03-30T13:12:40.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.559+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555aa8dab020 0x555aa8e45720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.559+0000 7fc2cd817740 4 client.5385 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:12:40.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.559+0000 7fc2cd817740 1 -- 172.21.15.99:0/3551772716 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555aa8cf1f60 con 0x555aa8dab020 2024-03-30T13:12:40.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.559+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555aa8dab020 0x555aa8e45720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.560+0000 7fc2c3e00640 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555aa8dab020 0x555aa8e45720 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3767c4a61dc8040 server_cookie=e508b529293c15eb in_seq=0 out_seq=0 2024-03-30T13:12:40.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.560+0000 7fc2acc00640 10 client.5385 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:40.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.560+0000 7fc2acc00640 1 -- 172.21.15.99:0/3551772716 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+564 (crc 0 0 0) 0x555aa8cf1f60 con 0x555aa8dab020 2024-03-30T13:12:40.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.560+0000 7fc2acc00640 10 client.5385 handle_command_reply: tid=0 2024-03-30T13:12:40.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.560+0000 7fc2cd817740 1 client.5385 shutdown 2024-03-30T13:12:40.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.560+0000 7fc2cd817740 1 -- 172.21.15.99:0/3551772716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 msgr2=0x555aa8daaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.560+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daaae0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc003bc0 tx=0x7fc2bc004ab0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cd817740 1 -- 172.21.15.99:0/3551772716 shutdown_connections 2024-03-30T13:12:40.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555aa8db5d40 0x555aa8daaae0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555aa8dab020 0x555aa8e45720 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555aa8dac9a0 0x555aa8daf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cd817740 1 --2- 172.21.15.99:0/3551772716 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555aa8dac5c0 0x555aa8dedc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cd817740 1 -- 172.21.15.99:0/3551772716 >> 172.21.15.99:0/3551772716 conn(0x555aa8d7faa0 msgr2=0x555aa8d84e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2acc00640 0 client.5385 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:12:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cd817740 1 -- 172.21.15.99:0/3551772716 shutdown_connections 2024-03-30T13:12:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cd817740 1 -- 172.21.15.99:0/3551772716 wait complete. 2024-03-30T13:12:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cd817740 20 client.5385 trim_cache size 0 max 16384 2024-03-30T13:12:40.569 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:12:40.569 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: "bb44bba3-62df-4f2b-ba9b-e831e668d773": { 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "bb44bba3-62df-4f2b-ba9b-e831e668d773", 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive" 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_stats": { 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: "bb44bba3-62df-4f2b-ba9b-e831e668d773": { 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: "start_time": "2024-03-30T13:12:40.259378+0000", 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-30T13:12:40.570 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_started": 0, 2024-03-30T13:12:40.571 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_passed": 0, 2024-03-30T13:12:40.571 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_failed": 0, 2024-03-30T13:12:40.571 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_skipped": 0 2024-03-30T13:12:40.571 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:12:40.571 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:12:40.571 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:12:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cac00640 1 -- 172.21.15.99:0/3939182133 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc2a406c530 msgr2=0x7fc2a406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cac00640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc2a406c530 0x7fc2a406e9f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4007fd0 tx=0x7fc2b4007de0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cac00640 1 -- 172.21.15.99:0/3939182133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c415c730 msgr2=0x7fc2c40b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.561+0000 7fc2cac00640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c415c730 0x7fc2c40b3ec0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0033000 tx=0x7fc2b00046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.562+0000 7fc2cac00640 1 -- 172.21.15.99:0/3939182133 shutdown_connections 2024-03-30T13:12:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.562+0000 7fc2cac00640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc2a406c530 0x7fc2a406e9f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.562+0000 7fc2cac00640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c4160340 0x7fc2c40b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.562+0000 7fc2cac00640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c415c730 0x7fc2c40b3ec0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.562+0000 7fc2cac00640 1 --2- 172.21.15.99:0/3939182133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2c40cd5b0 0x7fc2c41f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.562+0000 7fc2cac00640 1 -- 172.21.15.99:0/3939182133 >> 172.21.15.99:0/3939182133 conn(0x7fc2c40b2ed0 msgr2=0x7fc2c40d1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.562+0000 7fc2cac00640 1 -- 172.21.15.99:0/3939182133 shutdown_connections 2024-03-30T13:12:40.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:12:40.562+0000 7fc2cac00640 1 -- 172.21.15.99:0/3939182133 wait complete. 2024-03-30T13:12:40.583 INFO:tasks.cephfs.filesystem:scrub status for tag:bb44bba3-62df-4f2b-ba9b-e831e668d773 - {'path': '/', 'tag': 'bb44bba3-62df-4f2b-ba9b-e831e668d773', 'options': 'recursive'} 2024-03-30T13:13:01.009 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:13:01.018 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:13:10.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:10.584 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:13:10.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.799+0000 7f80ba800640 1 Processor -- start 2024-03-30T13:13:10.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.800+0000 7f80ba800640 1 -- start start 2024-03-30T13:13:10.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.801+0000 7f80ba800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f80b406f2a0 0x7f80b406d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.801+0000 7f80ba800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b406def0 con 0x7f80b40d0b20 2024-03-30T13:13:10.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.801+0000 7f80ba800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b406e1d0 con 0x7f80b415e7c0 2024-03-30T13:13:10.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.801+0000 7f80ba800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f80b406e790 con 0x7f80b406f2a0 2024-03-30T13:13:10.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.801+0000 7f80abe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f80b40d0b20 0x7f80b40ad7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49246/0 (socket says 172.21.15.99:49246) 2024-03-30T13:13:10.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.801+0000 7f80abe00640 1 -- 172.21.15.99:0/2094724254 learned_addr learned my addr 172.21.15.99:0/2094724254 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:10.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770739964 0 0) 0x7f80b406def0 con 0x7f80b40d0b20 2024-03-30T13:13:10.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8098003520 con 0x7f80b40d0b20 2024-03-30T13:13:10.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b3e00640 1 --2- 172.21.15.99:0/2094724254 >> v2:172.21.15.181:3300/0 conn(0x7f80b406f2a0 0x7f80b406d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1674411639 0 0) 0x7f8098003520 con 0x7f80b40d0b20 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 >> v2:172.21.15.181:3300/0 conn(0x7f80b406f2a0 msgr2=0x7f80b406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 --2- 172.21.15.99:0/2094724254 >> v2:172.21.15.181:3300/0 conn(0x7f80b406f2a0 0x7f80b406d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 >> v1:172.21.15.181:6789/0 conn(0x7f80b415e7c0 legacy=0x7f80b40d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b406e4b0 con 0x7f80b40d0b20 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f809c001670 con 0x7f80b40d0b20 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 >> v1:172.21.15.99:6789/0 conn(0x7f80b40d0b20 legacy=0x7f80b40ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 --2- 172.21.15.99:0/2094724254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 0x7f8098003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 --2- 172.21.15.99:0/2094724254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8098004800 0x7f8098004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 --2- 172.21.15.99:0/2094724254 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80980052e0 0x7f809800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f80b406e790 con 0x7f8098003a00 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f809800c230 con 0x7f8098004800 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f809800c430 con 0x7f80980052e0 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.802+0000 7f80b3400640 1 --2- 172.21.15.99:0/2094724254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 0x7f8098003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.803+0000 7f80abe00640 1 --2- 172.21.15.99:0/2094724254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8098004800 0x7f8098004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.803+0000 7f80b3400640 1 -- 172.21.15.99:0/2094724254 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80980052e0 msgr2=0x7f809800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.803+0000 7f80b3400640 1 --2- 172.21.15.99:0/2094724254 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80980052e0 0x7f809800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.803+0000 7f80b3400640 1 -- 172.21.15.99:0/2094724254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8098004800 msgr2=0x7f8098004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.803+0000 7f80b3400640 1 --2- 172.21.15.99:0/2094724254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8098004800 0x7f8098004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.803+0000 7f80b3400640 1 -- 172.21.15.99:0/2094724254 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8098003520 con 0x7f8098003a00 2024-03-30T13:13:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.803+0000 7f80abe00640 1 --2- 172.21.15.99:0/2094724254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8098004800 0x7f8098004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.803+0000 7f80b3e00640 1 -- 172.21.15.99:0/2094724254 reap_dead start 2024-03-30T13:13:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.804+0000 7f80b3400640 1 --2- 172.21.15.99:0/2094724254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 0x7f8098003e40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f80a4001720 tx=0x7f8098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0dcf4521119ccb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.804+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4001370 con 0x7f8098003a00 2024-03-30T13:13:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.804+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a40052d0 con 0x7f8098003a00 2024-03-30T13:13:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.804+0000 7f80b2a00640 1 -- 172.21.15.99:0/2094724254 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4003830 con 0x7f8098003a00 2024-03-30T13:13:10.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.805+0000 7f80ba800640 1 -- 172.21.15.99:0/2094724254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 msgr2=0x7f8098003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.805+0000 7f80ba800640 1 --2- 172.21.15.99:0/2094724254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 0x7f8098003e40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f80a4001720 tx=0x7f8098005830 comp rx=0 tx=0).stop 2024-03-30T13:13:10.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.805+0000 7f80ba800640 1 -- 172.21.15.99:0/2094724254 shutdown_connections 2024-03-30T13:13:10.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.805+0000 7f80ba800640 1 --2- 172.21.15.99:0/2094724254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 0x7f8098003e40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.805+0000 7f80ba800640 1 -- 172.21.15.99:0/2094724254 >> 172.21.15.99:0/2094724254 conn(0x7f80b406b6f0 msgr2=0x7f80b406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:10.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.805+0000 7f80ba800640 1 -- 172.21.15.99:0/2094724254 shutdown_connections 2024-03-30T13:13:10.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.805+0000 7f80ba800640 1 -- 172.21.15.99:0/2094724254 wait complete. 2024-03-30T13:13:10.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.807+0000 7f80ba800640 1 Processor -- start 2024-03-30T13:13:10.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.807+0000 7f80ba800640 1 -- start start 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80ba800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 0x7f80b4161970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80ba800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80b415add0 0x7f80b41588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80ba800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80b415b7e0 0x7f80b415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80ba800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f80b415eba0 con 0x7f8098003a00 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80ba800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f80b40b5150 con 0x7f80b415b7e0 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80ba800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f80b406d880 con 0x7f80b415add0 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80b3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 0x7f80b4161970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80b3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 0x7f80b4161970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49310/0 (socket says 172.21.15.99:49310) 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80b3400640 1 -- 172.21.15.99:0/3310908848 learned_addr learned my addr 172.21.15.99:0/3310908848 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80b3400640 1 -- 172.21.15.99:0/3310908848 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80b415add0 msgr2=0x7f80b41588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80b3400640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80b415add0 0x7f80b41588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80b3400640 1 -- 172.21.15.99:0/3310908848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80b415b7e0 msgr2=0x7f80b415bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80b3400640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80b415b7e0 0x7f80b415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.808+0000 7f80b3400640 1 -- 172.21.15.99:0/3310908848 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b41591b0 con 0x7f8098003a00 2024-03-30T13:13:10.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.809+0000 7f80b3400640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 0x7f80b4161970 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f80a4005040 tx=0x7f80a4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.809+0000 7f80ab400640 1 -- 172.21.15.99:0/3310908848 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4041020 con 0x7f8098003a00 2024-03-30T13:13:10.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.809+0000 7f80ab400640 1 -- 172.21.15.99:0/3310908848 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a4005480 con 0x7f8098003a00 2024-03-30T13:13:10.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.809+0000 7f80ab400640 1 -- 172.21.15.99:0/3310908848 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4001370 con 0x7f8098003a00 2024-03-30T13:13:10.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.809+0000 7f80ba800640 1 -- 172.21.15.99:0/3310908848 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b41461d0 con 0x7f8098003a00 2024-03-30T13:13:10.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.809+0000 7f80ba800640 1 -- 172.21.15.99:0/3310908848 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b4146790 con 0x7f8098003a00 2024-03-30T13:13:10.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.811+0000 7f80ab400640 1 -- 172.21.15.99:0/3310908848 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f80a4044020 con 0x7f8098003a00 2024-03-30T13:13:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.812+0000 7f80ab400640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f809006c530 0x7f809006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.812+0000 7f80ab400640 1 -- 172.21.15.99:0/3310908848 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f80a40ad320 con 0x7f8098003a00 2024-03-30T13:13:10.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.812+0000 7f80abe00640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f809006c530 0x7f809006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.813+0000 7f80bd443740 1 Processor -- start 2024-03-30T13:13:10.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.813+0000 7f80bd443740 1 -- start start 2024-03-30T13:13:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.813+0000 7f80abe00640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f809006c530 0x7f809006e9f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f809c0017e0 tx=0x7f809c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.814+0000 7f80bd443740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52ca0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.814+0000 7f80bd443740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd9a0 0x559a52cd0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.814+0000 7f80bd443740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ca0aa0 0x559a52cd0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.814+0000 7f80bd443740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559a52c0b6d0 con 0x559a52ccd5c0 2024-03-30T13:13:10.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.814+0000 7f80bd443740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559a52bb3770 con 0x559a52ca0aa0 2024-03-30T13:13:10.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.814+0000 7f80bd443740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x559a52c07680 con 0x559a52ccd9a0 2024-03-30T13:13:10.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.814+0000 7f80b3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52ca0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.814+0000 7f80b3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52ca0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49324/0 (socket says 172.21.15.99:49324) 2024-03-30T13:13:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.814+0000 7f80b3400640 1 -- 172.21.15.99:0/2009200695 learned_addr learned my addr 172.21.15.99:0/2009200695 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.815+0000 7f80b3400640 1 -- 172.21.15.99:0/2009200695 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd9a0 msgr2=0x559a52cd0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.815+0000 7f80b3400640 1 --2- 172.21.15.99:0/2009200695 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd9a0 0x559a52cd0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.815+0000 7f80b3400640 1 -- 172.21.15.99:0/2009200695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ca0aa0 msgr2=0x559a52cd0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.815+0000 7f80b3400640 1 --2- 172.21.15.99:0/2009200695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ca0aa0 0x559a52cd0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.815+0000 7f80b3400640 1 -- 172.21.15.99:0/2009200695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a529e97d0 con 0x559a52ccd5c0 2024-03-30T13:13:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.815+0000 7f80b3400640 1 --2- 172.21.15.99:0/2009200695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52ca0560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f80a407b020 tx=0x7f80a407ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e297f03f40616e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.815+0000 7f80a3e00640 1 -- 172.21.15.99:0/2009200695 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a407f440 con 0x559a52ccd5c0 2024-03-30T13:13:10.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.815+0000 7f80a3e00640 1 -- 172.21.15.99:0/2009200695 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a4083d00 con 0x559a52ccd5c0 2024-03-30T13:13:10.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.815+0000 7f80a3e00640 1 -- 172.21.15.99:0/2009200695 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4006e10 con 0x559a52ccd5c0 2024-03-30T13:13:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.816+0000 7f80bd443740 1 -- 172.21.15.99:0/2009200695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 msgr2=0x559a52ca0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.816+0000 7f80bd443740 1 --2- 172.21.15.99:0/2009200695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52ca0560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f80a407b020 tx=0x7f80a407ad00 comp rx=0 tx=0).stop 2024-03-30T13:13:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.816+0000 7f80bd443740 1 -- 172.21.15.99:0/2009200695 shutdown_connections 2024-03-30T13:13:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.816+0000 7f80bd443740 1 --2- 172.21.15.99:0/2009200695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ca0aa0 0x559a52cd0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.816+0000 7f80bd443740 1 --2- 172.21.15.99:0/2009200695 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd9a0 0x559a52cd0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.816+0000 7f80bd443740 1 --2- 172.21.15.99:0/2009200695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52ca0560 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.816+0000 7f80bd443740 1 -- 172.21.15.99:0/2009200695 >> 172.21.15.99:0/2009200695 conn(0x559a52ca27d0 msgr2=0x559a52ceb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.816+0000 7f80bd443740 1 -- 172.21.15.99:0/2009200695 shutdown_connections 2024-03-30T13:13:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.816+0000 7f80bd443740 1 -- 172.21.15.99:0/2009200695 wait complete. 2024-03-30T13:13:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.817+0000 7f80bd443740 1 -- start start 2024-03-30T13:13:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.817+0000 7f80bd443740 1 Processor -- start 2024-03-30T13:13:10.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.818+0000 7f80bd443740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52cc1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.818+0000 7f80bd443740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd9a0 0x559a52cd2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.818+0000 7f80bd443740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52cd3490 0x559a52ce5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.818+0000 7f80bd443740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559a52bb3770 con 0x559a52ccd5c0 2024-03-30T13:13:10.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.818+0000 7f80bd443740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559a52bc6aa0 con 0x559a52cd3490 2024-03-30T13:13:10.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.818+0000 7f80bd443740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x559a52c0b6d0 con 0x559a52ccd9a0 2024-03-30T13:13:10.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.818+0000 7f80bd443740 10 client.0 _ll_register_callbacks cb 0x559a52bc6490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:10.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.818+0000 7f80b3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52cc1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.818+0000 7f80b3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52cc1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49334/0 (socket says 172.21.15.99:49334) 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.818+0000 7f80b3400640 1 -- 172.21.15.99:0/2503707921 learned_addr learned my addr 172.21.15.99:0/2503707921 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80b3400640 1 -- 172.21.15.99:0/2503707921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd9a0 msgr2=0x559a52cd2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80b3400640 1 --2- 172.21.15.99:0/2503707921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd9a0 0x559a52cd2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80b3400640 1 -- 172.21.15.99:0/2503707921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52cd3490 msgr2=0x559a52ce5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80b3400640 1 --2- 172.21.15.99:0/2503707921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52cd3490 0x559a52ce5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80b3400640 1 -- 172.21.15.99:0/2503707921 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a5291f3f0 con 0x559a52ccd5c0 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80b3400640 1 --2- 172.21.15.99:0/2503707921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52cc1b00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f80a40774f0 tx=0x7f80a4039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17b5009c79cb213 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80a0c00640 1 -- 172.21.15.99:0/2503707921 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4006e10 con 0x559a52ccd5c0 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80a0c00640 1 -- 172.21.15.99:0/2503707921 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f80a4079390 con 0x559a52ccd5c0 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80bd443740 1 -- 172.21.15.99:0/2503707921 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80a4083d00 con 0x559a52ccd5c0 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80a0c00640 1 -- 172.21.15.99:0/2503707921 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f80a40a1050 con 0x559a52ccd5c0 2024-03-30T13:13:10.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80bd443740 10 client.5397 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:10.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.819+0000 7f80bd443740 1 -- 172.21.15.99:0/2503707921 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x559a528df0f0 con 0x559a52ccd5c0 2024-03-30T13:13:10.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.820+0000 7f80a0c00640 1 -- 172.21.15.99:0/2503707921 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a4083d00 con 0x559a52ccd5c0 2024-03-30T13:13:10.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.820+0000 7f80a0c00640 1 -- 172.21.15.99:0/2503707921 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f80a40a4020 con 0x559a52ccd5c0 2024-03-30T13:13:10.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.820+0000 7f80bd443740 10 client.5397 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:10.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.820+0000 7f80bd443740 10 client.5397 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:10.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.820+0000 7f80bd443740 20 client.5397 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:10.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.820+0000 7f80bd443740 1 --2- 172.21.15.99:0/2503707921 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a52cfef10 0x559a52cff370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.820+0000 7f80bd443740 4 client.5397 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:10.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.820+0000 7f80bd443740 1 -- 172.21.15.99:0/2503707921 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a52c18c10 con 0x559a52cfef10 2024-03-30T13:13:10.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.821+0000 7f80abe00640 1 --2- 172.21.15.99:0/2503707921 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a52cfef10 0x559a52cff370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.821+0000 7f80abe00640 1 --2- 172.21.15.99:0/2503707921 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a52cfef10 0x559a52cff370 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab1926cf5424232d server_cookie=5f698206920a937e in_seq=0 out_seq=0 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.821+0000 7f80a0c00640 10 client.5397 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80a0c00640 1 -- 172.21.15.99:0/2503707921 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x559a52c18c10 con 0x559a52cfef10 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80a0c00640 10 client.5397 handle_command_reply: tid=0 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 1 client.5397 shutdown 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 1 -- 172.21.15.99:0/2503707921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 msgr2=0x559a52cc1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 1 --2- 172.21.15.99:0/2503707921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52cc1b00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f80a40774f0 tx=0x7f80a4039000 comp rx=0 tx=0).stop 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 1 -- 172.21.15.99:0/2503707921 shutdown_connections 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 1 --2- 172.21.15.99:0/2503707921 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a52cfef10 0x559a52cff370 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 1 --2- 172.21.15.99:0/2503707921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52cd3490 0x559a52ce5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 1 --2- 172.21.15.99:0/2503707921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd9a0 0x559a52cd2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 1 --2- 172.21.15.99:0/2503707921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd5c0 0x559a52cc1b00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80a0c00640 0 client.5397 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:10.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 1 -- 172.21.15.99:0/2503707921 >> 172.21.15.99:0/2503707921 conn(0x559a52ca0aa0 msgr2=0x559a52ca7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:10.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 1 -- 172.21.15.99:0/2503707921 shutdown_connections 2024-03-30T13:13:10.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 1 -- 172.21.15.99:0/2503707921 wait complete. 2024-03-30T13:13:10.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.824+0000 7f80bd443740 20 client.5397 trim_cache size 0 max 16384 2024-03-30T13:13:10.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.843+0000 7f80bd443740 1 Processor -- start 2024-03-30T13:13:10.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.843+0000 7f80bd443740 1 -- start start 2024-03-30T13:13:10.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.844+0000 7f80bd443740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd5c0 0x559a52ce2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.844+0000 7f80bd443740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ccd9a0 0x559a52ccfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.844+0000 7f80bd443740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52cd3490 0x559a52cd0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.844+0000 7f80bd443740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f80b42018b0 con 0x559a52cd3490 2024-03-30T13:13:10.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.844+0000 7f80bd443740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f80b42008f0 con 0x559a52ccd9a0 2024-03-30T13:13:10.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.844+0000 7f80bd443740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f80b415fa60 con 0x559a52ccd5c0 2024-03-30T13:13:10.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.845+0000 7f80b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52cd3490 0x559a52cd0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.845+0000 7f80b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52cd3490 0x559a52cd0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49336/0 (socket says 172.21.15.99:49336) 2024-03-30T13:13:10.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.845+0000 7f80b3e00640 1 -- 172.21.15.99:0/134530908 learned_addr learned my addr 172.21.15.99:0/134530908 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.845+0000 7f80abe00640 1 --2- 172.21.15.99:0/134530908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ccd9a0 0x559a52ccfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.845+0000 7f80b3400640 1 --2- 172.21.15.99:0/134530908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd5c0 0x559a52ce2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.845+0000 7f80b3e00640 1 -- 172.21.15.99:0/134530908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd5c0 msgr2=0x559a52ce2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.845+0000 7f80b3e00640 1 --2- 172.21.15.99:0/134530908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd5c0 0x559a52ce2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.845+0000 7f80b3e00640 1 -- 172.21.15.99:0/134530908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ccd9a0 msgr2=0x559a52ccfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.845+0000 7f80b3e00640 1 --2- 172.21.15.99:0/134530908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ccd9a0 0x559a52ccfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.845+0000 7f80b3e00640 1 -- 172.21.15.99:0/134530908 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a52be9500 con 0x559a52cd3490 2024-03-30T13:13:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.846+0000 7f80b3e00640 1 --2- 172.21.15.99:0/134530908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52cd3490 0x559a52cd0330 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f80b4162300 tx=0x7f80ac0075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3136dd8a4d3a9f51 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.846+0000 7f80a3400640 1 -- 172.21.15.99:0/134530908 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0133f0 con 0x559a52cd3490 2024-03-30T13:13:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.846+0000 7f80a3400640 1 -- 172.21.15.99:0/134530908 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ac018070 con 0x559a52cd3490 2024-03-30T13:13:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.846+0000 7f80a3400640 1 -- 172.21.15.99:0/134530908 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0137d0 con 0x559a52cd3490 2024-03-30T13:13:10.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.847+0000 7f80bd443740 1 -- 172.21.15.99:0/134530908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52cd3490 msgr2=0x559a52cd0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.847+0000 7f80bd443740 1 --2- 172.21.15.99:0/134530908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52cd3490 0x559a52cd0330 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f80b4162300 tx=0x7f80ac0075c0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.847+0000 7f80bd443740 1 -- 172.21.15.99:0/134530908 shutdown_connections 2024-03-30T13:13:10.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.847+0000 7f80bd443740 1 --2- 172.21.15.99:0/134530908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52cd3490 0x559a52cd0330 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.847+0000 7f80bd443740 1 --2- 172.21.15.99:0/134530908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ccd9a0 0x559a52ccfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.847+0000 7f80bd443740 1 --2- 172.21.15.99:0/134530908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52ccd5c0 0x559a52ce2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.847+0000 7f80bd443740 1 -- 172.21.15.99:0/134530908 >> 172.21.15.99:0/134530908 conn(0x559a52ca0aa0 msgr2=0x559a52c9bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:10.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.847+0000 7f80bd443740 1 -- 172.21.15.99:0/134530908 shutdown_connections 2024-03-30T13:13:10.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.847+0000 7f80bd443740 1 -- 172.21.15.99:0/134530908 wait complete. 2024-03-30T13:13:10.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.848+0000 7f80bd443740 1 -- start start 2024-03-30T13:13:10.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.848+0000 7f80bd443740 1 Processor -- start 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80bd443740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ccd5c0 0x559a52ce2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80bd443740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd9a0 0x559a52d4d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80bd443740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52cd3490 0x559a52d67d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80bd443740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559a52cccdd0 con 0x559a52ccd9a0 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80bd443740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f80b42002a0 con 0x559a52ccd5c0 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80bd443740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x559a52c3f930 con 0x559a52cd3490 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80bd443740 10 client.0 _ll_register_callbacks cb 0x7f80a407f520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80abe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd9a0 0x559a52d4d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80abe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd9a0 0x559a52d4d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49348/0 (socket says 172.21.15.99:49348) 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80abe00640 1 -- 172.21.15.99:0/3282379691 learned_addr learned my addr 172.21.15.99:0/3282379691 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80abe00640 1 -- 172.21.15.99:0/3282379691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52cd3490 msgr2=0x559a52d67d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80abe00640 1 --2- 172.21.15.99:0/3282379691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52cd3490 0x559a52d67d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80abe00640 1 -- 172.21.15.99:0/3282379691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ccd5c0 msgr2=0x559a52ce2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80abe00640 1 --2- 172.21.15.99:0/3282379691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ccd5c0 0x559a52ce2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.849+0000 7f80abe00640 1 -- 172.21.15.99:0/3282379691 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a52d0ef30 con 0x559a52ccd9a0 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.850+0000 7f80abe00640 1 --2- 172.21.15.99:0/3282379691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd9a0 0x559a52d4d150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f809c007040 tx=0x7f809c005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47221a580357f500 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.850+0000 7f80a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.850+0000 7f80a0c00640 1 -- 172.21.15.99:0/3282379691 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c00de20 con 0x559a52ccd9a0 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.850+0000 7f80a0c00640 1 -- 172.21.15.99:0/3282379691 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f809c021430 con 0x559a52ccd9a0 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.850+0000 7f80bd443740 1 -- 172.21.15.99:0/3282379691 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80ac018070 con 0x559a52ccd9a0 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.850+0000 7f80a0c00640 1 -- 172.21.15.99:0/3282379691 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f809c02e050 con 0x559a52ccd9a0 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.850+0000 7f80bd443740 10 client.5403 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.850+0000 7f80bd443740 1 -- 172.21.15.99:0/3282379691 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x559a52d67840 con 0x559a52ccd9a0 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.850+0000 7f80a0c00640 1 -- 172.21.15.99:0/3282379691 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ac018070 con 0x559a52ccd9a0 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.851+0000 7f80a0c00640 1 -- 172.21.15.99:0/3282379691 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f809c031020 con 0x559a52ccd9a0 2024-03-30T13:13:10.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.851+0000 7f80bd443740 10 client.5403 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:10.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.851+0000 7f80bd443740 10 client.5403 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:10.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.851+0000 7f80bd443740 20 client.5403 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:10.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.851+0000 7f80bd443740 1 --2- 172.21.15.99:0/3282379691 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a52d6a8e0 0x559a52c9f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.851+0000 7f80bd443740 4 client.5403 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:13:10.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.851+0000 7f80bd443740 1 -- 172.21.15.99:0/3282379691 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a52c12f60 con 0x559a52d6a8e0 2024-03-30T13:13:10.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.851+0000 7f80b3400640 1 --2- 172.21.15.99:0/3282379691 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a52d6a8e0 0x559a52c9f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.852+0000 7f80a0c00640 10 client.5403 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:10.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.852+0000 7f80b3400640 1 --2- 172.21.15.99:0/3282379691 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a52d6a8e0 0x559a52c9f3f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7efaa1d4f5449110 server_cookie=205450d6fdbdc5f6 in_seq=0 out_seq=0 2024-03-30T13:13:10.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.852+0000 7f80a0c00640 1 -- 172.21.15.99:0/3282379691 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+376 (crc 0 0 0) 0x559a52c12f60 con 0x559a52d6a8e0 2024-03-30T13:13:10.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.852+0000 7f80a0c00640 10 client.5403 handle_command_reply: tid=0 2024-03-30T13:13:10.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.852+0000 7f80bd443740 1 client.5403 shutdown 2024-03-30T13:13:10.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80bd443740 1 -- 172.21.15.99:0/3282379691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd9a0 msgr2=0x559a52d4d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80bd443740 1 --2- 172.21.15.99:0/3282379691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd9a0 0x559a52d4d150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f809c007040 tx=0x7f809c005bc0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80bd443740 1 -- 172.21.15.99:0/3282379691 shutdown_connections 2024-03-30T13:13:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80bd443740 1 --2- 172.21.15.99:0/3282379691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a52cd3490 0x559a52d67d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80bd443740 1 --2- 172.21.15.99:0/3282379691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a52ccd9a0 0x559a52d4d150 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80bd443740 1 --2- 172.21.15.99:0/3282379691 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a52d6a8e0 0x559a52c9f3f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80bd443740 1 --2- 172.21.15.99:0/3282379691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a52ccd5c0 0x559a52ce2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80bd443740 1 -- 172.21.15.99:0/3282379691 >> 172.21.15.99:0/3282379691 conn(0x559a52ca0aa0 msgr2=0x559a52ccfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80a0c00640 0 client.5403 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80bd443740 1 -- 172.21.15.99:0/3282379691 shutdown_connections 2024-03-30T13:13:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80bd443740 1 -- 172.21.15.99:0/3282379691 wait complete. 2024-03-30T13:13:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.853+0000 7f80bd443740 20 client.5403 trim_cache size 0 max 16384 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {}, 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_stats": { 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "bb44bba3-62df-4f2b-ba9b-e831e668d773": { 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "start_time": "2024-03-30T13:12:40.259378+0000", 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_started": 75, 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_passed": 75, 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_failed": 0, 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_skipped": 0 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:10.860 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:10.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 -- 172.21.15.99:0/3310908848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f809006c530 msgr2=0x7f809006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f809006c530 0x7f809006e9f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f809c0017e0 tx=0x7f809c009040 comp rx=0 tx=0).stop 2024-03-30T13:13:10.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 -- 172.21.15.99:0/3310908848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 msgr2=0x7f80b4161970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 0x7f80b4161970 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f80a4005040 tx=0x7f80a4001120 comp rx=0 tx=0).stop 2024-03-30T13:13:10.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 -- 172.21.15.99:0/3310908848 shutdown_connections 2024-03-30T13:13:10.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f809006c530 0x7f809006e9f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80b415b7e0 0x7f80b415bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80b415add0 0x7f80b41588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 --2- 172.21.15.99:0/3310908848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098003a00 0x7f80b4161970 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 -- 172.21.15.99:0/3310908848 >> 172.21.15.99:0/3310908848 conn(0x7f80b406b6f0 msgr2=0x7f80b40ad6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:10.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 -- 172.21.15.99:0/3310908848 shutdown_connections 2024-03-30T13:13:10.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:10.854+0000 7f80ba800640 1 -- 172.21.15.99:0/3310908848 wait complete. 2024-03-30T13:13:10.874 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-30T13:13:10.874 DEBUG:tasks.cephfs.test_uninlining:extracting inodes 2024-03-30T13:13:10.874 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:13:10.875 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Kconfig 2024-03-30T13:13:10.925 INFO:teuthology.orchestra.run.smithi099.stdout:1099511627780 linux-5.4/fs/ceph/Kconfig 2024-03-30T13:13:10.926 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Makefile 2024-03-30T13:13:10.926 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Makefile 2024-03-30T13:13:10.974 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628281 linux-5.4/fs/ceph/Makefile 2024-03-30T13:13:10.974 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:13:10.975 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:13:11.026 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628287 linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:13:11.026 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/io.h 2024-03-30T13:13:11.027 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/io.h 2024-03-30T13:13:11.076 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628294 linux-5.4/fs/ceph/io.h 2024-03-30T13:13:11.076 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:13:11.076 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:13:11.128 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628296 linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:13:11.128 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:13:11.128 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Kconfig 2024-03-30T13:13:11.175 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628308 linux-5.4/fs/ext2/Kconfig 2024-03-30T13:13:11.175 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:13:11.175 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:13:11.226 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628326 linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:13:11.226 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:13:11.226 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:13:11.276 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628324 linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:13:11.277 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Makefile 2024-03-30T13:13:11.277 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Makefile 2024-03-30T13:13:11.331 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628309 linux-5.4/fs/ext2/Makefile 2024-03-30T13:13:11.331 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:13:11.332 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/symlink.c 2024-03-30T13:13:11.382 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628321 linux-5.4/fs/ext2/symlink.c 2024-03-30T13:13:11.382 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/acl.h 2024-03-30T13:13:11.382 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/acl.h 2024-03-30T13:13:11.436 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628311 linux-5.4/fs/ext2/acl.h 2024-03-30T13:13:11.437 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:13:11.437 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:13:11.483 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628325 linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:13:11.483 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:13:11.483 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr.h 2024-03-30T13:13:11.578 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628323 linux-5.4/fs/ext2/xattr.h 2024-03-30T13:13:11.578 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:13:11.582 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:13:11.636 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628328 linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:13:11.637 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:13:11.637 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:13:11.687 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628341 linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:13:11.688 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:13:11.688 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:13:11.743 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628348 linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:13:11.743 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:13:11.743 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:13:11.795 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628331 linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:13:11.796 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:13:11.796 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:13:11.849 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628339 linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:13:11.849 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:13:11.849 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:13:11.901 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628343 linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:13:11.901 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:13:11.901 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:13:11.950 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628344 linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:13:11.950 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:13:11.950 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Makefile 2024-03-30T13:13:12.001 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628329 linux-5.4/fs/orangefs/Makefile 2024-03-30T13:13:12.001 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:13:12.001 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:13:12.055 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628352 linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:13:12.055 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:13:12.055 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:13:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628334 linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:13:12.107 DEBUG:tasks.cephfs.test_uninlining:getting inline data info 2024-03-30T13:13:12.107 DEBUG:tasks.cephfs.test_uninlining:getting inode info #1 of 23:1099511627780 2024-03-30T13:13:12.107 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511627780 2024-03-30T13:13:12.107 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511627780 2024-03-30T13:13:12.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.321+0000 7ff461600640 1 Processor -- start 2024-03-30T13:13:12.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.321+0000 7ff461600640 1 -- start start 2024-03-30T13:13:12.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.323+0000 7ff461600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff45c09aa30 0x7ff45c09ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.323+0000 7ff461600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45c0d06f0 con 0x7ff45c161f50 2024-03-30T13:13:12.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.323+0000 7ff461600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45c070250 con 0x7ff45c0d0bd0 2024-03-30T13:13:12.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.323+0000 7ff461600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff45c09b3d0 con 0x7ff45c09aa30 2024-03-30T13:13:12.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.323+0000 7ff45aa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff45c161f50 0x7ff45c06fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49250/0 (socket says 172.21.15.99:49250) 2024-03-30T13:13:12.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.323+0000 7ff45aa00640 1 -- 172.21.15.99:0/3537744025 learned_addr learned my addr 172.21.15.99:0/3537744025 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:12.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.323+0000 7ff45a000640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff45c09aa30 0x7ff45c09ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.323+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680968537 0 0) 0x7ff45c0d06f0 con 0x7ff45c161f50 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.323+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff43c003520 con 0x7ff45c161f50 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3135994253 0 0) 0x7ff43c003520 con 0x7ff45c161f50 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff45c09aa30 msgr2=0x7ff45c09ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff45c09aa30 0x7ff45c09ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 >> v1:172.21.15.181:6789/0 conn(0x7ff45c0d0bd0 legacy=0x7ff45c0d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c15f300 con 0x7ff45c161f50 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7ff44c001670 con 0x7ff45c161f50 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 >> v1:172.21.15.99:6789/0 conn(0x7ff45c161f50 legacy=0x7ff45c06fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 0x7ff43c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff43c004800 0x7ff43c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43c0052e0 0x7ff43c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c00c0e0 con 0x7ff43c0039e0 2024-03-30T13:13:12.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c00c290 con 0x7ff43c004800 2024-03-30T13:13:12.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff43c00c490 con 0x7ff43c0052e0 2024-03-30T13:13:12.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff45a000640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff45c09aa30 0x7ff45c09ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:12.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff45aa00640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 0x7ff43c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.324+0000 7ff45b400640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43c0052e0 0x7ff43c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.325+0000 7ff45aa00640 1 -- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43c0052e0 msgr2=0x7ff43c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.325+0000 7ff45aa00640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43c0052e0 0x7ff43c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.325+0000 7ff45aa00640 1 -- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff43c004800 msgr2=0x7ff43c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.325+0000 7ff45aa00640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff43c004800 0x7ff43c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.325+0000 7ff45aa00640 1 -- 172.21.15.99:0/3537744025 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c003520 con 0x7ff43c0039e0 2024-03-30T13:13:12.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.325+0000 7ff45b400640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43c0052e0 0x7ff43c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:12.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.326+0000 7ff45aa00640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 0x7ff43c003e00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c210 tx=0x7ff43c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2664b9e6a50fd7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.326+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c007d30 con 0x7ff43c0039e0 2024-03-30T13:13:12.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.326+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c030070 con 0x7ff43c0039e0 2024-03-30T13:13:12.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.326+0000 7ff459600640 1 -- 172.21.15.99:0/3537744025 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c02cd60 con 0x7ff43c0039e0 2024-03-30T13:13:12.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.327+0000 7ff461600640 1 -- 172.21.15.99:0/3537744025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 msgr2=0x7ff43c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.327+0000 7ff461600640 1 --2- 172.21.15.99:0/3537744025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 0x7ff43c003e00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c210 tx=0x7ff43c005830 comp rx=0 tx=0).stop 2024-03-30T13:13:12.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.327+0000 7ff45b400640 1 -- 172.21.15.99:0/3537744025 reap_dead start 2024-03-30T13:13:12.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.327+0000 7ff461600640 1 -- 172.21.15.99:0/3537744025 shutdown_connections 2024-03-30T13:13:12.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.327+0000 7ff461600640 1 -- 172.21.15.99:0/3537744025 >> 172.21.15.99:0/3537744025 conn(0x7ff45c0b3fa0 msgr2=0x7ff45c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.327+0000 7ff461600640 1 -- 172.21.15.99:0/3537744025 shutdown_connections 2024-03-30T13:13:12.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.327+0000 7ff461600640 1 -- 172.21.15.99:0/3537744025 wait complete. 2024-03-30T13:13:12.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.329+0000 7ff461600640 1 Processor -- start 2024-03-30T13:13:12.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.329+0000 7ff461600640 1 -- start start 2024-03-30T13:13:12.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.330+0000 7ff461600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 0x7ff45c0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.330+0000 7ff461600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff45c0c7740 0x7ff45c09f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.330+0000 7ff461600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff45c0c7bc0 0x7ff45c09fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.330+0000 7ff461600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c15fba0 con 0x7ff43c0039e0 2024-03-30T13:13:12.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.330+0000 7ff461600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c15f8c0 con 0x7ff45c0c7bc0 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.330+0000 7ff461600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff45c160220 con 0x7ff45c0c7740 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.330+0000 7ff45aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 0x7ff45c0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.330+0000 7ff45aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 0x7ff45c0b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49370/0 (socket says 172.21.15.99:49370) 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.330+0000 7ff45aa00640 1 -- 172.21.15.99:0/3932595314 learned_addr learned my addr 172.21.15.99:0/3932595314 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.330+0000 7ff45a000640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff45c0c7740 0x7ff45c09f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.330+0000 7ff45b400640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff45c0c7bc0 0x7ff45c09fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff45aa00640 1 -- 172.21.15.99:0/3932595314 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff45c0c7740 msgr2=0x7ff45c09f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff45aa00640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff45c0c7740 0x7ff45c09f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff45aa00640 1 -- 172.21.15.99:0/3932595314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff45c0c7bc0 msgr2=0x7ff45c09fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff45aa00640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff45c0c7bc0 0x7ff45c09fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff45aa00640 1 -- 172.21.15.99:0/3932595314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c0c6dc0 con 0x7ff43c0039e0 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff45a000640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff45c0c7740 0x7ff45c09f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:12.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff45b400640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff45c0c7bc0 0x7ff45c09fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:12.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff45aa00640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 0x7ff45c0b6700 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c330 tx=0x7ff44c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff452a00640 1 -- 172.21.15.99:0/3932595314 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c045070 con 0x7ff43c0039e0 2024-03-30T13:13:12.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff452a00640 1 -- 172.21.15.99:0/3932595314 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c000ed0 con 0x7ff43c0039e0 2024-03-30T13:13:12.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff461600640 1 -- 172.21.15.99:0/3932595314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45c09eeb0 con 0x7ff43c0039e0 2024-03-30T13:13:12.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff452a00640 1 -- 172.21.15.99:0/3932595314 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c004e10 con 0x7ff43c0039e0 2024-03-30T13:13:12.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.331+0000 7ff461600640 1 -- 172.21.15.99:0/3932595314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45c09eb60 con 0x7ff43c0039e0 2024-03-30T13:13:12.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.334+0000 7ff452a00640 1 -- 172.21.15.99:0/3932595314 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff44c007070 con 0x7ff43c0039e0 2024-03-30T13:13:12.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.334+0000 7ff452a00640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff43806c530 0x7ff43806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.335+0000 7ff452a00640 1 -- 172.21.15.99:0/3932595314 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7ff44c0ac6d0 con 0x7ff43c0039e0 2024-03-30T13:13:12.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.335+0000 7ff45a000640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff43806c530 0x7ff43806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.335+0000 7ff46422e740 1 Processor -- start 2024-03-30T13:13:12.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.335+0000 7ff46422e740 1 -- start start 2024-03-30T13:13:12.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.336+0000 7ff45a000640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff43806c530 0x7ff43806e9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff4440070b0 tx=0x7ff44400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.336+0000 7ff46422e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c7bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.336+0000 7ff46422e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c7c300 0x55db75c542d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.336+0000 7ff46422e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55670 0x55db75c54810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.336+0000 7ff46422e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55db75bb8330 con 0x55db75c55290 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.336+0000 7ff46422e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55db75b60620 con 0x55db75c7c300 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.336+0000 7ff46422e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55db75bb4440 con 0x55db75c55670 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff45aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c7bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff45aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c7bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49382/0 (socket says 172.21.15.99:49382) 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff45aa00640 1 -- 172.21.15.99:0/4039614172 learned_addr learned my addr 172.21.15.99:0/4039614172 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff45a000640 1 --2- 172.21.15.99:0/4039614172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c7c300 0x55db75c542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff45aa00640 1 -- 172.21.15.99:0/4039614172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55670 msgr2=0x55db75c54810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff45aa00640 1 --2- 172.21.15.99:0/4039614172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55670 0x55db75c54810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff45aa00640 1 -- 172.21.15.99:0/4039614172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c7c300 msgr2=0x55db75c542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff45aa00640 1 --2- 172.21.15.99:0/4039614172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c7c300 0x55db75c542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff45aa00640 1 -- 172.21.15.99:0/4039614172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db75998920 con 0x55db75c55290 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff45a000640 1 --2- 172.21.15.99:0/4039614172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c7c300 0x55db75c542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff45aa00640 1 --2- 172.21.15.99:0/4039614172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c7bdc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff44c082c00 tx=0x7ff44c07ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf177cdd81dcb29 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff44b000640 1 -- 172.21.15.99:0/4039614172 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c078850 con 0x55db75c55290 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff44b000640 1 -- 172.21.15.99:0/4039614172 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c030040 con 0x55db75c55290 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.337+0000 7ff44b000640 1 -- 172.21.15.99:0/4039614172 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c076bc0 con 0x55db75c55290 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.338+0000 7ff46422e740 1 -- 172.21.15.99:0/4039614172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 msgr2=0x55db75c7bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.338+0000 7ff46422e740 1 --2- 172.21.15.99:0/4039614172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c7bdc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff44c082c00 tx=0x7ff44c07ad80 comp rx=0 tx=0).stop 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.338+0000 7ff46422e740 1 -- 172.21.15.99:0/4039614172 shutdown_connections 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.338+0000 7ff46422e740 1 --2- 172.21.15.99:0/4039614172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55670 0x55db75c54810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.338+0000 7ff46422e740 1 --2- 172.21.15.99:0/4039614172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c7c300 0x55db75c542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.338+0000 7ff46422e740 1 --2- 172.21.15.99:0/4039614172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c7bdc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.338+0000 7ff46422e740 1 -- 172.21.15.99:0/4039614172 >> 172.21.15.99:0/4039614172 conn(0x55db75c1bbe0 msgr2=0x55db75c99fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.338+0000 7ff46422e740 1 -- 172.21.15.99:0/4039614172 shutdown_connections 2024-03-30T13:13:12.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.338+0000 7ff46422e740 1 -- 172.21.15.99:0/4039614172 wait complete. 2024-03-30T13:13:12.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.339+0000 7ff46422e740 1 -- start start 2024-03-30T13:13:12.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.339+0000 7ff46422e740 1 Processor -- start 2024-03-30T13:13:12.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.340+0000 7ff46422e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55290 0x55db75cad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.340+0000 7ff46422e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55670 0x55db75c81a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.340+0000 7ff46422e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c96900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.340+0000 7ff46422e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55db75b60620 con 0x55db75c93020 2024-03-30T13:13:12.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.340+0000 7ff46422e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55db75b739d0 con 0x55db75c55670 2024-03-30T13:13:12.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.340+0000 7ff46422e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55db75bb8330 con 0x55db75c55290 2024-03-30T13:13:12.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.340+0000 7ff46422e740 10 client.0 _ll_register_callbacks cb 0x55db75baffd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:12.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff45b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c96900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff45b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c96900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49392/0 (socket says 172.21.15.99:49392) 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff45b400640 1 -- 172.21.15.99:0/4102592517 learned_addr learned my addr 172.21.15.99:0/4102592517 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff45a000640 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55670 0x55db75c81a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff45aa00640 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55290 0x55db75cad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff45b400640 1 -- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55290 msgr2=0x55db75cad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff45b400640 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55290 0x55db75cad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff45b400640 1 -- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55670 msgr2=0x55db75c81a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff45b400640 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55670 0x55db75c81a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff45b400640 1 -- 172.21.15.99:0/4102592517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db7588c210 con 0x55db75c93020 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff45b400640 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c96900 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0727a0 tx=0x7ff45400e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da949ff53cdd47e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.341+0000 7ff443400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.342+0000 7ff443400640 1 -- 172.21.15.99:0/4102592517 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4540052d0 con 0x55db75c93020 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.342+0000 7ff443400640 1 -- 172.21.15.99:0/4102592517 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7ff4540035f0 con 0x55db75c93020 2024-03-30T13:13:12.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.342+0000 7ff46422e740 1 -- 172.21.15.99:0/4102592517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff44c030040 con 0x55db75c93020 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.342+0000 7ff443400640 1 -- 172.21.15.99:0/4102592517 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff45401f050 con 0x55db75c93020 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.342+0000 7ff46422e740 10 client.5415 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.342+0000 7ff46422e740 1 -- 172.21.15.99:0/4102592517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55db759f90b0 con 0x55db75c93020 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.342+0000 7ff443400640 1 -- 172.21.15.99:0/4102592517 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c030040 con 0x55db75c93020 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.342+0000 7ff443400640 1 -- 172.21.15.99:0/4102592517 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7ff454022020 con 0x55db75c93020 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.342+0000 7ff46422e740 10 client.5415 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.342+0000 7ff46422e740 10 client.5415 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.342+0000 7ff46422e740 20 client.5415 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.343+0000 7ff46422e740 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55db75c805d0 0x55db75c809e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.343+0000 7ff46422e740 4 client.5415 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.343+0000 7ff46422e740 1 -- 172.21.15.99:0/4102592517 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db75bc5870 con 0x55db75c805d0 2024-03-30T13:13:12.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.343+0000 7ff45aa00640 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55db75c805d0 0x55db75c809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.344+0000 7ff45aa00640 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55db75c805d0 0x55db75c809e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58bc5cfa8a087187 server_cookie=8043717c9693d299 in_seq=0 out_seq=0 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.344+0000 7ff443400640 10 client.5415 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff443400640 1 -- 172.21.15.99:0/4102592517 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55db75bc5870 con 0x55db75c805d0 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff443400640 10 client.5415 handle_command_reply: tid=0 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff46422e740 1 client.5415 shutdown 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff46422e740 1 -- 172.21.15.99:0/4102592517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 msgr2=0x55db75c96900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff46422e740 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c96900 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0727a0 tx=0x7ff45400e590 comp rx=0 tx=0).stop 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff46422e740 1 -- 172.21.15.99:0/4102592517 shutdown_connections 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff46422e740 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c96900 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff46422e740 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55db75c805d0 0x55db75c809e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff46422e740 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55670 0x55db75c81a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff46422e740 1 --2- 172.21.15.99:0/4102592517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55290 0x55db75cad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff46422e740 1 -- 172.21.15.99:0/4102592517 >> 172.21.15.99:0/4102592517 conn(0x55db75c1bbe0 msgr2=0x55db75c7ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.346+0000 7ff443400640 0 client.5415 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.347+0000 7ff46422e740 1 -- 172.21.15.99:0/4102592517 shutdown_connections 2024-03-30T13:13:12.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.347+0000 7ff46422e740 1 -- 172.21.15.99:0/4102592517 wait complete. 2024-03-30T13:13:12.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.347+0000 7ff46422e740 20 client.5415 trim_cache size 0 max 16384 2024-03-30T13:13:12.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.362+0000 7ff46422e740 1 Processor -- start 2024-03-30T13:13:12.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.362+0000 7ff46422e740 1 -- start start 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.363+0000 7ff46422e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55290 0x55db75d0be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.363+0000 7ff46422e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55670 0x55db75d0b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.363+0000 7ff46422e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c925e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.363+0000 7ff46422e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c201480 con 0x55db75c93020 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.363+0000 7ff46422e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c200520 con 0x55db75c55290 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.363+0000 7ff46422e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff45c1f8630 con 0x55db75c55670 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.363+0000 7ff45b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c925e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff45b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c925e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49406/0 (socket says 172.21.15.99:49406) 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff45b400640 1 -- 172.21.15.99:0/3335111219 learned_addr learned my addr 172.21.15.99:0/3335111219 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff45aa00640 1 --2- 172.21.15.99:0/3335111219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55290 0x55db75d0be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff45b400640 1 -- 172.21.15.99:0/3335111219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55670 msgr2=0x55db75d0b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff45a000640 1 --2- 172.21.15.99:0/3335111219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55670 0x55db75d0b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff45b400640 1 --2- 172.21.15.99:0/3335111219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55670 0x55db75d0b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff45b400640 1 -- 172.21.15.99:0/3335111219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55290 msgr2=0x55db75d0be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff45b400640 1 --2- 172.21.15.99:0/3335111219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55290 0x55db75d0be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff45b400640 1 -- 172.21.15.99:0/3335111219 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db758652d0 con 0x55db75c93020 2024-03-30T13:13:12.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff45b400640 1 --2- 172.21.15.99:0/3335111219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c925e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff4540053f0 tx=0x7ff45400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6948b78c24f366b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff44a600640 1 -- 172.21.15.99:0/3335111219 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454027020 con 0x55db75c93020 2024-03-30T13:13:12.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff44a600640 1 -- 172.21.15.99:0/3335111219 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4540037f0 con 0x55db75c93020 2024-03-30T13:13:12.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.364+0000 7ff44a600640 1 -- 172.21.15.99:0/3335111219 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454003be0 con 0x55db75c93020 2024-03-30T13:13:12.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.365+0000 7ff46422e740 1 -- 172.21.15.99:0/3335111219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 msgr2=0x55db75c925e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.365+0000 7ff46422e740 1 --2- 172.21.15.99:0/3335111219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c925e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff4540053f0 tx=0x7ff45400c000 comp rx=0 tx=0).stop 2024-03-30T13:13:12.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.365+0000 7ff46422e740 1 -- 172.21.15.99:0/3335111219 shutdown_connections 2024-03-30T13:13:12.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.365+0000 7ff46422e740 1 --2- 172.21.15.99:0/3335111219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c93020 0x55db75c925e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.365+0000 7ff46422e740 1 --2- 172.21.15.99:0/3335111219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c55670 0x55db75d0b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.365+0000 7ff46422e740 1 --2- 172.21.15.99:0/3335111219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55290 0x55db75d0be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.365+0000 7ff46422e740 1 -- 172.21.15.99:0/3335111219 >> 172.21.15.99:0/3335111219 conn(0x55db75c1bbe0 msgr2=0x55db75c500c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.365+0000 7ff46422e740 1 -- 172.21.15.99:0/3335111219 shutdown_connections 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.365+0000 7ff46422e740 1 -- 172.21.15.99:0/3335111219 wait complete. 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.366+0000 7ff46422e740 1 -- start start 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.366+0000 7ff46422e740 1 Processor -- start 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.367+0000 7ff46422e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c90100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.367+0000 7ff46422e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55670 0x55db75d09d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.367+0000 7ff46422e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c93020 0x55db75d0a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.367+0000 7ff46422e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55db75c4a760 con 0x55db75c55290 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.367+0000 7ff46422e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c200070 con 0x55db75c55670 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.367+0000 7ff46422e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55db75caa1a0 con 0x55db75c93020 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.367+0000 7ff46422e740 10 client.0 _ll_register_callbacks cb 0x7ff4540019a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.367+0000 7ff45aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c90100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.367+0000 7ff45aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c90100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49412/0 (socket says 172.21.15.99:49412) 2024-03-30T13:13:12.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.367+0000 7ff45aa00640 1 -- 172.21.15.99:0/1325971369 learned_addr learned my addr 172.21.15.99:0/1325971369 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff45aa00640 1 -- 172.21.15.99:0/1325971369 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c93020 msgr2=0x55db75d0a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff45aa00640 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c93020 0x55db75d0a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff45a000640 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55670 0x55db75d09d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff45aa00640 1 -- 172.21.15.99:0/1325971369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55670 msgr2=0x55db75d09d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff45aa00640 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55670 0x55db75d09d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff45aa00640 1 -- 172.21.15.99:0/1325971369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db75c90640 con 0x55db75c55290 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff45aa00640 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c90100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c210 tx=0x7ff44c02df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b09f1a4e78e92a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff443400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff443400640 1 -- 172.21.15.99:0/1325971369 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c096070 con 0x55db75c55290 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff443400640 1 -- 172.21.15.99:0/1325971369 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7ff44c076bc0 con 0x55db75c55290 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff46422e740 1 -- 172.21.15.99:0/1325971369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4540037f0 con 0x55db75c55290 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff443400640 1 -- 172.21.15.99:0/1325971369 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff44c092b40 con 0x55db75c55290 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff46422e740 10 client.5421 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:12.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff46422e740 1 -- 172.21.15.99:0/1325971369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55db75c90640 con 0x55db75c55290 2024-03-30T13:13:12.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.368+0000 7ff443400640 1 -- 172.21.15.99:0/1325971369 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4540037f0 con 0x55db75c55290 2024-03-30T13:13:12.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.369+0000 7ff443400640 1 -- 172.21.15.99:0/1325971369 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7ff44c092ce0 con 0x55db75c55290 2024-03-30T13:13:12.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.369+0000 7ff46422e740 10 client.5421 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:12.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.369+0000 7ff46422e740 10 client.5421 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:12.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.369+0000 7ff46422e740 20 client.5421 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:12.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.369+0000 7ff46422e740 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55db75c72c70 0x55db75c73070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.369+0000 7ff46422e740 4 client.5421 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511627780}] 2024-03-30T13:13:12.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.369+0000 7ff46422e740 1 -- 172.21.15.99:0/1325971369 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511627780}) -- 0x55db75bbfbc0 con 0x55db75c72c70 2024-03-30T13:13:12.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.369+0000 7ff45a000640 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55db75c72c70 0x55db75c73070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.370+0000 7ff45a000640 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55db75c72c70 0x55db75c73070 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=919ca0cc3d918185 server_cookie=d637c8f9f7fb727d in_seq=0 out_seq=0 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.370+0000 7ff443400640 10 client.5421 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff443400640 1 -- 172.21.15.99:0/1325971369 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3965 (crc 0 0 0) 0x55db75bbfbc0 con 0x55db75c72c70 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff443400640 10 client.5421 handle_command_reply: tid=0 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff46422e740 1 client.5421 shutdown 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff46422e740 1 -- 172.21.15.99:0/1325971369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 msgr2=0x55db75c90100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff46422e740 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c90100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c210 tx=0x7ff44c02df90 comp rx=0 tx=0).stop 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff46422e740 1 -- 172.21.15.99:0/1325971369 shutdown_connections 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff46422e740 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55db75c93020 0x55db75d0a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff46422e740 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55db75c72c70 0x55db75c73070 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff46422e740 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db75c55670 0x55db75d09d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff46422e740 1 --2- 172.21.15.99:0/1325971369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55db75c55290 0x55db75c90100 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff443400640 0 client.5421 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff46422e740 1 -- 172.21.15.99:0/1325971369 >> 172.21.15.99:0/1325971369 conn(0x55db75c1bbe0 msgr2=0x55db75c7eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff46422e740 1 -- 172.21.15.99:0/1325971369 shutdown_connections 2024-03-30T13:13:12.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.371+0000 7ff46422e740 1 -- 172.21.15.99:0/1325971369 wait complete. 2024-03-30T13:13:12.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.372+0000 7ff46422e740 20 client.5421 trim_cache size 0 max 16384 2024-03-30T13:13:12.378 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:12.378 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ceph/Kconfig", 2024-03-30T13:13:12.378 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511627780, 2024-03-30T13:13:12.378 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:12.378 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.310465+0000", 2024-03-30T13:13:12.378 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.313960+0000", 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1481, 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.313960+0000", 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1481, 2024-03-30T13:13:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.310465+0000" 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1481, 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.310465+0000" 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 166, 2024-03-30T13:13:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 2, 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.360445+0000", 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 56, 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:12.390 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:12.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.372+0000 7ff461600640 1 -- 172.21.15.99:0/3932595314 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff43806c530 msgr2=0x7ff43806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.372+0000 7ff461600640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff43806c530 0x7ff43806e9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff4440070b0 tx=0x7ff44400b040 comp rx=0 tx=0).stop 2024-03-30T13:13:12.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.372+0000 7ff461600640 1 -- 172.21.15.99:0/3932595314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 msgr2=0x7ff45c0b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.372+0000 7ff461600640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 0x7ff45c0b6700 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c330 tx=0x7ff44c001a40 comp rx=0 tx=0).stop 2024-03-30T13:13:12.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.372+0000 7ff461600640 1 -- 172.21.15.99:0/3932595314 shutdown_connections 2024-03-30T13:13:12.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.372+0000 7ff461600640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff43806c530 0x7ff43806e9f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.372+0000 7ff461600640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff45c0c7bc0 0x7ff45c09fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.372+0000 7ff461600640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff45c0c7740 0x7ff45c09f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.372+0000 7ff461600640 1 --2- 172.21.15.99:0/3932595314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff43c0039e0 0x7ff45c0b6700 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.372+0000 7ff461600640 1 -- 172.21.15.99:0/3932595314 >> 172.21.15.99:0/3932595314 conn(0x7ff45c0b3fa0 msgr2=0x7ff45c0b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.373+0000 7ff461600640 1 -- 172.21.15.99:0/3932595314 shutdown_connections 2024-03-30T13:13:12.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.373+0000 7ff461600640 1 -- 172.21.15.99:0/3932595314 wait complete. 2024-03-30T13:13:12.393 DEBUG:tasks.cephfs.test_uninlining:getting inode info #2 of 23:1099511628281 2024-03-30T13:13:12.393 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628281 2024-03-30T13:13:12.393 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628281 2024-03-30T13:13:12.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.601+0000 7f790ae00640 1 Processor -- start 2024-03-30T13:13:12.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.601+0000 7f790ae00640 1 -- start start 2024-03-30T13:13:12.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f790ae00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79040cf330 0x7f790415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f790ae00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f79040acf20 0x7f79040ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f790ae00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790415d7b0 con 0x7f790415ca80 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f790ae00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f790406d840 con 0x7f79040acf20 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f790ae00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f790406db20 con 0x7f79040cf330 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f7909000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f79040acf20 0x7f79040ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f7909000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f79040acf20 0x7f79040ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49416/0 (socket says 172.21.15.99:49416) 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f7909000640 1 -- 172.21.15.99:0/3335710516 learned_addr learned my addr 172.21.15.99:0/3335710516 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f790a400640 1 --1- 172.21.15.99:0/3335710516 >> v1:172.21.15.99:6789/0 conn(0x7f790415ca80 0x7f790415cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49262/0 (socket says 172.21.15.99:49262) 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f7909a00640 1 --2- 172.21.15.99:0/3335710516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79040cf330 0x7f790415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f7909000640 1 -- 172.21.15.99:0/3335710516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79040cf330 msgr2=0x7f790415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f7909000640 1 --2- 172.21.15.99:0/3335710516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79040cf330 0x7f790415dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.603+0000 7f7909000640 1 -- 172.21.15.99:0/3335710516 >> v1:172.21.15.99:6789/0 conn(0x7f790415ca80 legacy=0x7f790415cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.604+0000 7f7909000640 1 -- 172.21.15.99:0/3335710516 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790406de00 con 0x7f79040acf20 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.604+0000 7f7903e00640 1 -- 172.21.15.99:0/3335710516 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 548100708 0 0) 0x7f790415d7b0 con 0x7f790415ca80 2024-03-30T13:13:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.604+0000 7f7909a00640 1 --2- 172.21.15.99:0/3335710516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79040cf330 0x7f790415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.605+0000 7f7909000640 1 --2- 172.21.15.99:0/3335710516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79040acf20 0x7f79040ad3a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009870 tx=0x7f78f002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc7d0828f77ceb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.605+0000 7f7903e00640 1 -- 172.21.15.99:0/3335710516 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0034070 con 0x7f79040acf20 2024-03-30T13:13:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.605+0000 7f7903e00640 1 -- 172.21.15.99:0/3335710516 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f0030840 con 0x7f79040acf20 2024-03-30T13:13:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.605+0000 7f7903e00640 1 -- 172.21.15.99:0/3335710516 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0030c10 con 0x7f79040acf20 2024-03-30T13:13:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.606+0000 7f790ae00640 1 -- 172.21.15.99:0/3335710516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79040acf20 msgr2=0x7f79040ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.606+0000 7f790ae00640 1 --2- 172.21.15.99:0/3335710516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79040acf20 0x7f79040ad3a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009870 tx=0x7f78f002b980 comp rx=0 tx=0).stop 2024-03-30T13:13:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.606+0000 7f790ae00640 1 -- 172.21.15.99:0/3335710516 shutdown_connections 2024-03-30T13:13:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.606+0000 7f790ae00640 1 --2- 172.21.15.99:0/3335710516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79040acf20 0x7f79040ad3a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.606+0000 7f790ae00640 1 --2- 172.21.15.99:0/3335710516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79040cf330 0x7f790415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.606+0000 7f790ae00640 1 -- 172.21.15.99:0/3335710516 >> 172.21.15.99:0/3335710516 conn(0x7f790406bb40 msgr2=0x7f79040b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.606+0000 7f790ae00640 1 -- 172.21.15.99:0/3335710516 shutdown_connections 2024-03-30T13:13:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.606+0000 7f790ae00640 1 -- 172.21.15.99:0/3335710516 wait complete. 2024-03-30T13:13:12.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.607+0000 7f790ae00640 1 Processor -- start 2024-03-30T13:13:12.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.608+0000 7f790ae00640 1 -- start start 2024-03-30T13:13:12.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.608+0000 7f790ae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79040acf20 0x7f79041e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.608+0000 7f790ae00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79040cf330 0x7f790414da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f790ae00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f790415ca80 0x7f79041e6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f790ae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f790406e6f0 con 0x7f79040acf20 2024-03-30T13:13:12.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f790ae00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f790406e570 con 0x7f790415ca80 2024-03-30T13:13:12.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f790ae00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f790406e870 con 0x7f79040cf330 2024-03-30T13:13:12.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f7909a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79040acf20 0x7f79041e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f7909a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79040acf20 0x7f79041e5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49430/0 (socket says 172.21.15.99:49430) 2024-03-30T13:13:12.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f7909a00640 1 -- 172.21.15.99:0/2940379398 learned_addr learned my addr 172.21.15.99:0/2940379398 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f7909000640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79040cf330 0x7f790414da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f7909a00640 1 -- 172.21.15.99:0/2940379398 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79040cf330 msgr2=0x7f790414da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f7909a00640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79040cf330 0x7f790414da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f7909a00640 1 -- 172.21.15.99:0/2940379398 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f790415ca80 msgr2=0x7f79041e6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f7909a00640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f790415ca80 0x7f79041e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.609+0000 7f7909a00640 1 -- 172.21.15.99:0/2940379398 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79041e6390 con 0x7f79040acf20 2024-03-30T13:13:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.610+0000 7f7909a00640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79040acf20 0x7f79041e5db0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f78f800c7f0 tx=0x7f78f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.610+0000 7f7901600640 1 -- 172.21.15.99:0/2940379398 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8015070 con 0x7f79040acf20 2024-03-30T13:13:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.610+0000 7f7901600640 1 -- 172.21.15.99:0/2940379398 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f8007a30 con 0x7f79040acf20 2024-03-30T13:13:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.610+0000 7f7901600640 1 -- 172.21.15.99:0/2940379398 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8007e00 con 0x7f79040acf20 2024-03-30T13:13:12.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.610+0000 7f790ae00640 1 -- 172.21.15.99:0/2940379398 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790409c270 con 0x7f79040acf20 2024-03-30T13:13:12.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.610+0000 7f790ae00640 1 -- 172.21.15.99:0/2940379398 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790409c830 con 0x7f79040acf20 2024-03-30T13:13:12.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.612+0000 7f7901600640 1 -- 172.21.15.99:0/2940379398 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f78f8018070 con 0x7f79040acf20 2024-03-30T13:13:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.613+0000 7f7901600640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f78e406c530 0x7f78e406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.613+0000 7f7901600640 1 -- 172.21.15.99:0/2940379398 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f78f808b890 con 0x7f79040acf20 2024-03-30T13:13:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.613+0000 7f7909000640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f78e406c530 0x7f78e406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.614+0000 7f790f1da740 1 Processor -- start 2024-03-30T13:13:12.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.614+0000 7f790f1da740 1 -- start start 2024-03-30T13:13:12.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.614+0000 7f7909000640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f78e406c530 0x7f78e406e9f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78f0036000 tx=0x7f78f003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f790f1da740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6470 0x55e5b7d1cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f790f1da740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d1d4e0 0x55e5b7cf54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f790f1da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6850 0x55e5b7cf59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f790f1da740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e5b7c59330 con 0x55e5b7d1d4e0 2024-03-30T13:13:12.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f790f1da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e5b7c01620 con 0x55e5b7cf6850 2024-03-30T13:13:12.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f790f1da740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55e5b7c55440 con 0x55e5b7cf6470 2024-03-30T13:13:12.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f7909000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d1d4e0 0x55e5b7cf54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f7909000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d1d4e0 0x55e5b7cf54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49446/0 (socket says 172.21.15.99:49446) 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f7909000640 1 -- 172.21.15.99:0/2692885823 learned_addr learned my addr 172.21.15.99:0/2692885823 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f7909a00640 1 --2- 172.21.15.99:0/2692885823 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6470 0x55e5b7d1cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f790a400640 1 --2- 172.21.15.99:0/2692885823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6850 0x55e5b7cf59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f7909000640 1 -- 172.21.15.99:0/2692885823 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6470 msgr2=0x55e5b7d1cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f7909000640 1 --2- 172.21.15.99:0/2692885823 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6470 0x55e5b7d1cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.615+0000 7f7909000640 1 -- 172.21.15.99:0/2692885823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6850 msgr2=0x55e5b7cf59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.616+0000 7f7909000640 1 --2- 172.21.15.99:0/2692885823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6850 0x55e5b7cf59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.616+0000 7f7909000640 1 -- 172.21.15.99:0/2692885823 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5b7a39920 con 0x55e5b7d1d4e0 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.616+0000 7f790a400640 1 --2- 172.21.15.99:0/2692885823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6850 0x55e5b7cf59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.616+0000 7f7909000640 1 --2- 172.21.15.99:0/2692885823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d1d4e0 0x55e5b7cf54b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f78f002b9c0 tx=0x7f78f0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb51917ce309d277 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.616+0000 7f78f6000640 1 -- 172.21.15.99:0/2692885823 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0053070 con 0x55e5b7d1d4e0 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.616+0000 7f78f6000640 1 -- 172.21.15.99:0/2692885823 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f0039960 con 0x55e5b7d1d4e0 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.616+0000 7f78f6000640 1 -- 172.21.15.99:0/2692885823 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0034040 con 0x55e5b7d1d4e0 2024-03-30T13:13:12.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.617+0000 7f790f1da740 1 -- 172.21.15.99:0/2692885823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d1d4e0 msgr2=0x55e5b7cf54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.617+0000 7f790f1da740 1 --2- 172.21.15.99:0/2692885823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d1d4e0 0x55e5b7cf54b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f78f002b9c0 tx=0x7f78f0030000 comp rx=0 tx=0).stop 2024-03-30T13:13:12.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.617+0000 7f790f1da740 1 -- 172.21.15.99:0/2692885823 shutdown_connections 2024-03-30T13:13:12.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.617+0000 7f790f1da740 1 --2- 172.21.15.99:0/2692885823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6850 0x55e5b7cf59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.617+0000 7f790f1da740 1 --2- 172.21.15.99:0/2692885823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d1d4e0 0x55e5b7cf54b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.617+0000 7f790f1da740 1 --2- 172.21.15.99:0/2692885823 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6470 0x55e5b7d1cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.617+0000 7f790f1da740 1 -- 172.21.15.99:0/2692885823 >> 172.21.15.99:0/2692885823 conn(0x55e5b7cbcbe0 msgr2=0x55e5b7d3b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.617+0000 7f790f1da740 1 -- 172.21.15.99:0/2692885823 shutdown_connections 2024-03-30T13:13:12.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.617+0000 7f790f1da740 1 -- 172.21.15.99:0/2692885823 wait complete. 2024-03-30T13:13:12.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.618+0000 7f790f1da740 1 -- start start 2024-03-30T13:13:12.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.618+0000 7f790f1da740 1 Processor -- start 2024-03-30T13:13:12.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.619+0000 7f790f1da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6470 0x55e5b7d143b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.619+0000 7f790f1da740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7d3a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.619+0000 7f790f1da740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7d38aa0 0x55e5b7d4ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.619+0000 7f790f1da740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e5b7d1cb10 con 0x55e5b7cf6850 2024-03-30T13:13:12.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.619+0000 7f790f1da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e5b7c149d0 con 0x55e5b7cf6470 2024-03-30T13:13:12.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.619+0000 7f790f1da740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55e5b7d15890 con 0x55e5b7d38aa0 2024-03-30T13:13:12.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.619+0000 7f790f1da740 10 client.0 _ll_register_callbacks cb 0x55e5b7c50fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:12.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.619+0000 7f7909000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7d3a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.619+0000 7f7909000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7d3a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49448/0 (socket says 172.21.15.99:49448) 2024-03-30T13:13:12.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.619+0000 7f7909000640 1 -- 172.21.15.99:0/3458938342 learned_addr learned my addr 172.21.15.99:0/3458938342 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f790a400640 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7d38aa0 0x55e5b7d4ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f7909a00640 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6470 0x55e5b7d143b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f7909000640 1 -- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7d38aa0 msgr2=0x55e5b7d4ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f7909000640 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7d38aa0 0x55e5b7d4ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f7909000640 1 -- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6470 msgr2=0x55e5b7d143b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f7909000640 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6470 0x55e5b7d143b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f7909000640 1 -- 172.21.15.99:0/3458938342 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5b792d210 con 0x55e5b7cf6850 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f7909a00640 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6470 0x55e5b7d143b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f7909000640 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7d3a320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009870 tx=0x7f78f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbab6693750cf56c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f78eaa00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f78eaa00640 1 -- 172.21.15.99:0/3458938342 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0053030 con 0x55e5b7cf6850 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f78eaa00640 1 -- 172.21.15.99:0/3458938342 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f78f0004410 con 0x55e5b7cf6850 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.620+0000 7f790f1da740 1 -- 172.21.15.99:0/3458938342 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f0039960 con 0x55e5b7cf6850 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.621+0000 7f78eaa00640 1 -- 172.21.15.99:0/3458938342 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f78f0034050 con 0x55e5b7cf6850 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.621+0000 7f790f1da740 10 client.5436 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.621+0000 7f790f1da740 1 -- 172.21.15.99:0/3458938342 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e5b7a9a0b0 con 0x55e5b7cf6850 2024-03-30T13:13:12.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.621+0000 7f78eaa00640 1 -- 172.21.15.99:0/3458938342 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f0039960 con 0x55e5b7cf6850 2024-03-30T13:13:12.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.621+0000 7f78eaa00640 1 -- 172.21.15.99:0/3458938342 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f78f0003610 con 0x55e5b7cf6850 2024-03-30T13:13:12.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.621+0000 7f790f1da740 10 client.5436 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:12.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.621+0000 7f790f1da740 10 client.5436 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:12.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.621+0000 7f790f1da740 20 client.5436 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:12.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.621+0000 7f790f1da740 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e5b7d3e5e0 0x55e5b7d3ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.621+0000 7f790f1da740 4 client.5436 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:12.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.621+0000 7f790f1da740 1 -- 172.21.15.99:0/3458938342 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5b7c66870 con 0x55e5b7d3e5e0 2024-03-30T13:13:12.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.622+0000 7f7909a00640 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e5b7d3e5e0 0x55e5b7d3ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.623+0000 7f7909a00640 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e5b7d3e5e0 0x55e5b7d3ea30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=707e0da7056e22e8 server_cookie=807aefea8c50a89e in_seq=0 out_seq=0 2024-03-30T13:13:12.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.623+0000 7f78eaa00640 10 client.5436 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.624+0000 7f78eaa00640 1 -- 172.21.15.99:0/3458938342 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55e5b7c66870 con 0x55e5b7d3e5e0 2024-03-30T13:13:12.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.624+0000 7f78eaa00640 10 client.5436 handle_command_reply: tid=0 2024-03-30T13:13:12.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 1 client.5436 shutdown 2024-03-30T13:13:12.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 1 -- 172.21.15.99:0/3458938342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 msgr2=0x55e5b7d3a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7d3a320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009870 tx=0x7f78f0004730 comp rx=0 tx=0).stop 2024-03-30T13:13:12.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 1 -- 172.21.15.99:0/3458938342 shutdown_connections 2024-03-30T13:13:12.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7d38aa0 0x55e5b7d4ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7d3a320 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e5b7d3e5e0 0x55e5b7d3ea30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 1 --2- 172.21.15.99:0/3458938342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6470 0x55e5b7d143b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 1 -- 172.21.15.99:0/3458938342 >> 172.21.15.99:0/3458938342 conn(0x55e5b7cbcbe0 msgr2=0x55e5b7cefb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f78eaa00640 0 client.5436 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 1 -- 172.21.15.99:0/3458938342 shutdown_connections 2024-03-30T13:13:12.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 1 -- 172.21.15.99:0/3458938342 wait complete. 2024-03-30T13:13:12.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.625+0000 7f790f1da740 20 client.5436 trim_cache size 0 max 16384 2024-03-30T13:13:12.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.641+0000 7f790f1da740 1 Processor -- start 2024-03-30T13:13:12.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.641+0000 7f790f1da740 1 -- start start 2024-03-30T13:13:12.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790f1da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6470 0x55e5b7dada20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790f1da740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6850 0x55e5b7d30b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790f1da740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d38aa0 0x55e5b7d31060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790f1da740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7904200a40 con 0x55e5b7d38aa0 2024-03-30T13:13:12.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790f1da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f79041ffad0 con 0x55e5b7cf6470 2024-03-30T13:13:12.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790f1da740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f79040b1950 con 0x55e5b7cf6850 2024-03-30T13:13:12.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790a400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d38aa0 0x55e5b7d31060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790a400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d38aa0 0x55e5b7d31060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49462/0 (socket says 172.21.15.99:49462) 2024-03-30T13:13:12.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790a400640 1 -- 172.21.15.99:0/2727258873 learned_addr learned my addr 172.21.15.99:0/2727258873 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f7909a00640 1 --2- 172.21.15.99:0/2727258873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6470 0x55e5b7dada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790a400640 1 -- 172.21.15.99:0/2727258873 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6850 msgr2=0x55e5b7d30b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790a400640 1 --2- 172.21.15.99:0/2727258873 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6850 0x55e5b7d30b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790a400640 1 -- 172.21.15.99:0/2727258873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6470 msgr2=0x55e5b7dada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790a400640 1 --2- 172.21.15.99:0/2727258873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6470 0x55e5b7dada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.642+0000 7f790a400640 1 -- 172.21.15.99:0/2727258873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5b79062d0 con 0x55e5b7d38aa0 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.643+0000 7f790a400640 1 --2- 172.21.15.99:0/2727258873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d38aa0 0x55e5b7d31060 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f78fc007450 tx=0x7f78fc007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fe2b486b9ffb43 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.643+0000 7f78f5600640 1 -- 172.21.15.99:0/2727258873 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc01a070 con 0x55e5b7d38aa0 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.643+0000 7f78f5600640 1 -- 172.21.15.99:0/2727258873 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78fc001cc0 con 0x55e5b7d38aa0 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.643+0000 7f78f5600640 1 -- 172.21.15.99:0/2727258873 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc002090 con 0x55e5b7d38aa0 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.644+0000 7f790f1da740 1 -- 172.21.15.99:0/2727258873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d38aa0 msgr2=0x55e5b7d31060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.644+0000 7f790f1da740 1 --2- 172.21.15.99:0/2727258873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d38aa0 0x55e5b7d31060 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f78fc007450 tx=0x7f78fc007910 comp rx=0 tx=0).stop 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.644+0000 7f790f1da740 1 -- 172.21.15.99:0/2727258873 shutdown_connections 2024-03-30T13:13:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.644+0000 7f790f1da740 1 --2- 172.21.15.99:0/2727258873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7d38aa0 0x55e5b7d31060 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.644+0000 7f790f1da740 1 --2- 172.21.15.99:0/2727258873 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6850 0x55e5b7d30b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.644+0000 7f790f1da740 1 --2- 172.21.15.99:0/2727258873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7cf6470 0x55e5b7dada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.644+0000 7f790f1da740 1 -- 172.21.15.99:0/2727258873 >> 172.21.15.99:0/2727258873 conn(0x55e5b7cbcbe0 msgr2=0x55e5b7cebb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.644+0000 7f790f1da740 1 -- 172.21.15.99:0/2727258873 shutdown_connections 2024-03-30T13:13:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.644+0000 7f790f1da740 1 -- 172.21.15.99:0/2727258873 wait complete. 2024-03-30T13:13:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.645+0000 7f790f1da740 1 -- start start 2024-03-30T13:13:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.645+0000 7f790f1da740 1 Processor -- start 2024-03-30T13:13:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f790f1da740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6470 0x55e5b7d21920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f790f1da740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7cef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f790f1da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7d38aa0 0x55e5b7d22ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f790f1da740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e5b7c5b7d0 con 0x55e5b7cf6850 2024-03-30T13:13:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f790f1da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f790409d580 con 0x55e5b7d38aa0 2024-03-30T13:13:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f790f1da740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55e5b7d39c60 con 0x55e5b7cf6470 2024-03-30T13:13:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f790f1da740 10 client.0 _ll_register_callbacks cb 0x7f78f0051070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f7909000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7cef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f7909000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7cef7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49468/0 (socket says 172.21.15.99:49468) 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f7909000640 1 -- 172.21.15.99:0/2888294898 learned_addr learned my addr 172.21.15.99:0/2888294898 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f7909a00640 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6470 0x55e5b7d21920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f7909000640 1 -- 172.21.15.99:0/2888294898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6470 msgr2=0x55e5b7d21920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f7909000640 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6470 0x55e5b7d21920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f7909000640 1 -- 172.21.15.99:0/2888294898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7d38aa0 msgr2=0x55e5b7d22ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f7909000640 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7d38aa0 0x55e5b7d22ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.646+0000 7f7909000640 1 -- 172.21.15.99:0/2888294898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5b7cefd30 con 0x55e5b7cf6850 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.647+0000 7f7909000640 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7cef7f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009630 tx=0x7f78f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2468157849134554 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.647+0000 7f78eaa00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.647+0000 7f78eaa00640 1 -- 172.21.15.99:0/2888294898 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0053070 con 0x55e5b7cf6850 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.647+0000 7f78eaa00640 1 -- 172.21.15.99:0/2888294898 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f78f0003b10 con 0x55e5b7cf6850 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.647+0000 7f790f1da740 1 -- 172.21.15.99:0/2888294898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78fc001cc0 con 0x55e5b7cf6850 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.647+0000 7f78eaa00640 1 -- 172.21.15.99:0/2888294898 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f78f0039e20 con 0x55e5b7cf6850 2024-03-30T13:13:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.647+0000 7f790f1da740 10 client.5442 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.647+0000 7f790f1da740 1 -- 172.21.15.99:0/2888294898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e5b7dab550 con 0x55e5b7cf6850 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.647+0000 7f78eaa00640 1 -- 172.21.15.99:0/2888294898 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78fc001cc0 con 0x55e5b7cf6850 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.647+0000 7f78eaa00640 1 -- 172.21.15.99:0/2888294898 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f78f006f050 con 0x55e5b7cf6850 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.648+0000 7f790f1da740 10 client.5442 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.648+0000 7f790f1da740 10 client.5442 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.648+0000 7f790f1da740 20 client.5442 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.648+0000 7f790f1da740 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e5b7d23020 0x55e5b7d54030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.648+0000 7f790f1da740 4 client.5442 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628281}] 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.648+0000 7f790f1da740 1 -- 172.21.15.99:0/2888294898 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628281}) -- 0x55e5b7c60bc0 con 0x55e5b7d23020 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.648+0000 7f7909a00640 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e5b7d23020 0x55e5b7d54030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.649+0000 7f7909a00640 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e5b7d23020 0x55e5b7d54030 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3531ed0b6cbc21b0 server_cookie=659fd9f02cbc7fdc in_seq=0 out_seq=0 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.649+0000 7f78eaa00640 10 client.5442 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f78eaa00640 1 -- 172.21.15.99:0/2888294898 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3963 (crc 0 0 0) 0x55e5b7c60bc0 con 0x55e5b7d23020 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f78eaa00640 10 client.5442 handle_command_reply: tid=0 2024-03-30T13:13:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 1 client.5442 shutdown 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 1 -- 172.21.15.99:0/2888294898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 msgr2=0x55e5b7cef7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7cef7f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009630 tx=0x7f78f00046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 1 -- 172.21.15.99:0/2888294898 shutdown_connections 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e5b7d23020 0x55e5b7d54030 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e5b7d38aa0 0x55e5b7d22ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e5b7cf6850 0x55e5b7cef7f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 1 --2- 172.21.15.99:0/2888294898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e5b7cf6470 0x55e5b7d21920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f78eaa00640 0 client.5442 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 1 -- 172.21.15.99:0/2888294898 >> 172.21.15.99:0/2888294898 conn(0x55e5b7cbcbe0 msgr2=0x55e5b7d13070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 1 -- 172.21.15.99:0/2888294898 shutdown_connections 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 1 -- 172.21.15.99:0/2888294898 wait complete. 2024-03-30T13:13:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.650+0000 7f790f1da740 20 client.5442 trim_cache size 0 max 16384 2024-03-30T13:13:12.658 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ceph/Makefile", 2024-03-30T13:13:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628281, 2024-03-30T13:13:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.354000+0000", 2024-03-30T13:13:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.317960+0000", 2024-03-30T13:13:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 356, 2024-03-30T13:13:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.317960+0000", 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 356, 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.354000+0000" 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 356, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.354000+0000" 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 164, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 4, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.403311+0000", 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 82, 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:12.670 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:12.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 -- 172.21.15.99:0/2940379398 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f78e406c530 msgr2=0x7f78e406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f78e406c530 0x7f78e406e9f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78f0036000 tx=0x7f78f003b040 comp rx=0 tx=0).stop 2024-03-30T13:13:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 -- 172.21.15.99:0/2940379398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79040acf20 msgr2=0x7f79041e5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79040acf20 0x7f79041e5db0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f78f800c7f0 tx=0x7f78f800cbf0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 -- 172.21.15.99:0/2940379398 shutdown_connections 2024-03-30T13:13:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f78e406c530 0x7f78e406e9f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f790415ca80 0x7f79041e6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79040cf330 0x7f790414da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 --2- 172.21.15.99:0/2940379398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79040acf20 0x7f79041e5db0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 -- 172.21.15.99:0/2940379398 >> 172.21.15.99:0/2940379398 conn(0x7f790406bb40 msgr2=0x7f790406ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 -- 172.21.15.99:0/2940379398 shutdown_connections 2024-03-30T13:13:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.651+0000 7f790ae00640 1 -- 172.21.15.99:0/2940379398 wait complete. 2024-03-30T13:13:12.672 DEBUG:tasks.cephfs.test_uninlining:getting inode info #3 of 23:1099511628287 2024-03-30T13:13:12.672 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628287 2024-03-30T13:13:12.673 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628287 2024-03-30T13:13:12.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.882+0000 7fd0a5400640 1 Processor -- start 2024-03-30T13:13:12.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.882+0000 7fd0a5400640 1 -- start start 2024-03-30T13:13:12.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.884+0000 7fd0a5400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0a015e920 0x7fd0a00d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.884+0000 7fd0a5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd0a00d16a0 0x7fd0a00d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.884+0000 7fd0a5400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a00d3780 con 0x7fd0a00cfde0 2024-03-30T13:13:12.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.884+0000 7fd0a5400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd0a015ed00 con 0x7fd0a00d16a0 2024-03-30T13:13:12.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.884+0000 7fd0a5400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a00d21e0 con 0x7fd0a015e920 2024-03-30T13:13:12.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.884+0000 7fd09f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd0a00d16a0 0x7fd0a00d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.884+0000 7fd09f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd0a00d16a0 0x7fd0a00d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49482/0 (socket says 172.21.15.99:49482) 2024-03-30T13:13:12.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.884+0000 7fd09f200640 1 -- 172.21.15.99:0/189597315 learned_addr learned my addr 172.21.15.99:0/189597315 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.885+0000 7fd09e800640 1 --2- 172.21.15.99:0/189597315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0a015e920 0x7fd0a00d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.885+0000 7fd09f200640 1 -- 172.21.15.99:0/189597315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0a015e920 msgr2=0x7fd0a00d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.885+0000 7fd09f200640 1 --2- 172.21.15.99:0/189597315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0a015e920 0x7fd0a00d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.885+0000 7fd09f200640 1 -- 172.21.15.99:0/189597315 >> v1:172.21.15.181:6789/0 conn(0x7fd0a00cfde0 legacy=0x7fd0a00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.885+0000 7fd09f200640 1 -- 172.21.15.99:0/189597315 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a00d2480 con 0x7fd0a00d16a0 2024-03-30T13:13:12.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.886+0000 7fd09f200640 1 --2- 172.21.15.99:0/189597315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a00d16a0 0x7fd0a00d0240 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd098009870 tx=0x7fd09802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe71ea7fd7f36f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.886+0000 7fd09de00640 1 -- 172.21.15.99:0/189597315 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098035020 con 0x7fd0a00d16a0 2024-03-30T13:13:12.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.886+0000 7fd09de00640 1 -- 172.21.15.99:0/189597315 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd098031640 con 0x7fd0a00d16a0 2024-03-30T13:13:12.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.886+0000 7fd09de00640 1 -- 172.21.15.99:0/189597315 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09802d040 con 0x7fd0a00d16a0 2024-03-30T13:13:12.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.887+0000 7fd0a5400640 1 -- 172.21.15.99:0/189597315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a00d16a0 msgr2=0x7fd0a00d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.887+0000 7fd0a5400640 1 --2- 172.21.15.99:0/189597315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a00d16a0 0x7fd0a00d0240 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd098009870 tx=0x7fd09802b8f0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.887+0000 7fd0a5400640 1 -- 172.21.15.99:0/189597315 shutdown_connections 2024-03-30T13:13:12.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.887+0000 7fd0a5400640 1 --2- 172.21.15.99:0/189597315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a00d16a0 0x7fd0a00d0240 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.887+0000 7fd0a5400640 1 --2- 172.21.15.99:0/189597315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0a015e920 0x7fd0a00d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.887+0000 7fd0a5400640 1 -- 172.21.15.99:0/189597315 >> 172.21.15.99:0/189597315 conn(0x7fd0a008bfc0 msgr2=0x7fd0a00d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.887+0000 7fd0a5400640 1 -- 172.21.15.99:0/189597315 shutdown_connections 2024-03-30T13:13:12.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.887+0000 7fd0a5400640 1 -- 172.21.15.99:0/189597315 wait complete. 2024-03-30T13:13:12.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.889+0000 7fd0a5400640 1 Processor -- start 2024-03-30T13:13:12.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.889+0000 7fd0a5400640 1 -- start start 2024-03-30T13:13:12.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.890+0000 7fd0a5400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0a00cfde0 0x7fd0a01f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.890+0000 7fd0a5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a00d16a0 0x7fd0a00cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.890+0000 7fd0a5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0a015e920 0x7fd0a014ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.890+0000 7fd0a5400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a00d2d20 con 0x7fd0a00d16a0 2024-03-30T13:13:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.890+0000 7fd0a5400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a00d2a40 con 0x7fd0a015e920 2024-03-30T13:13:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.890+0000 7fd0a5400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a00d4ef0 con 0x7fd0a00cfde0 2024-03-30T13:13:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.890+0000 7fd095e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a00d16a0 0x7fd0a00cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.890+0000 7fd095e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a00d16a0 0x7fd0a00cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49498/0 (socket says 172.21.15.99:49498) 2024-03-30T13:13:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.890+0000 7fd095e00640 1 -- 172.21.15.99:0/3290552452 learned_addr learned my addr 172.21.15.99:0/3290552452 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.890+0000 7fd09e800640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0a00cfde0 0x7fd0a01f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd09f200640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0a015e920 0x7fd0a014ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd095e00640 1 -- 172.21.15.99:0/3290552452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0a00cfde0 msgr2=0x7fd0a01f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd095e00640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0a00cfde0 0x7fd0a01f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd095e00640 1 -- 172.21.15.99:0/3290552452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0a015e920 msgr2=0x7fd0a014ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd095e00640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0a015e920 0x7fd0a014ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd095e00640 1 -- 172.21.15.99:0/3290552452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a01f8380 con 0x7fd0a00d16a0 2024-03-30T13:13:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd09e800640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0a00cfde0 0x7fd0a01f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd095e00640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a00d16a0 0x7fd0a00cab30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd08800b3f0 tx=0x7fd08800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd097400640 1 -- 172.21.15.99:0/3290552452 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088015020 con 0x7fd0a00d16a0 2024-03-30T13:13:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd097400640 1 -- 172.21.15.99:0/3290552452 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd088011830 con 0x7fd0a00d16a0 2024-03-30T13:13:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd0a5400640 1 -- 172.21.15.99:0/3290552452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a01f8660 con 0x7fd0a00d16a0 2024-03-30T13:13:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd097400640 1 -- 172.21.15.99:0/3290552452 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088011c20 con 0x7fd0a00d16a0 2024-03-30T13:13:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.891+0000 7fd0a5400640 1 -- 172.21.15.99:0/3290552452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a00cb6e0 con 0x7fd0a00d16a0 2024-03-30T13:13:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.893+0000 7fd097400640 1 -- 172.21.15.99:0/3290552452 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd088018020 con 0x7fd0a00d16a0 2024-03-30T13:13:12.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.894+0000 7fd097400640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd07c06c530 0x7fd07c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.894+0000 7fd097400640 1 -- 172.21.15.99:0/3290552452 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fd08808b340 con 0x7fd0a00d16a0 2024-03-30T13:13:12.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.895+0000 7fd09e800640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd07c06c530 0x7fd07c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.895+0000 7fd0a8056740 1 Processor -- start 2024-03-30T13:13:12.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.895+0000 7fd0a8056740 1 -- start start 2024-03-30T13:13:12.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.895+0000 7fd09e800640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd07c06c530 0x7fd07c06e9f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd090007330 tx=0x7fd09000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.896+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb290 0x5641399f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.896+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399f2300 0x5641399ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.896+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5641399cb670 0x5641399ca810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.896+0000 7fd0a8056740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56413992e330 con 0x5641399f2300 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.896+0000 7fd0a8056740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5641398d6620 con 0x5641399cb290 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.896+0000 7fd0a8056740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56413992a440 con 0x5641399cb670 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.896+0000 7fd095e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399f2300 0x5641399ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.896+0000 7fd095e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399f2300 0x5641399ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49508/0 (socket says 172.21.15.99:49508) 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.896+0000 7fd095e00640 1 -- 172.21.15.99:0/3365234762 learned_addr learned my addr 172.21.15.99:0/3365234762 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.897+0000 7fd095e00640 1 -- 172.21.15.99:0/3365234762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5641399cb670 msgr2=0x5641399ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.897+0000 7fd095e00640 1 --2- 172.21.15.99:0/3365234762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5641399cb670 0x5641399ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.897+0000 7fd095e00640 1 -- 172.21.15.99:0/3365234762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb290 msgr2=0x5641399f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.897+0000 7fd095e00640 1 --2- 172.21.15.99:0/3365234762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb290 0x5641399f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.897+0000 7fd095e00640 1 -- 172.21.15.99:0/3365234762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56413970e920 con 0x5641399f2300 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.897+0000 7fd095e00640 1 --2- 172.21.15.99:0/3365234762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399f2300 0x5641399ca2d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd088061880 tx=0x7fd088059290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4569b39929b79 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.897+0000 7fd08f000640 1 -- 172.21.15.99:0/3365234762 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088011dc0 con 0x5641399f2300 2024-03-30T13:13:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.897+0000 7fd08f000640 1 -- 172.21.15.99:0/3365234762 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd08808b070 con 0x5641399f2300 2024-03-30T13:13:12.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.897+0000 7fd08f000640 1 -- 172.21.15.99:0/3365234762 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088055840 con 0x5641399f2300 2024-03-30T13:13:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.898+0000 7fd0a8056740 1 -- 172.21.15.99:0/3365234762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399f2300 msgr2=0x5641399ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.898+0000 7fd0a8056740 1 --2- 172.21.15.99:0/3365234762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399f2300 0x5641399ca2d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd088061880 tx=0x7fd088059290 comp rx=0 tx=0).stop 2024-03-30T13:13:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.898+0000 7fd0a8056740 1 -- 172.21.15.99:0/3365234762 shutdown_connections 2024-03-30T13:13:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.898+0000 7fd0a8056740 1 --2- 172.21.15.99:0/3365234762 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5641399cb670 0x5641399ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.898+0000 7fd0a8056740 1 --2- 172.21.15.99:0/3365234762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399f2300 0x5641399ca2d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.898+0000 7fd0a8056740 1 --2- 172.21.15.99:0/3365234762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb290 0x5641399f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.898+0000 7fd0a8056740 1 -- 172.21.15.99:0/3365234762 >> 172.21.15.99:0/3365234762 conn(0x564139991be0 msgr2=0x564139a0ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.898+0000 7fd0a8056740 1 -- 172.21.15.99:0/3365234762 shutdown_connections 2024-03-30T13:13:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.898+0000 7fd0a8056740 1 -- 172.21.15.99:0/3365234762 wait complete. 2024-03-30T13:13:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.899+0000 7fd0a8056740 1 -- start start 2024-03-30T13:13:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.899+0000 7fd0a8056740 1 Processor -- start 2024-03-30T13:13:12.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.900+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a13ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.900+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb670 0x564139a103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.900+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564139a141e0 0x564139a10910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.900+0000 7fd0a8056740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5641399f1930 con 0x5641399cb290 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.900+0000 7fd0a8056740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5641398e99d0 con 0x5641399cb670 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.900+0000 7fd0a8056740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5641399ea6b0 con 0x564139a141e0 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.900+0000 7fd0a8056740 10 client.0 _ll_register_callbacks cb 0x564139925fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.900+0000 7fd09e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a13ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.900+0000 7fd09e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a13ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49510/0 (socket says 172.21.15.99:49510) 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.900+0000 7fd09e800640 1 -- 172.21.15.99:0/2712421818 learned_addr learned my addr 172.21.15.99:0/2712421818 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd095e00640 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb670 0x564139a103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd09e800640 1 -- 172.21.15.99:0/2712421818 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564139a141e0 msgr2=0x564139a10910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd09e800640 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564139a141e0 0x564139a10910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd09e800640 1 -- 172.21.15.99:0/2712421818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb670 msgr2=0x564139a103d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd09e800640 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb670 0x564139a103d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd09e800640 1 -- 172.21.15.99:0/2712421818 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564139602210 con 0x5641399cb290 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd09e800640 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a13ca0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd0900042e0 tx=0x7fd0900046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7e83ece4182f41 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd083400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd083400640 1 -- 172.21.15.99:0/2712421818 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090004810 con 0x5641399cb290 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd083400640 1 -- 172.21.15.99:0/2712421818 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fd090024b50 con 0x5641399cb290 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd0a8056740 1 -- 172.21.15.99:0/2712421818 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd08808b070 con 0x5641399cb290 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.901+0000 7fd083400640 1 -- 172.21.15.99:0/2712421818 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd090024d50 con 0x5641399cb290 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.902+0000 7fd0a8056740 10 client.5454 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.902+0000 7fd0a8056740 1 -- 172.21.15.99:0/2712421818 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x56413976f0b0 con 0x5641399cb290 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.902+0000 7fd083400640 1 -- 172.21.15.99:0/2712421818 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd08808b070 con 0x5641399cb290 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.902+0000 7fd083400640 1 -- 172.21.15.99:0/2712421818 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fd090019820 con 0x5641399cb290 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.902+0000 7fd0a8056740 10 client.5454 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.902+0000 7fd0a8056740 10 client.5454 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.902+0000 7fd0a8056740 20 client.5454 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:12.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.902+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564139a12730 0x564139a2d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.902+0000 7fd0a8056740 4 client.5454 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:12.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.902+0000 7fd0a8056740 1 -- 172.21.15.99:0/2712421818 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56413993b870 con 0x564139a12730 2024-03-30T13:13:12.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.903+0000 7fd095e00640 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564139a12730 0x564139a2d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.904+0000 7fd095e00640 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564139a12730 0x564139a2d180 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a709aaf8bb4b4ddc server_cookie=1411e3c8f4bc0957 in_seq=0 out_seq=0 2024-03-30T13:13:12.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.904+0000 7fd083400640 10 client.5454 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd083400640 1 -- 172.21.15.99:0/2712421818 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x56413993b870 con 0x564139a12730 2024-03-30T13:13:12.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd083400640 10 client.5454 handle_command_reply: tid=0 2024-03-30T13:13:12.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd0a8056740 1 client.5454 shutdown 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd0a8056740 1 -- 172.21.15.99:0/2712421818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 msgr2=0x564139a13ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a13ca0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd0900042e0 tx=0x7fd0900046e0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd0a8056740 1 -- 172.21.15.99:0/2712421818 shutdown_connections 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564139a141e0 0x564139a10910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564139a12730 0x564139a2d180 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb670 0x564139a103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2712421818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a13ca0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd0a8056740 1 -- 172.21.15.99:0/2712421818 >> 172.21.15.99:0/2712421818 conn(0x564139991be0 msgr2=0x5641399f4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd083400640 0 client.5454 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd0a8056740 1 -- 172.21.15.99:0/2712421818 shutdown_connections 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.906+0000 7fd0a8056740 1 -- 172.21.15.99:0/2712421818 wait complete. 2024-03-30T13:13:12.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.907+0000 7fd0a8056740 20 client.5454 trim_cache size 0 max 16384 2024-03-30T13:13:12.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.922+0000 7fd0a8056740 1 Processor -- start 2024-03-30T13:13:12.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.922+0000 7fd0a8056740 1 -- start start 2024-03-30T13:13:12.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.923+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5641399cb290 0x5641399e7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.923+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb670 0x564139a0cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.923+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564139a141e0 0x564139a0d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.923+0000 7fd0a8056740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a0200f10 con 0x5641399cb670 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.923+0000 7fd0a8056740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a01ffff0 con 0x564139a141e0 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.923+0000 7fd0a8056740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a01e91a0 con 0x5641399cb290 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.923+0000 7fd095e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb670 0x564139a0cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.923+0000 7fd095e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb670 0x564139a0cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49518/0 (socket says 172.21.15.99:49518) 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.923+0000 7fd095e00640 1 -- 172.21.15.99:0/397490307 learned_addr learned my addr 172.21.15.99:0/397490307 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.924+0000 7fd095e00640 1 -- 172.21.15.99:0/397490307 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5641399cb290 msgr2=0x5641399e7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.924+0000 7fd095e00640 1 --2- 172.21.15.99:0/397490307 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5641399cb290 0x5641399e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.924+0000 7fd095e00640 1 -- 172.21.15.99:0/397490307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564139a141e0 msgr2=0x564139a0d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.924+0000 7fd09f200640 1 --2- 172.21.15.99:0/397490307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564139a141e0 0x564139a0d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.924+0000 7fd095e00640 1 --2- 172.21.15.99:0/397490307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564139a141e0 0x564139a0d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.924+0000 7fd095e00640 1 -- 172.21.15.99:0/397490307 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641395db2d0 con 0x5641399cb670 2024-03-30T13:13:12.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.924+0000 7fd095e00640 1 --2- 172.21.15.99:0/397490307 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb670 0x564139a0cac0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd08800bdb0 tx=0x7fd08805b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ade6a3cf4a94007 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.924+0000 7fd08e600640 1 -- 172.21.15.99:0/397490307 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088011dc0 con 0x5641399cb670 2024-03-30T13:13:12.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.924+0000 7fd08e600640 1 -- 172.21.15.99:0/397490307 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd088076070 con 0x5641399cb670 2024-03-30T13:13:12.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.924+0000 7fd08e600640 1 -- 172.21.15.99:0/397490307 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0880574d0 con 0x5641399cb670 2024-03-30T13:13:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.925+0000 7fd0a8056740 1 -- 172.21.15.99:0/397490307 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb670 msgr2=0x564139a0cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.925+0000 7fd0a8056740 1 --2- 172.21.15.99:0/397490307 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb670 0x564139a0cac0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd08800bdb0 tx=0x7fd08805b000 comp rx=0 tx=0).stop 2024-03-30T13:13:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.925+0000 7fd0a8056740 1 -- 172.21.15.99:0/397490307 shutdown_connections 2024-03-30T13:13:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.925+0000 7fd0a8056740 1 --2- 172.21.15.99:0/397490307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564139a141e0 0x564139a0d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.925+0000 7fd0a8056740 1 --2- 172.21.15.99:0/397490307 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb670 0x564139a0cac0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.925+0000 7fd0a8056740 1 --2- 172.21.15.99:0/397490307 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5641399cb290 0x5641399e7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.925+0000 7fd0a8056740 1 -- 172.21.15.99:0/397490307 >> 172.21.15.99:0/397490307 conn(0x564139991be0 msgr2=0x564139a0e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.925+0000 7fd0a8056740 1 -- 172.21.15.99:0/397490307 shutdown_connections 2024-03-30T13:13:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.925+0000 7fd0a8056740 1 -- 172.21.15.99:0/397490307 wait complete. 2024-03-30T13:13:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.926+0000 7fd0a8056740 1 -- start start 2024-03-30T13:13:12.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.926+0000 7fd0a8056740 1 Processor -- start 2024-03-30T13:13:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.927+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a8b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.927+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb670 0x564139a1e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.927+0000 7fd0a8056740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564139a141e0 0x564139a1ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.927+0000 7fd0a8056740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5641399c7fd0 con 0x5641399cb290 2024-03-30T13:13:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.927+0000 7fd0a8056740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a01e97f0 con 0x5641399cb670 2024-03-30T13:13:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.927+0000 7fd0a8056740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5641399f9520 con 0x564139a141e0 2024-03-30T13:13:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.927+0000 7fd0a8056740 10 client.0 _ll_register_callbacks cb 0x7fd090009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.927+0000 7fd09e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a8b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.927+0000 7fd09e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a8b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49526/0 (socket says 172.21.15.99:49526) 2024-03-30T13:13:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.927+0000 7fd09e800640 1 -- 172.21.15.99:0/2005931087 learned_addr learned my addr 172.21.15.99:0/2005931087 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.928+0000 7fd09f200640 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564139a141e0 0x564139a1ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.928+0000 7fd09e800640 1 -- 172.21.15.99:0/2005931087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564139a141e0 msgr2=0x564139a1ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.928+0000 7fd09e800640 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564139a141e0 0x564139a1ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.928+0000 7fd09e800640 1 -- 172.21.15.99:0/2005931087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb670 msgr2=0x564139a1e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.928+0000 7fd09e800640 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb670 0x564139a1e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.928+0000 7fd09e800640 1 -- 172.21.15.99:0/2005931087 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641399c9b30 con 0x5641399cb290 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.928+0000 7fd09e800640 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a8b5f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd090007fd0 tx=0x7fd090013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b650e8a01a6fe673 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.928+0000 7fd083400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.928+0000 7fd083400640 1 -- 172.21.15.99:0/2005931087 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090023420 con 0x5641399cb290 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.928+0000 7fd083400640 1 -- 172.21.15.99:0/2005931087 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fd0900235c0 con 0x5641399cb290 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.928+0000 7fd0a8056740 1 -- 172.21.15.99:0/2005931087 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd088076070 con 0x5641399cb290 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.929+0000 7fd083400640 1 -- 172.21.15.99:0/2005931087 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd09003c050 con 0x5641399cb290 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.929+0000 7fd0a8056740 10 client.5460 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.929+0000 7fd0a8056740 1 -- 172.21.15.99:0/2005931087 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5641399cc530 con 0x5641399cb290 2024-03-30T13:13:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.929+0000 7fd083400640 1 -- 172.21.15.99:0/2005931087 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd088076070 con 0x5641399cb290 2024-03-30T13:13:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.929+0000 7fd083400640 1 -- 172.21.15.99:0/2005931087 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fd09003f020 con 0x5641399cb290 2024-03-30T13:13:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.929+0000 7fd0a8056740 10 client.5460 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.929+0000 7fd0a8056740 10 client.5460 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.929+0000 7fd0a8056740 20 client.5460 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.929+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564139a105c0 0x5641399c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.929+0000 7fd0a8056740 4 client.5460 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628287}] 2024-03-30T13:13:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.929+0000 7fd0a8056740 1 -- 172.21.15.99:0/2005931087 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628287}) -- 0x564139935bc0 con 0x564139a105c0 2024-03-30T13:13:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.930+0000 7fd095e00640 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564139a105c0 0x5641399c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.931+0000 7fd095e00640 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564139a105c0 0x5641399c9ec0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f185a225329d9792 server_cookie=a52d8370096d04ff in_seq=0 out_seq=0 2024-03-30T13:13:12.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.931+0000 7fd083400640 10 client.5460 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.931+0000 7fd083400640 1 -- 172.21.15.99:0/2005931087 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3968 (crc 0 0 0) 0x564139935bc0 con 0x564139a105c0 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.931+0000 7fd083400640 10 client.5460 handle_command_reply: tid=0 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.931+0000 7fd0a8056740 1 client.5460 shutdown 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.931+0000 7fd0a8056740 1 -- 172.21.15.99:0/2005931087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 msgr2=0x564139a8b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.931+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a8b5f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd090007fd0 tx=0x7fd090013000 comp rx=0 tx=0).stop 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a8056740 1 -- 172.21.15.99:0/2005931087 shutdown_connections 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564139a141e0 0x564139a1ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564139a105c0 0x5641399c9ec0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5641399cb670 0x564139a1e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a8056740 1 --2- 172.21.15.99:0/2005931087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5641399cb290 0x564139a8b5f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd083400640 0 client.5460 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a8056740 1 -- 172.21.15.99:0/2005931087 >> 172.21.15.99:0/2005931087 conn(0x564139991be0 msgr2=0x5641399f1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a8056740 1 -- 172.21.15.99:0/2005931087 shutdown_connections 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a8056740 1 -- 172.21.15.99:0/2005931087 wait complete. 2024-03-30T13:13:12.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a8056740 20 client.5460 trim_cache size 0 max 16384 2024-03-30T13:13:12.938 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ceph/ceph_frag.c", 2024-03-30T13:13:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628287, 2024-03-30T13:13:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.379959+0000", 2024-03-30T13:13:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.333960+0000", 2024-03-30T13:13:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 401, 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.333960+0000", 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 401, 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.379959+0000" 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 401, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.379959+0000" 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 170, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 16, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.427932+0000", 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 110, 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:12.949 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:12.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a5400640 1 -- 172.21.15.99:0/3290552452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd07c06c530 msgr2=0x7fd07c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a5400640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd07c06c530 0x7fd07c06e9f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd090007330 tx=0x7fd09000b040 comp rx=0 tx=0).stop 2024-03-30T13:13:12.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a5400640 1 -- 172.21.15.99:0/3290552452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a00d16a0 msgr2=0x7fd0a00cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.932+0000 7fd0a5400640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a00d16a0 0x7fd0a00cab30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd08800b3f0 tx=0x7fd08800b8b0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.933+0000 7fd0a5400640 1 -- 172.21.15.99:0/3290552452 shutdown_connections 2024-03-30T13:13:12.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.933+0000 7fd0a5400640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd07c06c530 0x7fd07c06e9f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.933+0000 7fd0a5400640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0a015e920 0x7fd0a014ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.933+0000 7fd0a5400640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a00d16a0 0x7fd0a00cab30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.933+0000 7fd0a5400640 1 --2- 172.21.15.99:0/3290552452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0a00cfde0 0x7fd0a01f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.933+0000 7fd0a5400640 1 -- 172.21.15.99:0/3290552452 >> 172.21.15.99:0/3290552452 conn(0x7fd0a008bfc0 msgr2=0x7fd0a00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.933+0000 7fd0a5400640 1 -- 172.21.15.99:0/3290552452 shutdown_connections 2024-03-30T13:13:12.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:12.933+0000 7fd0a5400640 1 -- 172.21.15.99:0/3290552452 wait complete. 2024-03-30T13:13:12.953 DEBUG:tasks.cephfs.test_uninlining:getting inode info #4 of 23:1099511628294 2024-03-30T13:13:12.953 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628294 2024-03-30T13:13:12.954 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628294 2024-03-30T13:13:13.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.157+0000 7fc559400640 1 Processor -- start 2024-03-30T13:13:13.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.157+0000 7fc559400640 1 -- start start 2024-03-30T13:13:13.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.158+0000 7fc559400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5540ca950 0x7fc5540b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.158+0000 7fc559400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5540cadb0 con 0x7fc5540b26f0 2024-03-30T13:13:13.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.158+0000 7fc559400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5540c6470 con 0x7fc55415b3d0 2024-03-30T13:13:13.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.158+0000 7fc559400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc5540c6240 con 0x7fc5540ca950 2024-03-30T13:13:13.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.159+0000 7fc553200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc5540b26f0 0x7fc55415be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49264/0 (socket says 172.21.15.99:49264) 2024-03-30T13:13:13.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.159+0000 7fc553200640 1 -- 172.21.15.99:0/1859423875 learned_addr learned my addr 172.21.15.99:0/1859423875 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:13.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.159+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684180380 0 0) 0x7fc5540cadb0 con 0x7fc5540b26f0 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.159+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc538003520 con 0x7fc5540b26f0 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.159+0000 7fc551e00640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5540ca950 0x7fc5540b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.159+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3186978693 0 0) 0x7fc538003520 con 0x7fc5540b26f0 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5540ca950 msgr2=0x7fc5540b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5540ca950 0x7fc5540b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 >> v1:172.21.15.181:6789/0 conn(0x7fc55415b3d0 legacy=0x7fc5540b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5540c6750 con 0x7fc5540b26f0 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fc54c001a10 con 0x7fc5540b26f0 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551e00640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5540ca950 0x7fc5540b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 >> v1:172.21.15.99:6789/0 conn(0x7fc5540b26f0 legacy=0x7fc55415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5380039e0 0x7fc538003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 0x7fc538004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5540ca950 0x7fc53800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc5380054e0 con 0x7fc538004800 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc538005690 con 0x7fc5380039e0 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc53800bf50 con 0x7fc5540ca950 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551e00640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 0x7fc538004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc552800640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5380039e0 0x7fc538003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551e00640 1 -- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5540ca950 msgr2=0x7fc53800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551e00640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5540ca950 0x7fc53800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551e00640 1 -- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5380039e0 msgr2=0x7fc538003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551e00640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5380039e0 0x7fc538003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.160+0000 7fc551e00640 1 -- 172.21.15.99:0/1859423875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc538003520 con 0x7fc538004800 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.161+0000 7fc552800640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5380039e0 0x7fc538003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.162+0000 7fc551e00640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 0x7fc538004c80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc54000aab0 tx=0x7fc538005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7077c8184e061c31 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.162+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54000a650 con 0x7fc538004800 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.162+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54002f640 con 0x7fc538004800 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.162+0000 7fc551400640 1 -- 172.21.15.99:0/1859423875 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54002fa10 con 0x7fc538004800 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.162+0000 7fc559400640 1 -- 172.21.15.99:0/1859423875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 msgr2=0x7fc538004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.162+0000 7fc559400640 1 --2- 172.21.15.99:0/1859423875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 0x7fc538004c80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc54000aab0 tx=0x7fc538005830 comp rx=0 tx=0).stop 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.162+0000 7fc553200640 1 -- 172.21.15.99:0/1859423875 reap_dead start 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.162+0000 7fc559400640 1 -- 172.21.15.99:0/1859423875 shutdown_connections 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.163+0000 7fc559400640 1 -- 172.21.15.99:0/1859423875 >> 172.21.15.99:0/1859423875 conn(0x7fc5540d0450 msgr2=0x7fc5540d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.163+0000 7fc559400640 1 -- 172.21.15.99:0/1859423875 shutdown_connections 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.163+0000 7fc559400640 1 -- 172.21.15.99:0/1859423875 wait complete. 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.164+0000 7fc559400640 1 Processor -- start 2024-03-30T13:13:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.164+0000 7fc559400640 1 -- start start 2024-03-30T13:13:13.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.165+0000 7fc559400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 0x7fc554156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.165+0000 7fc559400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5540c72b0 0x7fc5540ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.165+0000 7fc559400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc554158dc0 0x7fc554072820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.165+0000 7fc559400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540b2b30 con 0x7fc538004800 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.165+0000 7fc559400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540c7080 con 0x7fc5540c72b0 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.165+0000 7fc559400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc5540c6d10 con 0x7fc554158dc0 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.166+0000 7fc552800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 0x7fc554156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.166+0000 7fc552800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 0x7fc554156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49544/0 (socket says 172.21.15.99:49544) 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.166+0000 7fc552800640 1 -- 172.21.15.99:0/1787634878 learned_addr learned my addr 172.21.15.99:0/1787634878 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.166+0000 7fc551e00640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5540c72b0 0x7fc5540ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.166+0000 7fc552800640 1 -- 172.21.15.99:0/1787634878 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc554158dc0 msgr2=0x7fc554072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.166+0000 7fc552800640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc554158dc0 0x7fc554072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.166+0000 7fc552800640 1 -- 172.21.15.99:0/1787634878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5540c72b0 msgr2=0x7fc5540ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.166+0000 7fc552800640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5540c72b0 0x7fc5540ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.166+0000 7fc552800640 1 -- 172.21.15.99:0/1787634878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5540ca680 con 0x7fc538004800 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.166+0000 7fc552800640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 0x7fc554156df0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc54400d7a0 tx=0x7fc54400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.167+0000 7fc54aa00640 1 -- 172.21.15.99:0/1787634878 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544005070 con 0x7fc538004800 2024-03-30T13:13:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.167+0000 7fc54aa00640 1 -- 172.21.15.99:0/1787634878 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc544005210 con 0x7fc538004800 2024-03-30T13:13:13.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.167+0000 7fc54aa00640 1 -- 172.21.15.99:0/1787634878 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544007030 con 0x7fc538004800 2024-03-30T13:13:13.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.167+0000 7fc559400640 1 -- 172.21.15.99:0/1787634878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5540c7850 con 0x7fc538004800 2024-03-30T13:13:13.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.167+0000 7fc559400640 1 -- 172.21.15.99:0/1787634878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5541565f0 con 0x7fc538004800 2024-03-30T13:13:13.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.169+0000 7fc54aa00640 1 -- 172.21.15.99:0/1787634878 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc54401a020 con 0x7fc538004800 2024-03-30T13:13:13.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.170+0000 7fc54aa00640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53406c530 0x7fc53406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.170+0000 7fc54aa00640 1 -- 172.21.15.99:0/1787634878 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc54408afc0 con 0x7fc538004800 2024-03-30T13:13:13.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.171+0000 7fc551e00640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53406c530 0x7fc53406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.171+0000 7fc55c183740 1 Processor -- start 2024-03-30T13:13:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.171+0000 7fc55c183740 1 -- start start 2024-03-30T13:13:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.171+0000 7fc551e00640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53406c530 0x7fc53406e9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc540036000 tx=0x7fc540031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.172+0000 7fc55c183740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d558030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.172+0000 7fc55c183740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d57e230 0x55ce1d599b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.172+0000 7fc55c183740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d581580 0x55ce1d579ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.172+0000 7fc55c183740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55ce1d4ba330 con 0x55ce1d5811a0 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.172+0000 7fc55c183740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ce1d462620 con 0x55ce1d57e230 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.172+0000 7fc55c183740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ce1d4b6440 con 0x55ce1d581580 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.172+0000 7fc552800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d558030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.172+0000 7fc552800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d558030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49550/0 (socket says 172.21.15.99:49550) 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.172+0000 7fc552800640 1 -- 172.21.15.99:0/2525904320 learned_addr learned my addr 172.21.15.99:0/2525904320 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.173+0000 7fc552800640 1 -- 172.21.15.99:0/2525904320 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d581580 msgr2=0x55ce1d579ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.173+0000 7fc552800640 1 --2- 172.21.15.99:0/2525904320 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d581580 0x55ce1d579ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.173+0000 7fc552800640 1 -- 172.21.15.99:0/2525904320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d57e230 msgr2=0x55ce1d599b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.173+0000 7fc552800640 1 --2- 172.21.15.99:0/2525904320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d57e230 0x55ce1d599b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.173+0000 7fc552800640 1 -- 172.21.15.99:0/2525904320 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce1d29a920 con 0x55ce1d5811a0 2024-03-30T13:13:13.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.173+0000 7fc552800640 1 --2- 172.21.15.99:0/2525904320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d558030 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc5440552b0 tx=0x7fc544059690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcd9215232dff76 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.173+0000 7fc53f000640 1 -- 172.21.15.99:0/2525904320 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544087070 con 0x55ce1d5811a0 2024-03-30T13:13:13.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.173+0000 7fc53f000640 1 -- 172.21.15.99:0/2525904320 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54405b040 con 0x55ce1d5811a0 2024-03-30T13:13:13.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.173+0000 7fc53f000640 1 -- 172.21.15.99:0/2525904320 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544061a30 con 0x55ce1d5811a0 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.174+0000 7fc55c183740 1 -- 172.21.15.99:0/2525904320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 msgr2=0x55ce1d558030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.174+0000 7fc55c183740 1 --2- 172.21.15.99:0/2525904320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d558030 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc5440552b0 tx=0x7fc544059690 comp rx=0 tx=0).stop 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.174+0000 7fc55c183740 1 -- 172.21.15.99:0/2525904320 shutdown_connections 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.174+0000 7fc55c183740 1 --2- 172.21.15.99:0/2525904320 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d581580 0x55ce1d579ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.174+0000 7fc55c183740 1 --2- 172.21.15.99:0/2525904320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d57e230 0x55ce1d599b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.174+0000 7fc55c183740 1 --2- 172.21.15.99:0/2525904320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d558030 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.174+0000 7fc55c183740 1 -- 172.21.15.99:0/2525904320 >> 172.21.15.99:0/2525904320 conn(0x55ce1d51dbe0 msgr2=0x55ce1d59bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.174+0000 7fc55c183740 1 -- 172.21.15.99:0/2525904320 shutdown_connections 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.174+0000 7fc55c183740 1 -- 172.21.15.99:0/2525904320 wait complete. 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.175+0000 7fc55c183740 1 -- start start 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.175+0000 7fc55c183740 1 Processor -- start 2024-03-30T13:13:13.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.176+0000 7fc55c183740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d57e230 0x55ce1d57a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.176+0000 7fc55c183740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d598c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.176+0000 7fc55c183740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d581580 0x55ce1d555a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.176+0000 7fc55c183740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55ce1d5511c0 con 0x55ce1d5811a0 2024-03-30T13:13:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.176+0000 7fc55c183740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ce1d4759d0 con 0x55ce1d581580 2024-03-30T13:13:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.176+0000 7fc55c183740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ce1d551460 con 0x55ce1d57e230 2024-03-30T13:13:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.176+0000 7fc55c183740 10 client.0 _ll_register_callbacks cb 0x55ce1d4b1fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.176+0000 7fc551e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d598c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.176+0000 7fc551e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d598c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49562/0 (socket says 172.21.15.99:49562) 2024-03-30T13:13:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.176+0000 7fc551e00640 1 -- 172.21.15.99:0/4276441156 learned_addr learned my addr 172.21.15.99:0/4276441156 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc552800640 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d57e230 0x55ce1d57a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc551e00640 1 -- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d57e230 msgr2=0x55ce1d57a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc553200640 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d581580 0x55ce1d555a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc551e00640 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d57e230 0x55ce1d57a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc551e00640 1 -- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d581580 msgr2=0x55ce1d555a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc551e00640 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d581580 0x55ce1d555a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc551e00640 1 -- 172.21.15.99:0/4276441156 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce1d18e210 con 0x55ce1d5811a0 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc551e00640 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d598c70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc54000aba0 tx=0x7fc540004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3d8cb05ecc6de5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc533400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc533400640 1 -- 172.21.15.99:0/4276441156 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54004f640 con 0x55ce1d5811a0 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc533400640 1 -- 172.21.15.99:0/4276441156 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc540043400 con 0x55ce1d5811a0 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.177+0000 7fc55c183740 1 -- 172.21.15.99:0/4276441156 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc54405b040 con 0x55ce1d5811a0 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.178+0000 7fc533400640 1 -- 172.21.15.99:0/4276441156 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc540043600 con 0x55ce1d5811a0 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.178+0000 7fc55c183740 10 client.5472 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.178+0000 7fc55c183740 1 -- 172.21.15.99:0/4276441156 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ce1d2fb0b0 con 0x55ce1d5811a0 2024-03-30T13:13:13.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.178+0000 7fc533400640 1 -- 172.21.15.99:0/4276441156 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54405b040 con 0x55ce1d5811a0 2024-03-30T13:13:13.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.178+0000 7fc533400640 1 -- 172.21.15.99:0/4276441156 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc54004d070 con 0x55ce1d5811a0 2024-03-30T13:13:13.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.178+0000 7fc55c183740 10 client.5472 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:13.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.178+0000 7fc55c183740 10 client.5472 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:13.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.178+0000 7fc55c183740 20 client.5472 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:13.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.178+0000 7fc55c183740 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ce1d5b2eb0 0x55ce1d5b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.178+0000 7fc55c183740 4 client.5472 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:13.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.178+0000 7fc55c183740 1 -- 172.21.15.99:0/4276441156 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce1d4c7870 con 0x55ce1d5b2eb0 2024-03-30T13:13:13.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.179+0000 7fc552800640 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ce1d5b2eb0 0x55ce1d5b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.180+0000 7fc552800640 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ce1d5b2eb0 0x55ce1d5b3290 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1b32eacaeb11a8a server_cookie=ca1860a4e486d25 in_seq=0 out_seq=0 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.180+0000 7fc533400640 10 client.5472 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.181+0000 7fc533400640 1 -- 172.21.15.99:0/4276441156 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55ce1d4c7870 con 0x55ce1d5b2eb0 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.181+0000 7fc533400640 10 client.5472 handle_command_reply: tid=0 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.181+0000 7fc55c183740 1 client.5472 shutdown 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc55c183740 1 -- 172.21.15.99:0/4276441156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 msgr2=0x55ce1d598c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc55c183740 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d598c70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc54000aba0 tx=0x7fc540004730 comp rx=0 tx=0).stop 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc55c183740 1 -- 172.21.15.99:0/4276441156 shutdown_connections 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc55c183740 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ce1d5b2eb0 0x55ce1d5b3290 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc55c183740 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d581580 0x55ce1d555a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc55c183740 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d5811a0 0x55ce1d598c70 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc55c183740 1 --2- 172.21.15.99:0/4276441156 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d57e230 0x55ce1d57a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc533400640 0 client.5472 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc55c183740 1 -- 172.21.15.99:0/4276441156 >> 172.21.15.99:0/4276441156 conn(0x55ce1d51dbe0 msgr2=0x55ce1d5502c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc55c183740 1 -- 172.21.15.99:0/4276441156 shutdown_connections 2024-03-30T13:13:13.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc55c183740 1 -- 172.21.15.99:0/4276441156 wait complete. 2024-03-30T13:13:13.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.182+0000 7fc55c183740 20 client.5472 trim_cache size 0 max 16384 2024-03-30T13:13:13.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.197+0000 7fc55c183740 1 Processor -- start 2024-03-30T13:13:13.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.198+0000 7fc55c183740 1 -- start start 2024-03-30T13:13:13.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.198+0000 7fc55c183740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d57e230 0x55ce1d59ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.198+0000 7fc55c183740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d5811a0 0x55ce1d59b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.198+0000 7fc55c183740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d581580 0x55ce1d556890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.198+0000 7fc55c183740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc5541fd080 con 0x55ce1d581580 2024-03-30T13:13:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.198+0000 7fc55c183740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc5541fc060 con 0x55ce1d57e230 2024-03-30T13:13:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.198+0000 7fc55c183740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc5540aecc0 con 0x55ce1d5811a0 2024-03-30T13:13:13.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc553200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d581580 0x55ce1d556890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc553200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d581580 0x55ce1d556890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49574/0 (socket says 172.21.15.99:49574) 2024-03-30T13:13:13.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc553200640 1 -- 172.21.15.99:0/3135791030 learned_addr learned my addr 172.21.15.99:0/3135791030 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc552800640 1 --2- 172.21.15.99:0/3135791030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d57e230 0x55ce1d59ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc551e00640 1 --2- 172.21.15.99:0/3135791030 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d5811a0 0x55ce1d59b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc553200640 1 -- 172.21.15.99:0/3135791030 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d5811a0 msgr2=0x55ce1d59b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc553200640 1 --2- 172.21.15.99:0/3135791030 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d5811a0 0x55ce1d59b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc553200640 1 -- 172.21.15.99:0/3135791030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d57e230 msgr2=0x55ce1d59ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc553200640 1 --2- 172.21.15.99:0/3135791030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d57e230 0x55ce1d59ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc553200640 1 -- 172.21.15.99:0/3135791030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce1d1672d0 con 0x55ce1d581580 2024-03-30T13:13:13.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc552800640 1 --2- 172.21.15.99:0/3135791030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d57e230 0x55ce1d59ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:13.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.199+0000 7fc553200640 1 --2- 172.21.15.99:0/3135791030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d581580 0x55ce1d556890 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc5540ce010 tx=0x7fc54c00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592fd8b443ba63c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc53e600640 1 -- 172.21.15.99:0/3135791030 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c004d60 con 0x55ce1d581580 2024-03-30T13:13:13.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc53e600640 1 -- 172.21.15.99:0/3135791030 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c00db20 con 0x55ce1d581580 2024-03-30T13:13:13.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc53e600640 1 -- 172.21.15.99:0/3135791030 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c007110 con 0x55ce1d581580 2024-03-30T13:13:13.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc55c183740 1 -- 172.21.15.99:0/3135791030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d581580 msgr2=0x55ce1d556890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc55c183740 1 --2- 172.21.15.99:0/3135791030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d581580 0x55ce1d556890 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc5540ce010 tx=0x7fc54c00d520 comp rx=0 tx=0).stop 2024-03-30T13:13:13.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc55c183740 1 -- 172.21.15.99:0/3135791030 shutdown_connections 2024-03-30T13:13:13.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc55c183740 1 --2- 172.21.15.99:0/3135791030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d581580 0x55ce1d556890 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc55c183740 1 --2- 172.21.15.99:0/3135791030 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d5811a0 0x55ce1d59b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc55c183740 1 --2- 172.21.15.99:0/3135791030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d57e230 0x55ce1d59ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc55c183740 1 -- 172.21.15.99:0/3135791030 >> 172.21.15.99:0/3135791030 conn(0x55ce1d51dbe0 msgr2=0x55ce1d59b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc55c183740 1 -- 172.21.15.99:0/3135791030 shutdown_connections 2024-03-30T13:13:13.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.200+0000 7fc55c183740 1 -- 172.21.15.99:0/3135791030 wait complete. 2024-03-30T13:13:13.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.201+0000 7fc55c183740 1 -- start start 2024-03-30T13:13:13.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.201+0000 7fc55c183740 1 Processor -- start 2024-03-30T13:13:13.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.202+0000 7fc55c183740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d57e230 0x55ce1d59b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.202+0000 7fc55c183740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d5811a0 0x55ce1d59bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.202+0000 7fc55c183740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d581580 0x55ce1d5c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.202+0000 7fc55c183740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55ce1d550220 con 0x55ce1d57e230 2024-03-30T13:13:13.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.202+0000 7fc55c183740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc5541fbb40 con 0x55ce1d581580 2024-03-30T13:13:13.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.202+0000 7fc55c183740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ce1d592f50 con 0x55ce1d5811a0 2024-03-30T13:13:13.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.202+0000 7fc55c183740 10 client.0 _ll_register_callbacks cb 0x7fc5380036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:13.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.202+0000 7fc552800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d57e230 0x55ce1d59b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.202+0000 7fc552800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d57e230 0x55ce1d59b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49586/0 (socket says 172.21.15.99:49586) 2024-03-30T13:13:13.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.202+0000 7fc552800640 1 -- 172.21.15.99:0/580266946 learned_addr learned my addr 172.21.15.99:0/580266946 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc551e00640 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d5811a0 0x55ce1d59bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc552800640 1 -- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d5811a0 msgr2=0x55ce1d59bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc553200640 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d581580 0x55ce1d5c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc552800640 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d5811a0 0x55ce1d59bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc552800640 1 -- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d581580 msgr2=0x55ce1d5c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc552800640 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d581580 0x55ce1d5c30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc552800640 1 -- 172.21.15.99:0/580266946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce1d598c50 con 0x55ce1d57e230 2024-03-30T13:13:13.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc552800640 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d57e230 0x55ce1d59b9f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc544059010 tx=0x7fc54406e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6523356840b86d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc533400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:13.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc533400640 1 -- 172.21.15.99:0/580266946 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54407d060 con 0x55ce1d57e230 2024-03-30T13:13:13.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc533400640 1 -- 172.21.15.99:0/580266946 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc544056ef0 con 0x55ce1d57e230 2024-03-30T13:13:13.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.203+0000 7fc55c183740 1 -- 172.21.15.99:0/580266946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc54c00db20 con 0x55ce1d57e230 2024-03-30T13:13:13.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.204+0000 7fc533400640 1 -- 172.21.15.99:0/580266946 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc544087040 con 0x55ce1d57e230 2024-03-30T13:13:13.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.204+0000 7fc55c183740 10 client.5478 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:13.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.204+0000 7fc55c183740 1 -- 172.21.15.99:0/580266946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ce1d579500 con 0x55ce1d57e230 2024-03-30T13:13:13.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.204+0000 7fc533400640 1 -- 172.21.15.99:0/580266946 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c00db20 con 0x55ce1d57e230 2024-03-30T13:13:13.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.204+0000 7fc533400640 1 -- 172.21.15.99:0/580266946 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc5440554c0 con 0x55ce1d57e230 2024-03-30T13:13:13.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.204+0000 7fc55c183740 10 client.5478 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:13.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.204+0000 7fc55c183740 10 client.5478 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:13.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.204+0000 7fc55c183740 20 client.5478 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:13.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.204+0000 7fc55c183740 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ce1d5a00c0 0x55ce1d5c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.204+0000 7fc55c183740 4 client.5478 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628294}] 2024-03-30T13:13:13.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.204+0000 7fc55c183740 1 -- 172.21.15.99:0/580266946 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628294}) -- 0x55ce1d4c1bc0 con 0x55ce1d5a00c0 2024-03-30T13:13:13.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.205+0000 7fc551e00640 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ce1d5a00c0 0x55ce1d5c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.205+0000 7fc551e00640 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ce1d5a00c0 0x55ce1d5c35e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd1d7b68c0b03d1f server_cookie=fbada5b51c019b43 in_seq=0 out_seq=0 2024-03-30T13:13:13.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.205+0000 7fc533400640 10 client.5478 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.206+0000 7fc533400640 1 -- 172.21.15.99:0/580266946 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3961 (crc 0 0 0) 0x55ce1d4c1bc0 con 0x55ce1d5a00c0 2024-03-30T13:13:13.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.206+0000 7fc533400640 10 client.5478 handle_command_reply: tid=0 2024-03-30T13:13:13.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.206+0000 7fc55c183740 1 client.5478 shutdown 2024-03-30T13:13:13.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc55c183740 1 -- 172.21.15.99:0/580266946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d57e230 msgr2=0x55ce1d59b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc55c183740 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d57e230 0x55ce1d59b9f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc544059010 tx=0x7fc54406e000 comp rx=0 tx=0).stop 2024-03-30T13:13:13.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc55c183740 1 -- 172.21.15.99:0/580266946 shutdown_connections 2024-03-30T13:13:13.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc55c183740 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ce1d5a00c0 0x55ce1d5c35e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc55c183740 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce1d581580 0x55ce1d5c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc55c183740 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ce1d5811a0 0x55ce1d59bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc533400640 0 client.5478 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc55c183740 1 --2- 172.21.15.99:0/580266946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ce1d57e230 0x55ce1d59b9f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc55c183740 1 -- 172.21.15.99:0/580266946 >> 172.21.15.99:0/580266946 conn(0x55ce1d51dbe0 msgr2=0x55ce1d59abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc55c183740 1 -- 172.21.15.99:0/580266946 shutdown_connections 2024-03-30T13:13:13.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc55c183740 1 -- 172.21.15.99:0/580266946 wait complete. 2024-03-30T13:13:13.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.207+0000 7fc55c183740 20 client.5478 trim_cache size 0 max 16384 2024-03-30T13:13:13.223 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:13.224 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ceph/io.h", 2024-03-30T13:13:13.224 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628294, 2024-03-30T13:13:13.224 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:13.224 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.384015+0000", 2024-03-30T13:13:13.224 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.351959+0000", 2024-03-30T13:13:13.224 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:13.225 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:13.225 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:13.225 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:13.225 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:13.225 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:13.225 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:13.226 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:13.226 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:13.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.226 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:13.226 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:13.226 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:13.227 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:13.227 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:13.227 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:13.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.227 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:13.227 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 387, 2024-03-30T13:13:13.228 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:13.228 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:13.228 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:13.228 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:13.228 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:13.228 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.351959+0000", 2024-03-30T13:13:13.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:13.229 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:13.229 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:13.229 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:13.229 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:13.229 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:13.230 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:13.230 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:13.230 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:13.230 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:13.230 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:13.230 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:13.231 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:13.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.231 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:13.231 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:13.232 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 387, 2024-03-30T13:13:13.232 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:13.232 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:13.232 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:13.232 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.384015+0000" 2024-03-30T13:13:13.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.233 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:13.233 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:13.233 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 387, 2024-03-30T13:13:13.233 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:13.233 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:13.233 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:13.234 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.384015+0000" 2024-03-30T13:13:13.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.234 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 202, 2024-03-30T13:13:13.234 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:13.234 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:13.234 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 30, 2024-03-30T13:13:13.235 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:13.235 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:13.235 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:13.235 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:13.235 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:13.235 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:13.236 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:13.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.236 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.428388+0000", 2024-03-30T13:13:13.236 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 116, 2024-03-30T13:13:13.236 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:13.236 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:13.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:13.237 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:13.237 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:13.237 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:13.237 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.237 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:13.238 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:13.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.238 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:13.238 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:13.238 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:13.238 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:13.239 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:13.239 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:13.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.239 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:13.239 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:13.239 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:13.240 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:13.240 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.240 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:13.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.240 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:13.240 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:13.241 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:13.241 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:13.241 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:13.241 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:13.241 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:13.241 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:13.241 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:13.242 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:13.242 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:13.242 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:13.242 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:13.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.242 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:13.243 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:13.243 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:13.243 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:13.243 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:13.243 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:13.243 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:13.243 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:13.244 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:13.244 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:13.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.244 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:13.244 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:13.244 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:13.244 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:13.244 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:13.245 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:13.245 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:13.245 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:13.245 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:13.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:13.245 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:13.245 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:13.245 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:13.245 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:13.245 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:13.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.246 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:13.246 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:13.246 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:13.246 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:13.246 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:13.246 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:13.246 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:13.247 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:13.247 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:13.247 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:13.247 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:13.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.247 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:13.247 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:13.248 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:13.248 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:13.248 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:13.248 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.248 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:13.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:13.248 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:13.248 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:13.248 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:13.249 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:13.249 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:13.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:13.249 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.249 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:13.249 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:13.249 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:13.249 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:13.250 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:13.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 -- 172.21.15.99:0/1787634878 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53406c530 msgr2=0x7fc53406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53406c530 0x7fc53406e9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc540036000 tx=0x7fc540031000 comp rx=0 tx=0).stop 2024-03-30T13:13:13.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 -- 172.21.15.99:0/1787634878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 msgr2=0x7fc554156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 0x7fc554156df0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc54400d7a0 tx=0x7fc54400dc60 comp rx=0 tx=0).stop 2024-03-30T13:13:13.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 -- 172.21.15.99:0/1787634878 shutdown_connections 2024-03-30T13:13:13.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53406c530 0x7fc53406e9f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc554158dc0 0x7fc554072820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5540c72b0 0x7fc5540ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 --2- 172.21.15.99:0/1787634878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc538004800 0x7fc554156df0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 -- 172.21.15.99:0/1787634878 >> 172.21.15.99:0/1787634878 conn(0x7fc5540d0450 msgr2=0x7fc5540b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 -- 172.21.15.99:0/1787634878 shutdown_connections 2024-03-30T13:13:13.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.208+0000 7fc559400640 1 -- 172.21.15.99:0/1787634878 wait complete. 2024-03-30T13:13:13.254 DEBUG:tasks.cephfs.test_uninlining:getting inode info #5 of 23:1099511628296 2024-03-30T13:13:13.255 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628296 2024-03-30T13:13:13.255 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628296 2024-03-30T13:13:13.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.460+0000 7f2c41200640 1 Processor -- start 2024-03-30T13:13:13.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.460+0000 7f2c41200640 1 -- start start 2024-03-30T13:13:13.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.462+0000 7f2c41200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b4e40 0x7f2c3c0c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.462+0000 7f2c41200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2c3c0b31c0 0x7f2c3c0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.462+0000 7f2c41200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c3c1604d0 con 0x7f2c3c0b2640 2024-03-30T13:13:13.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.462+0000 7f2c41200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2c3c0c6d60 con 0x7f2c3c0b31c0 2024-03-30T13:13:13.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.462+0000 7f2c41200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3c0b2a90 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.462+0000 7f2c39e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b4e40 0x7f2c3c0c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.462+0000 7f2c3a800640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2c3c0b2640 0x7f2c3c0cbec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:51768/0 (socket says 172.21.15.99:51768) 2024-03-30T13:13:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.462+0000 7f2c39e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b4e40 0x7f2c3c0c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:54740/0 (socket says 172.21.15.99:54740) 2024-03-30T13:13:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.462+0000 7f2c3a800640 1 -- 172.21.15.99:0/950625016 learned_addr learned my addr 172.21.15.99:0/950625016 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.463+0000 7f2c31400640 1 --2- 172.21.15.99:0/950625016 >> v2:172.21.15.181:3300/0 conn(0x7f2c3c0b31c0 0x7f2c3c0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.463+0000 7f2c39e00640 1 -- 172.21.15.99:0/950625016 >> v2:172.21.15.181:3300/0 conn(0x7f2c3c0b31c0 msgr2=0x7f2c3c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.463+0000 7f2c39e00640 1 --2- 172.21.15.99:0/950625016 >> v2:172.21.15.181:3300/0 conn(0x7f2c3c0b31c0 0x7f2c3c0b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.463+0000 7f2c39e00640 1 -- 172.21.15.99:0/950625016 >> v1:172.21.15.181:6789/0 conn(0x7f2c3c0b2640 legacy=0x7f2c3c0cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.463+0000 7f2c39e00640 1 -- 172.21.15.99:0/950625016 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3c1607b0 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.464+0000 7f2c39e00640 1 --2- 172.21.15.99:0/950625016 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b4e40 0x7f2c3c0c6820 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0097a0 tx=0x7f2c2c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24885263d1916408 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.465+0000 7f2c39400640 1 -- 172.21.15.99:0/950625016 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0315a0 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.465+0000 7f2c39400640 1 -- 172.21.15.99:0/950625016 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2c037070 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.465+0000 7f2c39400640 1 -- 172.21.15.99:0/950625016 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c031960 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.466+0000 7f2c41200640 1 -- 172.21.15.99:0/950625016 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b4e40 msgr2=0x7f2c3c0c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.466+0000 7f2c41200640 1 --2- 172.21.15.99:0/950625016 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b4e40 0x7f2c3c0c6820 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0097a0 tx=0x7f2c2c02b840 comp rx=0 tx=0).stop 2024-03-30T13:13:13.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.466+0000 7f2c41200640 1 -- 172.21.15.99:0/950625016 shutdown_connections 2024-03-30T13:13:13.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.466+0000 7f2c41200640 1 --2- 172.21.15.99:0/950625016 >> v2:172.21.15.181:3300/0 conn(0x7f2c3c0b31c0 0x7f2c3c0b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.466+0000 7f2c41200640 1 --2- 172.21.15.99:0/950625016 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b4e40 0x7f2c3c0c6820 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.466+0000 7f2c41200640 1 -- 172.21.15.99:0/950625016 >> 172.21.15.99:0/950625016 conn(0x7f2c3c0d0450 msgr2=0x7f2c3c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.466+0000 7f2c41200640 1 -- 172.21.15.99:0/950625016 shutdown_connections 2024-03-30T13:13:13.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.466+0000 7f2c41200640 1 -- 172.21.15.99:0/950625016 wait complete. 2024-03-30T13:13:13.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.468+0000 7f2c41200640 1 Processor -- start 2024-03-30T13:13:13.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.468+0000 7f2c41200640 1 -- start start 2024-03-30T13:13:13.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.470+0000 7f2c41200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c3c0b2640 0x7f2c3c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.470+0000 7f2c41200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b31c0 0x7f2c3c157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.470+0000 7f2c41200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c3c0b4e40 0x7f2c3c0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.470+0000 7f2c41200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c160d70 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.470+0000 7f2c41200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c0cba20 con 0x7f2c3c0b2640 2024-03-30T13:13:13.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.470+0000 7f2c41200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3c0b3620 con 0x7f2c3c0b31c0 2024-03-30T13:13:13.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.470+0000 7f2c3a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c3c0b4e40 0x7f2c3c0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.470+0000 7f2c3a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c3c0b4e40 0x7f2c3c0adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49588/0 (socket says 172.21.15.99:49588) 2024-03-30T13:13:13.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.470+0000 7f2c3a800640 1 -- 172.21.15.99:0/2029984941 learned_addr learned my addr 172.21.15.99:0/2029984941 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.470+0000 7f2c39e00640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c3c0b2640 0x7f2c3c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.470+0000 7f2c31400640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b31c0 0x7f2c3c157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c3a800640 1 -- 172.21.15.99:0/2029984941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b31c0 msgr2=0x7f2c3c157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c3a800640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b31c0 0x7f2c3c157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c3a800640 1 -- 172.21.15.99:0/2029984941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c3c0b2640 msgr2=0x7f2c3c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c3a800640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c3c0b2640 0x7f2c3c0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c3a800640 1 -- 172.21.15.99:0/2029984941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3c158650 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c39e00640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c3c0b2640 0x7f2c3c0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c3a800640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c3c0b4e40 0x7f2c3c0adde0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400cbc0 tx=0x7f2c3400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c32a00640 1 -- 172.21.15.99:0/2029984941 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34017070 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c32a00640 1 -- 172.21.15.99:0/2029984941 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3400ad40 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c41200640 1 -- 172.21.15.99:0/2029984941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3c158930 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c32a00640 1 -- 172.21.15.99:0/2029984941 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34012600 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.471+0000 7f2c41200640 1 -- 172.21.15.99:0/2029984941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3c158340 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.475+0000 7f2c32a00640 1 -- 172.21.15.99:0/2029984941 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2c3401a070 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.476+0000 7f2c32a00640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c1806c530 0x7f2c1806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.476+0000 7f2c32a00640 1 -- 172.21.15.99:0/2029984941 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f2c3408b480 con 0x7f2c3c0b4e40 2024-03-30T13:13:13.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.476+0000 7f2c43fbe740 1 Processor -- start 2024-03-30T13:13:13.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.476+0000 7f2c39e00640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c1806c530 0x7f2c1806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.476+0000 7f2c43fbe740 1 -- start start 2024-03-30T13:13:13.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.477+0000 7f2c39e00640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c1806c530 0x7f2c1806e9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c036000 tx=0x7f2c2c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.477+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c47dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.477+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c48300 0x55ad52c202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.477+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 0x55ad52c20810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.477+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55ad52b84330 con 0x55ad52c48300 2024-03-30T13:13:13.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.477+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ad52b2c620 con 0x55ad52c21290 2024-03-30T13:13:13.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.477+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ad52b80440 con 0x55ad52c21670 2024-03-30T13:13:13.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.478+0000 7f2c31400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c48300 0x55ad52c202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.478+0000 7f2c31400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c48300 0x55ad52c202d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49602/0 (socket says 172.21.15.99:49602) 2024-03-30T13:13:13.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.478+0000 7f2c31400640 1 -- 172.21.15.99:0/3132982725 learned_addr learned my addr 172.21.15.99:0/3132982725 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.478+0000 7f2c39e00640 1 --2- 172.21.15.99:0/3132982725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c47dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.478+0000 7f2c31400640 1 -- 172.21.15.99:0/3132982725 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 msgr2=0x55ad52c20810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.478+0000 7f2c31400640 1 --2- 172.21.15.99:0/3132982725 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 0x55ad52c20810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.478+0000 7f2c31400640 1 -- 172.21.15.99:0/3132982725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 msgr2=0x55ad52c47dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.478+0000 7f2c31400640 1 --2- 172.21.15.99:0/3132982725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c47dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.478+0000 7f2c31400640 1 -- 172.21.15.99:0/3132982725 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad52964920 con 0x55ad52c48300 2024-03-30T13:13:13.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.478+0000 7f2c31400640 1 --2- 172.21.15.99:0/3132982725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c48300 0x55ad52c202d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009b60 tx=0x7f2c24009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10093cef5d1702e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.478+0000 7f2c2aa00640 1 -- 172.21.15.99:0/3132982725 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24019070 con 0x55ad52c48300 2024-03-30T13:13:13.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.479+0000 7f2c2aa00640 1 -- 172.21.15.99:0/3132982725 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c24009c50 con 0x55ad52c48300 2024-03-30T13:13:13.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.479+0000 7f2c2aa00640 1 -- 172.21.15.99:0/3132982725 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24015460 con 0x55ad52c48300 2024-03-30T13:13:13.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.479+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3132982725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c48300 msgr2=0x55ad52c202d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.479+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3132982725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c48300 0x55ad52c202d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009b60 tx=0x7f2c24009190 comp rx=0 tx=0).stop 2024-03-30T13:13:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.479+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3132982725 shutdown_connections 2024-03-30T13:13:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.479+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3132982725 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 0x55ad52c20810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.479+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3132982725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c48300 0x55ad52c202d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.479+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3132982725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c47dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.479+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3132982725 >> 172.21.15.99:0/3132982725 conn(0x55ad52be7be0 msgr2=0x55ad52c65fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.479+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3132982725 shutdown_connections 2024-03-30T13:13:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.479+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3132982725 wait complete. 2024-03-30T13:13:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.480+0000 7f2c43fbe740 1 -- start start 2024-03-30T13:13:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.480+0000 7f2c43fbe740 1 Processor -- start 2024-03-30T13:13:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.481+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c69f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.481+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 0x55ad52c5d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.481+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c62a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.481+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55ad52c47930 con 0x55ad52c3faf0 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.481+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ad52b3f9d0 con 0x55ad52c21290 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.481+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ad52c406b0 con 0x55ad52c21670 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.481+0000 7f2c43fbe740 10 client.0 _ll_register_callbacks cb 0x55ad52b7bfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c3a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c62a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c3a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c62a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49610/0 (socket says 172.21.15.99:49610) 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c3a800640 1 -- 172.21.15.99:0/2765603138 learned_addr learned my addr 172.21.15.99:0/2765603138 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c39e00640 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c69f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c31400640 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 0x55ad52c5d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c3a800640 1 -- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 msgr2=0x55ad52c5d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c3a800640 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 0x55ad52c5d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c3a800640 1 -- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 msgr2=0x55ad52c69f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c3a800640 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c69f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c3a800640 1 -- 172.21.15.99:0/2765603138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad52858210 con 0x55ad52c3faf0 2024-03-30T13:13:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c3a800640 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c62a40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2c340619c0 tx=0x7f2c34059500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78771c76c600e336 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.482+0000 7f2c1f400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c1f400640 1 -- 172.21.15.99:0/2765603138 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34061c60 con 0x55ad52c3faf0 2024-03-30T13:13:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c1f400640 1 -- 172.21.15.99:0/2765603138 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f2c34004b60 con 0x55ad52c3faf0 2024-03-30T13:13:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c43fbe740 1 -- 172.21.15.99:0/2765603138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c24009c50 con 0x55ad52c3faf0 2024-03-30T13:13:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c1f400640 1 -- 172.21.15.99:0/2765603138 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2c34057780 con 0x55ad52c3faf0 2024-03-30T13:13:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c43fbe740 10 client.5487 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c43fbe740 1 -- 172.21.15.99:0/2765603138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ad529c50b0 con 0x55ad52c3faf0 2024-03-30T13:13:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c1f400640 1 -- 172.21.15.99:0/2765603138 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c24009c50 con 0x55ad52c3faf0 2024-03-30T13:13:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c1f400640 1 -- 172.21.15.99:0/2765603138 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f2c3406db30 con 0x55ad52c3faf0 2024-03-30T13:13:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c43fbe740 10 client.5487 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c43fbe740 10 client.5487 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c43fbe740 20 client.5487 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad52c4c340 0x55ad52c4c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c43fbe740 4 client.5487 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.483+0000 7f2c43fbe740 1 -- 172.21.15.99:0/2765603138 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad52b91870 con 0x55ad52c4c340 2024-03-30T13:13:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.484+0000 7f2c39e00640 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad52c4c340 0x55ad52c4c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.485+0000 7f2c39e00640 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad52c4c340 0x55ad52c4c750 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6967bdbd8e1685a4 server_cookie=986381eaf84136c9 in_seq=0 out_seq=0 2024-03-30T13:13:13.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.485+0000 7f2c1f400640 10 client.5487 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.486+0000 7f2c1f400640 1 -- 172.21.15.99:0/2765603138 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55ad52b91870 con 0x55ad52c4c340 2024-03-30T13:13:13.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.486+0000 7f2c1f400640 10 client.5487 handle_command_reply: tid=0 2024-03-30T13:13:13.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 1 client.5487 shutdown 2024-03-30T13:13:13.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 1 -- 172.21.15.99:0/2765603138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 msgr2=0x55ad52c62a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c62a40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2c340619c0 tx=0x7f2c34059500 comp rx=0 tx=0).stop 2024-03-30T13:13:13.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 1 -- 172.21.15.99:0/2765603138 shutdown_connections 2024-03-30T13:13:13.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c62a40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 0x55ad52c5d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad52c4c340 0x55ad52c4c750 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/2765603138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c69f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 1 -- 172.21.15.99:0/2765603138 >> 172.21.15.99:0/2765603138 conn(0x55ad52be7be0 msgr2=0x55ad52c47070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c1f400640 0 client.5487 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 1 -- 172.21.15.99:0/2765603138 shutdown_connections 2024-03-30T13:13:13.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 1 -- 172.21.15.99:0/2765603138 wait complete. 2024-03-30T13:13:13.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.487+0000 7f2c43fbe740 20 client.5487 trim_cache size 0 max 16384 2024-03-30T13:13:13.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.503+0000 7f2c43fbe740 1 Processor -- start 2024-03-30T13:13:13.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.503+0000 7f2c43fbe740 1 -- start start 2024-03-30T13:13:13.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.504+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21290 0x55ad52c68700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.504+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21670 0x55ad52c1a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.504+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c1a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.504+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c200dd0 con 0x55ad52c3faf0 2024-03-30T13:13:13.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.504+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c1fff60 con 0x55ad52c21670 2024-03-30T13:13:13.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.504+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3c15b4a0 con 0x55ad52c21290 2024-03-30T13:13:13.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.504+0000 7f2c3a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c1a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.504+0000 7f2c3a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c1a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49624/0 (socket says 172.21.15.99:49624) 2024-03-30T13:13:13.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.504+0000 7f2c3a800640 1 -- 172.21.15.99:0/3475601375 learned_addr learned my addr 172.21.15.99:0/3475601375 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.504+0000 7f2c3a800640 1 -- 172.21.15.99:0/3475601375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21290 msgr2=0x55ad52c68700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.504+0000 7f2c3a800640 1 --2- 172.21.15.99:0/3475601375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21290 0x55ad52c68700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.505+0000 7f2c3a800640 1 -- 172.21.15.99:0/3475601375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21670 msgr2=0x55ad52c1a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.505+0000 7f2c3a800640 1 --2- 172.21.15.99:0/3475601375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21670 0x55ad52c1a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.505+0000 7f2c3a800640 1 -- 172.21.15.99:0/3475601375 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad528312d0 con 0x55ad52c3faf0 2024-03-30T13:13:13.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.505+0000 7f2c3a800640 1 --2- 172.21.15.99:0/3475601375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c1a5b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2c34059350 tx=0x7f2c3408a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8737a25c8e9956 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.505+0000 7f2c2a000640 1 -- 172.21.15.99:0/3475601375 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34061c60 con 0x55ad52c3faf0 2024-03-30T13:13:13.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.505+0000 7f2c2a000640 1 -- 172.21.15.99:0/3475601375 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c34004b60 con 0x55ad52c3faf0 2024-03-30T13:13:13.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.505+0000 7f2c2a000640 1 -- 172.21.15.99:0/3475601375 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34058810 con 0x55ad52c3faf0 2024-03-30T13:13:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.506+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3475601375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 msgr2=0x55ad52c1a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.506+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3475601375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c1a5b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2c34059350 tx=0x7f2c3408a000 comp rx=0 tx=0).stop 2024-03-30T13:13:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.506+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3475601375 shutdown_connections 2024-03-30T13:13:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.506+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3475601375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c1a5b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.506+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3475601375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21670 0x55ad52c1a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.506+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3475601375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21290 0x55ad52c68700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.506+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3475601375 >> 172.21.15.99:0/3475601375 conn(0x55ad52be7be0 msgr2=0x55ad52c3ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.506+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3475601375 shutdown_connections 2024-03-30T13:13:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.506+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3475601375 wait complete. 2024-03-30T13:13:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.507+0000 7f2c43fbe740 1 -- start start 2024-03-30T13:13:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.507+0000 7f2c43fbe740 1 Processor -- start 2024-03-30T13:13:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c88550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 0x55ad52c5ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c43fbe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c4d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55ad52c4e940 con 0x55ad52c3faf0 2024-03-30T13:13:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c15baf0 con 0x55ad52c21290 2024-03-30T13:13:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c43fbe740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ad52c3f900 con 0x55ad52c21670 2024-03-30T13:13:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c43fbe740 10 client.0 _ll_register_callbacks cb 0x7f2c34001c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c3a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c4d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c3a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c4d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49636/0 (socket says 172.21.15.99:49636) 2024-03-30T13:13:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c3a800640 1 -- 172.21.15.99:0/3197900042 learned_addr learned my addr 172.21.15.99:0/3197900042 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c39e00640 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c88550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c3a800640 1 -- 172.21.15.99:0/3197900042 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 msgr2=0x55ad52c5ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.508+0000 7f2c3a800640 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 0x55ad52c5ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.509+0000 7f2c3a800640 1 -- 172.21.15.99:0/3197900042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 msgr2=0x55ad52c88550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.509+0000 7f2c3a800640 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c88550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.509+0000 7f2c3a800640 1 -- 172.21.15.99:0/3197900042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad52c1ad40 con 0x55ad52c3faf0 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.509+0000 7f2c3a800640 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c4d030 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2c34058e90 tx=0x7f2c3401e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a5452d7e2e9d4f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.509+0000 7f2c1f400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.509+0000 7f2c1f400640 1 -- 172.21.15.99:0/3197900042 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34058f00 con 0x55ad52c3faf0 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.509+0000 7f2c1f400640 1 -- 172.21.15.99:0/3197900042 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f2c3406db30 con 0x55ad52c3faf0 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.509+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3197900042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c34004b60 con 0x55ad52c3faf0 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.509+0000 7f2c1f400640 1 -- 172.21.15.99:0/3197900042 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2c34058810 con 0x55ad52c3faf0 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.509+0000 7f2c43fbe740 10 client.5493 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.509+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3197900042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ad52c1ad40 con 0x55ad52c3faf0 2024-03-30T13:13:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.510+0000 7f2c1f400640 1 -- 172.21.15.99:0/3197900042 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c34004b60 con 0x55ad52c3faf0 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.510+0000 7f2c1f400640 1 -- 172.21.15.99:0/3197900042 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f2c340589b0 con 0x55ad52c3faf0 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.510+0000 7f2c43fbe740 10 client.5493 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.510+0000 7f2c43fbe740 10 client.5493 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.510+0000 7f2c43fbe740 20 client.5493 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.510+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad52c46a40 0x55ad52c4d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.510+0000 7f2c43fbe740 4 client.5493 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628296}] 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.510+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3197900042 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628296}) -- 0x55ad52b8bbc0 con 0x55ad52c46a40 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.511+0000 7f2c39e00640 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad52c46a40 0x55ad52c4d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.512+0000 7f2c1f400640 10 client.5493 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.512+0000 7f2c39e00640 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad52c46a40 0x55ad52c4d570 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c051e6b180bcd992 server_cookie=8c482ea57cbe87c7 in_seq=0 out_seq=0 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c1f400640 1 -- 172.21.15.99:0/3197900042 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3967 (crc 0 0 0) 0x55ad52b8bbc0 con 0x55ad52c46a40 2024-03-30T13:13:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c1f400640 10 client.5493 handle_command_reply: tid=0 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 1 client.5493 shutdown 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3197900042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 msgr2=0x55ad52c4d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c4d030 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2c34058e90 tx=0x7f2c3401e070 comp rx=0 tx=0).stop 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3197900042 shutdown_connections 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad52c3faf0 0x55ad52c4d030 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad52c21670 0x55ad52c5ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad52c46a40 0x55ad52c4d570 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 1 --2- 172.21.15.99:0/3197900042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad52c21290 0x55ad52c88550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3197900042 >> 172.21.15.99:0/3197900042 conn(0x55ad52be7be0 msgr2=0x55ad52c4ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c1f400640 0 client.5493 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3197900042 shutdown_connections 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 1 -- 172.21.15.99:0/3197900042 wait complete. 2024-03-30T13:13:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.513+0000 7f2c43fbe740 20 client.5493 trim_cache size 0 max 16384 2024-03-30T13:13:13.524 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:13.524 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ceph/ioctl.h", 2024-03-30T13:13:13.524 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628296, 2024-03-30T13:13:13.524 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:13.524 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.388506+0000", 2024-03-30T13:13:13.524 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.356959+0000", 2024-03-30T13:13:13.524 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:13.524 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:13.524 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:13.524 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:13.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 3724, 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.356959+0000", 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:13.526 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:13.527 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:13.527 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:13.527 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:13.527 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:13.527 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:13.527 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:13.527 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:13.527 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:13.527 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:13.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.528 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:13.528 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:13.528 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3724, 2024-03-30T13:13:13.528 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:13.528 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:13.528 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:13.528 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.388506+0000" 2024-03-30T13:13:13.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.528 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:13.528 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:13.529 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3724, 2024-03-30T13:13:13.529 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:13.529 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:13.529 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:13.529 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.388506+0000" 2024-03-30T13:13:13.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.529 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 172, 2024-03-30T13:13:13.529 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:13.529 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:13.529 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 34, 2024-03-30T13:13:13.529 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.433769+0000", 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 124, 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:13.530 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:13.531 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:13.532 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:13.533 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:13.534 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:13.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:13.536 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:13.537 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.537 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:13.537 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:13.537 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:13.537 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:13.537 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:13.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 -- 172.21.15.99:0/2029984941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c1806c530 msgr2=0x7f2c1806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c1806c530 0x7f2c1806e9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c036000 tx=0x7f2c2c03d040 comp rx=0 tx=0).stop 2024-03-30T13:13:13.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 -- 172.21.15.99:0/2029984941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c3c0b4e40 msgr2=0x7f2c3c0adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c3c0b4e40 0x7f2c3c0adde0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400cbc0 tx=0x7f2c3400a430 comp rx=0 tx=0).stop 2024-03-30T13:13:13.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 -- 172.21.15.99:0/2029984941 shutdown_connections 2024-03-30T13:13:13.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c1806c530 0x7f2c1806e9f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c3c0b4e40 0x7f2c3c0adde0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3c0b31c0 0x7f2c3c157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 --2- 172.21.15.99:0/2029984941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c3c0b2640 0x7f2c3c0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 -- 172.21.15.99:0/2029984941 >> 172.21.15.99:0/2029984941 conn(0x7f2c3c0d0450 msgr2=0x7f2c3c15f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 -- 172.21.15.99:0/2029984941 shutdown_connections 2024-03-30T13:13:13.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.514+0000 7f2c41200640 1 -- 172.21.15.99:0/2029984941 wait complete. 2024-03-30T13:13:13.539 DEBUG:tasks.cephfs.test_uninlining:getting inode info #6 of 23:1099511628308 2024-03-30T13:13:13.540 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628308 2024-03-30T13:13:13.540 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628308 2024-03-30T13:13:13.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.747+0000 7f95d1e00640 1 Processor -- start 2024-03-30T13:13:13.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.748+0000 7f95d1e00640 1 -- start start 2024-03-30T13:13:13.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.749+0000 7f95d1e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b4e40 0x7f95cc0c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.749+0000 7f95d1e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc1604d0 con 0x7f95cc0b31c0 2024-03-30T13:13:13.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.749+0000 7f95d1e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc1607b0 con 0x7f95cc0b2810 2024-03-30T13:13:13.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.749+0000 7f95d1e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc0c6d60 con 0x7f95cc0b4e40 2024-03-30T13:13:13.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.749+0000 7f95ca000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f95cc0b31c0 0x7f95cc0b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49268/0 (socket says 172.21.15.99:49268) 2024-03-30T13:13:13.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.749+0000 7f95ca000640 1 -- 172.21.15.99:0/885209034 learned_addr learned my addr 172.21.15.99:0/885209034 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95caa00640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b4e40 0x7f95cc0c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1999411851 0 0) 0x7f95cc1604d0 con 0x7f95cc0b31c0 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95b0003520 con 0x7f95cc0b31c0 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1733821993 0 0) 0x7f95b0003520 con 0x7f95cc0b31c0 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b4e40 msgr2=0x7f95cc0c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b4e40 0x7f95cc0c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 >> v1:172.21.15.181:6789/0 conn(0x7f95cc0b2810 legacy=0x7f95cc0cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc160a90 con 0x7f95cc0b31c0 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f95b8001670 con 0x7f95cc0b31c0 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 >> v1:172.21.15.99:6789/0 conn(0x7f95cc0b31c0 legacy=0x7f95cc0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95b00039e0 0x7f95b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b4e40 0x7f95b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b0004d40 0x7f95b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc0c6d60 con 0x7f95b0004d40 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f95b000bba0 con 0x7f95b00039e0 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.750+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f95b000bda0 con 0x7f95cc0b4e40 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.751+0000 7f95cb400640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b0004d40 0x7f95b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.751+0000 7f95caa00640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95b00039e0 0x7f95b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.751+0000 7f95ca000640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b4e40 0x7f95b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.751+0000 7f95cb400640 1 -- 172.21.15.99:0/885209034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b4e40 msgr2=0x7f95b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.751+0000 7f95cb400640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b4e40 0x7f95b0004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.751+0000 7f95cb400640 1 -- 172.21.15.99:0/885209034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95b00039e0 msgr2=0x7f95b0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.751+0000 7f95cb400640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95b00039e0 0x7f95b0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.751+0000 7f95cb400640 1 -- 172.21.15.99:0/885209034 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b0003520 con 0x7f95b0004d40 2024-03-30T13:13:13.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.752+0000 7f95cb400640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b0004d40 0x7f95b00051c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f95c4001e20 tx=0x7f95b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79181e97d8a26465 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.752+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4001a70 con 0x7f95b0004d40 2024-03-30T13:13:13.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.752+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c4003b70 con 0x7f95b0004d40 2024-03-30T13:13:13.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.752+0000 7f95c9600640 1 -- 172.21.15.99:0/885209034 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c40050d0 con 0x7f95b0004d40 2024-03-30T13:13:13.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.753+0000 7f95d1e00640 1 -- 172.21.15.99:0/885209034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b0004d40 msgr2=0x7f95b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.753+0000 7f95d1e00640 1 --2- 172.21.15.99:0/885209034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b0004d40 0x7f95b00051c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f95c4001e20 tx=0x7f95b0005830 comp rx=0 tx=0).stop 2024-03-30T13:13:13.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.753+0000 7f95cb400640 1 -- 172.21.15.99:0/885209034 reap_dead start 2024-03-30T13:13:13.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.753+0000 7f95d1e00640 1 -- 172.21.15.99:0/885209034 shutdown_connections 2024-03-30T13:13:13.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.753+0000 7f95d1e00640 1 -- 172.21.15.99:0/885209034 >> 172.21.15.99:0/885209034 conn(0x7f95cc0d0450 msgr2=0x7f95cc0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.753+0000 7f95d1e00640 1 -- 172.21.15.99:0/885209034 shutdown_connections 2024-03-30T13:13:13.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.753+0000 7f95d1e00640 1 -- 172.21.15.99:0/885209034 wait complete. 2024-03-30T13:13:13.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.755+0000 7f95d1e00640 1 Processor -- start 2024-03-30T13:13:13.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.755+0000 7f95d1e00640 1 -- start start 2024-03-30T13:13:13.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.756+0000 7f95d1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95b0004d40 0x7f95cc0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.756+0000 7f95d1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95cc0ad300 0x7f95cc0af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.756+0000 7f95d1e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b0550 0x7f95cc0afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.756+0000 7f95d1e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc0b3620 con 0x7f95cc0ad300 2024-03-30T13:13:13.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.756+0000 7f95d1e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc0cba20 con 0x7f95b0004d40 2024-03-30T13:13:13.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.756+0000 7f95d1e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc0c60f0 con 0x7f95cc0b0550 2024-03-30T13:13:13.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.756+0000 7f95ca000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95cc0ad300 0x7f95cc0af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.756+0000 7f95ca000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95cc0ad300 0x7f95cc0af920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49652/0 (socket says 172.21.15.99:49652) 2024-03-30T13:13:13.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.756+0000 7f95ca000640 1 -- 172.21.15.99:0/169024479 learned_addr learned my addr 172.21.15.99:0/169024479 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95caa00640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95b0004d40 0x7f95cc0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95ca000640 1 -- 172.21.15.99:0/169024479 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b0550 msgr2=0x7f95cc0afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95ca000640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b0550 0x7f95cc0afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95ca000640 1 -- 172.21.15.99:0/169024479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95b0004d40 msgr2=0x7f95cc0ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95ca000640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95b0004d40 0x7f95cc0ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95ca000640 1 -- 172.21.15.99:0/169024479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc0ad7e0 con 0x7f95cc0ad300 2024-03-30T13:13:13.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95ca000640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95cc0ad300 0x7f95cc0af920 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f95b800d870 tx=0x7f95b800dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95c3400640 1 -- 172.21.15.99:0/169024479 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8019070 con 0x7f95cc0ad300 2024-03-30T13:13:13.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95c3400640 1 -- 172.21.15.99:0/169024479 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b80074e0 con 0x7f95cc0ad300 2024-03-30T13:13:13.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95d1e00640 1 -- 172.21.15.99:0/169024479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95cc0adac0 con 0x7f95cc0ad300 2024-03-30T13:13:13.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95c3400640 1 -- 172.21.15.99:0/169024479 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b80049e0 con 0x7f95cc0ad300 2024-03-30T13:13:13.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.757+0000 7f95d1e00640 1 -- 172.21.15.99:0/169024479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95cc0ae080 con 0x7f95cc0ad300 2024-03-30T13:13:13.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.760+0000 7f95c3400640 1 -- 172.21.15.99:0/169024479 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f95b801c070 con 0x7f95cc0ad300 2024-03-30T13:13:13.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.761+0000 7f95c3400640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f95ac06c560 0x7f95ac06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.761+0000 7f95c3400640 1 -- 172.21.15.99:0/169024479 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f95b808b1c0 con 0x7f95cc0ad300 2024-03-30T13:13:13.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.762+0000 7f95caa00640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f95ac06c560 0x7f95ac06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.762+0000 7f95d4a7e740 1 Processor -- start 2024-03-30T13:13:13.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.762+0000 7f95d4a7e740 1 -- start start 2024-03-30T13:13:13.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.762+0000 7f95caa00640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f95ac06c560 0x7f95ac06ea20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f95bc006fd0 tx=0x7f95bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.763+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x562624688dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.763+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624689300 0x5626246612d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.763+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 0x562624661810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.763+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5626245c5330 con 0x562624662290 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.763+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56262456d620 con 0x562624689300 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.763+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5626245c1440 con 0x562624662670 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.763+0000 7f95caa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x562624688dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.763+0000 7f95caa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x562624688dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49662/0 (socket says 172.21.15.99:49662) 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.763+0000 7f95caa00640 1 -- 172.21.15.99:0/151351891 learned_addr learned my addr 172.21.15.99:0/151351891 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95ca000640 1 --2- 172.21.15.99:0/151351891 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624689300 0x5626246612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95cb400640 1 --2- 172.21.15.99:0/151351891 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 0x562624661810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95caa00640 1 -- 172.21.15.99:0/151351891 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 msgr2=0x562624661810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95caa00640 1 --2- 172.21.15.99:0/151351891 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 0x562624661810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95caa00640 1 -- 172.21.15.99:0/151351891 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624689300 msgr2=0x5626246612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95caa00640 1 --2- 172.21.15.99:0/151351891 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624689300 0x5626246612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95caa00640 1 -- 172.21.15.99:0/151351891 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626243a5920 con 0x562624662290 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95cb400640 1 --2- 172.21.15.99:0/151351891 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 0x562624661810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:13.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95caa00640 1 --2- 172.21.15.99:0/151351891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x562624688dc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f95bc004200 tx=0x7f95bc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162151d172803369 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95b7400640 1 -- 172.21.15.99:0/151351891 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc027070 con 0x562624662290 2024-03-30T13:13:13.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95b7400640 1 -- 172.21.15.99:0/151351891 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc01d050 con 0x562624662290 2024-03-30T13:13:13.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.764+0000 7f95b7400640 1 -- 172.21.15.99:0/151351891 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc003810 con 0x562624662290 2024-03-30T13:13:13.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.765+0000 7f95d4a7e740 1 -- 172.21.15.99:0/151351891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 msgr2=0x562624688dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.765+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/151351891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x562624688dc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f95bc004200 tx=0x7f95bc014000 comp rx=0 tx=0).stop 2024-03-30T13:13:13.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.765+0000 7f95d4a7e740 1 -- 172.21.15.99:0/151351891 shutdown_connections 2024-03-30T13:13:13.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.765+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/151351891 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 0x562624661810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.765+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/151351891 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624689300 0x5626246612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.765+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/151351891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x562624688dc0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.765+0000 7f95d4a7e740 1 -- 172.21.15.99:0/151351891 >> 172.21.15.99:0/151351891 conn(0x562624628be0 msgr2=0x5626246a6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.765+0000 7f95d4a7e740 1 -- 172.21.15.99:0/151351891 shutdown_connections 2024-03-30T13:13:13.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.765+0000 7f95d4a7e740 1 -- 172.21.15.99:0/151351891 wait complete. 2024-03-30T13:13:13.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.766+0000 7f95d4a7e740 1 -- start start 2024-03-30T13:13:13.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.766+0000 7f95d4a7e740 1 Processor -- start 2024-03-30T13:13:13.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.767+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624662290 0x562624680610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.767+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662670 0x5626246a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.767+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5626246a93d0 0x56262468f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.767+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x562624688930 con 0x562624662670 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.767+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5626245809d0 con 0x562624662290 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.767+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5626246816b0 con 0x5626246a93d0 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.767+0000 7f95d4a7e740 10 client.0 _ll_register_callbacks cb 0x5626245bcfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.767+0000 7f95ca000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662670 0x5626246a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95ca000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662670 0x5626246a53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49668/0 (socket says 172.21.15.99:49668) 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95ca000640 1 -- 172.21.15.99:0/1831098979 learned_addr learned my addr 172.21.15.99:0/1831098979 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95caa00640 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624662290 0x562624680610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95cb400640 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5626246a93d0 0x56262468f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95ca000640 1 -- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5626246a93d0 msgr2=0x56262468f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95ca000640 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5626246a93d0 0x56262468f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95ca000640 1 -- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624662290 msgr2=0x562624680610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95ca000640 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624662290 0x562624680610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95ca000640 1 -- 172.21.15.99:0/1831098979 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562624299210 con 0x562624662670 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95caa00640 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624662290 0x562624680610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95ca000640 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662670 0x5626246a53a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f95b8055580 tx=0x7f95b8059820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855989f1dd7ac8a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95abe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95abe00640 1 -- 172.21.15.99:0/1831098979 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8086020 con 0x562624662670 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95abe00640 1 -- 172.21.15.99:0/1831098979 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f95b805d160 con 0x562624662670 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.768+0000 7f95d4a7e740 1 -- 172.21.15.99:0/1831098979 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95bc01d050 con 0x562624662670 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.769+0000 7f95abe00640 1 -- 172.21.15.99:0/1831098979 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f95b8061d00 con 0x562624662670 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.769+0000 7f95d4a7e740 10 client.5505 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.769+0000 7f95d4a7e740 1 -- 172.21.15.99:0/1831098979 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5626244060b0 con 0x562624662670 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.769+0000 7f95abe00640 1 -- 172.21.15.99:0/1831098979 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc01d050 con 0x562624662670 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.769+0000 7f95abe00640 1 -- 172.21.15.99:0/1831098979 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f95b80781f0 con 0x562624662670 2024-03-30T13:13:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.769+0000 7f95d4a7e740 10 client.5505 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.769+0000 7f95d4a7e740 10 client.5505 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.769+0000 7f95d4a7e740 20 client.5505 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.769+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56262468f780 0x5626246aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.769+0000 7f95d4a7e740 4 client.5505 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.769+0000 7f95d4a7e740 1 -- 172.21.15.99:0/1831098979 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626245d2870 con 0x56262468f780 2024-03-30T13:13:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.770+0000 7f95caa00640 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56262468f780 0x5626246aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.771+0000 7f95caa00640 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56262468f780 0x5626246aaf00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f30e31dd85a28dfa server_cookie=4d5788dfa6594509 in_seq=0 out_seq=0 2024-03-30T13:13:13.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.771+0000 7f95abe00640 10 client.5505 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.772+0000 7f95abe00640 1 -- 172.21.15.99:0/1831098979 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5626245d2870 con 0x56262468f780 2024-03-30T13:13:13.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.772+0000 7f95abe00640 10 client.5505 handle_command_reply: tid=0 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 1 client.5505 shutdown 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 1 -- 172.21.15.99:0/1831098979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662670 msgr2=0x5626246a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662670 0x5626246a53a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f95b8055580 tx=0x7f95b8059820 comp rx=0 tx=0).stop 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 1 -- 172.21.15.99:0/1831098979 shutdown_connections 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5626246a93d0 0x56262468f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662670 0x5626246a53a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56262468f780 0x5626246aaf00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/1831098979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624662290 0x562624680610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95abe00640 0 client.5505 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 1 -- 172.21.15.99:0/1831098979 >> 172.21.15.99:0/1831098979 conn(0x562624628be0 msgr2=0x562624687e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 1 -- 172.21.15.99:0/1831098979 shutdown_connections 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 1 -- 172.21.15.99:0/1831098979 wait complete. 2024-03-30T13:13:13.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.773+0000 7f95d4a7e740 20 client.5505 trim_cache size 0 max 16384 2024-03-30T13:13:13.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.789+0000 7f95d4a7e740 1 Processor -- start 2024-03-30T13:13:13.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.789+0000 7f95d4a7e740 1 -- start start 2024-03-30T13:13:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624662290 0x56262465d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 0x5626246aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626246a93d0 0x5626246a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc2016e0 con 0x5626246a93d0 2024-03-30T13:13:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc200780 con 0x562624662290 2024-03-30T13:13:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc0ce1f0 con 0x562624662670 2024-03-30T13:13:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95cb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626246a93d0 0x5626246a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95cb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626246a93d0 0x5626246a53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49680/0 (socket says 172.21.15.99:49680) 2024-03-30T13:13:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95cb400640 1 -- 172.21.15.99:0/997848569 learned_addr learned my addr 172.21.15.99:0/997848569 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95cb400640 1 -- 172.21.15.99:0/997848569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 msgr2=0x5626246aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95cb400640 1 --2- 172.21.15.99:0/997848569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 0x5626246aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95cb400640 1 -- 172.21.15.99:0/997848569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624662290 msgr2=0x56262465d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95cb400640 1 --2- 172.21.15.99:0/997848569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624662290 0x56262465d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.790+0000 7f95cb400640 1 -- 172.21.15.99:0/997848569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626242722d0 con 0x5626246a93d0 2024-03-30T13:13:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.791+0000 7f95cb400640 1 --2- 172.21.15.99:0/997848569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626246a93d0 0x5626246a53a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f95c402c040 tx=0x7f95c402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0a3c7ca1ebdfc3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.791+0000 7f95b6a00640 1 -- 172.21.15.99:0/997848569 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4047070 con 0x5626246a93d0 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.791+0000 7f95b6a00640 1 -- 172.21.15.99:0/997848569 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c4003b70 con 0x5626246a93d0 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.791+0000 7f95b6a00640 1 -- 172.21.15.99:0/997848569 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c40050d0 con 0x5626246a93d0 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.791+0000 7f95d4a7e740 1 -- 172.21.15.99:0/997848569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626246a93d0 msgr2=0x5626246a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.791+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/997848569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626246a93d0 0x5626246a53a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f95c402c040 tx=0x7f95c402e000 comp rx=0 tx=0).stop 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.792+0000 7f95d4a7e740 1 -- 172.21.15.99:0/997848569 shutdown_connections 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.792+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/997848569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626246a93d0 0x5626246a53a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.792+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/997848569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 0x5626246aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.792+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/997848569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562624662290 0x56262465d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.792+0000 7f95d4a7e740 1 -- 172.21.15.99:0/997848569 >> 172.21.15.99:0/997848569 conn(0x562624628be0 msgr2=0x5626246a35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.792+0000 7f95d4a7e740 1 -- 172.21.15.99:0/997848569 shutdown_connections 2024-03-30T13:13:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.792+0000 7f95d4a7e740 1 -- 172.21.15.99:0/997848569 wait complete. 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.792+0000 7f95d4a7e740 1 -- start start 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.793+0000 7f95d4a7e740 1 Processor -- start 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.793+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x56262465ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.793+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 0x56262469cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.793+0000 7f95d4a7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5626246a93d0 0x56262469d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.793+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc0ce840 con 0x562624662290 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.793+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56262468f580 con 0x5626246a93d0 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95d4a7e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x562624719130 con 0x562624662670 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95d4a7e740 10 client.0 _ll_register_callbacks cb 0x7f95b808b050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95caa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x56262465ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95caa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x56262465ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49694/0 (socket says 172.21.15.99:49694) 2024-03-30T13:13:13.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95caa00640 1 -- 172.21.15.99:0/460166843 learned_addr learned my addr 172.21.15.99:0/460166843 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95caa00640 1 -- 172.21.15.99:0/460166843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 msgr2=0x56262469cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95caa00640 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 0x56262469cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95caa00640 1 -- 172.21.15.99:0/460166843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5626246a93d0 msgr2=0x56262469d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95cb400640 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5626246a93d0 0x56262469d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95caa00640 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5626246a93d0 0x56262469d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95caa00640 1 -- 172.21.15.99:0/460166843 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56262465bf70 con 0x562624662290 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95caa00640 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x56262465ba30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f95bc025040 tx=0x7f95bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1c6654dc96d9f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.794+0000 7f95abe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95abe00640 1 -- 172.21.15.99:0/460166843 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc027040 con 0x562624662290 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95abe00640 1 -- 172.21.15.99:0/460166843 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f95bc003c60 con 0x562624662290 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95d4a7e740 1 -- 172.21.15.99:0/460166843 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95c4003b70 con 0x562624662290 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95abe00640 1 -- 172.21.15.99:0/460166843 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f95bc040050 con 0x562624662290 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95d4a7e740 10 client.5511 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:13.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95d4a7e740 1 -- 172.21.15.99:0/460166843 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x562624718ed0 con 0x562624662290 2024-03-30T13:13:13.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95abe00640 1 -- 172.21.15.99:0/460166843 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c4003b70 con 0x562624662290 2024-03-30T13:13:13.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95abe00640 1 -- 172.21.15.99:0/460166843 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f95bc043020 con 0x562624662290 2024-03-30T13:13:13.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95d4a7e740 10 client.5511 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:13.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95d4a7e740 10 client.5511 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:13.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95d4a7e740 20 client.5511 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:13.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5626247133d0 0x56262469fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95d4a7e740 4 client.5511 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628308}] 2024-03-30T13:13:13.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.795+0000 7f95d4a7e740 1 -- 172.21.15.99:0/460166843 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628308}) -- 0x5626246aa140 con 0x5626247133d0 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.796+0000 7f95ca000640 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5626247133d0 0x56262469fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.797+0000 7f95ca000640 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5626247133d0 0x56262469fc70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=147c0e3a67246313 server_cookie=c2cdab5f0e287ec5 in_seq=0 out_seq=0 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.797+0000 7f95abe00640 10 client.5511 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95abe00640 1 -- 172.21.15.99:0/460166843 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3965 (crc 0 0 0) 0x5626246aa140 con 0x5626247133d0 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95abe00640 10 client.5511 handle_command_reply: tid=0 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95d4a7e740 1 client.5511 shutdown 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95d4a7e740 1 -- 172.21.15.99:0/460166843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 msgr2=0x56262465ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x56262465ba30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f95bc025040 tx=0x7f95bc004730 comp rx=0 tx=0).stop 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95d4a7e740 1 -- 172.21.15.99:0/460166843 shutdown_connections 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5626247133d0 0x56262469fc70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5626246a93d0 0x56262469d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x562624662670 0x56262469cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95d4a7e740 1 --2- 172.21.15.99:0/460166843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562624662290 0x56262465ba30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95abe00640 0 client.5511 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:13.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95d4a7e740 1 -- 172.21.15.99:0/460166843 >> 172.21.15.99:0/460166843 conn(0x562624628be0 msgr2=0x562624688030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95d4a7e740 1 -- 172.21.15.99:0/460166843 shutdown_connections 2024-03-30T13:13:13.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.798+0000 7f95d4a7e740 1 -- 172.21.15.99:0/460166843 wait complete. 2024-03-30T13:13:13.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d4a7e740 20 client.5511 trim_cache size 0 max 16384 2024-03-30T13:13:13.804 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:13.804 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/Kconfig", 2024-03-30T13:13:13.804 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628308, 2024-03-30T13:13:13.804 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.398242+0000", 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.430957+0000", 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:13.805 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1240, 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.430957+0000", 2024-03-30T13:13:13.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.807 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1240, 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.398242+0000" 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1240, 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:13.808 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.398242+0000" 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 126, 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 2, 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.451501+0000", 2024-03-30T13:13:13.809 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 40, 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:13.811 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:13.812 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:13.813 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:13.814 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:13.815 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:13.816 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:13.816 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:13.816 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:13.816 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:13.816 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d1e00640 1 -- 172.21.15.99:0/169024479 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f95ac06c560 msgr2=0x7f95ac06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d1e00640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f95ac06c560 0x7f95ac06ea20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f95bc006fd0 tx=0x7f95bc008040 comp rx=0 tx=0).stop 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d1e00640 1 -- 172.21.15.99:0/169024479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95cc0ad300 msgr2=0x7f95cc0af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d1e00640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95cc0ad300 0x7f95cc0af920 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f95b800d870 tx=0x7f95b800dd30 comp rx=0 tx=0).stop 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d1e00640 1 -- 172.21.15.99:0/169024479 shutdown_connections 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d1e00640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f95ac06c560 0x7f95ac06ea20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d1e00640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95cc0b0550 0x7f95cc0afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d1e00640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95cc0ad300 0x7f95cc0af920 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d1e00640 1 --2- 172.21.15.99:0/169024479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95b0004d40 0x7f95cc0ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d1e00640 1 -- 172.21.15.99:0/169024479 >> 172.21.15.99:0/169024479 conn(0x7f95cc0d0450 msgr2=0x7f95cc0b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.799+0000 7f95d1e00640 1 -- 172.21.15.99:0/169024479 shutdown_connections 2024-03-30T13:13:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:13.800+0000 7f95d1e00640 1 -- 172.21.15.99:0/169024479 wait complete. 2024-03-30T13:13:13.821 DEBUG:tasks.cephfs.test_uninlining:getting inode info #7 of 23:1099511628326 2024-03-30T13:13:13.821 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628326 2024-03-30T13:13:13.821 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628326 2024-03-30T13:13:14.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.032+0000 7fbd8a800640 1 Processor -- start 2024-03-30T13:13:14.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.032+0000 7fbd8a800640 1 -- start start 2024-03-30T13:13:14.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.034+0000 7fbd8a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbd840d3430 0x7fbd840cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.034+0000 7fbd8a800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd840d0210 0x7fbd840b7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.034+0000 7fbd8a800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd840d2390 con 0x7fbd840d1010 2024-03-30T13:13:14.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.034+0000 7fbd8a800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fbd840d5060 con 0x7fbd840d3430 2024-03-30T13:13:14.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.034+0000 7fbd8a800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbd840d2670 con 0x7fbd840d0210 2024-03-30T13:13:14.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.034+0000 7fbd7aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbd840d3430 0x7fbd840cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.034+0000 7fbd7aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbd840d3430 0x7fbd840cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49704/0 (socket says 172.21.15.99:49704) 2024-03-30T13:13:14.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.034+0000 7fbd7aa00640 1 -- 172.21.15.99:0/2313226500 learned_addr learned my addr 172.21.15.99:0/2313226500 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.035+0000 7fbd83e00640 1 --2- 172.21.15.99:0/2313226500 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd840d0210 0x7fbd840b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.035+0000 7fbd7aa00640 1 -- 172.21.15.99:0/2313226500 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd840d0210 msgr2=0x7fbd840b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.035+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/2313226500 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd840d0210 0x7fbd840b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.035+0000 7fbd7aa00640 1 -- 172.21.15.99:0/2313226500 >> v1:172.21.15.181:6789/0 conn(0x7fbd840d1010 legacy=0x7fbd840d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.035+0000 7fbd7aa00640 1 -- 172.21.15.99:0/2313226500 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd840d2950 con 0x7fbd840d3430 2024-03-30T13:13:14.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.036+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/2313226500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd840d3430 0x7fbd840cfcd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009870 tx=0x7fbd6c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a83712eed06152 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.036+0000 7fbd82a00640 1 -- 172.21.15.99:0/2313226500 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c035020 con 0x7fbd840d3430 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.036+0000 7fbd82a00640 1 -- 172.21.15.99:0/2313226500 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6c031640 con 0x7fbd840d3430 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.036+0000 7fbd82a00640 1 -- 172.21.15.99:0/2313226500 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c02d040 con 0x7fbd840d3430 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.037+0000 7fbd8a800640 1 -- 172.21.15.99:0/2313226500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd840d3430 msgr2=0x7fbd840cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.037+0000 7fbd8a800640 1 --2- 172.21.15.99:0/2313226500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd840d3430 0x7fbd840cfcd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009870 tx=0x7fbd6c02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.037+0000 7fbd8a800640 1 -- 172.21.15.99:0/2313226500 shutdown_connections 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.037+0000 7fbd8a800640 1 --2- 172.21.15.99:0/2313226500 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd840d0210 0x7fbd840b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.037+0000 7fbd8a800640 1 --2- 172.21.15.99:0/2313226500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd840d3430 0x7fbd840cfcd0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.037+0000 7fbd8a800640 1 -- 172.21.15.99:0/2313226500 >> 172.21.15.99:0/2313226500 conn(0x7fbd8408bfc0 msgr2=0x7fbd840d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.037+0000 7fbd8a800640 1 -- 172.21.15.99:0/2313226500 shutdown_connections 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.037+0000 7fbd8a800640 1 -- 172.21.15.99:0/2313226500 wait complete. 2024-03-30T13:13:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.039+0000 7fbd8a800640 1 Processor -- start 2024-03-30T13:13:14.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.039+0000 7fbd8a800640 1 -- start start 2024-03-30T13:13:14.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.040+0000 7fbd8a800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd840d0210 0x7fbd840c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.040+0000 7fbd8a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd840d1010 0x7fbd840b7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.040+0000 7fbd8a800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd840d3430 0x7fbd8414a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.040+0000 7fbd8a800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8415eaf0 con 0x7fbd840d1010 2024-03-30T13:13:14.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.040+0000 7fbd8a800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbd840d2f10 con 0x7fbd840d3430 2024-03-30T13:13:14.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.040+0000 7fbd8a800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8415ec70 con 0x7fbd840d0210 2024-03-30T13:13:14.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.040+0000 7fbd7aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd840d1010 0x7fbd840b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.040+0000 7fbd7aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd840d1010 0x7fbd840b7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49710/0 (socket says 172.21.15.99:49710) 2024-03-30T13:13:14.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.040+0000 7fbd7aa00640 1 -- 172.21.15.99:0/395675160 learned_addr learned my addr 172.21.15.99:0/395675160 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.041+0000 7fbd83400640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd840d0210 0x7fbd840c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.041+0000 7fbd83e00640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd840d3430 0x7fbd8414a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.041+0000 7fbd7aa00640 1 -- 172.21.15.99:0/395675160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd840d0210 msgr2=0x7fbd840c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.041+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd840d0210 0x7fbd840c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.041+0000 7fbd7aa00640 1 -- 172.21.15.99:0/395675160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd840d3430 msgr2=0x7fbd8414a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.041+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd840d3430 0x7fbd8414a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.041+0000 7fbd7aa00640 1 -- 172.21.15.99:0/395675160 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd840ba210 con 0x7fbd840d1010 2024-03-30T13:13:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.041+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd840d1010 0x7fbd840b7200 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0097c0 tx=0x7fbd6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.042+0000 7fbd7be00640 1 -- 172.21.15.99:0/395675160 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c040070 con 0x7fbd840d1010 2024-03-30T13:13:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.042+0000 7fbd7be00640 1 -- 172.21.15.99:0/395675160 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6c0399f0 con 0x7fbd840d1010 2024-03-30T13:13:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.042+0000 7fbd7be00640 1 -- 172.21.15.99:0/395675160 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c035040 con 0x7fbd840d1010 2024-03-30T13:13:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.042+0000 7fbd8a800640 1 -- 172.21.15.99:0/395675160 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd840c9180 con 0x7fbd840d1010 2024-03-30T13:13:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.042+0000 7fbd8a800640 1 -- 172.21.15.99:0/395675160 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd840c9740 con 0x7fbd840d1010 2024-03-30T13:13:14.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.044+0000 7fbd7be00640 1 -- 172.21.15.99:0/395675160 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbd6c04b060 con 0x7fbd840d1010 2024-03-30T13:13:14.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.045+0000 7fbd7be00640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd6006c530 0x7fbd6006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.045+0000 7fbd7be00640 1 -- 172.21.15.99:0/395675160 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fbd6c0ad260 con 0x7fbd840d1010 2024-03-30T13:13:14.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.045+0000 7fbd83400640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd6006c530 0x7fbd6006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.046+0000 7fbd8d589740 1 Processor -- start 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.046+0000 7fbd83400640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd6006c530 0x7fbd6006e9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbd74005520 tx=0x7fbd74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.046+0000 7fbd8d589740 1 -- start start 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.047+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43290 0x5569c3a69dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.047+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a6a300 0x5569c3a422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.047+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43670 0x5569c3a42810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.047+0000 7fbd8d589740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5569c39a6330 con 0x5569c3a43670 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.047+0000 7fbd8d589740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5569c394e620 con 0x5569c3a6a300 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.047+0000 7fbd8d589740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5569c39a2440 con 0x5569c3a43290 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.047+0000 7fbd83e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43670 0x5569c3a42810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.047+0000 7fbd83e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43670 0x5569c3a42810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49722/0 (socket says 172.21.15.99:49722) 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.047+0000 7fbd83e00640 1 -- 172.21.15.99:0/988527930 learned_addr learned my addr 172.21.15.99:0/988527930 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.048+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/988527930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a6a300 0x5569c3a422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.048+0000 7fbd83400640 1 --2- 172.21.15.99:0/988527930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43290 0x5569c3a69dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.048+0000 7fbd83e00640 1 -- 172.21.15.99:0/988527930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43290 msgr2=0x5569c3a69dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.048+0000 7fbd83e00640 1 --2- 172.21.15.99:0/988527930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43290 0x5569c3a69dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.048+0000 7fbd83e00640 1 -- 172.21.15.99:0/988527930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a6a300 msgr2=0x5569c3a422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.048+0000 7fbd83e00640 1 --2- 172.21.15.99:0/988527930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a6a300 0x5569c3a422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.048+0000 7fbd83e00640 1 -- 172.21.15.99:0/988527930 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c3786920 con 0x5569c3a43670 2024-03-30T13:13:14.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.048+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/988527930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a6a300 0x5569c3a422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.048+0000 7fbd83e00640 1 --2- 172.21.15.99:0/988527930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43670 0x5569c3a42810 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00b8b0 tx=0x7fbd7c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5370f13cea194ed2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.048+0000 7fbd73e00640 1 -- 172.21.15.99:0/988527930 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c018020 con 0x5569c3a43670 2024-03-30T13:13:14.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.048+0000 7fbd73e00640 1 -- 172.21.15.99:0/988527930 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c00f960 con 0x5569c3a43670 2024-03-30T13:13:14.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.049+0000 7fbd73e00640 1 -- 172.21.15.99:0/988527930 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c00fd50 con 0x5569c3a43670 2024-03-30T13:13:14.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.049+0000 7fbd8d589740 1 -- 172.21.15.99:0/988527930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43670 msgr2=0x5569c3a42810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.049+0000 7fbd8d589740 1 --2- 172.21.15.99:0/988527930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43670 0x5569c3a42810 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00b8b0 tx=0x7fbd7c00bd70 comp rx=0 tx=0).stop 2024-03-30T13:13:14.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.049+0000 7fbd8d589740 1 -- 172.21.15.99:0/988527930 shutdown_connections 2024-03-30T13:13:14.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.049+0000 7fbd8d589740 1 --2- 172.21.15.99:0/988527930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43670 0x5569c3a42810 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.049+0000 7fbd8d589740 1 --2- 172.21.15.99:0/988527930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a6a300 0x5569c3a422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.049+0000 7fbd8d589740 1 --2- 172.21.15.99:0/988527930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43290 0x5569c3a69dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.049+0000 7fbd8d589740 1 -- 172.21.15.99:0/988527930 >> 172.21.15.99:0/988527930 conn(0x5569c3a09be0 msgr2=0x5569c3a87fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.049+0000 7fbd8d589740 1 -- 172.21.15.99:0/988527930 shutdown_connections 2024-03-30T13:13:14.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.049+0000 7fbd8d589740 1 -- 172.21.15.99:0/988527930 wait complete. 2024-03-30T13:13:14.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.050+0000 7fbd8d589740 1 -- start start 2024-03-30T13:13:14.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.050+0000 7fbd8d589740 1 Processor -- start 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.051+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a68c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.051+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43670 0x5569c3a98fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.051+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a994e0 0x5569c3a87f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.051+0000 7fbd8d589740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5569c3a69930 con 0x5569c3a43290 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.051+0000 7fbd8d589740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5569c39619d0 con 0x5569c3a994e0 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.051+0000 7fbd8d589740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5569c3a626b0 con 0x5569c3a43670 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.051+0000 7fbd8d589740 10 client.0 _ll_register_callbacks cb 0x5569c399dfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd83400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a68c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd83400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a68c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49734/0 (socket says 172.21.15.99:49734) 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd83400640 1 -- 172.21.15.99:0/3152430283 learned_addr learned my addr 172.21.15.99:0/3152430283 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43670 0x5569c3a98fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd83e00640 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a994e0 0x5569c3a87f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd83400640 1 -- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43670 msgr2=0x5569c3a98fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd83400640 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43670 0x5569c3a98fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd83400640 1 -- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a994e0 msgr2=0x5569c3a87f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd83400640 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a994e0 0x5569c3a87f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd83400640 1 -- 172.21.15.99:0/3152430283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c367a210 con 0x5569c3a43290 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd83e00640 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a994e0 0x5569c3a87f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd83400640 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a68c90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbd74015430 tx=0x7fbd74003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbc0e075f8ca204 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.052+0000 7fbd70c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd70c00640 1 -- 172.21.15.99:0/3152430283 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd740135f0 con 0x5569c3a43290 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd70c00640 1 -- 172.21.15.99:0/3152430283 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fbd74013790 con 0x5569c3a43290 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd8d589740 1 -- 172.21.15.99:0/3152430283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd7c00f960 con 0x5569c3a43290 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd70c00640 1 -- 172.21.15.99:0/3152430283 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbd74003b80 con 0x5569c3a43290 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd8d589740 10 client.5523 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:14.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd8d589740 1 -- 172.21.15.99:0/3152430283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5569c37e70b0 con 0x5569c3a43290 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd70c00640 1 -- 172.21.15.99:0/3152430283 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c00f960 con 0x5569c3a43290 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd70c00640 1 -- 172.21.15.99:0/3152430283 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fbd74030080 con 0x5569c3a43290 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd8d589740 10 client.5523 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd8d589740 10 client.5523 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd8d589740 20 client.5523 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5569c3a86a40 0x5569c3a86eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd8d589740 4 client.5523 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.053+0000 7fbd8d589740 1 -- 172.21.15.99:0/3152430283 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569c39b3870 con 0x5569c3a86a40 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.054+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5569c3a86a40 0x5569c3a86eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.055+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5569c3a86a40 0x5569c3a86eb0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b3a4da674986c46 server_cookie=a72b416474fa0d37 in_seq=0 out_seq=0 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.055+0000 7fbd70c00640 10 client.5523 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd70c00640 1 -- 172.21.15.99:0/3152430283 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5569c39b3870 con 0x5569c3a86a40 2024-03-30T13:13:14.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd70c00640 10 client.5523 handle_command_reply: tid=0 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 1 client.5523 shutdown 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 1 -- 172.21.15.99:0/3152430283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 msgr2=0x5569c3a68c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a68c90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbd74015430 tx=0x7fbd74003a70 comp rx=0 tx=0).stop 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 1 -- 172.21.15.99:0/3152430283 shutdown_connections 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5569c3a86a40 0x5569c3a86eb0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a994e0 0x5569c3a87f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43670 0x5569c3a98fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3152430283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a68c90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd70c00640 0 client.5523 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 1 -- 172.21.15.99:0/3152430283 >> 172.21.15.99:0/3152430283 conn(0x5569c3a09be0 msgr2=0x5569c3a6cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 1 -- 172.21.15.99:0/3152430283 shutdown_connections 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 1 -- 172.21.15.99:0/3152430283 wait complete. 2024-03-30T13:13:14.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.057+0000 7fbd8d589740 20 client.5523 trim_cache size 0 max 16384 2024-03-30T13:13:14.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.073+0000 7fbd8d589740 1 Processor -- start 2024-03-30T13:13:14.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.073+0000 7fbd8d589740 1 -- start start 2024-03-30T13:13:14.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.074+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a09be0 0x5569c3b01c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.074+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a62c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.074+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a43670 0x5569c3a3c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.074+0000 7fbd8d589740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84201020 con 0x5569c3a43290 2024-03-30T13:13:14.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.074+0000 7fbd8d589740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbd842000f0 con 0x5569c3a43670 2024-03-30T13:13:14.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.074+0000 7fbd8d589740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbd840cc440 con 0x5569c3a09be0 2024-03-30T13:13:14.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.074+0000 7fbd7aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a62c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.074+0000 7fbd7aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a62c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49744/0 (socket says 172.21.15.99:49744) 2024-03-30T13:13:14.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.074+0000 7fbd7aa00640 1 -- 172.21.15.99:0/2469526417 learned_addr learned my addr 172.21.15.99:0/2469526417 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.075+0000 7fbd83e00640 1 --2- 172.21.15.99:0/2469526417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a43670 0x5569c3a3c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.075+0000 7fbd7aa00640 1 -- 172.21.15.99:0/2469526417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a09be0 msgr2=0x5569c3b01c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.075+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/2469526417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a09be0 0x5569c3b01c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.075+0000 7fbd7aa00640 1 -- 172.21.15.99:0/2469526417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a43670 msgr2=0x5569c3a3c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.075+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/2469526417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a43670 0x5569c3a3c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.075+0000 7fbd7aa00640 1 -- 172.21.15.99:0/2469526417 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c36532d0 con 0x5569c3a43290 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.075+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/2469526417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a62c10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0774c0 tx=0x7fbd6c03c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149ff05fce3cf28f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.075+0000 7fbd73400640 1 -- 172.21.15.99:0/2469526417 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c083c40 con 0x5569c3a43290 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.075+0000 7fbd73400640 1 -- 172.21.15.99:0/2469526417 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6c079100 con 0x5569c3a43290 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.075+0000 7fbd73400640 1 -- 172.21.15.99:0/2469526417 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c039de0 con 0x5569c3a43290 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.076+0000 7fbd8d589740 1 -- 172.21.15.99:0/2469526417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 msgr2=0x5569c3a62c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.076+0000 7fbd8d589740 1 --2- 172.21.15.99:0/2469526417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a62c10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0774c0 tx=0x7fbd6c03c040 comp rx=0 tx=0).stop 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.076+0000 7fbd8d589740 1 -- 172.21.15.99:0/2469526417 shutdown_connections 2024-03-30T13:13:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.076+0000 7fbd8d589740 1 --2- 172.21.15.99:0/2469526417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a43670 0x5569c3a3c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.076+0000 7fbd8d589740 1 --2- 172.21.15.99:0/2469526417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3a62c10 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.076+0000 7fbd8d589740 1 --2- 172.21.15.99:0/2469526417 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a09be0 0x5569c3b01c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.076+0000 7fbd8d589740 1 -- 172.21.15.99:0/2469526417 >> 172.21.15.99:0/2469526417 conn(0x5569c3a99100 msgr2=0x5569c3a62500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.076+0000 7fbd8d589740 1 -- 172.21.15.99:0/2469526417 shutdown_connections 2024-03-30T13:13:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.076+0000 7fbd8d589740 1 -- 172.21.15.99:0/2469526417 wait complete. 2024-03-30T13:13:14.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.077+0000 7fbd8d589740 1 -- start start 2024-03-30T13:13:14.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.077+0000 7fbd8d589740 1 Processor -- start 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a09be0 0x5569c3af0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3b0c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd8d589740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43670 0x5569c3a61230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd8d589740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbd840cca90 con 0x5569c3a43290 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd8d589740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5569c3b0cee0 con 0x5569c3a09be0 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd8d589740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5569c3b00aa0 con 0x5569c3a43670 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd8d589740 10 client.0 _ll_register_callbacks cb 0x7fbd74005110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd7aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3b0c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd7aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3b0c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49754/0 (socket says 172.21.15.99:49754) 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd7aa00640 1 -- 172.21.15.99:0/3023563507 learned_addr learned my addr 172.21.15.99:0/3023563507 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd7aa00640 1 -- 172.21.15.99:0/3023563507 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43670 msgr2=0x5569c3a61230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/3023563507 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43670 0x5569c3a61230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd7aa00640 1 -- 172.21.15.99:0/3023563507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a09be0 msgr2=0x5569c3af0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.078+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/3023563507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a09be0 0x5569c3af0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.079+0000 7fbd7aa00640 1 -- 172.21.15.99:0/3023563507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c3b00cf0 con 0x5569c3a43290 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.079+0000 7fbd7aa00640 1 --2- 172.21.15.99:0/3023563507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3b0c520 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c07ad60 tx=0x7fbd74014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5576c17d7958850a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.079+0000 7fbd70c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.079+0000 7fbd70c00640 1 -- 172.21.15.99:0/3023563507 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0aa060 con 0x5569c3a43290 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.079+0000 7fbd70c00640 1 -- 172.21.15.99:0/3023563507 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fbd6c0ab780 con 0x5569c3a43290 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.079+0000 7fbd8d589740 1 -- 172.21.15.99:0/3023563507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd6c079100 con 0x5569c3a43290 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.079+0000 7fbd70c00640 1 -- 172.21.15.99:0/3023563507 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbd6c07f0e0 con 0x5569c3a43290 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.079+0000 7fbd8d589740 10 client.5529 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.079+0000 7fbd8d589740 1 -- 172.21.15.99:0/3023563507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5569c3afcdf0 con 0x5569c3a43290 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.079+0000 7fbd70c00640 1 -- 172.21.15.99:0/3023563507 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6c079100 con 0x5569c3a43290 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.080+0000 7fbd70c00640 1 -- 172.21.15.99:0/3023563507 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fbd6c0776d0 con 0x5569c3a43290 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.080+0000 7fbd8d589740 10 client.5529 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.080+0000 7fbd8d589740 10 client.5529 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.080+0000 7fbd8d589740 20 client.5529 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.080+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3023563507 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5569c3a994e0 0x5569c3a3c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.080+0000 7fbd8d589740 4 client.5529 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628326}] 2024-03-30T13:13:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.080+0000 7fbd8d589740 1 -- 172.21.15.99:0/3023563507 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628326}) -- 0x5569c39adbc0 con 0x5569c3a994e0 2024-03-30T13:13:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.080+0000 7fbd83400640 1 --2- 172.21.15.99:0/3023563507 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5569c3a994e0 0x5569c3a3c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.081+0000 7fbd70c00640 10 client.5529 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.081+0000 7fbd83400640 1 --2- 172.21.15.99:0/3023563507 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5569c3a994e0 0x5569c3a3c470 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47d39b0a8b8280cf server_cookie=efc9538255f1b352 in_seq=0 out_seq=0 2024-03-30T13:13:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd70c00640 1 -- 172.21.15.99:0/3023563507 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3971 (crc 0 0 0) 0x5569c39adbc0 con 0x5569c3a994e0 2024-03-30T13:13:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd70c00640 10 client.5529 handle_command_reply: tid=0 2024-03-30T13:13:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd8d589740 1 client.5529 shutdown 2024-03-30T13:13:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd8d589740 1 -- 172.21.15.99:0/3023563507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 msgr2=0x5569c3b0c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3023563507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3b0c520 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c07ad60 tx=0x7fbd74014000 comp rx=0 tx=0).stop 2024-03-30T13:13:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd8d589740 1 -- 172.21.15.99:0/3023563507 shutdown_connections 2024-03-30T13:13:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3023563507 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5569c3a43670 0x5569c3a61230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3023563507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5569c3a43290 0x5569c3b0c520 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3023563507 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5569c3a994e0 0x5569c3a3c470 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd8d589740 1 --2- 172.21.15.99:0/3023563507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5569c3a09be0 0x5569c3af0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd70c00640 0 client.5529 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd8d589740 1 -- 172.21.15.99:0/3023563507 >> 172.21.15.99:0/3023563507 conn(0x5569c3a99100 msgr2=0x5569c3a62d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd8d589740 1 -- 172.21.15.99:0/3023563507 shutdown_connections 2024-03-30T13:13:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.082+0000 7fbd8d589740 1 -- 172.21.15.99:0/3023563507 wait complete. 2024-03-30T13:13:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8d589740 20 client.5529 trim_cache size 0 max 16384 2024-03-30T13:13:14.088 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/xattr_user.c", 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628326, 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.400485+0000", 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.492956+0000", 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:14.089 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1232, 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:14.090 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.492956+0000", 2024-03-30T13:13:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:14.093 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.093 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1232, 2024-03-30T13:13:14.093 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:14.093 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:14.093 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:14.093 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.400485+0000" 2024-03-30T13:13:14.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.093 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:14.093 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1232, 2024-03-30T13:13:14.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:14.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:14.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:14.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.400485+0000" 2024-03-30T13:13:14.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.094 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 138, 2024-03-30T13:13:14.094 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:14.095 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:14.095 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 38, 2024-03-30T13:13:14.095 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:14.095 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:14.095 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:14.095 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:14.095 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:14.095 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:14.095 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:14.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.096 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.453142+0000", 2024-03-30T13:13:14.096 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 42, 2024-03-30T13:13:14.096 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:14.096 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:14.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:14.096 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:14.096 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:14.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:14.097 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.097 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:14.097 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:14.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.097 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:14.097 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:14.097 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:14.098 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:14.098 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:14.098 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:14.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.098 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:14.098 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:14.098 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:14.098 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:14.098 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.099 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:14.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.099 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:14.099 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:14.099 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:14.099 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:14.099 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:14.099 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:14.100 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:14.100 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:14.100 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:14.100 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:14.100 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:14.100 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:14.100 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:14.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.100 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:14.101 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:14.101 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.101 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.101 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:14.101 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.101 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.101 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.101 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.101 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.102 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:14.102 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:14.102 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:14.102 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:14.102 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:14.102 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:14.102 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:14.103 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.103 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.103 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:14.103 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.103 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.103 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.103 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.103 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.104 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:14.104 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:14.104 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:14.104 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.104 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.104 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:14.104 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.104 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.105 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.105 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.105 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.105 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:14.105 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:14.105 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:14.105 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:14.105 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:14.105 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:14.106 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:14.107 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:14.107 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:14.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 -- 172.21.15.99:0/395675160 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd6006c530 msgr2=0x7fbd6006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd6006c530 0x7fbd6006e9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbd74005520 tx=0x7fbd74009040 comp rx=0 tx=0).stop 2024-03-30T13:13:14.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 -- 172.21.15.99:0/395675160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd840d1010 msgr2=0x7fbd840b7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd840d1010 0x7fbd840b7200 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0097c0 tx=0x7fbd6c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 -- 172.21.15.99:0/395675160 shutdown_connections 2024-03-30T13:13:14.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd6006c530 0x7fbd6006e9f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd840d3430 0x7fbd8414a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd840d1010 0x7fbd840b7200 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 --2- 172.21.15.99:0/395675160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd840d0210 0x7fbd840c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 -- 172.21.15.99:0/395675160 >> 172.21.15.99:0/395675160 conn(0x7fbd8408bfc0 msgr2=0x7fbd8415fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 -- 172.21.15.99:0/395675160 shutdown_connections 2024-03-30T13:13:14.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.083+0000 7fbd8a800640 1 -- 172.21.15.99:0/395675160 wait complete. 2024-03-30T13:13:14.110 DEBUG:tasks.cephfs.test_uninlining:getting inode info #8 of 23:1099511628324 2024-03-30T13:13:14.110 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628324 2024-03-30T13:13:14.110 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628324 2024-03-30T13:13:14.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.313+0000 7f8b0d600640 1 Processor -- start 2024-03-30T13:13:14.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.314+0000 7f8b0d600640 1 -- start start 2024-03-30T13:13:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.315+0000 7f8b0d600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8b080b4e40 0x7f8b080c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.315+0000 7f8b0d600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b081604d0 con 0x7f8b080b2810 2024-03-30T13:13:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.315+0000 7f8b0d600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b081607b0 con 0x7f8b080b31c0 2024-03-30T13:13:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.315+0000 7f8b0d600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8b080c6d60 con 0x7f8b080b4e40 2024-03-30T13:13:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.315+0000 7f8b06a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8b080b4e40 0x7f8b080c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.315+0000 7f8b06a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8b080b4e40 0x7f8b080c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49766/0 (socket says 172.21.15.99:49766) 2024-03-30T13:13:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.315+0000 7f8b07400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8b080b2810 0x7f8b080cbec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49278/0 (socket says 172.21.15.99:49278) 2024-03-30T13:13:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.315+0000 7f8b06a00640 1 -- 172.21.15.99:0/506456404 learned_addr learned my addr 172.21.15.99:0/506456404 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.316+0000 7f8b06a00640 1 -- 172.21.15.99:0/506456404 >> v1:172.21.15.181:6789/0 conn(0x7f8b080b31c0 legacy=0x7f8b080b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.316+0000 7f8b06000640 1 -- 172.21.15.99:0/506456404 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736763992 0 0) 0x7f8b081604d0 con 0x7f8b080b2810 2024-03-30T13:13:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.316+0000 7f8b06a00640 1 -- 172.21.15.99:0/506456404 >> v1:172.21.15.99:6789/0 conn(0x7f8b080b2810 legacy=0x7f8b080cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.316+0000 7f8b06a00640 1 -- 172.21.15.99:0/506456404 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b08160a90 con 0x7f8b080b4e40 2024-03-30T13:13:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.317+0000 7f8b06a00640 1 --2- 172.21.15.99:0/506456404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b080b4e40 0x7f8b080c6820 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009870 tx=0x7f8af802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2fd9ebf65a8be6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.317+0000 7f8b06000640 1 -- 172.21.15.99:0/506456404 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8034070 con 0x7f8b080b4e40 2024-03-30T13:13:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.317+0000 7f8b06000640 1 -- 172.21.15.99:0/506456404 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af8030860 con 0x7f8b080b4e40 2024-03-30T13:13:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.317+0000 7f8b06000640 1 -- 172.21.15.99:0/506456404 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8030c30 con 0x7f8b080b4e40 2024-03-30T13:13:14.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.318+0000 7f8b0d600640 1 -- 172.21.15.99:0/506456404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b080b4e40 msgr2=0x7f8b080c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.318+0000 7f8b0d600640 1 --2- 172.21.15.99:0/506456404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b080b4e40 0x7f8b080c6820 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009870 tx=0x7f8af802b9a0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.318+0000 7f8b0d600640 1 -- 172.21.15.99:0/506456404 shutdown_connections 2024-03-30T13:13:14.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.318+0000 7f8b0d600640 1 --2- 172.21.15.99:0/506456404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b080b4e40 0x7f8b080c6820 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.318+0000 7f8b0d600640 1 -- 172.21.15.99:0/506456404 >> 172.21.15.99:0/506456404 conn(0x7f8b080d0450 msgr2=0x7f8b080d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.318+0000 7f8b0d600640 1 -- 172.21.15.99:0/506456404 shutdown_connections 2024-03-30T13:13:14.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.318+0000 7f8b0d600640 1 -- 172.21.15.99:0/506456404 wait complete. 2024-03-30T13:13:14.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.320+0000 7f8b0d600640 1 Processor -- start 2024-03-30T13:13:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.320+0000 7f8b0d600640 1 -- start start 2024-03-30T13:13:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.321+0000 7f8b0d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b080b2810 0x7f8b081f8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.321+0000 7f8b0d600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b080b31c0 0x7f8b081513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.321+0000 7f8b0d600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b080b4e40 0x7f8b0815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.321+0000 7f8b0d600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8b080b3650 con 0x7f8b080b2810 2024-03-30T13:13:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.321+0000 7f8b0d600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8b080cba20 con 0x7f8b080b4e40 2024-03-30T13:13:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.321+0000 7f8b0d600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8b080c60f0 con 0x7f8b080b31c0 2024-03-30T13:13:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.321+0000 7f8b06a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b080b2810 0x7f8b081f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.321+0000 7f8b06a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b080b2810 0x7f8b081f8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49780/0 (socket says 172.21.15.99:49780) 2024-03-30T13:13:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.321+0000 7f8b06a00640 1 -- 172.21.15.99:0/3364146083 learned_addr learned my addr 172.21.15.99:0/3364146083 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8b06a00640 1 -- 172.21.15.99:0/3364146083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b080b31c0 msgr2=0x7f8b081513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8affe00640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b080b31c0 0x7f8b081513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8b06a00640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b080b31c0 0x7f8b081513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8b06a00640 1 -- 172.21.15.99:0/3364146083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b080b4e40 msgr2=0x7f8b0815bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8b06a00640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b080b4e40 0x7f8b0815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8b06a00640 1 -- 172.21.15.99:0/3364146083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b080ad710 con 0x7f8b080b2810 2024-03-30T13:13:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8affe00640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b080b31c0 0x7f8b081513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8b06a00640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b080b2810 0x7f8b081f8800 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009870 tx=0x7f8af80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8afea00640 1 -- 172.21.15.99:0/3364146083 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8034040 con 0x7f8b080b2810 2024-03-30T13:13:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8afea00640 1 -- 172.21.15.99:0/3364146083 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af80433f0 con 0x7f8b080b2810 2024-03-30T13:13:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8afea00640 1 -- 172.21.15.99:0/3364146083 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af80437e0 con 0x7f8b080b2810 2024-03-30T13:13:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.322+0000 7f8b0d600640 1 -- 172.21.15.99:0/3364146083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b080ad9f0 con 0x7f8b080b2810 2024-03-30T13:13:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.323+0000 7f8b0d600640 1 -- 172.21.15.99:0/3364146083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0815c500 con 0x7f8b080b2810 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.325+0000 7f8afea00640 1 -- 172.21.15.99:0/3364146083 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8af804a060 con 0x7f8b080b2810 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.325+0000 7f8afea00640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8ae406c530 0x7f8ae406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.326+0000 7f8afea00640 1 -- 172.21.15.99:0/3364146083 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f8af80ada10 con 0x7f8b080b2810 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.326+0000 7f8affe00640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8ae406c530 0x7f8ae406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.327+0000 7f8affe00640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8ae406c530 0x7f8ae406e9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8b0815a610 tx=0x7f8af0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.327+0000 7f8b103de740 1 Processor -- start 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.327+0000 7f8b103de740 1 -- start start 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8b103de740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 0x556b6b572dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8b103de740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b573300 0x556b6b54b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8b103de740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c670 0x556b6b54b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8b103de740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556b6b4af330 con 0x556b6b573300 2024-03-30T13:13:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8b103de740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556b6b457620 con 0x556b6b54c670 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8b103de740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x556b6b4ab440 con 0x556b6b54c290 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8affe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b573300 0x556b6b54b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8affe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b573300 0x556b6b54b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49784/0 (socket says 172.21.15.99:49784) 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8affe00640 1 -- 172.21.15.99:0/3852878851 learned_addr learned my addr 172.21.15.99:0/3852878851 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8b06a00640 1 --2- 172.21.15.99:0/3852878851 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 0x556b6b572dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8b07400640 1 --2- 172.21.15.99:0/3852878851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c670 0x556b6b54b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8affe00640 1 -- 172.21.15.99:0/3852878851 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 msgr2=0x556b6b572dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.328+0000 7f8affe00640 1 --2- 172.21.15.99:0/3852878851 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 0x556b6b572dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.329+0000 7f8affe00640 1 -- 172.21.15.99:0/3852878851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c670 msgr2=0x556b6b54b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.329+0000 7f8affe00640 1 --2- 172.21.15.99:0/3852878851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c670 0x556b6b54b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.329+0000 7f8affe00640 1 -- 172.21.15.99:0/3852878851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b6b28f920 con 0x556b6b573300 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.329+0000 7f8affe00640 1 --2- 172.21.15.99:0/3852878851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b573300 0x556b6b54b2d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8af000d9b0 tx=0x7f8af0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a9ebcfa4cba800 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.329+0000 7f8af7000640 1 -- 172.21.15.99:0/3852878851 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0024070 con 0x556b6b573300 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.329+0000 7f8af7000640 1 -- 172.21.15.99:0/3852878851 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af0014db0 con 0x556b6b573300 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.329+0000 7f8af7000640 1 -- 172.21.15.99:0/3852878851 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af001f600 con 0x556b6b573300 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.330+0000 7f8b103de740 1 -- 172.21.15.99:0/3852878851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b573300 msgr2=0x556b6b54b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.330+0000 7f8b103de740 1 --2- 172.21.15.99:0/3852878851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b573300 0x556b6b54b2d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8af000d9b0 tx=0x7f8af0010000 comp rx=0 tx=0).stop 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.330+0000 7f8b103de740 1 -- 172.21.15.99:0/3852878851 shutdown_connections 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.330+0000 7f8b103de740 1 --2- 172.21.15.99:0/3852878851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c670 0x556b6b54b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.330+0000 7f8b103de740 1 --2- 172.21.15.99:0/3852878851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b573300 0x556b6b54b2d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.330+0000 7f8b103de740 1 --2- 172.21.15.99:0/3852878851 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 0x556b6b572dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.330+0000 7f8b103de740 1 -- 172.21.15.99:0/3852878851 >> 172.21.15.99:0/3852878851 conn(0x556b6b512be0 msgr2=0x556b6b590fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.330+0000 7f8b103de740 1 -- 172.21.15.99:0/3852878851 shutdown_connections 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.330+0000 7f8b103de740 1 -- 172.21.15.99:0/3852878851 wait complete. 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.331+0000 7f8b103de740 1 -- start start 2024-03-30T13:13:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.331+0000 7f8b103de740 1 Processor -- start 2024-03-30T13:13:14.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8b103de740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 0x556b6b56a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8b103de740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b54c670 0x556b6b5a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8b103de740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b5a5070 0x556b6b5791b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8b103de740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556b6b572930 con 0x556b6b54c670 2024-03-30T13:13:14.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8b103de740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556b6b46a9d0 con 0x556b6b5a5070 2024-03-30T13:13:14.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8b103de740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x556b6b56b6b0 con 0x556b6b54c290 2024-03-30T13:13:14.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8b103de740 10 client.0 _ll_register_callbacks cb 0x556b6b4a6fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:14.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8affe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b54c670 0x556b6b5a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8affe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b54c670 0x556b6b5a0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49788/0 (socket says 172.21.15.99:49788) 2024-03-30T13:13:14.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8affe00640 1 -- 172.21.15.99:0/3147155085 learned_addr learned my addr 172.21.15.99:0/3147155085 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8affe00640 1 -- 172.21.15.99:0/3147155085 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 msgr2=0x556b6b56a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8affe00640 1 --2- 172.21.15.99:0/3147155085 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 0x556b6b56a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8affe00640 1 -- 172.21.15.99:0/3147155085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b5a5070 msgr2=0x556b6b5791b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.332+0000 7f8affe00640 1 --2- 172.21.15.99:0/3147155085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b5a5070 0x556b6b5791b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.333+0000 7f8affe00640 1 -- 172.21.15.99:0/3147155085 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b6b183210 con 0x556b6b54c670 2024-03-30T13:13:14.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.333+0000 7f8affe00640 1 --2- 172.21.15.99:0/3147155085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b54c670 0x556b6b5a0ee0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8af0017040 tx=0x7f8af0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eaffa4e8bf53961 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.333+0000 7f8aeb400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:14.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.333+0000 7f8aeb400640 1 -- 172.21.15.99:0/3147155085 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0024040 con 0x556b6b54c670 2024-03-30T13:13:14.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.333+0000 7f8aeb400640 1 -- 172.21.15.99:0/3147155085 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f8af0007470 con 0x556b6b54c670 2024-03-30T13:13:14.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.333+0000 7f8b103de740 1 -- 172.21.15.99:0/3147155085 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8af0014db0 con 0x556b6b54c670 2024-03-30T13:13:14.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.333+0000 7f8aeb400640 1 -- 172.21.15.99:0/3147155085 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8af0037050 con 0x556b6b54c670 2024-03-30T13:13:14.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.333+0000 7f8b103de740 10 client.5544 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:14.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.333+0000 7f8b103de740 1 -- 172.21.15.99:0/3147155085 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556b6b2f00b0 con 0x556b6b54c670 2024-03-30T13:13:14.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.334+0000 7f8aeb400640 1 -- 172.21.15.99:0/3147155085 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af0014db0 con 0x556b6b54c670 2024-03-30T13:13:14.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.334+0000 7f8aeb400640 1 -- 172.21.15.99:0/3147155085 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f8af003a020 con 0x556b6b54c670 2024-03-30T13:13:14.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.334+0000 7f8b103de740 10 client.5544 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:14.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.334+0000 7f8b103de740 10 client.5544 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:14.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.334+0000 7f8b103de740 20 client.5544 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:14.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.334+0000 7f8b103de740 1 --2- 172.21.15.99:0/3147155085 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556b6b56bd60 0x556b6b56c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.334+0000 7f8b103de740 4 client.5544 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:14.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.334+0000 7f8b103de740 1 -- 172.21.15.99:0/3147155085 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b6b4bc870 con 0x556b6b56bd60 2024-03-30T13:13:14.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.335+0000 7f8b06a00640 1 --2- 172.21.15.99:0/3147155085 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556b6b56bd60 0x556b6b56c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.335+0000 7f8b06a00640 1 --2- 172.21.15.99:0/3147155085 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556b6b56bd60 0x556b6b56c1a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a22f94e83af6769d server_cookie=312e4290636fe504 in_seq=0 out_seq=0 2024-03-30T13:13:14.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.335+0000 7f8aeb400640 10 client.5544 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.337+0000 7f8aeb400640 1 -- 172.21.15.99:0/3147155085 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x556b6b4bc870 con 0x556b6b56bd60 2024-03-30T13:13:14.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.337+0000 7f8aeb400640 10 client.5544 handle_command_reply: tid=0 2024-03-30T13:13:14.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.337+0000 7f8b103de740 1 client.5544 shutdown 2024-03-30T13:13:14.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.337+0000 7f8b103de740 1 -- 172.21.15.99:0/3147155085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b54c670 msgr2=0x556b6b5a0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.337+0000 7f8b103de740 1 --2- 172.21.15.99:0/3147155085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b54c670 0x556b6b5a0ee0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8af0017040 tx=0x7f8af0000ed0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.338+0000 7f8b103de740 1 -- 172.21.15.99:0/3147155085 shutdown_connections 2024-03-30T13:13:14.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.338+0000 7f8b103de740 1 --2- 172.21.15.99:0/3147155085 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556b6b56bd60 0x556b6b56c1a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.338+0000 7f8b103de740 1 --2- 172.21.15.99:0/3147155085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b5a5070 0x556b6b5791b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.338+0000 7f8b103de740 1 --2- 172.21.15.99:0/3147155085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b54c670 0x556b6b5a0ee0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.338+0000 7f8b103de740 1 --2- 172.21.15.99:0/3147155085 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 0x556b6b56a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.338+0000 7f8aeb400640 0 client.5544 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.338+0000 7f8b103de740 1 -- 172.21.15.99:0/3147155085 >> 172.21.15.99:0/3147155085 conn(0x556b6b512be0 msgr2=0x556b6b572160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.338+0000 7f8b103de740 1 -- 172.21.15.99:0/3147155085 shutdown_connections 2024-03-30T13:13:14.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.338+0000 7f8b103de740 1 -- 172.21.15.99:0/3147155085 wait complete. 2024-03-30T13:13:14.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.338+0000 7f8b103de740 20 client.5544 trim_cache size 0 max 16384 2024-03-30T13:13:14.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.353+0000 7f8b103de740 1 Processor -- start 2024-03-30T13:13:14.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.354+0000 7f8b103de740 1 -- start start 2024-03-30T13:13:14.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.354+0000 7f8b103de740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 0x556b6b570690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.354+0000 7f8b103de740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c670 0x556b6b571bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.354+0000 7f8b103de740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b6031e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.354+0000 7f8b103de740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8b08200cf0 con 0x556b6b5a5070 2024-03-30T13:13:14.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.354+0000 7f8b103de740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0815b310 con 0x556b6b54c670 2024-03-30T13:13:14.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.354+0000 7f8b103de740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0815a670 con 0x556b6b54c290 2024-03-30T13:13:14.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.355+0000 7f8b07400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b6031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.355+0000 7f8b07400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b6031e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49804/0 (socket says 172.21.15.99:49804) 2024-03-30T13:13:14.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.355+0000 7f8b07400640 1 -- 172.21.15.99:0/4196869400 learned_addr learned my addr 172.21.15.99:0/4196869400 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.355+0000 7f8b07400640 1 -- 172.21.15.99:0/4196869400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 msgr2=0x556b6b570690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.355+0000 7f8b07400640 1 --2- 172.21.15.99:0/4196869400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 0x556b6b570690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.355+0000 7f8b07400640 1 -- 172.21.15.99:0/4196869400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c670 msgr2=0x556b6b571bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.355+0000 7f8b07400640 1 --2- 172.21.15.99:0/4196869400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c670 0x556b6b571bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.355+0000 7f8b07400640 1 -- 172.21.15.99:0/4196869400 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b6b15c2d0 con 0x556b6b5a5070 2024-03-30T13:13:14.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.355+0000 7f8b07400640 1 --2- 172.21.15.99:0/4196869400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b6031e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8b00001bf0 tx=0x7f8b000020b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28574958d3c429c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.355+0000 7f8af6600640 1 -- 172.21.15.99:0/4196869400 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b00018070 con 0x556b6b5a5070 2024-03-30T13:13:14.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.355+0000 7f8af6600640 1 -- 172.21.15.99:0/4196869400 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0000d7d0 con 0x556b6b5a5070 2024-03-30T13:13:14.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.356+0000 7f8af6600640 1 -- 172.21.15.99:0/4196869400 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000dbc0 con 0x556b6b5a5070 2024-03-30T13:13:14.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.356+0000 7f8b103de740 1 -- 172.21.15.99:0/4196869400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 msgr2=0x556b6b6031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.356+0000 7f8b103de740 1 --2- 172.21.15.99:0/4196869400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b6031e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8b00001bf0 tx=0x7f8b000020b0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.356+0000 7f8b103de740 1 -- 172.21.15.99:0/4196869400 shutdown_connections 2024-03-30T13:13:14.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.356+0000 7f8b103de740 1 --2- 172.21.15.99:0/4196869400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b6031e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.356+0000 7f8b103de740 1 --2- 172.21.15.99:0/4196869400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c670 0x556b6b571bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.356+0000 7f8b103de740 1 --2- 172.21.15.99:0/4196869400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c290 0x556b6b570690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.356+0000 7f8b103de740 1 -- 172.21.15.99:0/4196869400 >> 172.21.15.99:0/4196869400 conn(0x556b6b512be0 msgr2=0x556b6b5789c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.356+0000 7f8b103de740 1 -- 172.21.15.99:0/4196869400 shutdown_connections 2024-03-30T13:13:14.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.356+0000 7f8b103de740 1 -- 172.21.15.99:0/4196869400 wait complete. 2024-03-30T13:13:14.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.357+0000 7f8b103de740 1 -- start start 2024-03-30T13:13:14.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.357+0000 7f8b103de740 1 Processor -- start 2024-03-30T13:13:14.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.358+0000 7f8b103de740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c290 0x556b6b5a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.358+0000 7f8b103de740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c670 0x556b6b5b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.358+0000 7f8b103de740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b5b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.358+0000 7f8b103de740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0815acc0 con 0x556b6b5a5070 2024-03-30T13:13:14.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.358+0000 7f8b103de740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556b6b5484d0 con 0x556b6b54c290 2024-03-30T13:13:14.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.358+0000 7f8b103de740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x556b6b603530 con 0x556b6b54c670 2024-03-30T13:13:14.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.358+0000 7f8b103de740 10 client.0 _ll_register_callbacks cb 0x7f8af0022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:14.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.358+0000 7f8b07400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b5b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.358+0000 7f8b07400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b5b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49816/0 (socket says 172.21.15.99:49816) 2024-03-30T13:13:14.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.358+0000 7f8b07400640 1 -- 172.21.15.99:0/619114237 learned_addr learned my addr 172.21.15.99:0/619114237 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8affe00640 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c670 0x556b6b5b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8b07400640 1 -- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c670 msgr2=0x556b6b5b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8b06a00640 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c290 0x556b6b5a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8b07400640 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c670 0x556b6b5b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8b07400640 1 -- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c290 msgr2=0x556b6b5a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8b07400640 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c290 0x556b6b5a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8b07400640 1 -- 172.21.15.99:0/619114237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b6b606090 con 0x556b6b5a5070 2024-03-30T13:13:14.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8affe00640 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c670 0x556b6b5b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8b07400640 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b5b3ec0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x556b6b57a010 tx=0x7f8b000014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2395c601ed9ea8bb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8aeb400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:14.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8aeb400640 1 -- 172.21.15.99:0/619114237 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b00022030 con 0x556b6b5a5070 2024-03-30T13:13:14.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8aeb400640 1 -- 172.21.15.99:0/619114237 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f8b00005da0 con 0x556b6b5a5070 2024-03-30T13:13:14.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.359+0000 7f8b103de740 1 -- 172.21.15.99:0/619114237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b0000d7d0 con 0x556b6b5a5070 2024-03-30T13:13:14.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.360+0000 7f8aeb400640 1 -- 172.21.15.99:0/619114237 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8b0002e050 con 0x556b6b5a5070 2024-03-30T13:13:14.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.360+0000 7f8b103de740 10 client.5550 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:14.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.360+0000 7f8b103de740 1 -- 172.21.15.99:0/619114237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556b6b603270 con 0x556b6b5a5070 2024-03-30T13:13:14.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.360+0000 7f8aeb400640 1 -- 172.21.15.99:0/619114237 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0000d7d0 con 0x556b6b5a5070 2024-03-30T13:13:14.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.360+0000 7f8aeb400640 1 -- 172.21.15.99:0/619114237 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f8b00031020 con 0x556b6b5a5070 2024-03-30T13:13:14.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.360+0000 7f8b103de740 10 client.5550 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:14.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.360+0000 7f8b103de740 10 client.5550 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:14.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.360+0000 7f8b103de740 20 client.5550 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:14.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.360+0000 7f8b103de740 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556b6b600230 0x556b6b56fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.360+0000 7f8b103de740 4 client.5550 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628324}] 2024-03-30T13:13:14.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.360+0000 7f8b103de740 1 -- 172.21.15.99:0/619114237 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628324}) -- 0x556b6b4b6bc0 con 0x556b6b600230 2024-03-30T13:13:14.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.361+0000 7f8b06a00640 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556b6b600230 0x556b6b56fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.362+0000 7f8b06a00640 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556b6b600230 0x556b6b56fe50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21a436c6c1800eaf server_cookie=101bf3cef5d7b903 in_seq=0 out_seq=0 2024-03-30T13:13:14.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.362+0000 7f8aeb400640 10 client.5550 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.362+0000 7f8aeb400640 1 -- 172.21.15.99:0/619114237 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3975 (crc 0 0 0) 0x556b6b4b6bc0 con 0x556b6b600230 2024-03-30T13:13:14.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.362+0000 7f8aeb400640 10 client.5550 handle_command_reply: tid=0 2024-03-30T13:13:14.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 1 client.5550 shutdown 2024-03-30T13:13:14.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 1 -- 172.21.15.99:0/619114237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 msgr2=0x556b6b5b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b5b3ec0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x556b6b57a010 tx=0x7f8b000014d0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 1 -- 172.21.15.99:0/619114237 shutdown_connections 2024-03-30T13:13:14.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b6b5a5070 0x556b6b5b3ec0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556b6b54c670 0x556b6b5b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556b6b600230 0x556b6b56fe50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 1 --2- 172.21.15.99:0/619114237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b6b54c290 0x556b6b5a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 1 -- 172.21.15.99:0/619114237 >> 172.21.15.99:0/619114237 conn(0x556b6b512be0 msgr2=0x556b6b56c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8aeb400640 0 client.5550 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 1 -- 172.21.15.99:0/619114237 shutdown_connections 2024-03-30T13:13:14.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 1 -- 172.21.15.99:0/619114237 wait complete. 2024-03-30T13:13:14.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.363+0000 7f8b103de740 20 client.5550 trim_cache size 0 max 16384 2024-03-30T13:13:14.380 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:14.380 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/xattr_security.c", 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628324, 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.408458+0000", 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.485956+0000", 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1473, 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.485956+0000", 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1473, 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.408458+0000" 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1473, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.408458+0000" 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 150, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 34, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.454169+0000", 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 46, 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:14.393 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:14.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 -- 172.21.15.99:0/3364146083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8ae406c530 msgr2=0x7f8ae406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8ae406c530 0x7f8ae406e9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8b0815a610 tx=0x7f8af0009040 comp rx=0 tx=0).stop 2024-03-30T13:13:14.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 -- 172.21.15.99:0/3364146083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b080b2810 msgr2=0x7f8b081f8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b080b2810 0x7f8b081f8800 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009870 tx=0x7f8af80046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 -- 172.21.15.99:0/3364146083 shutdown_connections 2024-03-30T13:13:14.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f8ae406c530 0x7f8ae406e9f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b080b4e40 0x7f8b0815bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b080b31c0 0x7f8b081513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 --2- 172.21.15.99:0/3364146083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b080b2810 0x7f8b081f8800 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 -- 172.21.15.99:0/3364146083 >> 172.21.15.99:0/3364146083 conn(0x7f8b080d0450 msgr2=0x7f8b0815ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 -- 172.21.15.99:0/3364146083 shutdown_connections 2024-03-30T13:13:14.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.364+0000 7f8b0d600640 1 -- 172.21.15.99:0/3364146083 wait complete. 2024-03-30T13:13:14.395 DEBUG:tasks.cephfs.test_uninlining:getting inode info #9 of 23:1099511628309 2024-03-30T13:13:14.395 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628309 2024-03-30T13:13:14.395 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628309 2024-03-30T13:13:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.598+0000 7f5403e00640 1 Processor -- start 2024-03-30T13:13:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.598+0000 7f5403e00640 1 -- start start 2024-03-30T13:13:14.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.599+0000 7f5403e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f53fc15e920 0x7f53fc0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.599+0000 7f5403e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f53fc0d16a0 0x7f53fc0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.600+0000 7f5403e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53fc0d3780 con 0x7f53fc0cfde0 2024-03-30T13:13:14.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.600+0000 7f5403e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f53fc15ed00 con 0x7f53fc0d16a0 2024-03-30T13:13:14.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.600+0000 7f5403e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f53fc0d21e0 con 0x7f53fc15e920 2024-03-30T13:13:14.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.600+0000 7f5401e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f53fc0d16a0 0x7f53fc0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.600+0000 7f5401e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f53fc0d16a0 0x7f53fc0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49824/0 (socket says 172.21.15.99:49824) 2024-03-30T13:13:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.600+0000 7f5401e00640 1 -- 172.21.15.99:0/2173215412 learned_addr learned my addr 172.21.15.99:0/2173215412 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.600+0000 7f5401e00640 1 -- 172.21.15.99:0/2173215412 >> v2:172.21.15.181:3300/0 conn(0x7f53fc15e920 msgr2=0x7f53fc0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.600+0000 7f5401e00640 1 --2- 172.21.15.99:0/2173215412 >> v2:172.21.15.181:3300/0 conn(0x7f53fc15e920 0x7f53fc0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.600+0000 7f5401e00640 1 -- 172.21.15.99:0/2173215412 >> v1:172.21.15.181:6789/0 conn(0x7f53fc0cfde0 legacy=0x7f53fc0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.600+0000 7f5401e00640 1 -- 172.21.15.99:0/2173215412 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc0d2480 con 0x7f53fc0d16a0 2024-03-30T13:13:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.601+0000 7f5401e00640 1 --2- 172.21.15.99:0/2173215412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc0d16a0 0x7f53fc0d0240 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f53fc08e880 tx=0x7f53f402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f4295057ba8300 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.602+0000 7f53fbe00640 1 -- 172.21.15.99:0/2173215412 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f402ca80 con 0x7f53fc0d16a0 2024-03-30T13:13:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.602+0000 7f53fbe00640 1 -- 172.21.15.99:0/2173215412 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f402cc20 con 0x7f53fc0d16a0 2024-03-30T13:13:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.602+0000 7f53fbe00640 1 -- 172.21.15.99:0/2173215412 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f40343f0 con 0x7f53fc0d16a0 2024-03-30T13:13:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.602+0000 7f5403e00640 1 -- 172.21.15.99:0/2173215412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc0d16a0 msgr2=0x7f53fc0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.602+0000 7f5403e00640 1 --2- 172.21.15.99:0/2173215412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc0d16a0 0x7f53fc0d0240 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f53fc08e880 tx=0x7f53f402bee0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.602+0000 7f5403e00640 1 -- 172.21.15.99:0/2173215412 shutdown_connections 2024-03-30T13:13:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.602+0000 7f5403e00640 1 --2- 172.21.15.99:0/2173215412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc0d16a0 0x7f53fc0d0240 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.602+0000 7f5403e00640 1 --2- 172.21.15.99:0/2173215412 >> v2:172.21.15.181:3300/0 conn(0x7f53fc15e920 0x7f53fc0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.602+0000 7f5403e00640 1 -- 172.21.15.99:0/2173215412 >> 172.21.15.99:0/2173215412 conn(0x7f53fc08bfc0 msgr2=0x7f53fc0d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.602+0000 7f5403e00640 1 -- 172.21.15.99:0/2173215412 shutdown_connections 2024-03-30T13:13:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.602+0000 7f5403e00640 1 -- 172.21.15.99:0/2173215412 wait complete. 2024-03-30T13:13:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.604+0000 7f5403e00640 1 Processor -- start 2024-03-30T13:13:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.604+0000 7f5403e00640 1 -- start start 2024-03-30T13:13:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.605+0000 7f5403e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f53fc0cfde0 0x7f53fc159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.605+0000 7f5403e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53fc0d16a0 0x7f53fc0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.605+0000 7f5403e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc15e920 0x7f53fc0cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.605+0000 7f5403e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc0d2d20 con 0x7f53fc15e920 2024-03-30T13:13:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.605+0000 7f5403e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc0d2a40 con 0x7f53fc0d16a0 2024-03-30T13:13:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.605+0000 7f5403e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f53fc0d4ef0 con 0x7f53fc0cfde0 2024-03-30T13:13:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.605+0000 7f5401e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc15e920 0x7f53fc0cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.605+0000 7f5401e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc15e920 0x7f53fc0cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49830/0 (socket says 172.21.15.99:49830) 2024-03-30T13:13:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.605+0000 7f5401e00640 1 -- 172.21.15.99:0/58881119 learned_addr learned my addr 172.21.15.99:0/58881119 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f5400a00640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53fc0d16a0 0x7f53fc0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f5401e00640 1 -- 172.21.15.99:0/58881119 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f53fc0cfde0 msgr2=0x7f53fc159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f5401400640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f53fc0cfde0 0x7f53fc159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f5401e00640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f53fc0cfde0 0x7f53fc159ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f5401e00640 1 -- 172.21.15.99:0/58881119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53fc0d16a0 msgr2=0x7f53fc0cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f5401e00640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53fc0d16a0 0x7f53fc0cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f5401e00640 1 -- 172.21.15.99:0/58881119 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc158450 con 0x7f53fc15e920 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f5400a00640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53fc0d16a0 0x7f53fc0cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f5401e00640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc15e920 0x7f53fc0cbc20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f53f4036040 tx=0x7f53f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f53f9600640 1 -- 172.21.15.99:0/58881119 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4043020 con 0x7f53fc15e920 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f53f9600640 1 -- 172.21.15.99:0/58881119 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f403e450 con 0x7f53fc15e920 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.606+0000 7f53f9600640 1 -- 172.21.15.99:0/58881119 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f403e820 con 0x7f53fc15e920 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.607+0000 7f5403e00640 1 -- 172.21.15.99:0/58881119 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53fc15fae0 con 0x7f53fc15e920 2024-03-30T13:13:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.607+0000 7f5403e00640 1 -- 172.21.15.99:0/58881119 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53fc1600a0 con 0x7f53fc15e920 2024-03-30T13:13:14.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.609+0000 7f53f9600640 1 -- 172.21.15.99:0/58881119 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f53f4046020 con 0x7f53fc15e920 2024-03-30T13:13:14.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.610+0000 7f53f9600640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f53dc06c530 0x7f53dc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.610+0000 7f53f9600640 1 -- 172.21.15.99:0/58881119 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f53f40ae1b0 con 0x7f53fc15e920 2024-03-30T13:13:14.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.610+0000 7f5401400640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f53dc06c530 0x7f53dc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.610+0000 7f5406bd9740 1 Processor -- start 2024-03-30T13:13:14.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.610+0000 7f5406bd9740 1 -- start start 2024-03-30T13:13:14.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.611+0000 7f5401400640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f53dc06c530 0x7f53dc06e9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f53f000a810 tx=0x7f53f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.611+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344290 0x563e8636adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.611+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e8636b300 0x563e863432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.611+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86344670 0x563e86343810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.611+0000 7f5406bd9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563e862a7330 con 0x563e8636b300 2024-03-30T13:13:14.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.611+0000 7f5406bd9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563e8624f620 con 0x563e86344290 2024-03-30T13:13:14.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.611+0000 7f5406bd9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563e862a3440 con 0x563e86344670 2024-03-30T13:13:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5400a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e8636b300 0x563e863432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5400a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e8636b300 0x563e863432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49836/0 (socket says 172.21.15.99:49836) 2024-03-30T13:13:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5400a00640 1 -- 172.21.15.99:0/3863391005 learned_addr learned my addr 172.21.15.99:0/3863391005 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5401400640 1 --2- 172.21.15.99:0/3863391005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344290 0x563e8636adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5401e00640 1 --2- 172.21.15.99:0/3863391005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86344670 0x563e86343810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5400a00640 1 -- 172.21.15.99:0/3863391005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86344670 msgr2=0x563e86343810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5400a00640 1 --2- 172.21.15.99:0/3863391005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86344670 0x563e86343810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5400a00640 1 -- 172.21.15.99:0/3863391005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344290 msgr2=0x563e8636adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5400a00640 1 --2- 172.21.15.99:0/3863391005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344290 0x563e8636adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5400a00640 1 -- 172.21.15.99:0/3863391005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e86087920 con 0x563e8636b300 2024-03-30T13:13:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5401400640 1 --2- 172.21.15.99:0/3863391005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344290 0x563e8636adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.612+0000 7f5400a00640 1 --2- 172.21.15.99:0/3863391005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e8636b300 0x563e863432d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f53e800a880 tx=0x7f53e800ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22c2f881d1c1fdb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.613+0000 7f53edc00640 1 -- 172.21.15.99:0/3863391005 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8015070 con 0x563e8636b300 2024-03-30T13:13:14.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.613+0000 7f53edc00640 1 -- 172.21.15.99:0/3863391005 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e800cae0 con 0x563e8636b300 2024-03-30T13:13:14.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.613+0000 7f53edc00640 1 -- 172.21.15.99:0/3863391005 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e80113f0 con 0x563e8636b300 2024-03-30T13:13:14.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.613+0000 7f5406bd9740 1 -- 172.21.15.99:0/3863391005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e8636b300 msgr2=0x563e863432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.613+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3863391005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e8636b300 0x563e863432d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f53e800a880 tx=0x7f53e800ad40 comp rx=0 tx=0).stop 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.613+0000 7f5406bd9740 1 -- 172.21.15.99:0/3863391005 shutdown_connections 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.613+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3863391005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86344670 0x563e86343810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.613+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3863391005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e8636b300 0x563e863432d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.613+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3863391005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344290 0x563e8636adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.613+0000 7f5406bd9740 1 -- 172.21.15.99:0/3863391005 >> 172.21.15.99:0/3863391005 conn(0x563e8630abe0 msgr2=0x563e86388fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.614+0000 7f5406bd9740 1 -- 172.21.15.99:0/3863391005 shutdown_connections 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.614+0000 7f5406bd9740 1 -- 172.21.15.99:0/3863391005 wait complete. 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.614+0000 7f5406bd9740 1 -- start start 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.614+0000 7f5406bd9740 1 Processor -- start 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.615+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344290 0x563e863628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.615+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86344670 0x563e86382590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.615+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e863709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.615+0000 7f5406bd9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563e8636a930 con 0x563e863816f0 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.615+0000 7f5406bd9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563e862629d0 con 0x563e86344290 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.615+0000 7f5406bd9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563e863636b0 con 0x563e86344670 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.615+0000 7f5406bd9740 10 client.0 _ll_register_callbacks cb 0x563e8629efd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f5401e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e863709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f5401e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e863709b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49850/0 (socket says 172.21.15.99:49850) 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f5401e00640 1 -- 172.21.15.99:0/3885186562 learned_addr learned my addr 172.21.15.99:0/3885186562 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f5401400640 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344290 0x563e863628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f5401e00640 1 -- 172.21.15.99:0/3885186562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86344670 msgr2=0x563e86382590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f5401e00640 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86344670 0x563e86382590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f5401e00640 1 -- 172.21.15.99:0/3885186562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344290 msgr2=0x563e863628b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f5401e00640 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344290 0x563e863628b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f5401e00640 1 -- 172.21.15.99:0/3885186562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e85f7b210 con 0x563e863816f0 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f5401e00640 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e863709b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f53f40ac560 tx=0x7f53f407c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74661a8de51c16b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f53e2000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f53e2000640 1 -- 172.21.15.99:0/3885186562 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4084b90 con 0x563e863816f0 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.616+0000 7f53e2000640 1 -- 172.21.15.99:0/3885186562 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f53f4094180 con 0x563e863816f0 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f5406bd9740 1 -- 172.21.15.99:0/3885186562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53e800cae0 con 0x563e863816f0 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f53e2000640 1 -- 172.21.15.99:0/3885186562 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f53f40943a0 con 0x563e863816f0 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f5406bd9740 10 client.5562 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f5406bd9740 1 -- 172.21.15.99:0/3885186562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x563e860e80b0 con 0x563e863816f0 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f53e2000640 1 -- 172.21.15.99:0/3885186562 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e800cae0 con 0x563e863816f0 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f53e2000640 1 -- 172.21.15.99:0/3885186562 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f53f40ac120 con 0x563e863816f0 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f5406bd9740 10 client.5562 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f5406bd9740 10 client.5562 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f5406bd9740 20 client.5562 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e86398e10 0x563e8636f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f5406bd9740 4 client.5562 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.617+0000 7f5406bd9740 1 -- 172.21.15.99:0/3885186562 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e862b4870 con 0x563e86398e10 2024-03-30T13:13:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.618+0000 7f5401400640 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e86398e10 0x563e8636f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.619+0000 7f5401400640 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e86398e10 0x563e8636f100 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75d330d5210b1f6 server_cookie=1501a975ec32b54f in_seq=0 out_seq=0 2024-03-30T13:13:14.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.619+0000 7f53e2000640 10 client.5562 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f53e2000640 1 -- 172.21.15.99:0/3885186562 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x563e862b4870 con 0x563e86398e10 2024-03-30T13:13:14.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f53e2000640 10 client.5562 handle_command_reply: tid=0 2024-03-30T13:13:14.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 1 client.5562 shutdown 2024-03-30T13:13:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 1 -- 172.21.15.99:0/3885186562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 msgr2=0x563e863709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e863709b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f53f40ac560 tx=0x7f53f407c770 comp rx=0 tx=0).stop 2024-03-30T13:13:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 1 -- 172.21.15.99:0/3885186562 shutdown_connections 2024-03-30T13:13:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e863709b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86344670 0x563e86382590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e86398e10 0x563e8636f100 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3885186562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344290 0x563e863628b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 1 -- 172.21.15.99:0/3885186562 >> 172.21.15.99:0/3885186562 conn(0x563e8630abe0 msgr2=0x563e8636dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f53e2000640 0 client.5562 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 1 -- 172.21.15.99:0/3885186562 shutdown_connections 2024-03-30T13:13:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 1 -- 172.21.15.99:0/3885186562 wait complete. 2024-03-30T13:13:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.621+0000 7f5406bd9740 20 client.5562 trim_cache size 0 max 16384 2024-03-30T13:13:14.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.638+0000 7f5406bd9740 1 Processor -- start 2024-03-30T13:13:14.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.638+0000 7f5406bd9740 1 -- start start 2024-03-30T13:13:14.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.638+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e86344290 0x563e8637fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.638+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344670 0x563e863801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.638+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e863816f0 0x563e863a1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.638+0000 7f5406bd9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc200f40 con 0x563e86344290 2024-03-30T13:13:14.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5406bd9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1fff90 con 0x563e86344670 2024-03-30T13:13:14.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5406bd9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f53fc1ff390 con 0x563e863816f0 2024-03-30T13:13:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5401400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e86344290 0x563e8637fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5401400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e86344290 0x563e8637fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49856/0 (socket says 172.21.15.99:49856) 2024-03-30T13:13:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5401400640 1 -- 172.21.15.99:0/2302841599 learned_addr learned my addr 172.21.15.99:0/2302841599 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5400a00640 1 --2- 172.21.15.99:0/2302841599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344670 0x563e863801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5401e00640 1 --2- 172.21.15.99:0/2302841599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e863816f0 0x563e863a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5401400640 1 -- 172.21.15.99:0/2302841599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e863816f0 msgr2=0x563e863a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5401400640 1 --2- 172.21.15.99:0/2302841599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e863816f0 0x563e863a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5401400640 1 -- 172.21.15.99:0/2302841599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344670 msgr2=0x563e863801a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5401400640 1 --2- 172.21.15.99:0/2302841599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344670 0x563e863801a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.639+0000 7f5401400640 1 -- 172.21.15.99:0/2302841599 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e85f542d0 con 0x563e86344290 2024-03-30T13:13:14.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.640+0000 7f5401400640 1 --2- 172.21.15.99:0/2302841599 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e86344290 0x563e8637fc60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c520 tx=0x7f53f0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddca62baad20402 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.640+0000 7f53ed200640 1 -- 172.21.15.99:0/2302841599 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f002a070 con 0x563e86344290 2024-03-30T13:13:14.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.640+0000 7f53ed200640 1 -- 172.21.15.99:0/2302841599 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f00241f0 con 0x563e86344290 2024-03-30T13:13:14.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.640+0000 7f53ed200640 1 -- 172.21.15.99:0/2302841599 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f00245c0 con 0x563e86344290 2024-03-30T13:13:14.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.641+0000 7f5406bd9740 1 -- 172.21.15.99:0/2302841599 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e86344290 msgr2=0x563e8637fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.641+0000 7f5406bd9740 1 --2- 172.21.15.99:0/2302841599 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e86344290 0x563e8637fc60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c520 tx=0x7f53f0012000 comp rx=0 tx=0).stop 2024-03-30T13:13:14.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.641+0000 7f5406bd9740 1 -- 172.21.15.99:0/2302841599 shutdown_connections 2024-03-30T13:13:14.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.641+0000 7f5406bd9740 1 --2- 172.21.15.99:0/2302841599 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e863816f0 0x563e863a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.641+0000 7f5406bd9740 1 --2- 172.21.15.99:0/2302841599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344670 0x563e863801a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.641+0000 7f5406bd9740 1 --2- 172.21.15.99:0/2302841599 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e86344290 0x563e8637fc60 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.641+0000 7f5406bd9740 1 -- 172.21.15.99:0/2302841599 >> 172.21.15.99:0/2302841599 conn(0x563e8630abe0 msgr2=0x563e86339880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.641+0000 7f5406bd9740 1 -- 172.21.15.99:0/2302841599 shutdown_connections 2024-03-30T13:13:14.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.641+0000 7f5406bd9740 1 -- 172.21.15.99:0/2302841599 wait complete. 2024-03-30T13:13:14.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.642+0000 7f5406bd9740 1 -- start start 2024-03-30T13:13:14.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.642+0000 7f5406bd9740 1 Processor -- start 2024-03-30T13:13:14.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344670 0x563e86404560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e8637ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5406bd9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86388c70 0x563e8637efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5406bd9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1ff940 con 0x563e863816f0 2024-03-30T13:13:14.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5406bd9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563e8636e0e0 con 0x563e86344670 2024-03-30T13:13:14.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5406bd9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563e86389370 con 0x563e86388c70 2024-03-30T13:13:14.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5406bd9740 10 client.0 _ll_register_callbacks cb 0x7f53f4009bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:14.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5400a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e8637ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5400a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e8637ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49866/0 (socket says 172.21.15.99:49866) 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5400a00640 1 -- 172.21.15.99:0/3909423735 learned_addr learned my addr 172.21.15.99:0/3909423735 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5401400640 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344670 0x563e86404560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.643+0000 7f5401e00640 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86388c70 0x563e8637efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.644+0000 7f5400a00640 1 -- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86388c70 msgr2=0x563e8637efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.644+0000 7f5400a00640 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86388c70 0x563e8637efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.644+0000 7f5400a00640 1 -- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344670 msgr2=0x563e86404560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.644+0000 7f5400a00640 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344670 0x563e86404560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.644+0000 7f5400a00640 1 -- 172.21.15.99:0/3909423735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e8637f780 con 0x563e863816f0 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.644+0000 7f5400a00640 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e8637ea80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f53e8006be0 tx=0x7f53e80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7dadc96c44b466 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.644+0000 7f53e2000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.644+0000 7f53e2000640 1 -- 172.21.15.99:0/3909423735 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8028060 con 0x563e863816f0 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.644+0000 7f53e2000640 1 -- 172.21.15.99:0/3909423735 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f53e801a450 con 0x563e863816f0 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.644+0000 7f5406bd9740 1 -- 172.21.15.99:0/3909423735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53f00241f0 con 0x563e863816f0 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.645+0000 7f53e2000640 1 -- 172.21.15.99:0/3909423735 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f53e802e050 con 0x563e863816f0 2024-03-30T13:13:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.645+0000 7f5406bd9740 10 client.5568 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.645+0000 7f5406bd9740 1 -- 172.21.15.99:0/3909423735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x563e863890b0 con 0x563e863816f0 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.645+0000 7f53e2000640 1 -- 172.21.15.99:0/3909423735 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f00241f0 con 0x563e863816f0 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.645+0000 7f53e2000640 1 -- 172.21.15.99:0/3909423735 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f53e8031020 con 0x563e863816f0 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.645+0000 7f5406bd9740 10 client.5568 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.645+0000 7f5406bd9740 10 client.5568 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.645+0000 7f5406bd9740 20 client.5568 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.645+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e863973d0 0x563e863977b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.645+0000 7f5406bd9740 4 client.5568 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628309}] 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.645+0000 7f5406bd9740 1 -- 172.21.15.99:0/3909423735 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628309}) -- 0x563e862aebc0 con 0x563e863973d0 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.646+0000 7f5401400640 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e863973d0 0x563e863977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.647+0000 7f5401400640 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e863973d0 0x563e863977b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d94e76fff79f8d7 server_cookie=3cb4346dc2ec335d in_seq=0 out_seq=0 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.647+0000 7f53e2000640 10 client.5568 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f53e2000640 1 -- 172.21.15.99:0/3909423735 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3963 (crc 0 0 0) 0x563e862aebc0 con 0x563e863973d0 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f53e2000640 10 client.5568 handle_command_reply: tid=0 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 1 client.5568 shutdown 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 1 -- 172.21.15.99:0/3909423735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 msgr2=0x563e8637ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e8637ea80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f53e8006be0 tx=0x7f53e80046b0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 1 -- 172.21.15.99:0/3909423735 shutdown_connections 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e86388c70 0x563e8637efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e863816f0 0x563e8637ea80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e863973d0 0x563e863977b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 1 --2- 172.21.15.99:0/3909423735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e86344670 0x563e86404560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 1 -- 172.21.15.99:0/3909423735 >> 172.21.15.99:0/3909423735 conn(0x563e8630abe0 msgr2=0x563e863855f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f53e2000640 0 client.5568 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 1 -- 172.21.15.99:0/3909423735 shutdown_connections 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 1 -- 172.21.15.99:0/3909423735 wait complete. 2024-03-30T13:13:14.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.648+0000 7f5406bd9740 20 client.5568 trim_cache size 0 max 16384 2024-03-30T13:13:14.656 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:14.656 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/Makefile", 2024-03-30T13:13:14.656 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628309, 2024-03-30T13:13:14.656 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:14.656 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.433340+0000", 2024-03-30T13:13:14.656 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.432957+0000", 2024-03-30T13:13:14.656 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:14.656 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:14.656 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:14.656 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:14.657 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 378, 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.432957+0000", 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:14.658 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 378, 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.433340+0000" 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.659 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 378, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.433340+0000" 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 122, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 4, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:14.660 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.480350+0000", 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 62, 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.661 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.662 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:14.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:14.664 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:14.665 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:14.666 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:14.667 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:14.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 -- 172.21.15.99:0/58881119 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f53dc06c530 msgr2=0x7f53dc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f53dc06c530 0x7f53dc06e9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f53f000a810 tx=0x7f53f0008040 comp rx=0 tx=0).stop 2024-03-30T13:13:14.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 -- 172.21.15.99:0/58881119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc15e920 msgr2=0x7f53fc0cbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc15e920 0x7f53fc0cbc20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f53f4036040 tx=0x7f53f4004a40 comp rx=0 tx=0).stop 2024-03-30T13:13:14.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 -- 172.21.15.99:0/58881119 shutdown_connections 2024-03-30T13:13:14.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f53dc06c530 0x7f53dc06e9f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc15e920 0x7f53fc0cbc20 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53fc0d16a0 0x7f53fc0cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 --2- 172.21.15.99:0/58881119 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f53fc0cfde0 0x7f53fc159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 -- 172.21.15.99:0/58881119 >> 172.21.15.99:0/58881119 conn(0x7f53fc08bfc0 msgr2=0x7f53fc0b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 -- 172.21.15.99:0/58881119 shutdown_connections 2024-03-30T13:13:14.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.649+0000 7f5403e00640 1 -- 172.21.15.99:0/58881119 wait complete. 2024-03-30T13:13:14.671 DEBUG:tasks.cephfs.test_uninlining:getting inode info #10 of 23:1099511628321 2024-03-30T13:13:14.672 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628321 2024-03-30T13:13:14.672 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628321 2024-03-30T13:13:14.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.878+0000 7fe97b200640 1 Processor -- start 2024-03-30T13:13:14.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.878+0000 7fe97b200640 1 -- start start 2024-03-30T13:13:14.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.879+0000 7fe97b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe97c0cf330 0x7fe97c15dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.879+0000 7fe97b200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe97c0acf20 0x7fe97c0ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.879+0000 7fe97b200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 0x7fe97c15cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.879+0000 7fe97b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe97c15d7b0 con 0x7fe97c0cf330 2024-03-30T13:13:14.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.879+0000 7fe97b200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe97c06d840 con 0x7fe97c0acf20 2024-03-30T13:13:14.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.879+0000 7fe97b200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c06db20 con 0x7fe97c15ca80 2024-03-30T13:13:14.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe979e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe97c0cf330 0x7fe97c15dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe979e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe97c0cf330 0x7fe97c15dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47860/0 (socket says 172.21.15.99:47860) 2024-03-30T13:13:14.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe979e00640 1 -- 172.21.15.99:0/18537945 learned_addr learned my addr 172.21.15.99:0/18537945 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe979400640 1 --2- 172.21.15.99:0/18537945 >> v2:172.21.15.181:3300/0 conn(0x7fe97c0acf20 0x7fe97c0ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe979e00640 1 -- 172.21.15.99:0/18537945 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 msgr2=0x7fe97c15cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe97a800640 1 --2- 172.21.15.99:0/18537945 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 0x7fe97c15cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe979e00640 1 --2- 172.21.15.99:0/18537945 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 0x7fe97c15cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe979e00640 1 -- 172.21.15.99:0/18537945 >> v2:172.21.15.181:3300/0 conn(0x7fe97c0acf20 msgr2=0x7fe97c0ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe979e00640 1 --2- 172.21.15.99:0/18537945 >> v2:172.21.15.181:3300/0 conn(0x7fe97c0acf20 0x7fe97c0ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe979e00640 1 -- 172.21.15.99:0/18537945 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c06de00 con 0x7fe97c0cf330 2024-03-30T13:13:14.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe979400640 1 --2- 172.21.15.99:0/18537945 >> v2:172.21.15.181:3300/0 conn(0x7fe97c0acf20 0x7fe97c0ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.880+0000 7fe97a800640 1 --2- 172.21.15.99:0/18537945 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 0x7fe97c15cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.881+0000 7fe979e00640 1 --2- 172.21.15.99:0/18537945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c0cf330 0x7fe97c15dd70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe97c073a80 tx=0x7fe96c02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8a95b5e0abc683 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.882+0000 7fe978a00640 1 -- 172.21.15.99:0/18537945 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c035020 con 0x7fe97c0cf330 2024-03-30T13:13:14.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.882+0000 7fe978a00640 1 -- 172.21.15.99:0/18537945 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c031880 con 0x7fe97c0cf330 2024-03-30T13:13:14.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.882+0000 7fe978a00640 1 -- 172.21.15.99:0/18537945 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c031c50 con 0x7fe97c0cf330 2024-03-30T13:13:14.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.882+0000 7fe97b200640 1 -- 172.21.15.99:0/18537945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c0cf330 msgr2=0x7fe97c15dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.882+0000 7fe97b200640 1 --2- 172.21.15.99:0/18537945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c0cf330 0x7fe97c15dd70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe97c073a80 tx=0x7fe96c02b920 comp rx=0 tx=0).stop 2024-03-30T13:13:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.882+0000 7fe97b200640 1 -- 172.21.15.99:0/18537945 shutdown_connections 2024-03-30T13:13:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.882+0000 7fe97b200640 1 --2- 172.21.15.99:0/18537945 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 0x7fe97c15cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.882+0000 7fe97b200640 1 --2- 172.21.15.99:0/18537945 >> v2:172.21.15.181:3300/0 conn(0x7fe97c0acf20 0x7fe97c0ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.882+0000 7fe97b200640 1 --2- 172.21.15.99:0/18537945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c0cf330 0x7fe97c15dd70 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.882+0000 7fe97b200640 1 -- 172.21.15.99:0/18537945 >> 172.21.15.99:0/18537945 conn(0x7fe97c06bb40 msgr2=0x7fe97c0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.883+0000 7fe97b200640 1 -- 172.21.15.99:0/18537945 shutdown_connections 2024-03-30T13:13:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.883+0000 7fe97b200640 1 -- 172.21.15.99:0/18537945 wait complete. 2024-03-30T13:13:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.884+0000 7fe97b200640 1 Processor -- start 2024-03-30T13:13:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.884+0000 7fe97b200640 1 -- start start 2024-03-30T13:13:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.885+0000 7fe97b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c0acf20 0x7fe97c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.885+0000 7fe97b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c0cf330 0x7fe97c072620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.885+0000 7fe97b200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 0x7fe97c072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.885+0000 7fe97b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c06e4a0 con 0x7fe97c0cf330 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.885+0000 7fe97b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c06e320 con 0x7fe97c0acf20 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.885+0000 7fe97b200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c06e620 con 0x7fe97c15ca80 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe979400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c0cf330 0x7fe97c072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe979400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c0cf330 0x7fe97c072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47866/0 (socket says 172.21.15.99:47866) 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe979400640 1 -- 172.21.15.99:0/2992192404 learned_addr learned my addr 172.21.15.99:0/2992192404 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe979e00640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c0acf20 0x7fe97c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe97a800640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 0x7fe97c072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe979400640 1 -- 172.21.15.99:0/2992192404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 msgr2=0x7fe97c072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe979400640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 0x7fe97c072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe979400640 1 -- 172.21.15.99:0/2992192404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c0acf20 msgr2=0x7fe97c159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe979400640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c0acf20 0x7fe97c159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe979400640 1 -- 172.21.15.99:0/2992192404 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c09aad0 con 0x7fe97c0cf330 2024-03-30T13:13:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe979e00640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c0acf20 0x7fe97c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe97a800640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 0x7fe97c072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.886+0000 7fe979400640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c0cf330 0x7fe97c072620 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe96800c820 tx=0x7fe96800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.887+0000 7fe972000640 1 -- 172.21.15.99:0/2992192404 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968015070 con 0x7fe97c0cf330 2024-03-30T13:13:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.887+0000 7fe972000640 1 -- 172.21.15.99:0/2992192404 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe968007a30 con 0x7fe97c0cf330 2024-03-30T13:13:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.887+0000 7fe972000640 1 -- 172.21.15.99:0/2992192404 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968007e00 con 0x7fe97c0cf330 2024-03-30T13:13:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.887+0000 7fe97b200640 1 -- 172.21.15.99:0/2992192404 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c09adb0 con 0x7fe97c0cf330 2024-03-30T13:13:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.887+0000 7fe97b200640 1 -- 172.21.15.99:0/2992192404 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97c09b370 con 0x7fe97c0cf330 2024-03-30T13:13:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.889+0000 7fe972000640 1 -- 172.21.15.99:0/2992192404 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe968018070 con 0x7fe97c0cf330 2024-03-30T13:13:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.890+0000 7fe972000640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe95c06c530 0x7fe95c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.890+0000 7fe972000640 1 -- 172.21.15.99:0/2992192404 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fe96808b730 con 0x7fe97c0cf330 2024-03-30T13:13:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.890+0000 7fe979e00640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe95c06c530 0x7fe95c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.891+0000 7fe979e00640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe95c06c530 0x7fe95c06e9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe96c036000 tx=0x7fe96c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.891+0000 7fe983b67740 1 Processor -- start 2024-03-30T13:13:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.891+0000 7fe983b67740 1 -- start start 2024-03-30T13:13:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.892+0000 7fe983b67740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dac470 0x563e36dd2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.892+0000 7fe983b67740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dd34e0 0x563e36dab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.892+0000 7fe983b67740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36dab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.892+0000 7fe983b67740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563e36d0f330 con 0x563e36dac850 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.892+0000 7fe983b67740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563e36cb7620 con 0x563e36dd34e0 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.892+0000 7fe983b67740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563e36d0b440 con 0x563e36dac470 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.893+0000 7fe97a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36dab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.893+0000 7fe97a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36dab9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47874/0 (socket says 172.21.15.99:47874) 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.893+0000 7fe97a800640 1 -- 172.21.15.99:0/39546403 learned_addr learned my addr 172.21.15.99:0/39546403 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.893+0000 7fe979e00640 1 --2- 172.21.15.99:0/39546403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dac470 0x563e36dd2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.893+0000 7fe979400640 1 --2- 172.21.15.99:0/39546403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dd34e0 0x563e36dab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.893+0000 7fe97a800640 1 -- 172.21.15.99:0/39546403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dac470 msgr2=0x563e36dd2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.893+0000 7fe97a800640 1 --2- 172.21.15.99:0/39546403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dac470 0x563e36dd2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.893+0000 7fe97a800640 1 -- 172.21.15.99:0/39546403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dd34e0 msgr2=0x563e36dab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.893+0000 7fe97a800640 1 --2- 172.21.15.99:0/39546403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dd34e0 0x563e36dab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.893+0000 7fe97a800640 1 -- 172.21.15.99:0/39546403 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e36aef920 con 0x563e36dac850 2024-03-30T13:13:14.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.894+0000 7fe97a800640 1 --2- 172.21.15.99:0/39546403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36dab9f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe974007f40 tx=0x7fe97400d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fdc49494f538e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.894+0000 7fe966a00640 1 -- 172.21.15.99:0/39546403 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97400f860 con 0x563e36dac850 2024-03-30T13:13:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.894+0000 7fe966a00640 1 -- 172.21.15.99:0/39546403 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97400fa00 con 0x563e36dac850 2024-03-30T13:13:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.894+0000 7fe966a00640 1 -- 172.21.15.99:0/39546403 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97400fdd0 con 0x563e36dac850 2024-03-30T13:13:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.894+0000 7fe983b67740 1 -- 172.21.15.99:0/39546403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 msgr2=0x563e36dab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.894+0000 7fe983b67740 1 --2- 172.21.15.99:0/39546403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36dab9f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe974007f40 tx=0x7fe97400d800 comp rx=0 tx=0).stop 2024-03-30T13:13:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.895+0000 7fe983b67740 1 -- 172.21.15.99:0/39546403 shutdown_connections 2024-03-30T13:13:14.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.895+0000 7fe983b67740 1 --2- 172.21.15.99:0/39546403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36dab9f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.895+0000 7fe983b67740 1 --2- 172.21.15.99:0/39546403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dd34e0 0x563e36dab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.895+0000 7fe983b67740 1 --2- 172.21.15.99:0/39546403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dac470 0x563e36dd2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.895+0000 7fe983b67740 1 -- 172.21.15.99:0/39546403 >> 172.21.15.99:0/39546403 conn(0x563e36d72be0 msgr2=0x563e36df1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.895+0000 7fe983b67740 1 -- 172.21.15.99:0/39546403 shutdown_connections 2024-03-30T13:13:14.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.895+0000 7fe983b67740 1 -- 172.21.15.99:0/39546403 wait complete. 2024-03-30T13:13:14.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.895+0000 7fe983b67740 1 -- start start 2024-03-30T13:13:14.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.896+0000 7fe983b67740 1 Processor -- start 2024-03-30T13:13:14.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.896+0000 7fe983b67740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac470 0x563e36dca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe983b67740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36df1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe983b67740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 0x563e36dd6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe983b67740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563e36dd2b10 con 0x563e36dac850 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe983b67740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563e36cca9d0 con 0x563e36dac470 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe983b67740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563e36dcb890 con 0x563e36dd6180 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe983b67740 10 client.0 _ll_register_callbacks cb 0x563e36d06fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe979400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36df1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe979400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36df1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47882/0 (socket says 172.21.15.99:47882) 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe979400640 1 -- 172.21.15.99:0/4284493 learned_addr learned my addr 172.21.15.99:0/4284493 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe979e00640 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac470 0x563e36dca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe979400640 1 -- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 msgr2=0x563e36dd6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe979400640 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 0x563e36dd6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe979400640 1 -- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac470 msgr2=0x563e36dca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe979400640 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac470 0x563e36dca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe979400640 1 -- 172.21.15.99:0/4284493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e369e3210 con 0x563e36dac850 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe979e00640 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac470 0x563e36dca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.897+0000 7fe979400640 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36df1370 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe96800c7f0 tx=0x7fe968059710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8621470dd0c6a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe95b400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe95b400640 1 -- 172.21.15.99:0/4284493 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96801f040 con 0x563e36dac850 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe95b400640 1 -- 172.21.15.99:0/4284493 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fe968058c20 con 0x563e36dac850 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe983b67740 1 -- 172.21.15.99:0/4284493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe97400fa00 con 0x563e36dac850 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe95b400640 1 -- 172.21.15.99:0/4284493 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe968071bc0 con 0x563e36dac850 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe983b67740 10 client.5580 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe983b67740 1 -- 172.21.15.99:0/4284493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x563e36b500b0 con 0x563e36dac850 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe95b400640 1 -- 172.21.15.99:0/4284493 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97400fa00 con 0x563e36dac850 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe95b400640 1 -- 172.21.15.99:0/4284493 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fe96805eb10 con 0x563e36dac850 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe983b67740 10 client.5580 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:14.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe983b67740 10 client.5580 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe983b67740 20 client.5580 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe983b67740 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e36df35e0 0x563e36df3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe983b67740 4 client.5580 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.898+0000 7fe983b67740 1 -- 172.21.15.99:0/4284493 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e36d1c870 con 0x563e36df35e0 2024-03-30T13:13:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.899+0000 7fe979e00640 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e36df35e0 0x563e36df3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.900+0000 7fe979e00640 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e36df35e0 0x563e36df3a50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf547b488984cf8d server_cookie=1132490633e78106 in_seq=0 out_seq=0 2024-03-30T13:13:14.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.900+0000 7fe95b400640 10 client.5580 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe95b400640 1 -- 172.21.15.99:0/4284493 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x563e36d1c870 con 0x563e36df35e0 2024-03-30T13:13:14.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe95b400640 10 client.5580 handle_command_reply: tid=0 2024-03-30T13:13:14.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 1 client.5580 shutdown 2024-03-30T13:13:14.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 1 -- 172.21.15.99:0/4284493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 msgr2=0x563e36df1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36df1370 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe96800c7f0 tx=0x7fe968059710 comp rx=0 tx=0).stop 2024-03-30T13:13:14.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 1 -- 172.21.15.99:0/4284493 shutdown_connections 2024-03-30T13:13:14.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 0x563e36dd6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac850 0x563e36df1370 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e36df35e0 0x563e36df3a50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 1 --2- 172.21.15.99:0/4284493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac470 0x563e36dca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe95b400640 0 client.5580 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 1 -- 172.21.15.99:0/4284493 >> 172.21.15.99:0/4284493 conn(0x563e36d72be0 msgr2=0x563e36da5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 1 -- 172.21.15.99:0/4284493 shutdown_connections 2024-03-30T13:13:14.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 1 -- 172.21.15.99:0/4284493 wait complete. 2024-03-30T13:13:14.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.902+0000 7fe983b67740 20 client.5580 trim_cache size 0 max 16384 2024-03-30T13:13:14.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.918+0000 7fe983b67740 1 Processor -- start 2024-03-30T13:13:14.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.918+0000 7fe983b67740 1 -- start start 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe983b67740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36e03d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe983b67740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac850 0x563e36da55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe983b67740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 0x563e36da5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe983b67740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c200bd0 con 0x563e36dac470 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe983b67740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1ffbf0 con 0x563e36dac850 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe983b67740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c1fef80 con 0x563e36dd6180 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe979e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36e03d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe979e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36e03d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47898/0 (socket says 172.21.15.99:47898) 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe979e00640 1 -- 172.21.15.99:0/338559702 learned_addr learned my addr 172.21.15.99:0/338559702 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe979e00640 1 -- 172.21.15.99:0/338559702 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 msgr2=0x563e36da5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe979e00640 1 --2- 172.21.15.99:0/338559702 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 0x563e36da5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe979e00640 1 -- 172.21.15.99:0/338559702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac850 msgr2=0x563e36da55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe979400640 1 --2- 172.21.15.99:0/338559702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac850 0x563e36da55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe979e00640 1 --2- 172.21.15.99:0/338559702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac850 0x563e36da55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.919+0000 7fe979e00640 1 -- 172.21.15.99:0/338559702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e369bc2d0 con 0x563e36dac470 2024-03-30T13:13:14.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.920+0000 7fe979e00640 1 --2- 172.21.15.99:0/338559702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36e03d00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe96c02bf30 tx=0x7fe96c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ec2a5197ecaec5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.920+0000 7fe966000640 1 -- 172.21.15.99:0/338559702 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c035040 con 0x563e36dac470 2024-03-30T13:13:14.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.920+0000 7fe966000640 1 -- 172.21.15.99:0/338559702 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c031e50 con 0x563e36dac470 2024-03-30T13:13:14.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.920+0000 7fe966000640 1 -- 172.21.15.99:0/338559702 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c004230 con 0x563e36dac470 2024-03-30T13:13:14.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.920+0000 7fe983b67740 1 -- 172.21.15.99:0/338559702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 msgr2=0x563e36e03d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.920+0000 7fe983b67740 1 --2- 172.21.15.99:0/338559702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36e03d00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe96c02bf30 tx=0x7fe96c030000 comp rx=0 tx=0).stop 2024-03-30T13:13:14.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.920+0000 7fe983b67740 1 -- 172.21.15.99:0/338559702 shutdown_connections 2024-03-30T13:13:14.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.920+0000 7fe983b67740 1 --2- 172.21.15.99:0/338559702 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 0x563e36da5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.920+0000 7fe983b67740 1 --2- 172.21.15.99:0/338559702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac850 0x563e36da55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.920+0000 7fe983b67740 1 --2- 172.21.15.99:0/338559702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36e03d00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.920+0000 7fe983b67740 1 -- 172.21.15.99:0/338559702 >> 172.21.15.99:0/338559702 conn(0x563e36d72be0 msgr2=0x563e36df39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.921+0000 7fe983b67740 1 -- 172.21.15.99:0/338559702 shutdown_connections 2024-03-30T13:13:14.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.921+0000 7fe983b67740 1 -- 172.21.15.99:0/338559702 wait complete. 2024-03-30T13:13:14.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.921+0000 7fe983b67740 1 -- start start 2024-03-30T13:13:14.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.921+0000 7fe983b67740 1 Processor -- start 2024-03-30T13:13:14.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.922+0000 7fe983b67740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36dbfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.922+0000 7fe983b67740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac850 0x563e36dc0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.922+0000 7fe983b67740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 0x563e36de6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.922+0000 7fe983b67740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563e36e04930 con 0x563e36dac470 2024-03-30T13:13:14.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.922+0000 7fe983b67740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1ff5a0 con 0x563e36dac850 2024-03-30T13:13:14.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.922+0000 7fe983b67740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563e36dedcc0 con 0x563e36dd6180 2024-03-30T13:13:14.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.922+0000 7fe983b67740 10 client.0 _ll_register_callbacks cb 0x7fe968059d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe979e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36dbfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe979e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36dbfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47906/0 (socket says 172.21.15.99:47906) 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe979e00640 1 -- 172.21.15.99:0/1767119729 learned_addr learned my addr 172.21.15.99:0/1767119729 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe979e00640 1 -- 172.21.15.99:0/1767119729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 msgr2=0x563e36de6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe979e00640 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 0x563e36de6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe979e00640 1 -- 172.21.15.99:0/1767119729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac850 msgr2=0x563e36dc0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe979400640 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac850 0x563e36dc0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe979e00640 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac850 0x563e36dc0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe979e00640 1 -- 172.21.15.99:0/1767119729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e36e5d9c0 con 0x563e36dac470 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe979e00640 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36dbfe00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009630 tx=0x7fe96c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2914c39382c9d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe95b400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.923+0000 7fe95b400640 1 -- 172.21.15.99:0/1767119729 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c05d060 con 0x563e36dac470 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe95b400640 1 -- 172.21.15.99:0/1767119729 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fe96c04f400 con 0x563e36dac470 2024-03-30T13:13:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe983b67740 1 -- 172.21.15.99:0/1767119729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe96c031e50 con 0x563e36dac470 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe95b400640 1 -- 172.21.15.99:0/1767119729 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe96c035040 con 0x563e36dac470 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe983b67740 10 client.5586 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe983b67740 1 -- 172.21.15.99:0/1767119729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x563e36dc3bf0 con 0x563e36dac470 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe95b400640 1 -- 172.21.15.99:0/1767119729 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c031e50 con 0x563e36dac470 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe95b400640 1 -- 172.21.15.99:0/1767119729 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fe96c04f600 con 0x563e36dac470 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe983b67740 10 client.5586 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe983b67740 10 client.5586 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe983b67740 20 client.5586 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe983b67740 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e36dd5d10 0x563e36de7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe983b67740 4 client.5586 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628321}] 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.924+0000 7fe983b67740 1 -- 172.21.15.99:0/1767119729 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628321}) -- 0x563e36d16bc0 con 0x563e36dd5d10 2024-03-30T13:13:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.925+0000 7fe979400640 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e36dd5d10 0x563e36de7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.926+0000 7fe979400640 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e36dd5d10 0x563e36de7060 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44ec31ea49d278ef server_cookie=d542863eaff283b in_seq=0 out_seq=0 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.926+0000 7fe95b400640 10 client.5586 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe95b400640 1 -- 172.21.15.99:0/1767119729 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3965 (crc 0 0 0) 0x563e36d16bc0 con 0x563e36dd5d10 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe95b400640 10 client.5586 handle_command_reply: tid=0 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 1 client.5586 shutdown 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 1 -- 172.21.15.99:0/1767119729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 msgr2=0x563e36dbfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36dbfe00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009630 tx=0x7fe96c004730 comp rx=0 tx=0).stop 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 1 -- 172.21.15.99:0/1767119729 shutdown_connections 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563e36dd6180 0x563e36de6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x563e36dd5d10 0x563e36de7060 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563e36dac850 0x563e36dc0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 1 --2- 172.21.15.99:0/1767119729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563e36dac470 0x563e36dbfe00 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe95b400640 0 client.5586 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 1 -- 172.21.15.99:0/1767119729 >> 172.21.15.99:0/1767119729 conn(0x563e36d72be0 msgr2=0x563e36da1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 1 -- 172.21.15.99:0/1767119729 shutdown_connections 2024-03-30T13:13:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 1 -- 172.21.15.99:0/1767119729 wait complete. 2024-03-30T13:13:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.927+0000 7fe983b67740 20 client.5586 trim_cache size 0 max 16384 2024-03-30T13:13:14.933 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:14.933 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/symlink.c", 2024-03-30T13:13:14.933 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628321, 2024-03-30T13:13:14.933 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:14.933 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.439261+0000", 2024-03-30T13:13:14.933 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.475956+0000", 2024-03-30T13:13:14.933 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 916, 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.475956+0000", 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:14.935 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 916, 2024-03-30T13:13:14.936 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.439261+0000" 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 916, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.439261+0000" 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 134, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:14.937 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 28, 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.486301+0000", 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 64, 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:14.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:14.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:14.940 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.941 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:14.942 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:14.943 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:14.944 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:14.945 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:14.945 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:14.945 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:14.945 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:14.945 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:14.945 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:14.945 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:14.945 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:14.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 -- 172.21.15.99:0/2992192404 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe95c06c530 msgr2=0x7fe95c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe95c06c530 0x7fe95c06e9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe96c036000 tx=0x7fe96c008030 comp rx=0 tx=0).stop 2024-03-30T13:13:14.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 -- 172.21.15.99:0/2992192404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c0cf330 msgr2=0x7fe97c072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c0cf330 0x7fe97c072620 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe96800c820 tx=0x7fe96800cc20 comp rx=0 tx=0).stop 2024-03-30T13:13:14.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 -- 172.21.15.99:0/2992192404 shutdown_connections 2024-03-30T13:13:14.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe95c06c530 0x7fe95c06e9f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe97c15ca80 0x7fe97c072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c0cf330 0x7fe97c072620 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 --2- 172.21.15.99:0/2992192404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c0acf20 0x7fe97c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 -- 172.21.15.99:0/2992192404 >> 172.21.15.99:0/2992192404 conn(0x7fe97c06bb40 msgr2=0x7fe97c0b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 -- 172.21.15.99:0/2992192404 shutdown_connections 2024-03-30T13:13:14.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:14.928+0000 7fe97b200640 1 -- 172.21.15.99:0/2992192404 wait complete. 2024-03-30T13:13:14.948 DEBUG:tasks.cephfs.test_uninlining:getting inode info #11 of 23:1099511628311 2024-03-30T13:13:14.948 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628311 2024-03-30T13:13:14.948 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628311 2024-03-30T13:13:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.154+0000 7f2ffe000640 1 Processor -- start 2024-03-30T13:13:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.154+0000 7f2ffe000640 1 -- start start 2024-03-30T13:13:15.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.155+0000 7f2ffe000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff80b4e40 0x7f2ff80c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.155+0000 7f2ffe000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2ff80b31c0 0x7f2ff80b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.155+0000 7f2ffe000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff81604d0 con 0x7f2ff80b2640 2024-03-30T13:13:15.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.155+0000 7f2ffe000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff80c6d60 con 0x7f2ff80b31c0 2024-03-30T13:13:15.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.155+0000 7f2ffe000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff80b2a90 con 0x7f2ff80b4e40 2024-03-30T13:13:15.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.156+0000 7f2ff7e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2ff80b2640 0x7f2ff80cbec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:41672/0 (socket says 172.21.15.99:41672) 2024-03-30T13:13:15.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.156+0000 7f2ff7e00640 1 -- 172.21.15.99:0/2150090106 learned_addr learned my addr 172.21.15.99:0/2150090106 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:15.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.156+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2150090106 >> v2:172.21.15.181:3300/0 conn(0x7f2ff80b31c0 0x7f2ff80b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.156+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2150090106 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff80b4e40 0x7f2ff80c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.156+0000 7f2ff6000640 1 -- 172.21.15.99:0/2150090106 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233783947 0 0) 0x7f2ff81604d0 con 0x7f2ff80b2640 2024-03-30T13:13:15.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.156+0000 7f2ff6000640 1 -- 172.21.15.99:0/2150090106 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fdc003520 con 0x7f2ff80b2640 2024-03-30T13:13:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.157+0000 7f2ff6000640 1 -- 172.21.15.99:0/2150090106 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1252395554 0 0) 0x7f2fdc003520 con 0x7f2ff80b2640 2024-03-30T13:13:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.157+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2150090106 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff80b4e40 msgr2=0x7f2ff80c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.157+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2150090106 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff80b4e40 0x7f2ff80c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.157+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2150090106 >> v1:172.21.15.99:6789/0 conn(0x7f2ff80b2640 legacy=0x7f2ff80cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.157+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2150090106 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff81607b0 con 0x7f2ff80b31c0 2024-03-30T13:13:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.158+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2150090106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80b31c0 0x7f2ff80b2100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40097a0 tx=0x7f2fe402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6297837208110254 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.158+0000 7f2ff6000640 1 -- 172.21.15.99:0/2150090106 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4037070 con 0x7f2ff80b31c0 2024-03-30T13:13:15.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.158+0000 7f2ff6000640 1 -- 172.21.15.99:0/2150090106 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe4030510 con 0x7f2ff80b31c0 2024-03-30T13:13:15.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.158+0000 7f2ff6000640 1 -- 172.21.15.99:0/2150090106 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00019f0 con 0x7f2ff80b31c0 2024-03-30T13:13:15.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.159+0000 7f2ffe000640 1 -- 172.21.15.99:0/2150090106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80b31c0 msgr2=0x7f2ff80b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.159+0000 7f2ffe000640 1 --2- 172.21.15.99:0/2150090106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80b31c0 0x7f2ff80b2100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40097a0 tx=0x7f2fe402b710 comp rx=0 tx=0).stop 2024-03-30T13:13:15.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.159+0000 7f2ffe000640 1 -- 172.21.15.99:0/2150090106 shutdown_connections 2024-03-30T13:13:15.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.159+0000 7f2ffe000640 1 --2- 172.21.15.99:0/2150090106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80b31c0 0x7f2ff80b2100 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.159+0000 7f2ffe000640 1 --2- 172.21.15.99:0/2150090106 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff80b4e40 0x7f2ff80c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.159+0000 7f2ffe000640 1 -- 172.21.15.99:0/2150090106 >> 172.21.15.99:0/2150090106 conn(0x7f2ff80d0450 msgr2=0x7f2ff80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.159+0000 7f2ffe000640 1 -- 172.21.15.99:0/2150090106 shutdown_connections 2024-03-30T13:13:15.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.159+0000 7f2ffe000640 1 -- 172.21.15.99:0/2150090106 wait complete. 2024-03-30T13:13:15.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.161+0000 7f2ffe000640 1 Processor -- start 2024-03-30T13:13:15.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.161+0000 7f2ffe000640 1 -- start start 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ffe000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80b2640 0x7f2ff80c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ffe000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff80b31c0 0x7f2ff8159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ffe000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ff80b4e40 0x7f2ff80717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ffe000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8160d70 con 0x7f2ff80b4e40 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ffe000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff80cba20 con 0x7f2ff80b2640 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ffe000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff80b3620 con 0x7f2ff80b31c0 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ff7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ff80b4e40 0x7f2ff80717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ff7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ff80b4e40 0x7f2ff80717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47916/0 (socket says 172.21.15.99:47916) 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ff7e00640 1 -- 172.21.15.99:0/3777104224 learned_addr learned my addr 172.21.15.99:0/3777104224 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ff7400640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80b2640 0x7f2ff80c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ff7e00640 1 -- 172.21.15.99:0/3777104224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff80b31c0 msgr2=0x7f2ff8159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff80b31c0 0x7f2ff8159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ff7e00640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff80b31c0 0x7f2ff8159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ff7e00640 1 -- 172.21.15.99:0/3777104224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80b2640 msgr2=0x7f2ff80c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ff7e00640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80b2640 0x7f2ff80c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.162+0000 7f2ff7e00640 1 -- 172.21.15.99:0/3777104224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff8071f40 con 0x7f2ff80b4e40 2024-03-30T13:13:15.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.163+0000 7f2ff7e00640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ff80b4e40 0x7f2ff80717d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0001f50 tx=0x7f2ff000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.163+0000 7f2fef400640 1 -- 172.21.15.99:0/3777104224 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0012400 con 0x7f2ff80b4e40 2024-03-30T13:13:15.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.163+0000 7f2fef400640 1 -- 172.21.15.99:0/3777104224 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff00125a0 con 0x7f2ff80b4e40 2024-03-30T13:13:15.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.163+0000 7f2ffe000640 1 -- 172.21.15.99:0/3777104224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff8072220 con 0x7f2ff80b4e40 2024-03-30T13:13:15.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.163+0000 7f2fef400640 1 -- 172.21.15.99:0/3777104224 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0012970 con 0x7f2ff80b4e40 2024-03-30T13:13:15.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.163+0000 7f2ffe000640 1 -- 172.21.15.99:0/3777104224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff80727e0 con 0x7f2ff80b4e40 2024-03-30T13:13:15.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.165+0000 7f2fef400640 1 -- 172.21.15.99:0/3777104224 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2ff0012b10 con 0x7f2ff80b4e40 2024-03-30T13:13:15.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.166+0000 7f2fef400640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2fd806c530 0x7f2fd806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.166+0000 7f2fef400640 1 -- 172.21.15.99:0/3777104224 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f2ff008bfc0 con 0x7f2ff80b4e40 2024-03-30T13:13:15.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.167+0000 7f2ff7400640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2fd806c530 0x7f2fd806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.167+0000 7f3000c6e740 1 Processor -- start 2024-03-30T13:13:15.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.167+0000 7f3000c6e740 1 -- start start 2024-03-30T13:13:15.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.167+0000 7f2ff7400640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2fd806c530 0x7f2fd806e9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8099680 tx=0x7f2fe8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.168+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576290 0x564eb459cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.168+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb459d300 0x564eb45752d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.168+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb4576670 0x564eb4575810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.168+0000 7f3000c6e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564eb44d9330 con 0x564eb4576290 2024-03-30T13:13:15.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.168+0000 7f3000c6e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564eb4481620 con 0x564eb4576670 2024-03-30T13:13:15.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.168+0000 7f3000c6e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x564eb44d5440 con 0x564eb459d300 2024-03-30T13:13:15.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.168+0000 7f2ff7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576290 0x564eb459cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.168+0000 7f2ff7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576290 0x564eb459cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47932/0 (socket says 172.21.15.99:47932) 2024-03-30T13:13:15.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.168+0000 7f2ff7400640 1 -- 172.21.15.99:0/2912630316 learned_addr learned my addr 172.21.15.99:0/2912630316 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.169+0000 7f2ff7400640 1 -- 172.21.15.99:0/2912630316 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb459d300 msgr2=0x564eb45752d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.169+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2912630316 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb459d300 0x564eb45752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.169+0000 7f2ff7400640 1 -- 172.21.15.99:0/2912630316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb4576670 msgr2=0x564eb4575810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.169+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2912630316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb4576670 0x564eb4575810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.169+0000 7f2ff7400640 1 -- 172.21.15.99:0/2912630316 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb42b9920 con 0x564eb4576290 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.169+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2912630316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576290 0x564eb459cdc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8011cc0 tx=0x7f2fe8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01956f7bed7820c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.169+0000 7f2fe3400640 1 -- 172.21.15.99:0/2912630316 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8011cf0 con 0x564eb4576290 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.169+0000 7f2fe3400640 1 -- 172.21.15.99:0/2912630316 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe8026070 con 0x564eb4576290 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.169+0000 7f2fe3400640 1 -- 172.21.15.99:0/2912630316 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8021640 con 0x564eb4576290 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.170+0000 7f3000c6e740 1 -- 172.21.15.99:0/2912630316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576290 msgr2=0x564eb459cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.170+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2912630316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576290 0x564eb459cdc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8011cc0 tx=0x7f2fe8014000 comp rx=0 tx=0).stop 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.170+0000 7f3000c6e740 1 -- 172.21.15.99:0/2912630316 shutdown_connections 2024-03-30T13:13:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.170+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2912630316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb4576670 0x564eb4575810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.170+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2912630316 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb459d300 0x564eb45752d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.170+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2912630316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576290 0x564eb459cdc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.170+0000 7f3000c6e740 1 -- 172.21.15.99:0/2912630316 >> 172.21.15.99:0/2912630316 conn(0x564eb453cbe0 msgr2=0x564eb45bafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.170+0000 7f3000c6e740 1 -- 172.21.15.99:0/2912630316 shutdown_connections 2024-03-30T13:13:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.170+0000 7f3000c6e740 1 -- 172.21.15.99:0/2912630316 wait complete. 2024-03-30T13:13:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.171+0000 7f3000c6e740 1 -- start start 2024-03-30T13:13:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.171+0000 7f3000c6e740 1 Processor -- start 2024-03-30T13:13:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.172+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb4576290 0x564eb45866f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.172+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb45a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.172+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb45a2ed0 0x564eb4586d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.172+0000 7f3000c6e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564eb459c930 con 0x564eb4576670 2024-03-30T13:13:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.172+0000 7f3000c6e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564eb44949d0 con 0x564eb45a2ed0 2024-03-30T13:13:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.172+0000 7f3000c6e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x564eb45956b0 con 0x564eb4576290 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.172+0000 7f3000c6e740 10 client.0 _ll_register_callbacks cb 0x564eb44d0fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.172+0000 7f2ff6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb45a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.172+0000 7f2ff6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb45a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47944/0 (socket says 172.21.15.99:47944) 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.172+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2339437509 learned_addr learned my addr 172.21.15.99:0/2339437509 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb4576290 0x564eb45866f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f2ff7e00640 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb45a2ed0 0x564eb4586d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb4576290 msgr2=0x564eb45866f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb4576290 0x564eb45866f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb45a2ed0 msgr2=0x564eb4586d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb45a2ed0 0x564eb4586d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2339437509 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eb41ad210 con 0x564eb4576670 2024-03-30T13:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb45a1c80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2fe402bd20 tx=0x7f2fe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a1545c44d1854e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f2fd7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2339437509 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4041020 con 0x564eb4576670 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f3000c6e740 1 -- 172.21.15.99:0/2339437509 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fe8026070 con 0x564eb4576670 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.173+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2339437509 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f2fe4003810 con 0x564eb4576670 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.174+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2339437509 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2fe404b050 con 0x564eb4576670 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.174+0000 7f3000c6e740 10 client.5598 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.174+0000 7f3000c6e740 1 -- 172.21.15.99:0/2339437509 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x564eb431a0b0 con 0x564eb4576670 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.174+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2339437509 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe8026070 con 0x564eb4576670 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.174+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2339437509 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f2fe404e020 con 0x564eb4576670 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.174+0000 7f3000c6e740 10 client.5598 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.174+0000 7f3000c6e740 10 client.5598 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.174+0000 7f3000c6e740 20 client.5598 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:15.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.174+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564eb45a3350 0x564eb45be3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.174+0000 7f3000c6e740 4 client.5598 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.174+0000 7f3000c6e740 1 -- 172.21.15.99:0/2339437509 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564eb44e6870 con 0x564eb45a3350 2024-03-30T13:13:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.175+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564eb45a3350 0x564eb45be3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.176+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564eb45a3350 0x564eb45be3c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b41c4c870b59f9f6 server_cookie=f16381c6322f9ef9 in_seq=0 out_seq=0 2024-03-30T13:13:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.176+0000 7f2fd7e00640 10 client.5598 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.177+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2339437509 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x564eb44e6870 con 0x564eb45a3350 2024-03-30T13:13:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.177+0000 7f2fd7e00640 10 client.5598 handle_command_reply: tid=0 2024-03-30T13:13:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 1 client.5598 shutdown 2024-03-30T13:13:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 1 -- 172.21.15.99:0/2339437509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 msgr2=0x564eb45a1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb45a1c80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2fe402bd20 tx=0x7f2fe40046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 1 -- 172.21.15.99:0/2339437509 shutdown_connections 2024-03-30T13:13:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564eb45a3350 0x564eb45be3c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb45a2ed0 0x564eb4586d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb45a1c80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f2fd7e00640 0 client.5598 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2339437509 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb4576290 0x564eb45866f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 1 -- 172.21.15.99:0/2339437509 >> 172.21.15.99:0/2339437509 conn(0x564eb453cbe0 msgr2=0x564eb459df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 1 -- 172.21.15.99:0/2339437509 shutdown_connections 2024-03-30T13:13:15.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 1 -- 172.21.15.99:0/2339437509 wait complete. 2024-03-30T13:13:15.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.178+0000 7f3000c6e740 20 client.5598 trim_cache size 0 max 16384 2024-03-30T13:13:15.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.194+0000 7f3000c6e740 1 Processor -- start 2024-03-30T13:13:15.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.194+0000 7f3000c6e740 1 -- start start 2024-03-30T13:13:15.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.195+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb4576290 0x564eb45939b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.195+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb4585a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.195+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb45a2ed0 0x564eb459c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.195+0000 7f3000c6e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8200bb0 con 0x564eb4576670 2024-03-30T13:13:15.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.195+0000 7f3000c6e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff81ffc10 con 0x564eb45a2ed0 2024-03-30T13:13:15.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.195+0000 7f3000c6e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff80adfa0 con 0x564eb4576290 2024-03-30T13:13:15.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.196+0000 7f2ff6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb4585a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.196+0000 7f2ff6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb4585a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47952/0 (socket says 172.21.15.99:47952) 2024-03-30T13:13:15.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.196+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2282794865 learned_addr learned my addr 172.21.15.99:0/2282794865 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.196+0000 7f2ff7e00640 1 --2- 172.21.15.99:0/2282794865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb45a2ed0 0x564eb459c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.196+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2282794865 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb4576290 0x564eb45939b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.196+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2282794865 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb4576290 msgr2=0x564eb45939b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.196+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2282794865 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb4576290 0x564eb45939b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.196+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2282794865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb45a2ed0 msgr2=0x564eb459c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.196+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2282794865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb45a2ed0 0x564eb459c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.196+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2282794865 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb41862d0 con 0x564eb4576670 2024-03-30T13:13:15.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.196+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2282794865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb4585a70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2fe402bdf0 tx=0x7f2fe4038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c54ba358bf4b4d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f2fe2a00640 1 -- 172.21.15.99:0/2282794865 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4041030 con 0x564eb4576670 2024-03-30T13:13:15.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f2fe2a00640 1 -- 172.21.15.99:0/2282794865 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe40038b0 con 0x564eb4576670 2024-03-30T13:13:15.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f2fe2a00640 1 -- 172.21.15.99:0/2282794865 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4037040 con 0x564eb4576670 2024-03-30T13:13:15.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f3000c6e740 1 -- 172.21.15.99:0/2282794865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 msgr2=0x564eb4585a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2282794865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb4585a70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2fe402bdf0 tx=0x7f2fe4038000 comp rx=0 tx=0).stop 2024-03-30T13:13:15.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f3000c6e740 1 -- 172.21.15.99:0/2282794865 shutdown_connections 2024-03-30T13:13:15.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2282794865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb45a2ed0 0x564eb459c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2282794865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb4585a70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2282794865 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb4576290 0x564eb45939b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f3000c6e740 1 -- 172.21.15.99:0/2282794865 >> 172.21.15.99:0/2282794865 conn(0x564eb453cbe0 msgr2=0x564eb45b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f3000c6e740 1 -- 172.21.15.99:0/2282794865 shutdown_connections 2024-03-30T13:13:15.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.197+0000 7f3000c6e740 1 -- 172.21.15.99:0/2282794865 wait complete. 2024-03-30T13:13:15.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.198+0000 7f3000c6e740 1 -- start start 2024-03-30T13:13:15.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.198+0000 7f3000c6e740 1 Processor -- start 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.199+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb4576290 0x564eb45cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.199+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb459c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.199+0000 7f3000c6e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb45a2ed0 0x564eb461cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.199+0000 7f3000c6e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564eb4594d80 con 0x564eb4576670 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.199+0000 7f3000c6e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff81ff5c0 con 0x564eb4576290 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.199+0000 7f3000c6e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x564eb4572660 con 0x564eb45a2ed0 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.199+0000 7f3000c6e740 10 client.0 _ll_register_callbacks cb 0x7f2fe4035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.200+0000 7f2ff6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb459c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.200+0000 7f2ff6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb459c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47954/0 (socket says 172.21.15.99:47954) 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.200+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2446869814 learned_addr learned my addr 172.21.15.99:0/2446869814 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.200+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb4576290 0x564eb45cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.200+0000 7f2ff7e00640 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb45a2ed0 0x564eb461cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.200+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb45a2ed0 msgr2=0x564eb461cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.200+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb45a2ed0 0x564eb461cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.200+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb4576290 msgr2=0x564eb45cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.200+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb4576290 0x564eb45cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.200+0000 7f2ff6a00640 1 -- 172.21.15.99:0/2446869814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eb45cd650 con 0x564eb4576670 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.200+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb4576290 0x564eb45cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f2ff6a00640 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb459c840 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4040040 tx=0x7f2fe4008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3696b7b2e7cbdf5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f2fd7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2446869814 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4037040 con 0x564eb4576670 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2446869814 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f2fe4003a60 con 0x564eb4576670 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f3000c6e740 1 -- 172.21.15.99:0/2446869814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fe40038b0 con 0x564eb4576670 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2446869814 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2fe4060050 con 0x564eb4576670 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f3000c6e740 10 client.5604 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f3000c6e740 1 -- 172.21.15.99:0/2446869814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x564eb4637b10 con 0x564eb4576670 2024-03-30T13:13:15.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2446869814 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe40038b0 con 0x564eb4576670 2024-03-30T13:13:15.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2446869814 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f2fe4063020 con 0x564eb4576670 2024-03-30T13:13:15.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f3000c6e740 10 client.5604 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:15.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f3000c6e740 10 client.5604 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:15.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f3000c6e740 20 client.5604 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:15.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.201+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564eb4637270 0x564eb459fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.202+0000 7f3000c6e740 4 client.5604 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628311}] 2024-03-30T13:13:15.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.202+0000 7f3000c6e740 1 -- 172.21.15.99:0/2446869814 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628311}) -- 0x564eb44e0bc0 con 0x564eb4637270 2024-03-30T13:13:15.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.202+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564eb4637270 0x564eb459fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.203+0000 7f2ff7400640 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564eb4637270 0x564eb459fb30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63a6394a5d5f1bd9 server_cookie=876b430f8854a76e in_seq=0 out_seq=0 2024-03-30T13:13:15.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.203+0000 7f2fd7e00640 10 client.5604 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f2fd7e00640 1 -- 172.21.15.99:0/2446869814 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3963 (crc 0 0 0) 0x564eb44e0bc0 con 0x564eb4637270 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f2fd7e00640 10 client.5604 handle_command_reply: tid=0 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 1 client.5604 shutdown 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 1 -- 172.21.15.99:0/2446869814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 msgr2=0x564eb459c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb459c840 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4040040 tx=0x7f2fe4008030 comp rx=0 tx=0).stop 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 1 -- 172.21.15.99:0/2446869814 shutdown_connections 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564eb45a2ed0 0x564eb461cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564eb4576670 0x564eb459c840 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564eb4637270 0x564eb459fb30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 1 --2- 172.21.15.99:0/2446869814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564eb4576290 0x564eb45cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 1 -- 172.21.15.99:0/2446869814 >> 172.21.15.99:0/2446869814 conn(0x564eb453cbe0 msgr2=0x564eb45a3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f2fd7e00640 0 client.5604 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 1 -- 172.21.15.99:0/2446869814 shutdown_connections 2024-03-30T13:13:15.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 1 -- 172.21.15.99:0/2446869814 wait complete. 2024-03-30T13:13:15.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.204+0000 7f3000c6e740 20 client.5604 trim_cache size 0 max 16384 2024-03-30T13:13:15.211 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/acl.h", 2024-03-30T13:13:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628311, 2024-03-30T13:13:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.443223+0000", 2024-03-30T13:13:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.439957+0000", 2024-03-30T13:13:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1502, 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.439957+0000", 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1502, 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.443223+0000" 2024-03-30T13:13:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1502, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.443223+0000" 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 128, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 8, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:15.215 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.488864+0000", 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 68, 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:15.216 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:15.217 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.219 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:15.220 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:15.221 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:15.222 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.223 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:15.223 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:15.223 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:15.223 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:15.223 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 -- 172.21.15.99:0/3777104224 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2fd806c530 msgr2=0x7f2fd806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2fd806c530 0x7f2fd806e9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8099680 tx=0x7f2fe8008040 comp rx=0 tx=0).stop 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 -- 172.21.15.99:0/3777104224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ff80b4e40 msgr2=0x7f2ff80717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ff80b4e40 0x7f2ff80717d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0001f50 tx=0x7f2ff000a430 comp rx=0 tx=0).stop 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 -- 172.21.15.99:0/3777104224 shutdown_connections 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2fd806c530 0x7f2fd806e9f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ff80b4e40 0x7f2ff80717d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff80b31c0 0x7f2ff8159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 --2- 172.21.15.99:0/3777104224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80b2640 0x7f2ff80c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 -- 172.21.15.99:0/3777104224 >> 172.21.15.99:0/3777104224 conn(0x7f2ff80d0450 msgr2=0x7f2ff80afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 -- 172.21.15.99:0/3777104224 shutdown_connections 2024-03-30T13:13:15.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.205+0000 7f2ffe000640 1 -- 172.21.15.99:0/3777104224 wait complete. 2024-03-30T13:13:15.226 DEBUG:tasks.cephfs.test_uninlining:getting inode info #12 of 23:1099511628325 2024-03-30T13:13:15.226 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628325 2024-03-30T13:13:15.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628325 2024-03-30T13:13:15.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.432+0000 7f494ec00640 1 Processor -- start 2024-03-30T13:13:15.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.432+0000 7f494ec00640 1 -- start start 2024-03-30T13:13:15.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.433+0000 7f494ec00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49480b4e40 0x7f49480c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.433+0000 7f494ec00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49481604d0 con 0x7f49480b2810 2024-03-30T13:13:15.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.433+0000 7f494ec00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49481607b0 con 0x7f49480b31c0 2024-03-30T13:13:15.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.433+0000 7f494ec00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f49480c6d60 con 0x7f49480b4e40 2024-03-30T13:13:15.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.434+0000 7f494cc00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f49480b2810 0x7f49480cbec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:41674/0 (socket says 172.21.15.99:41674) 2024-03-30T13:13:15.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.434+0000 7f494cc00640 1 -- 172.21.15.99:0/1370496538 learned_addr learned my addr 172.21.15.99:0/1370496538 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:15.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.434+0000 7f4947e00640 1 --2- 172.21.15.99:0/1370496538 >> v2:172.21.15.181:3300/0 conn(0x7f49480b4e40 0x7f49480c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.434+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237465905 0 0) 0x7f49481604d0 con 0x7f49480b2810 2024-03-30T13:13:15.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.434+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492c003520 con 0x7f49480b2810 2024-03-30T13:13:15.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1299364853 0 0) 0x7f492c003520 con 0x7f49480b2810 2024-03-30T13:13:15.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 >> v2:172.21.15.181:3300/0 conn(0x7f49480b4e40 msgr2=0x7f49480c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 --2- 172.21.15.99:0/1370496538 >> v2:172.21.15.181:3300/0 conn(0x7f49480b4e40 0x7f49480c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 >> v1:172.21.15.181:6789/0 conn(0x7f49480b31c0 legacy=0x7f49480b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4948160a90 con 0x7f49480b2810 2024-03-30T13:13:15.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f4940001a10 con 0x7f49480b2810 2024-03-30T13:13:15.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 >> v1:172.21.15.99:6789/0 conn(0x7f49480b2810 legacy=0x7f49480cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 --2- 172.21.15.99:0/1370496538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f492c0039b0 0x7f492c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 --2- 172.21.15.99:0/1370496538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f492c004800 0x7f492c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 --2- 172.21.15.99:0/1370496538 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f492c0051c0 0x7f492c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f49480c6d60 con 0x7f492c0039b0 2024-03-30T13:13:15.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f492c00c160 con 0x7f492c004800 2024-03-30T13:13:15.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f492c00c360 con 0x7f492c0051c0 2024-03-30T13:13:15.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4947e00640 1 --2- 172.21.15.99:0/1370496538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f492c0039b0 0x7f492c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4947e00640 1 -- 172.21.15.99:0/1370496538 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f492c0051c0 msgr2=0x7f492c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4947e00640 1 --2- 172.21.15.99:0/1370496538 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f492c0051c0 0x7f492c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4947e00640 1 -- 172.21.15.99:0/1370496538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f492c004800 msgr2=0x7f492c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.435+0000 7f4947e00640 1 --2- 172.21.15.99:0/1370496538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f492c004800 0x7f492c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.436+0000 7f4947e00640 1 -- 172.21.15.99:0/1370496538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c003520 con 0x7f492c0039b0 2024-03-30T13:13:15.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.436+0000 7f494cc00640 1 -- 172.21.15.99:0/1370496538 reap_dead start 2024-03-30T13:13:15.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.437+0000 7f4947e00640 1 --2- 172.21.15.99:0/1370496538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f492c0039b0 0x7f492c003dd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4938009ac0 tx=0x7f492c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5649e03d3f1ba963 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.437+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938039070 con 0x7f492c0039b0 2024-03-30T13:13:15.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.437+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493802c6d0 con 0x7f492c0039b0 2024-03-30T13:13:15.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.437+0000 7f4946a00640 1 -- 172.21.15.99:0/1370496538 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938009690 con 0x7f492c0039b0 2024-03-30T13:13:15.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.438+0000 7f494ec00640 1 -- 172.21.15.99:0/1370496538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f492c0039b0 msgr2=0x7f492c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.438+0000 7f494ec00640 1 --2- 172.21.15.99:0/1370496538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f492c0039b0 0x7f492c003dd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4938009ac0 tx=0x7f492c005830 comp rx=0 tx=0).stop 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.438+0000 7f494ec00640 1 -- 172.21.15.99:0/1370496538 shutdown_connections 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.438+0000 7f494ec00640 1 --2- 172.21.15.99:0/1370496538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f492c0039b0 0x7f492c003dd0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.438+0000 7f494ec00640 1 -- 172.21.15.99:0/1370496538 >> 172.21.15.99:0/1370496538 conn(0x7f49480d0450 msgr2=0x7f49480d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.438+0000 7f494ec00640 1 -- 172.21.15.99:0/1370496538 shutdown_connections 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.438+0000 7f494ec00640 1 -- 172.21.15.99:0/1370496538 wait complete. 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.440+0000 7f494ec00640 1 Processor -- start 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.440+0000 7f494ec00640 1 -- start start 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494ec00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f492c0039b0 0x7f494806d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494ec00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49480b08b0 0x7f494806e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494ec00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49481f5a10 0x7f49481f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494ec00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f49480b3650 con 0x7f49481f5a10 2024-03-30T13:13:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494ec00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f49480cba20 con 0x7f492c0039b0 2024-03-30T13:13:15.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494ec00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f49480c60f0 con 0x7f49480b08b0 2024-03-30T13:13:15.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49481f5a10 0x7f49481f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49481f5a10 0x7f49481f5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47968/0 (socket says 172.21.15.99:47968) 2024-03-30T13:13:15.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494cc00640 1 -- 172.21.15.99:0/2035433664 learned_addr learned my addr 172.21.15.99:0/2035433664 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494cc00640 1 -- 172.21.15.99:0/2035433664 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49480b08b0 msgr2=0x7f494806e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494cc00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49480b08b0 0x7f494806e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494cc00640 1 -- 172.21.15.99:0/2035433664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f492c0039b0 msgr2=0x7f494806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494cc00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f492c0039b0 0x7f494806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.441+0000 7f494cc00640 1 -- 172.21.15.99:0/2035433664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494806f860 con 0x7f49481f5a10 2024-03-30T13:13:15.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.442+0000 7f494cc00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49481f5a10 0x7f49481f5e90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f49480b2f60 tx=0x7f494000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.442+0000 7f493fe00640 1 -- 172.21.15.99:0/2035433664 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494000a610 con 0x7f49481f5a10 2024-03-30T13:13:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.442+0000 7f493fe00640 1 -- 172.21.15.99:0/2035433664 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494000a7d0 con 0x7f49481f5a10 2024-03-30T13:13:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.442+0000 7f493fe00640 1 -- 172.21.15.99:0/2035433664 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494000abc0 con 0x7f49481f5a10 2024-03-30T13:13:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.442+0000 7f494ec00640 1 -- 172.21.15.99:0/2035433664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494806e670 con 0x7f49481f5a10 2024-03-30T13:13:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.442+0000 7f494ec00640 1 -- 172.21.15.99:0/2035433664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494806ec30 con 0x7f49481f5a10 2024-03-30T13:13:15.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.444+0000 7f493fe00640 1 -- 172.21.15.99:0/2035433664 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4940007070 con 0x7f49481f5a10 2024-03-30T13:13:15.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.445+0000 7f493fe00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f492806c530 0x7f492806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.445+0000 7f493fe00640 1 -- 172.21.15.99:0/2035433664 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f494008a9e0 con 0x7f49481f5a10 2024-03-30T13:13:15.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.445+0000 7f4947e00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f492806c530 0x7f492806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.446+0000 7f49519ae740 1 Processor -- start 2024-03-30T13:13:15.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.446+0000 7f4947e00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f492806c530 0x7f492806e9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4938036000 tx=0x7f493802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.446+0000 7f49519ae740 1 -- start start 2024-03-30T13:13:15.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.447+0000 7f49519ae740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426290 0x55b9ae44cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.447+0000 7f49519ae740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae44d300 0x55b9ae4252d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.447+0000 7f49519ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae426670 0x55b9ae425810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.447+0000 7f49519ae740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b9ae389330 con 0x55b9ae44d300 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.447+0000 7f49519ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b9ae331620 con 0x55b9ae426670 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.447+0000 7f49519ae740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b9ae385440 con 0x55b9ae426290 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.447+0000 7f4947400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae44d300 0x55b9ae4252d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.447+0000 7f4947400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae44d300 0x55b9ae4252d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47976/0 (socket says 172.21.15.99:47976) 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.447+0000 7f4947400640 1 -- 172.21.15.99:0/1778696423 learned_addr learned my addr 172.21.15.99:0/1778696423 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.448+0000 7f4947e00640 1 --2- 172.21.15.99:0/1778696423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426290 0x55b9ae44cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.448+0000 7f494cc00640 1 --2- 172.21.15.99:0/1778696423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae426670 0x55b9ae425810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.448+0000 7f4947400640 1 -- 172.21.15.99:0/1778696423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426290 msgr2=0x55b9ae44cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.448+0000 7f4947400640 1 --2- 172.21.15.99:0/1778696423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426290 0x55b9ae44cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.448+0000 7f4947400640 1 -- 172.21.15.99:0/1778696423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae426670 msgr2=0x55b9ae425810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.448+0000 7f4947400640 1 --2- 172.21.15.99:0/1778696423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae426670 0x55b9ae425810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.448+0000 7f4947400640 1 -- 172.21.15.99:0/1778696423 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ae169920 con 0x55b9ae44d300 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.448+0000 7f4947400640 1 --2- 172.21.15.99:0/1778696423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae44d300 0x55b9ae4252d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4934001620 tx=0x7f4934001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fb44386e8c00a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.448+0000 7f4933e00640 1 -- 172.21.15.99:0/1778696423 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934017070 con 0x55b9ae44d300 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.448+0000 7f4933e00640 1 -- 172.21.15.99:0/1778696423 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4934001d30 con 0x55b9ae44d300 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.448+0000 7f4933e00640 1 -- 172.21.15.99:0/1778696423 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493400c870 con 0x55b9ae44d300 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.449+0000 7f49519ae740 1 -- 172.21.15.99:0/1778696423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae44d300 msgr2=0x55b9ae4252d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.449+0000 7f49519ae740 1 --2- 172.21.15.99:0/1778696423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae44d300 0x55b9ae4252d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4934001620 tx=0x7f4934001ae0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.449+0000 7f49519ae740 1 -- 172.21.15.99:0/1778696423 shutdown_connections 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.449+0000 7f49519ae740 1 --2- 172.21.15.99:0/1778696423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae426670 0x55b9ae425810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.449+0000 7f49519ae740 1 --2- 172.21.15.99:0/1778696423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae44d300 0x55b9ae4252d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.449+0000 7f49519ae740 1 --2- 172.21.15.99:0/1778696423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426290 0x55b9ae44cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.449+0000 7f49519ae740 1 -- 172.21.15.99:0/1778696423 >> 172.21.15.99:0/1778696423 conn(0x55b9ae3ecbe0 msgr2=0x55b9ae46afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.449+0000 7f49519ae740 1 -- 172.21.15.99:0/1778696423 shutdown_connections 2024-03-30T13:13:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.449+0000 7f49519ae740 1 -- 172.21.15.99:0/1778696423 wait complete. 2024-03-30T13:13:15.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.450+0000 7f49519ae740 1 -- start start 2024-03-30T13:13:15.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.450+0000 7f49519ae740 1 Processor -- start 2024-03-30T13:13:15.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.451+0000 7f49519ae740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae47e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.451+0000 7f49519ae740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae469380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.451+0000 7f49519ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae4698c0 0x55b9ae467cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.451+0000 7f49519ae740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b9ae44c930 con 0x55b9ae426290 2024-03-30T13:13:15.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.451+0000 7f49519ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b9ae3449d0 con 0x55b9ae4698c0 2024-03-30T13:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.451+0000 7f49519ae740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b9ae4456b0 con 0x55b9ae426670 2024-03-30T13:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.451+0000 7f49519ae740 10 client.0 _ll_register_callbacks cb 0x55b9ae380fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.451+0000 7f4947e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae47e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.451+0000 7f4947e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae47e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47980/0 (socket says 172.21.15.99:47980) 2024-03-30T13:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.451+0000 7f4947e00640 1 -- 172.21.15.99:0/3170565400 learned_addr learned my addr 172.21.15.99:0/3170565400 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.451+0000 7f494cc00640 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae4698c0 0x55b9ae467cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.452+0000 7f4947400640 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae469380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.452+0000 7f4947e00640 1 -- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 msgr2=0x55b9ae469380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.452+0000 7f4947e00640 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae469380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.452+0000 7f4947e00640 1 -- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae4698c0 msgr2=0x55b9ae467cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.452+0000 7f4947e00640 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae4698c0 0x55b9ae467cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.452+0000 7f4947e00640 1 -- 172.21.15.99:0/3170565400 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ae05d210 con 0x55b9ae426290 2024-03-30T13:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.452+0000 7f4947e00640 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae47e0d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4938004610 tx=0x7f49380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590f0c9a71ce161c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.452+0000 7f4930c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.452+0000 7f4930c00640 1 -- 172.21.15.99:0/3170565400 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938050060 con 0x55b9ae426290 2024-03-30T13:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.452+0000 7f4930c00640 1 -- 172.21.15.99:0/3170565400 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4938003810 con 0x55b9ae426290 2024-03-30T13:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.452+0000 7f49519ae740 1 -- 172.21.15.99:0/3170565400 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4934001d30 con 0x55b9ae426290 2024-03-30T13:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.453+0000 7f4930c00640 1 -- 172.21.15.99:0/3170565400 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4938056050 con 0x55b9ae426290 2024-03-30T13:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.453+0000 7f49519ae740 10 client.5616 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.453+0000 7f49519ae740 1 -- 172.21.15.99:0/3170565400 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55b9ae1ca0b0 con 0x55b9ae426290 2024-03-30T13:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.453+0000 7f4930c00640 1 -- 172.21.15.99:0/3170565400 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4934001d30 con 0x55b9ae426290 2024-03-30T13:13:15.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.453+0000 7f4930c00640 1 -- 172.21.15.99:0/3170565400 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4938059020 con 0x55b9ae426290 2024-03-30T13:13:15.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.453+0000 7f49519ae740 10 client.5616 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:15.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.453+0000 7f49519ae740 10 client.5616 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:15.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.453+0000 7f49519ae740 20 client.5616 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:15.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.453+0000 7f49519ae740 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b9ae47c860 0x55b9ae47cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.453+0000 7f49519ae740 4 client.5616 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:15.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.453+0000 7f49519ae740 1 -- 172.21.15.99:0/3170565400 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9ae396870 con 0x55b9ae47c860 2024-03-30T13:13:15.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.454+0000 7f4947400640 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b9ae47c860 0x55b9ae47cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.455+0000 7f4947400640 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b9ae47c860 0x55b9ae47cc80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa9d781465f9efa0 server_cookie=93e4639d1f0085a0 in_seq=0 out_seq=0 2024-03-30T13:13:15.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.455+0000 7f4930c00640 10 client.5616 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.457+0000 7f4930c00640 1 -- 172.21.15.99:0/3170565400 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b9ae396870 con 0x55b9ae47c860 2024-03-30T13:13:15.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.457+0000 7f4930c00640 10 client.5616 handle_command_reply: tid=0 2024-03-30T13:13:15.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.457+0000 7f49519ae740 1 client.5616 shutdown 2024-03-30T13:13:15.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.457+0000 7f49519ae740 1 -- 172.21.15.99:0/3170565400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 msgr2=0x55b9ae47e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.457+0000 7f49519ae740 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae47e0d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4938004610 tx=0x7f49380046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.457+0000 7f49519ae740 1 -- 172.21.15.99:0/3170565400 shutdown_connections 2024-03-30T13:13:15.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.457+0000 7f49519ae740 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b9ae47c860 0x55b9ae47cc80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.458+0000 7f49519ae740 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae4698c0 0x55b9ae467cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.458+0000 7f49519ae740 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae469380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.458+0000 7f49519ae740 1 --2- 172.21.15.99:0/3170565400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae47e0d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.458+0000 7f4930c00640 0 client.5616 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.458+0000 7f49519ae740 1 -- 172.21.15.99:0/3170565400 >> 172.21.15.99:0/3170565400 conn(0x55b9ae3ecbe0 msgr2=0x55b9ae44ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.458+0000 7f49519ae740 1 -- 172.21.15.99:0/3170565400 shutdown_connections 2024-03-30T13:13:15.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.458+0000 7f49519ae740 1 -- 172.21.15.99:0/3170565400 wait complete. 2024-03-30T13:13:15.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.458+0000 7f49519ae740 20 client.5616 trim_cache size 0 max 16384 2024-03-30T13:13:15.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.473+0000 7f49519ae740 1 Processor -- start 2024-03-30T13:13:15.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.474+0000 7f49519ae740 1 -- start start 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.474+0000 7f49519ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae426290 0x55b9ae445690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.474+0000 7f49519ae740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae47cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.474+0000 7f49519ae740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae4698c0 0x55b9ae41b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.474+0000 7f49519ae740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4948201600 con 0x55b9ae4698c0 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.474+0000 7f49519ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f49480cea50 con 0x55b9ae426290 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.474+0000 7f49519ae740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f49480cddb0 con 0x55b9ae426670 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.475+0000 7f494cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae4698c0 0x55b9ae41b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.475+0000 7f494cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae4698c0 0x55b9ae41b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47984/0 (socket says 172.21.15.99:47984) 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.475+0000 7f494cc00640 1 -- 172.21.15.99:0/206617481 learned_addr learned my addr 172.21.15.99:0/206617481 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.475+0000 7f494cc00640 1 -- 172.21.15.99:0/206617481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 msgr2=0x55b9ae47cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.475+0000 7f494cc00640 1 --2- 172.21.15.99:0/206617481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae47cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.475+0000 7f494cc00640 1 -- 172.21.15.99:0/206617481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae426290 msgr2=0x55b9ae445690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.475+0000 7f4947e00640 1 --2- 172.21.15.99:0/206617481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae426290 0x55b9ae445690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.475+0000 7f494cc00640 1 --2- 172.21.15.99:0/206617481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae426290 0x55b9ae445690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.475+0000 7f494cc00640 1 -- 172.21.15.99:0/206617481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ae0362d0 con 0x55b9ae4698c0 2024-03-30T13:13:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.475+0000 7f4947e00640 1 --2- 172.21.15.99:0/206617481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae426290 0x55b9ae445690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.475+0000 7f494cc00640 1 --2- 172.21.15.99:0/206617481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae4698c0 0x55b9ae41b960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4940058800 tx=0x7f49400584e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee72528d6d672db server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f4933400640 1 -- 172.21.15.99:0/206617481 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940056b70 con 0x55b9ae4698c0 2024-03-30T13:13:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f4933400640 1 -- 172.21.15.99:0/206617481 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494005f070 con 0x55b9ae4698c0 2024-03-30T13:13:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f4933400640 1 -- 172.21.15.99:0/206617481 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940054ee0 con 0x55b9ae4698c0 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f49519ae740 1 -- 172.21.15.99:0/206617481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae4698c0 msgr2=0x55b9ae41b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f49519ae740 1 --2- 172.21.15.99:0/206617481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae4698c0 0x55b9ae41b960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4940058800 tx=0x7f49400584e0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f49519ae740 1 -- 172.21.15.99:0/206617481 shutdown_connections 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f49519ae740 1 --2- 172.21.15.99:0/206617481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae4698c0 0x55b9ae41b960 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f49519ae740 1 --2- 172.21.15.99:0/206617481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae47cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f49519ae740 1 --2- 172.21.15.99:0/206617481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae426290 0x55b9ae445690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f49519ae740 1 -- 172.21.15.99:0/206617481 >> 172.21.15.99:0/206617481 conn(0x55b9ae3ecbe0 msgr2=0x55b9ae47dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f49519ae740 1 -- 172.21.15.99:0/206617481 shutdown_connections 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.476+0000 7f49519ae740 1 -- 172.21.15.99:0/206617481 wait complete. 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.477+0000 7f49519ae740 1 -- start start 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.477+0000 7f49519ae740 1 Processor -- start 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.478+0000 7f49519ae740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae4e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.478+0000 7f49519ae740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae443ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.478+0000 7f49519ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae4698c0 0x55b9ae4e4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.478+0000 7f49519ae740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b9ae4537b0 con 0x55b9ae426290 2024-03-30T13:13:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.478+0000 7f49519ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f49480ce400 con 0x55b9ae4698c0 2024-03-30T13:13:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.478+0000 7f49519ae740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b9ae3bd490 con 0x55b9ae426670 2024-03-30T13:13:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.478+0000 7f49519ae740 10 client.0 _ll_register_callbacks cb 0x7f4938037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.478+0000 7f4947e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae4e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.478+0000 7f4947e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae4e2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48000/0 (socket says 172.21.15.99:48000) 2024-03-30T13:13:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f4947e00640 1 -- 172.21.15.99:0/3749673818 learned_addr learned my addr 172.21.15.99:0/3749673818 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f494cc00640 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae4698c0 0x55b9ae4e4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f4947400640 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae443ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f4947e00640 1 -- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 msgr2=0x55b9ae443ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f4947e00640 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae443ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f4947e00640 1 -- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae4698c0 msgr2=0x55b9ae4e4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f4947e00640 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae4698c0 0x55b9ae4e4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f4947e00640 1 -- 172.21.15.99:0/3749673818 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ae444020 con 0x55b9ae426290 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f4947400640 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae443ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f4947e00640 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae4e2dc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4938006d00 tx=0x7f493803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1aa2eecd1384f79 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f4930c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.479+0000 7f4930c00640 1 -- 172.21.15.99:0/3749673818 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938005b90 con 0x55b9ae426290 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f4930c00640 1 -- 172.21.15.99:0/3749673818 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4938005d30 con 0x55b9ae426290 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f49519ae740 1 -- 172.21.15.99:0/3749673818 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f494005f070 con 0x55b9ae426290 2024-03-30T13:13:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f4930c00640 1 -- 172.21.15.99:0/3749673818 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4938006030 con 0x55b9ae426290 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f49519ae740 10 client.5622 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f49519ae740 1 -- 172.21.15.99:0/3749673818 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55b9ae4e3bc0 con 0x55b9ae426290 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f4930c00640 1 -- 172.21.15.99:0/3749673818 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494005f070 con 0x55b9ae426290 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f4930c00640 1 -- 172.21.15.99:0/3749673818 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4938059070 con 0x55b9ae426290 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f49519ae740 10 client.5622 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f49519ae740 10 client.5622 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f49519ae740 20 client.5622 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f49519ae740 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b9ae4e5320 0x55b9ae41f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f49519ae740 4 client.5622 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628325}] 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.480+0000 7f49519ae740 1 -- 172.21.15.99:0/3749673818 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628325}) -- 0x55b9ae390bc0 con 0x55b9ae4e5320 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.481+0000 7f4947400640 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b9ae4e5320 0x55b9ae41f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.482+0000 7f4947400640 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b9ae4e5320 0x55b9ae41f070 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7699b05aedad4d34 server_cookie=a7034bfc76d8e4fe in_seq=0 out_seq=0 2024-03-30T13:13:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.482+0000 7f4930c00640 10 client.5622 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f4930c00640 1 -- 172.21.15.99:0/3749673818 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3974 (crc 0 0 0) 0x55b9ae390bc0 con 0x55b9ae4e5320 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f4930c00640 10 client.5622 handle_command_reply: tid=0 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 1 client.5622 shutdown 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 1 -- 172.21.15.99:0/3749673818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 msgr2=0x55b9ae4e2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae4e2dc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4938006d00 tx=0x7f493803f000 comp rx=0 tx=0).stop 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 1 -- 172.21.15.99:0/3749673818 shutdown_connections 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b9ae4e5320 0x55b9ae41f070 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9ae4698c0 0x55b9ae4e4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b9ae426670 0x55b9ae443ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f4930c00640 0 client.5622 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 1 --2- 172.21.15.99:0/3749673818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9ae426290 0x55b9ae4e2dc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 1 -- 172.21.15.99:0/3749673818 >> 172.21.15.99:0/3749673818 conn(0x55b9ae3ecbe0 msgr2=0x55b9ae47dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 1 -- 172.21.15.99:0/3749673818 shutdown_connections 2024-03-30T13:13:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 1 -- 172.21.15.99:0/3749673818 wait complete. 2024-03-30T13:13:15.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.483+0000 7f49519ae740 20 client.5622 trim_cache size 0 max 16384 2024-03-30T13:13:15.490 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:15.490 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/xattr_trusted.c", 2024-03-30T13:13:15.490 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628325, 2024-03-30T13:13:15.490 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:15.490 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.447384+0000", 2024-03-30T13:13:15.490 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.489956+0000", 2024-03-30T13:13:15.490 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:15.490 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:15.490 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:15.490 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.491 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1094, 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.489956+0000", 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:15.492 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1094, 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.447384+0000" 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.493 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1094, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.447384+0000" 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 130, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 36, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:15.494 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.499159+0000", 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 72, 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:15.495 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:15.497 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:15.498 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.499 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:15.500 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:15.501 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:15.502 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:15.502 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:15.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 -- 172.21.15.99:0/2035433664 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f492806c530 msgr2=0x7f492806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f492806c530 0x7f492806e9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4938036000 tx=0x7f493802e000 comp rx=0 tx=0).stop 2024-03-30T13:13:15.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 -- 172.21.15.99:0/2035433664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49481f5a10 msgr2=0x7f49481f5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49481f5a10 0x7f49481f5e90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f49480b2f60 tx=0x7f494000ccd0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 -- 172.21.15.99:0/2035433664 shutdown_connections 2024-03-30T13:13:15.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f492806c530 0x7f492806e9f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49481f5a10 0x7f49481f5e90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49480b08b0 0x7f494806e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 --2- 172.21.15.99:0/2035433664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f492c0039b0 0x7f494806d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 -- 172.21.15.99:0/2035433664 >> 172.21.15.99:0/2035433664 conn(0x7f49480d0450 msgr2=0x7f494815e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 -- 172.21.15.99:0/2035433664 shutdown_connections 2024-03-30T13:13:15.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.484+0000 7f494ec00640 1 -- 172.21.15.99:0/2035433664 wait complete. 2024-03-30T13:13:15.506 DEBUG:tasks.cephfs.test_uninlining:getting inode info #13 of 23:1099511628323 2024-03-30T13:13:15.506 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628323 2024-03-30T13:13:15.506 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628323 2024-03-30T13:13:15.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.713+0000 7ffa3f800640 1 Processor -- start 2024-03-30T13:13:15.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.713+0000 7ffa3f800640 1 -- start start 2024-03-30T13:13:15.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.715+0000 7ffa3f800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ffa3815b3d0 0x7ffa380ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.715+0000 7ffa3f800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa380b28c0 0x7ffa380b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.715+0000 7ffa3f800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa380c6470 con 0x7ffa380b49f0 2024-03-30T13:13:15.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.715+0000 7ffa3f800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ffa380c6240 con 0x7ffa380b28c0 2024-03-30T13:13:15.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.715+0000 7ffa3f800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ffa380c7080 con 0x7ffa3815b3d0 2024-03-30T13:13:15.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.715+0000 7ffa3d800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa380b28c0 0x7ffa380b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.715+0000 7ffa2fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ffa380b49f0 0x7ffa380b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:41686/0 (socket says 172.21.15.99:41686) 2024-03-30T13:13:15.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.715+0000 7ffa2fe00640 1 -- 172.21.15.99:0/2022032519 learned_addr learned my addr 172.21.15.99:0/2022032519 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:15.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.715+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/2022032519 >> v2:172.21.15.181:3300/0 conn(0x7ffa3815b3d0 0x7ffa380ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.716+0000 7ffa3d800640 1 -- 172.21.15.99:0/2022032519 >> v2:172.21.15.181:3300/0 conn(0x7ffa3815b3d0 msgr2=0x7ffa380ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.716+0000 7ffa3d800640 1 --2- 172.21.15.99:0/2022032519 >> v2:172.21.15.181:3300/0 conn(0x7ffa3815b3d0 0x7ffa380ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.716+0000 7ffa3d800640 1 -- 172.21.15.99:0/2022032519 >> v1:172.21.15.99:6789/0 conn(0x7ffa380b49f0 legacy=0x7ffa380b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.716+0000 7ffa3d800640 1 -- 172.21.15.99:0/2022032519 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa380c6750 con 0x7ffa380b28c0 2024-03-30T13:13:15.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.716+0000 7ffa37e00640 1 -- 172.21.15.99:0/2022032519 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676051494 0 0) 0x7ffa380c6470 con 0x7ffa380b49f0 2024-03-30T13:13:15.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.717+0000 7ffa3d800640 1 --2- 172.21.15.99:0/2022032519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa380b28c0 0x7ffa380b4e80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffa380b2ee0 tx=0x7ffa3002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe2edbe4f44b704 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.717+0000 7ffa37e00640 1 -- 172.21.15.99:0/2022032519 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30039070 con 0x7ffa380b28c0 2024-03-30T13:13:15.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.717+0000 7ffa37e00640 1 -- 172.21.15.99:0/2022032519 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa3002cc80 con 0x7ffa380b28c0 2024-03-30T13:13:15.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.717+0000 7ffa37e00640 1 -- 172.21.15.99:0/2022032519 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30034660 con 0x7ffa380b28c0 2024-03-30T13:13:15.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.718+0000 7ffa3f800640 1 -- 172.21.15.99:0/2022032519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa380b28c0 msgr2=0x7ffa380b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.718+0000 7ffa3f800640 1 --2- 172.21.15.99:0/2022032519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa380b28c0 0x7ffa380b4e80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffa380b2ee0 tx=0x7ffa3002bed0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.718+0000 7ffa3f800640 1 -- 172.21.15.99:0/2022032519 shutdown_connections 2024-03-30T13:13:15.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.718+0000 7ffa3f800640 1 --2- 172.21.15.99:0/2022032519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa380b28c0 0x7ffa380b4e80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.718+0000 7ffa3f800640 1 --2- 172.21.15.99:0/2022032519 >> v2:172.21.15.181:3300/0 conn(0x7ffa3815b3d0 0x7ffa380ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.718+0000 7ffa3f800640 1 -- 172.21.15.99:0/2022032519 >> 172.21.15.99:0/2022032519 conn(0x7ffa380d0450 msgr2=0x7ffa380d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.718+0000 7ffa3f800640 1 -- 172.21.15.99:0/2022032519 shutdown_connections 2024-03-30T13:13:15.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.718+0000 7ffa3f800640 1 -- 172.21.15.99:0/2022032519 wait complete. 2024-03-30T13:13:15.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.720+0000 7ffa3f800640 1 Processor -- start 2024-03-30T13:13:15.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.720+0000 7ffa3f800640 1 -- start start 2024-03-30T13:13:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3f800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa380b28c0 0x7ffa381f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3f800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa380b49f0 0x7ffa38073490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3f800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3815b3d0 0x7ffa380b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3f800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3815b7b0 con 0x7ffa3815b3d0 2024-03-30T13:13:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3f800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffa380c6d10 con 0x7ffa380b28c0 2024-03-30T13:13:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3f800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3815b930 con 0x7ffa380b49f0 2024-03-30T13:13:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3815b3d0 0x7ffa380b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3815b3d0 0x7ffa380b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48016/0 (socket says 172.21.15.99:48016) 2024-03-30T13:13:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3d800640 1 -- 172.21.15.99:0/3738798419 learned_addr learned my addr 172.21.15.99:0/3738798419 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa380b49f0 0x7ffa38073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa380b28c0 0x7ffa381f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3d800640 1 -- 172.21.15.99:0/3738798419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa380b49f0 msgr2=0x7ffa38073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3d800640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa380b49f0 0x7ffa38073490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3d800640 1 -- 172.21.15.99:0/3738798419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa380b28c0 msgr2=0x7ffa381f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3d800640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa380b28c0 0x7ffa381f37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.721+0000 7ffa3d800640 1 -- 172.21.15.99:0/3738798419 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa381f5140 con 0x7ffa3815b3d0 2024-03-30T13:13:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.722+0000 7ffa3d800640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3815b3d0 0x7ffa380b0d80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009e80 tx=0x7ffa30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.722+0000 7ffa35600640 1 -- 172.21.15.99:0/3738798419 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30039050 con 0x7ffa3815b3d0 2024-03-30T13:13:15.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.722+0000 7ffa35600640 1 -- 172.21.15.99:0/3738798419 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa30045070 con 0x7ffa3815b3d0 2024-03-30T13:13:15.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.722+0000 7ffa35600640 1 -- 172.21.15.99:0/3738798419 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3003e830 con 0x7ffa3815b3d0 2024-03-30T13:13:15.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.722+0000 7ffa3f800640 1 -- 172.21.15.99:0/3738798419 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa381f5420 con 0x7ffa3815b3d0 2024-03-30T13:13:15.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.722+0000 7ffa3f800640 1 -- 172.21.15.99:0/3738798419 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa381f59e0 con 0x7ffa3815b3d0 2024-03-30T13:13:15.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.724+0000 7ffa35600640 1 -- 172.21.15.99:0/3738798419 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ffa3003e9d0 con 0x7ffa3815b3d0 2024-03-30T13:13:15.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.725+0000 7ffa35600640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffa1406c530 0x7ffa1406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.725+0000 7ffa35600640 1 -- 172.21.15.99:0/3738798419 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7ffa300ae4d0 con 0x7ffa3815b3d0 2024-03-30T13:13:15.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.726+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffa1406c530 0x7ffa1406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.726+0000 7ffa4246e740 1 Processor -- start 2024-03-30T13:13:15.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.726+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffa1406c530 0x7ffa1406e9f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffa28006fd0 tx=0x7ffa28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.726+0000 7ffa4246e740 1 -- start start 2024-03-30T13:13:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.727+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6b6290 0x55e54a6dcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.727+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6dd300 0x55e54a6b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.727+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6670 0x55e54a6b5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.727+0000 7ffa4246e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e54a619330 con 0x55e54a6dd300 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.727+0000 7ffa4246e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e54a5c1620 con 0x55e54a6b6670 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.727+0000 7ffa4246e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55e54a615440 con 0x55e54a6b6290 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.727+0000 7ffa2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6dd300 0x55e54a6b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.727+0000 7ffa2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6dd300 0x55e54a6b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48032/0 (socket says 172.21.15.99:48032) 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.727+0000 7ffa2fe00640 1 -- 172.21.15.99:0/2626495195 learned_addr learned my addr 172.21.15.99:0/2626495195 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.728+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/2626495195 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6b6290 0x55e54a6dcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.728+0000 7ffa3d800640 1 --2- 172.21.15.99:0/2626495195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6670 0x55e54a6b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.728+0000 7ffa2fe00640 1 -- 172.21.15.99:0/2626495195 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6b6290 msgr2=0x55e54a6dcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.728+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/2626495195 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6b6290 0x55e54a6dcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.728+0000 7ffa2fe00640 1 -- 172.21.15.99:0/2626495195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6670 msgr2=0x55e54a6b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.728+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/2626495195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6670 0x55e54a6b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.728+0000 7ffa2fe00640 1 -- 172.21.15.99:0/2626495195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54a3f9920 con 0x55e54a6dd300 2024-03-30T13:13:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.728+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/2626495195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6dd300 0x55e54a6b52d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007480 tx=0x7ffa20005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f054138afe518fd5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.728+0000 7ffa2d600640 1 -- 172.21.15.99:0/2626495195 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20019070 con 0x55e54a6dd300 2024-03-30T13:13:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.728+0000 7ffa2d600640 1 -- 172.21.15.99:0/2626495195 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa20001830 con 0x55e54a6dd300 2024-03-30T13:13:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.728+0000 7ffa2d600640 1 -- 172.21.15.99:0/2626495195 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20001c00 con 0x55e54a6dd300 2024-03-30T13:13:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.729+0000 7ffa4246e740 1 -- 172.21.15.99:0/2626495195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6dd300 msgr2=0x55e54a6b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.729+0000 7ffa4246e740 1 --2- 172.21.15.99:0/2626495195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6dd300 0x55e54a6b52d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007480 tx=0x7ffa20005bc0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.729+0000 7ffa4246e740 1 -- 172.21.15.99:0/2626495195 shutdown_connections 2024-03-30T13:13:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.729+0000 7ffa4246e740 1 --2- 172.21.15.99:0/2626495195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6670 0x55e54a6b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.729+0000 7ffa4246e740 1 --2- 172.21.15.99:0/2626495195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6dd300 0x55e54a6b52d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.729+0000 7ffa4246e740 1 --2- 172.21.15.99:0/2626495195 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6b6290 0x55e54a6dcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.729+0000 7ffa4246e740 1 -- 172.21.15.99:0/2626495195 >> 172.21.15.99:0/2626495195 conn(0x55e54a67cbe0 msgr2=0x55e54a6fafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.729+0000 7ffa4246e740 1 -- 172.21.15.99:0/2626495195 shutdown_connections 2024-03-30T13:13:15.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.729+0000 7ffa4246e740 1 -- 172.21.15.99:0/2626495195 wait complete. 2024-03-30T13:13:15.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.730+0000 7ffa4246e740 1 -- start start 2024-03-30T13:13:15.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.730+0000 7ffa4246e740 1 Processor -- start 2024-03-30T13:13:15.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.731+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6d4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.731+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6b6670 0x55e54a6f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.731+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6fa1e0 0x55e54a6fa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.731+0000 7ffa4246e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e54a6dc930 con 0x55e54a6fa1e0 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.731+0000 7ffa4246e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e54a5d49d0 con 0x55e54a6b6290 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.731+0000 7ffa4246e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55e54a6d56b0 con 0x55e54a6b6670 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.731+0000 7ffa4246e740 10 client.0 _ll_register_callbacks cb 0x55e54a610fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.731+0000 7ffa3d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6fa1e0 0x55e54a6fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.731+0000 7ffa3d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6fa1e0 0x55e54a6fa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48034/0 (socket says 172.21.15.99:48034) 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.731+0000 7ffa3d800640 1 -- 172.21.15.99:0/1658811660 learned_addr learned my addr 172.21.15.99:0/1658811660 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6d4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6b6670 0x55e54a6f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa3d800640 1 -- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6b6670 msgr2=0x55e54a6f92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa3d800640 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6b6670 0x55e54a6f92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa3d800640 1 -- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 msgr2=0x55e54a6d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa3d800640 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6d4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa3d800640 1 -- 172.21.15.99:0/1658811660 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e54a2ed210 con 0x55e54a6fa1e0 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6b6670 0x55e54a6f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa3d800640 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6fa1e0 0x55e54a6fa660 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffa300787c0 tx=0x7ffa3002cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23da3e520afaa1c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa26000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa26000640 1 -- 172.21.15.99:0/1658811660 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30094020 con 0x55e54a6fa1e0 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa26000640 1 -- 172.21.15.99:0/1658811660 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7ffa3003ecc0 con 0x55e54a6fa1e0 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.732+0000 7ffa4246e740 1 -- 172.21.15.99:0/1658811660 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa20001830 con 0x55e54a6fa1e0 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.733+0000 7ffa26000640 1 -- 172.21.15.99:0/1658811660 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffa300ae2d0 con 0x55e54a6fa1e0 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.733+0000 7ffa4246e740 10 client.5637 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.733+0000 7ffa4246e740 1 -- 172.21.15.99:0/1658811660 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e54a45a0b0 con 0x55e54a6fa1e0 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.733+0000 7ffa26000640 1 -- 172.21.15.99:0/1658811660 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa20001830 con 0x55e54a6fa1e0 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.733+0000 7ffa26000640 1 -- 172.21.15.99:0/1658811660 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7ffa30084ab0 con 0x55e54a6fa1e0 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.733+0000 7ffa4246e740 10 client.5637 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:15.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.733+0000 7ffa4246e740 10 client.5637 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:15.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.733+0000 7ffa4246e740 20 client.5637 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:15.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.733+0000 7ffa4246e740 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e54a6e2350 0x55e54a6e27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.733+0000 7ffa4246e740 4 client.5637 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:15.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.733+0000 7ffa4246e740 1 -- 172.21.15.99:0/1658811660 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e54a626870 con 0x55e54a6e2350 2024-03-30T13:13:15.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.734+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e54a6e2350 0x55e54a6e27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.735+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e54a6e2350 0x55e54a6e27a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8fa3943a3a576a7 server_cookie=8b6963a7ba77df76 in_seq=0 out_seq=0 2024-03-30T13:13:15.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.735+0000 7ffa26000640 10 client.5637 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa26000640 1 -- 172.21.15.99:0/1658811660 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55e54a626870 con 0x55e54a6e2350 2024-03-30T13:13:15.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa26000640 10 client.5637 handle_command_reply: tid=0 2024-03-30T13:13:15.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa4246e740 1 client.5637 shutdown 2024-03-30T13:13:15.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa4246e740 1 -- 172.21.15.99:0/1658811660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6fa1e0 msgr2=0x55e54a6fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa4246e740 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6fa1e0 0x55e54a6fa660 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffa300787c0 tx=0x7ffa3002cd40 comp rx=0 tx=0).stop 2024-03-30T13:13:15.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa4246e740 1 -- 172.21.15.99:0/1658811660 shutdown_connections 2024-03-30T13:13:15.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa4246e740 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6fa1e0 0x55e54a6fa660 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa4246e740 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6b6670 0x55e54a6f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa4246e740 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e54a6e2350 0x55e54a6e27a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa4246e740 1 --2- 172.21.15.99:0/1658811660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6d4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa26000640 0 client.5637 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.737+0000 7ffa4246e740 1 -- 172.21.15.99:0/1658811660 >> 172.21.15.99:0/1658811660 conn(0x55e54a67cbe0 msgr2=0x55e54a6dbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.738+0000 7ffa4246e740 1 -- 172.21.15.99:0/1658811660 shutdown_connections 2024-03-30T13:13:15.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.738+0000 7ffa4246e740 1 -- 172.21.15.99:0/1658811660 wait complete. 2024-03-30T13:13:15.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.738+0000 7ffa4246e740 20 client.5637 trim_cache size 0 max 16384 2024-03-30T13:13:15.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.753+0000 7ffa4246e740 1 Processor -- start 2024-03-30T13:13:15.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.753+0000 7ffa4246e740 1 -- start start 2024-03-30T13:13:15.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.754+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6fe110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.754+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a779350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.754+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6fa1e0 0x55e54a779890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.754+0000 7ffa4246e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffa38200b30 con 0x55e54a6b6670 2024-03-30T13:13:15.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.754+0000 7ffa4246e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffa381ffbc0 con 0x55e54a6b6290 2024-03-30T13:13:15.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.754+0000 7ffa4246e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ffa381f6bf0 con 0x55e54a6fa1e0 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a779350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a779350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48036/0 (socket says 172.21.15.99:48036) 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa2fe00640 1 -- 172.21.15.99:0/338491010 learned_addr learned my addr 172.21.15.99:0/338491010 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa3d800640 1 --2- 172.21.15.99:0/338491010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6fa1e0 0x55e54a779890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/338491010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6fe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa2fe00640 1 -- 172.21.15.99:0/338491010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6fa1e0 msgr2=0x55e54a779890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/338491010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6fa1e0 0x55e54a779890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa2fe00640 1 -- 172.21.15.99:0/338491010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 msgr2=0x55e54a6fe110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/338491010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6fe110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa2fe00640 1 -- 172.21.15.99:0/338491010 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54a2c62d0 con 0x55e54a6b6670 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa3d800640 1 --2- 172.21.15.99:0/338491010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6fa1e0 0x55e54a779890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/338491010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6fe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:15.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/338491010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a779350 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ffa200011e0 tx=0x7ffa20009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125a98e32a6caf18 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.755+0000 7ffa2cc00640 1 -- 172.21.15.99:0/338491010 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20023070 con 0x55e54a6b6670 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.756+0000 7ffa2cc00640 1 -- 172.21.15.99:0/338491010 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa2001a040 con 0x55e54a6b6670 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.756+0000 7ffa2cc00640 1 -- 172.21.15.99:0/338491010 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20019030 con 0x55e54a6b6670 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.756+0000 7ffa4246e740 1 -- 172.21.15.99:0/338491010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 msgr2=0x55e54a779350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.756+0000 7ffa4246e740 1 --2- 172.21.15.99:0/338491010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a779350 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ffa200011e0 tx=0x7ffa20009030 comp rx=0 tx=0).stop 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.756+0000 7ffa4246e740 1 -- 172.21.15.99:0/338491010 shutdown_connections 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.756+0000 7ffa4246e740 1 --2- 172.21.15.99:0/338491010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6fa1e0 0x55e54a779890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.756+0000 7ffa4246e740 1 --2- 172.21.15.99:0/338491010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a779350 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.756+0000 7ffa4246e740 1 --2- 172.21.15.99:0/338491010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6fe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.756+0000 7ffa4246e740 1 -- 172.21.15.99:0/338491010 >> 172.21.15.99:0/338491010 conn(0x55e54a67cbe0 msgr2=0x55e54a6e01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.756+0000 7ffa4246e740 1 -- 172.21.15.99:0/338491010 shutdown_connections 2024-03-30T13:13:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.756+0000 7ffa4246e740 1 -- 172.21.15.99:0/338491010 wait complete. 2024-03-30T13:13:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.757+0000 7ffa4246e740 1 -- start start 2024-03-30T13:13:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.757+0000 7ffa4246e740 1 Processor -- start 2024-03-30T13:13:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6e03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a77e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa4246e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6fa1e0 0x55e54a6d4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa4246e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e54a6b1800 con 0x55e54a6b6670 2024-03-30T13:13:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa4246e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffa381ff570 con 0x55e54a6b6290 2024-03-30T13:13:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa4246e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55e54a77eda0 con 0x55e54a6fa1e0 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa4246e740 10 client.0 _ll_register_callbacks cb 0x7ffa30009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a77e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a77e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48052/0 (socket says 172.21.15.99:48052) 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa2fe00640 1 -- 172.21.15.99:0/2394699803 learned_addr learned my addr 172.21.15.99:0/2394699803 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa2fe00640 1 -- 172.21.15.99:0/2394699803 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6fa1e0 msgr2=0x55e54a6d4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/2394699803 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6fa1e0 0x55e54a6d4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.758+0000 7ffa2fe00640 1 -- 172.21.15.99:0/2394699803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 msgr2=0x55e54a6e03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.759+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/2394699803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6e03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.759+0000 7ffa2fe00640 1 -- 172.21.15.99:0/2394699803 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e54a6e08e0 con 0x55e54a6b6670 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.759+0000 7ffa2fe00640 1 --2- 172.21.15.99:0/2394699803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a77e450 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007010 tx=0x7ffa20000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7852f9c83dcf9120 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.759+0000 7ffa26000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.759+0000 7ffa26000640 1 -- 172.21.15.99:0/2394699803 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2002c060 con 0x55e54a6b6670 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.759+0000 7ffa26000640 1 -- 172.21.15.99:0/2394699803 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7ffa200017b0 con 0x55e54a6b6670 2024-03-30T13:13:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.759+0000 7ffa4246e740 1 -- 172.21.15.99:0/2394699803 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa2001a040 con 0x55e54a6b6670 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.759+0000 7ffa26000640 1 -- 172.21.15.99:0/2394699803 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffa20032050 con 0x55e54a6b6670 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.759+0000 7ffa4246e740 10 client.5643 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.759+0000 7ffa4246e740 1 -- 172.21.15.99:0/2394699803 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e54a6f81b0 con 0x55e54a6b6670 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.760+0000 7ffa26000640 1 -- 172.21.15.99:0/2394699803 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa2001a040 con 0x55e54a6b6670 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.760+0000 7ffa26000640 1 -- 172.21.15.99:0/2394699803 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7ffa20035020 con 0x55e54a6b6670 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.760+0000 7ffa4246e740 10 client.5643 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.760+0000 7ffa4246e740 10 client.5643 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.760+0000 7ffa4246e740 20 client.5643 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.760+0000 7ffa4246e740 1 --2- 172.21.15.99:0/2394699803 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e54a77e990 0x55e54a6af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.760+0000 7ffa4246e740 4 client.5643 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628323}] 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.760+0000 7ffa4246e740 1 -- 172.21.15.99:0/2394699803 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628323}) -- 0x55e54a620bc0 con 0x55e54a77e990 2024-03-30T13:13:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.761+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/2394699803 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e54a77e990 0x55e54a6af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.761+0000 7ffa3ce00640 1 --2- 172.21.15.99:0/2394699803 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e54a77e990 0x55e54a6af070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f546d487a53e9365 server_cookie=c3e0779bfc1ac081 in_seq=0 out_seq=0 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.761+0000 7ffa26000640 10 client.5643 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.762+0000 7ffa26000640 1 -- 172.21.15.99:0/2394699803 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3966 (crc 0 0 0) 0x55e54a620bc0 con 0x55e54a77e990 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.762+0000 7ffa26000640 10 client.5643 handle_command_reply: tid=0 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.762+0000 7ffa4246e740 1 client.5643 shutdown 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa4246e740 1 -- 172.21.15.99:0/2394699803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 msgr2=0x55e54a77e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa4246e740 1 --2- 172.21.15.99:0/2394699803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a77e450 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007010 tx=0x7ffa20000ed0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa4246e740 1 -- 172.21.15.99:0/2394699803 shutdown_connections 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa4246e740 1 --2- 172.21.15.99:0/2394699803 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e54a6fa1e0 0x55e54a6d4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa4246e740 1 --2- 172.21.15.99:0/2394699803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e54a6b6670 0x55e54a77e450 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa4246e740 1 --2- 172.21.15.99:0/2394699803 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e54a77e990 0x55e54a6af070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa4246e740 1 --2- 172.21.15.99:0/2394699803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e54a6b6290 0x55e54a6e03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa4246e740 1 -- 172.21.15.99:0/2394699803 >> 172.21.15.99:0/2394699803 conn(0x55e54a67cbe0 msgr2=0x55e54a714640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa26000640 0 client.5643 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:15.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa4246e740 1 -- 172.21.15.99:0/2394699803 shutdown_connections 2024-03-30T13:13:15.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa4246e740 1 -- 172.21.15.99:0/2394699803 wait complete. 2024-03-30T13:13:15.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa4246e740 20 client.5643 trim_cache size 0 max 16384 2024-03-30T13:13:15.769 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/xattr.h", 2024-03-30T13:13:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628323, 2024-03-30T13:13:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.456515+0000", 2024-03-30T13:13:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.482956+0000", 2024-03-30T13:13:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 3340, 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.482956+0000", 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:15.771 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3340, 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:15.772 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.456515+0000" 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3340, 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.456515+0000" 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 148, 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:15.773 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 32, 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.504992+0000", 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 82, 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:15.774 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:15.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:15.776 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:15.777 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:15.778 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:15.781 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:15.781 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:15.781 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:15.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:15.781 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:15.781 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa3f800640 1 -- 172.21.15.99:0/3738798419 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffa1406c530 msgr2=0x7ffa1406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa3f800640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffa1406c530 0x7ffa1406e9f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffa28006fd0 tx=0x7ffa28008040 comp rx=0 tx=0).stop 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa3f800640 1 -- 172.21.15.99:0/3738798419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3815b3d0 msgr2=0x7ffa380b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.763+0000 7ffa3f800640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3815b3d0 0x7ffa380b0d80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009e80 tx=0x7ffa30004a40 comp rx=0 tx=0).stop 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.764+0000 7ffa3f800640 1 -- 172.21.15.99:0/3738798419 shutdown_connections 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.764+0000 7ffa3f800640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ffa1406c530 0x7ffa1406e9f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.764+0000 7ffa3f800640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3815b3d0 0x7ffa380b0d80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.764+0000 7ffa3f800640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa380b49f0 0x7ffa38073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.764+0000 7ffa3f800640 1 --2- 172.21.15.99:0/3738798419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa380b28c0 0x7ffa381f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.764+0000 7ffa3f800640 1 -- 172.21.15.99:0/3738798419 >> 172.21.15.99:0/3738798419 conn(0x7ffa380d0450 msgr2=0x7ffa380cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.764+0000 7ffa3f800640 1 -- 172.21.15.99:0/3738798419 shutdown_connections 2024-03-30T13:13:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.764+0000 7ffa3f800640 1 -- 172.21.15.99:0/3738798419 wait complete. 2024-03-30T13:13:15.784 DEBUG:tasks.cephfs.test_uninlining:getting inode info #14 of 23:1099511628328 2024-03-30T13:13:15.785 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628328 2024-03-30T13:13:15.785 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628328 2024-03-30T13:13:15.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.987+0000 7f6994200640 1 Processor -- start 2024-03-30T13:13:15.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.988+0000 7f6994200640 1 -- start start 2024-03-30T13:13:15.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.989+0000 7f6994200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f698c15e920 0x7f698c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.989+0000 7f6994200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f698c0cfde0 0x7f698c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:15.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.989+0000 7f6994200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f698c0d3780 con 0x7f698c0d0f90 2024-03-30T13:13:15.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.989+0000 7f6994200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f698c15ed00 con 0x7f698c0cfde0 2024-03-30T13:13:15.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.989+0000 7f6994200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f698c0d21e0 con 0x7f698c15e920 2024-03-30T13:13:15.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.990+0000 7f6990e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f698c0cfde0 0x7f698c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.990+0000 7f6992200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f698c0d0f90 0x7f698c06c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:41700/0 (socket says 172.21.15.99:41700) 2024-03-30T13:13:15.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.990+0000 7f6990e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f698c0cfde0 0x7f698c0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48062/0 (socket says 172.21.15.99:48062) 2024-03-30T13:13:15.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.990+0000 7f6992200640 1 -- 172.21.15.99:0/1655618653 learned_addr learned my addr 172.21.15.99:0/1655618653 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:15.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.990+0000 7f6991800640 1 --2- 172.21.15.99:0/1655618653 >> v2:172.21.15.181:3300/0 conn(0x7f698c15e920 0x7f698c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:15.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.990+0000 7f6990e00640 1 -- 172.21.15.99:0/1655618653 >> v2:172.21.15.181:3300/0 conn(0x7f698c15e920 msgr2=0x7f698c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:15.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.990+0000 7f6990e00640 1 --2- 172.21.15.99:0/1655618653 >> v2:172.21.15.181:3300/0 conn(0x7f698c15e920 0x7f698c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.990+0000 7f6990e00640 1 -- 172.21.15.99:0/1655618653 >> v1:172.21.15.99:6789/0 conn(0x7f698c0d0f90 legacy=0x7f698c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.990+0000 7f6990e00640 1 -- 172.21.15.99:0/1655618653 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c0d2480 con 0x7f698c0cfde0 2024-03-30T13:13:15.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.991+0000 7f6990e00640 1 --2- 172.21.15.99:0/1655618653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c0cfde0 0x7f698c0d0240 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f698c08e880 tx=0x7f697802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733ddfac7959abd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:15.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.992+0000 7f698be00640 1 -- 172.21.15.99:0/1655618653 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6978035020 con 0x7f698c0cfde0 2024-03-30T13:13:15.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.992+0000 7f698be00640 1 -- 172.21.15.99:0/1655618653 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6978031830 con 0x7f698c0cfde0 2024-03-30T13:13:15.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.992+0000 7f698be00640 1 -- 172.21.15.99:0/1655618653 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6978031c00 con 0x7f698c0cfde0 2024-03-30T13:13:15.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.992+0000 7f6994200640 1 -- 172.21.15.99:0/1655618653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c0cfde0 msgr2=0x7f698c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.992+0000 7f6994200640 1 --2- 172.21.15.99:0/1655618653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c0cfde0 0x7f698c0d0240 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f698c08e880 tx=0x7f697802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.992+0000 7f6994200640 1 -- 172.21.15.99:0/1655618653 shutdown_connections 2024-03-30T13:13:15.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.992+0000 7f6994200640 1 --2- 172.21.15.99:0/1655618653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c0cfde0 0x7f698c0d0240 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.992+0000 7f6994200640 1 --2- 172.21.15.99:0/1655618653 >> v2:172.21.15.181:3300/0 conn(0x7f698c15e920 0x7f698c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.992+0000 7f6994200640 1 -- 172.21.15.99:0/1655618653 >> 172.21.15.99:0/1655618653 conn(0x7f698c08bfc0 msgr2=0x7f698c0d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.992+0000 7f6994200640 1 -- 172.21.15.99:0/1655618653 shutdown_connections 2024-03-30T13:13:15.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.992+0000 7f6994200640 1 -- 172.21.15.99:0/1655618653 wait complete. 2024-03-30T13:13:15.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.994+0000 7f6994200640 1 Processor -- start 2024-03-30T13:13:15.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.994+0000 7f6994200640 1 -- start start 2024-03-30T13:13:16.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.995+0000 7f6994200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f698c0cfde0 0x7f698c1e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.995+0000 7f6994200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f698c0d0f90 0x7f698c1596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.995+0000 7f6994200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c15e920 0x7f698c15ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.995+0000 7f6994200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f698c0d2d20 con 0x7f698c15e920 2024-03-30T13:13:16.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.995+0000 7f6994200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f698c0d2a40 con 0x7f698c0d0f90 2024-03-30T13:13:16.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.995+0000 7f6994200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f698c0d4ef0 con 0x7f698c0cfde0 2024-03-30T13:13:16.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.996+0000 7f6992200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c15e920 0x7f698c15ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.996+0000 7f6992200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c15e920 0x7f698c15ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48068/0 (socket says 172.21.15.99:48068) 2024-03-30T13:13:16.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.996+0000 7f6992200640 1 -- 172.21.15.99:0/1091191188 learned_addr learned my addr 172.21.15.99:0/1091191188 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.996+0000 7f6991800640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f698c0cfde0 0x7f698c1e8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.996+0000 7f6990e00640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f698c0d0f90 0x7f698c1596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.996+0000 7f6992200640 1 -- 172.21.15.99:0/1091191188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f698c0cfde0 msgr2=0x7f698c1e8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.996+0000 7f6992200640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f698c0cfde0 0x7f698c1e8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.996+0000 7f6992200640 1 -- 172.21.15.99:0/1091191188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f698c0d0f90 msgr2=0x7f698c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.996+0000 7f6992200640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f698c0d0f90 0x7f698c1596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.996+0000 7f6992200640 1 -- 172.21.15.99:0/1091191188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c1e9500 con 0x7f698c15e920 2024-03-30T13:13:16.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.996+0000 7f6992200640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c15e920 0x7f698c15ada0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f698400cbc0 tx=0x7f698400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.997+0000 7f6989600640 1 -- 172.21.15.99:0/1091191188 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984017070 con 0x7f698c15e920 2024-03-30T13:13:16.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.997+0000 7f6989600640 1 -- 172.21.15.99:0/1091191188 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f698400ad40 con 0x7f698c15e920 2024-03-30T13:13:16.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.997+0000 7f6989600640 1 -- 172.21.15.99:0/1091191188 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984012600 con 0x7f698c15e920 2024-03-30T13:13:16.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.997+0000 7f6994200640 1 -- 172.21.15.99:0/1091191188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c1e97e0 con 0x7f698c15e920 2024-03-30T13:13:16.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.997+0000 7f6994200640 1 -- 172.21.15.99:0/1091191188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c1ea080 con 0x7f698c15e920 2024-03-30T13:13:16.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:15.999+0000 7f6989600640 1 -- 172.21.15.99:0/1091191188 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f698401a070 con 0x7f698c15e920 2024-03-30T13:13:16.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.001+0000 7f6989600640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f696c06c530 0x7f696c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.001+0000 7f6989600640 1 -- 172.21.15.99:0/1091191188 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f698408b480 con 0x7f698c15e920 2024-03-30T13:13:16.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.001+0000 7f6991800640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f696c06c530 0x7f696c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.001+0000 7f6996df9740 1 Processor -- start 2024-03-30T13:13:16.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.001+0000 7f6991800640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f696c06c530 0x7f696c06e9f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6980006fd0 tx=0x7f6980008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.002+0000 7f6996df9740 1 -- start start 2024-03-30T13:13:16.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.002+0000 7f6996df9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6c8fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.002+0000 7f6996df9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c90300 0x5594f6c682d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.002+0000 7f6996df9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 0x5594f6c68810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.002+0000 7f6996df9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5594f6bcc330 con 0x5594f6c69290 2024-03-30T13:13:16.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.002+0000 7f6996df9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5594f6b74620 con 0x5594f6c69670 2024-03-30T13:13:16.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.002+0000 7f6996df9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5594f6bc8440 con 0x5594f6c90300 2024-03-30T13:13:16.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6991800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6c8fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6991800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6c8fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48074/0 (socket says 172.21.15.99:48074) 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6991800640 1 -- 172.21.15.99:0/1043735703 learned_addr learned my addr 172.21.15.99:0/1043735703 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6990e00640 1 --2- 172.21.15.99:0/1043735703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c90300 0x5594f6c682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6992200640 1 --2- 172.21.15.99:0/1043735703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 0x5594f6c68810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6991800640 1 -- 172.21.15.99:0/1043735703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c90300 msgr2=0x5594f6c682d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6991800640 1 --2- 172.21.15.99:0/1043735703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c90300 0x5594f6c682d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6991800640 1 -- 172.21.15.99:0/1043735703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 msgr2=0x5594f6c68810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6991800640 1 --2- 172.21.15.99:0/1043735703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 0x5594f6c68810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6991800640 1 -- 172.21.15.99:0/1043735703 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f69ac920 con 0x5594f6c69290 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6992200640 1 --2- 172.21.15.99:0/1043735703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 0x5594f6c68810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6990e00640 1 --2- 172.21.15.99:0/1043735703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c90300 0x5594f6c682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:16.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.003+0000 7f6991800640 1 --2- 172.21.15.99:0/1043735703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6c8fdc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f698000fa20 tx=0x7f6980012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c2ef40d2c7d847 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.004+0000 7f697e000640 1 -- 172.21.15.99:0/1043735703 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698001b050 con 0x5594f6c69290 2024-03-30T13:13:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.004+0000 7f697e000640 1 -- 172.21.15.99:0/1043735703 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6980025070 con 0x5594f6c69290 2024-03-30T13:13:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.004+0000 7f697e000640 1 -- 172.21.15.99:0/1043735703 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980014de0 con 0x5594f6c69290 2024-03-30T13:13:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.004+0000 7f6996df9740 1 -- 172.21.15.99:0/1043735703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 msgr2=0x5594f6c8fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.004+0000 7f6996df9740 1 --2- 172.21.15.99:0/1043735703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6c8fdc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f698000fa20 tx=0x7f6980012000 comp rx=0 tx=0).stop 2024-03-30T13:13:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.005+0000 7f6996df9740 1 -- 172.21.15.99:0/1043735703 shutdown_connections 2024-03-30T13:13:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.005+0000 7f6996df9740 1 --2- 172.21.15.99:0/1043735703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 0x5594f6c68810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.005+0000 7f6996df9740 1 --2- 172.21.15.99:0/1043735703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c90300 0x5594f6c682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.005+0000 7f6996df9740 1 --2- 172.21.15.99:0/1043735703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6c8fdc0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.005+0000 7f6996df9740 1 -- 172.21.15.99:0/1043735703 >> 172.21.15.99:0/1043735703 conn(0x5594f6c2fbe0 msgr2=0x5594f6cadfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.005+0000 7f6996df9740 1 -- 172.21.15.99:0/1043735703 shutdown_connections 2024-03-30T13:13:16.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.005+0000 7f6996df9740 1 -- 172.21.15.99:0/1043735703 wait complete. 2024-03-30T13:13:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.005+0000 7f6996df9740 1 -- start start 2024-03-30T13:13:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.006+0000 7f6996df9740 1 Processor -- start 2024-03-30T13:13:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6996df9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c69290 0x5594f6cc1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6996df9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 0x5594f6cc17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6996df9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6cb1400 0x5594f6cb1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6996df9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5594f6c8f930 con 0x5594f6cb1400 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6996df9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5594f6b879d0 con 0x5594f6c69670 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6996df9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5594f6c886b0 con 0x5594f6c69290 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6996df9740 10 client.0 _ll_register_callbacks cb 0x5594f6bc3fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6992200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6cb1400 0x5594f6cb1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6992200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6cb1400 0x5594f6cb1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48080/0 (socket says 172.21.15.99:48080) 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6992200640 1 -- 172.21.15.99:0/2998250499 learned_addr learned my addr 172.21.15.99:0/2998250499 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6992200640 1 -- 172.21.15.99:0/2998250499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c69290 msgr2=0x5594f6cc1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6992200640 1 --2- 172.21.15.99:0/2998250499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c69290 0x5594f6cc1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6992200640 1 -- 172.21.15.99:0/2998250499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 msgr2=0x5594f6cc17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6992200640 1 --2- 172.21.15.99:0/2998250499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 0x5594f6cc17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6992200640 1 -- 172.21.15.99:0/2998250499 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594f68a0210 con 0x5594f6cb1400 2024-03-30T13:13:16.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6992200640 1 --2- 172.21.15.99:0/2998250499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6cb1400 0x5594f6cb1880 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6984001330 tx=0x7f698405d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351c86df734414e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.007+0000 7f6972a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6972a00640 1 -- 172.21.15.99:0/2998250499 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698408b280 con 0x5594f6cb1400 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6972a00640 1 -- 172.21.15.99:0/2998250499 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f6984061c60 con 0x5594f6cb1400 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6996df9740 1 -- 172.21.15.99:0/2998250499 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6980025070 con 0x5594f6cb1400 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6972a00640 1 -- 172.21.15.99:0/2998250499 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6984057780 con 0x5594f6cb1400 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6996df9740 10 client.5658 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6996df9740 1 -- 172.21.15.99:0/2998250499 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5594f6a0d0b0 con 0x5594f6cb1400 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6972a00640 1 -- 172.21.15.99:0/2998250499 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6980025070 con 0x5594f6cb1400 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6972a00640 1 -- 172.21.15.99:0/2998250499 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f6984004b60 con 0x5594f6cb1400 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6996df9740 10 client.5658 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6996df9740 10 client.5658 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6996df9740 20 client.5658 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6996df9740 1 --2- 172.21.15.99:0/2998250499 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5594f6ca8ab0 0x5594f6ca8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6996df9740 4 client.5658 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:16.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.008+0000 7f6996df9740 1 -- 172.21.15.99:0/2998250499 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594f6bd9870 con 0x5594f6ca8ab0 2024-03-30T13:13:16.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.009+0000 7f6991800640 1 --2- 172.21.15.99:0/2998250499 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5594f6ca8ab0 0x5594f6ca8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.010+0000 7f6991800640 1 --2- 172.21.15.99:0/2998250499 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5594f6ca8ab0 0x5594f6ca8f10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=565d710ac7dcad5e server_cookie=d1be0098db3ddedc in_seq=0 out_seq=0 2024-03-30T13:13:16.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.010+0000 7f6972a00640 10 client.5658 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6972a00640 1 -- 172.21.15.99:0/2998250499 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5594f6bd9870 con 0x5594f6ca8ab0 2024-03-30T13:13:16.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6972a00640 10 client.5658 handle_command_reply: tid=0 2024-03-30T13:13:16.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6996df9740 1 client.5658 shutdown 2024-03-30T13:13:16.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6996df9740 1 -- 172.21.15.99:0/2998250499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6cb1400 msgr2=0x5594f6cb1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6996df9740 1 --2- 172.21.15.99:0/2998250499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6cb1400 0x5594f6cb1880 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6984001330 tx=0x7f698405d6c0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6996df9740 1 -- 172.21.15.99:0/2998250499 shutdown_connections 2024-03-30T13:13:16.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6996df9740 1 --2- 172.21.15.99:0/2998250499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6cb1400 0x5594f6cb1880 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6996df9740 1 --2- 172.21.15.99:0/2998250499 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5594f6ca8ab0 0x5594f6ca8f10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6996df9740 1 --2- 172.21.15.99:0/2998250499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 0x5594f6cc17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6996df9740 1 --2- 172.21.15.99:0/2998250499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c69290 0x5594f6cc1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6972a00640 0 client.5658 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6996df9740 1 -- 172.21.15.99:0/2998250499 >> 172.21.15.99:0/2998250499 conn(0x5594f6c2fbe0 msgr2=0x5594f6c63140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.013+0000 7f6996df9740 1 -- 172.21.15.99:0/2998250499 shutdown_connections 2024-03-30T13:13:16.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.014+0000 7f6996df9740 1 -- 172.21.15.99:0/2998250499 wait complete. 2024-03-30T13:13:16.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.014+0000 7f6996df9740 20 client.5658 trim_cache size 0 max 16384 2024-03-30T13:13:16.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.029+0000 7f6996df9740 1 Processor -- start 2024-03-30T13:13:16.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.029+0000 7f6996df9740 1 -- start start 2024-03-30T13:13:16.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.030+0000 7f6996df9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c69290 0x5594f6c93390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.030+0000 7f6996df9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69670 0x5594f6c83b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.030+0000 7f6996df9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6cb1400 0x5594f6c84080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.030+0000 7f6996df9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f698c200e60 con 0x5594f6c69670 2024-03-30T13:13:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.030+0000 7f6996df9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f698c1ffe80 con 0x5594f6cb1400 2024-03-30T13:13:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.030+0000 7f6996df9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f698c1ff1e0 con 0x5594f6c69290 2024-03-30T13:13:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6990e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69670 0x5594f6c83b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6990e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69670 0x5594f6c83b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48096/0 (socket says 172.21.15.99:48096) 2024-03-30T13:13:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6990e00640 1 -- 172.21.15.99:0/3916121392 learned_addr learned my addr 172.21.15.99:0/3916121392 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6991800640 1 --2- 172.21.15.99:0/3916121392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c69290 0x5594f6c93390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6992200640 1 --2- 172.21.15.99:0/3916121392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6cb1400 0x5594f6c84080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6990e00640 1 -- 172.21.15.99:0/3916121392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c69290 msgr2=0x5594f6c93390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6990e00640 1 --2- 172.21.15.99:0/3916121392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c69290 0x5594f6c93390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6990e00640 1 -- 172.21.15.99:0/3916121392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6cb1400 msgr2=0x5594f6c84080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6990e00640 1 --2- 172.21.15.99:0/3916121392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6cb1400 0x5594f6c84080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6990e00640 1 -- 172.21.15.99:0/3916121392 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f68792d0 con 0x5594f6c69670 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6992200640 1 --2- 172.21.15.99:0/3916121392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6cb1400 0x5594f6c84080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.031+0000 7f6990e00640 1 --2- 172.21.15.99:0/3916121392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69670 0x5594f6c83b40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6978009890 tx=0x7f6978030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3407de9c1130e5c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f697d600640 1 -- 172.21.15.99:0/3916121392 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6978049070 con 0x5594f6c69670 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f697d600640 1 -- 172.21.15.99:0/3916121392 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69780318a0 con 0x5594f6c69670 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f697d600640 1 -- 172.21.15.99:0/3916121392 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6978035040 con 0x5594f6c69670 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f6996df9740 1 -- 172.21.15.99:0/3916121392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69670 msgr2=0x5594f6c83b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f6996df9740 1 --2- 172.21.15.99:0/3916121392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69670 0x5594f6c83b40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6978009890 tx=0x7f6978030000 comp rx=0 tx=0).stop 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f6996df9740 1 -- 172.21.15.99:0/3916121392 shutdown_connections 2024-03-30T13:13:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f6996df9740 1 --2- 172.21.15.99:0/3916121392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6cb1400 0x5594f6c84080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f6996df9740 1 --2- 172.21.15.99:0/3916121392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69670 0x5594f6c83b40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f6996df9740 1 --2- 172.21.15.99:0/3916121392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6c69290 0x5594f6c93390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f6996df9740 1 -- 172.21.15.99:0/3916121392 >> 172.21.15.99:0/3916121392 conn(0x5594f6c2fbe0 msgr2=0x5594f6cae410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f6996df9740 1 -- 172.21.15.99:0/3916121392 shutdown_connections 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.032+0000 7f6996df9740 1 -- 172.21.15.99:0/3916121392 wait complete. 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.033+0000 7f6996df9740 1 -- start start 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.033+0000 7f6996df9740 1 Processor -- start 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.034+0000 7f6996df9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6d2c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.034+0000 7f6996df9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 0x5594f6ca3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.034+0000 7f6996df9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6cb1400 0x5594f6ca3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.034+0000 7f6996df9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f698c1ff830 con 0x5594f6c69290 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.034+0000 7f6996df9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5594f6c8ec50 con 0x5594f6c69670 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.034+0000 7f6996df9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5594f6cd18a0 con 0x5594f6cb1400 2024-03-30T13:13:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.034+0000 7f6996df9740 10 client.0 _ll_register_callbacks cb 0x7f6984055660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.034+0000 7f6991800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6d2c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6991800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6d2c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48106/0 (socket says 172.21.15.99:48106) 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6991800640 1 -- 172.21.15.99:0/2292088463 learned_addr learned my addr 172.21.15.99:0/2292088463 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6991800640 1 -- 172.21.15.99:0/2292088463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6cb1400 msgr2=0x5594f6ca3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6991800640 1 --2- 172.21.15.99:0/2292088463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6cb1400 0x5594f6ca3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6991800640 1 -- 172.21.15.99:0/2292088463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 msgr2=0x5594f6ca3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6991800640 1 --2- 172.21.15.99:0/2292088463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 0x5594f6ca3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6991800640 1 -- 172.21.15.99:0/2292088463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594f6c84440 con 0x5594f6c69290 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6991800640 1 --2- 172.21.15.99:0/2292088463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6d2c710 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x5594f6c97670 tx=0x7f6980004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07c74db33c9a11e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6972a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6972a00640 1 -- 172.21.15.99:0/2292088463 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698001b040 con 0x5594f6c69290 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6972a00640 1 -- 172.21.15.99:0/2292088463 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f6980033dc0 con 0x5594f6c69290 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.035+0000 7f6996df9740 1 -- 172.21.15.99:0/2292088463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69780318a0 con 0x5594f6c69290 2024-03-30T13:13:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.036+0000 7f6972a00640 1 -- 172.21.15.99:0/2292088463 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6980041050 con 0x5594f6c69290 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.036+0000 7f6996df9740 10 client.5664 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.036+0000 7f6996df9740 1 -- 172.21.15.99:0/2292088463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5594f6cd1d70 con 0x5594f6c69290 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.036+0000 7f6972a00640 1 -- 172.21.15.99:0/2292088463 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69780318a0 con 0x5594f6c69290 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.036+0000 7f6972a00640 1 -- 172.21.15.99:0/2292088463 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f6980044020 con 0x5594f6c69290 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.036+0000 7f6996df9740 10 client.5664 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.036+0000 7f6996df9740 10 client.5664 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.036+0000 7f6996df9740 20 client.5664 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.036+0000 7f6996df9740 1 --2- 172.21.15.99:0/2292088463 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5594f6cae440 0x5594f6cd0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.036+0000 7f6996df9740 4 client.5664 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628328}] 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.036+0000 7f6996df9740 1 -- 172.21.15.99:0/2292088463 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628328}) -- 0x5594f6bd3bc0 con 0x5594f6cae440 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.037+0000 7f6990e00640 1 --2- 172.21.15.99:0/2292088463 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5594f6cae440 0x5594f6cd0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.038+0000 7f6990e00640 1 --2- 172.21.15.99:0/2292088463 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5594f6cae440 0x5594f6cd0910 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdc8bf87b60d173d server_cookie=dae9a9f8d988fe04 in_seq=0 out_seq=0 2024-03-30T13:13:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.038+0000 7f6972a00640 10 client.5664 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6972a00640 1 -- 172.21.15.99:0/2292088463 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3966 (crc 0 0 0) 0x5594f6bd3bc0 con 0x5594f6cae440 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6972a00640 10 client.5664 handle_command_reply: tid=0 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 1 client.5664 shutdown 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 1 -- 172.21.15.99:0/2292088463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 msgr2=0x5594f6d2c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 1 --2- 172.21.15.99:0/2292088463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6d2c710 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x5594f6c97670 tx=0x7f6980004730 comp rx=0 tx=0).stop 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 1 -- 172.21.15.99:0/2292088463 shutdown_connections 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 1 --2- 172.21.15.99:0/2292088463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5594f6cb1400 0x5594f6ca3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 1 --2- 172.21.15.99:0/2292088463 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5594f6cae440 0x5594f6cd0910 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 1 --2- 172.21.15.99:0/2292088463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5594f6c69670 0x5594f6ca3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 1 --2- 172.21.15.99:0/2292088463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f6c69290 0x5594f6d2c710 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6972a00640 0 client.5664 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 1 -- 172.21.15.99:0/2292088463 >> 172.21.15.99:0/2292088463 conn(0x5594f6c2fbe0 msgr2=0x5594f6caa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 1 -- 172.21.15.99:0/2292088463 shutdown_connections 2024-03-30T13:13:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 1 -- 172.21.15.99:0/2292088463 wait complete. 2024-03-30T13:13:16.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.039+0000 7f6996df9740 20 client.5664 trim_cache size 0 max 16384 2024-03-30T13:13:16.052 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:16.052 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/Kconfig", 2024-03-30T13:13:16.052 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628328, 2024-03-30T13:13:16.052 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:16.052 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.461102+0000", 2024-03-30T13:13:16.052 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.642952+0000", 2024-03-30T13:13:16.052 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:16.052 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:16.052 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:16.052 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:16.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.054 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:16.054 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 228, 2024-03-30T13:13:16.054 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:16.054 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:16.054 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:16.054 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:16.054 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:16.054 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.642952+0000", 2024-03-30T13:13:16.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.055 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 228, 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.461102+0000" 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 228, 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:16.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.461102+0000" 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 170, 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 2, 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.057 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.507804+0000", 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 58, 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:16.058 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:16.059 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.060 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:16.061 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:16.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:16.064 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:16.064 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:16.064 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:16.064 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:16.064 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:16.064 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.064 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:16.064 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:16.065 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:16.065 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:16.065 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:16.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 -- 172.21.15.99:0/1091191188 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f696c06c530 msgr2=0x7f696c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f696c06c530 0x7f696c06e9f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6980006fd0 tx=0x7f6980008040 comp rx=0 tx=0).stop 2024-03-30T13:13:16.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 -- 172.21.15.99:0/1091191188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c15e920 msgr2=0x7f698c15ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c15e920 0x7f698c15ada0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f698400cbc0 tx=0x7f698400a430 comp rx=0 tx=0).stop 2024-03-30T13:13:16.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 -- 172.21.15.99:0/1091191188 shutdown_connections 2024-03-30T13:13:16.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f696c06c530 0x7f696c06e9f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c15e920 0x7f698c15ada0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f698c0d0f90 0x7f698c1596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 --2- 172.21.15.99:0/1091191188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f698c0cfde0 0x7f698c1e8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 -- 172.21.15.99:0/1091191188 >> 172.21.15.99:0/1091191188 conn(0x7f698c08bfc0 msgr2=0x7f698c161170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 -- 172.21.15.99:0/1091191188 shutdown_connections 2024-03-30T13:13:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.040+0000 7f6994200640 1 -- 172.21.15.99:0/1091191188 wait complete. 2024-03-30T13:13:16.067 DEBUG:tasks.cephfs.test_uninlining:getting inode info #15 of 23:1099511628341 2024-03-30T13:13:16.067 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628341 2024-03-30T13:13:16.067 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628341 2024-03-30T13:13:16.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.280+0000 7f4d6fe00640 1 Processor -- start 2024-03-30T13:13:16.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.280+0000 7f4d6fe00640 1 -- start start 2024-03-30T13:13:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.281+0000 7f4d6fe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7015b140 0x7f4d7006e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.281+0000 7f4d6fe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4d7006ec80 0x7f4d700adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.282+0000 7f4d6fe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7006f0a0 con 0x7f4d700ae1c0 2024-03-30T13:13:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.282+0000 7f4d6fe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4d700aea00 con 0x7f4d7006ec80 2024-03-30T13:13:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.282+0000 7f4d6fe00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4d700aece0 con 0x7f4d7015b140 2024-03-30T13:13:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.282+0000 7f4d6ea00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7015b140 0x7f4d7006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.282+0000 7f4d6ea00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7015b140 0x7f4d7006e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:42828/0 (socket says 172.21.15.99:42828) 2024-03-30T13:13:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.282+0000 7f4d6ea00640 1 -- 172.21.15.99:0/1673831058 learned_addr learned my addr 172.21.15.99:0/1673831058 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.282+0000 7f4d66000640 1 --2- 172.21.15.99:0/1673831058 >> v2:172.21.15.181:3300/0 conn(0x7f4d7006ec80 0x7f4d700adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.283+0000 7f4d6ea00640 1 -- 172.21.15.99:0/1673831058 >> v2:172.21.15.181:3300/0 conn(0x7f4d7006ec80 msgr2=0x7f4d700adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.283+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/1673831058 >> v2:172.21.15.181:3300/0 conn(0x7f4d7006ec80 0x7f4d700adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.283+0000 7f4d6ea00640 1 -- 172.21.15.99:0/1673831058 >> v1:172.21.15.181:6789/0 conn(0x7f4d700ae1c0 legacy=0x7f4d700b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.283+0000 7f4d6ea00640 1 -- 172.21.15.99:0/1673831058 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d700aefc0 con 0x7f4d7015b140 2024-03-30T13:13:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.283+0000 7f4d66000640 1 --2- 172.21.15.99:0/1673831058 >> v2:172.21.15.181:3300/0 conn(0x7f4d7006ec80 0x7f4d700adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:13:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.285+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/1673831058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7015b140 0x7f4d7006e740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009870 tx=0x7f4d6002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a4253fc48273b8c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.285+0000 7f4d6e000640 1 -- 172.21.15.99:0/1673831058 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60034070 con 0x7f4d7015b140 2024-03-30T13:13:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.285+0000 7f4d6e000640 1 -- 172.21.15.99:0/1673831058 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d60030840 con 0x7f4d7015b140 2024-03-30T13:13:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.285+0000 7f4d6e000640 1 -- 172.21.15.99:0/1673831058 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60030c10 con 0x7f4d7015b140 2024-03-30T13:13:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.286+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1673831058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7015b140 msgr2=0x7f4d7006e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.286+0000 7f4d6fe00640 1 --2- 172.21.15.99:0/1673831058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7015b140 0x7f4d7006e740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009870 tx=0x7f4d6002b980 comp rx=0 tx=0).stop 2024-03-30T13:13:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.286+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1673831058 shutdown_connections 2024-03-30T13:13:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.286+0000 7f4d6fe00640 1 --2- 172.21.15.99:0/1673831058 >> v2:172.21.15.181:3300/0 conn(0x7f4d7006ec80 0x7f4d700adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.286+0000 7f4d6fe00640 1 --2- 172.21.15.99:0/1673831058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7015b140 0x7f4d7006e740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.286+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1673831058 >> 172.21.15.99:0/1673831058 conn(0x7f4d7006bb40 msgr2=0x7f4d700b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.286+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1673831058 shutdown_connections 2024-03-30T13:13:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.286+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1673831058 wait complete. 2024-03-30T13:13:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.288+0000 7f4d6fe00640 1 Processor -- start 2024-03-30T13:13:16.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.288+0000 7f4d6fe00640 1 -- start start 2024-03-30T13:13:16.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.289+0000 7f4d6fe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7006ec80 0x7f4d7009d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.290+0000 7f4d6fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d700ae1c0 0x7f4d700cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.290+0000 7f4d6fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d7015b140 0x7f4d7006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.290+0000 7f4d6fe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7015b520 con 0x7f4d700ae1c0 2024-03-30T13:13:16.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.290+0000 7f4d6fe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4d700af580 con 0x7f4d7015b140 2024-03-30T13:13:16.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.290+0000 7f4d6fe00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4d700ae650 con 0x7f4d7006ec80 2024-03-30T13:13:16.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.290+0000 7f4d66000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d700ae1c0 0x7f4d700cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.290+0000 7f4d66000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d700ae1c0 0x7f4d700cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48110/0 (socket says 172.21.15.99:48110) 2024-03-30T13:13:16.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.290+0000 7f4d66000640 1 -- 172.21.15.99:0/1268961180 learned_addr learned my addr 172.21.15.99:0/1268961180 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.290+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7006ec80 0x7f4d7009d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.290+0000 7f4d6f400640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d7015b140 0x7f4d7006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.290+0000 7f4d66000640 1 -- 172.21.15.99:0/1268961180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7006ec80 msgr2=0x7f4d7009d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.291+0000 7f4d66000640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7006ec80 0x7f4d7009d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.291+0000 7f4d66000640 1 -- 172.21.15.99:0/1268961180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d7015b140 msgr2=0x7f4d7006d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.291+0000 7f4d66000640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d7015b140 0x7f4d7006d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.291+0000 7f4d66000640 1 -- 172.21.15.99:0/1268961180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d700cd680 con 0x7f4d700ae1c0 2024-03-30T13:13:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.291+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7006ec80 0x7f4d7009d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.291+0000 7f4d66000640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d700ae1c0 0x7f4d700cd140 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800e990 tx=0x7f4d5800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.291+0000 7f4d67e00640 1 -- 172.21.15.99:0/1268961180 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58017070 con 0x7f4d700ae1c0 2024-03-30T13:13:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.291+0000 7f4d67e00640 1 -- 172.21.15.99:0/1268961180 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5800c9e0 con 0x7f4d700ae1c0 2024-03-30T13:13:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.291+0000 7f4d67e00640 1 -- 172.21.15.99:0/1268961180 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5800cdb0 con 0x7f4d700ae1c0 2024-03-30T13:13:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.291+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1268961180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7009dbf0 con 0x7f4d700ae1c0 2024-03-30T13:13:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.291+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1268961180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d700cdf80 con 0x7f4d700ae1c0 2024-03-30T13:13:16.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.294+0000 7f4d67e00640 1 -- 172.21.15.99:0/1268961180 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4d5801a070 con 0x7f4d700ae1c0 2024-03-30T13:13:16.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.294+0000 7f4d67e00640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d4c06c530 0x7f4d4c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.295+0000 7f4d67e00640 1 -- 172.21.15.99:0/1268961180 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4d5808b710 con 0x7f4d700ae1c0 2024-03-30T13:13:16.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.295+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d4c06c530 0x7f4d4c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.295+0000 7f4d789fc740 1 Processor -- start 2024-03-30T13:13:16.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.296+0000 7f4d789fc740 1 -- start start 2024-03-30T13:13:16.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.296+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d4c06c530 0x7f4d4c06e9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4d60036000 tx=0x7f4d6003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.296+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734a91880 0x564734ab83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734ab88f0 0x564734a908c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 0x564734a90e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d789fc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5647349f0330 con 0x564734ab88f0 2024-03-30T13:13:16.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d789fc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564734998620 con 0x564734a91c60 2024-03-30T13:13:16.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d789fc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5647349ec440 con 0x564734a91880 2024-03-30T13:13:16.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d66000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734ab88f0 0x564734a908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d66000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734ab88f0 0x564734a908c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48116/0 (socket says 172.21.15.99:48116) 2024-03-30T13:13:16.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d66000640 1 -- 172.21.15.99:0/981054429 learned_addr learned my addr 172.21.15.99:0/981054429 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/981054429 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734a91880 0x564734ab83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d6f400640 1 --2- 172.21.15.99:0/981054429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 0x564734a90e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d66000640 1 -- 172.21.15.99:0/981054429 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734a91880 msgr2=0x564734ab83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d66000640 1 --2- 172.21.15.99:0/981054429 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734a91880 0x564734ab83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d66000640 1 -- 172.21.15.99:0/981054429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 msgr2=0x564734a90e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d66000640 1 --2- 172.21.15.99:0/981054429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 0x564734a90e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d66000640 1 -- 172.21.15.99:0/981054429 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647347d0920 con 0x564734ab88f0 2024-03-30T13:13:16.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.297+0000 7f4d6f400640 1 --2- 172.21.15.99:0/981054429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 0x564734a90e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:16.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.298+0000 7f4d66000640 1 --2- 172.21.15.99:0/981054429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734ab88f0 0x564734a908c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4d58089a60 tx=0x7f4d58059510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64b8f3d5c29fdf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.298+0000 7f4d5f400640 1 -- 172.21.15.99:0/981054429 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d580620f0 con 0x564734ab88f0 2024-03-30T13:13:16.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.298+0000 7f4d5f400640 1 -- 172.21.15.99:0/981054429 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d580575b0 con 0x564734ab88f0 2024-03-30T13:13:16.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.298+0000 7f4d5f400640 1 -- 172.21.15.99:0/981054429 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58055b80 con 0x564734ab88f0 2024-03-30T13:13:16.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.298+0000 7f4d789fc740 1 -- 172.21.15.99:0/981054429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734ab88f0 msgr2=0x564734a908c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.298+0000 7f4d789fc740 1 --2- 172.21.15.99:0/981054429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734ab88f0 0x564734a908c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4d58089a60 tx=0x7f4d58059510 comp rx=0 tx=0).stop 2024-03-30T13:13:16.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.298+0000 7f4d789fc740 1 -- 172.21.15.99:0/981054429 shutdown_connections 2024-03-30T13:13:16.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.298+0000 7f4d789fc740 1 --2- 172.21.15.99:0/981054429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 0x564734a90e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.298+0000 7f4d789fc740 1 --2- 172.21.15.99:0/981054429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734ab88f0 0x564734a908c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.298+0000 7f4d789fc740 1 --2- 172.21.15.99:0/981054429 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734a91880 0x564734ab83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.299+0000 7f4d789fc740 1 -- 172.21.15.99:0/981054429 >> 172.21.15.99:0/981054429 conn(0x564734a53be0 msgr2=0x564734ad65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.299+0000 7f4d789fc740 1 -- 172.21.15.99:0/981054429 shutdown_connections 2024-03-30T13:13:16.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.299+0000 7f4d789fc740 1 -- 172.21.15.99:0/981054429 wait complete. 2024-03-30T13:13:16.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.299+0000 7f4d789fc740 1 -- start start 2024-03-30T13:13:16.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.299+0000 7f4d789fc740 1 Processor -- start 2024-03-30T13:13:16.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.300+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734aa4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.300+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734a91c60 0x564734ad9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.300+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734abf070 0x564734ada300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.300+0000 7f4d789fc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564734ab7f20 con 0x564734a91880 2024-03-30T13:13:16.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.300+0000 7f4d789fc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5647349ab9d0 con 0x564734abf070 2024-03-30T13:13:16.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.300+0000 7f4d789fc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x564734ab0ca0 con 0x564734a91c60 2024-03-30T13:13:16.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.300+0000 7f4d789fc740 10 client.0 _ll_register_callbacks cb 0x5647349e7fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:16.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d6ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734aa4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d6ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734aa4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48126/0 (socket says 172.21.15.99:48126) 2024-03-30T13:13:16.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d6ea00640 1 -- 172.21.15.99:0/3015493771 learned_addr learned my addr 172.21.15.99:0/3015493771 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d6f400640 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734abf070 0x564734ada300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d66000640 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734a91c60 0x564734ad9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d6ea00640 1 -- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734a91c60 msgr2=0x564734ad9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734a91c60 0x564734ad9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d6ea00640 1 -- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734abf070 msgr2=0x564734ada300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734abf070 0x564734ada300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d6ea00640 1 -- 172.21.15.99:0/3015493771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647346c4210 con 0x564734a91880 2024-03-30T13:13:16.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734aa4c80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009960 tx=0x7f4d6002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15138ea999a850c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.301+0000 7f4d57e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:16.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.302+0000 7f4d57e00640 1 -- 172.21.15.99:0/3015493771 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60034040 con 0x564734a91880 2024-03-30T13:13:16.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.302+0000 7f4d57e00640 1 -- 172.21.15.99:0/3015493771 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4d60039860 con 0x564734a91880 2024-03-30T13:13:16.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.302+0000 7f4d789fc740 1 -- 172.21.15.99:0/3015493771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d580575b0 con 0x564734a91880 2024-03-30T13:13:16.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.302+0000 7f4d57e00640 1 -- 172.21.15.99:0/3015493771 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4d60039a60 con 0x564734a91880 2024-03-30T13:13:16.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.302+0000 7f4d789fc740 10 client.5673 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:16.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.302+0000 7f4d789fc740 1 -- 172.21.15.99:0/3015493771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5647348310b0 con 0x564734a91880 2024-03-30T13:13:16.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.302+0000 7f4d57e00640 1 -- 172.21.15.99:0/3015493771 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d580575b0 con 0x564734a91880 2024-03-30T13:13:16.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.302+0000 7f4d57e00640 1 -- 172.21.15.99:0/3015493771 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4d60060080 con 0x564734a91880 2024-03-30T13:13:16.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.302+0000 7f4d789fc740 10 client.5673 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:16.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.302+0000 7f4d789fc740 10 client.5673 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:16.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.302+0000 7f4d789fc740 20 client.5673 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.303+0000 7f4d789fc740 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564734abc9d0 0x564734abce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.303+0000 7f4d789fc740 4 client.5673 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.303+0000 7f4d789fc740 1 -- 172.21.15.99:0/3015493771 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647349fd870 con 0x564734abc9d0 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.303+0000 7f4d66000640 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564734abc9d0 0x564734abce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.304+0000 7f4d66000640 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564734abc9d0 0x564734abce00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c40871547c72597f server_cookie=b84321769d8a19f3 in_seq=0 out_seq=0 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.304+0000 7f4d57e00640 10 client.5673 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.306+0000 7f4d57e00640 1 -- 172.21.15.99:0/3015493771 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5647349fd870 con 0x564734abc9d0 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.306+0000 7f4d57e00640 10 client.5673 handle_command_reply: tid=0 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.306+0000 7f4d789fc740 1 client.5673 shutdown 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.306+0000 7f4d789fc740 1 -- 172.21.15.99:0/3015493771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 msgr2=0x564734aa4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.306+0000 7f4d789fc740 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734aa4c80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009960 tx=0x7f4d6002e000 comp rx=0 tx=0).stop 2024-03-30T13:13:16.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.307+0000 7f4d789fc740 1 -- 172.21.15.99:0/3015493771 shutdown_connections 2024-03-30T13:13:16.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.307+0000 7f4d789fc740 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564734abc9d0 0x564734abce00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.307+0000 7f4d789fc740 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734abf070 0x564734ada300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.307+0000 7f4d789fc740 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734a91c60 0x564734ad9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.307+0000 7f4d57e00640 0 client.5673 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.307+0000 7f4d789fc740 1 --2- 172.21.15.99:0/3015493771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734aa4c80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.307+0000 7f4d789fc740 1 -- 172.21.15.99:0/3015493771 >> 172.21.15.99:0/3015493771 conn(0x564734a53be0 msgr2=0x564734a86b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.307+0000 7f4d789fc740 1 -- 172.21.15.99:0/3015493771 shutdown_connections 2024-03-30T13:13:16.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.307+0000 7f4d789fc740 1 -- 172.21.15.99:0/3015493771 wait complete. 2024-03-30T13:13:16.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.307+0000 7f4d789fc740 20 client.5673 trim_cache size 0 max 16384 2024-03-30T13:13:16.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.323+0000 7f4d789fc740 1 Processor -- start 2024-03-30T13:13:16.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.323+0000 7f4d789fc740 1 -- start start 2024-03-30T13:13:16.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91880 0x564734ab63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91c60 0x564734a90550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734abf070 0x564734a90a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d789fc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4d700cf070 con 0x564734a91c60 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d789fc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4d70168730 con 0x564734a91880 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d789fc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4d701f6ad0 con 0x564734abf070 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d66000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91c60 0x564734a90550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d66000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91c60 0x564734a90550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48136/0 (socket says 172.21.15.99:48136) 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d66000640 1 -- 172.21.15.99:0/170705432 learned_addr learned my addr 172.21.15.99:0/170705432 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d66000640 1 -- 172.21.15.99:0/170705432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734abf070 msgr2=0x564734a90a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d66000640 1 --2- 172.21.15.99:0/170705432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734abf070 0x564734a90a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d66000640 1 -- 172.21.15.99:0/170705432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91880 msgr2=0x564734ab63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d66000640 1 --2- 172.21.15.99:0/170705432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91880 0x564734ab63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.324+0000 7f4d66000640 1 -- 172.21.15.99:0/170705432 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473469d2d0 con 0x564734a91c60 2024-03-30T13:13:16.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.325+0000 7f4d66000640 1 --2- 172.21.15.99:0/170705432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91c60 0x564734a90550 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800e960 tx=0x7f4d5808b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7808ed7f4452f91 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.325+0000 7f4d5ea00640 1 -- 172.21.15.99:0/170705432 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58071040 con 0x564734a91c60 2024-03-30T13:13:16.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.325+0000 7f4d5ea00640 1 -- 172.21.15.99:0/170705432 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d58057810 con 0x564734a91c60 2024-03-30T13:13:16.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.325+0000 7f4d5ea00640 1 -- 172.21.15.99:0/170705432 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58058960 con 0x564734a91c60 2024-03-30T13:13:16.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.325+0000 7f4d789fc740 1 -- 172.21.15.99:0/170705432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91c60 msgr2=0x564734a90550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.325+0000 7f4d789fc740 1 --2- 172.21.15.99:0/170705432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91c60 0x564734a90550 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800e960 tx=0x7f4d5808b000 comp rx=0 tx=0).stop 2024-03-30T13:13:16.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.326+0000 7f4d789fc740 1 -- 172.21.15.99:0/170705432 shutdown_connections 2024-03-30T13:13:16.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.326+0000 7f4d789fc740 1 --2- 172.21.15.99:0/170705432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734abf070 0x564734a90a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.326+0000 7f4d789fc740 1 --2- 172.21.15.99:0/170705432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91c60 0x564734a90550 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.326+0000 7f4d789fc740 1 --2- 172.21.15.99:0/170705432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91880 0x564734ab63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.326+0000 7f4d789fc740 1 -- 172.21.15.99:0/170705432 >> 172.21.15.99:0/170705432 conn(0x564734a53be0 msgr2=0x564734ab7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.326+0000 7f4d789fc740 1 -- 172.21.15.99:0/170705432 shutdown_connections 2024-03-30T13:13:16.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.326+0000 7f4d789fc740 1 -- 172.21.15.99:0/170705432 wait complete. 2024-03-30T13:13:16.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.326+0000 7f4d789fc740 1 -- start start 2024-03-30T13:13:16.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.327+0000 7f4d789fc740 1 Processor -- start 2024-03-30T13:13:16.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.327+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734b53a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.327+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 0x564734aa3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.327+0000 7f4d789fc740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734abf070 0x564734aa3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.327+0000 7f4d789fc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4d701680c0 con 0x564734a91880 2024-03-30T13:13:16.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.327+0000 7f4d789fc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564734a8cad0 con 0x564734a91c60 2024-03-30T13:13:16.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.327+0000 7f4d789fc740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x564734ad92d0 con 0x564734abf070 2024-03-30T13:13:16.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d789fc740 10 client.0 _ll_register_callbacks cb 0x7f4d58009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:16.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d6ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734b53a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d6ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734b53a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48146/0 (socket says 172.21.15.99:48146) 2024-03-30T13:13:16.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d6ea00640 1 -- 172.21.15.99:0/1900788621 learned_addr learned my addr 172.21.15.99:0/1900788621 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d6ea00640 1 -- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734abf070 msgr2=0x564734aa3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d66000640 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 0x564734aa3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d6f400640 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734abf070 0x564734aa3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734abf070 0x564734aa3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d6ea00640 1 -- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 msgr2=0x564734aa3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 0x564734aa3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d6ea00640 1 -- 172.21.15.99:0/1900788621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564734b572e0 con 0x564734a91880 2024-03-30T13:13:16.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.328+0000 7f4d66000640 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 0x564734aa3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:16.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.329+0000 7f4d6ea00640 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734b53a20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4d6002b9c0 tx=0x7f4d600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35da0ef826e7d07 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.329+0000 7f4d57e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:16.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.329+0000 7f4d57e00640 1 -- 172.21.15.99:0/1900788621 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60034040 con 0x564734a91880 2024-03-30T13:13:16.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.329+0000 7f4d57e00640 1 -- 172.21.15.99:0/1900788621 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4d6004f920 con 0x564734a91880 2024-03-30T13:13:16.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.329+0000 7f4d789fc740 1 -- 172.21.15.99:0/1900788621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d58057810 con 0x564734a91880 2024-03-30T13:13:16.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.329+0000 7f4d57e00640 1 -- 172.21.15.99:0/1900788621 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4d60044cd0 con 0x564734a91880 2024-03-30T13:13:16.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.329+0000 7f4d789fc740 10 client.5679 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:16.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.329+0000 7f4d789fc740 1 -- 172.21.15.99:0/1900788621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x564734abba30 con 0x564734a91880 2024-03-30T13:13:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.330+0000 7f4d57e00640 1 -- 172.21.15.99:0/1900788621 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d58057810 con 0x564734a91880 2024-03-30T13:13:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.330+0000 7f4d57e00640 1 -- 172.21.15.99:0/1900788621 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4d6004fb40 con 0x564734a91880 2024-03-30T13:13:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.330+0000 7f4d789fc740 10 client.5679 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.330+0000 7f4d789fc740 10 client.5679 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.330+0000 7f4d789fc740 20 client.5679 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.330+0000 7f4d789fc740 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564734abcf40 0x564734aba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.330+0000 7f4d789fc740 4 client.5679 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628341}] 2024-03-30T13:13:16.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.330+0000 7f4d789fc740 1 -- 172.21.15.99:0/1900788621 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628341}) -- 0x5647349f7bc0 con 0x564734abcf40 2024-03-30T13:13:16.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.330+0000 7f4d66000640 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564734abcf40 0x564734aba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.331+0000 7f4d66000640 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564734abcf40 0x564734aba6a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12af47ae985958c2 server_cookie=f531f0b86ea1cc7a in_seq=0 out_seq=0 2024-03-30T13:13:16.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.331+0000 7f4d57e00640 10 client.5679 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d57e00640 1 -- 172.21.15.99:0/1900788621 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3979 (crc 0 0 0) 0x5647349f7bc0 con 0x564734abcf40 2024-03-30T13:13:16.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d57e00640 10 client.5679 handle_command_reply: tid=0 2024-03-30T13:13:16.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d789fc740 1 client.5679 shutdown 2024-03-30T13:13:16.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d789fc740 1 -- 172.21.15.99:0/1900788621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 msgr2=0x564734b53a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d789fc740 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734b53a20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4d6002b9c0 tx=0x7f4d600046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d789fc740 1 -- 172.21.15.99:0/1900788621 shutdown_connections 2024-03-30T13:13:16.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d789fc740 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564734abf070 0x564734aa3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d789fc740 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564734abcf40 0x564734aba6a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d789fc740 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564734a91c60 0x564734aa3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d789fc740 1 --2- 172.21.15.99:0/1900788621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564734a91880 0x564734b53a20 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d57e00640 0 client.5679 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.332+0000 7f4d789fc740 1 -- 172.21.15.99:0/1900788621 >> 172.21.15.99:0/1900788621 conn(0x564734a53be0 msgr2=0x564734ad3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.333+0000 7f4d789fc740 1 -- 172.21.15.99:0/1900788621 shutdown_connections 2024-03-30T13:13:16.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.333+0000 7f4d789fc740 1 -- 172.21.15.99:0/1900788621 wait complete. 2024-03-30T13:13:16.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.333+0000 7f4d789fc740 20 client.5679 trim_cache size 0 max 16384 2024-03-30T13:13:16.345 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:16.345 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debug.h", 2024-03-30T13:13:16.345 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628341, 2024-03-30T13:13:16.345 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:16.345 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.462131+0000", 2024-03-30T13:13:16.345 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.676952+0000", 2024-03-30T13:13:16.345 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:16.345 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:16.345 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:16.346 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2579, 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.676952+0000", 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 4, 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:16.347 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2579, 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:16.348 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.462131+0000" 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2579, 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.462131+0000" 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 206, 2024-03-30T13:13:16.349 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 28, 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.508729+0000", 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 60, 2024-03-30T13:13:16.350 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:16.351 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:16.352 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.353 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:16.354 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:16.355 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:16.356 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.357 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:16.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:16.357 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:16.357 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:16.357 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:16.357 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:16.357 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:16.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:16.357 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.357 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:16.357 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:16.358 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:16.358 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:16.358 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.333+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1268961180 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d4c06c530 msgr2=0x7f4d4c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.333+0000 7f4d6fe00640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d4c06c530 0x7f4d4c06e9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4d60036000 tx=0x7f4d6003b040 comp rx=0 tx=0).stop 2024-03-30T13:13:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.333+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1268961180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d700ae1c0 msgr2=0x7f4d700cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.333+0000 7f4d6fe00640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d700ae1c0 0x7f4d700cd140 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800e990 tx=0x7f4d5800ee50 comp rx=0 tx=0).stop 2024-03-30T13:13:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.333+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1268961180 shutdown_connections 2024-03-30T13:13:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.333+0000 7f4d6fe00640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4d4c06c530 0x7f4d4c06e9f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.333+0000 7f4d6fe00640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d7015b140 0x7f4d7006d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.334+0000 7f4d6fe00640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d700ae1c0 0x7f4d700cd140 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.334+0000 7f4d6fe00640 1 --2- 172.21.15.99:0/1268961180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d7006ec80 0x7f4d7009d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.334+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1268961180 >> 172.21.15.99:0/1268961180 conn(0x7f4d7006bb40 msgr2=0x7f4d700b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.334+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1268961180 shutdown_connections 2024-03-30T13:13:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.334+0000 7f4d6fe00640 1 -- 172.21.15.99:0/1268961180 wait complete. 2024-03-30T13:13:16.361 DEBUG:tasks.cephfs.test_uninlining:getting inode info #16 of 23:1099511628348 2024-03-30T13:13:16.362 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628348 2024-03-30T13:13:16.362 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628348 2024-03-30T13:13:16.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.572+0000 7f4ab0200640 1 Processor -- start 2024-03-30T13:13:16.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.573+0000 7f4ab0200640 1 -- start start 2024-03-30T13:13:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.574+0000 7f4ab0200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4aa815b3d0 0x7f4aa80ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.574+0000 7f4ab0200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4aa80b28c0 0x7f4aa80b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.574+0000 7f4ab0200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aa80c6470 con 0x7f4aa80b49f0 2024-03-30T13:13:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.574+0000 7f4ab0200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4aa80c6240 con 0x7f4aa80b28c0 2024-03-30T13:13:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.574+0000 7f4ab0200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4aa80c7080 con 0x7f4aa815b3d0 2024-03-30T13:13:16.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.574+0000 7f4aae200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4aa80b28c0 0x7f4aa80b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.574+0000 7f4aae200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4aa80b28c0 0x7f4aa80b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48162/0 (socket says 172.21.15.99:48162) 2024-03-30T13:13:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.574+0000 7f4aae200640 1 -- 172.21.15.99:0/2056262491 learned_addr learned my addr 172.21.15.99:0/2056262491 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.575+0000 7f4aad800640 1 --2- 172.21.15.99:0/2056262491 >> v2:172.21.15.181:3300/0 conn(0x7f4aa815b3d0 0x7f4aa80ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.575+0000 7f4aae200640 1 -- 172.21.15.99:0/2056262491 >> v2:172.21.15.181:3300/0 conn(0x7f4aa815b3d0 msgr2=0x7f4aa80ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.575+0000 7f4aae200640 1 --2- 172.21.15.99:0/2056262491 >> v2:172.21.15.181:3300/0 conn(0x7f4aa815b3d0 0x7f4aa80ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.575+0000 7f4aae200640 1 -- 172.21.15.99:0/2056262491 >> v1:172.21.15.181:6789/0 conn(0x7f4aa80b49f0 legacy=0x7f4aa80b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.575+0000 7f4aae200640 1 -- 172.21.15.99:0/2056262491 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa80c6750 con 0x7f4aa80b28c0 2024-03-30T13:13:16.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.576+0000 7f4aae200640 1 --2- 172.21.15.99:0/2056262491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa80b28c0 0x7f4aa80b4e80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4aa80b2ee0 tx=0x7f4aa002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0fc4fd9a5e0cd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.576+0000 7f4aa7e00640 1 -- 172.21.15.99:0/2056262491 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa002ca80 con 0x7f4aa80b28c0 2024-03-30T13:13:16.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.576+0000 7f4aa7e00640 1 -- 172.21.15.99:0/2056262491 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa002cc20 con 0x7f4aa80b28c0 2024-03-30T13:13:16.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.576+0000 7f4aa7e00640 1 -- 172.21.15.99:0/2056262491 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00343f0 con 0x7f4aa80b28c0 2024-03-30T13:13:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.577+0000 7f4ab0200640 1 -- 172.21.15.99:0/2056262491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa80b28c0 msgr2=0x7f4aa80b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.577+0000 7f4ab0200640 1 --2- 172.21.15.99:0/2056262491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa80b28c0 0x7f4aa80b4e80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4aa80b2ee0 tx=0x7f4aa002bee0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.577+0000 7f4ab0200640 1 -- 172.21.15.99:0/2056262491 shutdown_connections 2024-03-30T13:13:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.577+0000 7f4ab0200640 1 --2- 172.21.15.99:0/2056262491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa80b28c0 0x7f4aa80b4e80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.577+0000 7f4ab0200640 1 --2- 172.21.15.99:0/2056262491 >> v2:172.21.15.181:3300/0 conn(0x7f4aa815b3d0 0x7f4aa80ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.577+0000 7f4ab0200640 1 -- 172.21.15.99:0/2056262491 >> 172.21.15.99:0/2056262491 conn(0x7f4aa80d0450 msgr2=0x7f4aa80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.577+0000 7f4ab0200640 1 -- 172.21.15.99:0/2056262491 shutdown_connections 2024-03-30T13:13:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.577+0000 7f4ab0200640 1 -- 172.21.15.99:0/2056262491 wait complete. 2024-03-30T13:13:16.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.579+0000 7f4ab0200640 1 Processor -- start 2024-03-30T13:13:16.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.579+0000 7f4ab0200640 1 -- start start 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.580+0000 7f4ab0200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa80b28c0 0x7f4aa814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.580+0000 7f4ab0200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa80b49f0 0x7f4aa814e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.580+0000 7f4ab0200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aa815b3d0 0x7f4aa806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.580+0000 7f4ab0200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa815b7b0 con 0x7f4aa80b28c0 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.580+0000 7f4ab0200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa80c6d10 con 0x7f4aa80b49f0 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.580+0000 7f4ab0200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa815b930 con 0x7f4aa815b3d0 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.580+0000 7f4aad800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa80b28c0 0x7f4aa814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.580+0000 7f4aad800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa80b28c0 0x7f4aa814fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48170/0 (socket says 172.21.15.99:48170) 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.580+0000 7f4aad800640 1 -- 172.21.15.99:0/1638101921 learned_addr learned my addr 172.21.15.99:0/1638101921 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4aad800640 1 -- 172.21.15.99:0/1638101921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aa815b3d0 msgr2=0x7f4aa806eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4aad800640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aa815b3d0 0x7f4aa806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4aace00640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa80b49f0 0x7f4aa814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4aad800640 1 -- 172.21.15.99:0/1638101921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa80b49f0 msgr2=0x7f4aa814e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4aad800640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa80b49f0 0x7f4aa814e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4aad800640 1 -- 172.21.15.99:0/1638101921 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa81f8710 con 0x7f4aa80b28c0 2024-03-30T13:13:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4aace00640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa80b49f0 0x7f4aa814e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4aad800640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa80b28c0 0x7f4aa814fee0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c7f0 tx=0x7f4a9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4aa5600640 1 -- 172.21.15.99:0/1638101921 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98015070 con 0x7f4aa80b28c0 2024-03-30T13:13:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4aa5600640 1 -- 172.21.15.99:0/1638101921 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a98004240 con 0x7f4aa80b28c0 2024-03-30T13:13:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4aa5600640 1 -- 172.21.15.99:0/1638101921 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98007620 con 0x7f4aa80b28c0 2024-03-30T13:13:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4ab0200640 1 -- 172.21.15.99:0/1638101921 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa814f120 con 0x7f4aa80b28c0 2024-03-30T13:13:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.581+0000 7f4ab0200640 1 -- 172.21.15.99:0/1638101921 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa814f6e0 con 0x7f4aa80b28c0 2024-03-30T13:13:16.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.583+0000 7f4aa5600640 1 -- 172.21.15.99:0/1638101921 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4a980079d0 con 0x7f4aa80b28c0 2024-03-30T13:13:16.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.584+0000 7f4aa5600640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4a8806c530 0x7f4a8806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.584+0000 7f4aa5600640 1 -- 172.21.15.99:0/1638101921 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4a9808b8f0 con 0x7f4aa80b28c0 2024-03-30T13:13:16.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.585+0000 7f4aace00640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4a8806c530 0x7f4a8806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.585+0000 7f4ab2fd5740 1 Processor -- start 2024-03-30T13:13:16.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.585+0000 7f4ab2fd5740 1 -- start start 2024-03-30T13:13:16.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.585+0000 7f4aace00640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4a8806c530 0x7f4a8806e9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4aa80addc0 tx=0x7f4a94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.586+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4290 0x55c862d0adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.586+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862d0b300 0x55c862ce32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.586+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862ce4670 0x55c862ce3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.586+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c862c47330 con 0x55c862d0b300 2024-03-30T13:13:16.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.586+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c862bef620 con 0x55c862ce4290 2024-03-30T13:13:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.586+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55c862c43440 con 0x55c862ce4670 2024-03-30T13:13:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.586+0000 7f4aace00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862d0b300 0x55c862ce32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.587+0000 7f4aace00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862d0b300 0x55c862ce32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48176/0 (socket says 172.21.15.99:48176) 2024-03-30T13:13:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.587+0000 7f4aace00640 1 -- 172.21.15.99:0/2789528392 learned_addr learned my addr 172.21.15.99:0/2789528392 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.587+0000 7f4aae200640 1 --2- 172.21.15.99:0/2789528392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862ce4670 0x55c862ce3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.587+0000 7f4aace00640 1 -- 172.21.15.99:0/2789528392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862ce4670 msgr2=0x55c862ce3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.587+0000 7f4aace00640 1 --2- 172.21.15.99:0/2789528392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862ce4670 0x55c862ce3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.587+0000 7f4aad800640 1 --2- 172.21.15.99:0/2789528392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4290 0x55c862d0adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.587+0000 7f4aace00640 1 -- 172.21.15.99:0/2789528392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4290 msgr2=0x55c862d0adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.587+0000 7f4aace00640 1 --2- 172.21.15.99:0/2789528392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4290 0x55c862d0adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.587+0000 7f4aace00640 1 -- 172.21.15.99:0/2789528392 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c862a27920 con 0x55c862d0b300 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.587+0000 7f4aace00640 1 --2- 172.21.15.99:0/2789528392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862d0b300 0x55c862ce32d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400da30 tx=0x7f4a94010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af6ef8947f507f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.587+0000 7f4a9e000640 1 -- 172.21.15.99:0/2789528392 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94024070 con 0x55c862d0b300 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.588+0000 7f4a9e000640 1 -- 172.21.15.99:0/2789528392 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a940149a0 con 0x55c862d0b300 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.588+0000 7f4a9e000640 1 -- 172.21.15.99:0/2789528392 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94014d90 con 0x55c862d0b300 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.588+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2789528392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862d0b300 msgr2=0x55c862ce32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.588+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2789528392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862d0b300 0x55c862ce32d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400da30 tx=0x7f4a94010000 comp rx=0 tx=0).stop 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.588+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2789528392 shutdown_connections 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.588+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2789528392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862ce4670 0x55c862ce3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.588+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2789528392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862d0b300 0x55c862ce32d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.588+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2789528392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4290 0x55c862d0adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.588+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2789528392 >> 172.21.15.99:0/2789528392 conn(0x55c862caabe0 msgr2=0x55c862d28fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.588+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2789528392 shutdown_connections 2024-03-30T13:13:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.588+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2789528392 wait complete. 2024-03-30T13:13:16.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.589+0000 7f4ab2fd5740 1 -- start start 2024-03-30T13:13:16.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.589+0000 7f4ab2fd5740 1 Processor -- start 2024-03-30T13:13:16.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.590+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4290 0x55c862d0f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.590+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4670 0x55c862d0f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.590+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862d029f0 0x55c862d20590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.590+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c862d0a930 con 0x55c862ce4670 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.590+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c862c029d0 con 0x55c862ce4290 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.590+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55c862d036b0 con 0x55c862d029f0 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.590+0000 7f4ab2fd5740 10 client.0 _ll_register_callbacks cb 0x55c862c3efd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.591+0000 7f4aace00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4670 0x55c862d0f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.591+0000 7f4aace00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4670 0x55c862d0f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48182/0 (socket says 172.21.15.99:48182) 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.591+0000 7f4aace00640 1 -- 172.21.15.99:0/2357280785 learned_addr learned my addr 172.21.15.99:0/2357280785 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.591+0000 7f4aad800640 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4290 0x55c862d0f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.591+0000 7f4aae200640 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862d029f0 0x55c862d20590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.591+0000 7f4aace00640 1 -- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862d029f0 msgr2=0x55c862d20590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.591+0000 7f4aace00640 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862d029f0 0x55c862d20590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.591+0000 7f4aace00640 1 -- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4290 msgr2=0x55c862d0f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.591+0000 7f4aace00640 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4290 0x55c862d0f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.591+0000 7f4aace00640 1 -- 172.21.15.99:0/2357280785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c86291b210 con 0x55c862ce4670 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.592+0000 7f4aace00640 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4670 0x55c862d0f640 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4a94017040 tx=0x7f4a940036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78af9326bb44dae server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.592+0000 7f4a92a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.592+0000 7f4a92a00640 1 -- 172.21.15.99:0/2357280785 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94024040 con 0x55c862ce4670 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.592+0000 7f4a92a00640 1 -- 172.21.15.99:0/2357280785 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4a9402a730 con 0x55c862ce4670 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.592+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2357280785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a940149a0 con 0x55c862ce4670 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.592+0000 7f4a92a00640 1 -- 172.21.15.99:0/2357280785 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4a94037050 con 0x55c862ce4670 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.592+0000 7f4ab2fd5740 10 client.5691 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.592+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2357280785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55c862a880b0 con 0x55c862ce4670 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.592+0000 7f4a92a00640 1 -- 172.21.15.99:0/2357280785 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a940149a0 con 0x55c862ce4670 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.592+0000 7f4a92a00640 1 -- 172.21.15.99:0/2357280785 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4a9403a020 con 0x55c862ce4670 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.593+0000 7f4ab2fd5740 10 client.5691 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.593+0000 7f4ab2fd5740 10 client.5691 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.593+0000 7f4ab2fd5740 20 client.5691 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.593+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c862d446b0 0x55c862d46aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.593+0000 7f4ab2fd5740 4 client.5691 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:16.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.593+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2357280785 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c862c54870 con 0x55c862d446b0 2024-03-30T13:13:16.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.593+0000 7f4aad800640 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c862d446b0 0x55c862d46aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.594+0000 7f4aad800640 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c862d446b0 0x55c862d46aa0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eed4ca9aed33a8ec server_cookie=b62c06192fdb97ed in_seq=0 out_seq=0 2024-03-30T13:13:16.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.594+0000 7f4a92a00640 10 client.5691 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4a92a00640 1 -- 172.21.15.99:0/2357280785 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55c862c54870 con 0x55c862d446b0 2024-03-30T13:13:16.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4a92a00640 10 client.5691 handle_command_reply: tid=0 2024-03-30T13:13:16.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4ab2fd5740 1 client.5691 shutdown 2024-03-30T13:13:16.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2357280785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4670 msgr2=0x55c862d0f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4670 0x55c862d0f640 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4a94017040 tx=0x7f4a940036f0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2357280785 shutdown_connections 2024-03-30T13:13:16.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862d029f0 0x55c862d20590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4670 0x55c862d0f640 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c862d446b0 0x55c862d46aa0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2357280785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4290 0x55c862d0f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2357280785 >> 172.21.15.99:0/2357280785 conn(0x55c862caabe0 msgr2=0x55c862d0a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.596+0000 7f4a92a00640 0 client.5691 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.597+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2357280785 shutdown_connections 2024-03-30T13:13:16.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.597+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2357280785 wait complete. 2024-03-30T13:13:16.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.597+0000 7f4ab2fd5740 20 client.5691 trim_cache size 0 max 16384 2024-03-30T13:13:16.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.612+0000 7f4ab2fd5740 1 Processor -- start 2024-03-30T13:13:16.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.613+0000 7f4ab2fd5740 1 -- start start 2024-03-30T13:13:16.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.613+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862d11910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.613+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862ce4670 0x55c862d11e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.613+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862d029f0 0x55c862d0df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.613+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa8200e00 con 0x55c862ce4290 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.613+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa81ffe50 con 0x55c862d029f0 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.613+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa80b1b40 con 0x55c862ce4670 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.614+0000 7f4aad800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862d11910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.614+0000 7f4aad800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862d11910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48196/0 (socket says 172.21.15.99:48196) 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.614+0000 7f4aad800640 1 -- 172.21.15.99:0/1165815634 learned_addr learned my addr 172.21.15.99:0/1165815634 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.614+0000 7f4aace00640 1 --2- 172.21.15.99:0/1165815634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862ce4670 0x55c862d11e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.614+0000 7f4aad800640 1 -- 172.21.15.99:0/1165815634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862ce4670 msgr2=0x55c862d11e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.614+0000 7f4aad800640 1 --2- 172.21.15.99:0/1165815634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862ce4670 0x55c862d11e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.614+0000 7f4aad800640 1 -- 172.21.15.99:0/1165815634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862d029f0 msgr2=0x55c862d0df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.614+0000 7f4aad800640 1 --2- 172.21.15.99:0/1165815634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862d029f0 0x55c862d0df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.614+0000 7f4aad800640 1 -- 172.21.15.99:0/1165815634 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c862d20900 con 0x55c862ce4290 2024-03-30T13:13:16.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.614+0000 7f4aad800640 1 --2- 172.21.15.99:0/1165815634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862d11910 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4a98055b50 tx=0x7f4a98060040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd950e5eb3869e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.614+0000 7f4a9d600640 1 -- 172.21.15.99:0/1165815634 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9801e040 con 0x55c862ce4290 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.615+0000 7f4a9d600640 1 -- 172.21.15.99:0/1165815634 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a98076070 con 0x55c862ce4290 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.615+0000 7f4a9d600640 1 -- 172.21.15.99:0/1165815634 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a980622d0 con 0x55c862ce4290 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.615+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/1165815634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 msgr2=0x55c862d11910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.615+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/1165815634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862d11910 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4a98055b50 tx=0x7f4a98060040 comp rx=0 tx=0).stop 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.615+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/1165815634 shutdown_connections 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.615+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/1165815634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862d029f0 0x55c862d0df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.615+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/1165815634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862ce4670 0x55c862d11e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.615+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/1165815634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862d11910 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.615+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/1165815634 >> 172.21.15.99:0/1165815634 conn(0x55c862caabe0 msgr2=0x55c862cdf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.615+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/1165815634 shutdown_connections 2024-03-30T13:13:16.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.615+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/1165815634 wait complete. 2024-03-30T13:13:16.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.616+0000 7f4ab2fd5740 1 -- start start 2024-03-30T13:13:16.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.616+0000 7f4ab2fd5740 1 Processor -- start 2024-03-30T13:13:16.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.617+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862da1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.617+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4670 0x55c862d006b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.617+0000 7f4ab2fd5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862d029f0 0x55c862d11e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.617+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c862d2a8d0 con 0x55c862ce4290 2024-03-30T13:13:16.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.617+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa80c7e50 con 0x55c862ce4670 2024-03-30T13:13:16.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.617+0000 7f4ab2fd5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55c862d11610 con 0x55c862d029f0 2024-03-30T13:13:16.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.617+0000 7f4ab2fd5740 10 client.0 _ll_register_callbacks cb 0x7f4a94022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:16.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.617+0000 7f4aad800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862da1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.617+0000 7f4aad800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862da1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48200/0 (socket says 172.21.15.99:48200) 2024-03-30T13:13:16.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.617+0000 7f4aad800640 1 -- 172.21.15.99:0/2560925180 learned_addr learned my addr 172.21.15.99:0/2560925180 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4aad800640 1 -- 172.21.15.99:0/2560925180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862d029f0 msgr2=0x55c862d11e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4aad800640 1 --2- 172.21.15.99:0/2560925180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862d029f0 0x55c862d11e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4aad800640 1 -- 172.21.15.99:0/2560925180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4670 msgr2=0x55c862d006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4aad800640 1 --2- 172.21.15.99:0/2560925180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4670 0x55c862d006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4aad800640 1 -- 172.21.15.99:0/2560925180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8628f42d0 con 0x55c862ce4290 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4aad800640 1 --2- 172.21.15.99:0/2560925180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862da1c30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4a98055b50 tx=0x7f4a9806f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef06c77990341ad server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4a92a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4a92a00640 1 -- 172.21.15.99:0/2560925180 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98088060 con 0x55c862ce4290 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4a92a00640 1 -- 172.21.15.99:0/2560925180 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4a98089930 con 0x55c862ce4290 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2560925180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a98076070 con 0x55c862ce4290 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4a92a00640 1 -- 172.21.15.99:0/2560925180 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4a9801e070 con 0x55c862ce4290 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4ab2fd5740 10 client.5697 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.618+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2560925180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55c862cfff10 con 0x55c862ce4290 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.619+0000 7f4a92a00640 1 -- 172.21.15.99:0/2560925180 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a98076070 con 0x55c862ce4290 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.619+0000 7f4a92a00640 1 -- 172.21.15.99:0/2560925180 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4a98071ce0 con 0x55c862ce4290 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.619+0000 7f4ab2fd5740 10 client.5697 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.619+0000 7f4ab2fd5740 10 client.5697 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:16.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.619+0000 7f4ab2fd5740 20 client.5697 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:16.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.619+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2560925180 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c862da45e0 0x55c862da4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.619+0000 7f4ab2fd5740 4 client.5697 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628348}] 2024-03-30T13:13:16.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.619+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2560925180 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628348}) -- 0x55c862c4ebc0 con 0x55c862da45e0 2024-03-30T13:13:16.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.619+0000 7f4aace00640 1 --2- 172.21.15.99:0/2560925180 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c862da45e0 0x55c862da4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.620+0000 7f4aace00640 1 --2- 172.21.15.99:0/2560925180 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c862da45e0 0x55c862da4a10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dc890b35e07673e server_cookie=3829ee87b12f4839 in_seq=0 out_seq=0 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.620+0000 7f4a92a00640 10 client.5697 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4a92a00640 1 -- 172.21.15.99:0/2560925180 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3973 (crc 0 0 0) 0x55c862c4ebc0 con 0x55c862da45e0 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4a92a00640 10 client.5697 handle_command_reply: tid=0 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4ab2fd5740 1 client.5697 shutdown 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2560925180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 msgr2=0x55c862da1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2560925180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862da1c30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4a98055b50 tx=0x7f4a9806f040 comp rx=0 tx=0).stop 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2560925180 shutdown_connections 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2560925180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c862d029f0 0x55c862d11e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2560925180 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c862da45e0 0x55c862da4a10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2560925180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c862ce4670 0x55c862d006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4ab2fd5740 1 --2- 172.21.15.99:0/2560925180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c862ce4290 0x55c862da1c30 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2560925180 >> 172.21.15.99:0/2560925180 conn(0x55c862caabe0 msgr2=0x55c862d255a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4a92a00640 0 client.5697 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.621+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2560925180 shutdown_connections 2024-03-30T13:13:16.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab2fd5740 1 -- 172.21.15.99:0/2560925180 wait complete. 2024-03-30T13:13:16.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab2fd5740 20 client.5697 trim_cache size 0 max 16384 2024-03-30T13:13:16.629 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:16.629 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-sysfs.h", 2024-03-30T13:13:16.629 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628348, 2024-03-30T13:13:16.629 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:16.629 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.467360+0000", 2024-03-30T13:13:16.629 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.695951+0000", 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:16.630 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 77, 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.695951+0000", 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:16.631 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 77, 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:16.632 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.467360+0000" 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 77, 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.467360+0000" 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 188, 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:16.633 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:16.634 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 42, 2024-03-30T13:13:16.634 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:16.634 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:16.634 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:16.634 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:16.634 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:16.634 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:16.634 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.513630+0000", 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 62, 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:16.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.636 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:16.636 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:16.636 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:16.636 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:16.636 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:16.636 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:16.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.636 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:16.636 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:16.636 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:16.637 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:16.637 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.637 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:16.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.637 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:16.637 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:16.637 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:16.637 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:16.637 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:16.637 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.638 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:16.639 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.640 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:16.641 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:16.642 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:16.642 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:16.642 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.642 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:16.642 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:16.642 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:16.642 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:16.642 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab0200640 1 -- 172.21.15.99:0/1638101921 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4a8806c530 msgr2=0x7f4a8806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab0200640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4a8806c530 0x7f4a8806e9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4aa80addc0 tx=0x7f4a94009040 comp rx=0 tx=0).stop 2024-03-30T13:13:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab0200640 1 -- 172.21.15.99:0/1638101921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa80b28c0 msgr2=0x7f4aa814fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab0200640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa80b28c0 0x7f4aa814fee0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c7f0 tx=0x7f4a9800ccb0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab0200640 1 -- 172.21.15.99:0/1638101921 shutdown_connections 2024-03-30T13:13:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab0200640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4a8806c530 0x7f4a8806e9f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab0200640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aa815b3d0 0x7f4aa806eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab0200640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa80b49f0 0x7f4aa814e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab0200640 1 --2- 172.21.15.99:0/1638101921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa80b28c0 0x7f4aa814fee0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab0200640 1 -- 172.21.15.99:0/1638101921 >> 172.21.15.99:0/1638101921 conn(0x7f4aa80d0450 msgr2=0x7f4aa80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.622+0000 7f4ab0200640 1 -- 172.21.15.99:0/1638101921 shutdown_connections 2024-03-30T13:13:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.623+0000 7f4ab0200640 1 -- 172.21.15.99:0/1638101921 wait complete. 2024-03-30T13:13:16.645 DEBUG:tasks.cephfs.test_uninlining:getting inode info #17 of 23:1099511628331 2024-03-30T13:13:16.645 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628331 2024-03-30T13:13:16.645 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628331 2024-03-30T13:13:16.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.838+0000 7f4ec4a00640 1 Processor -- start 2024-03-30T13:13:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.838+0000 7f4ec4a00640 1 -- start start 2024-03-30T13:13:16.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.840+0000 7f4ec4a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4ec00b2810 0x7f4ec00c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.840+0000 7f4ec4a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec00c6100 con 0x7f4ec015e970 2024-03-30T13:13:16.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.840+0000 7f4ec4a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec00cfc90 con 0x7f4ec015e590 2024-03-30T13:13:16.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.840+0000 7f4ec4a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4ec00cff70 con 0x7f4ec00b2810 2024-03-30T13:13:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.840+0000 7f4ebd400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4ec015e970 0x7f4ec00b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:41712/0 (socket says 172.21.15.99:41712) 2024-03-30T13:13:16.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.840+0000 7f4ebd400640 1 -- 172.21.15.99:0/731686050 learned_addr learned my addr 172.21.15.99:0/731686050 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebe800640 1 --2- 172.21.15.99:0/731686050 >> v2:172.21.15.181:3300/0 conn(0x7f4ec00b2810 0x7f4ec00c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317514163 0 0) 0x7f4ec00c6100 con 0x7f4ec015e970 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ea4003520 con 0x7f4ec015e970 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3280977083 0 0) 0x7f4ea4003520 con 0x7f4ec015e970 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 >> v2:172.21.15.181:3300/0 conn(0x7f4ec00b2810 msgr2=0x7f4ec00c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 --2- 172.21.15.99:0/731686050 >> v2:172.21.15.181:3300/0 conn(0x7f4ec00b2810 0x7f4ec00c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 >> v1:172.21.15.181:6789/0 conn(0x7f4ec015e590 legacy=0x7f4ec00cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec00c63c0 con 0x7f4ec015e970 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f4eb0001670 con 0x7f4ec015e970 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 >> v1:172.21.15.99:6789/0 conn(0x7f4ec015e970 legacy=0x7f4ec00b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 --2- 172.21.15.99:0/731686050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea40039b0 0x7f4ea4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 --2- 172.21.15.99:0/731686050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 0x7f4ea4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 --2- 172.21.15.99:0/731686050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea40051c0 0x7f4ea400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00cff70 con 0x7f4ea4004800 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea400c160 con 0x7f4ea40039b0 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.841+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea400c360 con 0x7f4ea40051c0 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.842+0000 7f4ebd400640 1 --2- 172.21.15.99:0/731686050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 0x7f4ea4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.842+0000 7f4ebe800640 1 --2- 172.21.15.99:0/731686050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea40051c0 0x7f4ea400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.842+0000 7f4ebde00640 1 --2- 172.21.15.99:0/731686050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea40039b0 0x7f4ea4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.842+0000 7f4ebd400640 1 -- 172.21.15.99:0/731686050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea40051c0 msgr2=0x7f4ea400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.842+0000 7f4ebd400640 1 --2- 172.21.15.99:0/731686050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea40051c0 0x7f4ea400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.842+0000 7f4ebd400640 1 -- 172.21.15.99:0/731686050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea40039b0 msgr2=0x7f4ea4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.842+0000 7f4ebd400640 1 --2- 172.21.15.99:0/731686050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea40039b0 0x7f4ea4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.842+0000 7f4ebd400640 1 -- 172.21.15.99:0/731686050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea4003520 con 0x7f4ea4004800 2024-03-30T13:13:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.842+0000 7f4ebe800640 1 -- 172.21.15.99:0/731686050 reap_dead start 2024-03-30T13:13:16.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.843+0000 7f4ebd400640 1 --2- 172.21.15.99:0/731686050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 0x7f4ea4004c80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000c210 tx=0x7f4ea4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d04ff6112247c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.843+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0007cf0 con 0x7f4ea4004800 2024-03-30T13:13:16.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.843+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb0030070 con 0x7f4ea4004800 2024-03-30T13:13:16.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.843+0000 7f4ebca00640 1 -- 172.21.15.99:0/731686050 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0005d70 con 0x7f4ea4004800 2024-03-30T13:13:16.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.844+0000 7f4ec4a00640 1 -- 172.21.15.99:0/731686050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 msgr2=0x7f4ea4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.844+0000 7f4ec4a00640 1 --2- 172.21.15.99:0/731686050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 0x7f4ea4004c80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000c210 tx=0x7f4ea4005830 comp rx=0 tx=0).stop 2024-03-30T13:13:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.844+0000 7f4ec4a00640 1 -- 172.21.15.99:0/731686050 shutdown_connections 2024-03-30T13:13:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.844+0000 7f4ec4a00640 1 --2- 172.21.15.99:0/731686050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 0x7f4ea4004c80 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.844+0000 7f4ec4a00640 1 -- 172.21.15.99:0/731686050 >> 172.21.15.99:0/731686050 conn(0x7f4ec00d0450 msgr2=0x7f4ec00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.844+0000 7f4ec4a00640 1 -- 172.21.15.99:0/731686050 shutdown_connections 2024-03-30T13:13:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.844+0000 7f4ec4a00640 1 -- 172.21.15.99:0/731686050 wait complete. 2024-03-30T13:13:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.846+0000 7f4ec4a00640 1 Processor -- start 2024-03-30T13:13:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.846+0000 7f4ec4a00640 1 -- start start 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.847+0000 7f4ec4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 0x7f4ec00c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.847+0000 7f4ec4a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ec015d570 0x7f4ec014a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.847+0000 7f4ec4a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ec00ca140 0x7f4ec014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.847+0000 7f4ec4a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00cca70 con 0x7f4ea4004800 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.847+0000 7f4ec4a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00cc8f0 con 0x7f4ec015d570 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.847+0000 7f4ec4a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec00c6bc0 con 0x7f4ec00ca140 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.847+0000 7f4ebde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 0x7f4ec00c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.847+0000 7f4ebde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 0x7f4ec00c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48226/0 (socket says 172.21.15.99:48226) 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.847+0000 7f4ebde00640 1 -- 172.21.15.99:0/3404938904 learned_addr learned my addr 172.21.15.99:0/3404938904 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.848+0000 7f4ebde00640 1 -- 172.21.15.99:0/3404938904 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ec00ca140 msgr2=0x7f4ec014a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.848+0000 7f4ebde00640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ec00ca140 0x7f4ec014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.848+0000 7f4ebde00640 1 -- 172.21.15.99:0/3404938904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ec015d570 msgr2=0x7f4ec014a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.848+0000 7f4ebde00640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ec015d570 0x7f4ec014a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.848+0000 7f4ebde00640 1 -- 172.21.15.99:0/3404938904 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec00c8b60 con 0x7f4ea4004800 2024-03-30T13:13:16.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.848+0000 7f4ebde00640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 0x7f4ec00c9c00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800e4d0 tx=0x7f4ea800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.848+0000 7f4eb6000640 1 -- 172.21.15.99:0/3404938904 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80052e0 con 0x7f4ea4004800 2024-03-30T13:13:16.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.848+0000 7f4eb6000640 1 -- 172.21.15.99:0/3404938904 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea8018070 con 0x7f4ea4004800 2024-03-30T13:13:16.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.848+0000 7f4eb6000640 1 -- 172.21.15.99:0/3404938904 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8003810 con 0x7f4ea4004800 2024-03-30T13:13:16.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.848+0000 7f4ec4a00640 1 -- 172.21.15.99:0/3404938904 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec00c8e40 con 0x7f4ea4004800 2024-03-30T13:13:16.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.848+0000 7f4ec4a00640 1 -- 172.21.15.99:0/3404938904 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec00c9400 con 0x7f4ea4004800 2024-03-30T13:13:16.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.851+0000 7f4eb6000640 1 -- 172.21.15.99:0/3404938904 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4ea80039b0 con 0x7f4ea4004800 2024-03-30T13:13:16.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.851+0000 7f4eb6000640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e9c06c530 0x7f4e9c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.852+0000 7f4eb6000640 1 -- 172.21.15.99:0/3404938904 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4ea808b4e0 con 0x7f4ea4004800 2024-03-30T13:13:16.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.852+0000 7f4ebd400640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e9c06c530 0x7f4e9c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.852+0000 7f4ec77e1740 1 Processor -- start 2024-03-30T13:13:16.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.852+0000 7f4ec77e1740 1 -- start start 2024-03-30T13:13:16.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.852+0000 7f4ebd400640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e9c06c530 0x7f4e9c06e9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0034000 tx=0x7f4eb002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.853+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99290 0x565135bbfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.853+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135bc0300 0x565135b982d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.853+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135b98810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.853+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x565135afc330 con 0x565135b99670 2024-03-30T13:13:16.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.853+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x565135aa4620 con 0x565135bc0300 2024-03-30T13:13:16.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.853+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x565135af8440 con 0x565135b99290 2024-03-30T13:13:16.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebe800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135b98810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebe800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135b98810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48234/0 (socket says 172.21.15.99:48234) 2024-03-30T13:13:16.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebe800640 1 -- 172.21.15.99:0/388427876 learned_addr learned my addr 172.21.15.99:0/388427876 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebde00640 1 --2- 172.21.15.99:0/388427876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99290 0x565135bbfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebd400640 1 --2- 172.21.15.99:0/388427876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135bc0300 0x565135b982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebe800640 1 -- 172.21.15.99:0/388427876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99290 msgr2=0x565135bbfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebe800640 1 --2- 172.21.15.99:0/388427876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99290 0x565135bbfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebe800640 1 -- 172.21.15.99:0/388427876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135bc0300 msgr2=0x565135b982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebe800640 1 --2- 172.21.15.99:0/388427876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135bc0300 0x565135b982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebe800640 1 -- 172.21.15.99:0/388427876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651358dc920 con 0x565135b99670 2024-03-30T13:13:16.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebd400640 1 --2- 172.21.15.99:0/388427876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135bc0300 0x565135b982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:16.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.854+0000 7f4ebe800640 1 --2- 172.21.15.99:0/388427876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135b98810 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4ec006fde0 tx=0x7f4eb8007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67162923a376c0bf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4eae600640 1 -- 172.21.15.99:0/388427876 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8003990 con 0x565135b99670 2024-03-30T13:13:16.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4eae600640 1 -- 172.21.15.99:0/388427876 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb8003b30 con 0x565135b99670 2024-03-30T13:13:16.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4eae600640 1 -- 172.21.15.99:0/388427876 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8004020 con 0x565135b99670 2024-03-30T13:13:16.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4ec77e1740 1 -- 172.21.15.99:0/388427876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 msgr2=0x565135b98810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/388427876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135b98810 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4ec006fde0 tx=0x7f4eb8007870 comp rx=0 tx=0).stop 2024-03-30T13:13:16.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4ec77e1740 1 -- 172.21.15.99:0/388427876 shutdown_connections 2024-03-30T13:13:16.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/388427876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135b98810 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/388427876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135bc0300 0x565135b982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/388427876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99290 0x565135bbfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4ec77e1740 1 -- 172.21.15.99:0/388427876 >> 172.21.15.99:0/388427876 conn(0x565135b5fbe0 msgr2=0x565135bddfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4ec77e1740 1 -- 172.21.15.99:0/388427876 shutdown_connections 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.855+0000 7f4ec77e1740 1 -- 172.21.15.99:0/388427876 wait complete. 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.856+0000 7f4ec77e1740 1 -- start start 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.856+0000 7f4ec77e1740 1 Processor -- start 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.857+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99290 0x565135bdcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.857+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99670 0x565135bdc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.857+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bc5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.857+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x565135bbf930 con 0x565135bb6f30 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.857+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x565135ab79d0 con 0x565135b99670 2024-03-30T13:13:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.857+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x565135bb86b0 con 0x565135b99290 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ec77e1740 10 client.0 _ll_register_callbacks cb 0x565135af3fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebe800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bc5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebe800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bc5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48250/0 (socket says 172.21.15.99:48250) 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebe800640 1 -- 172.21.15.99:0/1227594490 learned_addr learned my addr 172.21.15.99:0/1227594490 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebde00640 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99290 0x565135bdcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebd400640 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99670 0x565135bdc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebe800640 1 -- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99290 msgr2=0x565135bdcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebe800640 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99290 0x565135bdcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebe800640 1 -- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99670 msgr2=0x565135bdc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebe800640 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99670 0x565135bdc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebe800640 1 -- 172.21.15.99:0/1227594490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651357d0210 con 0x565135bb6f30 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebd400640 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99670 0x565135bdc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ebe800640 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bc5af0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x565135bc7670 tx=0x7f4eb800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd0dfe880f72021 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.858+0000 7f4ea2a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:16.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ea2a00640 1 -- 172.21.15.99:0/1227594490 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8004670 con 0x565135bb6f30 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ea2a00640 1 -- 172.21.15.99:0/1227594490 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4eb8004810 con 0x565135bb6f30 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1227594490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4eb8003b30 con 0x565135bb6f30 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ea2a00640 1 -- 172.21.15.99:0/1227594490 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4eb80145e0 con 0x565135bb6f30 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ec77e1740 10 client.5709 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1227594490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x56513593d0b0 con 0x565135bb6f30 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ea2a00640 1 -- 172.21.15.99:0/1227594490 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb8003b30 con 0x565135bb6f30 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ea2a00640 1 -- 172.21.15.99:0/1227594490 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4eb8033020 con 0x565135bb6f30 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ec77e1740 10 client.5709 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ec77e1740 10 client.5709 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ec77e1740 20 client.5709 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x565135bb8d60 0x565135bdf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ec77e1740 4 client.5709 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.859+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1227594490 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565135b09870 con 0x565135bb8d60 2024-03-30T13:13:16.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.860+0000 7f4ebde00640 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x565135bb8d60 0x565135bdf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.861+0000 7f4ebde00640 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x565135bb8d60 0x565135bdf4c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=709143135f5219d9 server_cookie=962e48ce18a4db23 in_seq=0 out_seq=0 2024-03-30T13:13:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.861+0000 7f4ea2a00640 10 client.5709 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ea2a00640 1 -- 172.21.15.99:0/1227594490 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x565135b09870 con 0x565135bb8d60 2024-03-30T13:13:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ea2a00640 10 client.5709 handle_command_reply: tid=0 2024-03-30T13:13:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ec77e1740 1 client.5709 shutdown 2024-03-30T13:13:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1227594490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 msgr2=0x565135bc5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bc5af0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x565135bc7670 tx=0x7f4eb800b040 comp rx=0 tx=0).stop 2024-03-30T13:13:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1227594490 shutdown_connections 2024-03-30T13:13:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bc5af0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x565135bb8d60 0x565135bdf4c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99670 0x565135bdc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/1227594490 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99290 0x565135bdcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1227594490 >> 172.21.15.99:0/1227594490 conn(0x565135b5fbe0 msgr2=0x565135bc2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ea2a00640 0 client.5709 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1227594490 shutdown_connections 2024-03-30T13:13:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.863+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1227594490 wait complete. 2024-03-30T13:13:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.864+0000 7f4ec77e1740 20 client.5709 trim_cache size 0 max 16384 2024-03-30T13:13:16.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.879+0000 7f4ec77e1740 1 Processor -- start 2024-03-30T13:13:16.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.879+0000 7f4ec77e1740 1 -- start start 2024-03-30T13:13:16.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.880+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99290 0x565135bf6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.880+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99670 0x565135bf72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.880+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bdf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.880+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec0201480 con 0x565135bb6f30 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.880+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec0200460 con 0x565135b99290 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.880+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec015f710 con 0x565135b99670 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.880+0000 7f4ebe800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bdf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4ebe800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bdf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48258/0 (socket says 172.21.15.99:48258) 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4ebe800640 1 -- 172.21.15.99:0/1781636083 learned_addr learned my addr 172.21.15.99:0/1781636083 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4ebd400640 1 --2- 172.21.15.99:0/1781636083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99670 0x565135bf72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4ebde00640 1 --2- 172.21.15.99:0/1781636083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99290 0x565135bf6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4ebe800640 1 -- 172.21.15.99:0/1781636083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99670 msgr2=0x565135bf72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4ebe800640 1 --2- 172.21.15.99:0/1781636083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99670 0x565135bf72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4ebe800640 1 -- 172.21.15.99:0/1781636083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99290 msgr2=0x565135bf6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4ebe800640 1 --2- 172.21.15.99:0/1781636083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99290 0x565135bf6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4ebe800640 1 -- 172.21.15.99:0/1781636083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651357a92d0 con 0x565135bb6f30 2024-03-30T13:13:16.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4ebe800640 1 --2- 172.21.15.99:0/1781636083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bdf8e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8007100 tx=0x7f4eb801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf40ce1f724c43f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4eadc00640 1 -- 172.21.15.99:0/1781636083 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8003990 con 0x565135bb6f30 2024-03-30T13:13:16.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4eadc00640 1 -- 172.21.15.99:0/1781636083 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb8028070 con 0x565135bb6f30 2024-03-30T13:13:16.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.881+0000 7f4eadc00640 1 -- 172.21.15.99:0/1781636083 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8003b30 con 0x565135bb6f30 2024-03-30T13:13:16.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.882+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1781636083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 msgr2=0x565135bdf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.882+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/1781636083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bdf8e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8007100 tx=0x7f4eb801f000 comp rx=0 tx=0).stop 2024-03-30T13:13:16.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.882+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1781636083 shutdown_connections 2024-03-30T13:13:16.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.882+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/1781636083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135bb6f30 0x565135bdf8e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.882+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/1781636083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135b99670 0x565135bf72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.882+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/1781636083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99290 0x565135bf6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.882+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1781636083 >> 172.21.15.99:0/1781636083 conn(0x565135b5fbe0 msgr2=0x565135bdca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.882+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1781636083 shutdown_connections 2024-03-30T13:13:16.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.882+0000 7f4ec77e1740 1 -- 172.21.15.99:0/1781636083 wait complete. 2024-03-30T13:13:16.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.883+0000 7f4ec77e1740 1 -- start start 2024-03-30T13:13:16.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.883+0000 7f4ec77e1740 1 Processor -- start 2024-03-30T13:13:16.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.884+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99290 0x565135bdb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.884+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135bb52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.884+0000 7f4ec77e1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135bb6f30 0x565135bb5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.884+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec01ffe50 con 0x565135b99670 2024-03-30T13:13:16.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.884+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x565135bb6050 con 0x565135b99290 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.884+0000 7f4ec77e1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x565135b92770 con 0x565135bb6f30 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.884+0000 7f4ec77e1740 10 client.0 _ll_register_callbacks cb 0x7f4eb8007330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.884+0000 7f4ebd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135bb52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135bb52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48274/0 (socket says 172.21.15.99:48274) 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebd400640 1 -- 172.21.15.99:0/3039648246 learned_addr learned my addr 172.21.15.99:0/3039648246 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebde00640 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99290 0x565135bdb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebe800640 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135bb6f30 0x565135bb5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebd400640 1 -- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135bb6f30 msgr2=0x565135bb5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebd400640 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135bb6f30 0x565135bb5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebd400640 1 -- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99290 msgr2=0x565135bdb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebd400640 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99290 0x565135bdb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebd400640 1 -- 172.21.15.99:0/3039648246 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565135b9a650 con 0x565135b99670 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebe800640 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135bb6f30 0x565135bb5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebde00640 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99290 0x565135bdb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ebd400640 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135bb52c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000c330 tx=0x7f4eb002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1b50748e144314 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.885+0000 7f4ea2a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ea2a00640 1 -- 172.21.15.99:0/3039648246 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0007270 con 0x565135b99670 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ea2a00640 1 -- 172.21.15.99:0/3039648246 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4eb0007410 con 0x565135b99670 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ec77e1740 1 -- 172.21.15.99:0/3039648246 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4eb8028070 con 0x565135b99670 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ea2a00640 1 -- 172.21.15.99:0/3039648246 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4eb0056050 con 0x565135b99670 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ec77e1740 10 client.5715 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ec77e1740 1 -- 172.21.15.99:0/3039648246 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x565135b93b50 con 0x565135b99670 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ea2a00640 1 -- 172.21.15.99:0/3039648246 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb8028070 con 0x565135b99670 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ea2a00640 1 -- 172.21.15.99:0/3039648246 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4eb0059020 con 0x565135b99670 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ec77e1740 10 client.5715 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ec77e1740 10 client.5715 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ec77e1740 20 client.5715 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:16.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x565135c56860 0x565135bf6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ec77e1740 4 client.5715 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628331}] 2024-03-30T13:13:16.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.886+0000 7f4ec77e1740 1 -- 172.21.15.99:0/3039648246 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628331}) -- 0x565135b03bc0 con 0x565135c56860 2024-03-30T13:13:16.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.887+0000 7f4ebde00640 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x565135c56860 0x565135bf6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.888+0000 7f4ebde00640 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x565135c56860 0x565135bf6d80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dfd1fa2925da9a9 server_cookie=f5653324b870858c in_seq=0 out_seq=0 2024-03-30T13:13:16.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.888+0000 7f4ea2a00640 10 client.5715 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ea2a00640 1 -- 172.21.15.99:0/3039648246 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3970 (crc 0 0 0) 0x565135b03bc0 con 0x565135c56860 2024-03-30T13:13:16.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ea2a00640 10 client.5715 handle_command_reply: tid=0 2024-03-30T13:13:16.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 1 client.5715 shutdown 2024-03-30T13:13:16.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 1 -- 172.21.15.99:0/3039648246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 msgr2=0x565135bb52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135bb52c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000c330 tx=0x7f4eb002e070 comp rx=0 tx=0).stop 2024-03-30T13:13:16.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 1 -- 172.21.15.99:0/3039648246 shutdown_connections 2024-03-30T13:13:16.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x565135bb6f30 0x565135bb5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565135b99670 0x565135bb52c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x565135c56860 0x565135bf6d80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 1 --2- 172.21.15.99:0/3039648246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565135b99290 0x565135bdb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 1 -- 172.21.15.99:0/3039648246 >> 172.21.15.99:0/3039648246 conn(0x565135b5fbe0 msgr2=0x565135c012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ea2a00640 0 client.5715 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 1 -- 172.21.15.99:0/3039648246 shutdown_connections 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 1 -- 172.21.15.99:0/3039648246 wait complete. 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.889+0000 7f4ec77e1740 20 client.5715 trim_cache size 0 max 16384 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/dcache.c", 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628331, 2024-03-30T13:13:16.895 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.471297+0000", 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.649952+0000", 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:16.896 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 3670, 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.649952+0000", 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 4, 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:16.898 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3670, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.471297+0000" 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3670, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.471297+0000" 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.899 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 214, 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 8, 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.513963+0000", 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 64, 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:16.900 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:16.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:16.902 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.903 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.904 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:16.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:16.906 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:16.907 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:16.907 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:16.907 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:16.909 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:16.909 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:16.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 -- 172.21.15.99:0/3404938904 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e9c06c530 msgr2=0x7f4e9c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e9c06c530 0x7f4e9c06e9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0034000 tx=0x7f4eb002e000 comp rx=0 tx=0).stop 2024-03-30T13:13:16.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 -- 172.21.15.99:0/3404938904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 msgr2=0x7f4ec00c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 0x7f4ec00c9c00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800e4d0 tx=0x7f4ea800e990 comp rx=0 tx=0).stop 2024-03-30T13:13:16.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 -- 172.21.15.99:0/3404938904 shutdown_connections 2024-03-30T13:13:16.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e9c06c530 0x7f4e9c06e9f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ec00ca140 0x7f4ec014a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ec015d570 0x7f4ec014a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 --2- 172.21.15.99:0/3404938904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ea4004800 0x7f4ec00c9c00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 -- 172.21.15.99:0/3404938904 >> 172.21.15.99:0/3404938904 conn(0x7f4ec00d0450 msgr2=0x7f4ec00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 -- 172.21.15.99:0/3404938904 shutdown_connections 2024-03-30T13:13:16.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:16.890+0000 7f4ec4a00640 1 -- 172.21.15.99:0/3404938904 wait complete. 2024-03-30T13:13:16.912 DEBUG:tasks.cephfs.test_uninlining:getting inode info #18 of 23:1099511628339 2024-03-30T13:13:16.912 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628339 2024-03-30T13:13:16.912 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628339 2024-03-30T13:13:17.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.112+0000 7f08d2000640 1 Processor -- start 2024-03-30T13:13:17.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.112+0000 7f08d2000640 1 -- start start 2024-03-30T13:13:17.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.113+0000 7f08d2000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f08cc072f80 0x7f08cc0733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.114+0000 7f08d2000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08cc15e950 con 0x7f08cc15e570 2024-03-30T13:13:17.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.114+0000 7f08d2000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08cc06f0b0 con 0x7f08cc0acf20 2024-03-30T13:13:17.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.114+0000 7f08d2000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f08cc073900 con 0x7f08cc072f80 2024-03-30T13:13:17.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.114+0000 7f08d0c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f08cc15e570 0x7f08cc06d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:41724/0 (socket says 172.21.15.99:41724) 2024-03-30T13:13:17.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.114+0000 7f08d0c00640 1 -- 172.21.15.99:0/1053615193 learned_addr learned my addr 172.21.15.99:0/1053615193 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:17.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.114+0000 7f08cbe00640 1 --2- 172.21.15.99:0/1053615193 >> v2:172.21.15.181:3300/0 conn(0x7f08cc072f80 0x7f08cc0733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960174992 0 0) 0x7f08cc15e950 con 0x7f08cc15e570 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b4003520 con 0x7f08cc15e570 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375383884 0 0) 0x7f08cc06f0b0 con 0x7f08cc0acf20 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08cc15e950 con 0x7f08cc0acf20 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3221090582 0 0) 0x7f08b4003520 con 0x7f08cc15e570 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 >> v2:172.21.15.181:3300/0 conn(0x7f08cc072f80 msgr2=0x7f08cc0733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 --2- 172.21.15.99:0/1053615193 >> v2:172.21.15.181:3300/0 conn(0x7f08cc072f80 0x7f08cc0733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 >> v1:172.21.15.181:6789/0 conn(0x7f08cc0acf20 legacy=0x7f08cc0ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08cc06dd40 con 0x7f08cc15e570 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f08c0001670 con 0x7f08cc15e570 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 >> v1:172.21.15.99:6789/0 conn(0x7f08cc15e570 legacy=0x7f08cc06d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 --2- 172.21.15.99:0/1053615193 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08b4003b90 0x7f08b4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 --2- 172.21.15.99:0/1053615193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08b4004800 0x7f08b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 --2- 172.21.15.99:0/1053615193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 0x7f08b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc073900 con 0x7f08b40051c0 2024-03-30T13:13:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f08b400bfe0 con 0x7f08b4004800 2024-03-30T13:13:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.115+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f08b400c1e0 con 0x7f08b4003b90 2024-03-30T13:13:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.116+0000 7f08d1600640 1 --2- 172.21.15.99:0/1053615193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 0x7f08b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.116+0000 7f08d0c00640 1 --2- 172.21.15.99:0/1053615193 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08b4003b90 0x7f08b4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.116+0000 7f08d1600640 1 -- 172.21.15.99:0/1053615193 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08b4003b90 msgr2=0x7f08b4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.116+0000 7f08d1600640 1 --2- 172.21.15.99:0/1053615193 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08b4003b90 0x7f08b4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.116+0000 7f08cbe00640 1 --2- 172.21.15.99:0/1053615193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08b4004800 0x7f08b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.116+0000 7f08d1600640 1 -- 172.21.15.99:0/1053615193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08b4004800 msgr2=0x7f08b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.116+0000 7f08d1600640 1 --2- 172.21.15.99:0/1053615193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08b4004800 0x7f08b4004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.116+0000 7f08d1600640 1 -- 172.21.15.99:0/1053615193 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b4003520 con 0x7f08b40051c0 2024-03-30T13:13:17.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.117+0000 7f08d1600640 1 -- 172.21.15.99:0/1053615193 reap_dead start 2024-03-30T13:13:17.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.117+0000 7f08d1600640 1 --2- 172.21.15.99:0/1053615193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 0x7f08b400b9c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f08c4001fd0 tx=0x7f08b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35f484edb8ebd24 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.117+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c4001bf0 con 0x7f08b40051c0 2024-03-30T13:13:17.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.118+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c4003b70 con 0x7f08b40051c0 2024-03-30T13:13:17.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.118+0000 7f08cb400640 1 -- 172.21.15.99:0/1053615193 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c40050d0 con 0x7f08b40051c0 2024-03-30T13:13:17.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.118+0000 7f08d2000640 1 -- 172.21.15.99:0/1053615193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 msgr2=0x7f08b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.118+0000 7f08d2000640 1 --2- 172.21.15.99:0/1053615193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 0x7f08b400b9c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f08c4001fd0 tx=0x7f08b4005830 comp rx=0 tx=0).stop 2024-03-30T13:13:17.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.118+0000 7f08d2000640 1 -- 172.21.15.99:0/1053615193 shutdown_connections 2024-03-30T13:13:17.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.118+0000 7f08d2000640 1 --2- 172.21.15.99:0/1053615193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 0x7f08b400b9c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.118+0000 7f08d2000640 1 -- 172.21.15.99:0/1053615193 >> 172.21.15.99:0/1053615193 conn(0x7f08cc06bb40 msgr2=0x7f08cc0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.118+0000 7f08d2000640 1 -- 172.21.15.99:0/1053615193 shutdown_connections 2024-03-30T13:13:17.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.118+0000 7f08d2000640 1 -- 172.21.15.99:0/1053615193 wait complete. 2024-03-30T13:13:17.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.120+0000 7f08d2000640 1 Processor -- start 2024-03-30T13:13:17.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.120+0000 7f08d2000640 1 -- start start 2024-03-30T13:13:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.121+0000 7f08d2000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 0x7f08cc160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.121+0000 7f08d2000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08cc161520 0x7f08cc0c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.121+0000 7f08d2000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08cc0c9800 0x7f08cc0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.121+0000 7f08d2000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc06e5d0 con 0x7f08b40051c0 2024-03-30T13:13:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.121+0000 7f08d2000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc06e2f0 con 0x7f08cc161520 2024-03-30T13:13:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.121+0000 7f08d2000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f08cc06e8b0 con 0x7f08cc0c9800 2024-03-30T13:13:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.121+0000 7f08d0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 0x7f08cc160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.121+0000 7f08d0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 0x7f08cc160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48284/0 (socket says 172.21.15.99:48284) 2024-03-30T13:13:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.121+0000 7f08d0c00640 1 -- 172.21.15.99:0/1761567729 learned_addr learned my addr 172.21.15.99:0/1761567729 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08d1600640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08cc0c9800 0x7f08cc0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08cbe00640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08cc161520 0x7f08cc0c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08d0c00640 1 -- 172.21.15.99:0/1761567729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08cc0c9800 msgr2=0x7f08cc0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08d0c00640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08cc0c9800 0x7f08cc0c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08d0c00640 1 -- 172.21.15.99:0/1761567729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08cc161520 msgr2=0x7f08cc0c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08d0c00640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08cc161520 0x7f08cc0c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08d0c00640 1 -- 172.21.15.99:0/1761567729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08cc1619a0 con 0x7f08b40051c0 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08d1600640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08cc0c9800 0x7f08cc0c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08cbe00640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08cc161520 0x7f08cc0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08d0c00640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 0x7f08cc160fe0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f08c0001050 tx=0x7f08c000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08c8c00640 1 -- 172.21.15.99:0/1761567729 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c000c660 con 0x7f08b40051c0 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.122+0000 7f08c8c00640 1 -- 172.21.15.99:0/1761567729 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c0018070 con 0x7f08b40051c0 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.123+0000 7f08c8c00640 1 -- 172.21.15.99:0/1761567729 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c000ca60 con 0x7f08b40051c0 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.123+0000 7f08d2000640 1 -- 172.21.15.99:0/1761567729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08cc09d2a0 con 0x7f08b40051c0 2024-03-30T13:13:17.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.123+0000 7f08d2000640 1 -- 172.21.15.99:0/1761567729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08cc15f050 con 0x7f08b40051c0 2024-03-30T13:13:17.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.125+0000 7f08c8c00640 1 -- 172.21.15.99:0/1761567729 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f08c000cc00 con 0x7f08b40051c0 2024-03-30T13:13:17.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.126+0000 7f08c8c00640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f08ac06c560 0x7f08ac06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.126+0000 7f08c8c00640 1 -- 172.21.15.99:0/1761567729 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f08c008b5b0 con 0x7f08b40051c0 2024-03-30T13:13:17.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.126+0000 7f08cbe00640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f08ac06c560 0x7f08ac06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.126+0000 7f08d624d740 1 Processor -- start 2024-03-30T13:13:17.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.127+0000 7f08cbe00640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f08ac06c560 0x7f08ac06ea20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0cc2c0 tx=0x7f08b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.127+0000 7f08d624d740 1 -- start start 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.127+0000 7f08d624d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9470 0x5579cfecffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.127+0000 7f08d624d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfed04e0 0x5579cfea84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08d624d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfea89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08d624d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5579cfe0c330 con 0x5579cfed04e0 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08d624d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5579cfdb4620 con 0x5579cfea9470 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08d624d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5579cfe08440 con 0x5579cfea9850 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08cbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfed04e0 0x5579cfea84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08cbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfed04e0 0x5579cfea84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48298/0 (socket says 172.21.15.99:48298) 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08cbe00640 1 -- 172.21.15.99:0/1092872565 learned_addr learned my addr 172.21.15.99:0/1092872565 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08d1600640 1 --2- 172.21.15.99:0/1092872565 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfea89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08cbe00640 1 -- 172.21.15.99:0/1092872565 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 msgr2=0x5579cfea89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08d0c00640 1 --2- 172.21.15.99:0/1092872565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9470 0x5579cfecffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08cbe00640 1 --2- 172.21.15.99:0/1092872565 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfea89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08cbe00640 1 -- 172.21.15.99:0/1092872565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9470 msgr2=0x5579cfecffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08cbe00640 1 --2- 172.21.15.99:0/1092872565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9470 0x5579cfecffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08cbe00640 1 -- 172.21.15.99:0/1092872565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579cfbec920 con 0x5579cfed04e0 2024-03-30T13:13:17.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.128+0000 7f08d1600640 1 --2- 172.21.15.99:0/1092872565 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfea89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.129+0000 7f08cbe00640 1 --2- 172.21.15.99:0/1092872565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfed04e0 0x5579cfea84b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f08b8011cc0 tx=0x7f08b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f751bdfe542edb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.129+0000 7f08bd200640 1 -- 172.21.15.99:0/1092872565 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8011cf0 con 0x5579cfed04e0 2024-03-30T13:13:17.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.129+0000 7f08bd200640 1 -- 172.21.15.99:0/1092872565 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b8026070 con 0x5579cfed04e0 2024-03-30T13:13:17.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.129+0000 7f08bd200640 1 -- 172.21.15.99:0/1092872565 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8021660 con 0x5579cfed04e0 2024-03-30T13:13:17.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.129+0000 7f08d624d740 1 -- 172.21.15.99:0/1092872565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfed04e0 msgr2=0x5579cfea84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.129+0000 7f08d624d740 1 --2- 172.21.15.99:0/1092872565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfed04e0 0x5579cfea84b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f08b8011cc0 tx=0x7f08b8014000 comp rx=0 tx=0).stop 2024-03-30T13:13:17.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.130+0000 7f08d624d740 1 -- 172.21.15.99:0/1092872565 shutdown_connections 2024-03-30T13:13:17.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.130+0000 7f08d624d740 1 --2- 172.21.15.99:0/1092872565 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfea89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.130+0000 7f08d624d740 1 --2- 172.21.15.99:0/1092872565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfed04e0 0x5579cfea84b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.130+0000 7f08d624d740 1 --2- 172.21.15.99:0/1092872565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9470 0x5579cfecffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.130+0000 7f08d624d740 1 -- 172.21.15.99:0/1092872565 >> 172.21.15.99:0/1092872565 conn(0x5579cfe6fbe0 msgr2=0x5579cfeee190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.130+0000 7f08d624d740 1 -- 172.21.15.99:0/1092872565 shutdown_connections 2024-03-30T13:13:17.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.130+0000 7f08d624d740 1 -- 172.21.15.99:0/1092872565 wait complete. 2024-03-30T13:13:17.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.130+0000 7f08d624d740 1 -- start start 2024-03-30T13:13:17.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.131+0000 7f08d624d740 1 Processor -- start 2024-03-30T13:13:17.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d624d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9470 0x5579cfed5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d624d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfec6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d624d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfec7510 0x5579cfeec210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d624d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5579cfecfb10 con 0x5579cfec7510 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d624d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5579cfdc79d0 con 0x5579cfea9470 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d624d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5579cfec8890 con 0x5579cfea9850 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d624d740 10 client.0 _ll_register_callbacks cb 0x5579cfe03fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d1600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfec7510 0x5579cfeec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d1600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfec7510 0x5579cfeec210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48314/0 (socket says 172.21.15.99:48314) 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d1600640 1 -- 172.21.15.99:0/3951069306 learned_addr learned my addr 172.21.15.99:0/3951069306 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08cbe00640 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfec6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d1600640 1 -- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 msgr2=0x5579cfec6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d1600640 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfec6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d0c00640 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9470 0x5579cfed5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d1600640 1 -- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9470 msgr2=0x5579cfed5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d1600640 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9470 0x5579cfed5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.132+0000 7f08d1600640 1 -- 172.21.15.99:0/3951069306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579cfae0210 con 0x5579cfec7510 2024-03-30T13:13:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.133+0000 7f08d1600640 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfec7510 0x5579cfeec210 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f08c40020c0 tx=0x7f08c402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16483331e311baf6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.133+0000 7f08b1600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.133+0000 7f08b1600640 1 -- 172.21.15.99:0/3951069306 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c4004e10 con 0x5579cfec7510 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.133+0000 7f08b1600640 1 -- 172.21.15.99:0/3951069306 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f08c4041b40 con 0x5579cfec7510 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.133+0000 7f08d624d740 1 -- 172.21.15.99:0/3951069306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08b8026070 con 0x5579cfec7510 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.133+0000 7f08b1600640 1 -- 172.21.15.99:0/3951069306 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f08c4041d40 con 0x5579cfec7510 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.133+0000 7f08d624d740 10 client.5727 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.133+0000 7f08d624d740 1 -- 172.21.15.99:0/3951069306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5579cfc4d0b0 con 0x5579cfec7510 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.134+0000 7f08b1600640 1 -- 172.21.15.99:0/3951069306 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b8026070 con 0x5579cfec7510 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.134+0000 7f08b1600640 1 -- 172.21.15.99:0/3951069306 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f08c404b080 con 0x5579cfec7510 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.134+0000 7f08d624d740 10 client.5727 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.134+0000 7f08d624d740 10 client.5727 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.134+0000 7f08d624d740 20 client.5727 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.134+0000 7f08d624d740 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5579cfeec810 0x5579cfed62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.134+0000 7f08d624d740 4 client.5727 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:17.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.134+0000 7f08d624d740 1 -- 172.21.15.99:0/3951069306 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579cfe19870 con 0x5579cfeec810 2024-03-30T13:13:17.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.134+0000 7f08d0c00640 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5579cfeec810 0x5579cfed62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.135+0000 7f08d0c00640 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5579cfeec810 0x5579cfed62d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50dc3d1812ee4a7a server_cookie=70baacc01c5deb60 in_seq=0 out_seq=0 2024-03-30T13:13:17.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.135+0000 7f08b1600640 10 client.5727 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.137+0000 7f08b1600640 1 -- 172.21.15.99:0/3951069306 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5579cfe19870 con 0x5579cfeec810 2024-03-30T13:13:17.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.137+0000 7f08b1600640 10 client.5727 handle_command_reply: tid=0 2024-03-30T13:13:17.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.137+0000 7f08d624d740 1 client.5727 shutdown 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08d624d740 1 -- 172.21.15.99:0/3951069306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfec7510 msgr2=0x5579cfeec210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08d624d740 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfec7510 0x5579cfeec210 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f08c40020c0 tx=0x7f08c402e070 comp rx=0 tx=0).stop 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08d624d740 1 -- 172.21.15.99:0/3951069306 shutdown_connections 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08d624d740 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfec7510 0x5579cfeec210 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08d624d740 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfec6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08d624d740 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5579cfeec810 0x5579cfed62d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08d624d740 1 --2- 172.21.15.99:0/3951069306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9470 0x5579cfed5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08b1600640 0 client.5727 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08d624d740 1 -- 172.21.15.99:0/3951069306 >> 172.21.15.99:0/3951069306 conn(0x5579cfe6fbe0 msgr2=0x5579cfecf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08d624d740 1 -- 172.21.15.99:0/3951069306 shutdown_connections 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08d624d740 1 -- 172.21.15.99:0/3951069306 wait complete. 2024-03-30T13:13:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.138+0000 7f08d624d740 20 client.5727 trim_cache size 0 max 16384 2024-03-30T13:13:17.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.154+0000 7f08d624d740 1 Processor -- start 2024-03-30T13:13:17.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.154+0000 7f08d624d740 1 -- start start 2024-03-30T13:13:17.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.154+0000 7f08d624d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cfea8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.154+0000 7f08d624d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9850 0x5579cfea42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.154+0000 7f08d624d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfec7510 0x5579cfed5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.154+0000 7f08d624d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc2011c0 con 0x5579cfea9470 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.154+0000 7f08d624d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc2001a0 con 0x5579cfea9850 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.154+0000 7f08d624d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f08cc1608f0 con 0x5579cfec7510 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.155+0000 7f08d0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cfea8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.155+0000 7f08d0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cfea8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48324/0 (socket says 172.21.15.99:48324) 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.155+0000 7f08d0c00640 1 -- 172.21.15.99:0/4096910169 learned_addr learned my addr 172.21.15.99:0/4096910169 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.155+0000 7f08d0c00640 1 -- 172.21.15.99:0/4096910169 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfec7510 msgr2=0x5579cfed5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.155+0000 7f08d0c00640 1 --2- 172.21.15.99:0/4096910169 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfec7510 0x5579cfed5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.155+0000 7f08d0c00640 1 -- 172.21.15.99:0/4096910169 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9850 msgr2=0x5579cfea42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.155+0000 7f08d0c00640 1 --2- 172.21.15.99:0/4096910169 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9850 0x5579cfea42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.155+0000 7f08d0c00640 1 -- 172.21.15.99:0/4096910169 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579cfab92d0 con 0x5579cfea9470 2024-03-30T13:13:17.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.155+0000 7f08d0c00640 1 --2- 172.21.15.99:0/4096910169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cfea8660 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f08c0059140 tx=0x7f08c008b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10686235a86e1672 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08b3e00640 1 -- 172.21.15.99:0/4096910169 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0089070 con 0x5579cfea9470 2024-03-30T13:13:17.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08b3e00640 1 -- 172.21.15.99:0/4096910169 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c0062020 con 0x5579cfea9470 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08b3e00640 1 -- 172.21.15.99:0/4096910169 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0057740 con 0x5579cfea9470 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08d624d740 1 -- 172.21.15.99:0/4096910169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 msgr2=0x5579cfea8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08d624d740 1 --2- 172.21.15.99:0/4096910169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cfea8660 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f08c0059140 tx=0x7f08c008b040 comp rx=0 tx=0).stop 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08d624d740 1 -- 172.21.15.99:0/4096910169 shutdown_connections 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08d624d740 1 --2- 172.21.15.99:0/4096910169 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfec7510 0x5579cfed5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08d624d740 1 --2- 172.21.15.99:0/4096910169 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfea9850 0x5579cfea42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08d624d740 1 --2- 172.21.15.99:0/4096910169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cfea8660 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08d624d740 1 -- 172.21.15.99:0/4096910169 >> 172.21.15.99:0/4096910169 conn(0x5579cfe6fbe0 msgr2=0x5579cfef1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08d624d740 1 -- 172.21.15.99:0/4096910169 shutdown_connections 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.156+0000 7f08d624d740 1 -- 172.21.15.99:0/4096910169 wait complete. 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.157+0000 7f08d624d740 1 -- start start 2024-03-30T13:13:17.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.157+0000 7f08d624d740 1 Processor -- start 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.158+0000 7f08d624d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cff117a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.158+0000 7f08d624d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfea23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.158+0000 7f08d624d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfec7510 0x5579cfea2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.158+0000 7f08d624d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5579cfeeb710 con 0x5579cfea9470 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.158+0000 7f08d624d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc1ffb10 con 0x5579cfec7510 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.158+0000 7f08d624d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5579cfeaa9e0 con 0x5579cfea9850 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.158+0000 7f08d624d740 10 client.0 _ll_register_callbacks cb 0x7f08b40036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.158+0000 7f08d0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cff117a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.158+0000 7f08d0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cff117a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48340/0 (socket says 172.21.15.99:48340) 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.158+0000 7f08d0c00640 1 -- 172.21.15.99:0/1285094708 learned_addr learned my addr 172.21.15.99:0/1285094708 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08d0c00640 1 -- 172.21.15.99:0/1285094708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 msgr2=0x5579cfea23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08d0c00640 1 --2- 172.21.15.99:0/1285094708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfea23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08d0c00640 1 -- 172.21.15.99:0/1285094708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfec7510 msgr2=0x5579cfea2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08d0c00640 1 --2- 172.21.15.99:0/1285094708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfec7510 0x5579cfea2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08d0c00640 1 -- 172.21.15.99:0/1285094708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579cfec55b0 con 0x5579cfea9470 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08d0c00640 1 --2- 172.21.15.99:0/1285094708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cff117a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f08c000c4b0 tx=0x7f08c4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0a6c96a49726b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08b1600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08b1600640 1 -- 172.21.15.99:0/1285094708 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0089040 con 0x5579cfea9470 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08b1600640 1 -- 172.21.15.99:0/1285094708 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f08c0061d90 con 0x5579cfea9470 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08d624d740 1 -- 172.21.15.99:0/1285094708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08c0062020 con 0x5579cfea9470 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08b1600640 1 -- 172.21.15.99:0/1285094708 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f08c0089b90 con 0x5579cfea9470 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08d624d740 10 client.5733 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.159+0000 7f08d624d740 1 -- 172.21.15.99:0/1285094708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5579cff616e0 con 0x5579cfea9470 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.160+0000 7f08b1600640 1 -- 172.21.15.99:0/1285094708 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c0062020 con 0x5579cfea9470 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.160+0000 7f08b1600640 1 -- 172.21.15.99:0/1285094708 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f08c0078b70 con 0x5579cfea9470 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.160+0000 7f08d624d740 10 client.5733 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:17.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.160+0000 7f08d624d740 10 client.5733 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:17.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.160+0000 7f08d624d740 20 client.5733 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:17.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.160+0000 7f08d624d740 1 --2- 172.21.15.99:0/1285094708 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5579cfec4e40 0x5579cfefd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.160+0000 7f08d624d740 4 client.5733 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628339}] 2024-03-30T13:13:17.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.160+0000 7f08d624d740 1 -- 172.21.15.99:0/1285094708 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628339}) -- 0x5579cfee82e0 con 0x5579cfec4e40 2024-03-30T13:13:17.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.161+0000 7f08cbe00640 1 --2- 172.21.15.99:0/1285094708 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5579cfec4e40 0x5579cfefd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.161+0000 7f08cbe00640 1 --2- 172.21.15.99:0/1285094708 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5579cfec4e40 0x5579cfefd020 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23e95f7f4d543fd8 server_cookie=3e86638c57ca6f8c in_seq=0 out_seq=0 2024-03-30T13:13:17.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.161+0000 7f08b1600640 10 client.5733 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08b1600640 1 -- 172.21.15.99:0/1285094708 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3977 (crc 0 0 0) 0x5579cfee82e0 con 0x5579cfec4e40 2024-03-30T13:13:17.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08b1600640 10 client.5733 handle_command_reply: tid=0 2024-03-30T13:13:17.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08d624d740 1 client.5733 shutdown 2024-03-30T13:13:17.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08d624d740 1 -- 172.21.15.99:0/1285094708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 msgr2=0x5579cff117a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08d624d740 1 --2- 172.21.15.99:0/1285094708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cff117a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f08c000c4b0 tx=0x7f08c4030000 comp rx=0 tx=0).stop 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08d624d740 1 -- 172.21.15.99:0/1285094708 shutdown_connections 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08d624d740 1 --2- 172.21.15.99:0/1285094708 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5579cfec4e40 0x5579cfefd020 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08d624d740 1 --2- 172.21.15.99:0/1285094708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cfec7510 0x5579cfea2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08d624d740 1 --2- 172.21.15.99:0/1285094708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5579cfea9850 0x5579cfea23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08d624d740 1 --2- 172.21.15.99:0/1285094708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579cfea9470 0x5579cff117a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08b1600640 0 client.5733 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.162+0000 7f08d624d740 1 -- 172.21.15.99:0/1285094708 >> 172.21.15.99:0/1285094708 conn(0x5579cfe6fbe0 msgr2=0x5579cfeec060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d624d740 1 -- 172.21.15.99:0/1285094708 shutdown_connections 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d624d740 1 -- 172.21.15.99:0/1285094708 wait complete. 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d624d740 20 client.5733 trim_cache size 0 max 16384 2024-03-30T13:13:17.168 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-bufmap.h", 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628339, 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.472245+0000", 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.671952+0000", 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:17.169 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 925, 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:17.170 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.671952+0000", 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:17.171 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 925, 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.472245+0000" 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 925, 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:17.172 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.472245+0000" 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 200, 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 24, 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.173 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:40.513021+0000", 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 66, 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:17.174 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:17.175 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:17.176 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:17.177 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:17.178 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:17.179 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:17.180 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:17.180 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:17.180 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:17.180 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:17.180 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.180 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:17.180 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:17.180 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:17.180 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:17.180 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:17.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d2000640 1 -- 172.21.15.99:0/1761567729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f08ac06c560 msgr2=0x7f08ac06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d2000640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f08ac06c560 0x7f08ac06ea20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0cc2c0 tx=0x7f08b8008040 comp rx=0 tx=0).stop 2024-03-30T13:13:17.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d2000640 1 -- 172.21.15.99:0/1761567729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 msgr2=0x7f08cc160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d2000640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 0x7f08cc160fe0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f08c0001050 tx=0x7f08c000ec10 comp rx=0 tx=0).stop 2024-03-30T13:13:17.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d2000640 1 -- 172.21.15.99:0/1761567729 shutdown_connections 2024-03-30T13:13:17.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d2000640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f08ac06c560 0x7f08ac06ea20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d2000640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08cc0c9800 0x7f08cc0c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d2000640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08cc161520 0x7f08cc0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d2000640 1 --2- 172.21.15.99:0/1761567729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b40051c0 0x7f08cc160fe0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.163+0000 7f08d2000640 1 -- 172.21.15.99:0/1761567729 >> 172.21.15.99:0/1761567729 conn(0x7f08cc06bb40 msgr2=0x7f08cc0b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.164+0000 7f08d2000640 1 -- 172.21.15.99:0/1761567729 shutdown_connections 2024-03-30T13:13:17.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.164+0000 7f08d2000640 1 -- 172.21.15.99:0/1761567729 wait complete. 2024-03-30T13:13:17.183 DEBUG:tasks.cephfs.test_uninlining:getting inode info #19 of 23:1099511628343 2024-03-30T13:13:17.183 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628343 2024-03-30T13:13:17.183 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628343 2024-03-30T13:13:17.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.391+0000 7efcab600640 1 Processor -- start 2024-03-30T13:13:17.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.392+0000 7efcab600640 1 -- start start 2024-03-30T13:13:17.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.393+0000 7efcab600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efca40b4e40 0x7efca40c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.393+0000 7efcab600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca40b31c0 0x7efca40b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.393+0000 7efcab600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efca40b2640 0x7efca40cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.393+0000 7efcab600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7efca40c6d60 con 0x7efca40b2640 2024-03-30T13:13:17.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.393+0000 7efcab600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7efca40b2a90 con 0x7efca40b4e40 2024-03-30T13:13:17.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.393+0000 7efcab600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7efca40cba20 con 0x7efca40b31c0 2024-03-30T13:13:17.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.393+0000 7efca9600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efca40b2640 0x7efca40cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.394+0000 7efca9600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efca40b2640 0x7efca40cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48354/0 (socket says 172.21.15.99:48354) 2024-03-30T13:13:17.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.394+0000 7efca9600640 1 -- 172.21.15.99:0/4124856105 learned_addr learned my addr 172.21.15.99:0/4124856105 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.394+0000 7efca3e00640 1 --2- 172.21.15.99:0/4124856105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca40b31c0 0x7efca40b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.394+0000 7efca9600640 1 -- 172.21.15.99:0/4124856105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca40b31c0 msgr2=0x7efca40b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.394+0000 7efca8c00640 1 --2- 172.21.15.99:0/4124856105 >> v2:172.21.15.181:3300/0 conn(0x7efca40b4e40 0x7efca40c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.394+0000 7efca9600640 1 --2- 172.21.15.99:0/4124856105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca40b31c0 0x7efca40b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.394+0000 7efca9600640 1 -- 172.21.15.99:0/4124856105 >> v2:172.21.15.181:3300/0 conn(0x7efca40b4e40 msgr2=0x7efca40c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.394+0000 7efca9600640 1 --2- 172.21.15.99:0/4124856105 >> v2:172.21.15.181:3300/0 conn(0x7efca40b4e40 0x7efca40c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.394+0000 7efca9600640 1 -- 172.21.15.99:0/4124856105 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca41604d0 con 0x7efca40b2640 2024-03-30T13:13:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.394+0000 7efca8c00640 1 --2- 172.21.15.99:0/4124856105 >> v2:172.21.15.181:3300/0 conn(0x7efca40b4e40 0x7efca40c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.395+0000 7efca9600640 1 --2- 172.21.15.99:0/4124856105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efca40b2640 0x7efca40cbec0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7efca406c5b0 tx=0x7efc9c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a2fe3d15370a6d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.395+0000 7efca3400640 1 -- 172.21.15.99:0/4124856105 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c02e070 con 0x7efca40b2640 2024-03-30T13:13:17.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.395+0000 7efca3400640 1 -- 172.21.15.99:0/4124856105 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9c037070 con 0x7efca40b2640 2024-03-30T13:13:17.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.396+0000 7efca3400640 1 -- 172.21.15.99:0/4124856105 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c031a00 con 0x7efca40b2640 2024-03-30T13:13:17.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.396+0000 7efcab600640 1 -- 172.21.15.99:0/4124856105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efca40b2640 msgr2=0x7efca40cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.396+0000 7efcab600640 1 --2- 172.21.15.99:0/4124856105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efca40b2640 0x7efca40cbec0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7efca406c5b0 tx=0x7efc9c02b880 comp rx=0 tx=0).stop 2024-03-30T13:13:17.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.396+0000 7efcab600640 1 -- 172.21.15.99:0/4124856105 shutdown_connections 2024-03-30T13:13:17.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.396+0000 7efcab600640 1 --2- 172.21.15.99:0/4124856105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efca40b2640 0x7efca40cbec0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.396+0000 7efcab600640 1 --2- 172.21.15.99:0/4124856105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca40b31c0 0x7efca40b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.396+0000 7efcab600640 1 --2- 172.21.15.99:0/4124856105 >> v2:172.21.15.181:3300/0 conn(0x7efca40b4e40 0x7efca40c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.396+0000 7efcab600640 1 -- 172.21.15.99:0/4124856105 >> 172.21.15.99:0/4124856105 conn(0x7efca40d0450 msgr2=0x7efca40d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.396+0000 7efcab600640 1 -- 172.21.15.99:0/4124856105 shutdown_connections 2024-03-30T13:13:17.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.396+0000 7efcab600640 1 -- 172.21.15.99:0/4124856105 wait complete. 2024-03-30T13:13:17.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.398+0000 7efcab600640 1 Processor -- start 2024-03-30T13:13:17.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.398+0000 7efcab600640 1 -- start start 2024-03-30T13:13:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.399+0000 7efcab600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efca40b2640 0x7efca4099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.399+0000 7efcab600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca40b31c0 0x7efca40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.399+0000 7efcab600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40b4e40 0x7efca406f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.399+0000 7efcab600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7efca4160d70 con 0x7efca40b2640 2024-03-30T13:13:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.399+0000 7efcab600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efca4160a90 con 0x7efca40b4e40 2024-03-30T13:13:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.399+0000 7efcab600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7efca40b3620 con 0x7efca40b31c0 2024-03-30T13:13:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.399+0000 7efca8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efca40b2640 0x7efca4099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.399+0000 7efca8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efca40b2640 0x7efca4099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48370/0 (socket says 172.21.15.99:48370) 2024-03-30T13:13:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.399+0000 7efca8c00640 1 -- 172.21.15.99:0/438631097 learned_addr learned my addr 172.21.15.99:0/438631097 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efca9600640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40b4e40 0x7efca406f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efca8c00640 1 -- 172.21.15.99:0/438631097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca40b31c0 msgr2=0x7efca40cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efca8c00640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca40b31c0 0x7efca40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efca8c00640 1 -- 172.21.15.99:0/438631097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40b4e40 msgr2=0x7efca406f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efca8c00640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40b4e40 0x7efca406f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efca8c00640 1 -- 172.21.15.99:0/438631097 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca40aeed0 con 0x7efca40b2640 2024-03-30T13:13:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efca9600640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40b4e40 0x7efca406f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efca8c00640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efca40b2640 0x7efca4099a90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c7f0 tx=0x7efc8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efca0c00640 1 -- 172.21.15.99:0/438631097 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c015070 con 0x7efca40b2640 2024-03-30T13:13:17.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efca0c00640 1 -- 172.21.15.99:0/438631097 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8c007820 con 0x7efca40b2640 2024-03-30T13:13:17.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efca0c00640 1 -- 172.21.15.99:0/438631097 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c007bd0 con 0x7efca40b2640 2024-03-30T13:13:17.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efcab600640 1 -- 172.21.15.99:0/438631097 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca40af1b0 con 0x7efca40b2640 2024-03-30T13:13:17.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.400+0000 7efcab600640 1 -- 172.21.15.99:0/438631097 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca406eae0 con 0x7efca40b2640 2024-03-30T13:13:17.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.403+0000 7efca0c00640 1 -- 172.21.15.99:0/438631097 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efc8c018070 con 0x7efca40b2640 2024-03-30T13:13:17.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.404+0000 7efca0c00640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc8006c530 0x7efc8006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.404+0000 7efca0c00640 1 -- 172.21.15.99:0/438631097 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7efc8c08b8b0 con 0x7efca40b2640 2024-03-30T13:13:17.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.404+0000 7efca3e00640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc8006c530 0x7efc8006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.404+0000 7efcae1f7740 1 Processor -- start 2024-03-30T13:13:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.405+0000 7efcae1f7740 1 -- start start 2024-03-30T13:13:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.405+0000 7efca3e00640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc8006c530 0x7efc8006e9f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efc94007130 tx=0x7efc94007310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.405+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7dadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.405+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7db300 0x55b90c7b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.405+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4670 0x55b90c7b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.405+0000 7efcae1f7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b90c717330 con 0x55b90c7b4290 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.405+0000 7efcae1f7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b90c6bf620 con 0x55b90c7db300 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.405+0000 7efcae1f7740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b90c713440 con 0x55b90c7b4670 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.406+0000 7efca8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7dadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.406+0000 7efca8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7dadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48384/0 (socket says 172.21.15.99:48384) 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.406+0000 7efca8c00640 1 -- 172.21.15.99:0/594445252 learned_addr learned my addr 172.21.15.99:0/594445252 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.406+0000 7efca8c00640 1 -- 172.21.15.99:0/594445252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4670 msgr2=0x55b90c7b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.406+0000 7efca3e00640 1 --2- 172.21.15.99:0/594445252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7db300 0x55b90c7b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.406+0000 7efca8c00640 1 --2- 172.21.15.99:0/594445252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4670 0x55b90c7b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.406+0000 7efca8c00640 1 -- 172.21.15.99:0/594445252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7db300 msgr2=0x55b90c7b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.406+0000 7efca8c00640 1 --2- 172.21.15.99:0/594445252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7db300 0x55b90c7b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.406+0000 7efca8c00640 1 -- 172.21.15.99:0/594445252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b90c4f7920 con 0x55b90c7b4290 2024-03-30T13:13:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.406+0000 7efca8c00640 1 --2- 172.21.15.99:0/594445252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7dadc0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efc8c007410 tx=0x7efc8c059800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c83838f8a58e211 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efc99200640 1 -- 172.21.15.99:0/594445252 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c01f040 con 0x55b90c7b4290 2024-03-30T13:13:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efc99200640 1 -- 172.21.15.99:0/594445252 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8c057a40 con 0x55b90c7b4290 2024-03-30T13:13:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efc99200640 1 -- 172.21.15.99:0/594445252 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c058b90 con 0x55b90c7b4290 2024-03-30T13:13:17.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efcae1f7740 1 -- 172.21.15.99:0/594445252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 msgr2=0x55b90c7dadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efcae1f7740 1 --2- 172.21.15.99:0/594445252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7dadc0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efc8c007410 tx=0x7efc8c059800 comp rx=0 tx=0).stop 2024-03-30T13:13:17.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efcae1f7740 1 -- 172.21.15.99:0/594445252 shutdown_connections 2024-03-30T13:13:17.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efcae1f7740 1 --2- 172.21.15.99:0/594445252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4670 0x55b90c7b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efcae1f7740 1 --2- 172.21.15.99:0/594445252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7db300 0x55b90c7b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efcae1f7740 1 --2- 172.21.15.99:0/594445252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7dadc0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efcae1f7740 1 -- 172.21.15.99:0/594445252 >> 172.21.15.99:0/594445252 conn(0x55b90c77abe0 msgr2=0x55b90c7f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efcae1f7740 1 -- 172.21.15.99:0/594445252 shutdown_connections 2024-03-30T13:13:17.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.407+0000 7efcae1f7740 1 -- 172.21.15.99:0/594445252 wait complete. 2024-03-30T13:13:17.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.408+0000 7efcae1f7740 1 -- start start 2024-03-30T13:13:17.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.408+0000 7efcae1f7740 1 Processor -- start 2024-03-30T13:13:17.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.409+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4290 0x55b90c7c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.409+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c7d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.409+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c7f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.409+0000 7efcae1f7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b90c7da930 con 0x55b90c7f0e90 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.409+0000 7efcae1f7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b90c6d29d0 con 0x55b90c7b4670 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.409+0000 7efcae1f7740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b90c7d36b0 con 0x55b90c7b4290 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.409+0000 7efcae1f7740 10 client.0 _ll_register_callbacks cb 0x55b90c70efd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c7f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c7f53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48396/0 (socket says 172.21.15.99:48396) 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca9600640 1 -- 172.21.15.99:0/3511750560 learned_addr learned my addr 172.21.15.99:0/3511750560 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca3e00640 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c7d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca8c00640 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4290 0x55b90c7c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca9600640 1 -- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4290 msgr2=0x55b90c7c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca9600640 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4290 0x55b90c7c72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca9600640 1 -- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 msgr2=0x55b90c7d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca9600640 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c7d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca9600640 1 -- 172.21.15.99:0/3511750560 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b90c3eb210 con 0x55b90c7f0e90 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca3e00640 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c7d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efca9600640 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c7f53b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efc9c02b8c0 tx=0x7efc9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1794b3dce9066eb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.410+0000 7efc91600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efc91600640 1 -- 172.21.15.99:0/3511750560 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c032670 con 0x55b90c7f0e90 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efcae1f7740 1 -- 172.21.15.99:0/3511750560 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc8c057a40 con 0x55b90c7f0e90 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efc91600640 1 -- 172.21.15.99:0/3511750560 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7efc9c032810 con 0x55b90c7f0e90 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efc91600640 1 -- 172.21.15.99:0/3511750560 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efc9c04f050 con 0x55b90c7f0e90 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efcae1f7740 10 client.5745 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efcae1f7740 1 -- 172.21.15.99:0/3511750560 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55b90c5580b0 con 0x55b90c7f0e90 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efc91600640 1 -- 172.21.15.99:0/3511750560 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8c057a40 con 0x55b90c7f0e90 2024-03-30T13:13:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efc91600640 1 -- 172.21.15.99:0/3511750560 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7efc9c052020 con 0x55b90c7f0e90 2024-03-30T13:13:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efcae1f7740 10 client.5745 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efcae1f7740 10 client.5745 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efcae1f7740 20 client.5745 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efcae1f7740 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b90c7f1a60 0x55b90c7f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efcae1f7740 4 client.5745 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.411+0000 7efcae1f7740 1 -- 172.21.15.99:0/3511750560 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b90c724870 con 0x55b90c7f1a60 2024-03-30T13:13:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.412+0000 7efca8c00640 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b90c7f1a60 0x55b90c7f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.413+0000 7efca8c00640 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b90c7f1a60 0x55b90c7f1e70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac3985a53806ce8b server_cookie=f43278256a15b7f6 in_seq=0 out_seq=0 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.413+0000 7efc91600640 10 client.5745 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efc91600640 1 -- 172.21.15.99:0/3511750560 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b90c724870 con 0x55b90c7f1a60 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efc91600640 10 client.5745 handle_command_reply: tid=0 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efcae1f7740 1 client.5745 shutdown 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efcae1f7740 1 -- 172.21.15.99:0/3511750560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 msgr2=0x55b90c7f53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efcae1f7740 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c7f53b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efc9c02b8c0 tx=0x7efc9c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efcae1f7740 1 -- 172.21.15.99:0/3511750560 shutdown_connections 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efcae1f7740 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c7f53b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efcae1f7740 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b90c7f1a60 0x55b90c7f1e70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efcae1f7740 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c7d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efcae1f7740 1 --2- 172.21.15.99:0/3511750560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4290 0x55b90c7c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efcae1f7740 1 -- 172.21.15.99:0/3511750560 >> 172.21.15.99:0/3511750560 conn(0x55b90c77abe0 msgr2=0x55b90c7da0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efc91600640 0 client.5745 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efcae1f7740 1 -- 172.21.15.99:0/3511750560 shutdown_connections 2024-03-30T13:13:17.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.415+0000 7efcae1f7740 1 -- 172.21.15.99:0/3511750560 wait complete. 2024-03-30T13:13:17.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.416+0000 7efcae1f7740 20 client.5745 trim_cache size 0 max 16384 2024-03-30T13:13:17.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.431+0000 7efcae1f7740 1 Processor -- start 2024-03-30T13:13:17.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.431+0000 7efcae1f7740 1 -- start start 2024-03-30T13:13:17.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.432+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4290 0x55b90c7d9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.432+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c86eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.432+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c81ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.432+0000 7efcae1f7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7efca4200d20 con 0x55b90c7f0e90 2024-03-30T13:13:17.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.432+0000 7efcae1f7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efca40ce9e0 con 0x55b90c7b4670 2024-03-30T13:13:17.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.432+0000 7efcae1f7740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7efca40cdd90 con 0x55b90c7b4290 2024-03-30T13:13:17.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.432+0000 7efca9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c81ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.432+0000 7efca9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c81ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48412/0 (socket says 172.21.15.99:48412) 2024-03-30T13:13:17.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.432+0000 7efca9600640 1 -- 172.21.15.99:0/2866819972 learned_addr learned my addr 172.21.15.99:0/2866819972 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efca3e00640 1 --2- 172.21.15.99:0/2866819972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c86eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efca8c00640 1 --2- 172.21.15.99:0/2866819972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4290 0x55b90c7d9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efca9600640 1 -- 172.21.15.99:0/2866819972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4290 msgr2=0x55b90c7d9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efca9600640 1 --2- 172.21.15.99:0/2866819972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4290 0x55b90c7d9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efca9600640 1 -- 172.21.15.99:0/2866819972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 msgr2=0x55b90c86eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efca9600640 1 --2- 172.21.15.99:0/2866819972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c86eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efca9600640 1 -- 172.21.15.99:0/2866819972 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b90c3c42d0 con 0x55b90c7f0e90 2024-03-30T13:13:17.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efca3e00640 1 --2- 172.21.15.99:0/2866819972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c86eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efca9600640 1 --2- 172.21.15.99:0/2866819972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c81ba40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efc9c031980 tx=0x7efc9c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b1eea89e90823e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efc93e00640 1 -- 172.21.15.99:0/2866819972 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c032470 con 0x55b90c7f0e90 2024-03-30T13:13:17.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efc93e00640 1 -- 172.21.15.99:0/2866819972 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9c037040 con 0x55b90c7f0e90 2024-03-30T13:13:17.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.433+0000 7efc93e00640 1 -- 172.21.15.99:0/2866819972 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c032830 con 0x55b90c7f0e90 2024-03-30T13:13:17.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.434+0000 7efcae1f7740 1 -- 172.21.15.99:0/2866819972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 msgr2=0x55b90c81ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.434+0000 7efcae1f7740 1 --2- 172.21.15.99:0/2866819972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c81ba40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efc9c031980 tx=0x7efc9c03e000 comp rx=0 tx=0).stop 2024-03-30T13:13:17.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.434+0000 7efcae1f7740 1 -- 172.21.15.99:0/2866819972 shutdown_connections 2024-03-30T13:13:17.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.434+0000 7efcae1f7740 1 --2- 172.21.15.99:0/2866819972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7f0e90 0x55b90c81ba40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.434+0000 7efcae1f7740 1 --2- 172.21.15.99:0/2866819972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c86eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.434+0000 7efcae1f7740 1 --2- 172.21.15.99:0/2866819972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7b4290 0x55b90c7d9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.434+0000 7efcae1f7740 1 -- 172.21.15.99:0/2866819972 >> 172.21.15.99:0/2866819972 conn(0x55b90c77abe0 msgr2=0x55b90c7f2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.434+0000 7efcae1f7740 1 -- 172.21.15.99:0/2866819972 shutdown_connections 2024-03-30T13:13:17.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.434+0000 7efcae1f7740 1 -- 172.21.15.99:0/2866819972 wait complete. 2024-03-30T13:13:17.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.435+0000 7efcae1f7740 1 -- start start 2024-03-30T13:13:17.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.435+0000 7efcae1f7740 1 Processor -- start 2024-03-30T13:13:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.436+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.436+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c86d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.436+0000 7efcae1f7740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7f0e90 0x55b90c81ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.436+0000 7efcae1f7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b90c7a9c20 con 0x55b90c7b4290 2024-03-30T13:13:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.436+0000 7efcae1f7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efca40ce390 con 0x55b90c7b4670 2024-03-30T13:13:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.436+0000 7efcae1f7740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b90c7e1cb0 con 0x55b90c7f0e90 2024-03-30T13:13:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.436+0000 7efcae1f7740 10 client.0 _ll_register_callbacks cb 0x7efc9c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.436+0000 7efca8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.436+0000 7efca8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7fcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48426/0 (socket says 172.21.15.99:48426) 2024-03-30T13:13:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.436+0000 7efca8c00640 1 -- 172.21.15.99:0/706476766 learned_addr learned my addr 172.21.15.99:0/706476766 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efca3e00640 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c86d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efca8c00640 1 -- 172.21.15.99:0/706476766 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7f0e90 msgr2=0x55b90c81ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efca8c00640 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7f0e90 0x55b90c81ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efca8c00640 1 -- 172.21.15.99:0/706476766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 msgr2=0x55b90c86d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efca8c00640 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c86d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efca8c00640 1 -- 172.21.15.99:0/706476766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b90c86d9d0 con 0x55b90c7b4290 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efca8c00640 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7fcd00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efc8c05dcb0 tx=0x7efc8c01c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6e244ff46ed14f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efc91600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efc91600640 1 -- 172.21.15.99:0/706476766 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c01f040 con 0x55b90c7b4290 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efc91600640 1 -- 172.21.15.99:0/706476766 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7efc8c01bb80 con 0x55b90c7b4290 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efcae1f7740 1 -- 172.21.15.99:0/706476766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc9c037040 con 0x55b90c7b4290 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efc91600640 1 -- 172.21.15.99:0/706476766 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efc8c01bd80 con 0x55b90c7b4290 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efcae1f7740 10 client.5751 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.437+0000 7efcae1f7740 1 -- 172.21.15.99:0/706476766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55b90c7ae0a0 con 0x55b90c7b4290 2024-03-30T13:13:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.438+0000 7efc91600640 1 -- 172.21.15.99:0/706476766 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9c037040 con 0x55b90c7b4290 2024-03-30T13:13:17.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.438+0000 7efc91600640 1 -- 172.21.15.99:0/706476766 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7efc8c058b90 con 0x55b90c7b4290 2024-03-30T13:13:17.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.438+0000 7efcae1f7740 10 client.5751 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:17.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.438+0000 7efcae1f7740 10 client.5751 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:17.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.438+0000 7efcae1f7740 20 client.5751 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:17.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.438+0000 7efcae1f7740 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b90c81bf80 0x55b90c7d9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.438+0000 7efcae1f7740 4 client.5751 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628343}] 2024-03-30T13:13:17.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.438+0000 7efcae1f7740 1 -- 172.21.15.99:0/706476766 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628343}) -- 0x55b90c71ebc0 con 0x55b90c81bf80 2024-03-30T13:13:17.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.438+0000 7efca3e00640 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b90c81bf80 0x55b90c7d9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.439+0000 7efca3e00640 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b90c81bf80 0x55b90c7d9b60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5105447d1d931cd6 server_cookie=66c6047b0989ee38 in_seq=0 out_seq=0 2024-03-30T13:13:17.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.439+0000 7efc91600640 10 client.5751 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efc91600640 1 -- 172.21.15.99:0/706476766 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x55b90c71ebc0 con 0x55b90c81bf80 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efc91600640 10 client.5751 handle_command_reply: tid=0 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efcae1f7740 1 client.5751 shutdown 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efcae1f7740 1 -- 172.21.15.99:0/706476766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 msgr2=0x55b90c7fcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efcae1f7740 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7fcd00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efc8c05dcb0 tx=0x7efc8c01c070 comp rx=0 tx=0).stop 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efcae1f7740 1 -- 172.21.15.99:0/706476766 shutdown_connections 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efcae1f7740 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b90c7f0e90 0x55b90c81ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efcae1f7740 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b90c81bf80 0x55b90c7d9b60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efcae1f7740 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b90c7b4670 0x55b90c86d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efcae1f7740 1 --2- 172.21.15.99:0/706476766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b90c7b4290 0x55b90c7fcd00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efc91600640 0 client.5751 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efcae1f7740 1 -- 172.21.15.99:0/706476766 >> 172.21.15.99:0/706476766 conn(0x55b90c77abe0 msgr2=0x55b90c7f28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efcae1f7740 1 -- 172.21.15.99:0/706476766 shutdown_connections 2024-03-30T13:13:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.440+0000 7efcae1f7740 1 -- 172.21.15.99:0/706476766 wait complete. 2024-03-30T13:13:17.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcae1f7740 20 client.5751 trim_cache size 0 max 16384 2024-03-30T13:13:17.447 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debugfs.h", 2024-03-30T13:13:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628343, 2024-03-30T13:13:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.503850+0000", 2024-03-30T13:13:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.681952+0000", 2024-03-30T13:13:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 311, 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.681952+0000", 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 311, 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.503850+0000" 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 311, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.503850+0000" 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 194, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 32, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:41.320976+0000", 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 84, 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:17.459 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:17.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 -- 172.21.15.99:0/438631097 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc8006c530 msgr2=0x7efc8006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc8006c530 0x7efc8006e9f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efc94007130 tx=0x7efc94007310 comp rx=0 tx=0).stop 2024-03-30T13:13:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 -- 172.21.15.99:0/438631097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efca40b2640 msgr2=0x7efca4099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efca40b2640 0x7efca4099a90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c7f0 tx=0x7efc8c00ccb0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 -- 172.21.15.99:0/438631097 shutdown_connections 2024-03-30T13:13:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7efc8006c530 0x7efc8006e9f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca40b4e40 0x7efca406f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efca40b31c0 0x7efca40cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 --2- 172.21.15.99:0/438631097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efca40b2640 0x7efca4099a90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 -- 172.21.15.99:0/438631097 >> 172.21.15.99:0/438631097 conn(0x7efca40d0450 msgr2=0x7efca415ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 -- 172.21.15.99:0/438631097 shutdown_connections 2024-03-30T13:13:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.441+0000 7efcab600640 1 -- 172.21.15.99:0/438631097 wait complete. 2024-03-30T13:13:17.462 DEBUG:tasks.cephfs.test_uninlining:getting inode info #20 of 23:1099511628344 2024-03-30T13:13:17.462 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628344 2024-03-30T13:13:17.462 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628344 2024-03-30T13:13:17.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.663+0000 7fb58a200640 1 Processor -- start 2024-03-30T13:13:17.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.663+0000 7fb58a200640 1 -- start start 2024-03-30T13:13:17.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.665+0000 7fb58a200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5840cf330 0x7fb58415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.665+0000 7fb58a200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb58415d7b0 con 0x7fb5840acf20 2024-03-30T13:13:17.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.665+0000 7fb58a200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb58406d840 con 0x7fb58415d190 2024-03-30T13:13:17.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.665+0000 7fb58a200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb58406db20 con 0x7fb5840cf330 2024-03-30T13:13:17.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.665+0000 7fb583e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb5840acf20 0x7fb58415ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:41730/0 (socket says 172.21.15.99:41730) 2024-03-30T13:13:17.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.665+0000 7fb583e00640 1 -- 172.21.15.99:0/1755109790 learned_addr learned my addr 172.21.15.99:0/1755109790 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:17.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.665+0000 7fb588e00640 1 --2- 172.21.15.99:0/1755109790 >> v2:172.21.15.99:3300/0 conn(0x7fb5840cf330 0x7fb58415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.666+0000 7fb583400640 1 -- 172.21.15.99:0/1755109790 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3356056119 0 0) 0x7fb58415d7b0 con 0x7fb5840acf20 2024-03-30T13:13:17.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.666+0000 7fb583400640 1 -- 172.21.15.99:0/1755109790 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb56c003520 con 0x7fb5840acf20 2024-03-30T13:13:17.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.666+0000 7fb588e00640 1 -- 172.21.15.99:0/1755109790 >> v1:172.21.15.181:6789/0 conn(0x7fb58415d190 legacy=0x7fb58406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.666+0000 7fb588e00640 1 -- 172.21.15.99:0/1755109790 >> v1:172.21.15.99:6789/0 conn(0x7fb5840acf20 legacy=0x7fb58415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.666+0000 7fb583400640 1 -- 172.21.15.99:0/1755109790 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1589595784 0 0) 0x7fb56c003520 con 0x7fb5840acf20 2024-03-30T13:13:17.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.666+0000 7fb588e00640 1 -- 172.21.15.99:0/1755109790 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58406de00 con 0x7fb5840cf330 2024-03-30T13:13:17.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.667+0000 7fb588e00640 1 --2- 172.21.15.99:0/1755109790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840cf330 0x7fb58415dd70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb5780097a0 tx=0x7fb57802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9462d5ad781267b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.667+0000 7fb583400640 1 -- 172.21.15.99:0/1755109790 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578038070 con 0x7fb5840cf330 2024-03-30T13:13:17.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.667+0000 7fb583400640 1 -- 172.21.15.99:0/1755109790 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb578031500 con 0x7fb5840cf330 2024-03-30T13:13:17.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.667+0000 7fb583400640 1 -- 172.21.15.99:0/1755109790 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570001670 con 0x7fb5840cf330 2024-03-30T13:13:17.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.668+0000 7fb58a200640 1 -- 172.21.15.99:0/1755109790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840cf330 msgr2=0x7fb58415dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.668+0000 7fb58a200640 1 --2- 172.21.15.99:0/1755109790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840cf330 0x7fb58415dd70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb5780097a0 tx=0x7fb57802b820 comp rx=0 tx=0).stop 2024-03-30T13:13:17.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.668+0000 7fb58a200640 1 -- 172.21.15.99:0/1755109790 shutdown_connections 2024-03-30T13:13:17.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.668+0000 7fb58a200640 1 --2- 172.21.15.99:0/1755109790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840cf330 0x7fb58415dd70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.668+0000 7fb58a200640 1 -- 172.21.15.99:0/1755109790 >> 172.21.15.99:0/1755109790 conn(0x7fb58406bb40 msgr2=0x7fb5840b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.668+0000 7fb58a200640 1 -- 172.21.15.99:0/1755109790 shutdown_connections 2024-03-30T13:13:17.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.668+0000 7fb58a200640 1 -- 172.21.15.99:0/1755109790 wait complete. 2024-03-30T13:13:17.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.670+0000 7fb58a200640 1 Processor -- start 2024-03-30T13:13:17.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.670+0000 7fb58a200640 1 -- start start 2024-03-30T13:13:17.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.671+0000 7fb58a200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840acf20 0x7fb584143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.671+0000 7fb58a200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5840cf330 0x7fb58415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.671+0000 7fb58a200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb58415d190 0x7fb58415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.671+0000 7fb58a200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb5840ad730 con 0x7fb5840acf20 2024-03-30T13:13:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.671+0000 7fb58a200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb5840ad5b0 con 0x7fb5840cf330 2024-03-30T13:13:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.671+0000 7fb58a200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb5840ad8b0 con 0x7fb58415d190 2024-03-30T13:13:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.671+0000 7fb588e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840acf20 0x7fb584143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.671+0000 7fb588e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840acf20 0x7fb584143350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48434/0 (socket says 172.21.15.99:48434) 2024-03-30T13:13:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.671+0000 7fb588e00640 1 -- 172.21.15.99:0/105116251 learned_addr learned my addr 172.21.15.99:0/105116251 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.672+0000 7fb588e00640 1 -- 172.21.15.99:0/105116251 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb58415d190 msgr2=0x7fb58415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.672+0000 7fb588e00640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb58415d190 0x7fb58415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.672+0000 7fb588e00640 1 -- 172.21.15.99:0/105116251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5840cf330 msgr2=0x7fb58415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.672+0000 7fb588e00640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5840cf330 0x7fb58415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.672+0000 7fb588e00640 1 -- 172.21.15.99:0/105116251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58409c720 con 0x7fb5840acf20 2024-03-30T13:13:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.672+0000 7fb588e00640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840acf20 0x7fb584143350 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb5780098c0 tx=0x7fb5780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.672+0000 7fb580c00640 1 -- 172.21.15.99:0/105116251 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578042070 con 0x7fb5840acf20 2024-03-30T13:13:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.672+0000 7fb580c00640 1 -- 172.21.15.99:0/105116251 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb57803d870 con 0x7fb5840acf20 2024-03-30T13:13:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.672+0000 7fb580c00640 1 -- 172.21.15.99:0/105116251 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578038040 con 0x7fb5840acf20 2024-03-30T13:13:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.672+0000 7fb58a200640 1 -- 172.21.15.99:0/105116251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58409ca00 con 0x7fb5840acf20 2024-03-30T13:13:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.673+0000 7fb58a200640 1 -- 172.21.15.99:0/105116251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5840b0fb0 con 0x7fb5840acf20 2024-03-30T13:13:17.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.675+0000 7fb580c00640 1 -- 172.21.15.99:0/105116251 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb578045070 con 0x7fb5840acf20 2024-03-30T13:13:17.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.676+0000 7fb580c00640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb56406c560 0x7fb56406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.676+0000 7fb580c00640 1 -- 172.21.15.99:0/105116251 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fb5780ad220 con 0x7fb5840acf20 2024-03-30T13:13:17.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.676+0000 7fb583e00640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb56406c560 0x7fb56406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.677+0000 7fb58e5d1740 1 Processor -- start 2024-03-30T13:13:17.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.677+0000 7fb583e00640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb56406c560 0x7fb56406ea20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb584145350 tx=0x7fb5700010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.677+0000 7fb58e5d1740 1 -- start start 2024-03-30T13:13:17.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.678+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 0x559a10da5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.678+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10da64e0 0x559a10d7e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.678+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f850 0x559a10d7e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.678+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559a10ce2330 con 0x559a10d7f850 2024-03-30T13:13:17.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.678+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559a10c8a620 con 0x559a10d7f470 2024-03-30T13:13:17.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.678+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x559a10cde440 con 0x559a10da64e0 2024-03-30T13:13:17.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.678+0000 7fb589800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f850 0x559a10d7e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.678+0000 7fb589800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f850 0x559a10d7e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48440/0 (socket says 172.21.15.99:48440) 2024-03-30T13:13:17.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.678+0000 7fb589800640 1 -- 172.21.15.99:0/2661881605 learned_addr learned my addr 172.21.15.99:0/2661881605 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb588e00640 1 --2- 172.21.15.99:0/2661881605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 0x559a10da5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb583e00640 1 --2- 172.21.15.99:0/2661881605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10da64e0 0x559a10d7e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb589800640 1 -- 172.21.15.99:0/2661881605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10da64e0 msgr2=0x559a10d7e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb589800640 1 --2- 172.21.15.99:0/2661881605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10da64e0 0x559a10d7e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb589800640 1 -- 172.21.15.99:0/2661881605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 msgr2=0x559a10da5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb589800640 1 --2- 172.21.15.99:0/2661881605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 0x559a10da5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb589800640 1 -- 172.21.15.99:0/2661881605 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a10ac2920 con 0x559a10d7f850 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb588e00640 1 --2- 172.21.15.99:0/2661881605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 0x559a10da5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb583e00640 1 --2- 172.21.15.99:0/2661881605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10da64e0 0x559a10d7e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb589800640 1 --2- 172.21.15.99:0/2661881605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f850 0x559a10d7e9f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb57c001c80 tx=0x7fb57c002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3497d812e7ab381 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb575600640 1 -- 172.21.15.99:0/2661881605 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c017070 con 0x559a10d7f850 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb575600640 1 -- 172.21.15.99:0/2661881605 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb57c00cc10 con 0x559a10d7f850 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.679+0000 7fb575600640 1 -- 172.21.15.99:0/2661881605 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c003970 con 0x559a10d7f850 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.680+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2661881605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f850 msgr2=0x559a10d7e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.680+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/2661881605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f850 0x559a10d7e9f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb57c001c80 tx=0x7fb57c002140 comp rx=0 tx=0).stop 2024-03-30T13:13:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.680+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2661881605 shutdown_connections 2024-03-30T13:13:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.680+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/2661881605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f850 0x559a10d7e9f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.680+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/2661881605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10da64e0 0x559a10d7e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.680+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/2661881605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 0x559a10da5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.680+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2661881605 >> 172.21.15.99:0/2661881605 conn(0x559a10d45be0 msgr2=0x559a10dc4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.680+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2661881605 shutdown_connections 2024-03-30T13:13:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.680+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2661881605 wait complete. 2024-03-30T13:13:17.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.681+0000 7fb58e5d1740 1 -- start start 2024-03-30T13:13:17.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.681+0000 7fb58e5d1740 1 Processor -- start 2024-03-30T13:13:17.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.682+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 0x559a10da31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.682+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f850 0x559a10da9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.682+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10d92140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.682+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559a10da5b10 con 0x559a10da0ab0 2024-03-30T13:13:17.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.682+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559a10c9d9d0 con 0x559a10d7f470 2024-03-30T13:13:17.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.682+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x559a10d9e890 con 0x559a10d7f850 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.682+0000 7fb58e5d1740 10 client.0 _ll_register_callbacks cb 0x559a10cd9fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.682+0000 7fb589800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10d92140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.682+0000 7fb589800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10d92140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48444/0 (socket says 172.21.15.99:48444) 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.682+0000 7fb589800640 1 -- 172.21.15.99:0/3273283073 learned_addr learned my addr 172.21.15.99:0/3273283073 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.683+0000 7fb588e00640 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 0x559a10da31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.683+0000 7fb583e00640 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f850 0x559a10da9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.683+0000 7fb589800640 1 -- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f850 msgr2=0x559a10da9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.683+0000 7fb589800640 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f850 0x559a10da9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.683+0000 7fb589800640 1 -- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 msgr2=0x559a10da31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.683+0000 7fb589800640 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 0x559a10da31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.683+0000 7fb589800640 1 -- 172.21.15.99:0/3273283073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a109b6210 con 0x559a10da0ab0 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.683+0000 7fb588e00640 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 0x559a10da31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.683+0000 7fb589800640 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10d92140 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x559a10dad850 tx=0x7fb57c001470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a1b33d3579b2e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.683+0000 7fb56a000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.683+0000 7fb56a000640 1 -- 172.21.15.99:0/3273283073 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c022030 con 0x559a10da0ab0 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb56a000640 1 -- 172.21.15.99:0/3273283073 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fb57c006d60 con 0x559a10da0ab0 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3273283073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb57c00cc10 con 0x559a10da0ab0 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb56a000640 1 -- 172.21.15.99:0/3273283073 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb57c02b050 con 0x559a10da0ab0 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb58e5d1740 10 client.5766 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3273283073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x559a10b230b0 con 0x559a10da0ab0 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb56a000640 1 -- 172.21.15.99:0/3273283073 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb57c00cc10 con 0x559a10da0ab0 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb56a000640 1 -- 172.21.15.99:0/3273283073 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fb57c003970 con 0x559a10da0ab0 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb58e5d1740 10 client.5766 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb58e5d1740 10 client.5766 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb58e5d1740 20 client.5766 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a10d9ef40 0x559a10d9f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb58e5d1740 4 client.5766 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.684+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3273283073 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a10cef870 con 0x559a10d9ef40 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.685+0000 7fb588e00640 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a10d9ef40 0x559a10d9f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.686+0000 7fb588e00640 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a10d9ef40 0x559a10d9f370 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbd555e916a5789 server_cookie=3c3c9da16e2ff645 in_seq=0 out_seq=0 2024-03-30T13:13:17.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.686+0000 7fb56a000640 10 client.5766 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.687+0000 7fb56a000640 1 -- 172.21.15.99:0/3273283073 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x559a10cef870 con 0x559a10d9ef40 2024-03-30T13:13:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.687+0000 7fb56a000640 10 client.5766 handle_command_reply: tid=0 2024-03-30T13:13:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 1 client.5766 shutdown 2024-03-30T13:13:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3273283073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 msgr2=0x559a10d92140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10d92140 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x559a10dad850 tx=0x7fb57c001470 comp rx=0 tx=0).stop 2024-03-30T13:13:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3273283073 shutdown_connections 2024-03-30T13:13:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10d92140 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f850 0x559a10da9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a10d9ef40 0x559a10d9f370 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/3273283073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f470 0x559a10da31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3273283073 >> 172.21.15.99:0/3273283073 conn(0x559a10d45be0 msgr2=0x559a10d78b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb56a000640 0 client.5766 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3273283073 shutdown_connections 2024-03-30T13:13:17.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3273283073 wait complete. 2024-03-30T13:13:17.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.688+0000 7fb58e5d1740 20 client.5766 trim_cache size 0 max 16384 2024-03-30T13:13:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.704+0000 7fb58e5d1740 1 Processor -- start 2024-03-30T13:13:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.704+0000 7fb58e5d1740 1 -- start start 2024-03-30T13:13:17.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f470 0x559a10dc7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f850 0x559a10dc8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10ddd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb584200bc0 con 0x559a10da0ab0 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb5841ffd30 con 0x559a10d7f850 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb58409b490 con 0x559a10d7f470 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb589800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10ddd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb589800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10ddd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48446/0 (socket says 172.21.15.99:48446) 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb589800640 1 -- 172.21.15.99:0/3598395844 learned_addr learned my addr 172.21.15.99:0/3598395844 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb588e00640 1 --2- 172.21.15.99:0/3598395844 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f470 0x559a10dc7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb589800640 1 -- 172.21.15.99:0/3598395844 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f470 msgr2=0x559a10dc7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb589800640 1 --2- 172.21.15.99:0/3598395844 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f470 0x559a10dc7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb589800640 1 -- 172.21.15.99:0/3598395844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f850 msgr2=0x559a10dc8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb589800640 1 --2- 172.21.15.99:0/3598395844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f850 0x559a10dc8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.705+0000 7fb589800640 1 -- 172.21.15.99:0/3598395844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a1098f2d0 con 0x559a10da0ab0 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.706+0000 7fb589800640 1 --2- 172.21.15.99:0/3598395844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10ddd560 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb57c007d00 tx=0x7fb57c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e992d0c9a54b3878 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.706+0000 7fb574c00640 1 -- 172.21.15.99:0/3598395844 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c034070 con 0x559a10da0ab0 2024-03-30T13:13:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.706+0000 7fb574c00640 1 -- 172.21.15.99:0/3598395844 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb57c018040 con 0x559a10da0ab0 2024-03-30T13:13:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.706+0000 7fb574c00640 1 -- 172.21.15.99:0/3598395844 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c022070 con 0x559a10da0ab0 2024-03-30T13:13:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.707+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3598395844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 msgr2=0x559a10ddd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.707+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/3598395844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10ddd560 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb57c007d00 tx=0x7fb57c01c000 comp rx=0 tx=0).stop 2024-03-30T13:13:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.707+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3598395844 shutdown_connections 2024-03-30T13:13:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.707+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/3598395844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10da0ab0 0x559a10ddd560 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.707+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/3598395844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10d7f850 0x559a10dc8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.707+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/3598395844 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f470 0x559a10dc7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.707+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3598395844 >> 172.21.15.99:0/3598395844 conn(0x559a10d45be0 msgr2=0x559a10da9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.707+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3598395844 shutdown_connections 2024-03-30T13:13:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.707+0000 7fb58e5d1740 1 -- 172.21.15.99:0/3598395844 wait complete. 2024-03-30T13:13:17.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.708+0000 7fb58e5d1740 1 -- start start 2024-03-30T13:13:17.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.708+0000 7fb58e5d1740 1 Processor -- start 2024-03-30T13:13:17.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f470 0x559a10e47690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f850 0x559a10d783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb58e5d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10da0ab0 0x559a10d78930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb58409bae0 con 0x559a10d7f470 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559a10d7e060 con 0x559a10da0ab0 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb58e5d1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x559a10dd3670 con 0x559a10d7f850 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb58e5d1740 10 client.0 _ll_register_callbacks cb 0x7fb57c015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb588e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f470 0x559a10e47690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb588e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f470 0x559a10e47690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48454/0 (socket says 172.21.15.99:48454) 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb588e00640 1 -- 172.21.15.99:0/2584224 learned_addr learned my addr 172.21.15.99:0/2584224 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb588e00640 1 -- 172.21.15.99:0/2584224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f850 msgr2=0x559a10d783f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb588e00640 1 --2- 172.21.15.99:0/2584224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f850 0x559a10d783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb588e00640 1 -- 172.21.15.99:0/2584224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10da0ab0 msgr2=0x559a10d78930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb588e00640 1 --2- 172.21.15.99:0/2584224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10da0ab0 0x559a10d78930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.709+0000 7fb588e00640 1 -- 172.21.15.99:0/2584224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a10dc14a0 con 0x559a10d7f470 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.710+0000 7fb588e00640 1 --2- 172.21.15.99:0/2584224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f470 0x559a10e47690 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb578077630 tx=0x7fb5780ad040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a1b1847e97896c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.710+0000 7fb56a000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.710+0000 7fb56a000640 1 -- 172.21.15.99:0/2584224 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57804c040 con 0x559a10d7f470 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.710+0000 7fb56a000640 1 -- 172.21.15.99:0/2584224 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fb578077840 con 0x559a10d7f470 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.710+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2584224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb57c018040 con 0x559a10d7f470 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.710+0000 7fb56a000640 1 -- 172.21.15.99:0/2584224 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb5780ab2f0 con 0x559a10d7f470 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.710+0000 7fb58e5d1740 10 client.5772 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.710+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2584224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x559a10d7dab0 con 0x559a10d7f470 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.710+0000 7fb56a000640 1 -- 172.21.15.99:0/2584224 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb57c018040 con 0x559a10d7f470 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.710+0000 7fb56a000640 1 -- 172.21.15.99:0/2584224 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fb578032070 con 0x559a10d7f470 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.711+0000 7fb58e5d1740 10 client.5772 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.711+0000 7fb58e5d1740 10 client.5772 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.711+0000 7fb58e5d1740 20 client.5772 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:17.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.711+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/2584224 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a10dddb70 0x559a10dd27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.711+0000 7fb58e5d1740 4 client.5772 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628344}] 2024-03-30T13:13:17.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.711+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2584224 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628344}) -- 0x559a10ce9bc0 con 0x559a10dddb70 2024-03-30T13:13:17.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.711+0000 7fb583e00640 1 --2- 172.21.15.99:0/2584224 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a10dddb70 0x559a10dd27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.712+0000 7fb583e00640 1 --2- 172.21.15.99:0/2584224 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a10dddb70 0x559a10dd27c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3be71830122e9044 server_cookie=d5f832f2dbd47f36 in_seq=0 out_seq=0 2024-03-30T13:13:17.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.712+0000 7fb56a000640 10 client.5772 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb56a000640 1 -- 172.21.15.99:0/2584224 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3983 (crc 0 0 0) 0x559a10ce9bc0 con 0x559a10dddb70 2024-03-30T13:13:17.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb56a000640 10 client.5772 handle_command_reply: tid=0 2024-03-30T13:13:17.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb58e5d1740 1 client.5772 shutdown 2024-03-30T13:13:17.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2584224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f470 msgr2=0x559a10e47690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/2584224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f470 0x559a10e47690 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb578077630 tx=0x7fb5780ad040 comp rx=0 tx=0).stop 2024-03-30T13:13:17.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2584224 shutdown_connections 2024-03-30T13:13:17.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/2584224 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559a10dddb70 0x559a10dd27c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/2584224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559a10da0ab0 0x559a10d78930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/2584224 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559a10d7f850 0x559a10d783f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb58e5d1740 1 --2- 172.21.15.99:0/2584224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a10d7f470 0x559a10e47690 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2584224 >> 172.21.15.99:0/2584224 conn(0x559a10d45be0 msgr2=0x559a10dc7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.713+0000 7fb56a000640 0 client.5772 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.714+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2584224 shutdown_connections 2024-03-30T13:13:17.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.714+0000 7fb58e5d1740 1 -- 172.21.15.99:0/2584224 wait complete. 2024-03-30T13:13:17.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.714+0000 7fb58e5d1740 20 client.5772 trim_cache size 0 max 16384 2024-03-30T13:13:17.720 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-dev-proto.h", 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628344, 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.511453+0000", 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.684951+0000", 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2111, 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.684951+0000", 2024-03-30T13:13:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 4, 2024-03-30T13:13:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2111, 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.511453+0000" 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2111, 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.511453+0000" 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 178, 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 34, 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:41.323183+0000", 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 96, 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:17.733 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:17.733 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:17.733 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:17.733 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:17.733 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:17.733 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:17.733 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:17.733 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:17.734 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:17.734 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:17.734 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:17.734 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:17.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.734 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:17.734 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:17.735 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:17.735 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:17.735 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:17.735 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:17.735 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:17.735 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:17.735 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:17.736 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:17.736 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:17.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:17.736 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:17.736 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:17.736 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:17.737 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:17.737 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:17.737 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.737 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:17.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:17.737 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:17.737 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:17.738 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:17.738 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:17.738 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:17.738 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:17.738 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:17.738 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:17.738 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:17.739 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:17.739 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:17.739 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:17.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.714+0000 7fb58a200640 1 -- 172.21.15.99:0/105116251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb56406c560 msgr2=0x7fb56406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.714+0000 7fb58a200640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb56406c560 0x7fb56406ea20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb584145350 tx=0x7fb5700010a0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.714+0000 7fb58a200640 1 -- 172.21.15.99:0/105116251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840acf20 msgr2=0x7fb584143350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.714+0000 7fb58a200640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840acf20 0x7fb584143350 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb5780098c0 tx=0x7fb5780046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.714+0000 7fb58a200640 1 -- 172.21.15.99:0/105116251 shutdown_connections 2024-03-30T13:13:17.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.714+0000 7fb58a200640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb56406c560 0x7fb56406ea20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.714+0000 7fb58a200640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb58415d190 0x7fb58415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.715+0000 7fb58a200640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5840cf330 0x7fb58415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.715+0000 7fb58a200640 1 --2- 172.21.15.99:0/105116251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840acf20 0x7fb584143350 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.715+0000 7fb58a200640 1 -- 172.21.15.99:0/105116251 >> 172.21.15.99:0/105116251 conn(0x7fb58406bb40 msgr2=0x7fb5840b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.715+0000 7fb58a200640 1 -- 172.21.15.99:0/105116251 shutdown_connections 2024-03-30T13:13:17.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.715+0000 7fb58a200640 1 -- 172.21.15.99:0/105116251 wait complete. 2024-03-30T13:13:17.743 DEBUG:tasks.cephfs.test_uninlining:getting inode info #21 of 23:1099511628329 2024-03-30T13:13:17.744 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628329 2024-03-30T13:13:17.744 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628329 2024-03-30T13:13:17.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.950+0000 7f23fb600640 1 Processor -- start 2024-03-30T13:13:17.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.950+0000 7f23fb600640 1 -- start start 2024-03-30T13:13:17.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.952+0000 7f23fb600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e590 0x7f23f40c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.952+0000 7f23fb600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f23f415e970 0x7f23f40cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.952+0000 7f23fb600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23f40c6100 con 0x7f23f40cf680 2024-03-30T13:13:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.952+0000 7f23fb600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f23f40cfc90 con 0x7f23f415e970 2024-03-30T13:13:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.952+0000 7f23fb600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f23f40cff70 con 0x7f23f415e590 2024-03-30T13:13:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.953+0000 7f23f8c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e590 0x7f23f40c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.953+0000 7f23f8c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e590 0x7f23f40c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:43148/0 (socket says 172.21.15.99:43148) 2024-03-30T13:13:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.953+0000 7f23f8c00640 1 -- 172.21.15.99:0/596107780 learned_addr learned my addr 172.21.15.99:0/596107780 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.953+0000 7f23ebe00640 1 --2- 172.21.15.99:0/596107780 >> v2:172.21.15.181:3300/0 conn(0x7f23f415e970 0x7f23f40cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.954+0000 7f23f8c00640 1 -- 172.21.15.99:0/596107780 >> v2:172.21.15.181:3300/0 conn(0x7f23f415e970 msgr2=0x7f23f40cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.954+0000 7f23f8c00640 1 --2- 172.21.15.99:0/596107780 >> v2:172.21.15.181:3300/0 conn(0x7f23f415e970 0x7f23f40cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.954+0000 7f23f3e00640 1 -- 172.21.15.99:0/596107780 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935534092 0 0) 0x7f23f40c6100 con 0x7f23f40cf680 2024-03-30T13:13:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.954+0000 7f23f8c00640 1 -- 172.21.15.99:0/596107780 >> v1:172.21.15.181:6789/0 conn(0x7f23f40cf680 legacy=0x7f23f40b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.954+0000 7f23f8c00640 1 -- 172.21.15.99:0/596107780 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f40c63c0 con 0x7f23f415e590 2024-03-30T13:13:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.955+0000 7f23f8c00640 1 --2- 172.21.15.99:0/596107780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e590 0x7f23f40c6bc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009870 tx=0x7f23e402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6f935b28a8739af server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.956+0000 7f23f3e00640 1 -- 172.21.15.99:0/596107780 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4035020 con 0x7f23f415e590 2024-03-30T13:13:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.956+0000 7f23f3e00640 1 -- 172.21.15.99:0/596107780 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e4031640 con 0x7f23f415e590 2024-03-30T13:13:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.956+0000 7f23f3e00640 1 -- 172.21.15.99:0/596107780 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e402d040 con 0x7f23f415e590 2024-03-30T13:13:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.956+0000 7f23fb600640 1 -- 172.21.15.99:0/596107780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e590 msgr2=0x7f23f40c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.956+0000 7f23fb600640 1 --2- 172.21.15.99:0/596107780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e590 0x7f23f40c6bc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009870 tx=0x7f23e402b8f0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.957+0000 7f23fb600640 1 -- 172.21.15.99:0/596107780 shutdown_connections 2024-03-30T13:13:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.957+0000 7f23fb600640 1 --2- 172.21.15.99:0/596107780 >> v2:172.21.15.181:3300/0 conn(0x7f23f415e970 0x7f23f40cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.957+0000 7f23fb600640 1 --2- 172.21.15.99:0/596107780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e590 0x7f23f40c6bc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.957+0000 7f23fb600640 1 -- 172.21.15.99:0/596107780 >> 172.21.15.99:0/596107780 conn(0x7f23f40d0450 msgr2=0x7f23f40d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.957+0000 7f23fb600640 1 -- 172.21.15.99:0/596107780 shutdown_connections 2024-03-30T13:13:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.957+0000 7f23fb600640 1 -- 172.21.15.99:0/596107780 wait complete. 2024-03-30T13:13:17.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.959+0000 7f23fb600640 1 Processor -- start 2024-03-30T13:13:17.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.959+0000 7f23fb600640 1 -- start start 2024-03-30T13:13:17.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.960+0000 7f23fb600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40cf680 0x7f23f4160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.960+0000 7f23fb600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23f415e590 0x7f23f4072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.960+0000 7f23fb600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e970 0x7f23f4073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.960+0000 7f23fb600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f23f40cca70 con 0x7f23f40cf680 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.960+0000 7f23fb600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f23f40cc8f0 con 0x7f23f415e590 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.960+0000 7f23fb600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f23f40b2810 con 0x7f23f415e970 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.961+0000 7f23f8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40cf680 0x7f23f4160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.961+0000 7f23f8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40cf680 0x7f23f4160fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48460/0 (socket says 172.21.15.99:48460) 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.961+0000 7f23f8c00640 1 -- 172.21.15.99:0/841468660 learned_addr learned my addr 172.21.15.99:0/841468660 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.961+0000 7f23f9600640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e970 0x7f23f4073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.961+0000 7f23ebe00640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23f415e590 0x7f23f4072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.961+0000 7f23f8c00640 1 -- 172.21.15.99:0/841468660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e970 msgr2=0x7f23f4073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.961+0000 7f23f8c00640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e970 0x7f23f4073300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.961+0000 7f23f8c00640 1 -- 172.21.15.99:0/841468660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23f415e590 msgr2=0x7f23f4072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.961+0000 7f23f8c00640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23f415e590 0x7f23f4072dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.961+0000 7f23f8c00640 1 -- 172.21.15.99:0/841468660 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f40c8fb0 con 0x7f23f40cf680 2024-03-30T13:13:17.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.961+0000 7f23f9600640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e970 0x7f23f4073300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.962+0000 7f23f8c00640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40cf680 0x7f23f4160fc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f23e402b930 tx=0x7f23e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.962+0000 7f23f1600640 1 -- 172.21.15.99:0/841468660 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4040070 con 0x7f23f40cf680 2024-03-30T13:13:17.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.962+0000 7f23f1600640 1 -- 172.21.15.99:0/841468660 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e40399f0 con 0x7f23f40cf680 2024-03-30T13:13:17.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.962+0000 7f23f1600640 1 -- 172.21.15.99:0/841468660 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4035040 con 0x7f23f40cf680 2024-03-30T13:13:17.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.962+0000 7f23fb600640 1 -- 172.21.15.99:0/841468660 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f40c9290 con 0x7f23f40cf680 2024-03-30T13:13:17.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.962+0000 7f23fb600640 1 -- 172.21.15.99:0/841468660 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f4161500 con 0x7f23f40cf680 2024-03-30T13:13:17.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.964+0000 7f23f1600640 1 -- 172.21.15.99:0/841468660 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f23e4038020 con 0x7f23f40cf680 2024-03-30T13:13:17.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.966+0000 7f23f1600640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f23d006c560 0x7f23d006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.966+0000 7f23f1600640 1 -- 172.21.15.99:0/841468660 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f23e40ad150 con 0x7f23f40cf680 2024-03-30T13:13:17.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.966+0000 7f23ebe00640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f23d006c560 0x7f23d006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.966+0000 7f23fe3bd740 1 Processor -- start 2024-03-30T13:13:17.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.966+0000 7f23ebe00640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f23d006c560 0x7f23d006ea20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f23f41f7ce0 tx=0x7f23dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.967+0000 7f23fe3bd740 1 -- start start 2024-03-30T13:13:17.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.967+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244290 0x55882326adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.967+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55882326b300 0x5588232432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.967+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244670 0x558823243810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.967+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5588231a7330 con 0x558823244670 2024-03-30T13:13:17.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.967+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55882314f620 con 0x55882326b300 2024-03-30T13:13:17.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.967+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5588231a3440 con 0x558823244290 2024-03-30T13:13:17.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.968+0000 7f23f9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244670 0x558823243810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.968+0000 7f23f9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244670 0x558823243810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48474/0 (socket says 172.21.15.99:48474) 2024-03-30T13:13:17.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.968+0000 7f23f9600640 1 -- 172.21.15.99:0/71234187 learned_addr learned my addr 172.21.15.99:0/71234187 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.968+0000 7f23f8c00640 1 --2- 172.21.15.99:0/71234187 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244290 0x55882326adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.968+0000 7f23ebe00640 1 --2- 172.21.15.99:0/71234187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55882326b300 0x5588232432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.968+0000 7f23f9600640 1 -- 172.21.15.99:0/71234187 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244290 msgr2=0x55882326adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.968+0000 7f23f9600640 1 --2- 172.21.15.99:0/71234187 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244290 0x55882326adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.968+0000 7f23f9600640 1 -- 172.21.15.99:0/71234187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55882326b300 msgr2=0x5588232432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.968+0000 7f23f9600640 1 --2- 172.21.15.99:0/71234187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55882326b300 0x5588232432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.968+0000 7f23f9600640 1 -- 172.21.15.99:0/71234187 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558822f87920 con 0x558823244670 2024-03-30T13:13:17.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.968+0000 7f23f9600640 1 --2- 172.21.15.99:0/71234187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244670 0x558823243810 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f23ec001d90 tx=0x7f23ec00d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89078c9bf924d132 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.969+0000 7f23e9200640 1 -- 172.21.15.99:0/71234187 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec018070 con 0x558823244670 2024-03-30T13:13:17.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.969+0000 7f23e9200640 1 -- 172.21.15.99:0/71234187 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23ec003da0 con 0x558823244670 2024-03-30T13:13:17.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.969+0000 7f23e9200640 1 -- 172.21.15.99:0/71234187 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec00db60 con 0x558823244670 2024-03-30T13:13:17.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.969+0000 7f23fe3bd740 1 -- 172.21.15.99:0/71234187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244670 msgr2=0x558823243810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.969+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/71234187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244670 0x558823243810 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f23ec001d90 tx=0x7f23ec00d150 comp rx=0 tx=0).stop 2024-03-30T13:13:17.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.969+0000 7f23fe3bd740 1 -- 172.21.15.99:0/71234187 shutdown_connections 2024-03-30T13:13:17.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.969+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/71234187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244670 0x558823243810 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.969+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/71234187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55882326b300 0x5588232432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.969+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/71234187 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244290 0x55882326adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.969+0000 7f23fe3bd740 1 -- 172.21.15.99:0/71234187 >> 172.21.15.99:0/71234187 conn(0x55882320abe0 msgr2=0x558823288fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.969+0000 7f23fe3bd740 1 -- 172.21.15.99:0/71234187 shutdown_connections 2024-03-30T13:13:17.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.970+0000 7f23fe3bd740 1 -- 172.21.15.99:0/71234187 wait complete. 2024-03-30T13:13:17.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.970+0000 7f23fe3bd740 1 -- start start 2024-03-30T13:13:17.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.970+0000 7f23fe3bd740 1 Processor -- start 2024-03-30T13:13:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.971+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823298d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.971+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823244670 0x558823289200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.971+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823262380 0x558823289740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.971+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55882326a930 con 0x558823244290 2024-03-30T13:13:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.971+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5588231629d0 con 0x558823244670 2024-03-30T13:13:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.971+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5588232636b0 con 0x558823262380 2024-03-30T13:13:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.971+0000 7f23fe3bd740 10 client.0 _ll_register_callbacks cb 0x55882319efd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23f8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823298d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23f8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823298d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48482/0 (socket says 172.21.15.99:48482) 2024-03-30T13:13:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23f8c00640 1 -- 172.21.15.99:0/2343587076 learned_addr learned my addr 172.21.15.99:0/2343587076 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23ebe00640 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823244670 0x558823289200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23f9600640 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823262380 0x558823289740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23f8c00640 1 -- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823262380 msgr2=0x558823289740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23f8c00640 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823262380 0x558823289740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23f8c00640 1 -- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823244670 msgr2=0x558823289200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23f8c00640 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823244670 0x558823289200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23f8c00640 1 -- 172.21.15.99:0/2343587076 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558822e7b210 con 0x558823244290 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23ebe00640 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823244670 0x558823289200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23f8c00640 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823298d70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f23e407aee0 tx=0x7f23e407b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6db62ae5f27f85 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.972+0000 7f23e1600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23e1600640 1 -- 172.21.15.99:0/2343587076 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e40930d0 con 0x558823244290 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23e1600640 1 -- 172.21.15.99:0/2343587076 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f23e4093270 con 0x558823244290 2024-03-30T13:13:17.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23fe3bd740 1 -- 172.21.15.99:0/2343587076 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23ec003da0 con 0x558823244290 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23e1600640 1 -- 172.21.15.99:0/2343587076 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f23e40ab0d0 con 0x558823244290 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23fe3bd740 10 client.5781 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23fe3bd740 1 -- 172.21.15.99:0/2343587076 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x558822fe80b0 con 0x558823244290 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23e1600640 1 -- 172.21.15.99:0/2343587076 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23ec003da0 con 0x558823244290 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23e1600640 1 -- 172.21.15.99:0/2343587076 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f23e404cc50 con 0x558823244290 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23fe3bd740 10 client.5781 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23fe3bd740 10 client.5781 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23fe3bd740 20 client.5781 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55882328aed0 0x5588232868c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23fe3bd740 4 client.5781 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.973+0000 7f23fe3bd740 1 -- 172.21.15.99:0/2343587076 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588231b4870 con 0x55882328aed0 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.974+0000 7f23ebe00640 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55882328aed0 0x5588232868c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.975+0000 7f23ebe00640 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55882328aed0 0x5588232868c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e23132dc8f4c7ec server_cookie=b2970436e6d22147 in_seq=0 out_seq=0 2024-03-30T13:13:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.975+0000 7f23e1600640 10 client.5781 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23e1600640 1 -- 172.21.15.99:0/2343587076 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5588231b4870 con 0x55882328aed0 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23e1600640 10 client.5781 handle_command_reply: tid=0 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 1 client.5781 shutdown 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 1 -- 172.21.15.99:0/2343587076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 msgr2=0x558823298d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823298d70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f23e407aee0 tx=0x7f23e407b090 comp rx=0 tx=0).stop 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 1 -- 172.21.15.99:0/2343587076 shutdown_connections 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823262380 0x558823289740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55882328aed0 0x5588232868c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823244670 0x558823289200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/2343587076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823298d70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23e1600640 0 client.5781 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 1 -- 172.21.15.99:0/2343587076 >> 172.21.15.99:0/2343587076 conn(0x55882320abe0 msgr2=0x558823269ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 1 -- 172.21.15.99:0/2343587076 shutdown_connections 2024-03-30T13:13:17.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 1 -- 172.21.15.99:0/2343587076 wait complete. 2024-03-30T13:13:17.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.977+0000 7f23fe3bd740 20 client.5781 trim_cache size 0 max 16384 2024-03-30T13:13:17.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.993+0000 7f23fe3bd740 1 Processor -- start 2024-03-30T13:13:17.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.993+0000 7f23fe3bd740 1 -- start start 2024-03-30T13:13:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.994+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823244290 0x55882328bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.994+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244670 0x55882326c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.994+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823262380 0x5588233069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.994+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f23f4200e40 con 0x558823262380 2024-03-30T13:13:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.994+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f23f41fffd0 con 0x558823244290 2024-03-30T13:13:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.994+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f23f415fe00 con 0x558823244670 2024-03-30T13:13:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.994+0000 7f23f9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823262380 0x5588233069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.994+0000 7f23f9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823262380 0x5588233069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48488/0 (socket says 172.21.15.99:48488) 2024-03-30T13:13:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.994+0000 7f23f9600640 1 -- 172.21.15.99:0/781380325 learned_addr learned my addr 172.21.15.99:0/781380325 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.995+0000 7f23ebe00640 1 --2- 172.21.15.99:0/781380325 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244670 0x55882326c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.995+0000 7f23f9600640 1 -- 172.21.15.99:0/781380325 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244670 msgr2=0x55882326c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.995+0000 7f23f9600640 1 --2- 172.21.15.99:0/781380325 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244670 0x55882326c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.995+0000 7f23f9600640 1 -- 172.21.15.99:0/781380325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823244290 msgr2=0x55882328bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.995+0000 7f23f9600640 1 --2- 172.21.15.99:0/781380325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823244290 0x55882328bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.995+0000 7f23f9600640 1 -- 172.21.15.99:0/781380325 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558822e542d0 con 0x558823262380 2024-03-30T13:13:18.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.995+0000 7f23f9600640 1 --2- 172.21.15.99:0/781380325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823262380 0x5588233069c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x558823272670 tx=0x7f23ec00b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5763acedc44f2709 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.995+0000 7f23e3e00640 1 -- 172.21.15.99:0/781380325 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec024070 con 0x558823262380 2024-03-30T13:13:18.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.995+0000 7f23e3e00640 1 -- 172.21.15.99:0/781380325 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23ec001950 con 0x558823262380 2024-03-30T13:13:18.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.995+0000 7f23e3e00640 1 -- 172.21.15.99:0/781380325 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec018030 con 0x558823262380 2024-03-30T13:13:18.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.996+0000 7f23fe3bd740 1 -- 172.21.15.99:0/781380325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823262380 msgr2=0x5588233069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.996+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/781380325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823262380 0x5588233069c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x558823272670 tx=0x7f23ec00b000 comp rx=0 tx=0).stop 2024-03-30T13:13:18.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.996+0000 7f23fe3bd740 1 -- 172.21.15.99:0/781380325 shutdown_connections 2024-03-30T13:13:18.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.996+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/781380325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823262380 0x5588233069c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.996+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/781380325 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244670 0x55882326c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.996+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/781380325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823244290 0x55882328bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.996+0000 7f23fe3bd740 1 -- 172.21.15.99:0/781380325 >> 172.21.15.99:0/781380325 conn(0x55882320abe0 msgr2=0x558823269f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.996+0000 7f23fe3bd740 1 -- 172.21.15.99:0/781380325 shutdown_connections 2024-03-30T13:13:18.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.996+0000 7f23fe3bd740 1 -- 172.21.15.99:0/781380325 wait complete. 2024-03-30T13:13:18.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.997+0000 7f23fe3bd740 1 -- start start 2024-03-30T13:13:18.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.997+0000 7f23fe3bd740 1 Processor -- start 2024-03-30T13:13:18.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.998+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823300cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.998+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244670 0x558823304100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.998+0000 7f23fe3bd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823262380 0x558823304640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.998+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5588232a2d80 con 0x558823244290 2024-03-30T13:13:18.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.998+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f23f4160450 con 0x558823262380 2024-03-30T13:13:18.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.998+0000 7f23fe3bd740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x558823287f00 con 0x558823244670 2024-03-30T13:13:18.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.998+0000 7f23fe3bd740 10 client.0 _ll_register_callbacks cb 0x7f23e407b6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:18.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.998+0000 7f23f8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823300cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.998+0000 7f23f8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823300cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48504/0 (socket says 172.21.15.99:48504) 2024-03-30T13:13:18.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.998+0000 7f23f8c00640 1 -- 172.21.15.99:0/3687818127 learned_addr learned my addr 172.21.15.99:0/3687818127 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23f8c00640 1 -- 172.21.15.99:0/3687818127 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244670 msgr2=0x558823304100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23f8c00640 1 --2- 172.21.15.99:0/3687818127 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244670 0x558823304100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23f8c00640 1 -- 172.21.15.99:0/3687818127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823262380 msgr2=0x558823304640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23f8c00640 1 --2- 172.21.15.99:0/3687818127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823262380 0x558823304640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23f8c00640 1 -- 172.21.15.99:0/3687818127 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558823271630 con 0x558823244290 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23f8c00640 1 --2- 172.21.15.99:0/3687818127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823300cd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f23e4083600 tx=0x7f23e4031f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57c3507050db6f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23e1600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23e1600640 1 -- 172.21.15.99:0/3687818127 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e40771f0 con 0x558823244290 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23e1600640 1 -- 172.21.15.99:0/3687818127 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f23e40836a0 con 0x558823244290 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23fe3bd740 1 -- 172.21.15.99:0/3687818127 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23ec001950 con 0x558823244290 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23e1600640 1 -- 172.21.15.99:0/3687818127 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f23e40a0050 con 0x558823244290 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23fe3bd740 10 client.5787 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:17.999+0000 7f23fe3bd740 1 -- 172.21.15.99:0/3687818127 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5588232ab9d0 con 0x558823244290 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.000+0000 7f23e1600640 1 -- 172.21.15.99:0/3687818127 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23ec001950 con 0x558823244290 2024-03-30T13:13:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.000+0000 7f23e1600640 1 -- 172.21.15.99:0/3687818127 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f23e40a3020 con 0x558823244290 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.000+0000 7f23fe3bd740 10 client.5787 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.000+0000 7f23fe3bd740 10 client.5787 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.000+0000 7f23fe3bd740 20 client.5787 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.000+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/3687818127 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x558823239d10 0x558823289170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.000+0000 7f23fe3bd740 4 client.5787 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628329}] 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.000+0000 7f23fe3bd740 1 -- 172.21.15.99:0/3687818127 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628329}) -- 0x5588231aebc0 con 0x558823239d10 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.000+0000 7f23ebe00640 1 --2- 172.21.15.99:0/3687818127 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x558823239d10 0x558823289170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.001+0000 7f23ebe00640 1 --2- 172.21.15.99:0/3687818127 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x558823239d10 0x558823289170 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a61459a7ebc59a1c server_cookie=c5f8c23b854ff342 in_seq=0 out_seq=0 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.001+0000 7f23e1600640 10 client.5787 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23e1600640 1 -- 172.21.15.99:0/3687818127 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3967 (crc 0 0 0) 0x5588231aebc0 con 0x558823239d10 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23e1600640 10 client.5787 handle_command_reply: tid=0 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23fe3bd740 1 client.5787 shutdown 2024-03-30T13:13:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23fe3bd740 1 -- 172.21.15.99:0/3687818127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 msgr2=0x558823300cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/3687818127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823300cd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f23e4083600 tx=0x7f23e4031f90 comp rx=0 tx=0).stop 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23fe3bd740 1 -- 172.21.15.99:0/3687818127 shutdown_connections 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/3687818127 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x558823239d10 0x558823289170 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/3687818127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558823262380 0x558823304640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/3687818127 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x558823244670 0x558823304100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23fe3bd740 1 --2- 172.21.15.99:0/3687818127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558823244290 0x558823300cd0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23e1600640 0 client.5787 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.002+0000 7f23fe3bd740 1 -- 172.21.15.99:0/3687818127 >> 172.21.15.99:0/3687818127 conn(0x55882320abe0 msgr2=0x55882326a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.003+0000 7f23fe3bd740 1 -- 172.21.15.99:0/3687818127 shutdown_connections 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.003+0000 7f23fe3bd740 1 -- 172.21.15.99:0/3687818127 wait complete. 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.003+0000 7f23fe3bd740 20 client.5787 trim_cache size 0 max 16384 2024-03-30T13:13:18.011 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/Makefile", 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628329, 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.512049+0000", 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.644952+0000", 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 356, 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.644952+0000", 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 356, 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.512049+0000" 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 356, 2024-03-30T13:13:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.512049+0000" 2024-03-30T13:13:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 192, 2024-03-30T13:13:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 4, 2024-03-30T13:13:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:41.322105+0000", 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 98, 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:18.020 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:18.020 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:18.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.020 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:18.020 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:18.020 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:18.020 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:18.021 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:18.021 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:18.021 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:18.021 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:18.021 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:18.021 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:18.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.021 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:18.021 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:18.021 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:18.021 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:18.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:18.023 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:18.024 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:18.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.003+0000 7f23fb600640 1 -- 172.21.15.99:0/841468660 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f23d006c560 msgr2=0x7f23d006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.003+0000 7f23fb600640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f23d006c560 0x7f23d006ea20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f23f41f7ce0 tx=0x7f23dc008040 comp rx=0 tx=0).stop 2024-03-30T13:13:18.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.003+0000 7f23fb600640 1 -- 172.21.15.99:0/841468660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40cf680 msgr2=0x7f23f4160fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.003+0000 7f23fb600640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40cf680 0x7f23f4160fc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f23e402b930 tx=0x7f23e40046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.004+0000 7f23fb600640 1 -- 172.21.15.99:0/841468660 shutdown_connections 2024-03-30T13:13:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.004+0000 7f23fb600640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f23d006c560 0x7f23d006ea20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.004+0000 7f23fb600640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23f415e970 0x7f23f4073300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.004+0000 7f23fb600640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23f415e590 0x7f23f4072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.004+0000 7f23fb600640 1 --2- 172.21.15.99:0/841468660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23f40cf680 0x7f23f4160fc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.004+0000 7f23fb600640 1 -- 172.21.15.99:0/841468660 >> 172.21.15.99:0/841468660 conn(0x7f23f40d0450 msgr2=0x7f23f406e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.004+0000 7f23fb600640 1 -- 172.21.15.99:0/841468660 shutdown_connections 2024-03-30T13:13:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.004+0000 7f23fb600640 1 -- 172.21.15.99:0/841468660 wait complete. 2024-03-30T13:13:18.027 DEBUG:tasks.cephfs.test_uninlining:getting inode info #22 of 23:1099511628352 2024-03-30T13:13:18.028 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628352 2024-03-30T13:13:18.028 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628352 2024-03-30T13:13:18.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.224+0000 7f92a9600640 1 Processor -- start 2024-03-30T13:13:18.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.224+0000 7f92a9600640 1 -- start start 2024-03-30T13:13:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.226+0000 7f92a9600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f92a415e570 0x7f92a406d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.226+0000 7f92a9600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a4073690 0x7f92a40acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.226+0000 7f92a9600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92a415e950 con 0x7f92a406db70 2024-03-30T13:13:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.226+0000 7f92a9600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f92a406f0b0 con 0x7f92a415e570 2024-03-30T13:13:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.226+0000 7f92a9600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f92a406e010 con 0x7f92a4073690 2024-03-30T13:13:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.227+0000 7f92a8c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a4073690 0x7f92a40acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.227+0000 7f92a3e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f92a415e570 0x7f92a406d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.227+0000 7f92a3400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f92a406db70 0x7f92a4072f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:55862/0 (socket says 172.21.15.99:55862) 2024-03-30T13:13:18.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.227+0000 7f92a3400640 1 -- 172.21.15.99:0/3491638432 learned_addr learned my addr 172.21.15.99:0/3491638432 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:18.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.228+0000 7f92a8c00640 1 -- 172.21.15.99:0/3491638432 >> v2:172.21.15.181:3300/0 conn(0x7f92a415e570 msgr2=0x7f92a406d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.228+0000 7f92a8c00640 1 --2- 172.21.15.99:0/3491638432 >> v2:172.21.15.181:3300/0 conn(0x7f92a415e570 0x7f92a406d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.228+0000 7f92a8c00640 1 -- 172.21.15.99:0/3491638432 >> v1:172.21.15.181:6789/0 conn(0x7f92a406db70 legacy=0x7f92a4072f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.228+0000 7f92a8c00640 1 -- 172.21.15.99:0/3491638432 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a406e2f0 con 0x7f92a4073690 2024-03-30T13:13:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.229+0000 7f92a8c00640 1 --2- 172.21.15.99:0/3491638432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a4073690 0x7f92a40acf20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f929c009d90 tx=0x7f929c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=103b628094928cf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.230+0000 7f92a2a00640 1 -- 172.21.15.99:0/3491638432 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c039070 con 0x7f92a4073690 2024-03-30T13:13:18.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.230+0000 7f92a2a00640 1 -- 172.21.15.99:0/3491638432 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929c02cce0 con 0x7f92a4073690 2024-03-30T13:13:18.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.230+0000 7f92a2a00640 1 -- 172.21.15.99:0/3491638432 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c034660 con 0x7f92a4073690 2024-03-30T13:13:18.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.231+0000 7f92a9600640 1 -- 172.21.15.99:0/3491638432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a4073690 msgr2=0x7f92a40acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.231+0000 7f92a9600640 1 --2- 172.21.15.99:0/3491638432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a4073690 0x7f92a40acf20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f929c009d90 tx=0x7f929c02bf30 comp rx=0 tx=0).stop 2024-03-30T13:13:18.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.231+0000 7f92a9600640 1 -- 172.21.15.99:0/3491638432 shutdown_connections 2024-03-30T13:13:18.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.231+0000 7f92a9600640 1 --2- 172.21.15.99:0/3491638432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a4073690 0x7f92a40acf20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.231+0000 7f92a9600640 1 --2- 172.21.15.99:0/3491638432 >> v2:172.21.15.181:3300/0 conn(0x7f92a415e570 0x7f92a406d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.231+0000 7f92a9600640 1 -- 172.21.15.99:0/3491638432 >> 172.21.15.99:0/3491638432 conn(0x7f92a406bb40 msgr2=0x7f92a40b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.231+0000 7f92a9600640 1 -- 172.21.15.99:0/3491638432 shutdown_connections 2024-03-30T13:13:18.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.231+0000 7f92a9600640 1 -- 172.21.15.99:0/3491638432 wait complete. 2024-03-30T13:13:18.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.233+0000 7f92a9600640 1 Processor -- start 2024-03-30T13:13:18.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.234+0000 7f92a9600640 1 -- start start 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.235+0000 7f92a9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a406db70 0x7f92a414bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.235+0000 7f92a9600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92a4073690 0x7f92a409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.235+0000 7f92a9600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a415e570 0x7f92a409c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.235+0000 7f92a9600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f92a406eb90 con 0x7f92a406db70 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.235+0000 7f92a9600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f92a406e8b0 con 0x7f92a4073690 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.235+0000 7f92a9600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f92a4072950 con 0x7f92a415e570 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.235+0000 7f92a3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a406db70 0x7f92a414bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.235+0000 7f92a3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a406db70 0x7f92a414bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48508/0 (socket says 172.21.15.99:48508) 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.235+0000 7f92a3e00640 1 -- 172.21.15.99:0/237690712 learned_addr learned my addr 172.21.15.99:0/237690712 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a3400640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92a4073690 0x7f92a409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a8c00640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a415e570 0x7f92a409c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a3e00640 1 -- 172.21.15.99:0/237690712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a415e570 msgr2=0x7f92a409c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a3e00640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a415e570 0x7f92a409c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a3e00640 1 -- 172.21.15.99:0/237690712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92a4073690 msgr2=0x7f92a409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a3e00640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92a4073690 0x7f92a409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a3e00640 1 -- 172.21.15.99:0/237690712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a409b4d0 con 0x7f92a406db70 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a3400640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92a4073690 0x7f92a409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a8c00640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a415e570 0x7f92a409c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a3e00640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a406db70 0x7f92a414bc20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f929400e9b0 tx=0x7f929400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f929be00640 1 -- 172.21.15.99:0/237690712 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294017070 con 0x7f92a406db70 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f929be00640 1 -- 172.21.15.99:0/237690712 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929400c9a0 con 0x7f92a406db70 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a9600640 1 -- 172.21.15.99:0/237690712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a409b7b0 con 0x7f92a406db70 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f929be00640 1 -- 172.21.15.99:0/237690712 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929400cd90 con 0x7f92a406db70 2024-03-30T13:13:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.236+0000 7f92a9600640 1 -- 172.21.15.99:0/237690712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a4154f90 con 0x7f92a406db70 2024-03-30T13:13:18.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.239+0000 7f929be00640 1 -- 172.21.15.99:0/237690712 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f929401a070 con 0x7f92a406db70 2024-03-30T13:13:18.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.239+0000 7f929be00640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928006c530 0x7f928006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.240+0000 7f929be00640 1 -- 172.21.15.99:0/237690712 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f929408b7e0 con 0x7f92a406db70 2024-03-30T13:13:18.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.240+0000 7f92a3400640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928006c530 0x7f928006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.240+0000 7f92ad9a2740 1 Processor -- start 2024-03-30T13:13:18.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.240+0000 7f92ad9a2740 1 -- start start 2024-03-30T13:13:18.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.240+0000 7f92a3400640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928006c530 0x7f928006e9f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f92a40cc2c0 tx=0x7f928c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.241+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244c8b470 0x55e244cb1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.241+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb24e0 0x55e244c8a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.241+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244c8a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.241+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e244bee330 con 0x55e244cb24e0 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.241+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e244b96620 con 0x55e244c8b850 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.241+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55e244bea440 con 0x55e244c8b470 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f92a3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb24e0 0x55e244c8a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f92a3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb24e0 0x55e244c8a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48516/0 (socket says 172.21.15.99:48516) 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f92a3400640 1 -- 172.21.15.99:0/3057751526 learned_addr learned my addr 172.21.15.99:0/3057751526 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f92a3e00640 1 --2- 172.21.15.99:0/3057751526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244c8b470 0x55e244cb1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f92a8c00640 1 --2- 172.21.15.99:0/3057751526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244c8a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f92a3400640 1 -- 172.21.15.99:0/3057751526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244c8b470 msgr2=0x55e244cb1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f92a3400640 1 --2- 172.21.15.99:0/3057751526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244c8b470 0x55e244cb1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f92a3400640 1 -- 172.21.15.99:0/3057751526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 msgr2=0x55e244c8a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f92a3400640 1 --2- 172.21.15.99:0/3057751526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244c8a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f92a3400640 1 -- 172.21.15.99:0/3057751526 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2449ce920 con 0x55e244cb24e0 2024-03-30T13:13:18.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f92a3400640 1 --2- 172.21.15.99:0/3057751526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb24e0 0x55e244c8a4b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f928c000f60 tx=0x7f928c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eeb0a65965a573 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.242+0000 7f9293e00640 1 -- 172.21.15.99:0/3057751526 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c00d8b0 con 0x55e244cb24e0 2024-03-30T13:13:18.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.243+0000 7f9293e00640 1 -- 172.21.15.99:0/3057751526 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928c00da50 con 0x55e244cb24e0 2024-03-30T13:13:18.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.243+0000 7f9293e00640 1 -- 172.21.15.99:0/3057751526 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c00de40 con 0x55e244cb24e0 2024-03-30T13:13:18.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.243+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3057751526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb24e0 msgr2=0x55e244c8a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.243+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/3057751526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb24e0 0x55e244c8a4b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f928c000f60 tx=0x7f928c010000 comp rx=0 tx=0).stop 2024-03-30T13:13:18.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.243+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3057751526 shutdown_connections 2024-03-30T13:13:18.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.243+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/3057751526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244c8a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.243+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/3057751526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb24e0 0x55e244c8a4b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.243+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/3057751526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244c8b470 0x55e244cb1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.243+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3057751526 >> 172.21.15.99:0/3057751526 conn(0x55e244c51be0 msgr2=0x55e244cd0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.243+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3057751526 shutdown_connections 2024-03-30T13:13:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.243+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3057751526 wait complete. 2024-03-30T13:13:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.244+0000 7f92ad9a2740 1 -- start start 2024-03-30T13:13:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.244+0000 7f92ad9a2740 1 Processor -- start 2024-03-30T13:13:18.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.245+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244cdff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.245+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cb7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.245+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244cb9290 0x55e244cb0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.245+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e244cb1b10 con 0x55e244c8b470 2024-03-30T13:13:18.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.245+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e244ba99d0 con 0x55e244c8b850 2024-03-30T13:13:18.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.245+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55e244caa890 con 0x55e244cb9290 2024-03-30T13:13:18.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.245+0000 7f92ad9a2740 10 client.0 _ll_register_callbacks cb 0x55e244be5fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244cdff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244cdff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48526/0 (socket says 172.21.15.99:48526) 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a3e00640 1 -- 172.21.15.99:0/3630572328 learned_addr learned my addr 172.21.15.99:0/3630572328 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a3400640 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cb7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a8c00640 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244cb9290 0x55e244cb0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a3e00640 1 -- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244cb9290 msgr2=0x55e244cb0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a3e00640 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244cb9290 0x55e244cb0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a3e00640 1 -- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 msgr2=0x55e244cb7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a3e00640 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cb7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a3e00640 1 -- 172.21.15.99:0/3630572328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2448c2210 con 0x55e244c8b470 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a8c00640 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244cb9290 0x55e244cb0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f92a3e00640 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244cdff20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f92940592e0 tx=0x7f9294059030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8675a1eb114f69 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.246+0000 7f9290c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:18.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f9290c00640 1 -- 172.21.15.99:0/3630572328 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294021040 con 0x55e244c8b470 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f9290c00640 1 -- 172.21.15.99:0/3630572328 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f9294058a30 con 0x55e244c8b470 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3630572328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f928c00da50 con 0x55e244c8b470 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f9290c00640 1 -- 172.21.15.99:0/3630572328 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f92940621c0 con 0x55e244c8b470 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f92ad9a2740 10 client.5796 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3630572328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e244a2f0b0 con 0x55e244c8b470 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f9290c00640 1 -- 172.21.15.99:0/3630572328 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928c00da50 con 0x55e244c8b470 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f9290c00640 1 -- 172.21.15.99:0/3630572328 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f9294024060 con 0x55e244c8b470 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f92ad9a2740 10 client.5796 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f92ad9a2740 10 client.5796 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f92ad9a2740 20 client.5796 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e244ceb680 0x55e244ceda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f92ad9a2740 4 client.5796 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.247+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3630572328 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e244bfb870 con 0x55e244ceb680 2024-03-30T13:13:18.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.248+0000 7f92a3400640 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e244ceb680 0x55e244ceda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.249+0000 7f92a3400640 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e244ceb680 0x55e244ceda70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cab16a7960e4cb0 server_cookie=1d366f2bcca00656 in_seq=0 out_seq=0 2024-03-30T13:13:18.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.249+0000 7f9290c00640 10 client.5796 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f9290c00640 1 -- 172.21.15.99:0/3630572328 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55e244bfb870 con 0x55e244ceb680 2024-03-30T13:13:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f9290c00640 10 client.5796 handle_command_reply: tid=0 2024-03-30T13:13:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 1 client.5796 shutdown 2024-03-30T13:13:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3630572328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 msgr2=0x55e244cdff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244cdff20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f92940592e0 tx=0x7f9294059030 comp rx=0 tx=0).stop 2024-03-30T13:13:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3630572328 shutdown_connections 2024-03-30T13:13:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244cb9290 0x55e244cb0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e244ceb680 0x55e244ceda70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cb7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/3630572328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244cdff20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f9290c00640 0 client.5796 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:18.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3630572328 >> 172.21.15.99:0/3630572328 conn(0x55e244c51be0 msgr2=0x55e244c84b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3630572328 shutdown_connections 2024-03-30T13:13:18.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 1 -- 172.21.15.99:0/3630572328 wait complete. 2024-03-30T13:13:18.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.251+0000 7f92ad9a2740 20 client.5796 trim_cache size 0 max 16384 2024-03-30T13:13:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.267+0000 7f92ad9a2740 1 Processor -- start 2024-03-30T13:13:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.267+0000 7f92ad9a2740 1 -- start start 2024-03-30T13:13:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.268+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244c8b470 0x55e244cc7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.268+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cafa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.268+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb9290 0x55e244caff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.268+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f92a4200d30 con 0x55e244cb9290 2024-03-30T13:13:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.268+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f92a41ffd70 con 0x55e244c8b850 2024-03-30T13:13:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.268+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f92a40ca630 con 0x55e244c8b470 2024-03-30T13:13:18.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.269+0000 7f92a8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb9290 0x55e244caff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.269+0000 7f92a8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb9290 0x55e244caff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48538/0 (socket says 172.21.15.99:48538) 2024-03-30T13:13:18.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.269+0000 7f92a8c00640 1 -- 172.21.15.99:0/2923959190 learned_addr learned my addr 172.21.15.99:0/2923959190 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.269+0000 7f92a3e00640 1 --2- 172.21.15.99:0/2923959190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244c8b470 0x55e244cc7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.269+0000 7f92a3400640 1 --2- 172.21.15.99:0/2923959190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cafa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.269+0000 7f92a8c00640 1 -- 172.21.15.99:0/2923959190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244c8b470 msgr2=0x55e244cc7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.269+0000 7f92a8c00640 1 --2- 172.21.15.99:0/2923959190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244c8b470 0x55e244cc7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.269+0000 7f92a8c00640 1 -- 172.21.15.99:0/2923959190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 msgr2=0x55e244cafa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.269+0000 7f92a8c00640 1 --2- 172.21.15.99:0/2923959190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cafa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.269+0000 7f92a8c00640 1 -- 172.21.15.99:0/2923959190 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24489b2d0 con 0x55e244cb9290 2024-03-30T13:13:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.270+0000 7f92a8c00640 1 --2- 172.21.15.99:0/2923959190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb9290 0x55e244caff50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f929c009eb0 tx=0x7f929c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edaaad7f0a3a464 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.270+0000 7f9293400640 1 -- 172.21.15.99:0/2923959190 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c044070 con 0x55e244cb9290 2024-03-30T13:13:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.270+0000 7f9293400640 1 -- 172.21.15.99:0/2923959190 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929c040460 con 0x55e244cb9290 2024-03-30T13:13:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.270+0000 7f9293400640 1 -- 172.21.15.99:0/2923959190 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c039040 con 0x55e244cb9290 2024-03-30T13:13:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.270+0000 7f92ad9a2740 1 -- 172.21.15.99:0/2923959190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb9290 msgr2=0x55e244caff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.270+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/2923959190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb9290 0x55e244caff50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f929c009eb0 tx=0x7f929c02e000 comp rx=0 tx=0).stop 2024-03-30T13:13:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.271+0000 7f92ad9a2740 1 -- 172.21.15.99:0/2923959190 shutdown_connections 2024-03-30T13:13:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.271+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/2923959190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244cb9290 0x55e244caff50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.271+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/2923959190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cafa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.271+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/2923959190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244c8b470 0x55e244cc7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.271+0000 7f92ad9a2740 1 -- 172.21.15.99:0/2923959190 >> 172.21.15.99:0/2923959190 conn(0x55e244c51be0 msgr2=0x55e244ca8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.271+0000 7f92ad9a2740 1 -- 172.21.15.99:0/2923959190 shutdown_connections 2024-03-30T13:13:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.271+0000 7f92ad9a2740 1 -- 172.21.15.99:0/2923959190 wait complete. 2024-03-30T13:13:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.271+0000 7f92ad9a2740 1 -- start start 2024-03-30T13:13:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.272+0000 7f92ad9a2740 1 Processor -- start 2024-03-30T13:13:18.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.272+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244d4b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.272+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cb0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92ad9a2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244cb9290 0x55e244cc9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e244cf3900 con 0x55e244c8b470 2024-03-30T13:13:18.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f92a40cac80 con 0x55e244c8b850 2024-03-30T13:13:18.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92ad9a2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55e244cca090 con 0x55e244cb9290 2024-03-30T13:13:18.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92ad9a2740 10 client.0 _ll_register_callbacks cb 0x7f929400e900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:18.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92a3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244d4b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92a3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244d4b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48542/0 (socket says 172.21.15.99:48542) 2024-03-30T13:13:18.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92a3e00640 1 -- 172.21.15.99:0/668826155 learned_addr learned my addr 172.21.15.99:0/668826155 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92a3400640 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cb0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92a8c00640 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244cb9290 0x55e244cc9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92a3e00640 1 -- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244cb9290 msgr2=0x55e244cc9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92a3e00640 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244cb9290 0x55e244cc9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92a3e00640 1 -- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 msgr2=0x55e244cb0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92a3e00640 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cb0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.273+0000 7f92a3e00640 1 -- 172.21.15.99:0/668826155 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e244c88fa0 con 0x55e244c8b470 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.274+0000 7f92a3e00640 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244d4b7f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9294055a40 tx=0x7f9294089ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7359b97bc1dbd069 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.274+0000 7f9290c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.274+0000 7f9290c00640 1 -- 172.21.15.99:0/668826155 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294021070 con 0x55e244c8b470 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.274+0000 7f9290c00640 1 -- 172.21.15.99:0/668826155 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f9294055540 con 0x55e244c8b470 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.274+0000 7f92ad9a2740 1 -- 172.21.15.99:0/668826155 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f929c040460 con 0x55e244c8b470 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.274+0000 7f9290c00640 1 -- 172.21.15.99:0/668826155 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f929407f050 con 0x55e244c8b470 2024-03-30T13:13:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.274+0000 7f92ad9a2740 10 client.5802 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.274+0000 7f92ad9a2740 1 -- 172.21.15.99:0/668826155 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e244cb69c0 con 0x55e244c8b470 2024-03-30T13:13:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.274+0000 7f9290c00640 1 -- 172.21.15.99:0/668826155 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929c040460 con 0x55e244c8b470 2024-03-30T13:13:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.275+0000 7f9290c00640 1 -- 172.21.15.99:0/668826155 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f9294082020 con 0x55e244c8b470 2024-03-30T13:13:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.275+0000 7f92ad9a2740 10 client.5802 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.275+0000 7f92ad9a2740 10 client.5802 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.275+0000 7f92ad9a2740 20 client.5802 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.275+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e244cc99c0 0x55e244cd3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.275+0000 7f92ad9a2740 4 client.5802 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628352}] 2024-03-30T13:13:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.275+0000 7f92ad9a2740 1 -- 172.21.15.99:0/668826155 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628352}) -- 0x55e244cb5740 con 0x55e244cc99c0 2024-03-30T13:13:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.275+0000 7f92a3400640 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e244cc99c0 0x55e244cd3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.276+0000 7f92a3400640 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e244cc99c0 0x55e244cd3290 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57b302b574230985 server_cookie=54b8615cd7201962 in_seq=0 out_seq=0 2024-03-30T13:13:18.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.276+0000 7f9290c00640 10 client.5802 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f9290c00640 1 -- 172.21.15.99:0/668826155 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3970 (crc 0 0 0) 0x55e244cb5740 con 0x55e244cc99c0 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f9290c00640 10 client.5802 handle_command_reply: tid=0 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f92ad9a2740 1 client.5802 shutdown 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f92ad9a2740 1 -- 172.21.15.99:0/668826155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 msgr2=0x55e244d4b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244d4b7f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9294055a40 tx=0x7f9294089ac0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f92ad9a2740 1 -- 172.21.15.99:0/668826155 shutdown_connections 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55e244cb9290 0x55e244cc9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55e244cc99c0 0x55e244cd3290 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e244c8b850 0x55e244cb0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f92ad9a2740 1 --2- 172.21.15.99:0/668826155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e244c8b470 0x55e244d4b7f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f9290c00640 0 client.5802 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f92ad9a2740 1 -- 172.21.15.99:0/668826155 >> 172.21.15.99:0/668826155 conn(0x55e244c51be0 msgr2=0x55e244ccc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f92ad9a2740 1 -- 172.21.15.99:0/668826155 shutdown_connections 2024-03-30T13:13:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.277+0000 7f92ad9a2740 1 -- 172.21.15.99:0/668826155 wait complete. 2024-03-30T13:13:18.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92ad9a2740 20 client.5802 trim_cache size 0 max 16384 2024-03-30T13:13:18.284 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:18.284 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/symlink.c", 2024-03-30T13:13:18.284 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628352, 2024-03-30T13:13:18.284 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:18.284 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.513522+0000", 2024-03-30T13:13:18.284 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.706951+0000", 2024-03-30T13:13:18.284 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:18.284 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:18.284 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 497, 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.706951+0000", 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:18.286 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 497, 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:18.287 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.513522+0000" 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 497, 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.513522+0000" 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 172, 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 50, 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:41.322817+0000", 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 100, 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:18.289 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:18.290 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:18.291 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:18.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:18.293 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:18.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:18.295 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:18.296 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.296 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:18.296 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:18.296 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:18.296 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:18.296 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92a9600640 1 -- 172.21.15.99:0/237690712 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928006c530 msgr2=0x7f928006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92a9600640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928006c530 0x7f928006e9f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f92a40cc2c0 tx=0x7f928c009040 comp rx=0 tx=0).stop 2024-03-30T13:13:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92a9600640 1 -- 172.21.15.99:0/237690712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a406db70 msgr2=0x7f92a414bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92a9600640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a406db70 0x7f92a414bc20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f929400e9b0 tx=0x7f929400ee70 comp rx=0 tx=0).stop 2024-03-30T13:13:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92a9600640 1 -- 172.21.15.99:0/237690712 shutdown_connections 2024-03-30T13:13:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92a9600640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f928006c530 0x7f928006e9f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92a9600640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92a415e570 0x7f92a409c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92a9600640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92a4073690 0x7f92a409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92a9600640 1 --2- 172.21.15.99:0/237690712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92a406db70 0x7f92a414bc20 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92a9600640 1 -- 172.21.15.99:0/237690712 >> 172.21.15.99:0/237690712 conn(0x7f92a406bb40 msgr2=0x7f92a40b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.278+0000 7f92a9600640 1 -- 172.21.15.99:0/237690712 shutdown_connections 2024-03-30T13:13:18.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.279+0000 7f92a9600640 1 -- 172.21.15.99:0/237690712 wait complete. 2024-03-30T13:13:18.299 DEBUG:tasks.cephfs.test_uninlining:getting inode info #23 of 23:1099511628334 2024-03-30T13:13:18.299 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628334 2024-03-30T13:13:18.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628334 2024-03-30T13:13:18.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.503+0000 7f2074a00640 1 Processor -- start 2024-03-30T13:13:18.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.503+0000 7f2074a00640 1 -- start start 2024-03-30T13:13:18.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f2074a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f20700cf330 0x7f207015dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f2074a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20700acf20 0x7f20700ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f2074a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f207015ca80 0x7f207015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f2074a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f207015d7b0 con 0x7f20700cf330 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f2074a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f207006d840 con 0x7f207015ca80 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f2074a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f207006db20 con 0x7f20700acf20 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f206e800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f20700cf330 0x7f207015dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f206e800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f20700cf330 0x7f207015dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48554/0 (socket says 172.21.15.99:48554) 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f206e800640 1 -- 172.21.15.99:0/1266232927 learned_addr learned my addr 172.21.15.99:0/1266232927 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f206e800640 1 -- 172.21.15.99:0/1266232927 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20700acf20 msgr2=0x7f20700ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f206e800640 1 --2- 172.21.15.99:0/1266232927 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20700acf20 0x7f20700ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f206e800640 1 -- 172.21.15.99:0/1266232927 >> v2:172.21.15.181:3300/0 conn(0x7f207015ca80 msgr2=0x7f207015cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f206e800640 1 --2- 172.21.15.99:0/1266232927 >> v2:172.21.15.181:3300/0 conn(0x7f207015ca80 0x7f207015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.505+0000 7f206e800640 1 -- 172.21.15.99:0/1266232927 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207006de00 con 0x7f20700cf330 2024-03-30T13:13:18.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.506+0000 7f206e800640 1 --2- 172.21.15.99:0/1266232927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20700cf330 0x7f207015dd70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f20700d10d0 tx=0x7f206002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8e692076f6b4df server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.507+0000 7f206d400640 1 -- 172.21.15.99:0/1266232927 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206002ca80 con 0x7f20700cf330 2024-03-30T13:13:18.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.507+0000 7f206d400640 1 -- 172.21.15.99:0/1266232927 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206002cc20 con 0x7f20700cf330 2024-03-30T13:13:18.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.507+0000 7f206d400640 1 -- 172.21.15.99:0/1266232927 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20600343f0 con 0x7f20700cf330 2024-03-30T13:13:18.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.507+0000 7f2074a00640 1 -- 172.21.15.99:0/1266232927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20700cf330 msgr2=0x7f207015dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.507+0000 7f2074a00640 1 --2- 172.21.15.99:0/1266232927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20700cf330 0x7f207015dd70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f20700d10d0 tx=0x7f206002bee0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.508+0000 7f2074a00640 1 -- 172.21.15.99:0/1266232927 shutdown_connections 2024-03-30T13:13:18.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.508+0000 7f2074a00640 1 --2- 172.21.15.99:0/1266232927 >> v2:172.21.15.181:3300/0 conn(0x7f207015ca80 0x7f207015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.508+0000 7f2074a00640 1 --2- 172.21.15.99:0/1266232927 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20700acf20 0x7f20700ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.508+0000 7f2074a00640 1 --2- 172.21.15.99:0/1266232927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20700cf330 0x7f207015dd70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.508+0000 7f2074a00640 1 -- 172.21.15.99:0/1266232927 >> 172.21.15.99:0/1266232927 conn(0x7f207006bb40 msgr2=0x7f20700b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.508+0000 7f2074a00640 1 -- 172.21.15.99:0/1266232927 shutdown_connections 2024-03-30T13:13:18.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.508+0000 7f2074a00640 1 -- 172.21.15.99:0/1266232927 wait complete. 2024-03-30T13:13:18.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.510+0000 7f2074a00640 1 Processor -- start 2024-03-30T13:13:18.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.510+0000 7f2074a00640 1 -- start start 2024-03-30T13:13:18.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.511+0000 7f2074a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20700acf20 0x7f207014c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.511+0000 7f2074a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20700cf330 0x7f207009b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.511+0000 7f2074a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f207015ca80 0x7f20700b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.511+0000 7f2074a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f207006e4a0 con 0x7f20700acf20 2024-03-30T13:13:18.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.511+0000 7f2074a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f207006e320 con 0x7f20700cf330 2024-03-30T13:13:18.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.511+0000 7f2074a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f207006e620 con 0x7f207015ca80 2024-03-30T13:13:18.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.511+0000 7f206e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20700acf20 0x7f207014c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.511+0000 7f206e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20700acf20 0x7f207014c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48568/0 (socket says 172.21.15.99:48568) 2024-03-30T13:13:18.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.511+0000 7f206e800640 1 -- 172.21.15.99:0/432332439 learned_addr learned my addr 172.21.15.99:0/432332439 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.512+0000 7f206e800640 1 -- 172.21.15.99:0/432332439 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f207015ca80 msgr2=0x7f20700b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.512+0000 7f206e800640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f207015ca80 0x7f20700b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.512+0000 7f206e800640 1 -- 172.21.15.99:0/432332439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20700cf330 msgr2=0x7f207009b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.512+0000 7f206e800640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20700cf330 0x7f207009b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.512+0000 7f206e800640 1 -- 172.21.15.99:0/432332439 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207014ca70 con 0x7f20700acf20 2024-03-30T13:13:18.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.512+0000 7f206e800640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20700acf20 0x7f207014c530 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2060036040 tx=0x7f2060004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.512+0000 7f2066a00640 1 -- 172.21.15.99:0/432332439 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2060043020 con 0x7f20700acf20 2024-03-30T13:13:18.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.512+0000 7f2066a00640 1 -- 172.21.15.99:0/432332439 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206003e450 con 0x7f20700acf20 2024-03-30T13:13:18.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.512+0000 7f2066a00640 1 -- 172.21.15.99:0/432332439 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206003e840 con 0x7f20700acf20 2024-03-30T13:13:18.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.512+0000 7f2074a00640 1 -- 172.21.15.99:0/432332439 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2070149e30 con 0x7f20700acf20 2024-03-30T13:13:18.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.513+0000 7f2074a00640 1 -- 172.21.15.99:0/432332439 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f207014a3f0 con 0x7f20700acf20 2024-03-30T13:13:18.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.515+0000 7f2066a00640 1 -- 172.21.15.99:0/432332439 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2060046020 con 0x7f20700acf20 2024-03-30T13:13:18.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.515+0000 7f2066a00640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f204c06c530 0x7f204c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.516+0000 7f2066a00640 1 -- 172.21.15.99:0/432332439 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f20600ae190 con 0x7f20700acf20 2024-03-30T13:13:18.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.516+0000 7f206de00640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f204c06c530 0x7f204c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.516+0000 7f20781cf740 1 Processor -- start 2024-03-30T13:13:18.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.516+0000 7f20781cf740 1 -- start start 2024-03-30T13:13:18.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.516+0000 7f206de00640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f204c06c530 0x7f204c06e9f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f20700b16d0 tx=0x7f2058006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.517+0000 7f20781cf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 0x56198718e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.517+0000 7f20781cf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.517+0000 7f20781cf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b7760 0x5619871b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.517+0000 7f20781cf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5619870f0330 con 0x5619871b4410 2024-03-30T13:13:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.517+0000 7f20781cf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561987098620 con 0x5619871b7760 2024-03-30T13:13:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.517+0000 7f20781cf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5619870ec440 con 0x5619871b7380 2024-03-30T13:13:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.518+0000 7f206de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.518+0000 7f206de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48572/0 (socket says 172.21.15.99:48572) 2024-03-30T13:13:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.518+0000 7f206de00640 1 -- 172.21.15.99:0/311463171 learned_addr learned my addr 172.21.15.99:0/311463171 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.518+0000 7f206de00640 1 -- 172.21.15.99:0/311463171 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 msgr2=0x56198718e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.518+0000 7f206de00640 1 --2- 172.21.15.99:0/311463171 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 0x56198718e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.518+0000 7f206de00640 1 -- 172.21.15.99:0/311463171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b7760 msgr2=0x5619871b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.518+0000 7f206de00640 1 --2- 172.21.15.99:0/311463171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b7760 0x5619871b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.518+0000 7f206de00640 1 -- 172.21.15.99:0/311463171 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561986ed0920 con 0x5619871b4410 2024-03-30T13:13:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.518+0000 7f206de00640 1 --2- 172.21.15.99:0/311463171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871cfd60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2058015860 tx=0x7f205800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80861644c429ccad server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.518+0000 7f205f000640 1 -- 172.21.15.99:0/311463171 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058023070 con 0x5619871b4410 2024-03-30T13:13:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.519+0000 7f205f000640 1 -- 172.21.15.99:0/311463171 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20580152e0 con 0x5619871b4410 2024-03-30T13:13:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.519+0000 7f205f000640 1 -- 172.21.15.99:0/311463171 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205800bb50 con 0x5619871b4410 2024-03-30T13:13:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.519+0000 7f20781cf740 1 -- 172.21.15.99:0/311463171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 msgr2=0x5619871cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.519+0000 7f20781cf740 1 --2- 172.21.15.99:0/311463171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871cfd60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2058015860 tx=0x7f205800e000 comp rx=0 tx=0).stop 2024-03-30T13:13:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.519+0000 7f20781cf740 1 -- 172.21.15.99:0/311463171 shutdown_connections 2024-03-30T13:13:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.519+0000 7f20781cf740 1 --2- 172.21.15.99:0/311463171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b7760 0x5619871b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.519+0000 7f20781cf740 1 --2- 172.21.15.99:0/311463171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871cfd60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.519+0000 7f20781cf740 1 --2- 172.21.15.99:0/311463171 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 0x56198718e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.519+0000 7f20781cf740 1 -- 172.21.15.99:0/311463171 >> 172.21.15.99:0/311463171 conn(0x561987153be0 msgr2=0x5619871d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.519+0000 7f20781cf740 1 -- 172.21.15.99:0/311463171 shutdown_connections 2024-03-30T13:13:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.519+0000 7f20781cf740 1 -- 172.21.15.99:0/311463171 wait complete. 2024-03-30T13:13:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.520+0000 7f20781cf740 1 -- start start 2024-03-30T13:13:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.520+0000 7f20781cf740 1 Processor -- start 2024-03-30T13:13:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.521+0000 7f20781cf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.521+0000 7f20781cf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b7380 0x5619871b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.521+0000 7f20781cf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7760 0x5619871b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.521+0000 7f20781cf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5619871873a0 con 0x5619871b4410 2024-03-30T13:13:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.521+0000 7f20781cf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5619870ab9d0 con 0x5619871b7380 2024-03-30T13:13:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.521+0000 7f20781cf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x561987187640 con 0x5619871b7760 2024-03-30T13:13:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.521+0000 7f20781cf740 10 client.0 _ll_register_callbacks cb 0x5619870e7fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f206e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f206e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48588/0 (socket says 172.21.15.99:48588) 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f206e800640 1 -- 172.21.15.99:0/4122602549 learned_addr learned my addr 172.21.15.99:0/4122602549 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f206e800640 1 -- 172.21.15.99:0/4122602549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7760 msgr2=0x5619871b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f206e800640 1 --2- 172.21.15.99:0/4122602549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7760 0x5619871b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f206e800640 1 -- 172.21.15.99:0/4122602549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b7380 msgr2=0x5619871b8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f206e800640 1 --2- 172.21.15.99:0/4122602549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b7380 0x5619871b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f206e800640 1 -- 172.21.15.99:0/4122602549 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561986dc4210 con 0x5619871b4410 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f206e800640 1 --2- 172.21.15.99:0/4122602549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871b1650 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f206007bd20 tx=0x7f206007c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f599527c765028 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f2053400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f2053400640 1 -- 172.21.15.99:0/4122602549 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20600803d0 con 0x5619871b4410 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f2053400640 1 -- 172.21.15.99:0/4122602549 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f206002ca90 con 0x5619871b4410 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.522+0000 7f20781cf740 1 -- 172.21.15.99:0/4122602549 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20580152e0 con 0x5619871b4410 2024-03-30T13:13:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.523+0000 7f2053400640 1 -- 172.21.15.99:0/4122602549 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f20600ac050 con 0x5619871b4410 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.523+0000 7f20781cf740 10 client.5814 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.523+0000 7f20781cf740 1 -- 172.21.15.99:0/4122602549 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x561986f310b0 con 0x5619871b4410 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.523+0000 7f2053400640 1 -- 172.21.15.99:0/4122602549 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20580152e0 con 0x5619871b4410 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.523+0000 7f2053400640 1 -- 172.21.15.99:0/4122602549 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f20600ac1f0 con 0x5619871b4410 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.523+0000 7f20781cf740 10 client.5814 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.523+0000 7f20781cf740 10 client.5814 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.523+0000 7f20781cf740 20 client.5814 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.523+0000 7f20781cf740 1 --2- 172.21.15.99:0/4122602549 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5619871c9770 0x5619871c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.523+0000 7f20781cf740 4 client.5814 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.523+0000 7f20781cf740 1 -- 172.21.15.99:0/4122602549 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619870fd870 con 0x5619871c9770 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.524+0000 7f206de00640 1 --2- 172.21.15.99:0/4122602549 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5619871c9770 0x5619871c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.525+0000 7f2053400640 10 client.5814 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.525+0000 7f206de00640 1 --2- 172.21.15.99:0/4122602549 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5619871c9770 0x5619871c9bd0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=573640fdf8f2237a server_cookie=eca33889ed20bac2 in_seq=0 out_seq=0 2024-03-30T13:13:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.526+0000 7f2053400640 1 -- 172.21.15.99:0/4122602549 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5619870fd870 con 0x5619871c9770 2024-03-30T13:13:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.526+0000 7f2053400640 10 client.5814 handle_command_reply: tid=0 2024-03-30T13:13:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.526+0000 7f20781cf740 1 client.5814 shutdown 2024-03-30T13:13:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f20781cf740 1 -- 172.21.15.99:0/4122602549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 msgr2=0x5619871b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f20781cf740 1 --2- 172.21.15.99:0/4122602549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871b1650 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f206007bd20 tx=0x7f206007c720 comp rx=0 tx=0).stop 2024-03-30T13:13:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f20781cf740 1 -- 172.21.15.99:0/4122602549 shutdown_connections 2024-03-30T13:13:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f20781cf740 1 --2- 172.21.15.99:0/4122602549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7760 0x5619871b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f20781cf740 1 --2- 172.21.15.99:0/4122602549 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5619871c9770 0x5619871c9bd0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f20781cf740 1 --2- 172.21.15.99:0/4122602549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b7380 0x5619871b8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f20781cf740 1 --2- 172.21.15.99:0/4122602549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b4410 0x5619871b1650 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f2053400640 0 client.5814 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f20781cf740 1 -- 172.21.15.99:0/4122602549 >> 172.21.15.99:0/4122602549 conn(0x561987153be0 msgr2=0x5619871863f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f20781cf740 1 -- 172.21.15.99:0/4122602549 shutdown_connections 2024-03-30T13:13:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f20781cf740 1 -- 172.21.15.99:0/4122602549 wait complete. 2024-03-30T13:13:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.527+0000 7f20781cf740 20 client.5814 trim_cache size 0 max 16384 2024-03-30T13:13:18.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.543+0000 7f20781cf740 1 Processor -- start 2024-03-30T13:13:18.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.543+0000 7f20781cf740 1 -- start start 2024-03-30T13:13:18.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f20781cf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b4410 0x5619871ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f20781cf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 0x56198724ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f20781cf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x56198724bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f20781cf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5619871b1b40 con 0x5619871b7760 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f20781cf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f20700b1450 con 0x5619871b4410 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f20781cf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2070073620 con 0x5619871b7380 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f206f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x56198724bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f206f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x56198724bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48602/0 (socket says 172.21.15.99:48602) 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f206f200640 1 -- 172.21.15.99:0/2736683764 learned_addr learned my addr 172.21.15.99:0/2736683764 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f206f200640 1 -- 172.21.15.99:0/2736683764 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 msgr2=0x56198724ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f206f200640 1 --2- 172.21.15.99:0/2736683764 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 0x56198724ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f206f200640 1 -- 172.21.15.99:0/2736683764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b4410 msgr2=0x5619871ba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f206f200640 1 --2- 172.21.15.99:0/2736683764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b4410 0x5619871ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.544+0000 7f206f200640 1 -- 172.21.15.99:0/2736683764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561986d9d2d0 con 0x5619871b7760 2024-03-30T13:13:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.545+0000 7f206f200640 1 --2- 172.21.15.99:0/2736683764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x56198724bfd0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x5619871d56b0 tx=0x7f206800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e150d90d8076f03 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.545+0000 7f205e600640 1 -- 172.21.15.99:0/2736683764 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20680107b0 con 0x5619871b7760 2024-03-30T13:13:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.545+0000 7f205e600640 1 -- 172.21.15.99:0/2736683764 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2068016070 con 0x5619871b7760 2024-03-30T13:13:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.545+0000 7f205e600640 1 -- 172.21.15.99:0/2736683764 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2068010b90 con 0x5619871b7760 2024-03-30T13:13:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.545+0000 7f20781cf740 1 -- 172.21.15.99:0/2736683764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 msgr2=0x56198724bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.545+0000 7f20781cf740 1 --2- 172.21.15.99:0/2736683764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x56198724bfd0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x5619871d56b0 tx=0x7f206800b990 comp rx=0 tx=0).stop 2024-03-30T13:13:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.546+0000 7f20781cf740 1 -- 172.21.15.99:0/2736683764 shutdown_connections 2024-03-30T13:13:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.546+0000 7f20781cf740 1 --2- 172.21.15.99:0/2736683764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x56198724bfd0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.546+0000 7f20781cf740 1 --2- 172.21.15.99:0/2736683764 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 0x56198724ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.546+0000 7f20781cf740 1 --2- 172.21.15.99:0/2736683764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b4410 0x5619871ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.546+0000 7f20781cf740 1 -- 172.21.15.99:0/2736683764 >> 172.21.15.99:0/2736683764 conn(0x561987153be0 msgr2=0x5619871c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.546+0000 7f20781cf740 1 -- 172.21.15.99:0/2736683764 shutdown_connections 2024-03-30T13:13:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.546+0000 7f20781cf740 1 -- 172.21.15.99:0/2736683764 wait complete. 2024-03-30T13:13:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.546+0000 7f20781cf740 1 -- start start 2024-03-30T13:13:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.546+0000 7f20781cf740 1 Processor -- start 2024-03-30T13:13:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.547+0000 7f20781cf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b4410 0x5619871b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.547+0000 7f20781cf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 0x5619871c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.547+0000 7f20781cf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x5619871e8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.547+0000 7f20781cf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2070072fd0 con 0x5619871b7760 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.547+0000 7f20781cf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2070072980 con 0x5619871b4410 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.547+0000 7f20781cf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5619871b8860 con 0x5619871b7380 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.548+0000 7f20781cf740 10 client.0 _ll_register_callbacks cb 0x7f2060009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.548+0000 7f206f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x5619871e8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.548+0000 7f206f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x5619871e8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48618/0 (socket says 172.21.15.99:48618) 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.548+0000 7f206f200640 1 -- 172.21.15.99:0/4147816844 learned_addr learned my addr 172.21.15.99:0/4147816844 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.548+0000 7f206f200640 1 -- 172.21.15.99:0/4147816844 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 msgr2=0x5619871c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.548+0000 7f206f200640 1 --2- 172.21.15.99:0/4147816844 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 0x5619871c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.548+0000 7f206f200640 1 -- 172.21.15.99:0/4147816844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b4410 msgr2=0x5619871b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.548+0000 7f206f200640 1 --2- 172.21.15.99:0/4147816844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b4410 0x5619871b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.548+0000 7f206f200640 1 -- 172.21.15.99:0/4147816844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561987186ae0 con 0x5619871b7760 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.548+0000 7f206f200640 1 --2- 172.21.15.99:0/4147816844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x5619871e8980 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2068013040 tx=0x7f2068004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716af8d0064018b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.548+0000 7f2053400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f2053400640 1 -- 172.21.15.99:0/4147816844 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2068025470 con 0x5619871b7760 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f2053400640 1 -- 172.21.15.99:0/4147816844 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f2068025610 con 0x5619871b7760 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f20781cf740 1 -- 172.21.15.99:0/4147816844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2068016070 con 0x5619871b7760 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f2053400640 1 -- 172.21.15.99:0/4147816844 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f206802d050 con 0x5619871b7760 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f20781cf740 10 client.5820 fetch_fsmap learned FSMap version 19 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f20781cf740 1 -- 172.21.15.99:0/4147816844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5619871b85a0 con 0x5619871b7760 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f2053400640 1 -- 172.21.15.99:0/4147816844 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2068016070 con 0x5619871b7760 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f2053400640 1 -- 172.21.15.99:0/4147816844 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f2068030020 con 0x5619871b7760 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f20781cf740 10 client.5820 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f20781cf740 10 client.5820 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f20781cf740 20 client.5820 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f20781cf740 1 --2- 172.21.15.99:0/4147816844 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5619871cb360 0x56198724a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f20781cf740 4 client.5820 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628334}] 2024-03-30T13:13:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.549+0000 7f20781cf740 1 -- 172.21.15.99:0/4147816844 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628334}) -- 0x5619870f7bc0 con 0x5619871cb360 2024-03-30T13:13:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.550+0000 7f206e800640 1 --2- 172.21.15.99:0/4147816844 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5619871cb360 0x56198724a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.551+0000 7f206e800640 1 --2- 172.21.15.99:0/4147816844 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5619871cb360 0x56198724a1e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcc676caa02c0d1a server_cookie=b1bdd6f285e0fd1b in_seq=0 out_seq=0 2024-03-30T13:13:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.551+0000 7f2053400640 10 client.5820 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f2053400640 1 -- 172.21.15.99:0/4147816844 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3974 (crc 0 0 0) 0x5619870f7bc0 con 0x5619871cb360 2024-03-30T13:13:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f2053400640 10 client.5820 handle_command_reply: tid=0 2024-03-30T13:13:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f20781cf740 1 client.5820 shutdown 2024-03-30T13:13:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f20781cf740 1 -- 172.21.15.99:0/4147816844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 msgr2=0x5619871e8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f20781cf740 1 --2- 172.21.15.99:0/4147816844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x5619871e8980 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2068013040 tx=0x7f2068004810 comp rx=0 tx=0).stop 2024-03-30T13:13:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f20781cf740 1 -- 172.21.15.99:0/4147816844 shutdown_connections 2024-03-30T13:13:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f20781cf740 1 --2- 172.21.15.99:0/4147816844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5619871b7760 0x5619871e8980 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f20781cf740 1 --2- 172.21.15.99:0/4147816844 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5619871b7380 0x5619871c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f20781cf740 1 --2- 172.21.15.99:0/4147816844 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5619871cb360 0x56198724a1e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f20781cf740 1 --2- 172.21.15.99:0/4147816844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619871b4410 0x5619871b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f20781cf740 1 -- 172.21.15.99:0/4147816844 >> 172.21.15.99:0/4147816844 conn(0x561987153be0 msgr2=0x5619871d2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.552+0000 7f2053400640 0 client.5820 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f20781cf740 1 -- 172.21.15.99:0/4147816844 shutdown_connections 2024-03-30T13:13:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f20781cf740 1 -- 172.21.15.99:0/4147816844 wait complete. 2024-03-30T13:13:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f20781cf740 20 client.5820 trim_cache size 0 max 16384 2024-03-30T13:13:18.558 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/downcall.h", 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628334, 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:12:40.520372+0000", 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:12:38.657952+0000", 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2953, 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:12:38.657952+0000", 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [], 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2953, 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.520372+0000" 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2953, 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:12:40.520372+0000" 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 220, 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 14, 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:12:41.324930+0000", 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 120, 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:13:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": {}, 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": {}, 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": {}, 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "-", 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": -1, 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:18.570 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:18.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f2074a00640 1 -- 172.21.15.99:0/432332439 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f204c06c530 msgr2=0x7f204c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f2074a00640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f204c06c530 0x7f204c06e9f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f20700b16d0 tx=0x7f2058006c90 comp rx=0 tx=0).stop 2024-03-30T13:13:18.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f2074a00640 1 -- 172.21.15.99:0/432332439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20700acf20 msgr2=0x7f207014c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f2074a00640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20700acf20 0x7f207014c530 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2060036040 tx=0x7f2060004a40 comp rx=0 tx=0).stop 2024-03-30T13:13:18.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f2074a00640 1 -- 172.21.15.99:0/432332439 shutdown_connections 2024-03-30T13:13:18.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f2074a00640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f204c06c530 0x7f204c06e9f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f2074a00640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f207015ca80 0x7f20700b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f2074a00640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20700cf330 0x7f207009b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f2074a00640 1 --2- 172.21.15.99:0/432332439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20700acf20 0x7f207014c530 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.553+0000 7f2074a00640 1 -- 172.21.15.99:0/432332439 >> 172.21.15.99:0/432332439 conn(0x7f207006bb40 msgr2=0x7f2070160650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.554+0000 7f2074a00640 1 -- 172.21.15.99:0/432332439 shutdown_connections 2024-03-30T13:13:18.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:18.554+0000 7f2074a00640 1 -- 172.21.15.99:0/432332439 wait complete. 2024-03-30T13:13:18.575 DEBUG:tasks.cephfs.test_uninlining:removing dir linux-5.4 2024-03-30T13:13:18.575 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && rm -rf linux-5.4/ 2024-03-30T13:13:19.220 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_length == 0 2024-03-30T13:13:19.220 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_version == CEPH_INLINE_NONE 2024-03-30T13:13:19.220 INFO:tasks.cephfs.test_uninlining:Running Data Uninlining test with: without clearing cache, without unmount client, without mount.open_background, without multimds, with snapshots 2024-03-30T13:13:19.220 DEBUG:tasks.cephfs.test_uninlining:setting max_mds:1 2024-03-30T13:13:19.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-03-30T13:13:19.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.438+0000 7f7fce400640 1 Processor -- start 2024-03-30T13:13:19.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.438+0000 7f7fce400640 1 -- start start 2024-03-30T13:13:19.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.439+0000 7f7fce400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7fc80b4e40 0x7f7fc80c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.439+0000 7f7fce400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc81604d0 con 0x7f7fc80b31c0 2024-03-30T13:13:19.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.439+0000 7f7fce400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc81607b0 con 0x7f7fc80b2810 2024-03-30T13:13:19.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.439+0000 7f7fce400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc80c6d60 con 0x7f7fc80b4e40 2024-03-30T13:13:19.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.440+0000 7f7fc6a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7fc80b31c0 0x7f7fc80b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:41732/0 (socket says 172.21.15.99:41732) 2024-03-30T13:13:19.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.440+0000 7f7fc6a00640 1 -- 172.21.15.99:0/3745797542 learned_addr learned my addr 172.21.15.99:0/3745797542 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:19.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.440+0000 7f7fc7400640 1 --2- 172.21.15.99:0/3745797542 >> v2:172.21.15.99:3300/0 conn(0x7f7fc80b4e40 0x7f7fc80c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.440+0000 7f7fc6000640 1 -- 172.21.15.99:0/3745797542 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138871537 0 0) 0x7f7fc81604d0 con 0x7f7fc80b31c0 2024-03-30T13:13:19.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.440+0000 7f7fc7400640 1 -- 172.21.15.99:0/3745797542 >> v1:172.21.15.181:6789/0 conn(0x7f7fc80b2810 legacy=0x7f7fc80cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.440+0000 7f7fc7400640 1 -- 172.21.15.99:0/3745797542 >> v1:172.21.15.99:6789/0 conn(0x7f7fc80b31c0 legacy=0x7f7fc80b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.440+0000 7f7fc7400640 1 -- 172.21.15.99:0/3745797542 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc8160a90 con 0x7f7fc80b4e40 2024-03-30T13:13:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.441+0000 7f7fc7400640 1 --2- 172.21.15.99:0/3745797542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc80b4e40 0x7f7fc80c6820 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80097a0 tx=0x7f7fb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebae18b536fb8734 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.442+0000 7f7fc6000640 1 -- 172.21.15.99:0/3745797542 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8035020 con 0x7f7fc80b4e40 2024-03-30T13:13:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.442+0000 7f7fc6000640 1 -- 172.21.15.99:0/3745797542 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8031830 con 0x7f7fc80b4e40 2024-03-30T13:13:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.442+0000 7f7fc6000640 1 -- 172.21.15.99:0/3745797542 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8031c00 con 0x7f7fc80b4e40 2024-03-30T13:13:19.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.442+0000 7f7fce400640 1 -- 172.21.15.99:0/3745797542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc80b4e40 msgr2=0x7f7fc80c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.442+0000 7f7fce400640 1 --2- 172.21.15.99:0/3745797542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc80b4e40 0x7f7fc80c6820 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80097a0 tx=0x7f7fb802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.442+0000 7f7fce400640 1 -- 172.21.15.99:0/3745797542 shutdown_connections 2024-03-30T13:13:19.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.442+0000 7f7fce400640 1 --2- 172.21.15.99:0/3745797542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc80b4e40 0x7f7fc80c6820 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.442+0000 7f7fce400640 1 -- 172.21.15.99:0/3745797542 >> 172.21.15.99:0/3745797542 conn(0x7f7fc80d0450 msgr2=0x7f7fc80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:19.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.442+0000 7f7fce400640 1 -- 172.21.15.99:0/3745797542 shutdown_connections 2024-03-30T13:13:19.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.442+0000 7f7fce400640 1 -- 172.21.15.99:0/3745797542 wait complete. 2024-03-30T13:13:19.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.444+0000 7f7fce400640 1 Processor -- start 2024-03-30T13:13:19.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.444+0000 7f7fce400640 1 -- start start 2024-03-30T13:13:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.445+0000 7f7fce400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc80b2810 0x7f7fc814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.445+0000 7f7fce400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7fc80b31c0 0x7f7fc81e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.445+0000 7f7fce400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc80b4e40 0x7f7fc815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.445+0000 7f7fce400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80b3650 con 0x7f7fc80b2810 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.445+0000 7f7fce400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80cba20 con 0x7f7fc80b31c0 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.445+0000 7f7fce400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc80c60f0 con 0x7f7fc80b4e40 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.445+0000 7f7fc7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc80b2810 0x7f7fc814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.445+0000 7f7fc7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc80b2810 0x7f7fc814f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48646/0 (socket says 172.21.15.99:48646) 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.445+0000 7f7fc7400640 1 -- 172.21.15.99:0/571646567 learned_addr learned my addr 172.21.15.99:0/571646567 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.446+0000 7f7fc6a00640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7fc80b31c0 0x7f7fc81e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.446+0000 7f7fc7400640 1 -- 172.21.15.99:0/571646567 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc80b4e40 msgr2=0x7f7fc815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.446+0000 7f7fc7400640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc80b4e40 0x7f7fc815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.446+0000 7f7fc7400640 1 -- 172.21.15.99:0/571646567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7fc80b31c0 msgr2=0x7f7fc81e7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.446+0000 7f7fc7400640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7fc80b31c0 0x7f7fc81e7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.446+0000 7f7fc7400640 1 -- 172.21.15.99:0/571646567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc81e8420 con 0x7f7fc80b2810 2024-03-30T13:13:19.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.446+0000 7f7fc7400640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc80b2810 0x7f7fc814f980 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80097a0 tx=0x7f7fb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:19.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.446+0000 7f7fbf400640 1 -- 172.21.15.99:0/571646567 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8041070 con 0x7f7fc80b2810 2024-03-30T13:13:19.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.446+0000 7f7fbf400640 1 -- 172.21.15.99:0/571646567 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8004230 con 0x7f7fc80b2810 2024-03-30T13:13:19.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.446+0000 7f7fbf400640 1 -- 172.21.15.99:0/571646567 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8035040 con 0x7f7fc80b2810 2024-03-30T13:13:19.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.446+0000 7f7fce400640 1 -- 172.21.15.99:0/571646567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc81e8700 con 0x7f7fc80b2810 2024-03-30T13:13:19.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.447+0000 7f7fce400640 1 -- 172.21.15.99:0/571646567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc8071d90 con 0x7f7fc80b2810 2024-03-30T13:13:19.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.448+0000 7f7fce400640 1 -- 172.21.15.99:0/571646567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc804f9d0 con 0x7f7fc80b2810 2024-03-30T13:13:19.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.449+0000 7f7fbf400640 1 -- 172.21.15.99:0/571646567 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7fb8038020 con 0x7f7fc80b2810 2024-03-30T13:13:19.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.450+0000 7f7fbf400640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 0x7f7fa806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.450+0000 7f7fbf400640 1 -- 172.21.15.99:0/571646567 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f7fb80ad2b0 con 0x7f7fc80b2810 2024-03-30T13:13:19.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.450+0000 7f7fc6a00640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 0x7f7fa806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.451+0000 7f7fc6a00640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 0x7f7fa806e9f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7fc814fec0 tx=0x7f7fb4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:19.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.455+0000 7f7fbf400640 1 -- 172.21.15.99:0/571646567 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7fb807b7b0 con 0x7f7fc80b2810 2024-03-30T13:13:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:19.697+0000 7f7fce400640 1 -- 172.21.15.99:0/571646567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f7fc80c5cb0 con 0x7f7fc80b2810 2024-03-30T13:13:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.568+0000 7f7fbf400640 1 -- 172.21.15.99:0/571646567 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v20) ==== 105+0+0 (secure 0 0 0) 0x7f7fb807b0b0 con 0x7f7fc80b2810 2024-03-30T13:13:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.572+0000 7f7fce400640 1 -- 172.21.15.99:0/571646567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 msgr2=0x7f7fa806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.572+0000 7f7fce400640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 0x7f7fa806e9f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7fc814fec0 tx=0x7f7fb4009040 comp rx=0 tx=0).stop 2024-03-30T13:13:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.572+0000 7f7fce400640 1 -- 172.21.15.99:0/571646567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc80b2810 msgr2=0x7f7fc814f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.572+0000 7f7fce400640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc80b2810 0x7f7fc814f980 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80097a0 tx=0x7f7fb80046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.572+0000 7f7fce400640 1 -- 172.21.15.99:0/571646567 shutdown_connections 2024-03-30T13:13:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.572+0000 7f7fce400640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fa806c530 0x7f7fa806e9f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.572+0000 7f7fce400640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7fc80b4e40 0x7f7fc815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.572+0000 7f7fce400640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7fc80b31c0 0x7f7fc81e7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.572+0000 7f7fce400640 1 --2- 172.21.15.99:0/571646567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fc80b2810 0x7f7fc814f980 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.572+0000 7f7fce400640 1 -- 172.21.15.99:0/571646567 >> 172.21.15.99:0/571646567 conn(0x7f7fc80d0450 msgr2=0x7f7fc80ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.573+0000 7f7fce400640 1 -- 172.21.15.99:0/571646567 shutdown_connections 2024-03-30T13:13:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:20.573+0000 7f7fce400640 1 -- 172.21.15.99:0/571646567 wait complete. 2024-03-30T13:13:20.601 DEBUG:tasks.cephfs.test_uninlining:getting client_max_inline_size 2024-03-30T13:13:20.602 DEBUG:tasks.cephfs.test_uninlining:got client_max_inline_size:4096 2024-03-30T13:13:20.602 DEBUG:tasks.cephfs.test_uninlining:starting snapshotter thread 2024-03-30T13:13:20.602 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4 2024-03-30T13:13:20.675 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_0 2024-03-30T13:13:20.676 DEBUG:tasks.cephfs.test_uninlining:extracting tarball 2024-03-30T13:13:20.676 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && tar -x -z -f linux-5.4.tar.gz linux-5.4/fs/ceph linux-5.4/fs/orangefs linux-5.4/fs/ext2 2024-03-30T13:13:21.759 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_1 2024-03-30T13:13:22.839 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_2 2024-03-30T13:13:23.924 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_3 2024-03-30T13:13:25.010 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_4 2024-03-30T13:13:25.835 DEBUG:tasks.cephfs.test_uninlining:fetching dir list 2024-03-30T13:13:25.835 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -mindepth 2 -maxdepth 2 -type d 2024-03-30T13:13:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph 2024-03-30T13:13:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2 2024-03-30T13:13:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs 2024-03-30T13:13:25.891 DEBUG:tasks.cephfs.test_uninlining:distributing dir pins 2024-03-30T13:13:25.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:25.892 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ceph) 2024-03-30T13:13:25.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:25.944 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ext2) 2024-03-30T13:13:25.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:25.995 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/orangefs) 2024-03-30T13:13:26.045 DEBUG:tasks.cephfs.test_uninlining:listing files with size <= 4096 2024-03-30T13:13:26.045 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -type f -size -4097c 2024-03-30T13:13:26.130 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:13:26.130 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/Makefile 2024-03-30T13:13:26.130 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:13:26.130 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/io.h 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/Makefile 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/acl.h 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:13:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:13:26.132 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:13:26.132 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:13:26.132 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:13:26.132 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:13:26.132 INFO:tasks.cephfs.test_uninlining:Found 23 inlined files 2024-03-30T13:13:26.132 DEBUG:tasks.cephfs.test_uninlining:starting scrub 2024-03-30T13:13:26.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:26.132 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive 2024-03-30T13:13:26.172 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_5 2024-03-30T13:13:26.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.365+0000 7fbfe7e00640 1 Processor -- start 2024-03-30T13:13:26.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.365+0000 7fbfe7e00640 1 -- start start 2024-03-30T13:13:26.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.366+0000 7fbfe7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbfe0156ba0 0x7fbfe015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.366+0000 7fbfe7e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe006e300 con 0x7fbfe006d860 2024-03-30T13:13:26.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.366+0000 7fbfe7e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe006e5e0 con 0x7fbfe00d0ba0 2024-03-30T13:13:26.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.366+0000 7fbfe7e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe015db70 con 0x7fbfe0156ba0 2024-03-30T13:13:26.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.367+0000 7fbfe5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbfe0156ba0 0x7fbfe015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.367+0000 7fbfe5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbfe0156ba0 0x7fbfe015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36346/0 (socket says 172.21.15.99:36346) 2024-03-30T13:13:26.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.367+0000 7fbfe5400640 1 -- 172.21.15.99:0/3816717907 learned_addr learned my addr 172.21.15.99:0/3816717907 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.367+0000 7fbfe5400640 1 -- 172.21.15.99:0/3816717907 >> v1:172.21.15.181:6789/0 conn(0x7fbfe00d0ba0 legacy=0x7fbfe0160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.367+0000 7fbfe5400640 1 -- 172.21.15.99:0/3816717907 >> v1:172.21.15.99:6789/0 conn(0x7fbfe006d860 legacy=0x7fbfe00d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.367+0000 7fbfe5400640 1 -- 172.21.15.99:0/3816717907 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe015ce50 con 0x7fbfe0156ba0 2024-03-30T13:13:26.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.368+0000 7fbfe5400640 1 --2- 172.21.15.99:0/3816717907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfe0156ba0 0x7fbfe015d630 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4009870 tx=0x7fbfd402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2949f30ec75a74 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.368+0000 7fbfdfe00640 1 -- 172.21.15.99:0/3816717907 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40317d0 con 0x7fbfe0156ba0 2024-03-30T13:13:26.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.368+0000 7fbfdfe00640 1 -- 172.21.15.99:0/3816717907 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd4037070 con 0x7fbfe0156ba0 2024-03-30T13:13:26.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.368+0000 7fbfdfe00640 1 -- 172.21.15.99:0/3816717907 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4031b90 con 0x7fbfe0156ba0 2024-03-30T13:13:26.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.369+0000 7fbfe7e00640 1 -- 172.21.15.99:0/3816717907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfe0156ba0 msgr2=0x7fbfe015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.369+0000 7fbfe7e00640 1 --2- 172.21.15.99:0/3816717907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfe0156ba0 0x7fbfe015d630 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4009870 tx=0x7fbfd402b870 comp rx=0 tx=0).stop 2024-03-30T13:13:26.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.369+0000 7fbfe7e00640 1 -- 172.21.15.99:0/3816717907 shutdown_connections 2024-03-30T13:13:26.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.369+0000 7fbfe7e00640 1 --2- 172.21.15.99:0/3816717907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfe0156ba0 0x7fbfe015d630 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.369+0000 7fbfe7e00640 1 -- 172.21.15.99:0/3816717907 >> 172.21.15.99:0/3816717907 conn(0x7fbfe006b6f0 msgr2=0x7fbfe006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.369+0000 7fbfe7e00640 1 -- 172.21.15.99:0/3816717907 shutdown_connections 2024-03-30T13:13:26.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.369+0000 7fbfe7e00640 1 -- 172.21.15.99:0/3816717907 wait complete. 2024-03-30T13:13:26.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.371+0000 7fbfe7e00640 1 Processor -- start 2024-03-30T13:13:26.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.371+0000 7fbfe7e00640 1 -- start start 2024-03-30T13:13:26.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe7e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbfe006d860 0x7fbfe0099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfe00d0ba0 0x7fbfe014feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfe0156ba0 0x7fbfe01503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe00ad3d0 con 0x7fbfe0156ba0 2024-03-30T13:13:26.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe7e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe015cb40 con 0x7fbfe00d0ba0 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe7e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe0156f80 con 0x7fbfe006d860 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfe0156ba0 0x7fbfe01503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfe0156ba0 0x7fbfe01503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36348/0 (socket says 172.21.15.99:36348) 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe5e00640 1 -- 172.21.15.99:0/1672941308 learned_addr learned my addr 172.21.15.99:0/1672941308 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe5400640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbfe006d860 0x7fbfe0099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe5e00640 1 -- 172.21.15.99:0/1672941308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbfe006d860 msgr2=0x7fbfe0099850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe5e00640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbfe006d860 0x7fbfe0099850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe5e00640 1 -- 172.21.15.99:0/1672941308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfe00d0ba0 msgr2=0x7fbfe014feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe4a00640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfe00d0ba0 0x7fbfe014feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe5e00640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfe00d0ba0 0x7fbfe014feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe5e00640 1 -- 172.21.15.99:0/1672941308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe01e5fe0 con 0x7fbfe0156ba0 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.372+0000 7fbfe5400640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbfe006d860 0x7fbfe0099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.373+0000 7fbfe5e00640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfe0156ba0 0x7fbfe01503f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800c700 tx=0x7fbfd800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.373+0000 7fbfdd600640 1 -- 172.21.15.99:0/1672941308 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8016020 con 0x7fbfe0156ba0 2024-03-30T13:13:26.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.373+0000 7fbfdd600640 1 -- 172.21.15.99:0/1672941308 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd800aa50 con 0x7fbfe0156ba0 2024-03-30T13:13:26.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.373+0000 7fbfdd600640 1 -- 172.21.15.99:0/1672941308 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800ae40 con 0x7fbfe0156ba0 2024-03-30T13:13:26.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.373+0000 7fbfe7e00640 1 -- 172.21.15.99:0/1672941308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe01e62c0 con 0x7fbfe0156ba0 2024-03-30T13:13:26.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.373+0000 7fbfe7e00640 1 -- 172.21.15.99:0/1672941308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe01e6880 con 0x7fbfe0156ba0 2024-03-30T13:13:26.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.375+0000 7fbfdd600640 1 -- 172.21.15.99:0/1672941308 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbfd8019020 con 0x7fbfe0156ba0 2024-03-30T13:13:26.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.376+0000 7fbfdd600640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbfc006c530 0x7fbfc006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.376+0000 7fbfdd600640 1 -- 172.21.15.99:0/1672941308 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fbfd808ba90 con 0x7fbfe0156ba0 2024-03-30T13:13:26.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.376+0000 7fbfe5400640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbfc006c530 0x7fbfc006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.377+0000 7fbfea9f8740 1 Processor -- start 2024-03-30T13:13:26.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.377+0000 7fbfe5400640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbfc006c530 0x7fbfc006e9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4036000 tx=0x7fbfd403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.377+0000 7fbfea9f8740 1 -- start start 2024-03-30T13:13:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24d8160 0x561ce24ab100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8540 0x561ce24daef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24ab640 0x561ce24db430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561ce2410350 con 0x561ce24ab640 2024-03-30T13:13:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561ce23b8530 con 0x561ce24d8160 2024-03-30T13:13:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x561ce240c300 con 0x561ce24d8540 2024-03-30T13:13:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfe5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24ab640 0x561ce24db430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfe5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24ab640 0x561ce24db430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36350/0 (socket says 172.21.15.99:36350) 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfe5e00640 1 -- 172.21.15.99:0/325901820 learned_addr learned my addr 172.21.15.99:0/325901820 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfe5400640 1 --2- 172.21.15.99:0/325901820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24d8160 0x561ce24ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfe5e00640 1 -- 172.21.15.99:0/325901820 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8540 msgr2=0x561ce24daef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfe4a00640 1 --2- 172.21.15.99:0/325901820 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8540 0x561ce24daef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfe5e00640 1 --2- 172.21.15.99:0/325901820 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8540 0x561ce24daef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfe5e00640 1 -- 172.21.15.99:0/325901820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24d8160 msgr2=0x561ce24ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfe5e00640 1 --2- 172.21.15.99:0/325901820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24d8160 0x561ce24ab100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.378+0000 7fbfe5e00640 1 -- 172.21.15.99:0/325901820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce23cf1d0 con 0x561ce24ab640 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.379+0000 7fbfe5e00640 1 --2- 172.21.15.99:0/325901820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24ab640 0x561ce24db430 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8089de0 tx=0x7fbfd8059890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c090d5c1c7432472 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.379+0000 7fbfd1c00640 1 -- 172.21.15.99:0/325901820 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800ce10 con 0x561ce24ab640 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.379+0000 7fbfd1c00640 1 -- 172.21.15.99:0/325901820 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd8057930 con 0x561ce24ab640 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.379+0000 7fbfd1c00640 1 -- 172.21.15.99:0/325901820 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80600b0 con 0x561ce24ab640 2024-03-30T13:13:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.379+0000 7fbfea9f8740 1 -- 172.21.15.99:0/325901820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24ab640 msgr2=0x561ce24db430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.379+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/325901820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24ab640 0x561ce24db430 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8089de0 tx=0x7fbfd8059890 comp rx=0 tx=0).stop 2024-03-30T13:13:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.380+0000 7fbfea9f8740 1 -- 172.21.15.99:0/325901820 shutdown_connections 2024-03-30T13:13:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.380+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/325901820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24ab640 0x561ce24db430 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.380+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/325901820 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8540 0x561ce24daef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.380+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/325901820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24d8160 0x561ce24ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.380+0000 7fbfea9f8740 1 -- 172.21.15.99:0/325901820 >> 172.21.15.99:0/325901820 conn(0x561ce24ad370 msgr2=0x561ce24f5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.380+0000 7fbfea9f8740 1 -- 172.21.15.99:0/325901820 shutdown_connections 2024-03-30T13:13:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.380+0000 7fbfea9f8740 1 -- 172.21.15.99:0/325901820 wait complete. 2024-03-30T13:13:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.380+0000 7fbfea9f8740 1 -- start start 2024-03-30T13:13:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.380+0000 7fbfea9f8740 1 Processor -- start 2024-03-30T13:13:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.381+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8160 0x561ce24f6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.381+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8540 0x561ce24d9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.381+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24da270 0x561ce24df820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.381+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561ce24afa10 con 0x561ce24d8160 2024-03-30T13:13:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561ce23cb8f0 con 0x561ce24da270 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x561ce24b2250 con 0x561ce24d8540 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfea9f8740 10 client.0 _ll_register_callbacks cb 0x561ce23d00c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfe5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8160 0x561ce24f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfe5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8160 0x561ce24f6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36360/0 (socket says 172.21.15.99:36360) 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfe5400640 1 -- 172.21.15.99:0/1990762687 learned_addr learned my addr 172.21.15.99:0/1990762687 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfe5400640 1 -- 172.21.15.99:0/1990762687 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8540 msgr2=0x561ce24d9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfe5400640 1 --2- 172.21.15.99:0/1990762687 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8540 0x561ce24d9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfe5400640 1 -- 172.21.15.99:0/1990762687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24da270 msgr2=0x561ce24df820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfe5400640 1 --2- 172.21.15.99:0/1990762687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24da270 0x561ce24df820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfe5400640 1 -- 172.21.15.99:0/1990762687 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce21f07b0 con 0x561ce24d8160 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfe5400640 1 --2- 172.21.15.99:0/1990762687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8160 0x561ce24f6440 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbfd402be80 tx=0x7fbfd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a356268fcca548b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.382+0000 7fbfc6000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfc6000640 1 -- 172.21.15.99:0/1990762687 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4053060 con 0x561ce24d8160 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfc6000640 1 -- 172.21.15.99:0/1990762687 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fbfd4042070 con 0x561ce24d8160 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfea9f8740 1 -- 172.21.15.99:0/1990762687 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfd8057930 con 0x561ce24d8160 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfc6000640 1 -- 172.21.15.99:0/1990762687 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbfd4059050 con 0x561ce24d8160 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfea9f8740 10 client.5844 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfea9f8740 1 -- 172.21.15.99:0/1990762687 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x561ce2250f40 con 0x561ce24d8160 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfc6000640 1 -- 172.21.15.99:0/1990762687 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd8057930 con 0x561ce24d8160 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfc6000640 1 -- 172.21.15.99:0/1990762687 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fbfd405c020 con 0x561ce24d8160 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfea9f8740 10 client.5844 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfea9f8740 10 client.5844 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfea9f8740 20 client.5844 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/1990762687 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561ce24c4200 0x561ce24c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfea9f8740 4 client.5844 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.383+0000 7fbfea9f8740 1 -- 172.21.15.99:0/1990762687 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ce241d890 con 0x561ce24c4200 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.384+0000 7fbfe4a00640 1 --2- 172.21.15.99:0/1990762687 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561ce24c4200 0x561ce24c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.385+0000 7fbfe4a00640 1 --2- 172.21.15.99:0/1990762687 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561ce24c4200 0x561ce24c4690 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1ed9f58673ccab9 server_cookie=16dbc399909e6ff8 in_seq=0 out_seq=0 2024-03-30T13:13:26.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.385+0000 7fbfc6000640 10 client.5844 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfc6000640 1 -- 172.21.15.99:0/1990762687 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x561ce241d890 con 0x561ce24c4200 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfc6000640 10 client.5844 handle_command_reply: tid=0 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfea9f8740 1 client.5844 shutdown 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfea9f8740 1 -- 172.21.15.99:0/1990762687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8160 msgr2=0x561ce24f6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/1990762687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8160 0x561ce24f6440 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbfd402be80 tx=0x7fbfd4004730 comp rx=0 tx=0).stop 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfea9f8740 1 -- 172.21.15.99:0/1990762687 shutdown_connections 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/1990762687 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561ce24c4200 0x561ce24c4690 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/1990762687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24da270 0x561ce24df820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/1990762687 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8540 0x561ce24d9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/1990762687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8160 0x561ce24f6440 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfea9f8740 1 -- 172.21.15.99:0/1990762687 >> 172.21.15.99:0/1990762687 conn(0x561ce24ab640 msgr2=0x561ce24af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.386+0000 7fbfc6000640 0 client.5844 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.387+0000 7fbfea9f8740 1 -- 172.21.15.99:0/1990762687 shutdown_connections 2024-03-30T13:13:26.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.387+0000 7fbfea9f8740 1 -- 172.21.15.99:0/1990762687 wait complete. 2024-03-30T13:13:26.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.387+0000 7fbfea9f8740 20 client.5844 trim_cache size 0 max 16384 2024-03-30T13:13:26.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.405+0000 7fbfea9f8740 1 Processor -- start 2024-03-30T13:13:26.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.405+0000 7fbfea9f8740 1 -- start start 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24d8160 0x561ce24b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24da270 0x561ce24a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561ce24dc260 con 0x561ce24d8540 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe01fcbf0 con 0x561ce24d8160 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe015ecc0 con 0x561ce24da270 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfe4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfe4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24a5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36376/0 (socket says 172.21.15.99:36376) 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfe4a00640 1 -- 172.21.15.99:0/2935279998 learned_addr learned my addr 172.21.15.99:0/2935279998 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfe5e00640 1 --2- 172.21.15.99:0/2935279998 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24da270 0x561ce24a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfe4a00640 1 -- 172.21.15.99:0/2935279998 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24da270 msgr2=0x561ce24a60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfe4a00640 1 --2- 172.21.15.99:0/2935279998 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24da270 0x561ce24a60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfe4a00640 1 -- 172.21.15.99:0/2935279998 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24d8160 msgr2=0x561ce24b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfe4a00640 1 --2- 172.21.15.99:0/2935279998 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24d8160 0x561ce24b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.406+0000 7fbfe4a00640 1 -- 172.21.15.99:0/2935279998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce24dfb90 con 0x561ce24d8540 2024-03-30T13:13:26.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfe4a00640 1 --2- 172.21.15.99:0/2935279998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24a5b80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0142f90 tx=0x7fbfcc0051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af57ea14ac5579e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfd1200640 1 -- 172.21.15.99:0/2935279998 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc01c020 con 0x561ce24d8540 2024-03-30T13:13:26.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfd1200640 1 -- 172.21.15.99:0/2935279998 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0035f0 con 0x561ce24d8540 2024-03-30T13:13:26.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfd1200640 1 -- 172.21.15.99:0/2935279998 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0039e0 con 0x561ce24d8540 2024-03-30T13:13:26.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2935279998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 msgr2=0x561ce24a5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/2935279998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24a5b80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0142f90 tx=0x7fbfcc0051c0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2935279998 shutdown_connections 2024-03-30T13:13:26.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/2935279998 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24da270 0x561ce24a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/2935279998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24a5b80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/2935279998 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24d8160 0x561ce24b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2935279998 >> 172.21.15.99:0/2935279998 conn(0x561ce24ab640 msgr2=0x561ce24a2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2935279998 shutdown_connections 2024-03-30T13:13:26.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.407+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2935279998 wait complete. 2024-03-30T13:13:26.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.408+0000 7fbfea9f8740 1 -- start start 2024-03-30T13:13:26.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.408+0000 7fbfea9f8740 1 Processor -- start 2024-03-30T13:13:26.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.409+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8160 0x561ce24d6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.409+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24f6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.409+0000 7fbfea9f8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24da270 0x561ce24f6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.409+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0073520 con 0x561ce24d8540 2024-03-30T13:13:26.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.409+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0072ed0 con 0x561ce24da270 2024-03-30T13:13:26.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.409+0000 7fbfea9f8740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x561ce2565470 con 0x561ce24d8160 2024-03-30T13:13:26.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.409+0000 7fbfea9f8740 10 client.0 _ll_register_callbacks cb 0x7fbfd40096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:26.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36380/0 (socket says 172.21.15.99:36380) 2024-03-30T13:13:26.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe4a00640 1 -- 172.21.15.99:0/2384170368 learned_addr learned my addr 172.21.15.99:0/2384170368 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe5400640 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8160 0x561ce24d6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe5e00640 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24da270 0x561ce24f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe4a00640 1 -- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8160 msgr2=0x561ce24d6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe4a00640 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8160 0x561ce24d6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe4a00640 1 -- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24da270 msgr2=0x561ce24f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe4a00640 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24da270 0x561ce24f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe4a00640 1 -- 172.21.15.99:0/2384170368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce20e40a0 con 0x561ce24d8540 2024-03-30T13:13:26.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe5400640 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8160 0x561ce24d6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:26.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe5e00640 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24da270 0x561ce24f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:26.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfe4a00640 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24f6250 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0014c0 tx=0x7fbfcc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31eb2a3bc4979fd9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfc6000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:26.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.410+0000 7fbfc6000640 1 -- 172.21.15.99:0/2384170368 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc003bb0 con 0x561ce24d8540 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfc6000640 1 -- 172.21.15.99:0/2384170368 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fbfcc003d50 con 0x561ce24d8540 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2384170368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfcc0035f0 con 0x561ce24d8540 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfc6000640 1 -- 172.21.15.99:0/2384170368 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbfcc033050 con 0x561ce24d8540 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfea9f8740 10 client.5850 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2384170368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x561ce25651b0 con 0x561ce24d8540 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfc6000640 1 -- 172.21.15.99:0/2384170368 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0035f0 con 0x561ce24d8540 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfc6000640 1 -- 172.21.15.99:0/2384170368 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fbfcc036020 con 0x561ce24d8540 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfea9f8740 10 client.5850 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfea9f8740 10 client.5850 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfea9f8740 20 client.5850 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561ce254f830 0x561ce256b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfea9f8740 4 client.5850 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.411+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2384170368 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x561ce2417be0 con 0x561ce254f830 2024-03-30T13:13:26.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.412+0000 7fbfe5400640 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561ce254f830 0x561ce256b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.413+0000 7fbfe5400640 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561ce254f830 0x561ce256b290 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74cd4baf51146f49 server_cookie=19140b03816e54e3 in_seq=0 out_seq=0 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.413+0000 7fbfc6000640 10 client.5850 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.415+0000 7fbfc6000640 1 -- 172.21.15.99:0/2384170368 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561ce2417be0 con 0x561ce254f830 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.415+0000 7fbfc6000640 10 client.5850 handle_command_reply: tid=0 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.415+0000 7fbfea9f8740 1 client.5850 shutdown 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.415+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2384170368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 msgr2=0x561ce24f6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.415+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24f6250 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0014c0 tx=0x7fbfcc009040 comp rx=0 tx=0).stop 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.415+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2384170368 shutdown_connections 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.415+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561ce254f830 0x561ce256b290 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.415+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ce24da270 0x561ce24f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.415+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ce24d8540 0x561ce24f6250 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.415+0000 7fbfea9f8740 1 --2- 172.21.15.99:0/2384170368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x561ce24d8160 0x561ce24d6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.415+0000 7fbfc6000640 0 client.5850 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:26.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.416+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2384170368 >> 172.21.15.99:0/2384170368 conn(0x561ce24ab640 msgr2=0x561ce24a2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.416+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2384170368 shutdown_connections 2024-03-30T13:13:26.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.416+0000 7fbfea9f8740 1 -- 172.21.15.99:0/2384170368 wait complete. 2024-03-30T13:13:26.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.416+0000 7fbfea9f8740 20 client.5850 trim_cache size 0 max 16384 2024-03-30T13:13:26.429 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:26.430 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-03-30T13:13:26.430 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "35967ff8-91c1-445d-ae49-584e4340fa36", 2024-03-30T13:13:26.430 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-03-30T13:13:26.430 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:26.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.416+0000 7fbfe7e00640 1 -- 172.21.15.99:0/1672941308 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbfc006c530 msgr2=0x7fbfc006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.416+0000 7fbfe7e00640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbfc006c530 0x7fbfc006e9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4036000 tx=0x7fbfd403d040 comp rx=0 tx=0).stop 2024-03-30T13:13:26.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.416+0000 7fbfe7e00640 1 -- 172.21.15.99:0/1672941308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfe0156ba0 msgr2=0x7fbfe01503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.416+0000 7fbfe7e00640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfe0156ba0 0x7fbfe01503f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800c700 tx=0x7fbfd800cbc0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.416+0000 7fbfe7e00640 1 -- 172.21.15.99:0/1672941308 shutdown_connections 2024-03-30T13:13:26.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.416+0000 7fbfe7e00640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbfc006c530 0x7fbfc006e9f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.416+0000 7fbfe7e00640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfe0156ba0 0x7fbfe01503f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.417+0000 7fbfe7e00640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfe00d0ba0 0x7fbfe014feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.417+0000 7fbfe7e00640 1 --2- 172.21.15.99:0/1672941308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbfe006d860 0x7fbfe0099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.417+0000 7fbfe7e00640 1 -- 172.21.15.99:0/1672941308 >> 172.21.15.99:0/1672941308 conn(0x7fbfe006b6f0 msgr2=0x7fbfe00b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.417+0000 7fbfe7e00640 1 -- 172.21.15.99:0/1672941308 shutdown_connections 2024-03-30T13:13:26.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.417+0000 7fbfe7e00640 1 -- 172.21.15.99:0/1672941308 wait complete. 2024-03-30T13:13:26.437 DEBUG:tasks.cephfs.test_uninlining:scrub start response: {'return_code': 0, 'scrub_tag': '35967ff8-91c1-445d-ae49-584e4340fa36', 'mode': 'asynchronous'} 2024-03-30T13:13:26.437 DEBUG:tasks.cephfs.test_uninlining:waiting for scrub to complete 2024-03-30T13:13:26.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:26.438 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:13:26.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.642+0000 7f6948400640 1 Processor -- start 2024-03-30T13:13:26.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.643+0000 7f6948400640 1 -- start start 2024-03-30T13:13:26.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.644+0000 7f6948400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f694015b3d0 0x7f694006f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.644+0000 7f6948400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6940071860 0x7f69400b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.644+0000 7f6948400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6940071f20 con 0x7f69400b3da0 2024-03-30T13:13:26.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.644+0000 7f6948400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6940071ce0 con 0x7f694015b3d0 2024-03-30T13:13:26.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.644+0000 7f6948400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6940072200 con 0x7f6940071860 2024-03-30T13:13:26.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.644+0000 7f6945a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f694015b3d0 0x7f694006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.644+0000 7f6945000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6940071860 0x7f69400b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.644+0000 7f6945a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f694015b3d0 0x7f694006f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49964/0 (socket says 172.21.15.99:49964) 2024-03-30T13:13:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.644+0000 7f6945a00640 1 -- 172.21.15.99:0/69427396 learned_addr learned my addr 172.21.15.99:0/69427396 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.645+0000 7f6945a00640 1 -- 172.21.15.99:0/69427396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6940071860 msgr2=0x7f69400b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.645+0000 7f6945a00640 1 --2- 172.21.15.99:0/69427396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6940071860 0x7f69400b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.645+0000 7f6945a00640 1 -- 172.21.15.99:0/69427396 >> v1:172.21.15.181:6789/0 conn(0x7f69400b3da0 legacy=0x7f69400d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.645+0000 7f6945a00640 1 -- 172.21.15.99:0/69427396 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69400724e0 con 0x7f694015b3d0 2024-03-30T13:13:26.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.646+0000 7f6945a00640 1 --2- 172.21.15.99:0/69427396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694015b3d0 0x7f694006f320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6934009870 tx=0x7f693402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b5c577229734981 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.646+0000 7f693fe00640 1 -- 172.21.15.99:0/69427396 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934034070 con 0x7f694015b3d0 2024-03-30T13:13:26.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.646+0000 7f693fe00640 1 -- 172.21.15.99:0/69427396 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934030840 con 0x7f694015b3d0 2024-03-30T13:13:26.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.646+0000 7f693fe00640 1 -- 172.21.15.99:0/69427396 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934030c10 con 0x7f694015b3d0 2024-03-30T13:13:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.647+0000 7f6948400640 1 -- 172.21.15.99:0/69427396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694015b3d0 msgr2=0x7f694006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.647+0000 7f6948400640 1 --2- 172.21.15.99:0/69427396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694015b3d0 0x7f694006f320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6934009870 tx=0x7f693402b980 comp rx=0 tx=0).stop 2024-03-30T13:13:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.647+0000 7f6948400640 1 -- 172.21.15.99:0/69427396 shutdown_connections 2024-03-30T13:13:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.647+0000 7f6948400640 1 --2- 172.21.15.99:0/69427396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6940071860 0x7f69400b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.647+0000 7f6948400640 1 --2- 172.21.15.99:0/69427396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694015b3d0 0x7f694006f320 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.647+0000 7f6948400640 1 -- 172.21.15.99:0/69427396 >> 172.21.15.99:0/69427396 conn(0x7f694006b6f0 msgr2=0x7f694006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.647+0000 7f6948400640 1 -- 172.21.15.99:0/69427396 shutdown_connections 2024-03-30T13:13:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.647+0000 7f6948400640 1 -- 172.21.15.99:0/69427396 wait complete. 2024-03-30T13:13:26.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.650+0000 7f6948400640 1 Processor -- start 2024-03-30T13:13:26.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.650+0000 7f6948400640 1 -- start start 2024-03-30T13:13:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.651+0000 7f6948400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6940071860 0x7f6940099a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.651+0000 7f6948400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69400b3da0 0x7f6940146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.651+0000 7f6948400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f694015b3d0 0x7f6940150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.651+0000 7f6948400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f69400d0b20 con 0x7f69400b3da0 2024-03-30T13:13:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.651+0000 7f6948400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f694015b7b0 con 0x7f6940071860 2024-03-30T13:13:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.651+0000 7f6948400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f69400d0ca0 con 0x7f694015b3d0 2024-03-30T13:13:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.652+0000 7f6946400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f694015b3d0 0x7f6940150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.652+0000 7f6945a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6940071860 0x7f6940099a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.652+0000 7f6946400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f694015b3d0 0x7f6940150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:53700/0 (socket says 172.21.15.99:53700) 2024-03-30T13:13:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.652+0000 7f6946400640 1 -- 172.21.15.99:0/327591194 learned_addr learned my addr 172.21.15.99:0/327591194 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.652+0000 7f6945000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69400b3da0 0x7f6940146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.652+0000 7f6946400640 1 -- 172.21.15.99:0/327591194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6940071860 msgr2=0x7f6940099a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.652+0000 7f6946400640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6940071860 0x7f6940099a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.652+0000 7f6946400640 1 -- 172.21.15.99:0/327591194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69400b3da0 msgr2=0x7f6940146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.652+0000 7f6946400640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69400b3da0 0x7f6940146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.652+0000 7f6946400640 1 -- 172.21.15.99:0/327591194 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69401516f0 con 0x7f694015b3d0 2024-03-30T13:13:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.652+0000 7f6945000640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69400b3da0 0x7f6940146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:13:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.653+0000 7f6946400640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f694015b3d0 0x7f6940150700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f693800c6b0 tx=0x7f693800cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.653+0000 7f693d600640 1 -- 172.21.15.99:0/327591194 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938003b70 con 0x7f694015b3d0 2024-03-30T13:13:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.653+0000 7f693d600640 1 -- 172.21.15.99:0/327591194 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6938003d30 con 0x7f694015b3d0 2024-03-30T13:13:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.653+0000 7f6948400640 1 -- 172.21.15.99:0/327591194 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6940151410 con 0x7f694015b3d0 2024-03-30T13:13:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.653+0000 7f6948400640 1 -- 172.21.15.99:0/327591194 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6940149ff0 con 0x7f694015b3d0 2024-03-30T13:13:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.653+0000 7f693d600640 1 -- 172.21.15.99:0/327591194 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938005310 con 0x7f694015b3d0 2024-03-30T13:13:26.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.657+0000 7f693d600640 1 -- 172.21.15.99:0/327591194 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f69380054b0 con 0x7f694015b3d0 2024-03-30T13:13:26.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.659+0000 7f693d600640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f692006c560 0x7f692006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.659+0000 7f693d600640 1 -- 172.21.15.99:0/327591194 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f693808b490 con 0x7f694015b3d0 2024-03-30T13:13:26.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.659+0000 7f6945a00640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f692006c560 0x7f692006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.660+0000 7f694b013740 1 Processor -- start 2024-03-30T13:13:26.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.660+0000 7f694b013740 1 -- start start 2024-03-30T13:13:26.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.660+0000 7f6945a00640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f692006c560 0x7f692006ea20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6934036000 tx=0x7f693403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.661+0000 7f694b013740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df91560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.661+0000 7f694b013740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe9a0 0x56027dfc1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.661+0000 7f694b013740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027df91aa0 0x56027dfc1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.661+0000 7f694b013740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56027defc6d0 con 0x56027dfbe5c0 2024-03-30T13:13:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.661+0000 7f694b013740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56027dea4770 con 0x56027dfbe9a0 2024-03-30T13:13:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.661+0000 7f694b013740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56027def8680 con 0x56027df91aa0 2024-03-30T13:13:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.661+0000 7f6945a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df91560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.661+0000 7f6945a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df91560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36408/0 (socket says 172.21.15.99:36408) 2024-03-30T13:13:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.661+0000 7f6945a00640 1 -- 172.21.15.99:0/176685525 learned_addr learned my addr 172.21.15.99:0/176685525 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.661+0000 7f6945000640 1 --2- 172.21.15.99:0/176685525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe9a0 0x56027dfc1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.662+0000 7f6946400640 1 --2- 172.21.15.99:0/176685525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027df91aa0 0x56027dfc1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.662+0000 7f6945a00640 1 -- 172.21.15.99:0/176685525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027df91aa0 msgr2=0x56027dfc1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.662+0000 7f6945a00640 1 --2- 172.21.15.99:0/176685525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027df91aa0 0x56027dfc1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.662+0000 7f6945a00640 1 -- 172.21.15.99:0/176685525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe9a0 msgr2=0x56027dfc1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.662+0000 7f6945a00640 1 --2- 172.21.15.99:0/176685525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe9a0 0x56027dfc1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.662+0000 7f6945a00640 1 -- 172.21.15.99:0/176685525 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56027dcda7d0 con 0x56027dfbe5c0 2024-03-30T13:13:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.662+0000 7f6945000640 1 --2- 172.21.15.99:0/176685525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe9a0 0x56027dfc1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:13:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.662+0000 7f6945a00640 1 --2- 172.21.15.99:0/176685525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df91560 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6934009960 tx=0x7f6934030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87ac49b861b2175 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.663+0000 7f6932000640 1 -- 172.21.15.99:0/176685525 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934053070 con 0x56027dfbe5c0 2024-03-30T13:13:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.663+0000 7f6932000640 1 -- 172.21.15.99:0/176685525 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934039950 con 0x56027dfbe5c0 2024-03-30T13:13:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.663+0000 7f6932000640 1 -- 172.21.15.99:0/176685525 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934034040 con 0x56027dfbe5c0 2024-03-30T13:13:26.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.664+0000 7f694b013740 1 -- 172.21.15.99:0/176685525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 msgr2=0x56027df91560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.664+0000 7f694b013740 1 --2- 172.21.15.99:0/176685525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df91560 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6934009960 tx=0x7f6934030000 comp rx=0 tx=0).stop 2024-03-30T13:13:26.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.664+0000 7f694b013740 1 -- 172.21.15.99:0/176685525 shutdown_connections 2024-03-30T13:13:26.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.664+0000 7f694b013740 1 --2- 172.21.15.99:0/176685525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027df91aa0 0x56027dfc1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.664+0000 7f694b013740 1 --2- 172.21.15.99:0/176685525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe9a0 0x56027dfc1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.664+0000 7f694b013740 1 --2- 172.21.15.99:0/176685525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df91560 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.664+0000 7f694b013740 1 -- 172.21.15.99:0/176685525 >> 172.21.15.99:0/176685525 conn(0x56027df937d0 msgr2=0x56027dfdc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.664+0000 7f694b013740 1 -- 172.21.15.99:0/176685525 shutdown_connections 2024-03-30T13:13:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.665+0000 7f694b013740 1 -- 172.21.15.99:0/176685525 wait complete. 2024-03-30T13:13:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.665+0000 7f694b013740 1 -- start start 2024-03-30T13:13:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.665+0000 7f694b013740 1 Processor -- start 2024-03-30T13:13:26.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.667+0000 7f694b013740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe5c0 0x56027dfc4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.667+0000 7f694b013740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfbe9a0 0x56027dfd9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.667+0000 7f694b013740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfc3570 0x56027dfb70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.667+0000 7f694b013740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56027df95e70 con 0x56027dfc3570 2024-03-30T13:13:26.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.667+0000 7f694b013740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56027deb7aa0 con 0x56027dfbe5c0 2024-03-30T13:13:26.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.667+0000 7f694b013740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56027df986b0 con 0x56027dfbe9a0 2024-03-30T13:13:26.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.667+0000 7f694b013740 10 client.0 _ll_register_callbacks cb 0x56027deb7490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:26.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.667+0000 7f6945a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe5c0 0x56027dfc4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.667+0000 7f6946400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfc3570 0x56027dfb70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.667+0000 7f6945a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe5c0 0x56027dfc4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49994/0 (socket says 172.21.15.99:49994) 2024-03-30T13:13:26.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.667+0000 7f6945a00640 1 -- 172.21.15.99:0/1001477041 learned_addr learned my addr 172.21.15.99:0/1001477041 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.668+0000 7f6945000640 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfbe9a0 0x56027dfd9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.668+0000 7f6945a00640 1 -- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfbe9a0 msgr2=0x56027dfd9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.668+0000 7f6945a00640 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfbe9a0 0x56027dfd9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.668+0000 7f6945a00640 1 -- 172.21.15.99:0/1001477041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfc3570 msgr2=0x56027dfb70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.668+0000 7f6945a00640 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfc3570 0x56027dfb70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.668+0000 7f6945a00640 1 -- 172.21.15.99:0/1001477041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56027dc103f0 con 0x56027dfbe5c0 2024-03-30T13:13:26.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.668+0000 7f6945000640 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfbe9a0 0x56027dfd9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:26.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.668+0000 7f6945a00640 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe5c0 0x56027dfc4460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6934009960 tx=0x7f6934004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddfa5051c178a1e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.668+0000 7f6926a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f6926a00640 1 -- 172.21.15.99:0/1001477041 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693405c060 con 0x56027dfbe5c0 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f694b013740 1 -- 172.21.15.99:0/1001477041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6934039950 con 0x56027dfbe5c0 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f6926a00640 1 -- 172.21.15.99:0/1001477041 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f693404e8a0 con 0x56027dfbe5c0 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f6926a00640 1 -- 172.21.15.99:0/1001477041 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6934062050 con 0x56027dfbe5c0 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f694b013740 10 client.5065 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f694b013740 1 -- 172.21.15.99:0/1001477041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x56027dbd00f0 con 0x56027dfbe5c0 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f6926a00640 1 -- 172.21.15.99:0/1001477041 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934039950 con 0x56027dfbe5c0 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f6926a00640 1 -- 172.21.15.99:0/1001477041 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f6934065020 con 0x56027dfbe5c0 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f694b013740 10 client.5065 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f694b013740 10 client.5065 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f694b013740 20 client.5065 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f694b013740 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56027dfb9930 0x56027dfb9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f694b013740 4 client.5065 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:26.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.669+0000 7f694b013740 1 -- 172.21.15.99:0/1001477041 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56027df09c10 con 0x56027dfb9930 2024-03-30T13:13:26.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.670+0000 7f6945000640 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56027dfb9930 0x56027dfb9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.670+0000 7f6945000640 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56027dfb9930 0x56027dfb9d50 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac8b5b7ab01adf16 server_cookie=ac330b26e578ec19 in_seq=0 out_seq=0 2024-03-30T13:13:26.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.670+0000 7f6926a00640 10 client.5065 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:26.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.671+0000 7f6926a00640 1 -- 172.21.15.99:0/1001477041 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x56027df09c10 con 0x56027dfb9930 2024-03-30T13:13:26.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.671+0000 7f6926a00640 10 client.5065 handle_command_reply: tid=0 2024-03-30T13:13:26.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.671+0000 7f694b013740 1 client.5065 shutdown 2024-03-30T13:13:26.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f694b013740 1 -- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe5c0 msgr2=0x56027dfc4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f694b013740 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe5c0 0x56027dfc4460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6934009960 tx=0x7f6934004730 comp rx=0 tx=0).stop 2024-03-30T13:13:26.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f694b013740 1 -- 172.21.15.99:0/1001477041 shutdown_connections 2024-03-30T13:13:26.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f694b013740 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfc3570 0x56027dfb70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f694b013740 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfbe9a0 0x56027dfd9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f694b013740 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56027dfb9930 0x56027dfb9d50 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f694b013740 1 --2- 172.21.15.99:0/1001477041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe5c0 0x56027dfc4460 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f694b013740 1 -- 172.21.15.99:0/1001477041 >> 172.21.15.99:0/1001477041 conn(0x56027df91aa0 msgr2=0x56027df95540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f6926a00640 0 client.5065 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:26.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f694b013740 1 -- 172.21.15.99:0/1001477041 shutdown_connections 2024-03-30T13:13:26.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f694b013740 1 -- 172.21.15.99:0/1001477041 wait complete. 2024-03-30T13:13:26.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.672+0000 7f694b013740 20 client.5065 trim_cache size 0 max 16384 2024-03-30T13:13:26.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.691+0000 7f694b013740 1 Processor -- start 2024-03-30T13:13:26.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.692+0000 7f694b013740 1 -- start start 2024-03-30T13:13:26.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.692+0000 7f694b013740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027dfebb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.692+0000 7f694b013740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe9a0 0x56027dfd9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.692+0000 7f694b013740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfc3570 0x56027dfbc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.692+0000 7f694b013740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6940200f00 con 0x56027dfbe5c0 2024-03-30T13:13:26.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.692+0000 7f694b013740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f694014ae90 con 0x56027dfbe9a0 2024-03-30T13:13:26.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.692+0000 7f694b013740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f694015c6a0 con 0x56027dfc3570 2024-03-30T13:13:26.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6945a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027dfebb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6945a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027dfebb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36428/0 (socket says 172.21.15.99:36428) 2024-03-30T13:13:26.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6945a00640 1 -- 172.21.15.99:0/858454994 learned_addr learned my addr 172.21.15.99:0/858454994 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6945000640 1 --2- 172.21.15.99:0/858454994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe9a0 0x56027dfd9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6946400640 1 --2- 172.21.15.99:0/858454994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfc3570 0x56027dfbc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6945a00640 1 -- 172.21.15.99:0/858454994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfc3570 msgr2=0x56027dfbc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6945a00640 1 --2- 172.21.15.99:0/858454994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfc3570 0x56027dfbc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6945a00640 1 -- 172.21.15.99:0/858454994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe9a0 msgr2=0x56027dfd9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6945a00640 1 --2- 172.21.15.99:0/858454994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe9a0 0x56027dfd9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6945a00640 1 -- 172.21.15.99:0/858454994 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56027dfdae20 con 0x56027dfbe5c0 2024-03-30T13:13:26.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6946400640 1 --2- 172.21.15.99:0/858454994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfc3570 0x56027dfbc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:26.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.693+0000 7f6945a00640 1 --2- 172.21.15.99:0/858454994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027dfebb20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f69340090b0 tx=0x7f6934053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9d7eaae95adaa1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f6931600640 1 -- 172.21.15.99:0/858454994 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934034070 con 0x56027dfbe5c0 2024-03-30T13:13:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f6931600640 1 -- 172.21.15.99:0/858454994 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693404e720 con 0x56027dfbe5c0 2024-03-30T13:13:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f6931600640 1 -- 172.21.15.99:0/858454994 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934053070 con 0x56027dfbe5c0 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f694b013740 1 -- 172.21.15.99:0/858454994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 msgr2=0x56027dfebb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f694b013740 1 --2- 172.21.15.99:0/858454994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027dfebb20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f69340090b0 tx=0x7f6934053000 comp rx=0 tx=0).stop 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f694b013740 1 -- 172.21.15.99:0/858454994 shutdown_connections 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f694b013740 1 --2- 172.21.15.99:0/858454994 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfc3570 0x56027dfbc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f694b013740 1 --2- 172.21.15.99:0/858454994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfbe9a0 0x56027dfd9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f694b013740 1 --2- 172.21.15.99:0/858454994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027dfebb20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f694b013740 1 -- 172.21.15.99:0/858454994 >> 172.21.15.99:0/858454994 conn(0x56027df91aa0 msgr2=0x56027dfc3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f694b013740 1 -- 172.21.15.99:0/858454994 shutdown_connections 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.694+0000 7f694b013740 1 -- 172.21.15.99:0/858454994 wait complete. 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.695+0000 7f694b013740 1 -- start start 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.695+0000 7f694b013740 1 Processor -- start 2024-03-30T13:13:26.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.696+0000 7f694b013740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df96af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.696+0000 7f694b013740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfbe9a0 0x56027e052000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.696+0000 7f694b013740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfc3570 0x56027dfd8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.696+0000 7f694b013740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56027df8cb80 con 0x56027dfbe5c0 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.696+0000 7f694b013740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f694014a840 con 0x56027dfc3570 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.696+0000 7f694b013740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56027def8800 con 0x56027dfbe9a0 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.696+0000 7f694b013740 10 client.0 _ll_register_callbacks cb 0x7f6934051070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6945a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df96af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6945a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df96af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36444/0 (socket says 172.21.15.99:36444) 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6945a00640 1 -- 172.21.15.99:0/1140007621 learned_addr learned my addr 172.21.15.99:0/1140007621 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6945000640 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfbe9a0 0x56027e052000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6946400640 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfc3570 0x56027dfd8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6945a00640 1 -- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfbe9a0 msgr2=0x56027e052000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6945a00640 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfbe9a0 0x56027e052000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6945a00640 1 -- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfc3570 msgr2=0x56027dfd8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6945a00640 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfc3570 0x56027dfd8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6945a00640 1 -- 172.21.15.99:0/1140007621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56027dfd8ac0 con 0x56027dfbe5c0 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6946400640 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfc3570 0x56027dfd8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6945a00640 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df96af0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f693402bf90 tx=0x7f6934046070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e215f4cf96a2ac86 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6926a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6926a00640 1 -- 172.21.15.99:0/1140007621 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934053070 con 0x56027dfbe5c0 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f6926a00640 1 -- 172.21.15.99:0/1140007621 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f6934044b30 con 0x56027dfbe5c0 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.697+0000 7f694b013740 1 -- 172.21.15.99:0/1140007621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f693404e720 con 0x56027dfbe5c0 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.698+0000 7f6926a00640 1 -- 172.21.15.99:0/1140007621 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6934044d30 con 0x56027dfbe5c0 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.698+0000 7f694b013740 10 client.5865 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.698+0000 7f694b013740 1 -- 172.21.15.99:0/1140007621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x56027df90680 con 0x56027dfbe5c0 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.698+0000 7f6926a00640 1 -- 172.21.15.99:0/1140007621 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693404e720 con 0x56027dfbe5c0 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.698+0000 7f6926a00640 1 -- 172.21.15.99:0/1140007621 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f693405f020 con 0x56027dfbe5c0 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.698+0000 7f694b013740 10 client.5865 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:26.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.698+0000 7f694b013740 10 client.5865 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.698+0000 7f694b013740 20 client.5865 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.698+0000 7f694b013740 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56027dfb4e80 0x56027dfb5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.698+0000 7f694b013740 4 client.5865 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.698+0000 7f694b013740 1 -- 172.21.15.99:0/1140007621 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56027df03f60 con 0x56027dfb4e80 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.699+0000 7f6945000640 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56027dfb4e80 0x56027dfb5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.699+0000 7f6945000640 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56027dfb4e80 0x56027dfb5260 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4acb483fa4e7043 server_cookie=209fbd55ac101ffa in_seq=0 out_seq=0 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.699+0000 7f6926a00640 10 client.5865 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.699+0000 7f6926a00640 1 -- 172.21.15.99:0/1140007621 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+850 (crc 0 0 0) 0x56027df03f60 con 0x56027dfb4e80 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.699+0000 7f6926a00640 10 client.5865 handle_command_reply: tid=0 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.699+0000 7f694b013740 1 client.5865 shutdown 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f694b013740 1 -- 172.21.15.99:0/1140007621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 msgr2=0x56027df96af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f694b013740 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df96af0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f693402bf90 tx=0x7f6934046070 comp rx=0 tx=0).stop 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f694b013740 1 -- 172.21.15.99:0/1140007621 shutdown_connections 2024-03-30T13:13:26.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f694b013740 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56027dfb4e80 0x56027dfb5260 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f694b013740 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027dfc3570 0x56027dfd8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f694b013740 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56027dfbe9a0 0x56027e052000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f694b013740 1 --2- 172.21.15.99:0/1140007621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56027dfbe5c0 0x56027df96af0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f6926a00640 0 client.5865 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:26.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f694b013740 1 -- 172.21.15.99:0/1140007621 >> 172.21.15.99:0/1140007621 conn(0x56027df91aa0 msgr2=0x56027dfdbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f694b013740 1 -- 172.21.15.99:0/1140007621 shutdown_connections 2024-03-30T13:13:26.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f694b013740 1 -- 172.21.15.99:0/1140007621 wait complete. 2024-03-30T13:13:26.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f694b013740 20 client.5865 trim_cache size 0 max 16384 2024-03-30T13:13:26.710 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:26.710 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: "35967ff8-91c1-445d-ae49-584e4340fa36": { 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "35967ff8-91c1-445d-ae49-584e4340fa36", 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive" 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_stats": { 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: "35967ff8-91c1-445d-ae49-584e4340fa36": { 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: "start_time": "2024-03-30T13:13:26.413469+0000", 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_started": 0, 2024-03-30T13:13:26.711 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_passed": 0, 2024-03-30T13:13:26.712 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_failed": 0, 2024-03-30T13:13:26.712 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_skipped": 0 2024-03-30T13:13:26.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:26.712 INFO:teuthology.orchestra.run.smithi099.stdout: "bb44bba3-62df-4f2b-ba9b-e831e668d773": { 2024-03-30T13:13:26.712 INFO:teuthology.orchestra.run.smithi099.stdout: "start_time": "2024-03-30T13:12:40.259378+0000", 2024-03-30T13:13:26.712 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-30T13:13:26.712 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_started": 75, 2024-03-30T13:13:26.712 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_passed": 75, 2024-03-30T13:13:26.712 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_failed": 0, 2024-03-30T13:13:26.712 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_skipped": 0 2024-03-30T13:13:26.713 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:26.713 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:26.713 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:26.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f6948400640 1 -- 172.21.15.99:0/327591194 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f692006c560 msgr2=0x7f692006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.700+0000 7f6948400640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f692006c560 0x7f692006ea20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6934036000 tx=0x7f693403b040 comp rx=0 tx=0).stop 2024-03-30T13:13:26.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.701+0000 7f6948400640 1 -- 172.21.15.99:0/327591194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f694015b3d0 msgr2=0x7f6940150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.701+0000 7f6948400640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f694015b3d0 0x7f6940150700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f693800c6b0 tx=0x7f693800cb70 comp rx=0 tx=0).stop 2024-03-30T13:13:26.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.701+0000 7f6948400640 1 -- 172.21.15.99:0/327591194 shutdown_connections 2024-03-30T13:13:26.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.701+0000 7f6948400640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f692006c560 0x7f692006ea20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.701+0000 7f6948400640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f694015b3d0 0x7f6940150700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.701+0000 7f6948400640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69400b3da0 0x7f6940146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.701+0000 7f6948400640 1 --2- 172.21.15.99:0/327591194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6940071860 0x7f6940099a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.701+0000 7f6948400640 1 -- 172.21.15.99:0/327591194 >> 172.21.15.99:0/327591194 conn(0x7f694006b6f0 msgr2=0x7f694006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.701+0000 7f6948400640 1 -- 172.21.15.99:0/327591194 shutdown_connections 2024-03-30T13:13:26.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:26.701+0000 7f6948400640 1 -- 172.21.15.99:0/327591194 wait complete. 2024-03-30T13:13:26.721 INFO:tasks.cephfs.filesystem:scrub status for tag:35967ff8-91c1-445d-ae49-584e4340fa36 - {'path': '/', 'tag': '35967ff8-91c1-445d-ae49-584e4340fa36', 'options': 'recursive'} 2024-03-30T13:13:27.267 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_6 2024-03-30T13:13:28.362 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_7 2024-03-30T13:13:29.451 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_8 2024-03-30T13:13:30.537 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_9 2024-03-30T13:13:31.148 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:13:31.156 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:13:56.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:56.722 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:13:56.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.936+0000 7fc02a600640 1 Processor -- start 2024-03-30T13:13:56.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.936+0000 7fc02a600640 1 -- start start 2024-03-30T13:13:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.937+0000 7fc02a600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc02415a1e0 0x7fc024160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.937+0000 7fc02a600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc02415cb30 0x7fc02415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.937+0000 7fc02a600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc0240d0410 0x7fc0240d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.937+0000 7fc02a600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc02415a5c0 con 0x7fc0240d0410 2024-03-30T13:13:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.937+0000 7fc02a600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc024161060 con 0x7fc02415cb30 2024-03-30T13:13:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.937+0000 7fc02a600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc02415d650 con 0x7fc02415a1e0 2024-03-30T13:13:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.938+0000 7fc023e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc0240d0410 0x7fc0240d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.938+0000 7fc023e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc0240d0410 0x7fc0240d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54712/0 (socket says 172.21.15.99:54712) 2024-03-30T13:13:56.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.938+0000 7fc023e00640 1 -- 172.21.15.99:0/2608627442 learned_addr learned my addr 172.21.15.99:0/2608627442 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:56.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.938+0000 7fc01be00640 1 --2- 172.21.15.99:0/2608627442 >> v2:172.21.15.181:3300/0 conn(0x7fc02415cb30 0x7fc02415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.938+0000 7fc023e00640 1 -- 172.21.15.99:0/2608627442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc02415a1e0 msgr2=0x7fc024160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:56.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.938+0000 7fc023400640 1 --2- 172.21.15.99:0/2608627442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc02415a1e0 0x7fc024160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.938+0000 7fc023e00640 1 --2- 172.21.15.99:0/2608627442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc02415a1e0 0x7fc024160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.938+0000 7fc023e00640 1 -- 172.21.15.99:0/2608627442 >> v2:172.21.15.181:3300/0 conn(0x7fc02415cb30 msgr2=0x7fc02415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:56.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.938+0000 7fc023e00640 1 --2- 172.21.15.99:0/2608627442 >> v2:172.21.15.181:3300/0 conn(0x7fc02415cb30 0x7fc02415cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.938+0000 7fc023e00640 1 -- 172.21.15.99:0/2608627442 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02415d930 con 0x7fc0240d0410 2024-03-30T13:13:56.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.938+0000 7fc01be00640 1 --2- 172.21.15.99:0/2608627442 >> v2:172.21.15.181:3300/0 conn(0x7fc02415cb30 0x7fc02415cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.939+0000 7fc023e00640 1 --2- 172.21.15.99:0/2608627442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0240d0410 0x7fc0240d08a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc024073b30 tx=0x7fc01c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c5cc3720b03944 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.940+0000 7fc022a00640 1 -- 172.21.15.99:0/2608627442 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c02ca80 con 0x7fc0240d0410 2024-03-30T13:13:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.940+0000 7fc022a00640 1 -- 172.21.15.99:0/2608627442 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01c02cc20 con 0x7fc0240d0410 2024-03-30T13:13:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.940+0000 7fc022a00640 1 -- 172.21.15.99:0/2608627442 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0343f0 con 0x7fc0240d0410 2024-03-30T13:13:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.940+0000 7fc02a600640 1 -- 172.21.15.99:0/2608627442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0240d0410 msgr2=0x7fc0240d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.940+0000 7fc02a600640 1 --2- 172.21.15.99:0/2608627442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0240d0410 0x7fc0240d08a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc024073b30 tx=0x7fc01c02bee0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.940+0000 7fc02a600640 1 -- 172.21.15.99:0/2608627442 shutdown_connections 2024-03-30T13:13:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.940+0000 7fc02a600640 1 --2- 172.21.15.99:0/2608627442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0240d0410 0x7fc0240d08a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.940+0000 7fc02a600640 1 --2- 172.21.15.99:0/2608627442 >> v2:172.21.15.181:3300/0 conn(0x7fc02415cb30 0x7fc02415cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.940+0000 7fc02a600640 1 --2- 172.21.15.99:0/2608627442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc02415a1e0 0x7fc024160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.940+0000 7fc02a600640 1 -- 172.21.15.99:0/2608627442 >> 172.21.15.99:0/2608627442 conn(0x7fc02406b6f0 msgr2=0x7fc02406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:56.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.941+0000 7fc02a600640 1 -- 172.21.15.99:0/2608627442 shutdown_connections 2024-03-30T13:13:56.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.941+0000 7fc02a600640 1 -- 172.21.15.99:0/2608627442 wait complete. 2024-03-30T13:13:56.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.943+0000 7fc02a600640 1 Processor -- start 2024-03-30T13:13:56.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.943+0000 7fc02a600640 1 -- start start 2024-03-30T13:13:56.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.944+0000 7fc02a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0240d0410 0x7fc0240cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.944+0000 7fc02a600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc02415a1e0 0x7fc0241f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.944+0000 7fc02a600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc02415cb30 0x7fc0240b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.944+0000 7fc02a600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc0240b31c0 con 0x7fc0240d0410 2024-03-30T13:13:56.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.944+0000 7fc02a600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc0240ad3c0 con 0x7fc02415cb30 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.944+0000 7fc02a600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc0240b3340 con 0x7fc02415a1e0 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.944+0000 7fc023400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0240d0410 0x7fc0240cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.944+0000 7fc023400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0240d0410 0x7fc0240cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54722/0 (socket says 172.21.15.99:54722) 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.944+0000 7fc023400640 1 -- 172.21.15.99:0/243979886 learned_addr learned my addr 172.21.15.99:0/243979886 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc023e00640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc02415cb30 0x7fc0240b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc01be00640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc02415a1e0 0x7fc0241f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc023400640 1 -- 172.21.15.99:0/243979886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc02415a1e0 msgr2=0x7fc0241f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc023400640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc02415a1e0 0x7fc0241f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc023400640 1 -- 172.21.15.99:0/243979886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc02415cb30 msgr2=0x7fc0240b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc023400640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc02415cb30 0x7fc0240b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc023400640 1 -- 172.21.15.99:0/243979886 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0240ce3d0 con 0x7fc0240d0410 2024-03-30T13:13:56.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc023400640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0240d0410 0x7fc0240cf470 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc01400c820 tx=0x7fc01400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:56.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc01b400640 1 -- 172.21.15.99:0/243979886 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014015070 con 0x7fc0240d0410 2024-03-30T13:13:56.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc01b400640 1 -- 172.21.15.99:0/243979886 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc014004220 con 0x7fc0240d0410 2024-03-30T13:13:56.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc01b400640 1 -- 172.21.15.99:0/243979886 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01400ce10 con 0x7fc0240d0410 2024-03-30T13:13:56.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.945+0000 7fc02a600640 1 -- 172.21.15.99:0/243979886 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0240ce6b0 con 0x7fc0240d0410 2024-03-30T13:13:56.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.946+0000 7fc02a600640 1 -- 172.21.15.99:0/243979886 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0240cec70 con 0x7fc0240d0410 2024-03-30T13:13:56.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.948+0000 7fc01b400640 1 -- 172.21.15.99:0/243979886 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc014007830 con 0x7fc0240d0410 2024-03-30T13:13:56.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.948+0000 7fc01b400640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc00006c530 0x7fc00006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.949+0000 7fc01b400640 1 -- 172.21.15.99:0/243979886 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc01408b6d0 con 0x7fc0240d0410 2024-03-30T13:13:56.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.949+0000 7fc01be00640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc00006c530 0x7fc00006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.949+0000 7fc02d1fd740 1 Processor -- start 2024-03-30T13:13:56.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.950+0000 7fc02d1fd740 1 -- start start 2024-03-30T13:13:56.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.950+0000 7fc01be00640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc00006c530 0x7fc00006e9f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0240ccb00 tx=0x7fc00c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x563371154560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711819a0 0x563371184350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563371154aa0 0x563371184890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5633710bf6d0 con 0x5633711815c0 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563371067770 con 0x5633711819a0 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5633710bb680 con 0x563371154aa0 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc023400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x563371154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc023400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x563371154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54738/0 (socket says 172.21.15.99:54738) 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc023400640 1 -- 172.21.15.99:0/2018978591 learned_addr learned my addr 172.21.15.99:0/2018978591 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc023400640 1 -- 172.21.15.99:0/2018978591 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563371154aa0 msgr2=0x563371184890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc023400640 1 --2- 172.21.15.99:0/2018978591 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563371154aa0 0x563371184890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc023400640 1 -- 172.21.15.99:0/2018978591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711819a0 msgr2=0x563371184350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc023400640 1 --2- 172.21.15.99:0/2018978591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711819a0 0x563371184350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.951+0000 7fc023400640 1 -- 172.21.15.99:0/2018978591 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563370e9d7d0 con 0x5633711815c0 2024-03-30T13:13:56.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.952+0000 7fc023400640 1 --2- 172.21.15.99:0/2018978591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x563371154560 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc014089a50 tx=0x7fc014058ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caad4637c10812ed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:56.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.952+0000 7fc013e00640 1 -- 172.21.15.99:0/2018978591 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01401e040 con 0x5633711815c0 2024-03-30T13:13:56.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.952+0000 7fc013e00640 1 -- 172.21.15.99:0/2018978591 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0140620b0 con 0x5633711815c0 2024-03-30T13:13:56.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.952+0000 7fc013e00640 1 -- 172.21.15.99:0/2018978591 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014055ab0 con 0x5633711815c0 2024-03-30T13:13:56.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.953+0000 7fc02d1fd740 1 -- 172.21.15.99:0/2018978591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 msgr2=0x563371154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:56.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.953+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/2018978591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x563371154560 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc014089a50 tx=0x7fc014058ed0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.953+0000 7fc02d1fd740 1 -- 172.21.15.99:0/2018978591 shutdown_connections 2024-03-30T13:13:56.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.953+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/2018978591 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563371154aa0 0x563371184890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.953+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/2018978591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711819a0 0x563371184350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.953+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/2018978591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x563371154560 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.953+0000 7fc02d1fd740 1 -- 172.21.15.99:0/2018978591 >> 172.21.15.99:0/2018978591 conn(0x5633711567d0 msgr2=0x56337119f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:56.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.953+0000 7fc02d1fd740 1 -- 172.21.15.99:0/2018978591 shutdown_connections 2024-03-30T13:13:56.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.953+0000 7fc02d1fd740 1 -- 172.21.15.99:0/2018978591 wait complete. 2024-03-30T13:13:56.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.953+0000 7fc02d1fd740 1 -- start start 2024-03-30T13:13:56.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.954+0000 7fc02d1fd740 1 Processor -- start 2024-03-30T13:13:56.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337119ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711819a0 0x5633711974d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563371197a10 0x5633711aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563371158e70 con 0x5633711815c0 2024-03-30T13:13:56.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56337107aaa0 con 0x5633711819a0 2024-03-30T13:13:56.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56337115b6b0 con 0x563371197a10 2024-03-30T13:13:56.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc02d1fd740 10 client.0 _ll_register_callbacks cb 0x56337107a490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:56.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc023400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337119ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc023400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337119ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54750/0 (socket says 172.21.15.99:54750) 2024-03-30T13:13:56.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc023400640 1 -- 172.21.15.99:0/957285221 learned_addr learned my addr 172.21.15.99:0/957285221 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc023400640 1 -- 172.21.15.99:0/957285221 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563371197a10 msgr2=0x5633711aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc023400640 1 --2- 172.21.15.99:0/957285221 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563371197a10 0x5633711aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc023400640 1 -- 172.21.15.99:0/957285221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711819a0 msgr2=0x5633711974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc023400640 1 --2- 172.21.15.99:0/957285221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711819a0 0x5633711974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.955+0000 7fc023400640 1 -- 172.21.15.99:0/957285221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563370dd33f0 con 0x5633711815c0 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.956+0000 7fc023400640 1 --2- 172.21.15.99:0/957285221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337119ea30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc01400c7f0 tx=0x7fc01401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0196583c64d5a84 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.956+0000 7fc010c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.956+0000 7fc010c00640 1 -- 172.21.15.99:0/957285221 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01401e040 con 0x5633711815c0 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.956+0000 7fc010c00640 1 -- 172.21.15.99:0/957285221 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc014058890 con 0x5633711815c0 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.956+0000 7fc02d1fd740 1 -- 172.21.15.99:0/957285221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0140620b0 con 0x5633711815c0 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.956+0000 7fc010c00640 1 -- 172.21.15.99:0/957285221 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc014058a90 con 0x5633711815c0 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.956+0000 7fc02d1fd740 10 client.5877 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:56.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.956+0000 7fc02d1fd740 1 -- 172.21.15.99:0/957285221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x563370d930f0 con 0x5633711815c0 2024-03-30T13:13:56.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.956+0000 7fc010c00640 1 -- 172.21.15.99:0/957285221 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0140620b0 con 0x5633711815c0 2024-03-30T13:13:56.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.956+0000 7fc010c00640 1 -- 172.21.15.99:0/957285221 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc014007b20 con 0x5633711815c0 2024-03-30T13:13:56.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.957+0000 7fc02d1fd740 10 client.5877 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:56.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.957+0000 7fc02d1fd740 10 client.5877 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:56.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.957+0000 7fc02d1fd740 20 client.5877 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:56.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.957+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/957285221 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5633711859c0 0x563371185de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.957+0000 7fc02d1fd740 4 client.5877 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:56.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.957+0000 7fc02d1fd740 1 -- 172.21.15.99:0/957285221 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633710ccc10 con 0x5633711859c0 2024-03-30T13:13:56.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.957+0000 7fc01be00640 1 --2- 172.21.15.99:0/957285221 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5633711859c0 0x563371185de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.958+0000 7fc01be00640 1 --2- 172.21.15.99:0/957285221 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5633711859c0 0x563371185de0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d8c7fac0ff29dbd server_cookie=9c19babd4a015ef1 in_seq=0 out_seq=0 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.958+0000 7fc010c00640 10 client.5877 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc010c00640 1 -- 172.21.15.99:0/957285221 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5633710ccc10 con 0x5633711859c0 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc010c00640 10 client.5877 handle_command_reply: tid=0 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc02d1fd740 1 client.5877 shutdown 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc02d1fd740 1 -- 172.21.15.99:0/957285221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 msgr2=0x56337119ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/957285221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337119ea30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc01400c7f0 tx=0x7fc01401c000 comp rx=0 tx=0).stop 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc02d1fd740 1 -- 172.21.15.99:0/957285221 shutdown_connections 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/957285221 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x563371197a10 0x5633711aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/957285221 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5633711859c0 0x563371185de0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/957285221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711819a0 0x5633711974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/957285221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337119ea30 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc010c00640 0 client.5877 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:56.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.960+0000 7fc02d1fd740 1 -- 172.21.15.99:0/957285221 >> 172.21.15.99:0/957285221 conn(0x563371154aa0 msgr2=0x563371158570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:56.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.961+0000 7fc02d1fd740 1 -- 172.21.15.99:0/957285221 shutdown_connections 2024-03-30T13:13:56.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.961+0000 7fc02d1fd740 1 -- 172.21.15.99:0/957285221 wait complete. 2024-03-30T13:13:56.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.961+0000 7fc02d1fd740 20 client.5877 trim_cache size 0 max 16384 2024-03-30T13:13:56.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.980+0000 7fc02d1fd740 1 Processor -- start 2024-03-30T13:13:56.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.980+0000 7fc02d1fd740 1 -- start start 2024-03-30T13:13:56.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711815c0 0x5633711a1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5633711819a0 0x56337119f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563371197a10 0x5633711580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc0241fece0 con 0x563371197a10 2024-03-30T13:13:56.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc0241fdd70 con 0x5633711815c0 2024-03-30T13:13:56.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc0240cd9c0 con 0x5633711819a0 2024-03-30T13:13:56.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc023e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563371197a10 0x5633711580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc023e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563371197a10 0x5633711580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54760/0 (socket says 172.21.15.99:54760) 2024-03-30T13:13:56.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc023e00640 1 -- 172.21.15.99:0/194654933 learned_addr learned my addr 172.21.15.99:0/194654933 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:56.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc023400640 1 --2- 172.21.15.99:0/194654933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711815c0 0x5633711a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc023e00640 1 -- 172.21.15.99:0/194654933 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5633711819a0 msgr2=0x56337119f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc023e00640 1 --2- 172.21.15.99:0/194654933 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5633711819a0 0x56337119f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc023e00640 1 -- 172.21.15.99:0/194654933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711815c0 msgr2=0x5633711a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc023e00640 1 --2- 172.21.15.99:0/194654933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711815c0 0x5633711a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.981+0000 7fc023e00640 1 -- 172.21.15.99:0/194654933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633711af030 con 0x563371197a10 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.982+0000 7fc023e00640 1 --2- 172.21.15.99:0/194654933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563371197a10 0x5633711580c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009f10 tx=0x7fc01c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4c633e98deb06a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.982+0000 7fc013400640 1 -- 172.21.15.99:0/194654933 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c044020 con 0x563371197a10 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.982+0000 7fc013400640 1 -- 172.21.15.99:0/194654933 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01c02cac0 con 0x563371197a10 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.982+0000 7fc013400640 1 -- 172.21.15.99:0/194654933 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c009510 con 0x563371197a10 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.983+0000 7fc02d1fd740 1 -- 172.21.15.99:0/194654933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563371197a10 msgr2=0x5633711580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.983+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/194654933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563371197a10 0x5633711580c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009f10 tx=0x7fc01c004ab0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.983+0000 7fc02d1fd740 1 -- 172.21.15.99:0/194654933 shutdown_connections 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.983+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/194654933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563371197a10 0x5633711580c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.983+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/194654933 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5633711819a0 0x56337119f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.983+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/194654933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633711815c0 0x5633711a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.983+0000 7fc02d1fd740 1 -- 172.21.15.99:0/194654933 >> 172.21.15.99:0/194654933 conn(0x563371154aa0 msgr2=0x563371198780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:56.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.983+0000 7fc02d1fd740 1 -- 172.21.15.99:0/194654933 shutdown_connections 2024-03-30T13:13:56.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.983+0000 7fc02d1fd740 1 -- 172.21.15.99:0/194654933 wait complete. 2024-03-30T13:13:56.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.983+0000 7fc02d1fd740 1 -- start start 2024-03-30T13:13:56.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.984+0000 7fc02d1fd740 1 Processor -- start 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337121eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5633711819a0 0x56337117fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc02d1fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563371197a10 0x563371180270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5633711b9c80 con 0x5633711815c0 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc0240ce010 con 0x563371197a10 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc02d1fd740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x563370de01a0 con 0x5633711819a0 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc02d1fd740 10 client.0 _ll_register_callbacks cb 0x7fc014059580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc023400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337121eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc023400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337121eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54772/0 (socket says 172.21.15.99:54772) 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc023400640 1 -- 172.21.15.99:0/3983811874 learned_addr learned my addr 172.21.15.99:0/3983811874 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc023e00640 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563371197a10 0x563371180270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc01be00640 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5633711819a0 0x56337117fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc023400640 1 -- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5633711819a0 msgr2=0x56337117fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc023400640 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5633711819a0 0x56337117fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc023400640 1 -- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563371197a10 msgr2=0x563371180270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc023400640 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563371197a10 0x563371180270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc023400640 1 -- 172.21.15.99:0/3983811874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56337121f430 con 0x5633711815c0 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.985+0000 7fc023e00640 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563371197a10 0x563371180270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc023400640 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337121eef0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc01400cfd0 tx=0x7fc014011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef739e0de150a1cd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc010c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc010c00640 1 -- 172.21.15.99:0/3983811874 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01401e040 con 0x5633711815c0 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc010c00640 1 -- 172.21.15.99:0/3983811874 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc014055190 con 0x5633711815c0 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc02d1fd740 1 -- 172.21.15.99:0/3983811874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc01c02cac0 con 0x5633711815c0 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc010c00640 1 -- 172.21.15.99:0/3983811874 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc0140620b0 con 0x5633711815c0 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc02d1fd740 10 client.5883 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc02d1fd740 1 -- 172.21.15.99:0/3983811874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x56337119f4d0 con 0x5633711815c0 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc010c00640 1 -- 172.21.15.99:0/3983811874 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01c02cac0 con 0x5633711815c0 2024-03-30T13:13:56.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc010c00640 1 -- 172.21.15.99:0/3983811874 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc014055390 con 0x5633711815c0 2024-03-30T13:13:56.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc02d1fd740 10 client.5883 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:56.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc02d1fd740 10 client.5883 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:56.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc02d1fd740 20 client.5883 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:56.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56337119b490 0x56337119b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:56.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc02d1fd740 4 client.5883 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:13:56.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.986+0000 7fc02d1fd740 1 -- 172.21.15.99:0/3983811874 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5633710c6f60 con 0x56337119b490 2024-03-30T13:13:56.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.987+0000 7fc01be00640 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56337119b490 0x56337119b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:56.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.988+0000 7fc01be00640 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56337119b490 0x56337119b8a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f631c712a3835e server_cookie=3133453d7541320b in_seq=0 out_seq=0 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.988+0000 7fc010c00640 10 client.5883 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.988+0000 7fc010c00640 1 -- 172.21.15.99:0/3983811874 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+662 (crc 0 0 0) 0x5633710c6f60 con 0x56337119b490 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc010c00640 10 client.5883 handle_command_reply: tid=0 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 1 client.5883 shutdown 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 1 -- 172.21.15.99:0/3983811874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 msgr2=0x56337121eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337121eef0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc01400cfd0 tx=0x7fc014011000 comp rx=0 tx=0).stop 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 1 -- 172.21.15.99:0/3983811874 shutdown_connections 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56337119b490 0x56337119b8a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563371197a10 0x563371180270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5633711819a0 0x56337117fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 1 --2- 172.21.15.99:0/3983811874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633711815c0 0x56337121eef0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc010c00640 0 client.5883 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 1 -- 172.21.15.99:0/3983811874 >> 172.21.15.99:0/3983811874 conn(0x563371154aa0 msgr2=0x56337119f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:56.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 1 -- 172.21.15.99:0/3983811874 shutdown_connections 2024-03-30T13:13:56.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 1 -- 172.21.15.99:0/3983811874 wait complete. 2024-03-30T13:13:56.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.989+0000 7fc02d1fd740 20 client.5883 trim_cache size 0 max 16384 2024-03-30T13:13:56.996 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:56.996 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-03-30T13:13:56.996 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {}, 2024-03-30T13:13:56.996 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_stats": { 2024-03-30T13:13:56.996 INFO:teuthology.orchestra.run.smithi099.stdout: "35967ff8-91c1-445d-ae49-584e4340fa36": { 2024-03-30T13:13:56.996 INFO:teuthology.orchestra.run.smithi099.stdout: "start_time": "2024-03-30T13:13:26.413469+0000", 2024-03-30T13:13:56.996 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-30T13:13:56.996 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_started": 74, 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_passed": 74, 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_failed": 0, 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_skipped": 0 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: "bb44bba3-62df-4f2b-ba9b-e831e668d773": { 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: "start_time": "2024-03-30T13:12:40.259378+0000", 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_started": 75, 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_passed": 75, 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_failed": 0, 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: "uninline_skipped": 0 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:56.997 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 -- 172.21.15.99:0/243979886 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc00006c530 msgr2=0x7fc00006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc00006c530 0x7fc00006e9f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0240ccb00 tx=0x7fc00c008040 comp rx=0 tx=0).stop 2024-03-30T13:13:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 -- 172.21.15.99:0/243979886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0240d0410 msgr2=0x7fc0240cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0240d0410 0x7fc0240cf470 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc01400c820 tx=0x7fc01400cce0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 -- 172.21.15.99:0/243979886 shutdown_connections 2024-03-30T13:13:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc00006c530 0x7fc00006e9f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc02415cb30 0x7fc0240b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc02415a1e0 0x7fc0241f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 --2- 172.21.15.99:0/243979886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0240d0410 0x7fc0240cf470 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 -- 172.21.15.99:0/243979886 >> 172.21.15.99:0/243979886 conn(0x7fc02406b6f0 msgr2=0x7fc02415dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 -- 172.21.15.99:0/243979886 shutdown_connections 2024-03-30T13:13:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:56.990+0000 7fc02a600640 1 -- 172.21.15.99:0/243979886 wait complete. 2024-03-30T13:13:57.010 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-30T13:13:57.010 DEBUG:tasks.cephfs.test_uninlining:joining snapshotter thread 2024-03-30T13:13:57.010 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_0 2024-03-30T13:13:57.077 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_1 2024-03-30T13:13:57.137 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_2 2024-03-30T13:13:57.190 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_3 2024-03-30T13:13:57.241 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_4 2024-03-30T13:13:57.293 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_5 2024-03-30T13:13:57.339 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_6 2024-03-30T13:13:57.438 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_7 2024-03-30T13:13:57.489 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_8 2024-03-30T13:13:57.542 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_9 2024-03-30T13:13:57.598 DEBUG:tasks.cephfs.test_uninlining:extracting inodes 2024-03-30T13:13:57.599 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:13:57.599 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Kconfig 2024-03-30T13:13:57.657 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628358 linux-5.4/fs/ceph/Kconfig 2024-03-30T13:13:57.657 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Makefile 2024-03-30T13:13:57.657 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Makefile 2024-03-30T13:13:57.711 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628359 linux-5.4/fs/ceph/Makefile 2024-03-30T13:13:57.712 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:13:57.712 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:13:57.762 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628365 linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:13:57.762 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/io.h 2024-03-30T13:13:57.763 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/io.h 2024-03-30T13:13:57.814 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628372 linux-5.4/fs/ceph/io.h 2024-03-30T13:13:57.815 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:13:57.815 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:13:57.869 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628374 linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:13:57.869 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:13:57.869 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Kconfig 2024-03-30T13:13:57.920 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628386 linux-5.4/fs/ext2/Kconfig 2024-03-30T13:13:57.921 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:13:57.921 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:13:57.975 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628404 linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:13:57.976 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:13:57.976 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:13:58.029 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628402 linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:13:58.030 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Makefile 2024-03-30T13:13:58.030 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Makefile 2024-03-30T13:13:58.084 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628387 linux-5.4/fs/ext2/Makefile 2024-03-30T13:13:58.143 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:13:58.143 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/symlink.c 2024-03-30T13:13:58.199 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628399 linux-5.4/fs/ext2/symlink.c 2024-03-30T13:13:58.200 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/acl.h 2024-03-30T13:13:58.200 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/acl.h 2024-03-30T13:13:58.251 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628389 linux-5.4/fs/ext2/acl.h 2024-03-30T13:13:58.252 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:13:58.252 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:13:58.303 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628403 linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:13:58.304 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:13:58.304 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr.h 2024-03-30T13:13:58.358 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628401 linux-5.4/fs/ext2/xattr.h 2024-03-30T13:13:58.358 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:13:58.358 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:13:58.412 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628406 linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:13:58.413 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:13:58.413 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:13:58.462 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628419 linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:13:58.463 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:13:58.463 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:13:58.513 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628426 linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:13:58.513 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:13:58.513 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:13:58.562 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628409 linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:13:58.563 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:13:58.563 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:13:58.610 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628417 linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:13:58.610 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:13:58.610 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:13:58.657 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628421 linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:13:58.658 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:13:58.658 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:13:58.704 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628422 linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:13:58.705 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:13:58.705 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Makefile 2024-03-30T13:13:58.802 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628407 linux-5.4/fs/orangefs/Makefile 2024-03-30T13:13:58.802 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:13:58.802 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:13:58.852 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628430 linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:13:58.852 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:13:58.852 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:13:58.899 INFO:teuthology.orchestra.run.smithi099.stdout:1099511628412 linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:13:58.899 DEBUG:tasks.cephfs.test_uninlining:getting inline data info 2024-03-30T13:13:58.899 DEBUG:tasks.cephfs.test_uninlining:getting inode info #1 of 23:1099511628358 2024-03-30T13:13:58.899 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628358 2024-03-30T13:13:58.899 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628358 2024-03-30T13:13:59.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.156+0000 7f3e13200640 1 Processor -- start 2024-03-30T13:13:59.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.156+0000 7f3e13200640 1 -- start start 2024-03-30T13:13:59.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.157+0000 7f3e13200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3e14161ca0 0x7f3e140b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e13200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3e1409b140 0x7f3e140d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e13200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e140d0460 con 0x7f3e140b32b0 2024-03-30T13:13:59.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e13200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f3e140d0a70 con 0x7f3e1409b140 2024-03-30T13:13:59.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e13200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3e14162080 con 0x7f3e14161ca0 2024-03-30T13:13:59.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e12800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3e1409b140 0x7f3e140d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e09400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3e140b32b0 0x7f3e1409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33368/0 (socket says 172.21.15.99:33368) 2024-03-30T13:13:59.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e09400640 1 -- 172.21.15.99:0/489927269 learned_addr learned my addr 172.21.15.99:0/489927269 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:59.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e11e00640 1 --2- 172.21.15.99:0/489927269 >> v2:172.21.15.181:3300/0 conn(0x7f3e14161ca0 0x7f3e140b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e12800640 1 -- 172.21.15.99:0/489927269 >> v2:172.21.15.181:3300/0 conn(0x7f3e14161ca0 msgr2=0x7f3e140b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e12800640 1 --2- 172.21.15.99:0/489927269 >> v2:172.21.15.181:3300/0 conn(0x7f3e14161ca0 0x7f3e140b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e12800640 1 -- 172.21.15.99:0/489927269 >> v1:172.21.15.99:6789/0 conn(0x7f3e140b32b0 legacy=0x7f3e1409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.158+0000 7f3e12800640 1 -- 172.21.15.99:0/489927269 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1406d960 con 0x7f3e1409b140 2024-03-30T13:13:59.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.159+0000 7f3e12800640 1 --2- 172.21.15.99:0/489927269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1409b140 0x7f3e140d0f00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3e140b4ee0 tx=0x7f3e0c02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813e0fda9e0fb4c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.160+0000 7f3e11400640 1 -- 172.21.15.99:0/489927269 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c039070 con 0x7f3e1409b140 2024-03-30T13:13:59.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.160+0000 7f3e11400640 1 -- 172.21.15.99:0/489927269 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0c02cc70 con 0x7f3e1409b140 2024-03-30T13:13:59.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.160+0000 7f3e11400640 1 -- 172.21.15.99:0/489927269 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c034660 con 0x7f3e1409b140 2024-03-30T13:13:59.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.160+0000 7f3e13200640 1 -- 172.21.15.99:0/489927269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1409b140 msgr2=0x7f3e140d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.160+0000 7f3e13200640 1 --2- 172.21.15.99:0/489927269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1409b140 0x7f3e140d0f00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3e140b4ee0 tx=0x7f3e0c02bec0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.160+0000 7f3e13200640 1 -- 172.21.15.99:0/489927269 shutdown_connections 2024-03-30T13:13:59.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.160+0000 7f3e13200640 1 --2- 172.21.15.99:0/489927269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1409b140 0x7f3e140d0f00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.160+0000 7f3e13200640 1 --2- 172.21.15.99:0/489927269 >> v2:172.21.15.181:3300/0 conn(0x7f3e14161ca0 0x7f3e140b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.161+0000 7f3e13200640 1 -- 172.21.15.99:0/489927269 >> 172.21.15.99:0/489927269 conn(0x7f3e140b3de0 msgr2=0x7f3e140b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.161+0000 7f3e13200640 1 -- 172.21.15.99:0/489927269 shutdown_connections 2024-03-30T13:13:59.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.161+0000 7f3e13200640 1 -- 172.21.15.99:0/489927269 wait complete. 2024-03-30T13:13:59.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.162+0000 7f3e13200640 1 Processor -- start 2024-03-30T13:13:59.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.162+0000 7f3e13200640 1 -- start start 2024-03-30T13:13:59.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.163+0000 7f3e13200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1409b140 0x7f3e141487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.163+0000 7f3e13200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e140b32b0 0x7f3e14153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.163+0000 7f3e13200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e14161ca0 0x7f3e140b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.163+0000 7f3e13200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3e140d0700 con 0x7f3e140b32b0 2024-03-30T13:13:59.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.163+0000 7f3e13200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1406d680 con 0x7f3e1409b140 2024-03-30T13:13:59.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.163+0000 7f3e13200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1406cfe0 con 0x7f3e14161ca0 2024-03-30T13:13:59.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.164+0000 7f3e09400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e140b32b0 0x7f3e14153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.164+0000 7f3e09400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e140b32b0 0x7f3e14153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54790/0 (socket says 172.21.15.99:54790) 2024-03-30T13:13:59.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.164+0000 7f3e09400640 1 -- 172.21.15.99:0/3030627240 learned_addr learned my addr 172.21.15.99:0/3030627240 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.164+0000 7f3e11e00640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1409b140 0x7f3e141487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.164+0000 7f3e12800640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e14161ca0 0x7f3e140b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.164+0000 7f3e09400640 1 -- 172.21.15.99:0/3030627240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e14161ca0 msgr2=0x7f3e140b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.164+0000 7f3e09400640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e14161ca0 0x7f3e140b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.164+0000 7f3e09400640 1 -- 172.21.15.99:0/3030627240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1409b140 msgr2=0x7f3e141487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.164+0000 7f3e09400640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1409b140 0x7f3e141487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.164+0000 7f3e09400640 1 -- 172.21.15.99:0/3030627240 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e14156320 con 0x7f3e140b32b0 2024-03-30T13:13:59.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.164+0000 7f3e09400640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e140b32b0 0x7f3e14153620 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c470 tx=0x7f3dfc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.165+0000 7f3e0aa00640 1 -- 172.21.15.99:0/3030627240 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc017070 con 0x7f3e140b32b0 2024-03-30T13:13:59.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.165+0000 7f3e0aa00640 1 -- 172.21.15.99:0/3030627240 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc005ce0 con 0x7f3e140b32b0 2024-03-30T13:13:59.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.165+0000 7f3e0aa00640 1 -- 172.21.15.99:0/3030627240 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0072f0 con 0x7f3e140b32b0 2024-03-30T13:13:59.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.165+0000 7f3e13200640 1 -- 172.21.15.99:0/3030627240 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e14156600 con 0x7f3e140b32b0 2024-03-30T13:13:59.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.165+0000 7f3e13200640 1 -- 172.21.15.99:0/3030627240 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e140b5cf0 con 0x7f3e140b32b0 2024-03-30T13:13:59.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.167+0000 7f3e0aa00640 1 -- 172.21.15.99:0/3030627240 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3dfc01a070 con 0x7f3e140b32b0 2024-03-30T13:13:59.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.168+0000 7f3e0aa00640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df006c530 0x7f3df006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.168+0000 7f3e0aa00640 1 -- 172.21.15.99:0/3030627240 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f3dfc08abe0 con 0x7f3e140b32b0 2024-03-30T13:13:59.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.168+0000 7f3e11e00640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df006c530 0x7f3df006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.169+0000 7f3e1b85d740 1 Processor -- start 2024-03-30T13:13:59.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.169+0000 7f3e11e00640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df006c530 0x7f3df006e9f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3e04006fd0 tx=0x7f3e04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.169+0000 7f3e1b85d740 1 -- start start 2024-03-30T13:13:59.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.170+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x55575879bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.170+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55575879c4e0 0x5557587744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.170+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775850 0x5557587749f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.170+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5557586d8330 con 0x55575879c4e0 2024-03-30T13:13:59.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.170+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555758680620 con 0x555758775470 2024-03-30T13:13:59.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.170+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5557586d4440 con 0x555758775850 2024-03-30T13:13:59.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.170+0000 7f3e09400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55575879c4e0 0x5557587744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e09400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55575879c4e0 0x5557587744b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54794/0 (socket says 172.21.15.99:54794) 2024-03-30T13:13:59.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e09400640 1 -- 172.21.15.99:0/2999018749 learned_addr learned my addr 172.21.15.99:0/2999018749 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e11e00640 1 --2- 172.21.15.99:0/2999018749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x55575879bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e12800640 1 --2- 172.21.15.99:0/2999018749 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775850 0x5557587749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e09400640 1 -- 172.21.15.99:0/2999018749 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775850 msgr2=0x5557587749f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e09400640 1 --2- 172.21.15.99:0/2999018749 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775850 0x5557587749f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e09400640 1 -- 172.21.15.99:0/2999018749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 msgr2=0x55575879bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e09400640 1 --2- 172.21.15.99:0/2999018749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x55575879bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e09400640 1 -- 172.21.15.99:0/2999018749 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557584b8920 con 0x55575879c4e0 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e12800640 1 --2- 172.21.15.99:0/2999018749 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775850 0x5557587749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e11e00640 1 --2- 172.21.15.99:0/2999018749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x55575879bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e09400640 1 --2- 172.21.15.99:0/2999018749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55575879c4e0 0x5557587744b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00cfd0 tx=0x7f3dfc0588e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb71dac011efd6b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e02600640 1 -- 172.21.15.99:0/2999018749 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0615c0 con 0x55575879c4e0 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e02600640 1 -- 172.21.15.99:0/2999018749 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc056ce0 con 0x55575879c4e0 2024-03-30T13:13:59.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.171+0000 7f3e02600640 1 -- 172.21.15.99:0/2999018749 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc05f0f0 con 0x55575879c4e0 2024-03-30T13:13:59.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.172+0000 7f3e1b85d740 1 -- 172.21.15.99:0/2999018749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55575879c4e0 msgr2=0x5557587744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.172+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/2999018749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55575879c4e0 0x5557587744b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00cfd0 tx=0x7f3dfc0588e0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.172+0000 7f3e1b85d740 1 -- 172.21.15.99:0/2999018749 shutdown_connections 2024-03-30T13:13:59.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.172+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/2999018749 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775850 0x5557587749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.172+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/2999018749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55575879c4e0 0x5557587744b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.172+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/2999018749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x55575879bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.172+0000 7f3e1b85d740 1 -- 172.21.15.99:0/2999018749 >> 172.21.15.99:0/2999018749 conn(0x55575873bbe0 msgr2=0x5557587ba190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.172+0000 7f3e1b85d740 1 -- 172.21.15.99:0/2999018749 shutdown_connections 2024-03-30T13:13:59.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.172+0000 7f3e1b85d740 1 -- 172.21.15.99:0/2999018749 wait complete. 2024-03-30T13:13:59.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.173+0000 7f3e1b85d740 1 -- start start 2024-03-30T13:13:59.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.173+0000 7f3e1b85d740 1 Processor -- start 2024-03-30T13:13:59.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.174+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x5557587937f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.174+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x5557587a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.174+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5557587a21d0 0x5557587b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.174+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55575879bb10 con 0x555758775850 2024-03-30T13:13:59.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.174+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5557586939d0 con 0x555758775470 2024-03-30T13:13:59.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.174+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555758794890 con 0x5557587a21d0 2024-03-30T13:13:59.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.174+0000 7f3e1b85d740 10 client.0 _ll_register_callbacks cb 0x5557586cffd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:59.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.174+0000 7f3e09400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x5557587a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.174+0000 7f3e09400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x5557587a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54804/0 (socket says 172.21.15.99:54804) 2024-03-30T13:13:59.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.174+0000 7f3e09400640 1 -- 172.21.15.99:0/3807511384 learned_addr learned my addr 172.21.15.99:0/3807511384 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3e09400640 1 -- 172.21.15.99:0/3807511384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5557587a21d0 msgr2=0x5557587b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3e09400640 1 --2- 172.21.15.99:0/3807511384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5557587a21d0 0x5557587b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3e09400640 1 -- 172.21.15.99:0/3807511384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 msgr2=0x5557587937f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3e09400640 1 --2- 172.21.15.99:0/3807511384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x5557587937f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3e09400640 1 -- 172.21.15.99:0/3807511384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557583ac210 con 0x555758775850 2024-03-30T13:13:59.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3e09400640 1 --2- 172.21.15.99:0/3807511384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x5557587a1c90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc088f90 tx=0x7f3dfc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb66179409acfbb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3df6a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:59.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3df6a00640 1 -- 172.21.15.99:0/3807511384 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc087070 con 0x555758775850 2024-03-30T13:13:59.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3df6a00640 1 -- 172.21.15.99:0/3807511384 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f3dfc007690 con 0x555758775850 2024-03-30T13:13:59.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3807511384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dfc056ce0 con 0x555758775850 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3df6a00640 1 -- 172.21.15.99:0/3807511384 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3dfc057e30 con 0x555758775850 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3e1b85d740 10 client.5898 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.175+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3807511384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5557585190b0 con 0x555758775850 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.176+0000 7f3df6a00640 1 -- 172.21.15.99:0/3807511384 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc056ce0 con 0x555758775850 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.176+0000 7f3df6a00640 1 -- 172.21.15.99:0/3807511384 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f3dfc057fd0 con 0x555758775850 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.176+0000 7f3e1b85d740 10 client.5898 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.176+0000 7f3e1b85d740 10 client.5898 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.176+0000 7f3e1b85d740 20 client.5898 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.176+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/3807511384 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5557587d5790 0x5557587d7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.176+0000 7f3e1b85d740 4 client.5898 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.176+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3807511384 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557586e5870 con 0x5557587d5790 2024-03-30T13:13:59.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.177+0000 7f3e11e00640 1 --2- 172.21.15.99:0/3807511384 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5557587d5790 0x5557587d7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.178+0000 7f3e11e00640 1 --2- 172.21.15.99:0/3807511384 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5557587d5790 0x5557587d7b80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25e8e654a3307c1c server_cookie=d7b5b02953ad9640 in_seq=0 out_seq=0 2024-03-30T13:13:59.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.178+0000 7f3df6a00640 10 client.5898 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.179+0000 7f3df6a00640 1 -- 172.21.15.99:0/3807511384 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5557586e5870 con 0x5557587d5790 2024-03-30T13:13:59.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.179+0000 7f3df6a00640 10 client.5898 handle_command_reply: tid=0 2024-03-30T13:13:59.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 1 client.5898 shutdown 2024-03-30T13:13:59.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3807511384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 msgr2=0x5557587a1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/3807511384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x5557587a1c90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc088f90 tx=0x7f3dfc000bc0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3807511384 shutdown_connections 2024-03-30T13:13:59.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/3807511384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5557587a21d0 0x5557587b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/3807511384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x5557587a1c90 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/3807511384 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5557587d5790 0x5557587d7b80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/3807511384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x5557587937f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3df6a00640 0 client.5898 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3807511384 >> 172.21.15.99:0/3807511384 conn(0x55575873bbe0 msgr2=0x55575876eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3807511384 shutdown_connections 2024-03-30T13:13:59.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3807511384 wait complete. 2024-03-30T13:13:59.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.180+0000 7f3e1b85d740 20 client.5898 trim_cache size 0 max 16384 2024-03-30T13:13:59.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.196+0000 7f3e1b85d740 1 Processor -- start 2024-03-30T13:13:59.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.196+0000 7f3e1b85d740 1 -- start start 2024-03-30T13:13:59.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.197+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x5557587c9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.197+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775850 0x55575879f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.197+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557587a21d0 0x55575879fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.197+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14200de0 con 0x5557587a21d0 2024-03-30T13:13:59.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.197+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e141ffe70 con 0x555758775470 2024-03-30T13:13:59.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.197+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3e140caa40 con 0x555758775850 2024-03-30T13:13:59.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.197+0000 7f3e12800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557587a21d0 0x55575879fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.197+0000 7f3e12800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557587a21d0 0x55575879fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54814/0 (socket says 172.21.15.99:54814) 2024-03-30T13:13:59.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.197+0000 7f3e12800640 1 -- 172.21.15.99:0/3821102763 learned_addr learned my addr 172.21.15.99:0/3821102763 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.197+0000 7f3e11e00640 1 --2- 172.21.15.99:0/3821102763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x5557587c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.197+0000 7f3e09400640 1 --2- 172.21.15.99:0/3821102763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775850 0x55575879f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.198+0000 7f3e12800640 1 -- 172.21.15.99:0/3821102763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775850 msgr2=0x55575879f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.198+0000 7f3e12800640 1 --2- 172.21.15.99:0/3821102763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775850 0x55575879f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.198+0000 7f3e12800640 1 -- 172.21.15.99:0/3821102763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 msgr2=0x5557587c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.198+0000 7f3e12800640 1 --2- 172.21.15.99:0/3821102763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x5557587c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.198+0000 7f3e12800640 1 -- 172.21.15.99:0/3821102763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557583852d0 con 0x5557587a21d0 2024-03-30T13:13:59.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.198+0000 7f3e12800640 1 --2- 172.21.15.99:0/3821102763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557587a21d0 0x55575879fbe0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c02c4d0 tx=0x7f3e0c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157ff0b82f2a568a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.198+0000 7f3e01c00640 1 -- 172.21.15.99:0/3821102763 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c045070 con 0x5557587a21d0 2024-03-30T13:13:59.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.198+0000 7f3e01c00640 1 -- 172.21.15.99:0/3821102763 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0c03f450 con 0x5557587a21d0 2024-03-30T13:13:59.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.198+0000 7f3e01c00640 1 -- 172.21.15.99:0/3821102763 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c039040 con 0x5557587a21d0 2024-03-30T13:13:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.199+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3821102763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557587a21d0 msgr2=0x55575879fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.199+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/3821102763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557587a21d0 0x55575879fbe0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c02c4d0 tx=0x7f3e0c02e070 comp rx=0 tx=0).stop 2024-03-30T13:13:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.199+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3821102763 shutdown_connections 2024-03-30T13:13:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.199+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/3821102763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557587a21d0 0x55575879fbe0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.199+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/3821102763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775850 0x55575879f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.199+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/3821102763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555758775470 0x5557587c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.199+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3821102763 >> 172.21.15.99:0/3821102763 conn(0x55575873bbe0 msgr2=0x555758793e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.199+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3821102763 shutdown_connections 2024-03-30T13:13:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.199+0000 7f3e1b85d740 1 -- 172.21.15.99:0/3821102763 wait complete. 2024-03-30T13:13:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.200+0000 7f3e1b85d740 1 -- start start 2024-03-30T13:13:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.200+0000 7f3e1b85d740 1 Processor -- start 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775470 0x5557587bdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x55575876e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e1b85d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557587a21d0 0x5557587dbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555758769fd0 con 0x555758775850 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e140cb090 con 0x5557587a21d0 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e1b85d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5557587b78b0 con 0x555758775470 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e1b85d740 10 client.0 _ll_register_callbacks cb 0x7f3dfc0583d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e09400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x55575876e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e09400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x55575876e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54822/0 (socket says 172.21.15.99:54822) 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e09400640 1 -- 172.21.15.99:0/92055883 learned_addr learned my addr 172.21.15.99:0/92055883 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e09400640 1 -- 172.21.15.99:0/92055883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775470 msgr2=0x5557587bdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.201+0000 7f3e09400640 1 --2- 172.21.15.99:0/92055883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775470 0x5557587bdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3e09400640 1 -- 172.21.15.99:0/92055883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557587a21d0 msgr2=0x5557587dbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3e09400640 1 --2- 172.21.15.99:0/92055883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557587a21d0 0x5557587dbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3e09400640 1 -- 172.21.15.99:0/92055883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557587be210 con 0x555758775850 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3e09400640 1 --2- 172.21.15.99:0/92055883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x55575876e7f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c440 tx=0x7f3dfc054c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20320b2b6a2edfc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3df6a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3df6a00640 1 -- 172.21.15.99:0/92055883 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc087050 con 0x555758775850 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3e1b85d740 1 -- 172.21.15.99:0/92055883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e0c03f450 con 0x555758775850 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3df6a00640 1 -- 172.21.15.99:0/92055883 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f3dfc01db70 con 0x555758775850 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3df6a00640 1 -- 172.21.15.99:0/92055883 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3dfc01dd90 con 0x555758775850 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3e1b85d740 10 client.5904 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3e1b85d740 1 -- 172.21.15.99:0/92055883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5557587be210 con 0x555758775850 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.202+0000 7f3df6a00640 1 -- 172.21.15.99:0/92055883 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0c03f450 con 0x555758775850 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.203+0000 7f3df6a00640 1 -- 172.21.15.99:0/92055883 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f3dfc054730 con 0x555758775850 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.203+0000 7f3e1b85d740 10 client.5904 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.203+0000 7f3e1b85d740 10 client.5904 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.203+0000 7f3e1b85d740 20 client.5904 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.203+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/92055883 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5557587b4ab0 0x5557588382c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.203+0000 7f3e1b85d740 4 client.5904 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628358}] 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.203+0000 7f3e1b85d740 1 -- 172.21.15.99:0/92055883 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628358}) -- 0x5557586dfbc0 con 0x5557587b4ab0 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.203+0000 7f3e11e00640 1 --2- 172.21.15.99:0/92055883 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5557587b4ab0 0x5557588382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.204+0000 7f3e11e00640 1 --2- 172.21.15.99:0/92055883 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5557587b4ab0 0x5557588382c0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0f0435f17efd925 server_cookie=2f9ce2990b4e7f5d in_seq=0 out_seq=0 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.204+0000 7f3df6a00640 10 client.5904 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.205+0000 7f3df6a00640 1 -- 172.21.15.99:0/92055883 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4780 (crc 0 0 0) 0x5557586dfbc0 con 0x5557587b4ab0 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.205+0000 7f3df6a00640 10 client.5904 handle_command_reply: tid=0 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.205+0000 7f3e1b85d740 1 client.5904 shutdown 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3e1b85d740 1 -- 172.21.15.99:0/92055883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 msgr2=0x55575876e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/92055883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x55575876e7f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c440 tx=0x7f3dfc054c80 comp rx=0 tx=0).stop 2024-03-30T13:13:59.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3e1b85d740 1 -- 172.21.15.99:0/92055883 shutdown_connections 2024-03-30T13:13:59.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/92055883 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5557587b4ab0 0x5557588382c0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/92055883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557587a21d0 0x5557587dbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/92055883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555758775850 0x55575876e7f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3df6a00640 0 client.5904 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3e1b85d740 1 --2- 172.21.15.99:0/92055883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555758775470 0x5557587bdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3e1b85d740 1 -- 172.21.15.99:0/92055883 >> 172.21.15.99:0/92055883 conn(0x55575873bbe0 msgr2=0x5557587b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3e1b85d740 1 -- 172.21.15.99:0/92055883 shutdown_connections 2024-03-30T13:13:59.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3e1b85d740 1 -- 172.21.15.99:0/92055883 wait complete. 2024-03-30T13:13:59.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.206+0000 7f3e1b85d740 20 client.5904 trim_cache size 0 max 16384 2024-03-30T13:13:59.215 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ceph/Kconfig", 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628358, 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.441812+0000", 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.508878+0000", 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:59.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1481, 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:59.217 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.508878+0000", 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:13:59.218 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1481, 2024-03-30T13:13:59.219 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.441812+0000" 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1481, 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.441812+0000" 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 215, 2024-03-30T13:13:59.220 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 2, 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:59.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:59.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:59.223 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyrstat": 0, 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.224 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.225 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:59.226 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:59.226 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:13:59.226 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.226 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:13:59.226 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:13:59.226 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.226 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.226 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.226 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.226 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:59.227 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:59.228 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:59.229 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.229 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.229 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.229 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.229 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.229 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:59.229 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:59.229 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:59.229 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:59.229 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:59.230 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.230 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:59.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:59.231 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:59.231 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:13:59.231 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:13:59.231 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:13:59.231 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:59.231 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:59.232 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.232 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:59.232 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:13:59.232 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:59.232 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:59.232 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:59.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 -- 172.21.15.99:0/3030627240 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df006c530 msgr2=0x7f3df006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df006c530 0x7f3df006e9f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3e04006fd0 tx=0x7f3e04008040 comp rx=0 tx=0).stop 2024-03-30T13:13:59.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 -- 172.21.15.99:0/3030627240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e140b32b0 msgr2=0x7f3e14153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e140b32b0 0x7f3e14153620 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c470 tx=0x7f3dfc001e70 comp rx=0 tx=0).stop 2024-03-30T13:13:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 -- 172.21.15.99:0/3030627240 shutdown_connections 2024-03-30T13:13:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f3df006c530 0x7f3df006e9f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e14161ca0 0x7f3e140b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e140b32b0 0x7f3e14153620 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 --2- 172.21.15.99:0/3030627240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1409b140 0x7f3e141487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 -- 172.21.15.99:0/3030627240 >> 172.21.15.99:0/3030627240 conn(0x7f3e140b3de0 msgr2=0x7f3e140ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 -- 172.21.15.99:0/3030627240 shutdown_connections 2024-03-30T13:13:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.207+0000 7f3e13200640 1 -- 172.21.15.99:0/3030627240 wait complete. 2024-03-30T13:13:59.234 DEBUG:tasks.cephfs.test_uninlining:getting inode info #2 of 23:1099511628359 2024-03-30T13:13:59.235 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628359 2024-03-30T13:13:59.235 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628359 2024-03-30T13:13:59.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.443+0000 7f4736600640 1 Processor -- start 2024-03-30T13:13:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.444+0000 7f4736600640 1 -- start start 2024-03-30T13:13:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.445+0000 7f4736600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f47301624b0 0x7f47300b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.445+0000 7f4736600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473006d1b0 con 0x7f47300cca60 2024-03-30T13:13:59.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.445+0000 7f4736600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473006d470 con 0x7f47300ccea0 2024-03-30T13:13:59.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.445+0000 7f4736600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f47300d0a10 con 0x7f47301624b0 2024-03-30T13:13:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.445+0000 7f472ea00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f47300cca60 0x7f47300d0ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33370/0 (socket says 172.21.15.99:33370) 2024-03-30T13:13:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.445+0000 7f472ea00640 1 -- 172.21.15.99:0/837217421 learned_addr learned my addr 172.21.15.99:0/837217421 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.446+0000 7f472f400640 1 --2- 172.21.15.99:0/837217421 >> v2:172.21.15.181:3300/0 conn(0x7f47301624b0 0x7f47300b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.446+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2412814757 0 0) 0x7f473006d1b0 con 0x7f47300cca60 2024-03-30T13:13:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.446+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4714003520 con 0x7f47300cca60 2024-03-30T13:13:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.446+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3594313709 0 0) 0x7f4714003520 con 0x7f47300cca60 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.446+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 >> v2:172.21.15.181:3300/0 conn(0x7f47301624b0 msgr2=0x7f47300b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.446+0000 7f472e000640 1 --2- 172.21.15.99:0/837217421 >> v2:172.21.15.181:3300/0 conn(0x7f47301624b0 0x7f47300b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.446+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 >> v1:172.21.15.181:6789/0 conn(0x7f47300ccea0 legacy=0x7f4730162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.446+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473006d750 con 0x7f47300cca60 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.446+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f4718001670 con 0x7f47300cca60 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.446+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 >> v1:172.21.15.99:6789/0 conn(0x7f47300cca60 legacy=0x7f47300d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472e000640 1 --2- 172.21.15.99:0/837217421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47140039b0 0x7f4714003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472e000640 1 --2- 172.21.15.99:0/837217421 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4714004800 0x7f4714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472e000640 1 --2- 172.21.15.99:0/837217421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47140051c0 0x7f471400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f47300d0a10 con 0x7f47140039b0 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f471400c060 con 0x7f47140051c0 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f471400c260 con 0x7f4714004800 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472f400640 1 --2- 172.21.15.99:0/837217421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47140039b0 0x7f4714003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472f400640 1 -- 172.21.15.99:0/837217421 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4714004800 msgr2=0x7f4714004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472f400640 1 --2- 172.21.15.99:0/837217421 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4714004800 0x7f4714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472f400640 1 -- 172.21.15.99:0/837217421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47140051c0 msgr2=0x7f471400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472f400640 1 --2- 172.21.15.99:0/837217421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47140051c0 0x7f471400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472f400640 1 -- 172.21.15.99:0/837217421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4714003520 con 0x7f47140039b0 2024-03-30T13:13:59.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.447+0000 7f472fe00640 1 -- 172.21.15.99:0/837217421 reap_dead start 2024-03-30T13:13:59.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.448+0000 7f472f400640 1 --2- 172.21.15.99:0/837217421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47140039b0 0x7f4714003dd0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4720009fc0 tx=0x7f4714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5edda1d2d657a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.448+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720039070 con 0x7f47140039b0 2024-03-30T13:13:59.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.449+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472002cc60 con 0x7f47140039b0 2024-03-30T13:13:59.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.449+0000 7f472e000640 1 -- 172.21.15.99:0/837217421 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720009c10 con 0x7f47140039b0 2024-03-30T13:13:59.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.449+0000 7f4736600640 1 -- 172.21.15.99:0/837217421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47140039b0 msgr2=0x7f4714003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.449+0000 7f4736600640 1 --2- 172.21.15.99:0/837217421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47140039b0 0x7f4714003dd0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4720009fc0 tx=0x7f4714005830 comp rx=0 tx=0).stop 2024-03-30T13:13:59.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.449+0000 7f4736600640 1 -- 172.21.15.99:0/837217421 shutdown_connections 2024-03-30T13:13:59.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.449+0000 7f4736600640 1 --2- 172.21.15.99:0/837217421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47140039b0 0x7f4714003dd0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.449+0000 7f4736600640 1 -- 172.21.15.99:0/837217421 >> 172.21.15.99:0/837217421 conn(0x7f47300b3f00 msgr2=0x7f47300b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.449+0000 7f4736600640 1 -- 172.21.15.99:0/837217421 shutdown_connections 2024-03-30T13:13:59.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.449+0000 7f4736600640 1 -- 172.21.15.99:0/837217421 wait complete. 2024-03-30T13:13:59.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.451+0000 7f4736600640 1 Processor -- start 2024-03-30T13:13:59.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.451+0000 7f4736600640 1 -- start start 2024-03-30T13:13:59.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.452+0000 7f4736600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47140039b0 0x7f4730151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.452+0000 7f4736600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47300c85b0 0x7f47301f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.452+0000 7f4736600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473015d4e0 0x7f473015d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.452+0000 7f4736600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f473015feb0 con 0x7f47300c85b0 2024-03-30T13:13:59.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.452+0000 7f4736600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f473015fd30 con 0x7f473015d4e0 2024-03-30T13:13:59.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.452+0000 7f4736600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f47300b33b0 con 0x7f47140039b0 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.452+0000 7f472ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47300c85b0 0x7f47301f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.452+0000 7f472ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47300c85b0 0x7f47301f76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54836/0 (socket says 172.21.15.99:54836) 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.452+0000 7f472ea00640 1 -- 172.21.15.99:0/2832811380 learned_addr learned my addr 172.21.15.99:0/2832811380 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f472f400640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47140039b0 0x7f4730151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f472fe00640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473015d4e0 0x7f473015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f472ea00640 1 -- 172.21.15.99:0/2832811380 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47140039b0 msgr2=0x7f4730151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f472ea00640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47140039b0 0x7f4730151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f472ea00640 1 -- 172.21.15.99:0/2832811380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473015d4e0 msgr2=0x7f473015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f472ea00640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473015d4e0 0x7f473015d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f472ea00640 1 -- 172.21.15.99:0/2832811380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47300c8b40 con 0x7f47300c85b0 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f472f400640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47140039b0 0x7f4730151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f472ea00640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47300c85b0 0x7f47301f76a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f47180011e0 tx=0x7f471800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f4727400640 1 -- 172.21.15.99:0/2832811380 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718018070 con 0x7f47300c85b0 2024-03-30T13:13:59.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f4727400640 1 -- 172.21.15.99:0/2832811380 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f471800ce50 con 0x7f47300c85b0 2024-03-30T13:13:59.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.453+0000 7f4727400640 1 -- 172.21.15.99:0/2832811380 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47180047e0 con 0x7f47300c85b0 2024-03-30T13:13:59.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.454+0000 7f4736600640 1 -- 172.21.15.99:0/2832811380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47300b74a0 con 0x7f47300c85b0 2024-03-30T13:13:59.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.454+0000 7f4736600640 1 -- 172.21.15.99:0/2832811380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473015de60 con 0x7f47300c85b0 2024-03-30T13:13:59.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.456+0000 7f4727400640 1 -- 172.21.15.99:0/2832811380 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f471801b070 con 0x7f47300c85b0 2024-03-30T13:13:59.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.457+0000 7f4727400640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f470c06c530 0x7f470c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.457+0000 7f4727400640 1 -- 172.21.15.99:0/2832811380 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f471808ad90 con 0x7f47300c85b0 2024-03-30T13:13:59.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.457+0000 7f472f400640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f470c06c530 0x7f470c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.458+0000 7f473940f740 1 Processor -- start 2024-03-30T13:13:59.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.458+0000 7f473940f740 1 -- start start 2024-03-30T13:13:59.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.458+0000 7f472f400640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f470c06c530 0x7f470c06e9f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4720036000 tx=0x7f472002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.459+0000 7f473940f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123290 0x555af5149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.459+0000 7f473940f740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af514a300 0x555af51222d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.459+0000 7f473940f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123670 0x555af5122810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.459+0000 7f473940f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555af5086330 con 0x555af5123290 2024-03-30T13:13:59.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.459+0000 7f473940f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555af502e620 con 0x555af5123670 2024-03-30T13:13:59.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.459+0000 7f473940f740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555af5082440 con 0x555af514a300 2024-03-30T13:13:59.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.459+0000 7f472f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123290 0x555af5149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.459+0000 7f472f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123290 0x555af5149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54844/0 (socket says 172.21.15.99:54844) 2024-03-30T13:13:59.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.459+0000 7f472f400640 1 -- 172.21.15.99:0/125634380 learned_addr learned my addr 172.21.15.99:0/125634380 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.459+0000 7f472ea00640 1 --2- 172.21.15.99:0/125634380 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af514a300 0x555af51222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.459+0000 7f472f400640 1 -- 172.21.15.99:0/125634380 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af514a300 msgr2=0x555af51222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.460+0000 7f472f400640 1 --2- 172.21.15.99:0/125634380 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af514a300 0x555af51222d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.460+0000 7f472f400640 1 -- 172.21.15.99:0/125634380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123670 msgr2=0x555af5122810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.460+0000 7f472f400640 1 --2- 172.21.15.99:0/125634380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123670 0x555af5122810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.460+0000 7f472f400640 1 -- 172.21.15.99:0/125634380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af4e66920 con 0x555af5123290 2024-03-30T13:13:59.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.460+0000 7f472f400640 1 --2- 172.21.15.99:0/125634380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123290 0x555af5149dc0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4720037040 tx=0x7f472002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814ee8c6c1ef2d0f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.460+0000 7f471fe00640 1 -- 172.21.15.99:0/125634380 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472004f070 con 0x555af5123290 2024-03-30T13:13:59.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.460+0000 7f471fe00640 1 -- 172.21.15.99:0/125634380 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472003fd10 con 0x555af5123290 2024-03-30T13:13:59.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.460+0000 7f471fe00640 1 -- 172.21.15.99:0/125634380 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720039040 con 0x555af5123290 2024-03-30T13:13:59.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.461+0000 7f473940f740 1 -- 172.21.15.99:0/125634380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123290 msgr2=0x555af5149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.461+0000 7f473940f740 1 --2- 172.21.15.99:0/125634380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123290 0x555af5149dc0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4720037040 tx=0x7f472002e070 comp rx=0 tx=0).stop 2024-03-30T13:13:59.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.461+0000 7f473940f740 1 -- 172.21.15.99:0/125634380 shutdown_connections 2024-03-30T13:13:59.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.461+0000 7f473940f740 1 --2- 172.21.15.99:0/125634380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123670 0x555af5122810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.461+0000 7f473940f740 1 --2- 172.21.15.99:0/125634380 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af514a300 0x555af51222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.461+0000 7f473940f740 1 --2- 172.21.15.99:0/125634380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123290 0x555af5149dc0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.461+0000 7f473940f740 1 -- 172.21.15.99:0/125634380 >> 172.21.15.99:0/125634380 conn(0x555af50e9be0 msgr2=0x555af5167fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.461+0000 7f473940f740 1 -- 172.21.15.99:0/125634380 shutdown_connections 2024-03-30T13:13:59.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.461+0000 7f473940f740 1 -- 172.21.15.99:0/125634380 wait complete. 2024-03-30T13:13:59.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.462+0000 7f473940f740 1 -- start start 2024-03-30T13:13:59.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.462+0000 7f473940f740 1 Processor -- start 2024-03-30T13:13:59.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.463+0000 7f473940f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123290 0x555af5177e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.463+0000 7f473940f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123670 0x555af516bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.463+0000 7f473940f740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5150600 0x555af51412a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.463+0000 7f473940f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555af5149930 con 0x555af5123670 2024-03-30T13:13:59.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.463+0000 7f473940f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555af50419d0 con 0x555af5123290 2024-03-30T13:13:59.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.463+0000 7f473940f740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555af51426b0 con 0x555af5150600 2024-03-30T13:13:59.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.463+0000 7f473940f740 10 client.0 _ll_register_callbacks cb 0x555af507dfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.463+0000 7f472ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123670 0x555af516bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.463+0000 7f472ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123670 0x555af516bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54850/0 (socket says 172.21.15.99:54850) 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.463+0000 7f472ea00640 1 -- 172.21.15.99:0/1635707272 learned_addr learned my addr 172.21.15.99:0/1635707272 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f472f400640 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123290 0x555af5177e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f472ea00640 1 -- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5150600 msgr2=0x555af51412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f472fe00640 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5150600 0x555af51412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f472ea00640 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5150600 0x555af51412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f472ea00640 1 -- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123290 msgr2=0x555af5177e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f472ea00640 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123290 0x555af5177e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f472ea00640 1 -- 172.21.15.99:0/1635707272 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af4d5a210 con 0x555af5123670 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f472f400640 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123290 0x555af5177e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f472ea00640 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123670 0x555af516bc80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4718058890 tx=0x7f4718058c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf3df7c49ddcc70 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f471cc00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f471cc00640 1 -- 172.21.15.99:0/1635707272 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47180581e0 con 0x555af5123670 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f471cc00640 1 -- 172.21.15.99:0/1635707272 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f471805f150 con 0x555af5123670 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f473940f740 1 -- 172.21.15.99:0/1635707272 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f472003fd10 con 0x555af5123670 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f471cc00640 1 -- 172.21.15.99:0/1635707272 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f471805f350 con 0x555af5123670 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f473940f740 10 client.5916 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.464+0000 7f473940f740 1 -- 172.21.15.99:0/1635707272 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x555af4ec70b0 con 0x555af5123670 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.465+0000 7f471cc00640 1 -- 172.21.15.99:0/1635707272 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472003fd10 con 0x555af5123670 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.465+0000 7f471cc00640 1 -- 172.21.15.99:0/1635707272 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f4718082b00 con 0x555af5123670 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.465+0000 7f473940f740 10 client.5916 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.465+0000 7f473940f740 10 client.5916 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.465+0000 7f473940f740 20 client.5916 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.465+0000 7f473940f740 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555af51509e0 0x555af5167380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.465+0000 7f473940f740 4 client.5916 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.465+0000 7f473940f740 1 -- 172.21.15.99:0/1635707272 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555af5093870 con 0x555af51509e0 2024-03-30T13:13:59.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.465+0000 7f472f400640 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555af51509e0 0x555af5167380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.467+0000 7f472f400640 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555af51509e0 0x555af5167380 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa65c73b56618407 server_cookie=e44b890e24fb845b in_seq=0 out_seq=0 2024-03-30T13:13:59.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.467+0000 7f471cc00640 10 client.5916 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.468+0000 7f471cc00640 1 -- 172.21.15.99:0/1635707272 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x555af5093870 con 0x555af51509e0 2024-03-30T13:13:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.468+0000 7f471cc00640 10 client.5916 handle_command_reply: tid=0 2024-03-30T13:13:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.468+0000 7f473940f740 1 client.5916 shutdown 2024-03-30T13:13:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f473940f740 1 -- 172.21.15.99:0/1635707272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123670 msgr2=0x555af516bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f473940f740 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123670 0x555af516bc80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4718058890 tx=0x7f4718058c50 comp rx=0 tx=0).stop 2024-03-30T13:13:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f473940f740 1 -- 172.21.15.99:0/1635707272 shutdown_connections 2024-03-30T13:13:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f473940f740 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5150600 0x555af51412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f473940f740 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5123670 0x555af516bc80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f473940f740 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555af51509e0 0x555af5167380 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f473940f740 1 --2- 172.21.15.99:0/1635707272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123290 0x555af5177e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f473940f740 1 -- 172.21.15.99:0/1635707272 >> 172.21.15.99:0/1635707272 conn(0x555af50e9be0 msgr2=0x555af5120d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f471cc00640 0 client.5916 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f473940f740 1 -- 172.21.15.99:0/1635707272 shutdown_connections 2024-03-30T13:13:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f473940f740 1 -- 172.21.15.99:0/1635707272 wait complete. 2024-03-30T13:13:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.469+0000 7f473940f740 20 client.5916 trim_cache size 0 max 16384 2024-03-30T13:13:59.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.485+0000 7f473940f740 1 Processor -- start 2024-03-30T13:13:59.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.485+0000 7f473940f740 1 -- start start 2024-03-30T13:13:59.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.485+0000 7f473940f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123290 0x555af514d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.485+0000 7f473940f740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5123670 0x555af5167b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.485+0000 7f473940f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af518a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.485+0000 7f473940f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f47302015f0 con 0x555af5150600 2024-03-30T13:13:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.485+0000 7f473940f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4730200640 con 0x555af5123290 2024-03-30T13:13:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.485+0000 7f473940f740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f47300c6cd0 con 0x555af5123670 2024-03-30T13:13:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.486+0000 7f472fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af518a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.486+0000 7f472fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af518a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54858/0 (socket says 172.21.15.99:54858) 2024-03-30T13:13:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.486+0000 7f472fe00640 1 -- 172.21.15.99:0/1498609322 learned_addr learned my addr 172.21.15.99:0/1498609322 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.486+0000 7f472f400640 1 --2- 172.21.15.99:0/1498609322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123290 0x555af514d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.486+0000 7f472ea00640 1 --2- 172.21.15.99:0/1498609322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5123670 0x555af5167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.486+0000 7f472fe00640 1 -- 172.21.15.99:0/1498609322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5123670 msgr2=0x555af5167b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.486+0000 7f472fe00640 1 --2- 172.21.15.99:0/1498609322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5123670 0x555af5167b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.486+0000 7f472fe00640 1 -- 172.21.15.99:0/1498609322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123290 msgr2=0x555af514d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.486+0000 7f472fe00640 1 --2- 172.21.15.99:0/1498609322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123290 0x555af514d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.486+0000 7f472fe00640 1 -- 172.21.15.99:0/1498609322 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af4d332d0 con 0x555af5150600 2024-03-30T13:13:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.487+0000 7f472fe00640 1 --2- 172.21.15.99:0/1498609322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af518a6f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f47300a0490 tx=0x7f4728001830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260471bf437e489 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.487+0000 7f471f400640 1 -- 172.21.15.99:0/1498609322 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472801a070 con 0x555af5150600 2024-03-30T13:13:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.487+0000 7f471f400640 1 -- 172.21.15.99:0/1498609322 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4728007320 con 0x555af5150600 2024-03-30T13:13:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.487+0000 7f471f400640 1 -- 172.21.15.99:0/1498609322 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47280057c0 con 0x555af5150600 2024-03-30T13:13:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.487+0000 7f473940f740 1 -- 172.21.15.99:0/1498609322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 msgr2=0x555af518a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.487+0000 7f473940f740 1 --2- 172.21.15.99:0/1498609322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af518a6f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f47300a0490 tx=0x7f4728001830 comp rx=0 tx=0).stop 2024-03-30T13:13:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.488+0000 7f473940f740 1 -- 172.21.15.99:0/1498609322 shutdown_connections 2024-03-30T13:13:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.488+0000 7f473940f740 1 --2- 172.21.15.99:0/1498609322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af518a6f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.488+0000 7f473940f740 1 --2- 172.21.15.99:0/1498609322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5123670 0x555af5167b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.488+0000 7f473940f740 1 --2- 172.21.15.99:0/1498609322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123290 0x555af514d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.488+0000 7f473940f740 1 -- 172.21.15.99:0/1498609322 >> 172.21.15.99:0/1498609322 conn(0x555af50e9be0 msgr2=0x555af5141070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.488+0000 7f473940f740 1 -- 172.21.15.99:0/1498609322 shutdown_connections 2024-03-30T13:13:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.488+0000 7f473940f740 1 -- 172.21.15.99:0/1498609322 wait complete. 2024-03-30T13:13:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.488+0000 7f473940f740 1 -- start start 2024-03-30T13:13:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.489+0000 7f473940f740 1 Processor -- start 2024-03-30T13:13:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f473940f740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5123290 0x555af51e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f473940f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123670 0x555af5160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f473940f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af515e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f473940f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f47300c7320 con 0x555af5150600 2024-03-30T13:13:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f473940f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555af51619e0 con 0x555af5123670 2024-03-30T13:13:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f473940f740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555af5177330 con 0x555af5123290 2024-03-30T13:13:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f473940f740 10 client.0 _ll_register_callbacks cb 0x7f4718054e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f472fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af515e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f472fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af515e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54870/0 (socket says 172.21.15.99:54870) 2024-03-30T13:13:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f472fe00640 1 -- 172.21.15.99:0/606947067 learned_addr learned my addr 172.21.15.99:0/606947067 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f472f400640 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5123290 0x555af51e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f472ea00640 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123670 0x555af5160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f472fe00640 1 -- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5123290 msgr2=0x555af51e70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f472fe00640 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5123290 0x555af51e70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f472fe00640 1 -- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123670 msgr2=0x555af5160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f472fe00640 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123670 0x555af5160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.490+0000 7f472fe00640 1 -- 172.21.15.99:0/606947067 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af5164b00 con 0x555af5150600 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.491+0000 7f472fe00640 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af515e390 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4728000c00 tx=0x7f4728001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e1f596be02398 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.491+0000 7f471cc00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.491+0000 7f471cc00640 1 -- 172.21.15.99:0/606947067 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728026060 con 0x555af5150600 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.491+0000 7f471cc00640 1 -- 172.21.15.99:0/606947067 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4728005d70 con 0x555af5150600 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.491+0000 7f473940f740 1 -- 172.21.15.99:0/606947067 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4728007320 con 0x555af5150600 2024-03-30T13:13:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.491+0000 7f471cc00640 1 -- 172.21.15.99:0/606947067 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f472802c050 con 0x555af5150600 2024-03-30T13:13:59.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.491+0000 7f473940f740 10 client.5922 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:59.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.491+0000 7f473940f740 1 -- 172.21.15.99:0/606947067 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x555af51662d0 con 0x555af5150600 2024-03-30T13:13:59.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.492+0000 7f471cc00640 1 -- 172.21.15.99:0/606947067 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4728007320 con 0x555af5150600 2024-03-30T13:13:59.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.492+0000 7f471cc00640 1 -- 172.21.15.99:0/606947067 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f472802f020 con 0x555af5150600 2024-03-30T13:13:59.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.492+0000 7f473940f740 10 client.5922 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:59.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.492+0000 7f473940f740 10 client.5922 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:59.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.492+0000 7f473940f740 20 client.5922 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:59.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.492+0000 7f473940f740 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555af513fe40 0x555af51766d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.492+0000 7f473940f740 4 client.5922 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628359}] 2024-03-30T13:13:59.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.492+0000 7f473940f740 1 -- 172.21.15.99:0/606947067 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628359}) -- 0x555af5168aa0 con 0x555af513fe40 2024-03-30T13:13:59.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.492+0000 7f472f400640 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555af513fe40 0x555af51766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.493+0000 7f472f400640 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555af513fe40 0x555af51766d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60ee1170d7bf47b0 server_cookie=e386705f1060d3fb in_seq=0 out_seq=0 2024-03-30T13:13:59.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.493+0000 7f471cc00640 10 client.5922 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f471cc00640 1 -- 172.21.15.99:0/606947067 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4803 (crc 0 0 0) 0x555af5168aa0 con 0x555af513fe40 2024-03-30T13:13:59.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f471cc00640 10 client.5922 handle_command_reply: tid=0 2024-03-30T13:13:59.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f473940f740 1 client.5922 shutdown 2024-03-30T13:13:59.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f473940f740 1 -- 172.21.15.99:0/606947067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 msgr2=0x555af515e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f473940f740 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af515e390 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4728000c00 tx=0x7f4728001120 comp rx=0 tx=0).stop 2024-03-30T13:13:59.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f473940f740 1 -- 172.21.15.99:0/606947067 shutdown_connections 2024-03-30T13:13:59.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f473940f740 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af5150600 0x555af515e390 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f473940f740 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555af513fe40 0x555af51766d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f473940f740 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af5123670 0x555af5160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f473940f740 1 --2- 172.21.15.99:0/606947067 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555af5123290 0x555af51e70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f471cc00640 0 client.5922 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.494+0000 7f473940f740 1 -- 172.21.15.99:0/606947067 >> 172.21.15.99:0/606947067 conn(0x555af50e9be0 msgr2=0x555af5118760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.495+0000 7f473940f740 1 -- 172.21.15.99:0/606947067 shutdown_connections 2024-03-30T13:13:59.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.495+0000 7f473940f740 1 -- 172.21.15.99:0/606947067 wait complete. 2024-03-30T13:13:59.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.495+0000 7f473940f740 20 client.5922 trim_cache size 0 max 16384 2024-03-30T13:13:59.501 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:59.501 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ceph/Makefile", 2024-03-30T13:13:59.501 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628359, 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.490754+0000", 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.511878+0000", 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:59.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 356, 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:59.503 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.511878+0000", 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:13:59.504 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:13:59.505 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:13:59.505 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:13:59.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.505 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:13:59.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:59.505 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.505 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:59.505 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:59.505 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:59.505 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:59.505 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 356, 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.490754+0000" 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:59.506 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 356, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.490754+0000" 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 304, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 4, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:59.507 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "2024-03-30T13:13:26.540609+0000", 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 216, 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:59.508 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.509 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyrstat": 0, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:59.510 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:13:59.511 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:13:59.512 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.514 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.514 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:59.514 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:59.514 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.514 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:59.514 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:59.514 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.514 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.514 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.514 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.515 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:13:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:59.517 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:59.517 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.517 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:59.517 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:13:59.517 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:59.517 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:59.517 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:59.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.495+0000 7f4736600640 1 -- 172.21.15.99:0/2832811380 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f470c06c530 msgr2=0x7f470c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.495+0000 7f4736600640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f470c06c530 0x7f470c06e9f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4720036000 tx=0x7f472002e000 comp rx=0 tx=0).stop 2024-03-30T13:13:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.495+0000 7f4736600640 1 -- 172.21.15.99:0/2832811380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47300c85b0 msgr2=0x7f47301f76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.495+0000 7f4736600640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47300c85b0 0x7f47301f76a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f47180011e0 tx=0x7f471800cc00 comp rx=0 tx=0).stop 2024-03-30T13:13:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.496+0000 7f4736600640 1 -- 172.21.15.99:0/2832811380 shutdown_connections 2024-03-30T13:13:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.496+0000 7f4736600640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f470c06c530 0x7f470c06e9f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.496+0000 7f4736600640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473015d4e0 0x7f473015d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.496+0000 7f4736600640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47300c85b0 0x7f47301f76a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.496+0000 7f4736600640 1 --2- 172.21.15.99:0/2832811380 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47140039b0 0x7f4730151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.496+0000 7f4736600640 1 -- 172.21.15.99:0/2832811380 >> 172.21.15.99:0/2832811380 conn(0x7f47300b3f00 msgr2=0x7f4730070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.496+0000 7f4736600640 1 -- 172.21.15.99:0/2832811380 shutdown_connections 2024-03-30T13:13:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.496+0000 7f4736600640 1 -- 172.21.15.99:0/2832811380 wait complete. 2024-03-30T13:13:59.520 DEBUG:tasks.cephfs.test_uninlining:getting inode info #3 of 23:1099511628365 2024-03-30T13:13:59.520 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628365 2024-03-30T13:13:59.520 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628365 2024-03-30T13:13:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.724+0000 7fc7dd400640 1 Processor -- start 2024-03-30T13:13:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.725+0000 7fc7dd400640 1 -- start start 2024-03-30T13:13:59.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.726+0000 7fc7dd400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc7d815e920 0x7fc7d80d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.726+0000 7fc7dd400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc7d80cfde0 0x7fc7d80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.726+0000 7fc7dd400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7d80d3780 con 0x7fc7d80d0f90 2024-03-30T13:13:59.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.726+0000 7fc7dd400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc7d815ed00 con 0x7fc7d815e920 2024-03-30T13:13:59.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.726+0000 7fc7dd400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc7d80d21e0 con 0x7fc7d80cfde0 2024-03-30T13:13:59.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.726+0000 7fc7d6800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc7d815e920 0x7fc7d80d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.727+0000 7fc7d7200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc7d80d0f90 0x7fc7d806c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33378/0 (socket says 172.21.15.99:33378) 2024-03-30T13:13:59.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.727+0000 7fc7d6800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc7d815e920 0x7fc7d80d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54884/0 (socket says 172.21.15.99:54884) 2024-03-30T13:13:59.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.727+0000 7fc7d7200640 1 -- 172.21.15.99:0/1612285914 learned_addr learned my addr 172.21.15.99:0/1612285914 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:13:59.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.727+0000 7fc7cfe00640 1 --2- 172.21.15.99:0/1612285914 >> v2:172.21.15.181:3300/0 conn(0x7fc7d80cfde0 0x7fc7d80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.727+0000 7fc7d6800640 1 -- 172.21.15.99:0/1612285914 >> v2:172.21.15.181:3300/0 conn(0x7fc7d80cfde0 msgr2=0x7fc7d80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.727+0000 7fc7d6800640 1 --2- 172.21.15.99:0/1612285914 >> v2:172.21.15.181:3300/0 conn(0x7fc7d80cfde0 0x7fc7d80d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.727+0000 7fc7d6800640 1 -- 172.21.15.99:0/1612285914 >> v1:172.21.15.99:6789/0 conn(0x7fc7d80d0f90 legacy=0x7fc7d806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.727+0000 7fc7d6800640 1 -- 172.21.15.99:0/1612285914 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d80d2480 con 0x7fc7d815e920 2024-03-30T13:13:59.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.727+0000 7fc7d5e00640 1 -- 172.21.15.99:0/1612285914 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2779886626 0 0) 0x7fc7d0001490 con 0x7fc7d80d0f90 2024-03-30T13:13:59.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.728+0000 7fc7d6800640 1 --2- 172.21.15.99:0/1612285914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7d815e920 0x7fc7d80d3240 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc7d808ccb0 tx=0x7fc7c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436fab91231416af server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.728+0000 7fc7d5e00640 1 -- 172.21.15.99:0/1612285914 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8035020 con 0x7fc7d815e920 2024-03-30T13:13:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.728+0000 7fc7d5e00640 1 -- 172.21.15.99:0/1612285914 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c8031830 con 0x7fc7d815e920 2024-03-30T13:13:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.728+0000 7fc7d5e00640 1 -- 172.21.15.99:0/1612285914 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8031c00 con 0x7fc7d815e920 2024-03-30T13:13:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.729+0000 7fc7dd400640 1 -- 172.21.15.99:0/1612285914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7d815e920 msgr2=0x7fc7d80d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.729+0000 7fc7dd400640 1 --2- 172.21.15.99:0/1612285914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7d815e920 0x7fc7d80d3240 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc7d808ccb0 tx=0x7fc7c802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.729+0000 7fc7dd400640 1 -- 172.21.15.99:0/1612285914 shutdown_connections 2024-03-30T13:13:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.729+0000 7fc7dd400640 1 --2- 172.21.15.99:0/1612285914 >> v2:172.21.15.181:3300/0 conn(0x7fc7d80cfde0 0x7fc7d80d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.729+0000 7fc7dd400640 1 --2- 172.21.15.99:0/1612285914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7d815e920 0x7fc7d80d3240 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.729+0000 7fc7dd400640 1 -- 172.21.15.99:0/1612285914 >> 172.21.15.99:0/1612285914 conn(0x7fc7d808bfc0 msgr2=0x7fc7d80d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.729+0000 7fc7dd400640 1 -- 172.21.15.99:0/1612285914 shutdown_connections 2024-03-30T13:13:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.729+0000 7fc7dd400640 1 -- 172.21.15.99:0/1612285914 wait complete. 2024-03-30T13:13:59.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.731+0000 7fc7dd400640 1 Processor -- start 2024-03-30T13:13:59.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.731+0000 7fc7dd400640 1 -- start start 2024-03-30T13:13:59.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.732+0000 7fc7dd400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7d80cfde0 0x7fc7d814caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.732+0000 7fc7dd400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d80d0f90 0x7fc7d81e9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.732+0000 7fc7dd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7d815e920 0x7fc7d815fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.732+0000 7fc7dd400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d80d2d20 con 0x7fc7d815e920 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.732+0000 7fc7dd400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d80d2a40 con 0x7fc7d80d0f90 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.732+0000 7fc7dd400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d80d4ef0 con 0x7fc7d80cfde0 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.732+0000 7fc7d7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7d815e920 0x7fc7d815fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.732+0000 7fc7d7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7d815e920 0x7fc7d815fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54900/0 (socket says 172.21.15.99:54900) 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.732+0000 7fc7d7200640 1 -- 172.21.15.99:0/2687935851 learned_addr learned my addr 172.21.15.99:0/2687935851 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7d6800640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7d80cfde0 0x7fc7d814caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7cfe00640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d80d0f90 0x7fc7d81e9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7d7200640 1 -- 172.21.15.99:0/2687935851 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7d80cfde0 msgr2=0x7fc7d814caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7d7200640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7d80cfde0 0x7fc7d814caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7d7200640 1 -- 172.21.15.99:0/2687935851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d80d0f90 msgr2=0x7fc7d81e9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7d7200640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d80d0f90 0x7fc7d81e9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7d7200640 1 -- 172.21.15.99:0/2687935851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d80cb6e0 con 0x7fc7d815e920 2024-03-30T13:13:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7cfe00640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d80d0f90 0x7fc7d81e9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7d7200640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7d815e920 0x7fc7d815fed0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000c820 tx=0x7fc7d000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7cea00640 1 -- 172.21.15.99:0/2687935851 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0018070 con 0x7fc7d815e920 2024-03-30T13:13:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7cea00640 1 -- 172.21.15.99:0/2687935851 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d000a5e0 con 0x7fc7d815e920 2024-03-30T13:13:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.733+0000 7fc7cea00640 1 -- 172.21.15.99:0/2687935851 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000a9d0 con 0x7fc7d815e920 2024-03-30T13:13:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.734+0000 7fc7dd400640 1 -- 172.21.15.99:0/2687935851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d80cb980 con 0x7fc7d815e920 2024-03-30T13:13:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.734+0000 7fc7dd400640 1 -- 172.21.15.99:0/2687935851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d80cbf40 con 0x7fc7d815e920 2024-03-30T13:13:59.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.736+0000 7fc7cea00640 1 -- 172.21.15.99:0/2687935851 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc7d001b070 con 0x7fc7d815e920 2024-03-30T13:13:59.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.737+0000 7fc7cea00640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc7b406c530 0x7fc7b406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.737+0000 7fc7cea00640 1 -- 172.21.15.99:0/2687935851 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc7d008ad50 con 0x7fc7d815e920 2024-03-30T13:13:59.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.737+0000 7fc7d6800640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc7b406c530 0x7fc7b406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.738+0000 7fc7e018e740 1 Processor -- start 2024-03-30T13:13:59.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.738+0000 7fc7e018e740 1 -- start start 2024-03-30T13:13:59.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.738+0000 7fc7d6800640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc7b406c530 0x7fc7b406e9f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8036000 tx=0x7fc7c8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.739+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c290 0x55c04c792dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.739+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c793300 0x55c04c76b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.739+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c670 0x55c04c76b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.739+0000 7fc7e018e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c04c6cf330 con 0x55c04c76c670 2024-03-30T13:13:59.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.739+0000 7fc7e018e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c04c677620 con 0x55c04c76c290 2024-03-30T13:13:59.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.739+0000 7fc7e018e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55c04c6cb440 con 0x55c04c793300 2024-03-30T13:13:59.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.739+0000 7fc7d7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c670 0x55c04c76b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.739+0000 7fc7d7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c670 0x55c04c76b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54916/0 (socket says 172.21.15.99:54916) 2024-03-30T13:13:59.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.739+0000 7fc7d7200640 1 -- 172.21.15.99:0/2058002956 learned_addr learned my addr 172.21.15.99:0/2058002956 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.739+0000 7fc7cfe00640 1 --2- 172.21.15.99:0/2058002956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c793300 0x55c04c76b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.740+0000 7fc7d6800640 1 --2- 172.21.15.99:0/2058002956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c290 0x55c04c792dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.740+0000 7fc7d7200640 1 -- 172.21.15.99:0/2058002956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c793300 msgr2=0x55c04c76b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.740+0000 7fc7d7200640 1 --2- 172.21.15.99:0/2058002956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c793300 0x55c04c76b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.740+0000 7fc7d7200640 1 -- 172.21.15.99:0/2058002956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c290 msgr2=0x55c04c792dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.740+0000 7fc7d7200640 1 --2- 172.21.15.99:0/2058002956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c290 0x55c04c792dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.740+0000 7fc7d7200640 1 -- 172.21.15.99:0/2058002956 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04c4af920 con 0x55c04c76c670 2024-03-30T13:13:59.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.740+0000 7fc7d7200640 1 --2- 172.21.15.99:0/2058002956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c670 0x55c04c76b810 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000cfd0 tx=0x7fc7d0058be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6c77640c74ba7a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.740+0000 7fc7c7000640 1 -- 172.21.15.99:0/2058002956 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0056ee0 con 0x55c04c76c670 2024-03-30T13:13:59.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.740+0000 7fc7c7000640 1 -- 172.21.15.99:0/2058002956 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d0055250 con 0x55c04c76c670 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.740+0000 7fc7c7000640 1 -- 172.21.15.99:0/2058002956 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000adb0 con 0x55c04c76c670 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.741+0000 7fc7e018e740 1 -- 172.21.15.99:0/2058002956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c670 msgr2=0x55c04c76b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.741+0000 7fc7e018e740 1 --2- 172.21.15.99:0/2058002956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c670 0x55c04c76b810 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000cfd0 tx=0x7fc7d0058be0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.741+0000 7fc7e018e740 1 -- 172.21.15.99:0/2058002956 shutdown_connections 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.741+0000 7fc7e018e740 1 --2- 172.21.15.99:0/2058002956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c670 0x55c04c76b810 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.741+0000 7fc7e018e740 1 --2- 172.21.15.99:0/2058002956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c793300 0x55c04c76b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.741+0000 7fc7e018e740 1 --2- 172.21.15.99:0/2058002956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c290 0x55c04c792dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.741+0000 7fc7e018e740 1 -- 172.21.15.99:0/2058002956 >> 172.21.15.99:0/2058002956 conn(0x55c04c732be0 msgr2=0x55c04c7b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.741+0000 7fc7e018e740 1 -- 172.21.15.99:0/2058002956 shutdown_connections 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.741+0000 7fc7e018e740 1 -- 172.21.15.99:0/2058002956 wait complete. 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.742+0000 7fc7e018e740 1 -- start start 2024-03-30T13:13:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.742+0000 7fc7e018e740 1 Processor -- start 2024-03-30T13:13:59.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c670 0x55c04c7b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c799bc0 0x55c04c7b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7e018e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c04c792930 con 0x55c04c76c290 2024-03-30T13:13:59.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7e018e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c04c68a9d0 con 0x55c04c76c670 2024-03-30T13:13:59.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7e018e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55c04c78b6b0 con 0x55c04c799bc0 2024-03-30T13:13:59.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7e018e740 10 client.0 _ll_register_callbacks cb 0x55c04c6c6fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:59.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7d6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7d6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7c0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54924/0 (socket says 172.21.15.99:54924) 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7d6800640 1 -- 172.21.15.99:0/2342169299 learned_addr learned my addr 172.21.15.99:0/2342169299 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7d6800640 1 -- 172.21.15.99:0/2342169299 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c799bc0 msgr2=0x55c04c7b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7d6800640 1 --2- 172.21.15.99:0/2342169299 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c799bc0 0x55c04c7b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7d6800640 1 -- 172.21.15.99:0/2342169299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c670 msgr2=0x55c04c7b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.743+0000 7fc7d6800640 1 --2- 172.21.15.99:0/2342169299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c670 0x55c04c7b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.744+0000 7fc7d6800640 1 -- 172.21.15.99:0/2342169299 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c04c3a3210 con 0x55c04c76c290 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.744+0000 7fc7d6800640 1 --2- 172.21.15.99:0/2342169299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7c0ec0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc7c802bee0 tx=0x7fc7c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8f42dc8ea1e3ea server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.744+0000 7fc7bb400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.744+0000 7fc7bb400640 1 -- 172.21.15.99:0/2342169299 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8054060 con 0x55c04c76c290 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.744+0000 7fc7bb400640 1 -- 172.21.15.99:0/2342169299 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc7c8040030 con 0x55c04c76c290 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.744+0000 7fc7e018e740 1 -- 172.21.15.99:0/2342169299 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7d0055250 con 0x55c04c76c290 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.744+0000 7fc7bb400640 1 -- 172.21.15.99:0/2342169299 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc7c805a050 con 0x55c04c76c290 2024-03-30T13:13:59.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.744+0000 7fc7e018e740 10 client.5937 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:59.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.744+0000 7fc7e018e740 1 -- 172.21.15.99:0/2342169299 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55c04c5100b0 con 0x55c04c76c290 2024-03-30T13:13:59.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.745+0000 7fc7bb400640 1 -- 172.21.15.99:0/2342169299 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d0055250 con 0x55c04c76c290 2024-03-30T13:13:59.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.745+0000 7fc7bb400640 1 -- 172.21.15.99:0/2342169299 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc7c805d020 con 0x55c04c76c290 2024-03-30T13:13:59.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.745+0000 7fc7e018e740 10 client.5937 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:59.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.745+0000 7fc7e018e740 10 client.5937 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:59.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.745+0000 7fc7e018e740 20 client.5937 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:59.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.745+0000 7fc7e018e740 1 --2- 172.21.15.99:0/2342169299 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c04c798280 0x55c04c7986e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.745+0000 7fc7e018e740 4 client.5937 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:59.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.745+0000 7fc7e018e740 1 -- 172.21.15.99:0/2342169299 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c04c6dc870 con 0x55c04c798280 2024-03-30T13:13:59.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.746+0000 7fc7cfe00640 1 --2- 172.21.15.99:0/2342169299 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c04c798280 0x55c04c7986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.747+0000 7fc7cfe00640 1 --2- 172.21.15.99:0/2342169299 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c04c798280 0x55c04c7986e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=506066389030a11 server_cookie=243b9ceefa8a528d in_seq=0 out_seq=0 2024-03-30T13:13:59.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.747+0000 7fc7bb400640 10 client.5937 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.748+0000 7fc7bb400640 1 -- 172.21.15.99:0/2342169299 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55c04c6dc870 con 0x55c04c798280 2024-03-30T13:13:59.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.748+0000 7fc7bb400640 10 client.5937 handle_command_reply: tid=0 2024-03-30T13:13:59.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.748+0000 7fc7e018e740 1 client.5937 shutdown 2024-03-30T13:13:59.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7e018e740 1 -- 172.21.15.99:0/2342169299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 msgr2=0x55c04c7c0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7e018e740 1 --2- 172.21.15.99:0/2342169299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7c0ec0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc7c802bee0 tx=0x7fc7c8004730 comp rx=0 tx=0).stop 2024-03-30T13:13:59.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7e018e740 1 -- 172.21.15.99:0/2342169299 shutdown_connections 2024-03-30T13:13:59.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7e018e740 1 --2- 172.21.15.99:0/2342169299 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c799bc0 0x55c04c7b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7e018e740 1 --2- 172.21.15.99:0/2342169299 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c04c798280 0x55c04c7986e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7e018e740 1 --2- 172.21.15.99:0/2342169299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c670 0x55c04c7b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7e018e740 1 --2- 172.21.15.99:0/2342169299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7c0ec0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7bb400640 0 client.5937 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7e018e740 1 -- 172.21.15.99:0/2342169299 >> 172.21.15.99:0/2342169299 conn(0x55c04c732be0 msgr2=0x55c04c769d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7e018e740 1 -- 172.21.15.99:0/2342169299 shutdown_connections 2024-03-30T13:13:59.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7e018e740 1 -- 172.21.15.99:0/2342169299 wait complete. 2024-03-30T13:13:59.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.749+0000 7fc7e018e740 20 client.5937 trim_cache size 0 max 16384 2024-03-30T13:13:59.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.765+0000 7fc7e018e740 1 Processor -- start 2024-03-30T13:13:59.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.765+0000 7fc7e018e740 1 -- start start 2024-03-30T13:13:59.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7b0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c76c670 0x55c04c823b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c799bc0 0x55c04c795f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7e018e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d8200de0 con 0x55c04c76c290 2024-03-30T13:13:59.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7e018e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d81ffe30 con 0x55c04c799bc0 2024-03-30T13:13:59.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7e018e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d81ff300 con 0x55c04c76c670 2024-03-30T13:13:59.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7d6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7d6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54940/0 (socket says 172.21.15.99:54940) 2024-03-30T13:13:59.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7d6800640 1 -- 172.21.15.99:0/3257674420 learned_addr learned my addr 172.21.15.99:0/3257674420 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7d6800640 1 -- 172.21.15.99:0/3257674420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c76c670 msgr2=0x55c04c823b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7d6800640 1 --2- 172.21.15.99:0/3257674420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c76c670 0x55c04c823b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7d6800640 1 -- 172.21.15.99:0/3257674420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c799bc0 msgr2=0x55c04c795f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7d7200640 1 --2- 172.21.15.99:0/3257674420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c799bc0 0x55c04c795f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7d6800640 1 --2- 172.21.15.99:0/3257674420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c799bc0 0x55c04c795f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.766+0000 7fc7d6800640 1 -- 172.21.15.99:0/3257674420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04c37c2d0 con 0x55c04c76c290 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.767+0000 7fc7d6800640 1 --2- 172.21.15.99:0/3257674420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7b0430 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80317a0 tx=0x7fc7c804b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7485743af90f89d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.767+0000 7fc7c6600640 1 -- 172.21.15.99:0/3257674420 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8035040 con 0x55c04c76c290 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.767+0000 7fc7c6600640 1 -- 172.21.15.99:0/3257674420 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c80460f0 con 0x55c04c76c290 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.767+0000 7fc7c6600640 1 -- 172.21.15.99:0/3257674420 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8045410 con 0x55c04c76c290 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.767+0000 7fc7e018e740 1 -- 172.21.15.99:0/3257674420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 msgr2=0x55c04c7b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.767+0000 7fc7e018e740 1 --2- 172.21.15.99:0/3257674420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7b0430 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80317a0 tx=0x7fc7c804b000 comp rx=0 tx=0).stop 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.767+0000 7fc7e018e740 1 -- 172.21.15.99:0/3257674420 shutdown_connections 2024-03-30T13:13:59.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.767+0000 7fc7e018e740 1 --2- 172.21.15.99:0/3257674420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c799bc0 0x55c04c795f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.767+0000 7fc7e018e740 1 --2- 172.21.15.99:0/3257674420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c76c670 0x55c04c823b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.767+0000 7fc7e018e740 1 --2- 172.21.15.99:0/3257674420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c7b0430 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.767+0000 7fc7e018e740 1 -- 172.21.15.99:0/3257674420 >> 172.21.15.99:0/3257674420 conn(0x55c04c732be0 msgr2=0x55c04c7b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.768+0000 7fc7e018e740 1 -- 172.21.15.99:0/3257674420 shutdown_connections 2024-03-30T13:13:59.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.768+0000 7fc7e018e740 1 -- 172.21.15.99:0/3257674420 wait complete. 2024-03-30T13:13:59.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.768+0000 7fc7e018e740 1 -- start start 2024-03-30T13:13:59.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.768+0000 7fc7e018e740 1 Processor -- start 2024-03-30T13:13:59.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.769+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c825b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.769+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c670 0x55c04c8260c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.769+0000 7fc7e018e740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c799bc0 0x55c04c826600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.769+0000 7fc7e018e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d81ff7e0 con 0x55c04c76c290 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.769+0000 7fc7e018e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c04c826e20 con 0x55c04c76c670 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.769+0000 7fc7e018e740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55c04c7d2980 con 0x55c04c799bc0 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.769+0000 7fc7e018e740 10 client.0 _ll_register_callbacks cb 0x7fc7c8009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7d6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c825b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7d6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c825b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54942/0 (socket says 172.21.15.99:54942) 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7d6800640 1 -- 172.21.15.99:0/693976328 learned_addr learned my addr 172.21.15.99:0/693976328 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7cfe00640 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c670 0x55c04c8260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7d7200640 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c799bc0 0x55c04c826600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7d6800640 1 -- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c799bc0 msgr2=0x55c04c826600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7d6800640 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c799bc0 0x55c04c826600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7d6800640 1 -- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c670 msgr2=0x55c04c8260c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7d6800640 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c670 0x55c04c8260c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7d6800640 1 -- 172.21.15.99:0/693976328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c04c7d26d0 con 0x55c04c76c290 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7d6800640 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c825b80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8031800 tx=0x7fc7c803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba339ddebcb78ba6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7bb400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.770+0000 7fc7bb400640 1 -- 172.21.15.99:0/693976328 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c80462a0 con 0x55c04c76c290 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7bb400640 1 -- 172.21.15.99:0/693976328 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fc7c804fe00 con 0x55c04c76c290 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7e018e740 1 -- 172.21.15.99:0/693976328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c80460f0 con 0x55c04c76c290 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7bb400640 1 -- 172.21.15.99:0/693976328 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc7c805e3f0 con 0x55c04c76c290 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7e018e740 10 client.5943 fetch_fsmap learned FSMap version 20 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7e018e740 1 -- 172.21.15.99:0/693976328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55c04c826b60 con 0x55c04c76c290 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7bb400640 1 -- 172.21.15.99:0/693976328 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c80460f0 con 0x55c04c76c290 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7bb400640 1 -- 172.21.15.99:0/693976328 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc7c8070050 con 0x55c04c76c290 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7e018e740 10 client.5943 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7e018e740 10 client.5943 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:13:59.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7e018e740 20 client.5943 populate_metadata read hostname 'smithi099' 2024-03-30T13:13:59.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7e018e740 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c04c76d500 0x55c04c7a6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7e018e740 4 client.5943 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628365}] 2024-03-30T13:13:59.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.771+0000 7fc7e018e740 1 -- 172.21.15.99:0/693976328 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628365}) -- 0x55c04c6d6bc0 con 0x55c04c76d500 2024-03-30T13:13:59.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.772+0000 7fc7cfe00640 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c04c76d500 0x55c04c7a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.773+0000 7fc7cfe00640 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c04c76d500 0x55c04c7a6940 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3ae54ed85ddd0d5 server_cookie=4ee9fb498b3a974a in_seq=0 out_seq=0 2024-03-30T13:13:59.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.773+0000 7fc7bb400640 10 client.5943 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.773+0000 7fc7bb400640 1 -- 172.21.15.99:0/693976328 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4782 (crc 0 0 0) 0x55c04c6d6bc0 con 0x55c04c76d500 2024-03-30T13:13:59.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.773+0000 7fc7bb400640 10 client.5943 handle_command_reply: tid=0 2024-03-30T13:13:59.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 1 client.5943 shutdown 2024-03-30T13:13:59.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 1 -- 172.21.15.99:0/693976328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 msgr2=0x55c04c825b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c825b80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8031800 tx=0x7fc7c803f000 comp rx=0 tx=0).stop 2024-03-30T13:13:59.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 1 -- 172.21.15.99:0/693976328 shutdown_connections 2024-03-30T13:13:59.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55c04c799bc0 0x55c04c826600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55c04c76d500 0x55c04c7a6940 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c04c76c670 0x55c04c8260c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 1 --2- 172.21.15.99:0/693976328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c04c76c290 0x55c04c825b80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7bb400640 0 client.5943 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:13:59.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 1 -- 172.21.15.99:0/693976328 >> 172.21.15.99:0/693976328 conn(0x55c04c732be0 msgr2=0x55c04c790f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 1 -- 172.21.15.99:0/693976328 shutdown_connections 2024-03-30T13:13:59.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 1 -- 172.21.15.99:0/693976328 wait complete. 2024-03-30T13:13:59.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.774+0000 7fc7e018e740 20 client.5943 trim_cache size 0 max 16384 2024-03-30T13:13:59.780 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ceph/ceph_frag.c", 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628365, 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.517732+0000", 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.526878+0000", 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:13:59.781 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 401, 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:13:59.782 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.526878+0000", 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:13:59.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 401, 2024-03-30T13:13:59.784 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.517732+0000" 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 401, 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.517732+0000" 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 280, 2024-03-30T13:13:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 16, 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:13:59.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:13:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:13:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyrstat": 0, 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.789 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.790 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.791 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.792 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:13:59.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:13:59.794 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:13:59.795 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:13:59.795 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:13:59.795 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:13:59.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:13:59.795 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:13:59.795 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:13:59.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 -- 172.21.15.99:0/2687935851 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc7b406c530 msgr2=0x7fc7b406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc7b406c530 0x7fc7b406e9f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8036000 tx=0x7fc7c8008030 comp rx=0 tx=0).stop 2024-03-30T13:13:59.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 -- 172.21.15.99:0/2687935851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7d815e920 msgr2=0x7fc7d815fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7d815e920 0x7fc7d815fed0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000c820 tx=0x7fc7d000cce0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 -- 172.21.15.99:0/2687935851 shutdown_connections 2024-03-30T13:13:59.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc7b406c530 0x7fc7b406e9f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7d815e920 0x7fc7d815fed0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d80d0f90 0x7fc7d81e9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 --2- 172.21.15.99:0/2687935851 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7d80cfde0 0x7fc7d814caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 -- 172.21.15.99:0/2687935851 >> 172.21.15.99:0/2687935851 conn(0x7fc7d808bfc0 msgr2=0x7fc7d80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 -- 172.21.15.99:0/2687935851 shutdown_connections 2024-03-30T13:13:59.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.775+0000 7fc7dd400640 1 -- 172.21.15.99:0/2687935851 wait complete. 2024-03-30T13:13:59.797 DEBUG:tasks.cephfs.test_uninlining:getting inode info #4 of 23:1099511628372 2024-03-30T13:13:59.797 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628372 2024-03-30T13:13:59.798 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628372 2024-03-30T13:14:00.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.999+0000 7f0aa1a00640 1 Processor -- start 2024-03-30T13:14:00.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:13:59.999+0000 7f0aa1a00640 1 -- start start 2024-03-30T13:14:00.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.001+0000 7f0aa1a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0a9c0d1010 0x7f0a9c0d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.001+0000 7f0aa1a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0a9c0d3430 0x7f0a9c0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.001+0000 7f0aa1a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a9c0d1930 con 0x7f0a9c0d0210 2024-03-30T13:14:00.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.001+0000 7f0aa1a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9c0d5060 con 0x7f0a9c0d1010 2024-03-30T13:14:00.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.001+0000 7f0aa1a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9c0d2390 con 0x7f0a9c0d3430 2024-03-30T13:14:00.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.001+0000 7f0a9aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0a9c0d1010 0x7f0a9c0d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.001+0000 7f0a9aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0a9c0d1010 0x7f0a9c0d13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54944/0 (socket says 172.21.15.99:54944) 2024-03-30T13:14:00.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.001+0000 7f0a9aa00640 1 -- 172.21.15.99:0/2367364192 learned_addr learned my addr 172.21.15.99:0/2367364192 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.002+0000 7f0a9aa00640 1 -- 172.21.15.99:0/2367364192 >> v2:172.21.15.181:3300/0 conn(0x7f0a9c0d3430 msgr2=0x7f0a9c0cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.002+0000 7f0a92000640 1 --2- 172.21.15.99:0/2367364192 >> v2:172.21.15.181:3300/0 conn(0x7f0a9c0d3430 0x7f0a9c0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.002+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/2367364192 >> v2:172.21.15.181:3300/0 conn(0x7f0a9c0d3430 0x7f0a9c0cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.002+0000 7f0a9aa00640 1 -- 172.21.15.99:0/2367364192 >> v1:172.21.15.181:6789/0 conn(0x7f0a9c0d0210 legacy=0x7f0a9c1622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.002+0000 7f0a9aa00640 1 -- 172.21.15.99:0/2367364192 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c0d2670 con 0x7f0a9c0d1010 2024-03-30T13:14:00.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.003+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/2367364192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0d1010 0x7f0a9c0d13f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c08cfa0 tx=0x7f0a8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8941dacf6003c6d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.004+0000 7f0a9a000640 1 -- 172.21.15.99:0/2367364192 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c035020 con 0x7f0a9c0d1010 2024-03-30T13:14:00.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.004+0000 7f0a9a000640 1 -- 172.21.15.99:0/2367364192 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c031870 con 0x7f0a9c0d1010 2024-03-30T13:14:00.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.004+0000 7f0a9a000640 1 -- 172.21.15.99:0/2367364192 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c031c40 con 0x7f0a9c0d1010 2024-03-30T13:14:00.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.004+0000 7f0aa1a00640 1 -- 172.21.15.99:0/2367364192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0d1010 msgr2=0x7f0a9c0d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.004+0000 7f0aa1a00640 1 --2- 172.21.15.99:0/2367364192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0d1010 0x7f0a9c0d13f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c08cfa0 tx=0x7f0a8c02b910 comp rx=0 tx=0).stop 2024-03-30T13:14:00.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.005+0000 7f0aa1a00640 1 -- 172.21.15.99:0/2367364192 shutdown_connections 2024-03-30T13:14:00.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.005+0000 7f0aa1a00640 1 --2- 172.21.15.99:0/2367364192 >> v2:172.21.15.181:3300/0 conn(0x7f0a9c0d3430 0x7f0a9c0cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.005+0000 7f0aa1a00640 1 --2- 172.21.15.99:0/2367364192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0d1010 0x7f0a9c0d13f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.005+0000 7f0aa1a00640 1 -- 172.21.15.99:0/2367364192 >> 172.21.15.99:0/2367364192 conn(0x7f0a9c08bfc0 msgr2=0x7f0a9c0d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.005+0000 7f0aa1a00640 1 -- 172.21.15.99:0/2367364192 shutdown_connections 2024-03-30T13:14:00.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.005+0000 7f0aa1a00640 1 -- 172.21.15.99:0/2367364192 wait complete. 2024-03-30T13:14:00.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.006+0000 7f0aa1a00640 1 Processor -- start 2024-03-30T13:14:00.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.007+0000 7f0aa1a00640 1 -- start start 2024-03-30T13:14:00.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.007+0000 7f0aa1a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a9c0d0210 0x7f0a9c1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.007+0000 7f0aa1a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0d1010 0x7f0a9c156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.007+0000 7f0aa1a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a9c0d3430 0x7f0a9c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.007+0000 7f0aa1a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c0d2f10 con 0x7f0a9c0d1010 2024-03-30T13:14:00.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.007+0000 7f0aa1a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c0d2c30 con 0x7f0a9c0d0210 2024-03-30T13:14:00.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.007+0000 7f0aa1a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9c15eaf0 con 0x7f0a9c0d3430 2024-03-30T13:14:00.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a92000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0d1010 0x7f0a9c156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a92000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0d1010 0x7f0a9c156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54948/0 (socket says 172.21.15.99:54948) 2024-03-30T13:14:00.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a92000640 1 -- 172.21.15.99:0/3779372045 learned_addr learned my addr 172.21.15.99:0/3779372045 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a9c0d0210 0x7f0a9c1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a9b400640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a9c0d3430 0x7f0a9c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a92000640 1 -- 172.21.15.99:0/3779372045 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a9c0d3430 msgr2=0x7f0a9c158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a92000640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a9c0d3430 0x7f0a9c158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a92000640 1 -- 172.21.15.99:0/3779372045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a9c0d0210 msgr2=0x7f0a9c1587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a92000640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a9c0d0210 0x7f0a9c1587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a92000640 1 -- 172.21.15.99:0/3779372045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c1594c0 con 0x7f0a9c0d1010 2024-03-30T13:14:00.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a9c0d0210 0x7f0a9c1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a9b400640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a9c0d3430 0x7f0a9c158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.008+0000 7f0a92000640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0d1010 0x7f0a9c156f00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400c820 tx=0x7f0a8400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.009+0000 7f0a93400640 1 -- 172.21.15.99:0/3779372045 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84015070 con 0x7f0a9c0d1010 2024-03-30T13:14:00.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.009+0000 7f0a93400640 1 -- 172.21.15.99:0/3779372045 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a84004020 con 0x7f0a9c0d1010 2024-03-30T13:14:00.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.009+0000 7f0aa1a00640 1 -- 172.21.15.99:0/3779372045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9c159760 con 0x7f0a9c0d1010 2024-03-30T13:14:00.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.009+0000 7f0a93400640 1 -- 172.21.15.99:0/3779372045 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a840043f0 con 0x7f0a9c0d1010 2024-03-30T13:14:00.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.009+0000 7f0aa1a00640 1 -- 172.21.15.99:0/3779372045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9c160220 con 0x7f0a9c0d1010 2024-03-30T13:14:00.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.011+0000 7f0a93400640 1 -- 172.21.15.99:0/3779372045 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0a84007830 con 0x7f0a9c0d1010 2024-03-30T13:14:00.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.012+0000 7f0a93400640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0a7806c530 0x7f0a7806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.012+0000 7f0a93400640 1 -- 172.21.15.99:0/3779372045 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f0a8408b550 con 0x7f0a9c0d1010 2024-03-30T13:14:00.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.013+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0a7806c530 0x7f0a7806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.013+0000 7f0aa45f5740 1 Processor -- start 2024-03-30T13:14:00.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.013+0000 7f0aa45f5740 1 -- start start 2024-03-30T13:14:00.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.014+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0a7806c530 0x7f0a7806e9f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c036000 tx=0x7f0a8c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.014+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b47dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.014+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b48300 0x560046b202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.014+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21670 0x560046b20810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.014+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x560046a84330 con 0x560046b21290 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.014+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560046a2c620 con 0x560046b48300 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.014+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x560046a80440 con 0x560046b21670 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.014+0000 7f0a9aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b47dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.014+0000 7f0a9aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b47dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54958/0 (socket says 172.21.15.99:54958) 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.014+0000 7f0a9aa00640 1 -- 172.21.15.99:0/1521765242 learned_addr learned my addr 172.21.15.99:0/1521765242 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.015+0000 7f0a9b400640 1 --2- 172.21.15.99:0/1521765242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21670 0x560046b20810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.015+0000 7f0a92000640 1 --2- 172.21.15.99:0/1521765242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b48300 0x560046b202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.015+0000 7f0a9aa00640 1 -- 172.21.15.99:0/1521765242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21670 msgr2=0x560046b20810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.015+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/1521765242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21670 0x560046b20810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.015+0000 7f0a9aa00640 1 -- 172.21.15.99:0/1521765242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b48300 msgr2=0x560046b202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.015+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/1521765242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b48300 0x560046b202d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.015+0000 7f0a9aa00640 1 -- 172.21.15.99:0/1521765242 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560046864920 con 0x560046b21290 2024-03-30T13:14:00.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.015+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/1521765242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b47dc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c02bf20 tx=0x7f0a8c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df561e57a088649 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.015+0000 7f0a8b400640 1 -- 172.21.15.99:0/1521765242 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c04a070 con 0x560046b21290 2024-03-30T13:14:00.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.015+0000 7f0a8b400640 1 -- 172.21.15.99:0/1521765242 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c03acf0 con 0x560046b21290 2024-03-30T13:14:00.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.015+0000 7f0a8b400640 1 -- 172.21.15.99:0/1521765242 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c035040 con 0x560046b21290 2024-03-30T13:14:00.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.016+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1521765242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 msgr2=0x560046b47dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.016+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1521765242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b47dc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c02bf20 tx=0x7f0a8c030000 comp rx=0 tx=0).stop 2024-03-30T13:14:00.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.016+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1521765242 shutdown_connections 2024-03-30T13:14:00.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.016+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1521765242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21670 0x560046b20810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.016+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1521765242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b48300 0x560046b202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.016+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1521765242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b47dc0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.016+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1521765242 >> 172.21.15.99:0/1521765242 conn(0x560046ae7be0 msgr2=0x560046b65fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.016+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1521765242 shutdown_connections 2024-03-30T13:14:00.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.016+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1521765242 wait complete. 2024-03-30T13:14:00.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.017+0000 7f0aa45f5740 1 -- start start 2024-03-30T13:14:00.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.017+0000 7f0aa45f5740 1 Processor -- start 2024-03-30T13:14:00.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.018+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b75e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.018+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21670 0x560046b76350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.018+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b3faf0 0x560046b783c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.018+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x560046b47930 con 0x560046b21290 2024-03-30T13:14:00.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.018+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560046a3f9d0 con 0x560046b21670 2024-03-30T13:14:00.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.018+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x560046b406b0 con 0x560046b3faf0 2024-03-30T13:14:00.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.018+0000 7f0aa45f5740 10 client.0 _ll_register_callbacks cb 0x560046a7bfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.018+0000 7f0a9aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b75e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.018+0000 7f0a9aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b75e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54962/0 (socket says 172.21.15.99:54962) 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.018+0000 7f0a9aa00640 1 -- 172.21.15.99:0/1020918172 learned_addr learned my addr 172.21.15.99:0/1020918172 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a92000640 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21670 0x560046b76350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a9b400640 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b3faf0 0x560046b783c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a9aa00640 1 -- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b3faf0 msgr2=0x560046b783c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b3faf0 0x560046b783c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a9aa00640 1 -- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21670 msgr2=0x560046b76350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21670 0x560046b76350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a9aa00640 1 -- 172.21.15.99:0/1020918172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560046758210 con 0x560046b21290 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a9b400640 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b3faf0 0x560046b783c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a92000640 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21670 0x560046b76350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b75e10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c02b950 tx=0x7f0a8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24187974f53aa325 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a7fe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a7fe00640 1 -- 172.21.15.99:0/1020918172 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c04a070 con 0x560046b21290 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0a7fe00640 1 -- 172.21.15.99:0/1020918172 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f0a8c003c50 con 0x560046b21290 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.019+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1020918172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a8c03acf0 con 0x560046b21290 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.020+0000 7f0a7fe00640 1 -- 172.21.15.99:0/1020918172 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0a8c05f050 con 0x560046b21290 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.020+0000 7f0aa45f5740 10 client.5955 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.020+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1020918172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5600468c50b0 con 0x560046b21290 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.020+0000 7f0a7fe00640 1 -- 172.21.15.99:0/1020918172 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c03acf0 con 0x560046b21290 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.020+0000 7f0a7fe00640 1 -- 172.21.15.99:0/1020918172 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f0a8c062020 con 0x560046b21290 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.020+0000 7f0aa45f5740 10 client.5955 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:00.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.020+0000 7f0aa45f5740 10 client.5955 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:00.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.020+0000 7f0aa45f5740 20 client.5955 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:00.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.020+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560046b68730 0x560046b83550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.020+0000 7f0aa45f5740 4 client.5955 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:00.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.020+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1020918172 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560046a91870 con 0x560046b68730 2024-03-30T13:14:00.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.021+0000 7f0a92000640 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560046b68730 0x560046b83550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.021+0000 7f0a92000640 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560046b68730 0x560046b83550 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e0161ede185866a server_cookie=87c5f6898c63f70f in_seq=0 out_seq=0 2024-03-30T13:14:00.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.021+0000 7f0a7fe00640 10 client.5955 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0a7fe00640 1 -- 172.21.15.99:0/1020918172 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x560046a91870 con 0x560046b68730 2024-03-30T13:14:00.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0a7fe00640 10 client.5955 handle_command_reply: tid=0 2024-03-30T13:14:00.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0aa45f5740 1 client.5955 shutdown 2024-03-30T13:14:00.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1020918172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 msgr2=0x560046b75e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b75e10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c02b950 tx=0x7f0a8c004730 comp rx=0 tx=0).stop 2024-03-30T13:14:00.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1020918172 shutdown_connections 2024-03-30T13:14:00.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b3faf0 0x560046b783c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560046b68730 0x560046b83550 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21670 0x560046b76350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1020918172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b21290 0x560046b75e10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1020918172 >> 172.21.15.99:0/1020918172 conn(0x560046ae7be0 msgr2=0x560046b47070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0a7fe00640 0 client.5955 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1020918172 shutdown_connections 2024-03-30T13:14:00.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.023+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1020918172 wait complete. 2024-03-30T13:14:00.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.024+0000 7f0aa45f5740 20 client.5955 trim_cache size 0 max 16384 2024-03-30T13:14:00.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.039+0000 7f0aa45f5740 1 Processor -- start 2024-03-30T13:14:00.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.039+0000 7f0aa45f5740 1 -- start start 2024-03-30T13:14:00.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.040+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21290 0x560046b4e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.040+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21670 0x560046b5bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.040+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b7f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.040+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c200f20 con 0x560046b3faf0 2024-03-30T13:14:00.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.040+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c161af0 con 0x560046b21670 2024-03-30T13:14:00.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.040+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9c15f960 con 0x560046b21290 2024-03-30T13:14:00.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a9b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b7f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a9b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b7f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54974/0 (socket says 172.21.15.99:54974) 2024-03-30T13:14:00.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a9b400640 1 -- 172.21.15.99:0/1573614025 learned_addr learned my addr 172.21.15.99:0/1573614025 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/1573614025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21290 0x560046b4e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a9b400640 1 -- 172.21.15.99:0/1573614025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21290 msgr2=0x560046b4e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a9b400640 1 --2- 172.21.15.99:0/1573614025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21290 0x560046b4e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a9b400640 1 -- 172.21.15.99:0/1573614025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21670 msgr2=0x560046b5bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a9b400640 1 --2- 172.21.15.99:0/1573614025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21670 0x560046b5bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a9b400640 1 -- 172.21.15.99:0/1573614025 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600467312d0 con 0x560046b3faf0 2024-03-30T13:14:00.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/1573614025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21290 0x560046b4e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a9b400640 1 --2- 172.21.15.99:0/1573614025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b7f320 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0a94005420 tx=0x7f0a940058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c9b9daf26df27 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a8aa00640 1 -- 172.21.15.99:0/1573614025 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94006b50 con 0x560046b3faf0 2024-03-30T13:14:00.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a8aa00640 1 -- 172.21.15.99:0/1573614025 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a94006d10 con 0x560046b3faf0 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.041+0000 7f0a8aa00640 1 -- 172.21.15.99:0/1573614025 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400fb30 con 0x560046b3faf0 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.042+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1573614025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 msgr2=0x560046b7f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.042+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1573614025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b7f320 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0a94005420 tx=0x7f0a940058e0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.042+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1573614025 shutdown_connections 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.042+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1573614025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b7f320 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.042+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1573614025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21670 0x560046b5bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.042+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/1573614025 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21290 0x560046b4e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.042+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1573614025 >> 172.21.15.99:0/1573614025 conn(0x560046ae7be0 msgr2=0x560046b20920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.042+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1573614025 shutdown_connections 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.042+0000 7f0aa45f5740 1 -- 172.21.15.99:0/1573614025 wait complete. 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.043+0000 7f0aa45f5740 1 -- start start 2024-03-30T13:14:00.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.043+0000 7f0aa45f5740 1 Processor -- start 2024-03-30T13:14:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.044+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21290 0x560046b4ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.044+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21670 0x560046b5bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.044+0000 7f0aa45f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b87850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.044+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x560046b76e60 con 0x560046b3faf0 2024-03-30T13:14:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.044+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c1614a0 con 0x560046b21290 2024-03-30T13:14:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.044+0000 7f0aa45f5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x560046b76a90 con 0x560046b21670 2024-03-30T13:14:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.044+0000 7f0aa45f5740 10 client.0 _ll_register_callbacks cb 0x7f0a8c031a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.044+0000 7f0a9b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b87850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.044+0000 7f0a9b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b87850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54980/0 (socket says 172.21.15.99:54980) 2024-03-30T13:14:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.044+0000 7f0a9b400640 1 -- 172.21.15.99:0/2274377455 learned_addr learned my addr 172.21.15.99:0/2274377455 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0a9b400640 1 -- 172.21.15.99:0/2274377455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21670 msgr2=0x560046b5bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0a9b400640 1 --2- 172.21.15.99:0/2274377455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21670 0x560046b5bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0a9b400640 1 -- 172.21.15.99:0/2274377455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21290 msgr2=0x560046b4ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0a9b400640 1 --2- 172.21.15.99:0/2274377455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21290 0x560046b4ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0a9b400640 1 -- 172.21.15.99:0/2274377455 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560046b5c470 con 0x560046b3faf0 2024-03-30T13:14:00.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0a9b400640 1 --2- 172.21.15.99:0/2274377455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b87850 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400f6c0 tx=0x7f0a94003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397e01b4194de24 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0a7fe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:00.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0a7fe00640 1 -- 172.21.15.99:0/2274377455 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94007440 con 0x560046b3faf0 2024-03-30T13:14:00.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0a7fe00640 1 -- 172.21.15.99:0/2274377455 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f0a940075e0 con 0x560046b3faf0 2024-03-30T13:14:00.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0aa45f5740 1 -- 172.21.15.99:0/2274377455 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a94006d10 con 0x560046b3faf0 2024-03-30T13:14:00.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0a7fe00640 1 -- 172.21.15.99:0/2274377455 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0a9402d050 con 0x560046b3faf0 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0aa45f5740 10 client.5961 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.045+0000 7f0aa45f5740 1 -- 172.21.15.99:0/2274377455 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x560046b4bcb0 con 0x560046b3faf0 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.046+0000 7f0a7fe00640 1 -- 172.21.15.99:0/2274377455 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a94006d10 con 0x560046b3faf0 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.046+0000 7f0a7fe00640 1 -- 172.21.15.99:0/2274377455 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f0a94030020 con 0x560046b3faf0 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.046+0000 7f0aa45f5740 10 client.5961 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.046+0000 7f0aa45f5740 10 client.5961 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.046+0000 7f0aa45f5740 20 client.5961 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.046+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/2274377455 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560046b87d90 0x560046b881a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.046+0000 7f0aa45f5740 4 client.5961 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628372}] 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.046+0000 7f0aa45f5740 1 -- 172.21.15.99:0/2274377455 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628372}) -- 0x560046a8bbc0 con 0x560046b87d90 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.046+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/2274377455 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560046b87d90 0x560046b881a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.047+0000 7f0a9aa00640 1 --2- 172.21.15.99:0/2274377455 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560046b87d90 0x560046b881a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d06a67aeb1ec8a2 server_cookie=ddd706c728a38036 in_seq=0 out_seq=0 2024-03-30T13:14:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.047+0000 7f0a7fe00640 10 client.5961 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.048+0000 7f0a7fe00640 1 -- 172.21.15.99:0/2274377455 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4775 (crc 0 0 0) 0x560046a8bbc0 con 0x560046b87d90 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.048+0000 7f0a7fe00640 10 client.5961 handle_command_reply: tid=0 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.048+0000 7f0aa45f5740 1 client.5961 shutdown 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.048+0000 7f0aa45f5740 1 -- 172.21.15.99:0/2274377455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 msgr2=0x560046b87850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.048+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/2274377455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b87850 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400f6c0 tx=0x7f0a94003a70 comp rx=0 tx=0).stop 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa45f5740 1 -- 172.21.15.99:0/2274377455 shutdown_connections 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/2274377455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560046b3faf0 0x560046b87850 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/2274377455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560046b21670 0x560046b5bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/2274377455 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560046b87d90 0x560046b881a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa45f5740 1 --2- 172.21.15.99:0/2274377455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560046b21290 0x560046b4ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa45f5740 1 -- 172.21.15.99:0/2274377455 >> 172.21.15.99:0/2274377455 conn(0x560046ae7be0 msgr2=0x560046b4e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0a7fe00640 0 client.5961 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa45f5740 1 -- 172.21.15.99:0/2274377455 shutdown_connections 2024-03-30T13:14:00.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa45f5740 1 -- 172.21.15.99:0/2274377455 wait complete. 2024-03-30T13:14:00.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa45f5740 20 client.5961 trim_cache size 0 max 16384 2024-03-30T13:14:00.056 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:00.056 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ceph/io.h", 2024-03-30T13:14:00.056 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628372, 2024-03-30T13:14:00.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:00.056 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.521949+0000", 2024-03-30T13:14:00.056 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.544878+0000", 2024-03-30T13:14:00.056 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:00.057 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 387, 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.544878+0000", 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:00.058 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.059 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 387, 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:00.060 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.521949+0000" 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 387, 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.521949+0000" 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 284, 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 30, 2024-03-30T13:14:00.061 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.063 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:00.064 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyrstat": 0, 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.065 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.067 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.068 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.069 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:00.071 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:00.071 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:00.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.071 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.071 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:00.071 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:00.071 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:00.071 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:00.071 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa1a00640 1 -- 172.21.15.99:0/3779372045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0a7806c530 msgr2=0x7f0a7806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa1a00640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0a7806c530 0x7f0a7806e9f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c036000 tx=0x7f0a8c008030 comp rx=0 tx=0).stop 2024-03-30T13:14:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa1a00640 1 -- 172.21.15.99:0/3779372045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0d1010 msgr2=0x7f0a9c156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.049+0000 7f0aa1a00640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0d1010 0x7f0a9c156f00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400c820 tx=0x7f0a8400cce0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.050+0000 7f0aa1a00640 1 -- 172.21.15.99:0/3779372045 shutdown_connections 2024-03-30T13:14:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.050+0000 7f0aa1a00640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0a7806c530 0x7f0a7806e9f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.050+0000 7f0aa1a00640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a9c0d3430 0x7f0a9c158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.050+0000 7f0aa1a00640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0d1010 0x7f0a9c156f00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.050+0000 7f0aa1a00640 1 --2- 172.21.15.99:0/3779372045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a9c0d0210 0x7f0a9c1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.050+0000 7f0aa1a00640 1 -- 172.21.15.99:0/3779372045 >> 172.21.15.99:0/3779372045 conn(0x7f0a9c08bfc0 msgr2=0x7f0a9c157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.050+0000 7f0aa1a00640 1 -- 172.21.15.99:0/3779372045 shutdown_connections 2024-03-30T13:14:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.050+0000 7f0aa1a00640 1 -- 172.21.15.99:0/3779372045 wait complete. 2024-03-30T13:14:00.073 DEBUG:tasks.cephfs.test_uninlining:getting inode info #5 of 23:1099511628374 2024-03-30T13:14:00.073 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628374 2024-03-30T13:14:00.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628374 2024-03-30T13:14:00.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.276+0000 7fcec9a00640 1 Processor -- start 2024-03-30T13:14:00.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.277+0000 7fcec9a00640 1 -- start start 2024-03-30T13:14:00.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.278+0000 7fcec9a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcec4162e50 0x7fcec4099730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.278+0000 7fcec9a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcec40cddb0 0x7fcec40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.278+0000 7fcec9a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec40c56e0 con 0x7fcec4099c70 2024-03-30T13:14:00.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.278+0000 7fcec9a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fcec40c59c0 con 0x7fcec4162e50 2024-03-30T13:14:00.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.278+0000 7fcec9a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fcec40c5ca0 con 0x7fcec40cddb0 2024-03-30T13:14:00.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.278+0000 7fcec2a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcec4162e50 0x7fcec4099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.279+0000 7fcec2a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcec4162e50 0x7fcec4099730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54986/0 (socket says 172.21.15.99:54986) 2024-03-30T13:14:00.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.279+0000 7fcec2a00640 1 -- 172.21.15.99:0/467489862 learned_addr learned my addr 172.21.15.99:0/467489862 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.279+0000 7fcec2a00640 1 -- 172.21.15.99:0/467489862 >> v2:172.21.15.181:3300/0 conn(0x7fcec40cddb0 msgr2=0x7fcec40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.279+0000 7fcec2a00640 1 --2- 172.21.15.99:0/467489862 >> v2:172.21.15.181:3300/0 conn(0x7fcec40cddb0 0x7fcec40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.279+0000 7fcec2a00640 1 -- 172.21.15.99:0/467489862 >> v1:172.21.15.181:6789/0 conn(0x7fcec4099c70 legacy=0x7fcec40c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.279+0000 7fcec2a00640 1 -- 172.21.15.99:0/467489862 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec40c5f80 con 0x7fcec4162e50 2024-03-30T13:14:00.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.280+0000 7fcec2a00640 1 --2- 172.21.15.99:0/467489862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec4162e50 0x7fcec4099730 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fcec4071690 tx=0x7fceb402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539cbb7d5f40c724 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.280+0000 7fcec2000640 1 -- 172.21.15.99:0/467489862 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb402e070 con 0x7fcec4162e50 2024-03-30T13:14:00.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.280+0000 7fcec2000640 1 -- 172.21.15.99:0/467489862 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb4037070 con 0x7fcec4162e50 2024-03-30T13:14:00.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.280+0000 7fcec2000640 1 -- 172.21.15.99:0/467489862 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4031a00 con 0x7fcec4162e50 2024-03-30T13:14:00.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.281+0000 7fcec9a00640 1 -- 172.21.15.99:0/467489862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec4162e50 msgr2=0x7fcec4099730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.281+0000 7fcec9a00640 1 --2- 172.21.15.99:0/467489862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec4162e50 0x7fcec4099730 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fcec4071690 tx=0x7fceb402b880 comp rx=0 tx=0).stop 2024-03-30T13:14:00.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.281+0000 7fcec9a00640 1 -- 172.21.15.99:0/467489862 shutdown_connections 2024-03-30T13:14:00.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.281+0000 7fcec9a00640 1 --2- 172.21.15.99:0/467489862 >> v2:172.21.15.181:3300/0 conn(0x7fcec40cddb0 0x7fcec40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.281+0000 7fcec9a00640 1 --2- 172.21.15.99:0/467489862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec4162e50 0x7fcec4099730 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.281+0000 7fcec9a00640 1 -- 172.21.15.99:0/467489862 >> 172.21.15.99:0/467489862 conn(0x7fcec40d0450 msgr2=0x7fcec40d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.281+0000 7fcec9a00640 1 -- 172.21.15.99:0/467489862 shutdown_connections 2024-03-30T13:14:00.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.281+0000 7fcec9a00640 1 -- 172.21.15.99:0/467489862 wait complete. 2024-03-30T13:14:00.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.283+0000 7fcec9a00640 1 Processor -- start 2024-03-30T13:14:00.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.283+0000 7fcec9a00640 1 -- start start 2024-03-30T13:14:00.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.284+0000 7fcec9a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec4099c70 0x7fcec41fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.284+0000 7fcec9a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40cddb0 0x7fcec40c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.284+0000 7fcec9a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcec4162e50 0x7fcec40c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.284+0000 7fcec9a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcec40cfd70 con 0x7fcec40cddb0 2024-03-30T13:14:00.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.284+0000 7fcec9a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcec40c6e90 con 0x7fcec4099c70 2024-03-30T13:14:00.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.284+0000 7fcec9a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcec40cfef0 con 0x7fcec4162e50 2024-03-30T13:14:00.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.284+0000 7fcebbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40cddb0 0x7fcec40c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.284+0000 7fcebbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40cddb0 0x7fcec40c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54990/0 (socket says 172.21.15.99:54990) 2024-03-30T13:14:00.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.284+0000 7fcebbe00640 1 -- 172.21.15.99:0/2670113310 learned_addr learned my addr 172.21.15.99:0/2670113310 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.285+0000 7fcec3400640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcec4162e50 0x7fcec40c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.285+0000 7fcec2a00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec4099c70 0x7fcec41fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.285+0000 7fcebbe00640 1 -- 172.21.15.99:0/2670113310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcec4162e50 msgr2=0x7fcec40c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.285+0000 7fcebbe00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcec4162e50 0x7fcec40c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.285+0000 7fcebbe00640 1 -- 172.21.15.99:0/2670113310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec4099c70 msgr2=0x7fcec41fba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.285+0000 7fcebbe00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec4099c70 0x7fcec41fba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.285+0000 7fcebbe00640 1 -- 172.21.15.99:0/2670113310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec4161290 con 0x7fcec40cddb0 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.285+0000 7fcebbe00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40cddb0 0x7fcec40c72b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c430 tx=0x7fceac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.285+0000 7fcebaa00640 1 -- 172.21.15.99:0/2670113310 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac017070 con 0x7fcec40cddb0 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.285+0000 7fcebaa00640 1 -- 172.21.15.99:0/2670113310 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac0035f0 con 0x7fcec40cddb0 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.285+0000 7fcec9a00640 1 -- 172.21.15.99:0/2670113310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec4161570 con 0x7fcec40cddb0 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.286+0000 7fcebaa00640 1 -- 172.21.15.99:0/2670113310 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac0039e0 con 0x7fcec40cddb0 2024-03-30T13:14:00.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.286+0000 7fcec9a00640 1 -- 172.21.15.99:0/2670113310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec4161b30 con 0x7fcec40cddb0 2024-03-30T13:14:00.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.289+0000 7fcebaa00640 1 -- 172.21.15.99:0/2670113310 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fceac01a070 con 0x7fcec40cddb0 2024-03-30T13:14:00.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.290+0000 7fcebaa00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcea006c530 0x7fcea006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.290+0000 7fcebaa00640 1 -- 172.21.15.99:0/2670113310 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fceac08a9f0 con 0x7fcec40cddb0 2024-03-30T13:14:00.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.290+0000 7fcec2a00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcea006c530 0x7fcea006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.290+0000 7fcecc7fe740 1 Processor -- start 2024-03-30T13:14:00.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.290+0000 7fcecc7fe740 1 -- start start 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.291+0000 7fcec2a00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcea006c530 0x7fcea006e9f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fceb4036000 tx=0x7fceb403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.291+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x559303629dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.291+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55930362a300 0x5593036022d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.291+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x559303602810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.291+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559303566330 con 0x559303603670 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.291+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55930350e620 con 0x55930362a300 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.291+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x559303562440 con 0x559303603290 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.291+0000 7fcec3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x559303602810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.291+0000 7fcec3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x559303602810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55002/0 (socket says 172.21.15.99:55002) 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.291+0000 7fcec3400640 1 -- 172.21.15.99:0/1607175661 learned_addr learned my addr 172.21.15.99:0/1607175661 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.292+0000 7fcec2a00640 1 --2- 172.21.15.99:0/1607175661 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x559303629dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.292+0000 7fcebbe00640 1 --2- 172.21.15.99:0/1607175661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55930362a300 0x5593036022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.292+0000 7fcec3400640 1 -- 172.21.15.99:0/1607175661 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 msgr2=0x559303629dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.292+0000 7fcec3400640 1 --2- 172.21.15.99:0/1607175661 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x559303629dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.292+0000 7fcec3400640 1 -- 172.21.15.99:0/1607175661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55930362a300 msgr2=0x5593036022d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.292+0000 7fcec3400640 1 --2- 172.21.15.99:0/1607175661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55930362a300 0x5593036022d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.292+0000 7fcec3400640 1 -- 172.21.15.99:0/1607175661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559303346920 con 0x559303603670 2024-03-30T13:14:00.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.292+0000 7fcec3400640 1 --2- 172.21.15.99:0/1607175661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x559303602810 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009f20 tx=0x7fcebc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabb4d2c52a5e7b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.292+0000 7fceb3400640 1 -- 172.21.15.99:0/1607175661 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc01a070 con 0x559303603670 2024-03-30T13:14:00.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.292+0000 7fceb3400640 1 -- 172.21.15.99:0/1607175661 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc015410 con 0x559303603670 2024-03-30T13:14:00.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.292+0000 7fceb3400640 1 -- 172.21.15.99:0/1607175661 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc015800 con 0x559303603670 2024-03-30T13:14:00.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.293+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1607175661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 msgr2=0x559303602810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.293+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/1607175661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x559303602810 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009f20 tx=0x7fcebc00c8b0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.293+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1607175661 shutdown_connections 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.293+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/1607175661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x559303602810 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.293+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/1607175661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55930362a300 0x5593036022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.293+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/1607175661 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x559303629dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.293+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1607175661 >> 172.21.15.99:0/1607175661 conn(0x5593035c9be0 msgr2=0x559303647fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.293+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1607175661 shutdown_connections 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.293+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1607175661 wait complete. 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.294+0000 7fcecc7fe740 1 -- start start 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.294+0000 7fcecc7fe740 1 Processor -- start 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.295+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x5593036480c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.295+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303603670 0x559303648600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.295+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303621070 0x559303649cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.295+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559303629930 con 0x559303621070 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.295+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5593035219d0 con 0x559303603670 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.295+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5593036226b0 con 0x559303603290 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.295+0000 7fcecc7fe740 10 client.0 _ll_register_callbacks cb 0x55930355dfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.295+0000 7fcec3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303621070 0x559303649cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.295+0000 7fcec3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303621070 0x559303649cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55014/0 (socket says 172.21.15.99:55014) 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.295+0000 7fcec3400640 1 -- 172.21.15.99:0/889659010 learned_addr learned my addr 172.21.15.99:0/889659010 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcec2a00640 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x5593036480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcec3400640 1 -- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 msgr2=0x5593036480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcec3400640 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x5593036480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcec3400640 1 -- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303603670 msgr2=0x559303648600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcec3400640 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303603670 0x559303648600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcec3400640 1 -- 172.21.15.99:0/889659010 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55930323a210 con 0x559303621070 2024-03-30T13:14:00.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcec2a00640 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x5593036480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcec3400640 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303621070 0x559303649cb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x559303631670 tx=0x7fcebc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20234948d8b3ecb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcea7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:00.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcea7e00640 1 -- 172.21.15.99:0/889659010 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc026060 con 0x559303621070 2024-03-30T13:14:00.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcecc7fe740 1 -- 172.21.15.99:0/889659010 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcebc015410 con 0x559303621070 2024-03-30T13:14:00.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.296+0000 7fcea7e00640 1 -- 172.21.15.99:0/889659010 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fcebc01f640 con 0x559303621070 2024-03-30T13:14:00.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.297+0000 7fcea7e00640 1 -- 172.21.15.99:0/889659010 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcebc02c050 con 0x559303621070 2024-03-30T13:14:00.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.297+0000 7fcecc7fe740 10 client.5973 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:00.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.297+0000 7fcecc7fe740 1 -- 172.21.15.99:0/889659010 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5593033a70b0 con 0x559303621070 2024-03-30T13:14:00.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.297+0000 7fcea7e00640 1 -- 172.21.15.99:0/889659010 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc015410 con 0x559303621070 2024-03-30T13:14:00.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.297+0000 7fcea7e00640 1 -- 172.21.15.99:0/889659010 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fcebc02f020 con 0x559303621070 2024-03-30T13:14:00.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.297+0000 7fcecc7fe740 10 client.5973 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:00.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.297+0000 7fcecc7fe740 10 client.5973 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:00.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.297+0000 7fcecc7fe740 20 client.5973 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:00.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.297+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55930364a6c0 0x559303646030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.297+0000 7fcecc7fe740 4 client.5973 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:00.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.297+0000 7fcecc7fe740 1 -- 172.21.15.99:0/889659010 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559303573870 con 0x55930364a6c0 2024-03-30T13:14:00.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.298+0000 7fcec2a00640 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55930364a6c0 0x559303646030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.299+0000 7fcec2a00640 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55930364a6c0 0x559303646030 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed9298b2b08740ec server_cookie=b7a5436a2747c5da in_seq=0 out_seq=0 2024-03-30T13:14:00.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.299+0000 7fcea7e00640 10 client.5973 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.300+0000 7fcea7e00640 1 -- 172.21.15.99:0/889659010 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x559303573870 con 0x55930364a6c0 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.300+0000 7fcea7e00640 10 client.5973 handle_command_reply: tid=0 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.300+0000 7fcecc7fe740 1 client.5973 shutdown 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcecc7fe740 1 -- 172.21.15.99:0/889659010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303621070 msgr2=0x559303649cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303621070 0x559303649cb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x559303631670 tx=0x7fcebc004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcecc7fe740 1 -- 172.21.15.99:0/889659010 shutdown_connections 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303621070 0x559303649cb0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55930364a6c0 0x559303646030 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303603670 0x559303648600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/889659010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x5593036480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcecc7fe740 1 -- 172.21.15.99:0/889659010 >> 172.21.15.99:0/889659010 conn(0x5593035c9be0 msgr2=0x55930362ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcea7e00640 0 client.5973 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcecc7fe740 1 -- 172.21.15.99:0/889659010 shutdown_connections 2024-03-30T13:14:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcecc7fe740 1 -- 172.21.15.99:0/889659010 wait complete. 2024-03-30T13:14:00.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.301+0000 7fcecc7fe740 20 client.5973 trim_cache size 0 max 16384 2024-03-30T13:14:00.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.317+0000 7fcecc7fe740 1 Processor -- start 2024-03-30T13:14:00.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.317+0000 7fcecc7fe740 1 -- start start 2024-03-30T13:14:00.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603290 0x559303601810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303603670 0x55930362ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303621070 0x55930362b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4205240 con 0x559303603290 2024-03-30T13:14:00.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcec42042c0 con 0x559303603670 2024-03-30T13:14:00.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcec42036b0 con 0x559303621070 2024-03-30T13:14:00.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcec2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603290 0x559303601810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcec2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603290 0x559303601810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55028/0 (socket says 172.21.15.99:55028) 2024-03-30T13:14:00.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcec2a00640 1 -- 172.21.15.99:0/823675186 learned_addr learned my addr 172.21.15.99:0/823675186 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcec3400640 1 --2- 172.21.15.99:0/823675186 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303621070 0x55930362b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcebbe00640 1 --2- 172.21.15.99:0/823675186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303603670 0x55930362ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcec2a00640 1 -- 172.21.15.99:0/823675186 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303621070 msgr2=0x55930362b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcec2a00640 1 --2- 172.21.15.99:0/823675186 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303621070 0x55930362b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcec2a00640 1 -- 172.21.15.99:0/823675186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303603670 msgr2=0x55930362ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcec2a00640 1 --2- 172.21.15.99:0/823675186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303603670 0x55930362ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.318+0000 7fcec2a00640 1 -- 172.21.15.99:0/823675186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593032132d0 con 0x559303603290 2024-03-30T13:14:00.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.319+0000 7fcec2a00640 1 --2- 172.21.15.99:0/823675186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603290 0x559303601810 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fceb4034040 tx=0x7fceb4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e8ca17d2b50e24 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.319+0000 7fceb2a00640 1 -- 172.21.15.99:0/823675186 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4059070 con 0x559303603290 2024-03-30T13:14:00.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.319+0000 7fceb2a00640 1 -- 172.21.15.99:0/823675186 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb4037040 con 0x559303603290 2024-03-30T13:14:00.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.319+0000 7fceb2a00640 1 -- 172.21.15.99:0/823675186 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4054170 con 0x559303603290 2024-03-30T13:14:00.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.320+0000 7fcecc7fe740 1 -- 172.21.15.99:0/823675186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603290 msgr2=0x559303601810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.320+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/823675186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603290 0x559303601810 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fceb4034040 tx=0x7fceb4030000 comp rx=0 tx=0).stop 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.320+0000 7fcecc7fe740 1 -- 172.21.15.99:0/823675186 shutdown_connections 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.320+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/823675186 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303621070 0x55930362b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.320+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/823675186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303603670 0x55930362ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.320+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/823675186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603290 0x559303601810 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.320+0000 7fcecc7fe740 1 -- 172.21.15.99:0/823675186 >> 172.21.15.99:0/823675186 conn(0x5593035c9be0 msgr2=0x55930363f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.320+0000 7fcecc7fe740 1 -- 172.21.15.99:0/823675186 shutdown_connections 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.320+0000 7fcecc7fe740 1 -- 172.21.15.99:0/823675186 wait complete. 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.320+0000 7fcecc7fe740 1 -- start start 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.321+0000 7fcecc7fe740 1 Processor -- start 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x559303644170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x5593036446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcecc7fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303621070 0x55930362ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559303657560 con 0x559303603670 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4203ca0 con 0x559303621070 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcecc7fe740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x559303657080 con 0x559303603290 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcecc7fe740 10 client.0 _ll_register_callbacks cb 0x7fcebc018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcebbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x5593036446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcebbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x5593036446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55036/0 (socket says 172.21.15.99:55036) 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcebbe00640 1 -- 172.21.15.99:0/1076181414 learned_addr learned my addr 172.21.15.99:0/1076181414 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcebbe00640 1 -- 172.21.15.99:0/1076181414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 msgr2=0x559303644170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcec2a00640 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x559303644170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcebbe00640 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x559303644170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcebbe00640 1 -- 172.21.15.99:0/1076181414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303621070 msgr2=0x55930362ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcebbe00640 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303621070 0x55930362ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.322+0000 7fcebbe00640 1 -- 172.21.15.99:0/1076181414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593036a8c60 con 0x559303603670 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcebbe00640 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x5593036446b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fceac060fd0 tx=0x7fceac0589d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b12cf24538837b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcea7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcea7e00640 1 -- 172.21.15.99:0/1076181414 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac05de60 con 0x559303603670 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcea7e00640 1 -- 172.21.15.99:0/1076181414 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fceac003b80 con 0x559303603670 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1076181414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fceb4037040 con 0x559303603670 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcea7e00640 1 -- 172.21.15.99:0/1076181414 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fceac061500 con 0x559303603670 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcecc7fe740 10 client.5979 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1076181414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55930363da70 con 0x559303603670 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcea7e00640 1 -- 172.21.15.99:0/1076181414 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb4037040 con 0x559303603670 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcea7e00640 1 -- 172.21.15.99:0/1076181414 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fceac057e20 con 0x559303603670 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcecc7fe740 10 client.5979 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcecc7fe740 10 client.5979 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcecc7fe740 20 client.5979 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:00.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55930362b060 0x559303646150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcecc7fe740 4 client.5979 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628374}] 2024-03-30T13:14:00.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.323+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1076181414 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628374}) -- 0x55930356dbc0 con 0x55930362b060 2024-03-30T13:14:00.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.324+0000 7fcec2a00640 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55930362b060 0x559303646150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.325+0000 7fcec2a00640 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55930362b060 0x559303646150 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff719ac3790c9f2b server_cookie=e3255f7b48ad45af in_seq=0 out_seq=0 2024-03-30T13:14:00.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.325+0000 7fcea7e00640 10 client.5979 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcea7e00640 1 -- 172.21.15.99:0/1076181414 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4781 (crc 0 0 0) 0x55930356dbc0 con 0x55930362b060 2024-03-30T13:14:00.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcea7e00640 10 client.5979 handle_command_reply: tid=0 2024-03-30T13:14:00.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 1 client.5979 shutdown 2024-03-30T13:14:00.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1076181414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 msgr2=0x5593036446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x5593036446b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fceac060fd0 tx=0x7fceac0589d0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1076181414 shutdown_connections 2024-03-30T13:14:00.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55930362b060 0x559303646150 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559303621070 0x55930362ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559303603670 0x5593036446b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 1 --2- 172.21.15.99:0/1076181414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559303603290 0x559303644170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1076181414 >> 172.21.15.99:0/1076181414 conn(0x5593035c9be0 msgr2=0x559303656710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcea7e00640 0 client.5979 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1076181414 shutdown_connections 2024-03-30T13:14:00.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 1 -- 172.21.15.99:0/1076181414 wait complete. 2024-03-30T13:14:00.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.326+0000 7fcecc7fe740 20 client.5979 trim_cache size 0 max 16384 2024-03-30T13:14:00.333 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:00.333 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ceph/ioctl.h", 2024-03-30T13:14:00.333 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628374, 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.525076+0000", 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.549877+0000", 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:00.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 3724, 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:00.335 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.549877+0000", 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:00.336 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:00.337 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3724, 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.525076+0000" 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3724, 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:00.338 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.525076+0000" 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 286, 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 34, 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:00.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:00.341 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.342 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:00.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.342 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:00.342 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:00.342 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:00.342 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:00.342 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:00.342 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:00.342 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:00.342 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:00.342 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyrstat": 0, 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.343 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.344 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.344 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.344 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.344 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:00.344 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.344 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:00.344 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.344 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.344 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.345 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.346 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.348 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:00.349 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.350 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.350 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:00.350 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:00.350 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:00.350 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:00.350 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:00.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 -- 172.21.15.99:0/2670113310 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcea006c530 msgr2=0x7fcea006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcea006c530 0x7fcea006e9f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fceb4036000 tx=0x7fceb403d040 comp rx=0 tx=0).stop 2024-03-30T13:14:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 -- 172.21.15.99:0/2670113310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40cddb0 msgr2=0x7fcec40c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40cddb0 0x7fcec40c72b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c430 tx=0x7fceac00c8f0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 -- 172.21.15.99:0/2670113310 shutdown_connections 2024-03-30T13:14:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcea006c530 0x7fcea006e9f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcec4162e50 0x7fcec40c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40cddb0 0x7fcec40c72b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 --2- 172.21.15.99:0/2670113310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcec4099c70 0x7fcec41fba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 -- 172.21.15.99:0/2670113310 >> 172.21.15.99:0/2670113310 conn(0x7fcec40d0450 msgr2=0x7fcec406e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 -- 172.21.15.99:0/2670113310 shutdown_connections 2024-03-30T13:14:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.327+0000 7fcec9a00640 1 -- 172.21.15.99:0/2670113310 wait complete. 2024-03-30T13:14:00.353 DEBUG:tasks.cephfs.test_uninlining:getting inode info #6 of 23:1099511628386 2024-03-30T13:14:00.353 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628386 2024-03-30T13:14:00.353 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628386 2024-03-30T13:14:00.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.560+0000 7f4e7cc00640 1 Processor -- start 2024-03-30T13:14:00.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.560+0000 7f4e7cc00640 1 -- start start 2024-03-30T13:14:00.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.561+0000 7f4e7cc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4e780c6780 0x7f4e780c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.561+0000 7f4e7cc00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4e780cddb0 0x7f4e780ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.561+0000 7f4e7cc00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e780c56e0 con 0x7f4e78162e50 2024-03-30T13:14:00.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.562+0000 7f4e7cc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4e780c59c0 con 0x7f4e780c6780 2024-03-30T13:14:00.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.562+0000 7f4e7cc00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4e780c5ca0 con 0x7f4e780cddb0 2024-03-30T13:14:00.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.562+0000 7f4e6d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4e780c6780 0x7f4e780c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.562+0000 7f4e6d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4e780c6780 0x7f4e780c6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55048/0 (socket says 172.21.15.99:55048) 2024-03-30T13:14:00.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.562+0000 7f4e6d400640 1 -- 172.21.15.99:0/3032319006 learned_addr learned my addr 172.21.15.99:0/3032319006 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.562+0000 7f4e76800640 1 --2- 172.21.15.99:0/3032319006 >> v2:172.21.15.181:3300/0 conn(0x7f4e780cddb0 0x7f4e780ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.562+0000 7f4e6d400640 1 -- 172.21.15.99:0/3032319006 >> v2:172.21.15.181:3300/0 conn(0x7f4e780cddb0 msgr2=0x7f4e780ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.562+0000 7f4e6d400640 1 --2- 172.21.15.99:0/3032319006 >> v2:172.21.15.181:3300/0 conn(0x7f4e780cddb0 0x7f4e780ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.562+0000 7f4e6d400640 1 -- 172.21.15.99:0/3032319006 >> v1:172.21.15.181:6789/0 conn(0x7f4e78162e50 legacy=0x7f4e78099730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.562+0000 7f4e6d400640 1 -- 172.21.15.99:0/3032319006 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e780c5f80 con 0x7f4e780c6780 2024-03-30T13:14:00.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.563+0000 7f4e6d400640 1 --2- 172.21.15.99:0/3032319006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e780c6780 0x7f4e780c6be0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4e780ccca0 tx=0x7f4e6002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fe49197cec8660 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.564+0000 7f4e75400640 1 -- 172.21.15.99:0/3032319006 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60035020 con 0x7f4e780c6780 2024-03-30T13:14:00.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.564+0000 7f4e75400640 1 -- 172.21.15.99:0/3032319006 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60031870 con 0x7f4e780c6780 2024-03-30T13:14:00.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.564+0000 7f4e75400640 1 -- 172.21.15.99:0/3032319006 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60031c40 con 0x7f4e780c6780 2024-03-30T13:14:00.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.564+0000 7f4e7cc00640 1 -- 172.21.15.99:0/3032319006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e780c6780 msgr2=0x7f4e780c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.564+0000 7f4e7cc00640 1 --2- 172.21.15.99:0/3032319006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e780c6780 0x7f4e780c6be0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4e780ccca0 tx=0x7f4e6002b910 comp rx=0 tx=0).stop 2024-03-30T13:14:00.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.565+0000 7f4e7cc00640 1 -- 172.21.15.99:0/3032319006 shutdown_connections 2024-03-30T13:14:00.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.565+0000 7f4e7cc00640 1 --2- 172.21.15.99:0/3032319006 >> v2:172.21.15.181:3300/0 conn(0x7f4e780cddb0 0x7f4e780ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.565+0000 7f4e7cc00640 1 --2- 172.21.15.99:0/3032319006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e780c6780 0x7f4e780c6be0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.565+0000 7f4e7cc00640 1 -- 172.21.15.99:0/3032319006 >> 172.21.15.99:0/3032319006 conn(0x7f4e780d0450 msgr2=0x7f4e780d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.565+0000 7f4e7cc00640 1 -- 172.21.15.99:0/3032319006 shutdown_connections 2024-03-30T13:14:00.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.565+0000 7f4e7cc00640 1 -- 172.21.15.99:0/3032319006 wait complete. 2024-03-30T13:14:00.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.566+0000 7f4e7cc00640 1 Processor -- start 2024-03-30T13:14:00.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.566+0000 7f4e7cc00640 1 -- start start 2024-03-30T13:14:00.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.567+0000 7f4e7cc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e780c6780 0x7f4e7815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.567+0000 7f4e7cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e780cddb0 0x7f4e781593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.567+0000 7f4e7cc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e78162e50 0x7f4e7815e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.567+0000 7f4e7cc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780cfd70 con 0x7f4e780cddb0 2024-03-30T13:14:00.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.567+0000 7f4e7cc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4e78099e40 con 0x7f4e78162e50 2024-03-30T13:14:00.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.567+0000 7f4e7cc00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4e780cfef0 con 0x7f4e780c6780 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e6d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e780cddb0 0x7f4e781593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e6d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e780cddb0 0x7f4e781593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55052/0 (socket says 172.21.15.99:55052) 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e6d400640 1 -- 172.21.15.99:0/2180860384 learned_addr learned my addr 172.21.15.99:0/2180860384 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e76800640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e78162e50 0x7f4e7815e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e75e00640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e780c6780 0x7f4e7815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e6d400640 1 -- 172.21.15.99:0/2180860384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e780c6780 msgr2=0x7f4e7815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e6d400640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e780c6780 0x7f4e7815e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e6d400640 1 -- 172.21.15.99:0/2180860384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e78162e50 msgr2=0x7f4e7815e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e6d400640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e78162e50 0x7f4e7815e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e6d400640 1 -- 172.21.15.99:0/2180860384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7815f420 con 0x7f4e780cddb0 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e76800640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e78162e50 0x7f4e7815e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e75e00640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e780c6780 0x7f4e7815e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.568+0000 7f4e6d400640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e780cddb0 0x7f4e781593b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4e60000c00 tx=0x7f4e600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.569+0000 7f4e6ea00640 1 -- 172.21.15.99:0/2180860384 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6003ad60 con 0x7f4e780cddb0 2024-03-30T13:14:00.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.569+0000 7f4e6ea00640 1 -- 172.21.15.99:0/2180860384 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e600443f0 con 0x7f4e780cddb0 2024-03-30T13:14:00.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.569+0000 7f4e6ea00640 1 -- 172.21.15.99:0/2180860384 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600447e0 con 0x7f4e780cddb0 2024-03-30T13:14:00.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.569+0000 7f4e7cc00640 1 -- 172.21.15.99:0/2180860384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7815f140 con 0x7f4e780cddb0 2024-03-30T13:14:00.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.569+0000 7f4e7cc00640 1 -- 172.21.15.99:0/2180860384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7815d8b0 con 0x7f4e780cddb0 2024-03-30T13:14:00.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.571+0000 7f4e6ea00640 1 -- 172.21.15.99:0/2180860384 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4e6004b060 con 0x7f4e780cddb0 2024-03-30T13:14:00.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.572+0000 7f4e6ea00640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5406c530 0x7f4e5406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.572+0000 7f4e6ea00640 1 -- 172.21.15.99:0/2180860384 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4e600ada90 con 0x7f4e780cddb0 2024-03-30T13:14:00.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.572+0000 7f4e75e00640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5406c530 0x7f4e5406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.573+0000 7f4e7fa10740 1 Processor -- start 2024-03-30T13:14:00.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.573+0000 7f4e7fa10740 1 -- start start 2024-03-30T13:14:00.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.573+0000 7f4e75e00640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5406c530 0x7f4e5406e9f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4e68000f60 tx=0x7f4e68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298290 0x5644ad2bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2bf300 0x5644ad2972d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad298670 0x5644ad297810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5644ad1fb330 con 0x5644ad2bf300 2024-03-30T13:14:00.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5644ad1a3620 con 0x5644ad298290 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5644ad1f7440 con 0x5644ad298670 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e6d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2bf300 0x5644ad2972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e6d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2bf300 0x5644ad2972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55064/0 (socket says 172.21.15.99:55064) 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e6d400640 1 -- 172.21.15.99:0/1795285558 learned_addr learned my addr 172.21.15.99:0/1795285558 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e75e00640 1 --2- 172.21.15.99:0/1795285558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298290 0x5644ad2bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e76800640 1 --2- 172.21.15.99:0/1795285558 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad298670 0x5644ad297810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e6d400640 1 -- 172.21.15.99:0/1795285558 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad298670 msgr2=0x5644ad297810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e6d400640 1 --2- 172.21.15.99:0/1795285558 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad298670 0x5644ad297810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e6d400640 1 -- 172.21.15.99:0/1795285558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298290 msgr2=0x5644ad2bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e6d400640 1 --2- 172.21.15.99:0/1795285558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298290 0x5644ad2bedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.574+0000 7f4e6d400640 1 -- 172.21.15.99:0/1795285558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644acfdb920 con 0x5644ad2bf300 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.575+0000 7f4e6d400640 1 --2- 172.21.15.99:0/1795285558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2bf300 0x5644ad2972d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4e6007b820 tx=0x7f4e6007b2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63628c58284f47a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.575+0000 7f4e66600640 1 -- 172.21.15.99:0/1795285558 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6007fc40 con 0x5644ad2bf300 2024-03-30T13:14:00.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.575+0000 7f4e66600640 1 -- 172.21.15.99:0/1795285558 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60084470 con 0x5644ad2bf300 2024-03-30T13:14:00.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.575+0000 7f4e66600640 1 -- 172.21.15.99:0/1795285558 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600820c0 con 0x5644ad2bf300 2024-03-30T13:14:00.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.576+0000 7f4e7fa10740 1 -- 172.21.15.99:0/1795285558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2bf300 msgr2=0x5644ad2972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.576+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/1795285558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2bf300 0x5644ad2972d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4e6007b820 tx=0x7f4e6007b2b0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.576+0000 7f4e7fa10740 1 -- 172.21.15.99:0/1795285558 shutdown_connections 2024-03-30T13:14:00.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.576+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/1795285558 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad298670 0x5644ad297810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.576+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/1795285558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2bf300 0x5644ad2972d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.576+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/1795285558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298290 0x5644ad2bedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.576+0000 7f4e7fa10740 1 -- 172.21.15.99:0/1795285558 >> 172.21.15.99:0/1795285558 conn(0x5644ad25ebe0 msgr2=0x5644ad2dcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.576+0000 7f4e7fa10740 1 -- 172.21.15.99:0/1795285558 shutdown_connections 2024-03-30T13:14:00.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.576+0000 7f4e7fa10740 1 -- 172.21.15.99:0/1795285558 wait complete. 2024-03-30T13:14:00.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.577+0000 7f4e7fa10740 1 -- start start 2024-03-30T13:14:00.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.577+0000 7f4e7fa10740 1 Processor -- start 2024-03-30T13:14:00.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad2b6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad2c3b30 0x5644ad2b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5644ad1a3620 con 0x5644ad298290 2024-03-30T13:14:00.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5644ad1b69d0 con 0x5644ad298670 2024-03-30T13:14:00.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5644ad1fb330 con 0x5644ad2c3b30 2024-03-30T13:14:00.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e7fa10740 10 client.0 _ll_register_callbacks cb 0x5644ad1f2fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:00.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e75e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e75e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55068/0 (socket says 172.21.15.99:55068) 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e75e00640 1 -- 172.21.15.99:0/2090509555 learned_addr learned my addr 172.21.15.99:0/2090509555 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e6d400640 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad2b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e75e00640 1 -- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad2c3b30 msgr2=0x5644ad2b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e75e00640 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad2c3b30 0x5644ad2b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e75e00640 1 -- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 msgr2=0x5644ad2b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e75e00640 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad2b6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e75e00640 1 -- 172.21.15.99:0/2090509555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644acecf210 con 0x5644ad298290 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.578+0000 7f4e6d400640 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad2b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.579+0000 7f4e75e00640 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c6040 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800dd80 tx=0x7f4e68000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8772e9f474f214a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.579+0000 7f4e5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.579+0000 7f4e5aa00640 1 -- 172.21.15.99:0/2090509555 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68020420 con 0x5644ad298290 2024-03-30T13:14:00.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.579+0000 7f4e5aa00640 1 -- 172.21.15.99:0/2090509555 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4e680205c0 con 0x5644ad298290 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.579+0000 7f4e7fa10740 1 -- 172.21.15.99:0/2090509555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e60084470 con 0x5644ad298290 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.579+0000 7f4e5aa00640 1 -- 172.21.15.99:0/2090509555 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4e680207c0 con 0x5644ad298290 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.579+0000 7f4e7fa10740 10 client.5991 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.579+0000 7f4e7fa10740 1 -- 172.21.15.99:0/2090509555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5644ad03c0b0 con 0x5644ad298290 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.580+0000 7f4e5aa00640 1 -- 172.21.15.99:0/2090509555 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60084470 con 0x5644ad298290 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.580+0000 7f4e5aa00640 1 -- 172.21.15.99:0/2090509555 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f4e68031080 con 0x5644ad298290 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.580+0000 7f4e7fa10740 10 client.5991 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.580+0000 7f4e7fa10740 10 client.5991 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.580+0000 7f4e7fa10740 20 client.5991 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.580+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5644ad2d9810 0x5644ad2d4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.580+0000 7f4e7fa10740 4 client.5991 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.580+0000 7f4e7fa10740 1 -- 172.21.15.99:0/2090509555 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644ad208870 con 0x5644ad2d9810 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.581+0000 7f4e6d400640 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5644ad2d9810 0x5644ad2d4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.581+0000 7f4e6d400640 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5644ad2d9810 0x5644ad2d4750 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c49fcd0e1c22ca39 server_cookie=755c3b781f1c2b8 in_seq=0 out_seq=0 2024-03-30T13:14:00.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.581+0000 7f4e5aa00640 10 client.5991 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e5aa00640 1 -- 172.21.15.99:0/2090509555 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5644ad208870 con 0x5644ad2d9810 2024-03-30T13:14:00.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e5aa00640 10 client.5991 handle_command_reply: tid=0 2024-03-30T13:14:00.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e7fa10740 1 client.5991 shutdown 2024-03-30T13:14:00.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e7fa10740 1 -- 172.21.15.99:0/2090509555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 msgr2=0x5644ad2c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c6040 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800dd80 tx=0x7f4e68000ed0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e7fa10740 1 -- 172.21.15.99:0/2090509555 shutdown_connections 2024-03-30T13:14:00.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad2c3b30 0x5644ad2b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5644ad2d9810 0x5644ad2d4750 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad2b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/2090509555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c6040 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e5aa00640 0 client.5991 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.583+0000 7f4e7fa10740 1 -- 172.21.15.99:0/2090509555 >> 172.21.15.99:0/2090509555 conn(0x5644ad25ebe0 msgr2=0x5644ad2bff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.584+0000 7f4e7fa10740 1 -- 172.21.15.99:0/2090509555 shutdown_connections 2024-03-30T13:14:00.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.584+0000 7f4e7fa10740 1 -- 172.21.15.99:0/2090509555 wait complete. 2024-03-30T13:14:00.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.584+0000 7f4e7fa10740 20 client.5991 trim_cache size 0 max 16384 2024-03-30T13:14:00.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.599+0000 7f4e7fa10740 1 Processor -- start 2024-03-30T13:14:00.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.599+0000 7f4e7fa10740 1 -- start start 2024-03-30T13:14:00.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.600+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad298290 0x5644ad2d4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.600+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad2d54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.600+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2c3b30 0x5644ad2b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.600+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e78205210 con 0x5644ad2c3b30 2024-03-30T13:14:00.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.600+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780af5c0 con 0x5644ad298670 2024-03-30T13:14:00.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.600+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4e780ae920 con 0x5644ad298290 2024-03-30T13:14:00.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.601+0000 7f4e76800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2c3b30 0x5644ad2b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.601+0000 7f4e76800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2c3b30 0x5644ad2b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55074/0 (socket says 172.21.15.99:55074) 2024-03-30T13:14:00.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.601+0000 7f4e76800640 1 -- 172.21.15.99:0/3367970083 learned_addr learned my addr 172.21.15.99:0/3367970083 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.601+0000 7f4e75e00640 1 --2- 172.21.15.99:0/3367970083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad298290 0x5644ad2d4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.601+0000 7f4e6d400640 1 --2- 172.21.15.99:0/3367970083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad2d54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.601+0000 7f4e76800640 1 -- 172.21.15.99:0/3367970083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad298290 msgr2=0x5644ad2d4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.601+0000 7f4e76800640 1 --2- 172.21.15.99:0/3367970083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad298290 0x5644ad2d4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.601+0000 7f4e76800640 1 -- 172.21.15.99:0/3367970083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 msgr2=0x5644ad2d54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.601+0000 7f4e76800640 1 --2- 172.21.15.99:0/3367970083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad2d54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.601+0000 7f4e76800640 1 -- 172.21.15.99:0/3367970083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644acea82d0 con 0x5644ad2c3b30 2024-03-30T13:14:00.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.601+0000 7f4e76800640 1 --2- 172.21.15.99:0/3367970083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2c3b30 0x5644ad2b43c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009e50 tx=0x7f4e7000e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e76c990177c9cc4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.602+0000 7f4e65c00640 1 -- 172.21.15.99:0/3367970083 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000c860 con 0x5644ad2c3b30 2024-03-30T13:14:00.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.602+0000 7f4e65c00640 1 -- 172.21.15.99:0/3367970083 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7000ca20 con 0x5644ad2c3b30 2024-03-30T13:14:00.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.602+0000 7f4e65c00640 1 -- 172.21.15.99:0/3367970083 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000ce10 con 0x5644ad2c3b30 2024-03-30T13:14:00.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.602+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3367970083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2c3b30 msgr2=0x5644ad2b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.602+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/3367970083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2c3b30 0x5644ad2b43c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009e50 tx=0x7f4e7000e7c0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.602+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3367970083 shutdown_connections 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.602+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/3367970083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad2c3b30 0x5644ad2b43c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.602+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/3367970083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad2d54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.602+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/3367970083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad298290 0x5644ad2d4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.602+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3367970083 >> 172.21.15.99:0/3367970083 conn(0x5644ad25ebe0 msgr2=0x5644ad28d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.602+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3367970083 shutdown_connections 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.603+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3367970083 wait complete. 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.603+0000 7f4e7fa10740 1 -- start start 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.603+0000 7f4e7fa10740 1 Processor -- start 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.604+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.604+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad33bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.604+0000 7f4e7fa10740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad2c3b30 0x5644ad2d4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.604+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780aef70 con 0x5644ad298290 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.604+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5644ad2c4160 con 0x5644ad298670 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.604+0000 7f4e7fa10740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5644ad2c3980 con 0x5644ad2c3b30 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.604+0000 7f4e7fa10740 10 client.0 _ll_register_callbacks cb 0x7f4e68001460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e75e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e75e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55088/0 (socket says 172.21.15.99:55088) 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e75e00640 1 -- 172.21.15.99:0/3524415674 learned_addr learned my addr 172.21.15.99:0/3524415674 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e6d400640 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad33bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e76800640 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad2c3b30 0x5644ad2d4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e75e00640 1 -- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad2c3b30 msgr2=0x5644ad2d4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e75e00640 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad2c3b30 0x5644ad2d4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e75e00640 1 -- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 msgr2=0x5644ad33bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e75e00640 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad33bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e75e00640 1 -- 172.21.15.99:0/3524415674 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644ad33c0a0 con 0x5644ad298290 2024-03-30T13:14:00.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e75e00640 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c3440 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4e68020650 tx=0x7f4e68012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b2a4e312059083 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.605+0000 7f4e5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:00.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e5aa00640 1 -- 172.21.15.99:0/3524415674 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68014c80 con 0x5644ad298290 2024-03-30T13:14:00.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e5aa00640 1 -- 172.21.15.99:0/3524415674 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f4e68001ce0 con 0x5644ad298290 2024-03-30T13:14:00.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3524415674 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e7000ca20 con 0x5644ad298290 2024-03-30T13:14:00.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e5aa00640 1 -- 172.21.15.99:0/3524415674 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4e68007240 con 0x5644ad298290 2024-03-30T13:14:00.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e7fa10740 10 client.5997 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3524415674 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5644ad2bd3f0 con 0x5644ad298290 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e5aa00640 1 -- 172.21.15.99:0/3524415674 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7000ca20 con 0x5644ad298290 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e5aa00640 1 -- 172.21.15.99:0/3524415674 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f4e68031070 con 0x5644ad298290 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e7fa10740 10 client.5997 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e7fa10740 10 client.5997 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e7fa10740 20 client.5997 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5644ad33b5d0 0x5644ad2bdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e7fa10740 4 client.5997 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628386}] 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.606+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3524415674 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628386}) -- 0x5644ad293760 con 0x5644ad33b5d0 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.607+0000 7f4e6d400640 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5644ad33b5d0 0x5644ad2bdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.608+0000 7f4e6d400640 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5644ad33b5d0 0x5644ad2bdb40 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=166498e4f351b9d1 server_cookie=c5456041065270a1 in_seq=0 out_seq=0 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.608+0000 7f4e5aa00640 10 client.5997 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e5aa00640 1 -- 172.21.15.99:0/3524415674 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4755 (crc 0 0 0) 0x5644ad293760 con 0x5644ad33b5d0 2024-03-30T13:14:00.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e5aa00640 10 client.5997 handle_command_reply: tid=0 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 1 client.5997 shutdown 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3524415674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 msgr2=0x5644ad2c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c3440 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4e68020650 tx=0x7f4e68012000 comp rx=0 tx=0).stop 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3524415674 shutdown_connections 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5644ad2c3b30 0x5644ad2d4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5644ad33b5d0 0x5644ad2bdb40 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644ad298670 0x5644ad33bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 1 --2- 172.21.15.99:0/3524415674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644ad298290 0x5644ad2c3440 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e5aa00640 0 client.5997 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3524415674 >> 172.21.15.99:0/3524415674 conn(0x5644ad25ebe0 msgr2=0x5644ad2bfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3524415674 shutdown_connections 2024-03-30T13:14:00.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 1 -- 172.21.15.99:0/3524415674 wait complete. 2024-03-30T13:14:00.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.609+0000 7f4e7fa10740 20 client.5997 trim_cache size 0 max 16384 2024-03-30T13:14:00.616 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:00.616 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/Kconfig", 2024-03-30T13:14:00.616 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628386, 2024-03-30T13:14:00.616 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:00.616 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.531714+0000", 2024-03-30T13:14:00.616 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.625876+0000", 2024-03-30T13:14:00.616 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:00.616 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:00.616 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.617 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1240, 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.625876+0000", 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:00.619 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1240, 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.531714+0000" 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1240, 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.531714+0000" 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 148, 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 2, 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:00.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:00.622 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:00.623 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:00.623 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:00.623 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:00.623 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:00.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.623 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:00.623 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:00.623 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:00.623 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:00.623 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.623 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:00.624 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:00.625 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.627 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.628 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:00.629 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:00.629 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:00.629 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.629 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.629 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:00.629 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.629 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.629 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.629 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.629 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:00.630 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:00.631 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:00.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.631 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.631 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:00.631 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:00.631 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:00.631 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:00.631 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:00.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 -- 172.21.15.99:0/2180860384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5406c530 msgr2=0x7f4e5406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5406c530 0x7f4e5406e9f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4e68000f60 tx=0x7f4e68009040 comp rx=0 tx=0).stop 2024-03-30T13:14:00.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 -- 172.21.15.99:0/2180860384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e780cddb0 msgr2=0x7f4e781593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e780cddb0 0x7f4e781593b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4e60000c00 tx=0x7f4e600046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 -- 172.21.15.99:0/2180860384 shutdown_connections 2024-03-30T13:14:00.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5406c530 0x7f4e5406e9f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e78162e50 0x7f4e7815e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e780cddb0 0x7f4e781593b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 --2- 172.21.15.99:0/2180860384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e780c6780 0x7f4e7815e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 -- 172.21.15.99:0/2180860384 >> 172.21.15.99:0/2180860384 conn(0x7f4e780d0450 msgr2=0x7f4e780b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 -- 172.21.15.99:0/2180860384 shutdown_connections 2024-03-30T13:14:00.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.610+0000 7f4e7cc00640 1 -- 172.21.15.99:0/2180860384 wait complete. 2024-03-30T13:14:00.634 DEBUG:tasks.cephfs.test_uninlining:getting inode info #7 of 23:1099511628404 2024-03-30T13:14:00.634 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628404 2024-03-30T13:14:00.634 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628404 2024-03-30T13:14:00.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.832+0000 7f1bd4c00640 1 Processor -- start 2024-03-30T13:14:00.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.832+0000 7f1bd4c00640 1 -- start start 2024-03-30T13:14:00.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.833+0000 7f1bd4c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1bd00cfde0 0x7f1bd00d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.833+0000 7f1bd4c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd015ed00 con 0x7f1bd015e920 2024-03-30T13:14:00.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.833+0000 7f1bd4c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd00d21e0 con 0x7f1bd00d0f90 2024-03-30T13:14:00.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.833+0000 7f1bd4c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd00d2480 con 0x7f1bd00cfde0 2024-03-30T13:14:00.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.834+0000 7f1bcd400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1bd00cfde0 0x7f1bd00d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.834+0000 7f1bcd400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1bd00cfde0 0x7f1bd00d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55104/0 (socket says 172.21.15.99:55104) 2024-03-30T13:14:00.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.834+0000 7f1bcd400640 1 -- 172.21.15.99:0/1276303220 learned_addr learned my addr 172.21.15.99:0/1276303220 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.834+0000 7f1bcde00640 1 --1- 172.21.15.99:0/1276303220 >> v1:172.21.15.99:6789/0 conn(0x7f1bd015e920 0x7f1bd00d3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33394/0 (socket says 172.21.15.99:33394) 2024-03-30T13:14:00.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.834+0000 7f1bcd400640 1 -- 172.21.15.99:0/1276303220 >> v1:172.21.15.181:6789/0 conn(0x7f1bd00d0f90 legacy=0x7f1bd006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.834+0000 7f1bcd400640 1 -- 172.21.15.99:0/1276303220 >> v1:172.21.15.99:6789/0 conn(0x7f1bd015e920 legacy=0x7f1bd00d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.834+0000 7f1bcd400640 1 -- 172.21.15.99:0/1276303220 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd00d2760 con 0x7f1bd00cfde0 2024-03-30T13:14:00.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.835+0000 7f1bcd400640 1 --2- 172.21.15.99:0/1276303220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd00cfde0 0x7f1bd00d0240 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009870 tx=0x7f1bb802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1290a9a1649f01e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.836+0000 7f1bcca00640 1 -- 172.21.15.99:0/1276303220 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8034070 con 0x7f1bd00cfde0 2024-03-30T13:14:00.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.836+0000 7f1bcca00640 1 -- 172.21.15.99:0/1276303220 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb8030850 con 0x7f1bd00cfde0 2024-03-30T13:14:00.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.836+0000 7f1bcca00640 1 -- 172.21.15.99:0/1276303220 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8030c20 con 0x7f1bd00cfde0 2024-03-30T13:14:00.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.836+0000 7f1bd4c00640 1 -- 172.21.15.99:0/1276303220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd00cfde0 msgr2=0x7f1bd00d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.836+0000 7f1bd4c00640 1 --2- 172.21.15.99:0/1276303220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd00cfde0 0x7f1bd00d0240 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009870 tx=0x7f1bb802b990 comp rx=0 tx=0).stop 2024-03-30T13:14:00.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.837+0000 7f1bd4c00640 1 -- 172.21.15.99:0/1276303220 shutdown_connections 2024-03-30T13:14:00.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.837+0000 7f1bd4c00640 1 --2- 172.21.15.99:0/1276303220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd00cfde0 0x7f1bd00d0240 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.837+0000 7f1bd4c00640 1 -- 172.21.15.99:0/1276303220 >> 172.21.15.99:0/1276303220 conn(0x7f1bd008bfc0 msgr2=0x7f1bd00d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.837+0000 7f1bd4c00640 1 -- 172.21.15.99:0/1276303220 shutdown_connections 2024-03-30T13:14:00.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.837+0000 7f1bd4c00640 1 -- 172.21.15.99:0/1276303220 wait complete. 2024-03-30T13:14:00.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.838+0000 7f1bd4c00640 1 Processor -- start 2024-03-30T13:14:00.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.838+0000 7f1bd4c00640 1 -- start start 2024-03-30T13:14:00.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.839+0000 7f1bd4c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1bd00cfde0 0x7f1bd01f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.839+0000 7f1bd4c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd00d0f90 0x7f1bd01e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.839+0000 7f1bd4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd015e920 0x7f1bd0154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.839+0000 7f1bd4c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd00d4ef0 con 0x7f1bd015e920 2024-03-30T13:14:00.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.839+0000 7f1bd4c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd00d2d20 con 0x7f1bd00d0f90 2024-03-30T13:14:00.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.839+0000 7f1bd4c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd00d5070 con 0x7f1bd00cfde0 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.839+0000 7f1bce800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd015e920 0x7f1bd0154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.840+0000 7f1bce800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd015e920 0x7f1bd0154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55110/0 (socket says 172.21.15.99:55110) 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.840+0000 7f1bce800640 1 -- 172.21.15.99:0/2599754781 learned_addr learned my addr 172.21.15.99:0/2599754781 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.840+0000 7f1bcde00640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1bd00cfde0 0x7f1bd01f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.840+0000 7f1bce800640 1 -- 172.21.15.99:0/2599754781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1bd00cfde0 msgr2=0x7f1bd01f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.840+0000 7f1bcd400640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd00d0f90 0x7f1bd01e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.840+0000 7f1bce800640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1bd00cfde0 0x7f1bd01f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.840+0000 7f1bce800640 1 -- 172.21.15.99:0/2599754781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd00d0f90 msgr2=0x7f1bd01e94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.840+0000 7f1bce800640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd00d0f90 0x7f1bd01e94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.840+0000 7f1bce800640 1 -- 172.21.15.99:0/2599754781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd01e8440 con 0x7f1bd015e920 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.840+0000 7f1bcde00640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1bd00cfde0 0x7f1bd01f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.840+0000 7f1bce800640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd015e920 0x7f1bd0154980 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c7b0 tx=0x7f1bc800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.841+0000 7f1bc6000640 1 -- 172.21.15.99:0/2599754781 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8004b60 con 0x7f1bd015e920 2024-03-30T13:14:00.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.841+0000 7f1bc6000640 1 -- 172.21.15.99:0/2599754781 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc8004d00 con 0x7f1bd015e920 2024-03-30T13:14:00.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.841+0000 7f1bc6000640 1 -- 172.21.15.99:0/2599754781 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800aa90 con 0x7f1bd015e920 2024-03-30T13:14:00.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.841+0000 7f1bd4c00640 1 -- 172.21.15.99:0/2599754781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd01e8720 con 0x7f1bd015e920 2024-03-30T13:14:00.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.841+0000 7f1bd4c00640 1 -- 172.21.15.99:0/2599754781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd01e8ce0 con 0x7f1bd015e920 2024-03-30T13:14:00.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.843+0000 7f1bc6000640 1 -- 172.21.15.99:0/2599754781 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1bc800ac30 con 0x7f1bd015e920 2024-03-30T13:14:00.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.844+0000 7f1bc6000640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1bac06c530 0x7f1bac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.844+0000 7f1bc6000640 1 -- 172.21.15.99:0/2599754781 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f1bc808ba60 con 0x7f1bd015e920 2024-03-30T13:14:00.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.844+0000 7f1bcde00640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1bac06c530 0x7f1bac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.844+0000 7f1bd79a1740 1 Processor -- start 2024-03-30T13:14:00.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.845+0000 7f1bd79a1740 1 -- start start 2024-03-30T13:14:00.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.845+0000 7f1bcde00640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1bac06c530 0x7f1bac06e9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0000f60 tx=0x7f1bc0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.845+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b515196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.845+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b515197300 0x55b51516f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.845+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170670 0x55b51516f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.845+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b5150d3330 con 0x55b515170290 2024-03-30T13:14:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.845+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b51507b620 con 0x55b515197300 2024-03-30T13:14:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.845+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b5150cf440 con 0x55b515170670 2024-03-30T13:14:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.846+0000 7f1bcde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b515196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.846+0000 7f1bcde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b515196dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55118/0 (socket says 172.21.15.99:55118) 2024-03-30T13:14:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.846+0000 7f1bcde00640 1 -- 172.21.15.99:0/3558967763 learned_addr learned my addr 172.21.15.99:0/3558967763 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.846+0000 7f1bcd400640 1 --2- 172.21.15.99:0/3558967763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b515197300 0x55b51516f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.846+0000 7f1bcde00640 1 -- 172.21.15.99:0/3558967763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170670 msgr2=0x55b51516f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.846+0000 7f1bcde00640 1 --2- 172.21.15.99:0/3558967763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170670 0x55b51516f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.846+0000 7f1bcde00640 1 -- 172.21.15.99:0/3558967763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b515197300 msgr2=0x55b51516f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.846+0000 7f1bcde00640 1 --2- 172.21.15.99:0/3558967763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b515197300 0x55b51516f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.846+0000 7f1bcde00640 1 -- 172.21.15.99:0/3558967763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b514eb3920 con 0x55b515170290 2024-03-30T13:14:00.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.846+0000 7f1bcd400640 1 --2- 172.21.15.99:0/3558967763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b515197300 0x55b51516f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.846+0000 7f1bcde00640 1 --2- 172.21.15.99:0/3558967763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b515196dc0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0007500 tx=0x7f1bc0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3618d08056145a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.847+0000 7f1bbe600640 1 -- 172.21.15.99:0/3558967763 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000da20 con 0x55b515170290 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.847+0000 7f1bbe600640 1 -- 172.21.15.99:0/3558967763 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc000dbc0 con 0x55b515170290 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.847+0000 7f1bbe600640 1 -- 172.21.15.99:0/3558967763 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0020450 con 0x55b515170290 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.847+0000 7f1bd79a1740 1 -- 172.21.15.99:0/3558967763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 msgr2=0x55b515196dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.847+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/3558967763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b515196dc0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0007500 tx=0x7f1bc0010000 comp rx=0 tx=0).stop 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.847+0000 7f1bd79a1740 1 -- 172.21.15.99:0/3558967763 shutdown_connections 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.847+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/3558967763 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170670 0x55b51516f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.847+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/3558967763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b515197300 0x55b51516f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.847+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/3558967763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b515196dc0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.847+0000 7f1bd79a1740 1 -- 172.21.15.99:0/3558967763 >> 172.21.15.99:0/3558967763 conn(0x55b515136be0 msgr2=0x55b5151b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.848+0000 7f1bd79a1740 1 -- 172.21.15.99:0/3558967763 shutdown_connections 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.848+0000 7f1bd79a1740 1 -- 172.21.15.99:0/3558967763 wait complete. 2024-03-30T13:14:00.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.848+0000 7f1bd79a1740 1 -- start start 2024-03-30T13:14:00.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.848+0000 7f1bd79a1740 1 Processor -- start 2024-03-30T13:14:00.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.849+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b51518dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.849+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170670 0x55b5151b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.849+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5151c8020 0x55b5151b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.849+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b515196930 con 0x55b515170290 2024-03-30T13:14:00.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.849+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b51508e9d0 con 0x55b5151c8020 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.849+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b51518f6b0 con 0x55b515170670 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.849+0000 7f1bd79a1740 10 client.0 _ll_register_callbacks cb 0x55b5150cafd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bcde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b51518dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bcde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b51518dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55120/0 (socket says 172.21.15.99:55120) 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bcde00640 1 -- 172.21.15.99:0/1427812804 learned_addr learned my addr 172.21.15.99:0/1427812804 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bcd400640 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170670 0x55b5151b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bce800640 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5151c8020 0x55b5151b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bcde00640 1 -- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170670 msgr2=0x55b5151b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bcde00640 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170670 0x55b5151b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bcde00640 1 -- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5151c8020 msgr2=0x55b5151b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bcde00640 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5151c8020 0x55b5151b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bcde00640 1 -- 172.21.15.99:0/1427812804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b514da7210 con 0x55b515170290 2024-03-30T13:14:00.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bcde00640 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b51518dd10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009010 tx=0x7f1bc0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e02fb00d362412 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.850+0000 7f1bb6a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bb6a00640 1 -- 172.21.15.99:0/1427812804 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc00208e0 con 0x55b515170290 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bb6a00640 1 -- 172.21.15.99:0/1427812804 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f1bc002db60 con 0x55b515170290 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bd79a1740 1 -- 172.21.15.99:0/1427812804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bc000dbc0 con 0x55b515170290 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bb6a00640 1 -- 172.21.15.99:0/1427812804 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1bc002dd60 con 0x55b515170290 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bd79a1740 10 client.6012 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bd79a1740 1 -- 172.21.15.99:0/1427812804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55b514f140b0 con 0x55b515170290 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bb6a00640 1 -- 172.21.15.99:0/1427812804 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc000dbc0 con 0x55b515170290 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bb6a00640 1 -- 172.21.15.99:0/1427812804 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f1bc0037020 con 0x55b515170290 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bd79a1740 10 client.6012 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bd79a1740 10 client.6012 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bd79a1740 20 client.6012 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b5151b2d90 0x55b5151b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bd79a1740 4 client.6012 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.851+0000 7f1bd79a1740 1 -- 172.21.15.99:0/1427812804 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5150e0870 con 0x55b5151b2d90 2024-03-30T13:14:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.852+0000 7f1bcd400640 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b5151b2d90 0x55b5151b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.853+0000 7f1bcd400640 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b5151b2d90 0x55b5151b3170 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6dc56881c361d9 server_cookie=bb96bf195d60177b in_seq=0 out_seq=0 2024-03-30T13:14:00.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.853+0000 7f1bb6a00640 10 client.6012 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bb6a00640 1 -- 172.21.15.99:0/1427812804 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b5150e0870 con 0x55b5151b2d90 2024-03-30T13:14:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bb6a00640 10 client.6012 handle_command_reply: tid=0 2024-03-30T13:14:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 1 client.6012 shutdown 2024-03-30T13:14:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 1 -- 172.21.15.99:0/1427812804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 msgr2=0x55b51518dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b51518dd10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009010 tx=0x7f1bc0007000 comp rx=0 tx=0).stop 2024-03-30T13:14:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 1 -- 172.21.15.99:0/1427812804 shutdown_connections 2024-03-30T13:14:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b5151b2d90 0x55b5151b3170 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5151c8020 0x55b5151b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170670 0x55b5151b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/1427812804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170290 0x55b51518dd10 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 1 -- 172.21.15.99:0/1427812804 >> 172.21.15.99:0/1427812804 conn(0x55b515136be0 msgr2=0x55b515195eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bb6a00640 0 client.6012 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 1 -- 172.21.15.99:0/1427812804 shutdown_connections 2024-03-30T13:14:00.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 1 -- 172.21.15.99:0/1427812804 wait complete. 2024-03-30T13:14:00.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.855+0000 7f1bd79a1740 20 client.6012 trim_cache size 0 max 16384 2024-03-30T13:14:00.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.871+0000 7f1bd79a1740 1 Processor -- start 2024-03-30T13:14:00.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.871+0000 7f1bd79a1740 1 -- start start 2024-03-30T13:14:00.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.872+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b515170290 0x55b5151956b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.872+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.872+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5151c8020 0x55b5151ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.872+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0201010 con 0x55b515170670 2024-03-30T13:14:00.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.872+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01f8e00 con 0x55b515170290 2024-03-30T13:14:00.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.872+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd015fa00 con 0x55b5151c8020 2024-03-30T13:14:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.872+0000 7f1bcd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.872+0000 7f1bcd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55136/0 (socket says 172.21.15.99:55136) 2024-03-30T13:14:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.872+0000 7f1bcd400640 1 -- 172.21.15.99:0/3197507133 learned_addr learned my addr 172.21.15.99:0/3197507133 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.872+0000 7f1bce800640 1 --2- 172.21.15.99:0/3197507133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5151c8020 0x55b5151ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.872+0000 7f1bcde00640 1 --2- 172.21.15.99:0/3197507133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b515170290 0x55b5151956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.873+0000 7f1bcd400640 1 -- 172.21.15.99:0/3197507133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5151c8020 msgr2=0x55b5151ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.873+0000 7f1bcd400640 1 --2- 172.21.15.99:0/3197507133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5151c8020 0x55b5151ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.873+0000 7f1bcd400640 1 -- 172.21.15.99:0/3197507133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b515170290 msgr2=0x55b5151956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.873+0000 7f1bcd400640 1 --2- 172.21.15.99:0/3197507133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b515170290 0x55b5151956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.873+0000 7f1bcd400640 1 -- 172.21.15.99:0/3197507133 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b514d802d0 con 0x55b515170670 2024-03-30T13:14:00.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.873+0000 7f1bcd400640 1 --2- 172.21.15.99:0/3197507133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151cdde0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80090b0 tx=0x7f1bb8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a7901a752f8dda server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.873+0000 7f1bbdc00640 1 -- 172.21.15.99:0/3197507133 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8034040 con 0x55b515170670 2024-03-30T13:14:00.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.873+0000 7f1bbdc00640 1 -- 172.21.15.99:0/3197507133 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb8049070 con 0x55b515170670 2024-03-30T13:14:00.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.873+0000 7f1bbdc00640 1 -- 172.21.15.99:0/3197507133 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8030bc0 con 0x55b515170670 2024-03-30T13:14:00.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.874+0000 7f1bd79a1740 1 -- 172.21.15.99:0/3197507133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 msgr2=0x55b5151cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.874+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/3197507133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151cdde0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80090b0 tx=0x7f1bb8030000 comp rx=0 tx=0).stop 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.874+0000 7f1bd79a1740 1 -- 172.21.15.99:0/3197507133 shutdown_connections 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.874+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/3197507133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b5151c8020 0x55b5151ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.874+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/3197507133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151cdde0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.874+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/3197507133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b515170290 0x55b5151956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.874+0000 7f1bd79a1740 1 -- 172.21.15.99:0/3197507133 >> 172.21.15.99:0/3197507133 conn(0x55b515136be0 msgr2=0x55b5151b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.874+0000 7f1bd79a1740 1 -- 172.21.15.99:0/3197507133 shutdown_connections 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.874+0000 7f1bd79a1740 1 -- 172.21.15.99:0/3197507133 wait complete. 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.875+0000 7f1bd79a1740 1 -- start start 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.875+0000 7f1bd79a1740 1 Processor -- start 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.876+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170290 0x55b5151b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.876+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.876+0000 7f1bd79a1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5151c8020 0x55b5151d6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.876+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b51516b280 con 0x55b515170670 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.876+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01f87b0 con 0x55b5151c8020 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.876+0000 7f1bd79a1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55b5151b17a0 con 0x55b515170290 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.876+0000 7f1bd79a1740 10 client.0 _ll_register_callbacks cb 0x7f1bc00071d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.876+0000 7f1bcd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.876+0000 7f1bcd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55150/0 (socket says 172.21.15.99:55150) 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.876+0000 7f1bcd400640 1 -- 172.21.15.99:0/2972370977 learned_addr learned my addr 172.21.15.99:0/2972370977 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bcde00640 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170290 0x55b5151b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bce800640 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5151c8020 0x55b5151d6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bcd400640 1 -- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170290 msgr2=0x55b5151b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bcd400640 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170290 0x55b5151b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bcd400640 1 -- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5151c8020 msgr2=0x55b5151d6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bcd400640 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5151c8020 0x55b5151d6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bcd400640 1 -- 172.21.15.99:0/2972370977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b51516a110 con 0x55b515170670 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bce800640 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5151c8020 0x55b5151d6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bcd400640 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151ae680 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009990 tx=0x7f1bb8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320a0ead9c6bbd47 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bb6a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bb6a00640 1 -- 172.21.15.99:0/2972370977 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8054070 con 0x55b515170670 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bb6a00640 1 -- 172.21.15.99:0/2972370977 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f1bb8030db0 con 0x55b515170670 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bd79a1740 1 -- 172.21.15.99:0/2972370977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bb8049070 con 0x55b515170670 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bb6a00640 1 -- 172.21.15.99:0/2972370977 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1bb8034040 con 0x55b515170670 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.877+0000 7f1bd79a1740 10 client.6018 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.878+0000 7f1bd79a1740 1 -- 172.21.15.99:0/2972370977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55b5151d6b40 con 0x55b515170670 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.878+0000 7f1bb6a00640 1 -- 172.21.15.99:0/2972370977 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb8049070 con 0x55b515170670 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.878+0000 7f1bb6a00640 1 -- 172.21.15.99:0/2972370977 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f1bb8005990 con 0x55b515170670 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.878+0000 7f1bd79a1740 10 client.6018 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:00.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.878+0000 7f1bd79a1740 10 client.6018 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:00.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.878+0000 7f1bd79a1740 20 client.6018 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:00.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.878+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b5151ab2e0 0x55b51519cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:00.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.878+0000 7f1bd79a1740 4 client.6018 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628404}] 2024-03-30T13:14:00.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.878+0000 7f1bd79a1740 1 -- 172.21.15.99:0/2972370977 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628404}) -- 0x55b5150dabc0 con 0x55b5151ab2e0 2024-03-30T13:14:00.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.878+0000 7f1bcde00640 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b5151ab2e0 0x55b51519cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:00.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.879+0000 7f1bcde00640 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b5151ab2e0 0x55b51519cdd0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ada2079e1ac2e76 server_cookie=1a9a5413a9a2e6b9 in_seq=0 out_seq=0 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.879+0000 7f1bb6a00640 10 client.6018 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.880+0000 7f1bb6a00640 1 -- 172.21.15.99:0/2972370977 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4761 (crc 0 0 0) 0x55b5150dabc0 con 0x55b5151ab2e0 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.880+0000 7f1bb6a00640 10 client.6018 handle_command_reply: tid=0 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.880+0000 7f1bd79a1740 1 client.6018 shutdown 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.880+0000 7f1bd79a1740 1 -- 172.21.15.99:0/2972370977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 msgr2=0x55b5151ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151ae680 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009990 tx=0x7f1bb8004730 comp rx=0 tx=0).stop 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd79a1740 1 -- 172.21.15.99:0/2972370977 shutdown_connections 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55b5151ab2e0 0x55b51519cdd0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5151c8020 0x55b5151d6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b515170670 0x55b5151ae680 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd79a1740 1 --2- 172.21.15.99:0/2972370977 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55b515170290 0x55b5151b5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd79a1740 1 -- 172.21.15.99:0/2972370977 >> 172.21.15.99:0/2972370977 conn(0x55b515136be0 msgr2=0x55b5151956b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bb6a00640 0 client.6018 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd79a1740 1 -- 172.21.15.99:0/2972370977 shutdown_connections 2024-03-30T13:14:00.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd79a1740 1 -- 172.21.15.99:0/2972370977 wait complete. 2024-03-30T13:14:00.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd79a1740 20 client.6018 trim_cache size 0 max 16384 2024-03-30T13:14:00.888 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:00.888 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/xattr_user.c", 2024-03-30T13:14:00.888 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628404, 2024-03-30T13:14:00.888 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:00.888 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.537952+0000", 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.676874+0000", 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:00.889 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1232, 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.676874+0000", 2024-03-30T13:14:00.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:00.891 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1232, 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:00.892 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.537952+0000" 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1232, 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.537952+0000" 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 152, 2024-03-30T13:14:00.893 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 38, 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:00.894 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:00.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:00.896 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.897 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.898 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:00.899 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.900 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:00.901 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:00.903 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:00.903 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:00.903 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:00.903 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd4c00640 1 -- 172.21.15.99:0/2599754781 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1bac06c530 msgr2=0x7f1bac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd4c00640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1bac06c530 0x7f1bac06e9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0000f60 tx=0x7f1bc0009040 comp rx=0 tx=0).stop 2024-03-30T13:14:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.881+0000 7f1bd4c00640 1 -- 172.21.15.99:0/2599754781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd015e920 msgr2=0x7f1bd0154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.882+0000 7f1bd4c00640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd015e920 0x7f1bd0154980 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c7b0 tx=0x7f1bc800cc70 comp rx=0 tx=0).stop 2024-03-30T13:14:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.882+0000 7f1bd4c00640 1 -- 172.21.15.99:0/2599754781 shutdown_connections 2024-03-30T13:14:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.882+0000 7f1bd4c00640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1bac06c530 0x7f1bac06e9f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.882+0000 7f1bd4c00640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd015e920 0x7f1bd0154980 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.882+0000 7f1bd4c00640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd00d0f90 0x7f1bd01e94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.882+0000 7f1bd4c00640 1 --2- 172.21.15.99:0/2599754781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1bd00cfde0 0x7f1bd01f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.882+0000 7f1bd4c00640 1 -- 172.21.15.99:0/2599754781 >> 172.21.15.99:0/2599754781 conn(0x7f1bd008bfc0 msgr2=0x7f1bd01569c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.882+0000 7f1bd4c00640 1 -- 172.21.15.99:0/2599754781 shutdown_connections 2024-03-30T13:14:00.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:00.882+0000 7f1bd4c00640 1 -- 172.21.15.99:0/2599754781 wait complete. 2024-03-30T13:14:00.908 DEBUG:tasks.cephfs.test_uninlining:getting inode info #8 of 23:1099511628402 2024-03-30T13:14:00.908 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628402 2024-03-30T13:14:00.908 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628402 2024-03-30T13:14:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.104+0000 7fe47f200640 1 Processor -- start 2024-03-30T13:14:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.104+0000 7fe47f200640 1 -- start start 2024-03-30T13:14:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.106+0000 7fe47f200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe48006ee50 0x7fe4800adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.106+0000 7fe47f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe4800ae1c0 0x7fe480071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.106+0000 7fe47f200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4800aea00 con 0x7fe48015b140 2024-03-30T13:14:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.106+0000 7fe47f200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe4800aece0 con 0x7fe4800ae1c0 2024-03-30T13:14:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.106+0000 7fe47f200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe4800aefc0 con 0x7fe48006ee50 2024-03-30T13:14:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.106+0000 7fe47de00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe48015b140 0x7fe48006e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33404/0 (socket says 172.21.15.99:33404) 2024-03-30T13:14:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.106+0000 7fe47de00640 1 -- 172.21.15.99:0/3334970531 learned_addr learned my addr 172.21.15.99:0/3334970531 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.106+0000 7fe47e800640 1 --2- 172.21.15.99:0/3334970531 >> v2:172.21.15.99:3300/0 conn(0x7fe4800ae1c0 0x7fe480071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.106+0000 7fe47d400640 1 --2- 172.21.15.99:0/3334970531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe48006ee50 0x7fe4800adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.107+0000 7fe47ca00640 1 -- 172.21.15.99:0/3334970531 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595735586 0 0) 0x7fe4800aea00 con 0x7fe48015b140 2024-03-30T13:14:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.107+0000 7fe47ca00640 1 -- 172.21.15.99:0/3334970531 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe464005730 con 0x7fe48015b140 2024-03-30T13:14:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.107+0000 7fe47e800640 1 -- 172.21.15.99:0/3334970531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe48006ee50 msgr2=0x7fe4800adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.107+0000 7fe47e800640 1 --2- 172.21.15.99:0/3334970531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe48006ee50 0x7fe4800adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.107+0000 7fe47e800640 1 -- 172.21.15.99:0/3334970531 >> v1:172.21.15.99:6789/0 conn(0x7fe48015b140 legacy=0x7fe48006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.107+0000 7fe47e800640 1 -- 172.21.15.99:0/3334970531 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4800af2a0 con 0x7fe4800ae1c0 2024-03-30T13:14:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.107+0000 7fe47d400640 1 --2- 172.21.15.99:0/3334970531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe48006ee50 0x7fe4800adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.108+0000 7fe47e800640 1 --2- 172.21.15.99:0/3334970531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4800ae1c0 0x7fe480071810 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe478009d90 tx=0x7fe47802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1de3c720335f20 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.108+0000 7fe47ca00640 1 -- 172.21.15.99:0/3334970531 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe478039070 con 0x7fe4800ae1c0 2024-03-30T13:14:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.108+0000 7fe47ca00640 1 -- 172.21.15.99:0/3334970531 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47802cc60 con 0x7fe4800ae1c0 2024-03-30T13:14:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.108+0000 7fe47ca00640 1 -- 172.21.15.99:0/3334970531 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe478034660 con 0x7fe4800ae1c0 2024-03-30T13:14:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.109+0000 7fe47f200640 1 -- 172.21.15.99:0/3334970531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4800ae1c0 msgr2=0x7fe480071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.109+0000 7fe47f200640 1 --2- 172.21.15.99:0/3334970531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4800ae1c0 0x7fe480071810 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe478009d90 tx=0x7fe47802beb0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.109+0000 7fe47f200640 1 -- 172.21.15.99:0/3334970531 shutdown_connections 2024-03-30T13:14:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.109+0000 7fe47f200640 1 --2- 172.21.15.99:0/3334970531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4800ae1c0 0x7fe480071810 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.109+0000 7fe47f200640 1 --2- 172.21.15.99:0/3334970531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe48006ee50 0x7fe4800adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.109+0000 7fe47f200640 1 -- 172.21.15.99:0/3334970531 >> 172.21.15.99:0/3334970531 conn(0x7fe48006bb40 msgr2=0x7fe4800b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.109+0000 7fe47f200640 1 -- 172.21.15.99:0/3334970531 shutdown_connections 2024-03-30T13:14:01.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.109+0000 7fe47f200640 1 -- 172.21.15.99:0/3334970531 wait complete. 2024-03-30T13:14:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.111+0000 7fe47f200640 1 Processor -- start 2024-03-30T13:14:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.111+0000 7fe47f200640 1 -- start start 2024-03-30T13:14:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe48006ee50 0x7fe4801f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47f200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4800ae1c0 0x7fe4800afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47f200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe48015b140 0x7fe48014c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe4800ae650 con 0x7fe48006ee50 2024-03-30T13:14:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47f200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe48015b520 con 0x7fe4800ae1c0 2024-03-30T13:14:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47f200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe4800afff0 con 0x7fe48015b140 2024-03-30T13:14:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe48006ee50 0x7fe4801f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe48006ee50 0x7fe4801f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55166/0 (socket says 172.21.15.99:55166) 2024-03-30T13:14:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47de00640 1 -- 172.21.15.99:0/688010986 learned_addr learned my addr 172.21.15.99:0/688010986 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47e800640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe48015b140 0x7fe48014c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47de00640 1 -- 172.21.15.99:0/688010986 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe48015b140 msgr2=0x7fe48014c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47de00640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe48015b140 0x7fe48014c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47d400640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4800ae1c0 0x7fe4800afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.112+0000 7fe47de00640 1 -- 172.21.15.99:0/688010986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4800ae1c0 msgr2=0x7fe4800afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.113+0000 7fe47de00640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4800ae1c0 0x7fe4800afab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.113+0000 7fe47de00640 1 -- 172.21.15.99:0/688010986 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4800b0220 con 0x7fe48006ee50 2024-03-30T13:14:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.113+0000 7fe47de00640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe48006ee50 0x7fe4801f5080 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe47000c460 tx=0x7fe47000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.113+0000 7fe476000640 1 -- 172.21.15.99:0/688010986 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470017070 con 0x7fe48006ee50 2024-03-30T13:14:01.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.113+0000 7fe476000640 1 -- 172.21.15.99:0/688010986 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe470005ce0 con 0x7fe48006ee50 2024-03-30T13:14:01.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.113+0000 7fe476000640 1 -- 172.21.15.99:0/688010986 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470007290 con 0x7fe48006ee50 2024-03-30T13:14:01.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.113+0000 7fe47f200640 1 -- 172.21.15.99:0/688010986 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4800b0500 con 0x7fe48006ee50 2024-03-30T13:14:01.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.113+0000 7fe47f200640 1 -- 172.21.15.99:0/688010986 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe48014cf00 con 0x7fe48006ee50 2024-03-30T13:14:01.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.115+0000 7fe476000640 1 -- 172.21.15.99:0/688010986 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe47001a070 con 0x7fe48006ee50 2024-03-30T13:14:01.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.116+0000 7fe476000640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe46006c530 0x7fe46006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.116+0000 7fe476000640 1 -- 172.21.15.99:0/688010986 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fe47008ab80 con 0x7fe48006ee50 2024-03-30T13:14:01.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.116+0000 7fe47d400640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe46006c530 0x7fe46006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.117+0000 7fe48776a740 1 Processor -- start 2024-03-30T13:14:01.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.117+0000 7fe47d400640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe46006c530 0x7fe46006e9f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe46c006fd0 tx=0x7fe46c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.117+0000 7fe48776a740 1 -- start start 2024-03-30T13:14:01.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.118+0000 7fe48776a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae11ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.118+0000 7fe48776a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae1204e0 0x564cae0f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.118+0000 7fe48776a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae0f9850 0x564cae0f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.118+0000 7fe48776a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564cae05c330 con 0x564cae0f9470 2024-03-30T13:14:01.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.118+0000 7fe48776a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564cae004620 con 0x564cae1204e0 2024-03-30T13:14:01.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.118+0000 7fe48776a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x564cae058440 con 0x564cae0f9850 2024-03-30T13:14:01.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.118+0000 7fe47de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae11ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.118+0000 7fe47de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae11ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55180/0 (socket says 172.21.15.99:55180) 2024-03-30T13:14:01.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.118+0000 7fe47de00640 1 -- 172.21.15.99:0/3623995094 learned_addr learned my addr 172.21.15.99:0/3623995094 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.119+0000 7fe47de00640 1 -- 172.21.15.99:0/3623995094 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae0f9850 msgr2=0x564cae0f89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.119+0000 7fe47de00640 1 --2- 172.21.15.99:0/3623995094 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae0f9850 0x564cae0f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.119+0000 7fe47de00640 1 -- 172.21.15.99:0/3623995094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae1204e0 msgr2=0x564cae0f84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.119+0000 7fe47de00640 1 --2- 172.21.15.99:0/3623995094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae1204e0 0x564cae0f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.119+0000 7fe47de00640 1 -- 172.21.15.99:0/3623995094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cade3c920 con 0x564cae0f9470 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.119+0000 7fe47de00640 1 --2- 172.21.15.99:0/3623995094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae11ffa0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe470005fd0 tx=0x7fe470058a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188f4dfa6e5414c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.119+0000 7fe46a600640 1 -- 172.21.15.99:0/3623995094 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470056c80 con 0x564cae0f9470 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.119+0000 7fe46a600640 1 -- 172.21.15.99:0/3623995094 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe470054ff0 con 0x564cae0f9470 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.119+0000 7fe46a600640 1 -- 172.21.15.99:0/3623995094 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470058e20 con 0x564cae0f9470 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.120+0000 7fe48776a740 1 -- 172.21.15.99:0/3623995094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 msgr2=0x564cae11ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.120+0000 7fe48776a740 1 --2- 172.21.15.99:0/3623995094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae11ffa0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe470005fd0 tx=0x7fe470058a40 comp rx=0 tx=0).stop 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.120+0000 7fe48776a740 1 -- 172.21.15.99:0/3623995094 shutdown_connections 2024-03-30T13:14:01.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.120+0000 7fe48776a740 1 --2- 172.21.15.99:0/3623995094 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae0f9850 0x564cae0f89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.120+0000 7fe48776a740 1 --2- 172.21.15.99:0/3623995094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae1204e0 0x564cae0f84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.120+0000 7fe48776a740 1 --2- 172.21.15.99:0/3623995094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae11ffa0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.120+0000 7fe48776a740 1 -- 172.21.15.99:0/3623995094 >> 172.21.15.99:0/3623995094 conn(0x564cae0bfbe0 msgr2=0x564cae13e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.120+0000 7fe48776a740 1 -- 172.21.15.99:0/3623995094 shutdown_connections 2024-03-30T13:14:01.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.120+0000 7fe48776a740 1 -- 172.21.15.99:0/3623995094 wait complete. 2024-03-30T13:14:01.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.121+0000 7fe48776a740 1 -- start start 2024-03-30T13:14:01.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.121+0000 7fe48776a740 1 Processor -- start 2024-03-30T13:14:01.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe48776a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe48776a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9850 0x564cae0f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe48776a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae117a90 0x564cae0f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe48776a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564cae11fb10 con 0x564cae0f9470 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe48776a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564cae0179d0 con 0x564cae0f9850 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe48776a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x564cae118890 con 0x564cae117a90 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe48776a740 10 client.0 _ll_register_callbacks cb 0x564cae053fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe47de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe47de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae137ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55186/0 (socket says 172.21.15.99:55186) 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe47de00640 1 -- 172.21.15.99:0/3509258765 learned_addr learned my addr 172.21.15.99:0/3509258765 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe47de00640 1 -- 172.21.15.99:0/3509258765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae117a90 msgr2=0x564cae0f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe47de00640 1 --2- 172.21.15.99:0/3509258765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae117a90 0x564cae0f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe47de00640 1 -- 172.21.15.99:0/3509258765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9850 msgr2=0x564cae0f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe47de00640 1 --2- 172.21.15.99:0/3509258765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9850 0x564cae0f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.122+0000 7fe47de00640 1 -- 172.21.15.99:0/3509258765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cadd30210 con 0x564cae0f9470 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.123+0000 7fe47de00640 1 --2- 172.21.15.99:0/3509258765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae137ce0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe470058680 tx=0x7fe470000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c206cb699032b88 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.123+0000 7fe45ea00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.123+0000 7fe45ea00640 1 -- 172.21.15.99:0/3509258765 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470007630 con 0x564cae0f9470 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.123+0000 7fe45ea00640 1 -- 172.21.15.99:0/3509258765 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fe470057dd0 con 0x564cae0f9470 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.123+0000 7fe48776a740 1 -- 172.21.15.99:0/3509258765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe470054ff0 con 0x564cae0f9470 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.123+0000 7fe45ea00640 1 -- 172.21.15.99:0/3509258765 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe470081050 con 0x564cae0f9470 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.123+0000 7fe48776a740 10 client.6033 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.123+0000 7fe48776a740 1 -- 172.21.15.99:0/3509258765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x564cade9d0b0 con 0x564cae0f9470 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.123+0000 7fe45ea00640 1 -- 172.21.15.99:0/3509258765 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe470054ff0 con 0x564cae0f9470 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.123+0000 7fe45ea00640 1 -- 172.21.15.99:0/3509258765 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fe4700546d0 con 0x564cae0f9470 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.124+0000 7fe48776a740 10 client.6033 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.124+0000 7fe48776a740 10 client.6033 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.124+0000 7fe48776a740 20 client.6033 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.124+0000 7fe48776a740 1 --2- 172.21.15.99:0/3509258765 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564cae125880 0x564cae125cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.124+0000 7fe48776a740 4 client.6033 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:01.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.124+0000 7fe48776a740 1 -- 172.21.15.99:0/3509258765 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cae069870 con 0x564cae125880 2024-03-30T13:14:01.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.124+0000 7fe47d400640 1 --2- 172.21.15.99:0/3509258765 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564cae125880 0x564cae125cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.125+0000 7fe47d400640 1 --2- 172.21.15.99:0/3509258765 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564cae125880 0x564cae125cb0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7b2ebcba8655d2f server_cookie=5c1076fe09a7c474 in_seq=0 out_seq=0 2024-03-30T13:14:01.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.125+0000 7fe45ea00640 10 client.6033 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe45ea00640 1 -- 172.21.15.99:0/3509258765 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x564cae069870 con 0x564cae125880 2024-03-30T13:14:01.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe45ea00640 10 client.6033 handle_command_reply: tid=0 2024-03-30T13:14:01.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe48776a740 1 client.6033 shutdown 2024-03-30T13:14:01.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe48776a740 1 -- 172.21.15.99:0/3509258765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 msgr2=0x564cae137ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe48776a740 1 --2- 172.21.15.99:0/3509258765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae137ce0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe470058680 tx=0x7fe470000bc0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe48776a740 1 -- 172.21.15.99:0/3509258765 shutdown_connections 2024-03-30T13:14:01.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe48776a740 1 --2- 172.21.15.99:0/3509258765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae117a90 0x564cae0f85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe48776a740 1 --2- 172.21.15.99:0/3509258765 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564cae125880 0x564cae125cb0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe48776a740 1 --2- 172.21.15.99:0/3509258765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9850 0x564cae0f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe48776a740 1 --2- 172.21.15.99:0/3509258765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9470 0x564cae137ce0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe45ea00640 0 client.6033 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe48776a740 1 -- 172.21.15.99:0/3509258765 >> 172.21.15.99:0/3509258765 conn(0x564cae0bfbe0 msgr2=0x564cae0f2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe48776a740 1 -- 172.21.15.99:0/3509258765 shutdown_connections 2024-03-30T13:14:01.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.127+0000 7fe48776a740 1 -- 172.21.15.99:0/3509258765 wait complete. 2024-03-30T13:14:01.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.128+0000 7fe48776a740 20 client.6033 trim_cache size 0 max 16384 2024-03-30T13:14:01.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.143+0000 7fe48776a740 1 Processor -- start 2024-03-30T13:14:01.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.143+0000 7fe48776a740 1 -- start start 2024-03-30T13:14:01.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.144+0000 7fe48776a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9470 0x564cae1379c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.144+0000 7fe48776a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9850 0x564cae137f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.144+0000 7fe48776a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae117a90 0x564cae0f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.144+0000 7fe48776a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe4801f8700 con 0x564cae0f9850 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.144+0000 7fe48776a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe480149e90 con 0x564cae0f9470 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.144+0000 7fe48776a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe4801491f0 con 0x564cae117a90 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.144+0000 7fe47d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9850 0x564cae137f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.144+0000 7fe47d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9850 0x564cae137f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55194/0 (socket says 172.21.15.99:55194) 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.144+0000 7fe47d400640 1 -- 172.21.15.99:0/2657545744 learned_addr learned my addr 172.21.15.99:0/2657545744 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe47de00640 1 --2- 172.21.15.99:0/2657545744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9470 0x564cae1379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe47e800640 1 --2- 172.21.15.99:0/2657545744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae117a90 0x564cae0f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe47d400640 1 -- 172.21.15.99:0/2657545744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae117a90 msgr2=0x564cae0f6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe47d400640 1 --2- 172.21.15.99:0/2657545744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae117a90 0x564cae0f6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe47d400640 1 -- 172.21.15.99:0/2657545744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9470 msgr2=0x564cae1379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe47d400640 1 --2- 172.21.15.99:0/2657545744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9470 0x564cae1379c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe47d400640 1 -- 172.21.15.99:0/2657545744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cadd092d0 con 0x564cae0f9850 2024-03-30T13:14:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe47de00640 1 --2- 172.21.15.99:0/2657545744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9470 0x564cae1379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe47d400640 1 --2- 172.21.15.99:0/2657545744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9850 0x564cae137f00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe48015a7c0 tx=0x7fe46c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495f473c76ffded9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe469c00640 1 -- 172.21.15.99:0/2657545744 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00f040 con 0x564cae0f9850 2024-03-30T13:14:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe469c00640 1 -- 172.21.15.99:0/2657545744 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46c017310 con 0x564cae0f9850 2024-03-30T13:14:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.145+0000 7fe469c00640 1 -- 172.21.15.99:0/2657545744 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c004030 con 0x564cae0f9850 2024-03-30T13:14:01.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.146+0000 7fe48776a740 1 -- 172.21.15.99:0/2657545744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9850 msgr2=0x564cae137f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.146+0000 7fe48776a740 1 --2- 172.21.15.99:0/2657545744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9850 0x564cae137f00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe48015a7c0 tx=0x7fe46c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.146+0000 7fe48776a740 1 -- 172.21.15.99:0/2657545744 shutdown_connections 2024-03-30T13:14:01.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.146+0000 7fe48776a740 1 --2- 172.21.15.99:0/2657545744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae117a90 0x564cae0f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.146+0000 7fe48776a740 1 --2- 172.21.15.99:0/2657545744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae0f9850 0x564cae137f00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.146+0000 7fe48776a740 1 --2- 172.21.15.99:0/2657545744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9470 0x564cae1379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.146+0000 7fe48776a740 1 -- 172.21.15.99:0/2657545744 >> 172.21.15.99:0/2657545744 conn(0x564cae0bfbe0 msgr2=0x564cae10ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.146+0000 7fe48776a740 1 -- 172.21.15.99:0/2657545744 shutdown_connections 2024-03-30T13:14:01.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.146+0000 7fe48776a740 1 -- 172.21.15.99:0/2657545744 wait complete. 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.147+0000 7fe48776a740 1 -- start start 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.147+0000 7fe48776a740 1 Processor -- start 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe48776a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae0f9470 0x564cae13e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe48776a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9850 0x564cae0f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe48776a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae117a90 0x564cae157570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe48776a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564cae0fa9e0 con 0x564cae117a90 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe48776a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe480149840 con 0x564cae0f9850 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe48776a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x564cae138550 con 0x564cae0f9470 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe48776a740 10 client.0 _ll_register_callbacks cb 0x7fe470059080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe47e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae117a90 0x564cae157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe47e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae117a90 0x564cae157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55206/0 (socket says 172.21.15.99:55206) 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe47e800640 1 -- 172.21.15.99:0/3456433688 learned_addr learned my addr 172.21.15.99:0/3456433688 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe47e800640 1 -- 172.21.15.99:0/3456433688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae0f9470 msgr2=0x564cae13e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe47e800640 1 --2- 172.21.15.99:0/3456433688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae0f9470 0x564cae13e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe47e800640 1 -- 172.21.15.99:0/3456433688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9850 msgr2=0x564cae0f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe47e800640 1 --2- 172.21.15.99:0/3456433688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9850 0x564cae0f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.148+0000 7fe47e800640 1 -- 172.21.15.99:0/3456433688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cae0f8860 con 0x564cae117a90 2024-03-30T13:14:01.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.149+0000 7fe47e800640 1 --2- 172.21.15.99:0/3456433688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae117a90 0x564cae157570 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe478009d90 tx=0x7fe478009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1b4647d4dbf6f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.149+0000 7fe45ea00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:01.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.149+0000 7fe45ea00640 1 -- 172.21.15.99:0/3456433688 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe478044070 con 0x564cae117a90 2024-03-30T13:14:01.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.149+0000 7fe45ea00640 1 -- 172.21.15.99:0/3456433688 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7fe47803f850 con 0x564cae117a90 2024-03-30T13:14:01.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.149+0000 7fe48776a740 1 -- 172.21.15.99:0/3456433688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe46c017310 con 0x564cae117a90 2024-03-30T13:14:01.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.149+0000 7fe45ea00640 1 -- 172.21.15.99:0/3456433688 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe47804f050 con 0x564cae117a90 2024-03-30T13:14:01.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.149+0000 7fe48776a740 10 client.6039 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.149+0000 7fe48776a740 1 -- 172.21.15.99:0/3456433688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x564cae158240 con 0x564cae117a90 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.150+0000 7fe45ea00640 1 -- 172.21.15.99:0/3456433688 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46c017310 con 0x564cae117a90 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.150+0000 7fe45ea00640 1 -- 172.21.15.99:0/3456433688 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fe478052020 con 0x564cae117a90 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.150+0000 7fe48776a740 10 client.6039 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.150+0000 7fe48776a740 10 client.6039 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.150+0000 7fe48776a740 20 client.6039 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.150+0000 7fe48776a740 1 --2- 172.21.15.99:0/3456433688 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564cae157ab0 0x564cae122d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.150+0000 7fe48776a740 4 client.6039 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628402}] 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.150+0000 7fe48776a740 1 -- 172.21.15.99:0/3456433688 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628402}) -- 0x564cae063bc0 con 0x564cae157ab0 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.150+0000 7fe47de00640 1 --2- 172.21.15.99:0/3456433688 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564cae157ab0 0x564cae122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.151+0000 7fe47de00640 1 --2- 172.21.15.99:0/3456433688 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564cae157ab0 0x564cae122d10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=736086c73ee0cac3 server_cookie=f0795415991d1784 in_seq=0 out_seq=0 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.151+0000 7fe45ea00640 10 client.6039 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe45ea00640 1 -- 172.21.15.99:0/3456433688 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4765 (crc 0 0 0) 0x564cae063bc0 con 0x564cae157ab0 2024-03-30T13:14:01.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe45ea00640 10 client.6039 handle_command_reply: tid=0 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe48776a740 1 client.6039 shutdown 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe48776a740 1 -- 172.21.15.99:0/3456433688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae117a90 msgr2=0x564cae157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe48776a740 1 --2- 172.21.15.99:0/3456433688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae117a90 0x564cae157570 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe478009d90 tx=0x7fe478009b60 comp rx=0 tx=0).stop 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe48776a740 1 -- 172.21.15.99:0/3456433688 shutdown_connections 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe48776a740 1 --2- 172.21.15.99:0/3456433688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564cae117a90 0x564cae157570 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe48776a740 1 --2- 172.21.15.99:0/3456433688 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x564cae157ab0 0x564cae122d10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe48776a740 1 --2- 172.21.15.99:0/3456433688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564cae0f9850 0x564cae0f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe48776a740 1 --2- 172.21.15.99:0/3456433688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x564cae0f9470 0x564cae13e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe45ea00640 0 client.6039 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe48776a740 1 -- 172.21.15.99:0/3456433688 >> 172.21.15.99:0/3456433688 conn(0x564cae0bfbe0 msgr2=0x564cae14e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe48776a740 1 -- 172.21.15.99:0/3456433688 shutdown_connections 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.152+0000 7fe48776a740 1 -- 172.21.15.99:0/3456433688 wait complete. 2024-03-30T13:14:01.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe48776a740 20 client.6039 trim_cache size 0 max 16384 2024-03-30T13:14:01.159 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:01.159 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/xattr_security.c", 2024-03-30T13:14:01.159 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628402, 2024-03-30T13:14:01.159 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:01.159 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.548011+0000", 2024-03-30T13:14:01.159 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.670875+0000", 2024-03-30T13:14:01.159 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:01.159 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:01.159 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:01.159 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:01.159 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:01.160 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1473, 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.670875+0000", 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:01.161 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:01.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1473, 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.548011+0000" 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1473, 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:01.163 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.548011+0000" 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 160, 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 34, 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:01.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:01.166 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:01.167 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.168 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:01.170 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:01.171 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.172 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:01.173 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:01.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 -- 172.21.15.99:0/688010986 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe46006c530 msgr2=0x7fe46006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe46006c530 0x7fe46006e9f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe46c006fd0 tx=0x7fe46c008040 comp rx=0 tx=0).stop 2024-03-30T13:14:01.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 -- 172.21.15.99:0/688010986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe48006ee50 msgr2=0x7fe4801f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe48006ee50 0x7fe4801f5080 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe47000c460 tx=0x7fe47000c920 comp rx=0 tx=0).stop 2024-03-30T13:14:01.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 -- 172.21.15.99:0/688010986 shutdown_connections 2024-03-30T13:14:01.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fe46006c530 0x7fe46006e9f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe48015b140 0x7fe48014c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4800ae1c0 0x7fe4800afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 --2- 172.21.15.99:0/688010986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe48006ee50 0x7fe4801f5080 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 -- 172.21.15.99:0/688010986 >> 172.21.15.99:0/688010986 conn(0x7fe48006bb40 msgr2=0x7fe4800cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 -- 172.21.15.99:0/688010986 shutdown_connections 2024-03-30T13:14:01.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.153+0000 7fe47f200640 1 -- 172.21.15.99:0/688010986 wait complete. 2024-03-30T13:14:01.176 DEBUG:tasks.cephfs.test_uninlining:getting inode info #9 of 23:1099511628387 2024-03-30T13:14:01.176 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628387 2024-03-30T13:14:01.177 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628387 2024-03-30T13:14:01.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:01.354 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:01.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.376+0000 7f11dd600640 1 Processor -- start 2024-03-30T13:14:01.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.376+0000 7f11dd600640 1 -- start start 2024-03-30T13:14:01.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.377+0000 7f11dd600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11d80cf540 0x7f11d806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.377+0000 7f11dd600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d80cfae0 con 0x7f11d806cb10 2024-03-30T13:14:01.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.377+0000 7f11dd600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d80cfdc0 con 0x7f11d815e7f0 2024-03-30T13:14:01.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.377+0000 7f11dd600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f11d80d2c30 con 0x7f11d80cf540 2024-03-30T13:14:01.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.377+0000 7f11dcc00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f11d806cb10 0x7f11d80b5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33408/0 (socket says 172.21.15.99:33408) 2024-03-30T13:14:01.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.377+0000 7f11dcc00640 1 -- 172.21.15.99:0/2318096948 learned_addr learned my addr 172.21.15.99:0/2318096948 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:01.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.377+0000 7f11d7400640 1 --2- 172.21.15.99:0/2318096948 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11d80cf540 0x7f11d806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.378+0000 7f11d6a00640 1 -- 172.21.15.99:0/2318096948 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622201195 0 0) 0x7f11d80cfae0 con 0x7f11d806cb10 2024-03-30T13:14:01.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.378+0000 7f11d6a00640 1 -- 172.21.15.99:0/2318096948 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11bc003520 con 0x7f11d806cb10 2024-03-30T13:14:01.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.378+0000 7f11d7400640 1 -- 172.21.15.99:0/2318096948 >> v1:172.21.15.181:6789/0 conn(0x7f11d815e7f0 legacy=0x7f11d80d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.378+0000 7f11d7400640 1 -- 172.21.15.99:0/2318096948 >> v1:172.21.15.99:6789/0 conn(0x7f11d806cb10 legacy=0x7f11d80b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.378+0000 7f11d6a00640 1 -- 172.21.15.99:0/2318096948 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2525762383 0 0) 0x7f11bc003520 con 0x7f11d806cb10 2024-03-30T13:14:01.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.378+0000 7f11d7400640 1 -- 172.21.15.99:0/2318096948 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d80d28c0 con 0x7f11d80cf540 2024-03-30T13:14:01.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.379+0000 7f11d7400640 1 --2- 172.21.15.99:0/2318096948 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11d80cf540 0x7f11d806c5d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11c40097d0 tx=0x7f11c402b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ad117233f4837ec server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.380+0000 7f11d6a00640 1 -- 172.21.15.99:0/2318096948 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4037070 con 0x7f11d80cf540 2024-03-30T13:14:01.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.380+0000 7f11d6a00640 1 -- 172.21.15.99:0/2318096948 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c4030510 con 0x7f11d80cf540 2024-03-30T13:14:01.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.380+0000 7f11d6a00640 1 -- 172.21.15.99:0/2318096948 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0001670 con 0x7f11d80cf540 2024-03-30T13:14:01.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.380+0000 7f11dd600640 1 -- 172.21.15.99:0/2318096948 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11d80cf540 msgr2=0x7f11d806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.380+0000 7f11dd600640 1 --2- 172.21.15.99:0/2318096948 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11d80cf540 0x7f11d806c5d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11c40097d0 tx=0x7f11c402b770 comp rx=0 tx=0).stop 2024-03-30T13:14:01.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.380+0000 7f11dd600640 1 -- 172.21.15.99:0/2318096948 shutdown_connections 2024-03-30T13:14:01.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.380+0000 7f11dd600640 1 --2- 172.21.15.99:0/2318096948 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11d80cf540 0x7f11d806c5d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.380+0000 7f11dd600640 1 -- 172.21.15.99:0/2318096948 >> 172.21.15.99:0/2318096948 conn(0x7f11d809d7f0 msgr2=0x7f11d80d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.381+0000 7f11dd600640 1 -- 172.21.15.99:0/2318096948 shutdown_connections 2024-03-30T13:14:01.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.381+0000 7f11dd600640 1 -- 172.21.15.99:0/2318096948 wait complete. 2024-03-30T13:14:01.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.382+0000 7f11dd600640 1 Processor -- start 2024-03-30T13:14:01.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.382+0000 7f11dd600640 1 -- start start 2024-03-30T13:14:01.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.383+0000 7f11dd600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11d80cf540 0x7f11d80c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.383+0000 7f11dd600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11d815e7f0 0x7f11d80c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.383+0000 7f11dd600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11d80ca030 0x7f11d814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.383+0000 7f11dd600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f11d80b6670 con 0x7f11d80cf540 2024-03-30T13:14:01.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.383+0000 7f11dd600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11d80d2570 con 0x7f11d815e7f0 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.383+0000 7f11dd600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f11d80b67f0 con 0x7f11d80ca030 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.384+0000 7f11d7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11d80cf540 0x7f11d80c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.384+0000 7f11d7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11d80cf540 0x7f11d80c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55210/0 (socket says 172.21.15.99:55210) 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.384+0000 7f11d7e00640 1 -- 172.21.15.99:0/2160469952 learned_addr learned my addr 172.21.15.99:0/2160469952 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.384+0000 7f11dcc00640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11d80ca030 0x7f11d814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.384+0000 7f11d7e00640 1 -- 172.21.15.99:0/2160469952 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11d80ca030 msgr2=0x7f11d814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.384+0000 7f11d7e00640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11d80ca030 0x7f11d814dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.384+0000 7f11d7e00640 1 -- 172.21.15.99:0/2160469952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11d815e7f0 msgr2=0x7f11d80c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.384+0000 7f11d7e00640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11d815e7f0 0x7f11d80c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.384+0000 7f11d7e00640 1 -- 172.21.15.99:0/2160469952 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d80ca6b0 con 0x7f11d80cf540 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.384+0000 7f11d7e00640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11d80cf540 0x7f11d80c7de0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f11c800c7f0 tx=0x7f11c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.385+0000 7f11cfe00640 1 -- 172.21.15.99:0/2160469952 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8016020 con 0x7f11d80cf540 2024-03-30T13:14:01.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.385+0000 7f11cfe00640 1 -- 172.21.15.99:0/2160469952 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c800aa50 con 0x7f11d80cf540 2024-03-30T13:14:01.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.385+0000 7f11cfe00640 1 -- 172.21.15.99:0/2160469952 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c800ae40 con 0x7f11d80cf540 2024-03-30T13:14:01.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.385+0000 7f11dd600640 1 -- 172.21.15.99:0/2160469952 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d80ca990 con 0x7f11d80cf540 2024-03-30T13:14:01.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.385+0000 7f11dd600640 1 -- 172.21.15.99:0/2160469952 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d80caf50 con 0x7f11d80cf540 2024-03-30T13:14:01.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.387+0000 7f11cfe00640 1 -- 172.21.15.99:0/2160469952 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f11c8019020 con 0x7f11d80cf540 2024-03-30T13:14:01.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.388+0000 7f11cfe00640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f11b806c530 0x7f11b806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.388+0000 7f11cfe00640 1 -- 172.21.15.99:0/2160469952 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f11c808b840 con 0x7f11d80cf540 2024-03-30T13:14:01.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.388+0000 7f11d7400640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f11b806c530 0x7f11b806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.389+0000 7f11d7400640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f11b806c530 0x7f11b806e9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f11c4034000 tx=0x7f11c402f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.389+0000 7f11e1970740 1 Processor -- start 2024-03-30T13:14:01.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.390+0000 7f11e1970740 1 -- start start 2024-03-30T13:14:01.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.391+0000 7f11e1970740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac66fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.391+0000 7f11e1970740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac674e0 0x5631dac3f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.391+0000 7f11e1970740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40850 0x5631dac3f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.391+0000 7f11e1970740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5631daba3330 con 0x5631dac40470 2024-03-30T13:14:01.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.391+0000 7f11e1970740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5631dab4b620 con 0x5631dac674e0 2024-03-30T13:14:01.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.391+0000 7f11e1970740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5631dab9f440 con 0x5631dac40850 2024-03-30T13:14:01.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.391+0000 7f11d7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac66fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.391+0000 7f11d7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac66fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55222/0 (socket says 172.21.15.99:55222) 2024-03-30T13:14:01.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.391+0000 7f11d7e00640 1 -- 172.21.15.99:0/2048595222 learned_addr learned my addr 172.21.15.99:0/2048595222 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11dcc00640 1 --2- 172.21.15.99:0/2048595222 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40850 0x5631dac3f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11d7400640 1 --2- 172.21.15.99:0/2048595222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac674e0 0x5631dac3f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11d7e00640 1 -- 172.21.15.99:0/2048595222 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40850 msgr2=0x5631dac3f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11d7e00640 1 --2- 172.21.15.99:0/2048595222 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40850 0x5631dac3f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11d7e00640 1 -- 172.21.15.99:0/2048595222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac674e0 msgr2=0x5631dac3f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11d7e00640 1 --2- 172.21.15.99:0/2048595222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac674e0 0x5631dac3f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11d7e00640 1 -- 172.21.15.99:0/2048595222 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631da983920 con 0x5631dac40470 2024-03-30T13:14:01.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11dcc00640 1 --2- 172.21.15.99:0/2048595222 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40850 0x5631dac3f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:01.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11d7e00640 1 --2- 172.21.15.99:0/2048595222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac66fa0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f11c80014a0 tx=0x7f11c8001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90d8f9c0e6bb5d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11c3e00640 1 -- 172.21.15.99:0/2048595222 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c806de60 con 0x5631dac40470 2024-03-30T13:14:01.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11c3e00640 1 -- 172.21.15.99:0/2048595222 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c8062220 con 0x5631dac40470 2024-03-30T13:14:01.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.392+0000 7f11c3e00640 1 -- 172.21.15.99:0/2048595222 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8055cb0 con 0x5631dac40470 2024-03-30T13:14:01.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.393+0000 7f11e1970740 1 -- 172.21.15.99:0/2048595222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 msgr2=0x5631dac66fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.393+0000 7f11e1970740 1 --2- 172.21.15.99:0/2048595222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac66fa0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f11c80014a0 tx=0x7f11c8001940 comp rx=0 tx=0).stop 2024-03-30T13:14:01.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.393+0000 7f11e1970740 1 -- 172.21.15.99:0/2048595222 shutdown_connections 2024-03-30T13:14:01.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.393+0000 7f11e1970740 1 --2- 172.21.15.99:0/2048595222 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40850 0x5631dac3f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.393+0000 7f11e1970740 1 --2- 172.21.15.99:0/2048595222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac674e0 0x5631dac3f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.393+0000 7f11e1970740 1 --2- 172.21.15.99:0/2048595222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac66fa0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.393+0000 7f11e1970740 1 -- 172.21.15.99:0/2048595222 >> 172.21.15.99:0/2048595222 conn(0x5631dac06be0 msgr2=0x5631dac85190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.393+0000 7f11e1970740 1 -- 172.21.15.99:0/2048595222 shutdown_connections 2024-03-30T13:14:01.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.393+0000 7f11e1970740 1 -- 172.21.15.99:0/2048595222 wait complete. 2024-03-30T13:14:01.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.394+0000 7f11e1970740 1 -- start start 2024-03-30T13:14:01.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.394+0000 7f11e1970740 1 Processor -- start 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.395+0000 7f11e1970740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac5e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.395+0000 7f11e1970740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40850 0x5631dac7d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.395+0000 7f11e1970740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac87b60 0x5631dac88a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.395+0000 7f11e1970740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5631dac66b10 con 0x5631dac40470 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.395+0000 7f11e1970740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5631dab5e9d0 con 0x5631dac87b60 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.395+0000 7f11e1970740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5631dac5f890 con 0x5631dac40850 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.395+0000 7f11e1970740 10 client.0 _ll_register_callbacks cb 0x5631dab9afd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.395+0000 7f11d7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac5e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11d7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac5e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55232/0 (socket says 172.21.15.99:55232) 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11d7e00640 1 -- 172.21.15.99:0/500113919 learned_addr learned my addr 172.21.15.99:0/500113919 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11d7400640 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40850 0x5631dac7d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11dcc00640 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac87b60 0x5631dac88a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11d7e00640 1 -- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40850 msgr2=0x5631dac7d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11d7e00640 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40850 0x5631dac7d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11d7e00640 1 -- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac87b60 msgr2=0x5631dac88a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11d7e00640 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac87b60 0x5631dac88a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11d7e00640 1 -- 172.21.15.99:0/500113919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631da877210 con 0x5631dac40470 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11d7e00640 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac5e880 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f11c8089bc0 tx=0x7f11c8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03093364965470 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11c0c00640 1 -- 172.21.15.99:0/500113919 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8076060 con 0x5631dac40470 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11c0c00640 1 -- 172.21.15.99:0/500113919 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f11c805eb80 con 0x5631dac40470 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.396+0000 7f11e1970740 1 -- 172.21.15.99:0/500113919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11c8062220 con 0x5631dac40470 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.397+0000 7f11c0c00640 1 -- 172.21.15.99:0/500113919 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f11c8087070 con 0x5631dac40470 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.397+0000 7f11e1970740 10 client.6051 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.397+0000 7f11e1970740 1 -- 172.21.15.99:0/500113919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5631da9e40b0 con 0x5631dac40470 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.397+0000 7f11c0c00640 1 -- 172.21.15.99:0/500113919 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c8062220 con 0x5631dac40470 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.397+0000 7f11c0c00640 1 -- 172.21.15.99:0/500113919 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f11c8058a90 con 0x5631dac40470 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.397+0000 7f11e1970740 10 client.6051 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:01.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.397+0000 7f11e1970740 10 client.6051 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:01.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.397+0000 7f11e1970740 20 client.6051 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:01.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.397+0000 7f11e1970740 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5631dac6b7b0 0x5631dac862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.397+0000 7f11e1970740 4 client.6051 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:01.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.397+0000 7f11e1970740 1 -- 172.21.15.99:0/500113919 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631dabb0870 con 0x5631dac6b7b0 2024-03-30T13:14:01.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.398+0000 7f11d7400640 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5631dac6b7b0 0x5631dac862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.398+0000 7f11d7400640 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5631dac6b7b0 0x5631dac862c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2adb168c8016bf2 server_cookie=de04de922b50c213 in_seq=0 out_seq=0 2024-03-30T13:14:01.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.398+0000 7f11c0c00640 10 client.6051 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.399+0000 7f11c0c00640 1 -- 172.21.15.99:0/500113919 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5631dabb0870 con 0x5631dac6b7b0 2024-03-30T13:14:01.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.399+0000 7f11c0c00640 10 client.6051 handle_command_reply: tid=0 2024-03-30T13:14:01.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.399+0000 7f11e1970740 1 client.6051 shutdown 2024-03-30T13:14:01.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.399+0000 7f11e1970740 1 -- 172.21.15.99:0/500113919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 msgr2=0x5631dac5e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.399+0000 7f11e1970740 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac5e880 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f11c8089bc0 tx=0x7f11c8001250 comp rx=0 tx=0).stop 2024-03-30T13:14:01.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.399+0000 7f11e1970740 1 -- 172.21.15.99:0/500113919 shutdown_connections 2024-03-30T13:14:01.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.399+0000 7f11e1970740 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5631dac6b7b0 0x5631dac862c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.400+0000 7f11e1970740 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac87b60 0x5631dac88a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.400+0000 7f11e1970740 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40850 0x5631dac7d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.400+0000 7f11e1970740 1 --2- 172.21.15.99:0/500113919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40470 0x5631dac5e880 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.400+0000 7f11c0c00640 0 client.6051 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.400+0000 7f11e1970740 1 -- 172.21.15.99:0/500113919 >> 172.21.15.99:0/500113919 conn(0x5631dac06be0 msgr2=0x5631dac3e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.400+0000 7f11e1970740 1 -- 172.21.15.99:0/500113919 shutdown_connections 2024-03-30T13:14:01.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.400+0000 7f11e1970740 1 -- 172.21.15.99:0/500113919 wait complete. 2024-03-30T13:14:01.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.400+0000 7f11e1970740 20 client.6051 trim_cache size 0 max 16384 2024-03-30T13:14:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.416+0000 7f11e1970740 1 Processor -- start 2024-03-30T13:14:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.416+0000 7f11e1970740 1 -- start start 2024-03-30T13:14:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.417+0000 7f11e1970740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac40470 0x5631dacfad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.417+0000 7f11e1970740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40850 0x5631dac870c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.417+0000 7f11e1970740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac87b60 0x5631dac87600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.417+0000 7f11e1970740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f11d8200ce0 con 0x5631dac40850 2024-03-30T13:14:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.417+0000 7f11e1970740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11d80b9600 con 0x5631dac40470 2024-03-30T13:14:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.417+0000 7f11e1970740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f11d81517c0 con 0x5631dac87b60 2024-03-30T13:14:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.417+0000 7f11d7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40850 0x5631dac870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.417+0000 7f11d7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40850 0x5631dac870c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55244/0 (socket says 172.21.15.99:55244) 2024-03-30T13:14:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.417+0000 7f11d7400640 1 -- 172.21.15.99:0/1312066331 learned_addr learned my addr 172.21.15.99:0/1312066331 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.417+0000 7f11d7e00640 1 --2- 172.21.15.99:0/1312066331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac40470 0x5631dacfad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.417+0000 7f11dcc00640 1 --2- 172.21.15.99:0/1312066331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac87b60 0x5631dac87600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.418+0000 7f11d7400640 1 -- 172.21.15.99:0/1312066331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac87b60 msgr2=0x5631dac87600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.418+0000 7f11d7400640 1 --2- 172.21.15.99:0/1312066331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac87b60 0x5631dac87600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.418+0000 7f11d7400640 1 -- 172.21.15.99:0/1312066331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac40470 msgr2=0x5631dacfad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.418+0000 7f11d7400640 1 --2- 172.21.15.99:0/1312066331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac40470 0x5631dacfad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.418+0000 7f11d7400640 1 -- 172.21.15.99:0/1312066331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631da8502d0 con 0x5631dac40850 2024-03-30T13:14:01.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.418+0000 7f11d7400640 1 --2- 172.21.15.99:0/1312066331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40850 0x5631dac870c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f11c40097d0 tx=0x7f11c4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f7bc91ab1ca558 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.418+0000 7f11c3400640 1 -- 172.21.15.99:0/1312066331 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4057070 con 0x5631dac40850 2024-03-30T13:14:01.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.418+0000 7f11c3400640 1 -- 172.21.15.99:0/1312066331 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c40512f0 con 0x5631dac40850 2024-03-30T13:14:01.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.418+0000 7f11c3400640 1 -- 172.21.15.99:0/1312066331 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4037040 con 0x5631dac40850 2024-03-30T13:14:01.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.419+0000 7f11e1970740 1 -- 172.21.15.99:0/1312066331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40850 msgr2=0x5631dac870c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.419+0000 7f11e1970740 1 --2- 172.21.15.99:0/1312066331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40850 0x5631dac870c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f11c40097d0 tx=0x7f11c4030000 comp rx=0 tx=0).stop 2024-03-30T13:14:01.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.419+0000 7f11e1970740 1 -- 172.21.15.99:0/1312066331 shutdown_connections 2024-03-30T13:14:01.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.419+0000 7f11e1970740 1 --2- 172.21.15.99:0/1312066331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac87b60 0x5631dac87600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.419+0000 7f11e1970740 1 --2- 172.21.15.99:0/1312066331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac40850 0x5631dac870c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.419+0000 7f11e1970740 1 --2- 172.21.15.99:0/1312066331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac40470 0x5631dacfad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.419+0000 7f11e1970740 1 -- 172.21.15.99:0/1312066331 >> 172.21.15.99:0/1312066331 conn(0x5631dac06be0 msgr2=0x5631dac5f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.419+0000 7f11e1970740 1 -- 172.21.15.99:0/1312066331 shutdown_connections 2024-03-30T13:14:01.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.419+0000 7f11e1970740 1 -- 172.21.15.99:0/1312066331 wait complete. 2024-03-30T13:14:01.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.420+0000 7f11e1970740 1 -- start start 2024-03-30T13:14:01.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.420+0000 7f11e1970740 1 Processor -- start 2024-03-30T13:14:01.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.421+0000 7f11e1970740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40470 0x5631dacf93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.421+0000 7f11e1970740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac40850 0x5631dac9ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.421+0000 7f11e1970740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac87b60 0x5631dac7caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.421+0000 7f11e1970740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5631dac88a80 con 0x5631dac87b60 2024-03-30T13:14:01.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.421+0000 7f11e1970740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11d80b8fb0 con 0x5631dac40850 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.421+0000 7f11e1970740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5631dac97ae0 con 0x5631dac40470 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.421+0000 7f11e1970740 10 client.0 _ll_register_callbacks cb 0x7f11c8001820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.421+0000 7f11dcc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac87b60 0x5631dac7caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.421+0000 7f11dcc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac87b60 0x5631dac7caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55250/0 (socket says 172.21.15.99:55250) 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.421+0000 7f11dcc00640 1 -- 172.21.15.99:0/2669060576 learned_addr learned my addr 172.21.15.99:0/2669060576 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.421+0000 7f11d7400640 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac40850 0x5631dac9ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.422+0000 7f11d7e00640 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40470 0x5631dacf93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.422+0000 7f11dcc00640 1 -- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40470 msgr2=0x5631dacf93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.422+0000 7f11dcc00640 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40470 0x5631dacf93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.422+0000 7f11dcc00640 1 -- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac40850 msgr2=0x5631dac9ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.422+0000 7f11dcc00640 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac40850 0x5631dac9ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.422+0000 7f11dcc00640 1 -- 172.21.15.99:0/2669060576 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631dac9f2a0 con 0x5631dac87b60 2024-03-30T13:14:01.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.422+0000 7f11dcc00640 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac87b60 0x5631dac7caf0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f11d0015660 tx=0x7f11d0015b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f6c3e98196dc2a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.422+0000 7f11c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.422+0000 7f11c0c00640 1 -- 172.21.15.99:0/2669060576 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0013830 con 0x5631dac87b60 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.422+0000 7f11c0c00640 1 -- 172.21.15.99:0/2669060576 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5825+0+0 (secure 0 0 0) 0x7f11d00139d0 con 0x5631dac87b60 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.422+0000 7f11e1970740 1 -- 172.21.15.99:0/2669060576 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11c40512f0 con 0x5631dac87b60 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.423+0000 7f11c0c00640 1 -- 172.21.15.99:0/2669060576 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f11d0013bd0 con 0x5631dac87b60 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.423+0000 7f11e1970740 10 client.6057 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.423+0000 7f11e1970740 1 -- 172.21.15.99:0/2669060576 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5631dacf9a60 con 0x5631dac87b60 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.423+0000 7f11c0c00640 1 -- 172.21.15.99:0/2669060576 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c40512f0 con 0x5631dac87b60 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.423+0000 7f11c0c00640 1 -- 172.21.15.99:0/2669060576 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f11d002a080 con 0x5631dac87b60 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.423+0000 7f11e1970740 10 client.6057 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.423+0000 7f11e1970740 10 client.6057 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.423+0000 7f11e1970740 20 client.6057 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.423+0000 7f11e1970740 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5631dac7d030 0x5631dac7e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.423+0000 7f11e1970740 4 client.6057 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628387}] 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.423+0000 7f11e1970740 1 -- 172.21.15.99:0/2669060576 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628387}) -- 0x5631dabaabc0 con 0x5631dac7d030 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.424+0000 7f11d7e00640 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5631dac7d030 0x5631dac7e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.424+0000 7f11d7e00640 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5631dac7d030 0x5631dac7e6c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bab6f06a95eb0ca5 server_cookie=dbd3622cb65dedd in_seq=0 out_seq=0 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.424+0000 7f11c0c00640 10 client.6057 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11c0c00640 1 -- 172.21.15.99:0/2669060576 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4753 (crc 0 0 0) 0x5631dabaabc0 con 0x5631dac7d030 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11c0c00640 10 client.6057 handle_command_reply: tid=0 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 1 client.6057 shutdown 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 1 -- 172.21.15.99:0/2669060576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac87b60 msgr2=0x5631dac7caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac87b60 0x5631dac7caf0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f11d0015660 tx=0x7f11d0015b20 comp rx=0 tx=0).stop 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 1 -- 172.21.15.99:0/2669060576 shutdown_connections 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631dac87b60 0x5631dac7caf0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5631dac7d030 0x5631dac7e6c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5631dac40850 0x5631dac9ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 1 --2- 172.21.15.99:0/2669060576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5631dac40470 0x5631dacf93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 1 -- 172.21.15.99:0/2669060576 >> 172.21.15.99:0/2669060576 conn(0x5631dac06be0 msgr2=0x5631dac870c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11c0c00640 0 client.6057 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 1 -- 172.21.15.99:0/2669060576 shutdown_connections 2024-03-30T13:14:01.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 1 -- 172.21.15.99:0/2669060576 wait complete. 2024-03-30T13:14:01.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.425+0000 7f11e1970740 20 client.6057 trim_cache size 0 max 16384 2024-03-30T13:14:01.433 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:01.433 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/Makefile", 2024-03-30T13:14:01.433 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628387, 2024-03-30T13:14:01.433 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.572803+0000", 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.628876+0000", 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:01.434 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 378, 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.628876+0000", 2024-03-30T13:14:01.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.436 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 378, 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:01.437 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.572803+0000" 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 378, 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.572803+0000" 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 178, 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:01.438 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 4, 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:01.440 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:01.441 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:01.443 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.444 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.445 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.446 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:01.447 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:01.448 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:01.448 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:01.448 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.448 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:01.448 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:01.448 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:01.448 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:01.448 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:01.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 -- 172.21.15.99:0/2160469952 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f11b806c530 msgr2=0x7f11b806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f11b806c530 0x7f11b806e9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f11c4034000 tx=0x7f11c402f000 comp rx=0 tx=0).stop 2024-03-30T13:14:01.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 -- 172.21.15.99:0/2160469952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11d80cf540 msgr2=0x7f11d80c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11d80cf540 0x7f11d80c7de0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f11c800c7f0 tx=0x7f11c800ccb0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 -- 172.21.15.99:0/2160469952 shutdown_connections 2024-03-30T13:14:01.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f11b806c530 0x7f11b806e9f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11d80ca030 0x7f11d814dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11d815e7f0 0x7f11d80c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 --2- 172.21.15.99:0/2160469952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11d80cf540 0x7f11d80c7de0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 -- 172.21.15.99:0/2160469952 >> 172.21.15.99:0/2160469952 conn(0x7f11d809d7f0 msgr2=0x7f11d80b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 -- 172.21.15.99:0/2160469952 shutdown_connections 2024-03-30T13:14:01.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.426+0000 7f11dd600640 1 -- 172.21.15.99:0/2160469952 wait complete. 2024-03-30T13:14:01.451 DEBUG:tasks.cephfs.test_uninlining:getting inode info #10 of 23:1099511628399 2024-03-30T13:14:01.451 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628399 2024-03-30T13:14:01.451 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628399 2024-03-30T13:14:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.719+0000 7fc609c00640 1 Processor -- start 2024-03-30T13:14:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.720+0000 7fc609c00640 1 -- start start 2024-03-30T13:14:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.721+0000 7fc609c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc6040c6820 0x7fc6040b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.721+0000 7fc609c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6041604d0 con 0x7fc6040b2640 2024-03-30T13:14:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.721+0000 7fc609c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6041607b0 con 0x7fc6040b4e40 2024-03-30T13:14:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.721+0000 7fc609c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc6040cba20 con 0x7fc6040c6820 2024-03-30T13:14:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.722+0000 7fc603400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc6040b2640 0x7fc6040cbec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33420/0 (socket says 172.21.15.99:33420) 2024-03-30T13:14:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.722+0000 7fc603400640 1 -- 172.21.15.99:0/3391992099 learned_addr learned my addr 172.21.15.99:0/3391992099 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.722+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1057780578 0 0) 0x7fc6041604d0 con 0x7fc6040b2640 2024-03-30T13:14:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.722+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5e8003520 con 0x7fc6040b2640 2024-03-30T13:14:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.722+0000 7fc5fa000640 1 --2- 172.21.15.99:0/3391992099 >> v2:172.21.15.181:3300/0 conn(0x7fc6040c6820 0x7fc6040b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.722+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 132945158 0 0) 0x7fc5e8003520 con 0x7fc6040b2640 2024-03-30T13:14:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.722+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 >> v2:172.21.15.181:3300/0 conn(0x7fc6040c6820 msgr2=0x7fc6040b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.722+0000 7fc602000640 1 --2- 172.21.15.99:0/3391992099 >> v2:172.21.15.181:3300/0 conn(0x7fc6040c6820 0x7fc6040b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.722+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 >> v1:172.21.15.181:6789/0 conn(0x7fc6040b4e40 legacy=0x7fc6040b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.722+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc604160a90 con 0x7fc6040b2640 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fc5fc0019f0 con 0x7fc6040b2640 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 >> v1:172.21.15.99:6789/0 conn(0x7fc6040b2640 legacy=0x7fc6040cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602000640 1 --2- 172.21.15.99:0/3391992099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80039b0 0x7fc5e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602000640 1 --2- 172.21.15.99:0/3391992099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5e8004800 0x7fc5e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602000640 1 --2- 172.21.15.99:0/3391992099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e80052e0 0x7fc5e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc6040cba20 con 0x7fc5e80039b0 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e800c1b0 con 0x7fc5e80052e0 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e800c3b0 con 0x7fc5e8004800 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602a00640 1 --2- 172.21.15.99:0/3391992099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80039b0 0x7fc5e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc5fa000640 1 --2- 172.21.15.99:0/3391992099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5e8004800 0x7fc5e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc603400640 1 --2- 172.21.15.99:0/3391992099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e80052e0 0x7fc5e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602a00640 1 -- 172.21.15.99:0/3391992099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5e8004800 msgr2=0x7fc5e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602a00640 1 --2- 172.21.15.99:0/3391992099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc5e8004800 0x7fc5e8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602a00640 1 -- 172.21.15.99:0/3391992099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e80052e0 msgr2=0x7fc5e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602a00640 1 --2- 172.21.15.99:0/3391992099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e80052e0 0x7fc5e800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc602a00640 1 -- 172.21.15.99:0/3391992099 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e8003520 con 0x7fc5e80039b0 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.723+0000 7fc603400640 1 -- 172.21.15.99:0/3391992099 reap_dead start 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.724+0000 7fc602a00640 1 --2- 172.21.15.99:0/3391992099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80039b0 0x7fc5e8003dd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec001720 tx=0x7fc5e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122d7e5588cc9983 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.725+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec001370 con 0x7fc5e80039b0 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.725+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ec0052d0 con 0x7fc5e80039b0 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.725+0000 7fc602000640 1 -- 172.21.15.99:0/3391992099 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec003830 con 0x7fc5e80039b0 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.725+0000 7fc609c00640 1 -- 172.21.15.99:0/3391992099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80039b0 msgr2=0x7fc5e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.725+0000 7fc609c00640 1 --2- 172.21.15.99:0/3391992099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80039b0 0x7fc5e8003dd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec001720 tx=0x7fc5e8005830 comp rx=0 tx=0).stop 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.725+0000 7fc609c00640 1 -- 172.21.15.99:0/3391992099 shutdown_connections 2024-03-30T13:14:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.725+0000 7fc609c00640 1 --2- 172.21.15.99:0/3391992099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e80039b0 0x7fc5e8003dd0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.725+0000 7fc609c00640 1 -- 172.21.15.99:0/3391992099 >> 172.21.15.99:0/3391992099 conn(0x7fc6040d0450 msgr2=0x7fc6040d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.726+0000 7fc609c00640 1 -- 172.21.15.99:0/3391992099 shutdown_connections 2024-03-30T13:14:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.726+0000 7fc609c00640 1 -- 172.21.15.99:0/3391992099 wait complete. 2024-03-30T13:14:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.729+0000 7fc609c00640 1 Processor -- start 2024-03-30T13:14:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.729+0000 7fc609c00640 1 -- start start 2024-03-30T13:14:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.731+0000 7fc609c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e80039b0 0x7fc60415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.731+0000 7fc609c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc604098e50 0x7fc6041fcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.731+0000 7fc609c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6040992d0 0x7fc6040717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.731+0000 7fc609c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc6040c6cb0 con 0x7fc6040992d0 2024-03-30T13:14:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.731+0000 7fc609c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc6040b2a70 con 0x7fc5e80039b0 2024-03-30T13:14:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.731+0000 7fc609c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc6040c60f0 con 0x7fc604098e50 2024-03-30T13:14:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.731+0000 7fc603400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6040992d0 0x7fc6040717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.731+0000 7fc603400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6040992d0 0x7fc6040717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55262/0 (socket says 172.21.15.99:55262) 2024-03-30T13:14:01.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.731+0000 7fc603400640 1 -- 172.21.15.99:0/1151574161 learned_addr learned my addr 172.21.15.99:0/1151574161 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.731+0000 7fc602a00640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e80039b0 0x7fc60415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.731+0000 7fc5fa000640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc604098e50 0x7fc6041fcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.734+0000 7fc603400640 1 -- 172.21.15.99:0/1151574161 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc604098e50 msgr2=0x7fc6041fcfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.734+0000 7fc603400640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc604098e50 0x7fc6041fcfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.734+0000 7fc603400640 1 -- 172.21.15.99:0/1151574161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e80039b0 msgr2=0x7fc60415ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.734+0000 7fc603400640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e80039b0 0x7fc60415ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.734+0000 7fc603400640 1 -- 172.21.15.99:0/1151574161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6040af180 con 0x7fc6040992d0 2024-03-30T13:14:01.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.737+0000 7fc603400640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6040992d0 0x7fc6040717d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc000f80 tx=0x7fc5fc00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.738+0000 7fc5fb400640 1 -- 172.21.15.99:0/1151574161 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc004d60 con 0x7fc6040992d0 2024-03-30T13:14:01.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.738+0000 7fc5fb400640 1 -- 172.21.15.99:0/1151574161 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5fc00bb80 con 0x7fc6040992d0 2024-03-30T13:14:01.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.738+0000 7fc5fb400640 1 -- 172.21.15.99:0/1151574161 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc007070 con 0x7fc6040992d0 2024-03-30T13:14:01.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.738+0000 7fc609c00640 1 -- 172.21.15.99:0/1151574161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60415f260 con 0x7fc6040992d0 2024-03-30T13:14:01.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.738+0000 7fc609c00640 1 -- 172.21.15.99:0/1151574161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60415f820 con 0x7fc6040992d0 2024-03-30T13:14:01.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.750+0000 7fc5fb400640 1 -- 172.21.15.99:0/1151574161 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc5fc01b060 con 0x7fc6040992d0 2024-03-30T13:14:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.754+0000 7fc5fb400640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5e006c580 0x7fc5e006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.754+0000 7fc5fb400640 1 -- 172.21.15.99:0/1151574161 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7fc5fc08b3e0 con 0x7fc6040992d0 2024-03-30T13:14:01.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.756+0000 7fc602a00640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5e006c580 0x7fc5e006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.756+0000 7fc60c9f5740 1 Processor -- start 2024-03-30T13:14:01.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.757+0000 7fc60c9f5740 1 -- start start 2024-03-30T13:14:01.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.759+0000 7fc602a00640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5e006c580 0x7fc5e006ea40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec033000 tx=0x7fc5ec009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.760+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9290 0x55590851fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.760+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908520300 0x5559084f82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.760+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x5559084f8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.761+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55590845c330 con 0x5559084f9290 2024-03-30T13:14:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.761+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555908404620 con 0x5559084f9670 2024-03-30T13:14:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.761+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555908458440 con 0x555908520300 2024-03-30T13:14:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.761+0000 7fc602a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9290 0x55590851fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.761+0000 7fc5fa000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908520300 0x5559084f82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.761+0000 7fc5fa000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908520300 0x5559084f82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:35602/0 (socket says 172.21.15.99:35602) 2024-03-30T13:14:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.762+0000 7fc5fa000640 1 -- 172.21.15.99:0/2228823540 learned_addr learned my addr 172.21.15.99:0/2228823540 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.762+0000 7fc603400640 1 --2- 172.21.15.99:0/2228823540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x5559084f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.762+0000 7fc602a00640 1 -- 172.21.15.99:0/2228823540 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908520300 msgr2=0x5559084f82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.762+0000 7fc602a00640 1 --2- 172.21.15.99:0/2228823540 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908520300 0x5559084f82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.762+0000 7fc602a00640 1 -- 172.21.15.99:0/2228823540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 msgr2=0x5559084f8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.762+0000 7fc602a00640 1 --2- 172.21.15.99:0/2228823540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x5559084f8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.763+0000 7fc602a00640 1 -- 172.21.15.99:0/2228823540 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55590823c920 con 0x5559084f9290 2024-03-30T13:14:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.763+0000 7fc602a00640 1 --2- 172.21.15.99:0/2228823540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9290 0x55590851fdc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec004000 tx=0x7fc5ec02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7814f4746f280a98 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.765+0000 7fc5f3400640 1 -- 172.21.15.99:0/2228823540 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec04f070 con 0x5559084f9290 2024-03-30T13:14:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.765+0000 7fc5f3400640 1 -- 172.21.15.99:0/2228823540 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ec0075d0 con 0x5559084f9290 2024-03-30T13:14:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.765+0000 7fc5f3400640 1 -- 172.21.15.99:0/2228823540 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0069d0 con 0x5559084f9290 2024-03-30T13:14:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.767+0000 7fc60c9f5740 1 -- 172.21.15.99:0/2228823540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9290 msgr2=0x55590851fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.767+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/2228823540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9290 0x55590851fdc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec004000 tx=0x7fc5ec02f000 comp rx=0 tx=0).stop 2024-03-30T13:14:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.768+0000 7fc60c9f5740 1 -- 172.21.15.99:0/2228823540 shutdown_connections 2024-03-30T13:14:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.768+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/2228823540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x5559084f8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.768+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/2228823540 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908520300 0x5559084f82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.768+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/2228823540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9290 0x55590851fdc0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.768+0000 7fc60c9f5740 1 -- 172.21.15.99:0/2228823540 >> 172.21.15.99:0/2228823540 conn(0x5559084bfbe0 msgr2=0x55590853dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.768+0000 7fc60c9f5740 1 -- 172.21.15.99:0/2228823540 shutdown_connections 2024-03-30T13:14:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.768+0000 7fc60c9f5740 1 -- 172.21.15.99:0/2228823540 wait complete. 2024-03-30T13:14:01.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.770+0000 7fc60c9f5740 1 -- start start 2024-03-30T13:14:01.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.770+0000 7fc60c9f5740 1 Processor -- start 2024-03-30T13:14:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.771+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5559084f9290 0x55590853f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.771+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9670 0x555908541700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.771+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555908517b60 0x555908541c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.771+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55590851f930 con 0x5559084f9670 2024-03-30T13:14:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.771+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5559084179d0 con 0x555908517b60 2024-03-30T13:14:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.771+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5559085186b0 con 0x5559084f9290 2024-03-30T13:14:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.771+0000 7fc60c9f5740 10 client.0 _ll_register_callbacks cb 0x555908453fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.772+0000 7fc602a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5559084f9290 0x55590853f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.772+0000 7fc602a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5559084f9290 0x55590853f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:35604/0 (socket says 172.21.15.99:35604) 2024-03-30T13:14:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.772+0000 7fc602a00640 1 -- 172.21.15.99:0/3272641816 learned_addr learned my addr 172.21.15.99:0/3272641816 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.772+0000 7fc603400640 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555908517b60 0x555908541c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.772+0000 7fc5fa000640 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9670 0x555908541700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.772+0000 7fc602a00640 1 -- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555908517b60 msgr2=0x555908541c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.772+0000 7fc602a00640 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555908517b60 0x555908541c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.772+0000 7fc602a00640 1 -- 172.21.15.99:0/3272641816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9670 msgr2=0x555908541700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.772+0000 7fc602a00640 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9670 0x555908541700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.773+0000 7fc602a00640 1 -- 172.21.15.99:0/3272641816 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x555908130210 con 0x5559084f9290 2024-03-30T13:14:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.773+0000 7fc603400640 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555908517b60 0x555908541c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.773+0000 7fc602a00640 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5559084f9290 0x55590853f0e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec006d50 tx=0x7fc5ec001190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81a156a887fd96b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.773+0000 7fc5e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3301/0 2024-03-30T13:14:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.773+0000 7fc5e7e00640 1 -- 172.21.15.99:0/3272641816 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec04f040 con 0x5559084f9290 2024-03-30T13:14:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.774+0000 7fc5e7e00640 1 -- 172.21.15.99:0/3272641816 <== mon.2 v2:172.21.15.181:3301/0 2 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7fc5ec0035f0 con 0x5559084f9290 2024-03-30T13:14:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.774+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3272641816 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5ec0075d0 con 0x5559084f9290 2024-03-30T13:14:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.774+0000 7fc5e7e00640 1 -- 172.21.15.99:0/3272641816 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc5ec063050 con 0x5559084f9290 2024-03-30T13:14:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.774+0000 7fc60c9f5740 10 client.4883 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.774+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3272641816 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55590829d0b0 con 0x5559084f9290 2024-03-30T13:14:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.775+0000 7fc5e7e00640 1 -- 172.21.15.99:0/3272641816 <== mon.2 v2:172.21.15.181:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ec0075d0 con 0x5559084f9290 2024-03-30T13:14:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.775+0000 7fc5e7e00640 1 -- 172.21.15.99:0/3272641816 <== mon.2 v2:172.21.15.181:3301/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc5ec0037f0 con 0x5559084f9290 2024-03-30T13:14:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.775+0000 7fc60c9f5740 10 client.4883 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.775+0000 7fc60c9f5740 10 client.4883 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.775+0000 7fc60c9f5740 20 client.4883 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.775+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555908524600 0x555908524a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.775+0000 7fc60c9f5740 4 client.4883 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.775+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3272641816 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555908469870 con 0x555908524600 2024-03-30T13:14:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.776+0000 7fc5fa000640 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555908524600 0x555908524a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.777+0000 7fc5fa000640 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555908524600 0x555908524a80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a727c88fad3e072 server_cookie=1384ddc2a1e2f765 in_seq=0 out_seq=0 2024-03-30T13:14:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.777+0000 7fc5e7e00640 10 client.4883 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.777+0000 7fc5e7e00640 1 -- 172.21.15.99:0/3272641816 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x555908469870 con 0x555908524600 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.777+0000 7fc5e7e00640 10 client.4883 handle_command_reply: tid=0 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.778+0000 7fc60c9f5740 1 client.4883 shutdown 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.778+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5559084f9290 msgr2=0x55590853f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.778+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5559084f9290 0x55590853f0e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec006d50 tx=0x7fc5ec001190 comp rx=0 tx=0).stop 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.778+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3272641816 shutdown_connections 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.778+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555908524600 0x555908524a80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.778+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555908517b60 0x555908541c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.778+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9670 0x555908541700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.778+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/3272641816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5559084f9290 0x55590853f0e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.778+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3272641816 >> 172.21.15.99:0/3272641816 conn(0x5559084bfbe0 msgr2=0x55590851f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.778+0000 7fc5e7e00640 0 client.4883 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.779+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3272641816 shutdown_connections 2024-03-30T13:14:01.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.779+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3272641816 wait complete. 2024-03-30T13:14:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.779+0000 7fc60c9f5740 20 client.4883 trim_cache size 0 max 16384 2024-03-30T13:14:01.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.836+0000 7fc60c9f5740 1 Processor -- start 2024-03-30T13:14:01.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.837+0000 7fc60c9f5740 1 -- start start 2024-03-30T13:14:01.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.838+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9290 0x5559084f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.838+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x555908535c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.838+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908517b60 0x555908533940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.838+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc00cab0 con 0x5559084f9290 2024-03-30T13:14:01.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.838+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc00ba90 con 0x5559084f9670 2024-03-30T13:14:01.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.838+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc5dc00ad70 con 0x555908517b60 2024-03-30T13:14:01.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.839+0000 7fc603400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908517b60 0x555908533940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.839+0000 7fc5fa000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x555908535c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.839+0000 7fc603400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908517b60 0x555908533940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:35620/0 (socket says 172.21.15.99:35620) 2024-03-30T13:14:01.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.839+0000 7fc603400640 1 -- 172.21.15.99:0/3164400513 learned_addr learned my addr 172.21.15.99:0/3164400513 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.839+0000 7fc602a00640 1 --2- 172.21.15.99:0/3164400513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9290 0x5559084f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.839+0000 7fc5fa000640 1 -- 172.21.15.99:0/3164400513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908517b60 msgr2=0x555908533940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.839+0000 7fc5fa000640 1 --2- 172.21.15.99:0/3164400513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908517b60 0x555908533940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.839+0000 7fc5fa000640 1 -- 172.21.15.99:0/3164400513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9290 msgr2=0x5559084f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.839+0000 7fc5fa000640 1 --2- 172.21.15.99:0/3164400513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9290 0x5559084f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.839+0000 7fc5fa000640 1 -- 172.21.15.99:0/3164400513 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559081092d0 con 0x5559084f9670 2024-03-30T13:14:01.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.840+0000 7fc5fa000640 1 --2- 172.21.15.99:0/3164400513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x555908535c30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x555908540a10 tx=0x7fc5f4008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef94b1db580283d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.841+0000 7fc5f2a00640 1 -- 172.21.15.99:0/3164400513 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400f040 con 0x5559084f9670 2024-03-30T13:14:01.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.841+0000 7fc5f2a00640 1 -- 172.21.15.99:0/3164400513 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f4018ce0 con 0x5559084f9670 2024-03-30T13:14:01.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.841+0000 7fc5f2a00640 1 -- 172.21.15.99:0/3164400513 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400f040 con 0x5559084f9670 2024-03-30T13:14:01.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.842+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3164400513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 msgr2=0x555908535c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.842+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/3164400513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x555908535c30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x555908540a10 tx=0x7fc5f4008040 comp rx=0 tx=0).stop 2024-03-30T13:14:01.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.843+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3164400513 shutdown_connections 2024-03-30T13:14:01.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.843+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/3164400513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555908517b60 0x555908533940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.843+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/3164400513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x555908535c30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.843+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/3164400513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559084f9290 0x5559084f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.843+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3164400513 >> 172.21.15.99:0/3164400513 conn(0x5559084bfbe0 msgr2=0x555908522b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.843+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3164400513 shutdown_connections 2024-03-30T13:14:01.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.843+0000 7fc60c9f5740 1 -- 172.21.15.99:0/3164400513 wait complete. 2024-03-30T13:14:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.845+0000 7fc60c9f5740 1 -- start start 2024-03-30T13:14:01.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.845+0000 7fc60c9f5740 1 Processor -- start 2024-03-30T13:14:01.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.848+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5559084f9290 0x5559085b9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.848+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x555908522b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.848+0000 7fc60c9f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555908517b60 0x555908523070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.848+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc00b3c0 con 0x555908517b60 2024-03-30T13:14:01.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.848+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5559085347b0 con 0x5559084f9670 2024-03-30T13:14:01.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.848+0000 7fc60c9f5740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555908527270 con 0x5559084f9290 2024-03-30T13:14:01.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.848+0000 7fc60c9f5740 10 client.0 _ll_register_callbacks cb 0x7fc5fc055660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:01.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.848+0000 7fc603400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555908517b60 0x555908523070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.848+0000 7fc5fa000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x555908522b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.848+0000 7fc5fa000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x555908522b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:50672/0 (socket says 172.21.15.99:50672) 2024-03-30T13:14:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.848+0000 7fc5fa000640 1 -- 172.21.15.99:0/1911810587 learned_addr learned my addr 172.21.15.99:0/1911810587 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.849+0000 7fc5fa000640 1 -- 172.21.15.99:0/1911810587 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5559084f9290 msgr2=0x5559085b9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.849+0000 7fc5fa000640 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5559084f9290 0x5559085b9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.849+0000 7fc5fa000640 1 -- 172.21.15.99:0/1911810587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555908517b60 msgr2=0x555908523070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.849+0000 7fc5fa000640 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555908517b60 0x555908523070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.849+0000 7fc5fa000640 1 -- 172.21.15.99:0/1911810587 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559085158f0 con 0x5559084f9670 2024-03-30T13:14:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.849+0000 7fc603400640 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555908517b60 0x555908523070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.850+0000 7fc5fa000640 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x555908522b30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5559084f69c0 tx=0x7fc5f40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75fed293816d211 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.850+0000 7fc5e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-03-30T13:14:01.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.851+0000 7fc5e7e00640 1 -- 172.21.15.99:0/1911810587 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f402d020 con 0x5559084f9670 2024-03-30T13:14:01.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.851+0000 7fc5e7e00640 1 -- 172.21.15.99:0/1911810587 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7fc5f40043c0 con 0x5559084f9670 2024-03-30T13:14:01.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.851+0000 7fc60c9f5740 1 -- 172.21.15.99:0/1911810587 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5f4018ce0 con 0x5559084f9670 2024-03-30T13:14:01.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.852+0000 7fc5e7e00640 1 -- 172.21.15.99:0/1911810587 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc5f40203f0 con 0x5559084f9670 2024-03-30T13:14:01.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.852+0000 7fc60c9f5740 10 client.5146 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:01.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.852+0000 7fc60c9f5740 1 -- 172.21.15.99:0/1911810587 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5559085bdd10 con 0x5559084f9670 2024-03-30T13:14:01.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.852+0000 7fc5e7e00640 1 -- 172.21.15.99:0/1911810587 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f4018ce0 con 0x5559084f9670 2024-03-30T13:14:01.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.853+0000 7fc5e7e00640 1 -- 172.21.15.99:0/1911810587 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc5f4020590 con 0x5559084f9670 2024-03-30T13:14:01.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.853+0000 7fc60c9f5740 10 client.5146 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:01.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.853+0000 7fc60c9f5740 10 client.5146 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:01.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.853+0000 7fc60c9f5740 20 client.5146 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:01.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.853+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555908533e50 0x5559085bd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:01.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.853+0000 7fc60c9f5740 4 client.5146 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628399}] 2024-03-30T13:14:01.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.853+0000 7fc60c9f5740 1 -- 172.21.15.99:0/1911810587 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628399}) -- 0x555908463bc0 con 0x555908533e50 2024-03-30T13:14:01.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.854+0000 7fc602a00640 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555908533e50 0x5559085bd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:01.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.856+0000 7fc602a00640 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555908533e50 0x5559085bd040 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee50c7f239d49e3 server_cookie=45c3a6ebc8fa10bb in_seq=0 out_seq=0 2024-03-30T13:14:01.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.856+0000 7fc5e7e00640 10 client.5146 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.857+0000 7fc5e7e00640 1 -- 172.21.15.99:0/1911810587 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4755 (crc 0 0 0) 0x555908463bc0 con 0x555908533e50 2024-03-30T13:14:01.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.857+0000 7fc5e7e00640 10 client.5146 handle_command_reply: tid=0 2024-03-30T13:14:01.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.857+0000 7fc60c9f5740 1 client.5146 shutdown 2024-03-30T13:14:01.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.858+0000 7fc60c9f5740 1 -- 172.21.15.99:0/1911810587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 msgr2=0x555908522b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.858+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x555908522b30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5559084f69c0 tx=0x7fc5f40046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.858+0000 7fc60c9f5740 1 -- 172.21.15.99:0/1911810587 shutdown_connections 2024-03-30T13:14:01.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.858+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555908517b60 0x555908523070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.858+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555908533e50 0x5559085bd040 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.858+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559084f9670 0x555908522b30 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5559084f69c0 tx=0x7fc5f40046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.858+0000 7fc60c9f5740 1 --2- 172.21.15.99:0/1911810587 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5559084f9290 0x5559085b9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.858+0000 7fc60c9f5740 1 -- 172.21.15.99:0/1911810587 >> 172.21.15.99:0/1911810587 conn(0x5559084bfbe0 msgr2=0x555908535f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.858+0000 7fc5e7e00640 0 client.5146 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:01.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.858+0000 7fc60c9f5740 1 -- 172.21.15.99:0/1911810587 shutdown_connections 2024-03-30T13:14:01.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.858+0000 7fc60c9f5740 1 -- 172.21.15.99:0/1911810587 wait complete. 2024-03-30T13:14:01.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.859+0000 7fc60c9f5740 20 client.5146 trim_cache size 0 max 16384 2024-03-30T13:14:01.863 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:01.863 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/symlink.c", 2024-03-30T13:14:01.863 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628399, 2024-03-30T13:14:01.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:01.863 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.575142+0000", 2024-03-30T13:14:01.863 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.660875+0000", 2024-03-30T13:14:01.863 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:01.863 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 916, 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.660875+0000", 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:01.865 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:01.866 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 916, 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.575142+0000" 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 916, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.575142+0000" 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 182, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 28, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.869 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:01.870 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:01.871 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:01.872 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.873 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:01.875 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:01.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:01.877 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:01.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.860+0000 7fc609c00640 1 -- 172.21.15.99:0/1151574161 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5e006c580 msgr2=0x7fc5e006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.860+0000 7fc609c00640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5e006c580 0x7fc5e006ea40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec033000 tx=0x7fc5ec009030 comp rx=0 tx=0).stop 2024-03-30T13:14:01.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.860+0000 7fc609c00640 1 -- 172.21.15.99:0/1151574161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6040992d0 msgr2=0x7fc6040717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:01.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.860+0000 7fc609c00640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6040992d0 0x7fc6040717d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc000f80 tx=0x7fc5fc00b4a0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.860+0000 7fc609c00640 1 -- 172.21.15.99:0/1151574161 shutdown_connections 2024-03-30T13:14:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.860+0000 7fc609c00640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc5e006c580 0x7fc5e006ea40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.860+0000 7fc609c00640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6040992d0 0x7fc6040717d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.860+0000 7fc609c00640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc604098e50 0x7fc6041fcfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.860+0000 7fc609c00640 1 --2- 172.21.15.99:0/1151574161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5e80039b0 0x7fc60415ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.860+0000 7fc609c00640 1 -- 172.21.15.99:0/1151574161 >> 172.21.15.99:0/1151574161 conn(0x7fc6040d0450 msgr2=0x7fc60415ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.861+0000 7fc609c00640 1 -- 172.21.15.99:0/1151574161 shutdown_connections 2024-03-30T13:14:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:01.861+0000 7fc609c00640 1 -- 172.21.15.99:0/1151574161 wait complete. 2024-03-30T13:14:01.886 DEBUG:tasks.cephfs.test_uninlining:getting inode info #11 of 23:1099511628389 2024-03-30T13:14:01.886 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628389 2024-03-30T13:14:01.887 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628389 2024-03-30T13:14:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.054+0000 7fc1d1800640 1 Processor -- start 2024-03-30T13:14:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.055+0000 7fc1d1800640 1 -- start start 2024-03-30T13:14:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.056+0000 7fc1d1800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc1cc06ee50 0x7fc1cc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.056+0000 7fc1d1800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1cc0aea00 con 0x7fc1cc0ae1c0 2024-03-30T13:14:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.056+0000 7fc1d1800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1cc0aece0 con 0x7fc1cc15b140 2024-03-30T13:14:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.056+0000 7fc1d1800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc1cc0aefc0 con 0x7fc1cc06ee50 2024-03-30T13:14:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.056+0000 7fc1c3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc1cc06ee50 0x7fc1cc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.056+0000 7fc1c3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc1cc06ee50 0x7fc1cc0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55304/0 (socket says 172.21.15.99:55304) 2024-03-30T13:14:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.056+0000 7fc1c3400640 1 -- 172.21.15.99:0/3248024072 learned_addr learned my addr 172.21.15.99:0/3248024072 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.056+0000 7fc1d0e00640 1 --1- 172.21.15.99:0/3248024072 >> v1:172.21.15.99:6789/0 conn(0x7fc1cc0ae1c0 0x7fc1cc071810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33426/0 (socket says 172.21.15.99:33426) 2024-03-30T13:14:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.057+0000 7fc1c3400640 1 -- 172.21.15.99:0/3248024072 >> v1:172.21.15.181:6789/0 conn(0x7fc1cc15b140 legacy=0x7fc1cc06e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.057+0000 7fc1c3400640 1 -- 172.21.15.99:0/3248024072 >> v1:172.21.15.99:6789/0 conn(0x7fc1cc0ae1c0 legacy=0x7fc1cc071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.057+0000 7fc1c3400640 1 -- 172.21.15.99:0/3248024072 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc0af2a0 con 0x7fc1cc06ee50 2024-03-30T13:14:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.057+0000 7fc1cb400640 1 -- 172.21.15.99:0/3248024072 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2648473414 0 0) 0x7fc1cc0aea00 con 0x7fc1cc0ae1c0 2024-03-30T13:14:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.058+0000 7fc1c3400640 1 --2- 172.21.15.99:0/3248024072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1cc06ee50 0x7fc1cc0adc80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009870 tx=0x7fc1b402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25399461b993722a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.058+0000 7fc1cb400640 1 -- 172.21.15.99:0/3248024072 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b402f840 con 0x7fc1cc06ee50 2024-03-30T13:14:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.058+0000 7fc1cb400640 1 -- 172.21.15.99:0/3248024072 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b402f9e0 con 0x7fc1cc06ee50 2024-03-30T13:14:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.058+0000 7fc1cb400640 1 -- 172.21.15.99:0/3248024072 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b402fdb0 con 0x7fc1cc06ee50 2024-03-30T13:14:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.059+0000 7fc1d1800640 1 -- 172.21.15.99:0/3248024072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1cc06ee50 msgr2=0x7fc1cc0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.059+0000 7fc1d1800640 1 --2- 172.21.15.99:0/3248024072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1cc06ee50 0x7fc1cc0adc80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009870 tx=0x7fc1b402ba20 comp rx=0 tx=0).stop 2024-03-30T13:14:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.059+0000 7fc1d1800640 1 -- 172.21.15.99:0/3248024072 shutdown_connections 2024-03-30T13:14:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.059+0000 7fc1d1800640 1 --2- 172.21.15.99:0/3248024072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1cc06ee50 0x7fc1cc0adc80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.059+0000 7fc1d1800640 1 -- 172.21.15.99:0/3248024072 >> 172.21.15.99:0/3248024072 conn(0x7fc1cc06bb40 msgr2=0x7fc1cc0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.059+0000 7fc1d1800640 1 -- 172.21.15.99:0/3248024072 shutdown_connections 2024-03-30T13:14:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.059+0000 7fc1d1800640 1 -- 172.21.15.99:0/3248024072 wait complete. 2024-03-30T13:14:02.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.060+0000 7fc1d1800640 1 Processor -- start 2024-03-30T13:14:02.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.060+0000 7fc1d1800640 1 -- start start 2024-03-30T13:14:02.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.061+0000 7fc1d1800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc06ee50 0x7fc1cc09d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.061+0000 7fc1d1800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1cc0ae1c0 0x7fc1cc0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.061+0000 7fc1d1800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc15b140 0x7fc1cc0b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.061+0000 7fc1d1800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc0ae5f0 con 0x7fc1cc0ae1c0 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.061+0000 7fc1d1800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc15b520 con 0x7fc1cc15b140 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.061+0000 7fc1d1800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc0ae770 con 0x7fc1cc06ee50 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1cc0ae1c0 0x7fc1cc0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1cc0ae1c0 0x7fc1cc0cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55320/0 (socket says 172.21.15.99:55320) 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c3400640 1 -- 172.21.15.99:0/1856994788 learned_addr learned my addr 172.21.15.99:0/1856994788 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1cbe00640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc06ee50 0x7fc1cc09d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1d0e00640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc15b140 0x7fc1cc0b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c3400640 1 -- 172.21.15.99:0/1856994788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc06ee50 msgr2=0x7fc1cc09d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c3400640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc06ee50 0x7fc1cc09d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c3400640 1 -- 172.21.15.99:0/1856994788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc15b140 msgr2=0x7fc1cc0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c3400640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc15b140 0x7fc1cc0b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c3400640 1 -- 172.21.15.99:0/1856994788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc0ca440 con 0x7fc1cc0ae1c0 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1cbe00640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc06ee50 0x7fc1cc09d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1d0e00640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc15b140 0x7fc1cc0b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c3400640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1cc0ae1c0 0x7fc1cc0cb200 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009870 tx=0x7fc1b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c8c00640 1 -- 172.21.15.99:0/1856994788 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4047070 con 0x7fc1cc0ae1c0 2024-03-30T13:14:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c8c00640 1 -- 172.21.15.99:0/1856994788 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b4037cc0 con 0x7fc1cc0ae1c0 2024-03-30T13:14:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1c8c00640 1 -- 172.21.15.99:0/1856994788 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4004270 con 0x7fc1cc0ae1c0 2024-03-30T13:14:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.062+0000 7fc1d1800640 1 -- 172.21.15.99:0/1856994788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1cc0ca720 con 0x7fc1cc0ae1c0 2024-03-30T13:14:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.063+0000 7fc1d1800640 1 -- 172.21.15.99:0/1856994788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1cc0cace0 con 0x7fc1cc0ae1c0 2024-03-30T13:14:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.065+0000 7fc1c8c00640 1 -- 172.21.15.99:0/1856994788 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc1b404a070 con 0x7fc1cc0ae1c0 2024-03-30T13:14:02.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.066+0000 7fc1c8c00640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc1a806c530 0x7fc1a806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.066+0000 7fc1c8c00640 1 -- 172.21.15.99:0/1856994788 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7fc1b40ada10 con 0x7fc1cc0ae1c0 2024-03-30T13:14:02.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.066+0000 7fc1cbe00640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc1a806c530 0x7fc1a806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.067+0000 7fc1d5bc6740 1 Processor -- start 2024-03-30T13:14:02.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.067+0000 7fc1d5bc6740 1 -- start start 2024-03-30T13:14:02.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.067+0000 7fc1cbe00640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc1a806c530 0x7fc1a806e9f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0012e0 tx=0x7fc1bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37470 0x55afeab5dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab5e4e0 0x55afeab364b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab369f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55afeaa9a330 con 0x55afeab37850 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55afeaa42620 con 0x55afeab37470 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55afeaa96440 con 0x55afeab5e4e0 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1d0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1d0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab369f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55330/0 (socket says 172.21.15.99:55330) 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1d0e00640 1 -- 172.21.15.99:0/2041540435 learned_addr learned my addr 172.21.15.99:0/2041540435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1cbe00640 1 --2- 172.21.15.99:0/2041540435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37470 0x55afeab5dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1c3400640 1 --2- 172.21.15.99:0/2041540435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab5e4e0 0x55afeab364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1d0e00640 1 -- 172.21.15.99:0/2041540435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab5e4e0 msgr2=0x55afeab364b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.068+0000 7fc1d0e00640 1 --2- 172.21.15.99:0/2041540435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab5e4e0 0x55afeab364b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.069+0000 7fc1d0e00640 1 -- 172.21.15.99:0/2041540435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37470 msgr2=0x55afeab5dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.069+0000 7fc1d0e00640 1 --2- 172.21.15.99:0/2041540435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37470 0x55afeab5dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.069+0000 7fc1d0e00640 1 -- 172.21.15.99:0/2041540435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afea87a920 con 0x55afeab37850 2024-03-30T13:14:02.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.069+0000 7fc1c3400640 1 --2- 172.21.15.99:0/2041540435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab5e4e0 0x55afeab364b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:02.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.069+0000 7fc1d0e00640 1 --2- 172.21.15.99:0/2041540435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab369f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4001730 tx=0x7fc1c4001bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549c6b9e804a94b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.069+0000 7fc1c0c00640 1 -- 172.21.15.99:0/2041540435 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c40074e0 con 0x55afeab37850 2024-03-30T13:14:02.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.069+0000 7fc1c0c00640 1 -- 172.21.15.99:0/2041540435 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c40047e0 con 0x55afeab37850 2024-03-30T13:14:02.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.069+0000 7fc1c0c00640 1 -- 172.21.15.99:0/2041540435 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4004bb0 con 0x55afeab37850 2024-03-30T13:14:02.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.070+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/2041540435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 msgr2=0x55afeab369f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.070+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/2041540435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab369f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4001730 tx=0x7fc1c4001bf0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.070+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/2041540435 shutdown_connections 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.070+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/2041540435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab369f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.070+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/2041540435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab5e4e0 0x55afeab364b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.070+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/2041540435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37470 0x55afeab5dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.070+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/2041540435 >> 172.21.15.99:0/2041540435 conn(0x55afeaafdbe0 msgr2=0x55afeab7c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.070+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/2041540435 shutdown_connections 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.070+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/2041540435 wait complete. 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.070+0000 7fc1d5bc6740 1 -- start start 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.071+0000 7fc1d5bc6740 1 Processor -- start 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.071+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37470 0x55afeab7e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab37850 0x55afeab61620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab645c0 0x55afeab64a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55afeab5db10 con 0x55afeab645c0 2024-03-30T13:14:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55afeaa559d0 con 0x55afeab37470 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55afeab56890 con 0x55afeab37850 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d5bc6740 10 client.0 _ll_register_callbacks cb 0x55afeaa91fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab645c0 0x55afeab64a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab645c0 0x55afeab64a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55342/0 (socket says 172.21.15.99:55342) 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d0e00640 1 -- 172.21.15.99:0/3974358191 learned_addr learned my addr 172.21.15.99:0/3974358191 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1cbe00640 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37470 0x55afeab7e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1c3400640 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab37850 0x55afeab61620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d0e00640 1 -- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab37850 msgr2=0x55afeab61620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d0e00640 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab37850 0x55afeab61620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d0e00640 1 -- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37470 msgr2=0x55afeab7e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d0e00640 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37470 0x55afeab7e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.072+0000 7fc1d0e00640 1 -- 172.21.15.99:0/3974358191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afea76e210 con 0x55afeab645c0 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1d0e00640 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab645c0 0x55afeab64a40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40070a0 tx=0x7fc1c40012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42481db4104a884 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1b9600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1b9600640 1 -- 172.21.15.99:0/3974358191 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4023070 con 0x55afeab645c0 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1b9600640 1 -- 172.21.15.99:0/3974358191 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7fc1c400d6d0 con 0x55afeab645c0 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/3974358191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1c40047e0 con 0x55afeab645c0 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1b9600640 1 -- 172.21.15.99:0/3974358191 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc1c4001320 con 0x55afeab645c0 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1d5bc6740 10 client.6090 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/3974358191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55afea8db0b0 con 0x55afeab645c0 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1b9600640 1 -- 172.21.15.99:0/3974358191 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c40047e0 con 0x55afeab645c0 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1b9600640 1 -- 172.21.15.99:0/3974358191 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc1c400d8d0 con 0x55afeab645c0 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1d5bc6740 10 client.6090 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1d5bc6740 10 client.6090 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1d5bc6740 20 client.6090 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55afeab55160 0x55afeab55560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1d5bc6740 4 client.6090 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.073+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/3974358191 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afeaaa7870 con 0x55afeab55160 2024-03-30T13:14:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.074+0000 7fc1cbe00640 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55afeab55160 0x55afeab55560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.075+0000 7fc1cbe00640 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55afeab55160 0x55afeab55560 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da88b1ae1e731898 server_cookie=ef7d6a6a67b90a14 in_seq=0 out_seq=0 2024-03-30T13:14:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.075+0000 7fc1b9600640 10 client.6090 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.076+0000 7fc1b9600640 1 -- 172.21.15.99:0/3974358191 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55afeaaa7870 con 0x55afeab55160 2024-03-30T13:14:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.076+0000 7fc1b9600640 10 client.6090 handle_command_reply: tid=0 2024-03-30T13:14:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.076+0000 7fc1d5bc6740 1 client.6090 shutdown 2024-03-30T13:14:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.076+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/3974358191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab645c0 msgr2=0x55afeab64a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.076+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab645c0 0x55afeab64a40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40070a0 tx=0x7fc1c40012b0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.076+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/3974358191 shutdown_connections 2024-03-30T13:14:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.076+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab645c0 0x55afeab64a40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.076+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab37850 0x55afeab61620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.076+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55afeab55160 0x55afeab55560 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.076+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/3974358191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37470 0x55afeab7e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.076+0000 7fc1b9600640 0 client.6090 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.077+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/3974358191 >> 172.21.15.99:0/3974358191 conn(0x55afeaafdbe0 msgr2=0x55afeab30b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.077+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/3974358191 shutdown_connections 2024-03-30T13:14:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.077+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/3974358191 wait complete. 2024-03-30T13:14:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.077+0000 7fc1d5bc6740 20 client.6090 trim_cache size 0 max 16384 2024-03-30T13:14:02.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.092+0000 7fc1d5bc6740 1 Processor -- start 2024-03-30T13:14:02.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.092+0000 7fc1d5bc6740 1 -- start start 2024-03-30T13:14:02.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.093+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab37470 0x55afeab7fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.093+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab800c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.093+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab645c0 0x55afeab303f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.093+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc200c50 con 0x55afeab37850 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.093+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc0cd3b0 con 0x55afeab645c0 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.093+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc0cc710 con 0x55afeab37470 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.093+0000 7fc1c3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab800c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.093+0000 7fc1c3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab800c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55346/0 (socket says 172.21.15.99:55346) 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.093+0000 7fc1c3400640 1 -- 172.21.15.99:0/1962773911 learned_addr learned my addr 172.21.15.99:0/1962773911 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.094+0000 7fc1d0e00640 1 --2- 172.21.15.99:0/1962773911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab645c0 0x55afeab303f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.094+0000 7fc1c3400640 1 -- 172.21.15.99:0/1962773911 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab37470 msgr2=0x55afeab7fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.094+0000 7fc1c3400640 1 --2- 172.21.15.99:0/1962773911 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab37470 0x55afeab7fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.094+0000 7fc1c3400640 1 -- 172.21.15.99:0/1962773911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab645c0 msgr2=0x55afeab303f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.094+0000 7fc1c3400640 1 --2- 172.21.15.99:0/1962773911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab645c0 0x55afeab303f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.094+0000 7fc1c3400640 1 -- 172.21.15.99:0/1962773911 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afea7472d0 con 0x55afeab37850 2024-03-30T13:14:02.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.094+0000 7fc1c3400640 1 --2- 172.21.15.99:0/1962773911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab800c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4083f00 tx=0x7fc1b4009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7388338c97c18add server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.094+0000 7fc1bbe00640 1 -- 172.21.15.99:0/1962773911 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4093020 con 0x55afeab37850 2024-03-30T13:14:02.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.094+0000 7fc1bbe00640 1 -- 172.21.15.99:0/1962773911 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b407b850 con 0x55afeab37850 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.094+0000 7fc1bbe00640 1 -- 172.21.15.99:0/1962773911 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b407fc00 con 0x55afeab37850 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.095+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1962773911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 msgr2=0x55afeab800c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.095+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/1962773911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab800c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4083f00 tx=0x7fc1b4009240 comp rx=0 tx=0).stop 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.095+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1962773911 shutdown_connections 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.095+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/1962773911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab645c0 0x55afeab303f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.095+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/1962773911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37850 0x55afeab800c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.095+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/1962773911 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab37470 0x55afeab7fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.095+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1962773911 >> 172.21.15.99:0/1962773911 conn(0x55afeaafdbe0 msgr2=0x55afeab5dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.095+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1962773911 shutdown_connections 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.095+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1962773911 wait complete. 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.096+0000 7fc1d5bc6740 1 -- start start 2024-03-30T13:14:02.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.096+0000 7fc1d5bc6740 1 Processor -- start 2024-03-30T13:14:02.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37470 0x55afeab55540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37850 0x55afeabf48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1d5bc6740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab645c0 0x55afeab7faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55afeab5d990 con 0x55afeab37470 2024-03-30T13:14:02.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc0ccd60 con 0x55afeab37850 2024-03-30T13:14:02.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1d5bc6740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55afeabfb160 con 0x55afeab645c0 2024-03-30T13:14:02.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1d5bc6740 10 client.0 _ll_register_callbacks cb 0x7fc1c4001580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:02.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1cbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37470 0x55afeab55540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1cbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37470 0x55afeab55540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55354/0 (socket says 172.21.15.99:55354) 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1cbe00640 1 -- 172.21.15.99:0/1897363096 learned_addr learned my addr 172.21.15.99:0/1897363096 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1cbe00640 1 -- 172.21.15.99:0/1897363096 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab645c0 msgr2=0x55afeab7faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1cbe00640 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab645c0 0x55afeab7faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1cbe00640 1 -- 172.21.15.99:0/1897363096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37850 msgr2=0x55afeabf48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1c3400640 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37850 0x55afeabf48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.097+0000 7fc1cbe00640 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37850 0x55afeabf48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.098+0000 7fc1cbe00640 1 -- 172.21.15.99:0/1897363096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afeabf4e30 con 0x55afeab37470 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.098+0000 7fc1cbe00640 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37470 0x55afeab55540 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x55afeab55ad0 tx=0x7fc1bc001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2c4a0762b0a3dd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.098+0000 7fc1b9600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.098+0000 7fc1b9600640 1 -- 172.21.15.99:0/1897363096 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc02d060 con 0x55afeab37470 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.098+0000 7fc1b9600640 1 -- 172.21.15.99:0/1897363096 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7fc1bc0271d0 con 0x55afeab37470 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.098+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1897363096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b407b850 con 0x55afeab37470 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.098+0000 7fc1b9600640 1 -- 172.21.15.99:0/1897363096 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc1bc006e20 con 0x55afeab37470 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.098+0000 7fc1d5bc6740 10 client.6096 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:02.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.098+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1897363096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55afeab36310 con 0x55afeab37470 2024-03-30T13:14:02.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.099+0000 7fc1b9600640 1 -- 172.21.15.99:0/1897363096 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b407b850 con 0x55afeab37470 2024-03-30T13:14:02.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.099+0000 7fc1b9600640 1 -- 172.21.15.99:0/1897363096 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc1bc0273d0 con 0x55afeab37470 2024-03-30T13:14:02.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.099+0000 7fc1d5bc6740 10 client.6096 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:02.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.099+0000 7fc1d5bc6740 10 client.6096 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:02.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.099+0000 7fc1d5bc6740 20 client.6096 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:02.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.099+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55afeab80080 0x55afeabf78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.099+0000 7fc1d5bc6740 4 client.6096 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628389}] 2024-03-30T13:14:02.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.099+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1897363096 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628389}) -- 0x55afeab36880 con 0x55afeab80080 2024-03-30T13:14:02.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.099+0000 7fc1c3400640 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55afeab80080 0x55afeabf78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.100+0000 7fc1b9600640 10 client.6096 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.100+0000 7fc1c3400640 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55afeab80080 0x55afeabf78c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ff1a2c36225869e server_cookie=a25035a1f6a3d8dd in_seq=0 out_seq=0 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1b9600640 1 -- 172.21.15.99:0/1897363096 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4753 (crc 0 0 0) 0x55afeab36880 con 0x55afeab80080 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1b9600640 10 client.6096 handle_command_reply: tid=0 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 1 client.6096 shutdown 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1897363096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37470 msgr2=0x55afeab55540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37470 0x55afeab55540 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x55afeab55ad0 tx=0x7fc1bc001400 comp rx=0 tx=0).stop 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1897363096 shutdown_connections 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55afeab645c0 0x55afeab7faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55afeab80080 0x55afeabf78c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55afeab37850 0x55afeabf48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 1 --2- 172.21.15.99:0/1897363096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55afeab37470 0x55afeab55540 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1b9600640 0 client.6096 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1897363096 >> 172.21.15.99:0/1897363096 conn(0x55afeaafdbe0 msgr2=0x55afeab5db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1897363096 shutdown_connections 2024-03-30T13:14:02.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 1 -- 172.21.15.99:0/1897363096 wait complete. 2024-03-30T13:14:02.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.101+0000 7fc1d5bc6740 20 client.6096 trim_cache size 0 max 16384 2024-03-30T13:14:02.109 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/acl.h", 2024-03-30T13:14:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628389, 2024-03-30T13:14:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.578450+0000", 2024-03-30T13:14:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.633875+0000", 2024-03-30T13:14:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1502, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.633875+0000", 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1502, 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.578450+0000" 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1502, 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.578450+0000" 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 180, 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 8, 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:02.123 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:02.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 -- 172.21.15.99:0/1856994788 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc1a806c530 msgr2=0x7fc1a806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc1a806c530 0x7fc1a806e9f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0012e0 tx=0x7fc1bc009040 comp rx=0 tx=0).stop 2024-03-30T13:14:02.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 -- 172.21.15.99:0/1856994788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1cc0ae1c0 msgr2=0x7fc1cc0cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1cc0ae1c0 0x7fc1cc0cb200 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009870 tx=0x7fc1b4004730 comp rx=0 tx=0).stop 2024-03-30T13:14:02.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 -- 172.21.15.99:0/1856994788 shutdown_connections 2024-03-30T13:14:02.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc1a806c530 0x7fc1a806e9f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc15b140 0x7fc1cc0b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1cc0ae1c0 0x7fc1cc0cb200 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 --2- 172.21.15.99:0/1856994788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc06ee50 0x7fc1cc09d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 -- 172.21.15.99:0/1856994788 >> 172.21.15.99:0/1856994788 conn(0x7fc1cc06bb40 msgr2=0x7fc1cc071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 -- 172.21.15.99:0/1856994788 shutdown_connections 2024-03-30T13:14:02.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.102+0000 7fc1d1800640 1 -- 172.21.15.99:0/1856994788 wait complete. 2024-03-30T13:14:02.126 DEBUG:tasks.cephfs.test_uninlining:getting inode info #12 of 23:1099511628403 2024-03-30T13:14:02.126 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628403 2024-03-30T13:14:02.126 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628403 2024-03-30T13:14:02.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.329+0000 7fb34ee00640 1 Processor -- start 2024-03-30T13:14:02.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.329+0000 7fb34ee00640 1 -- start start 2024-03-30T13:14:02.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.330+0000 7fb34ee00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3480b28c0 0x7fb34815be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.330+0000 7fb34ee00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3480cade0 con 0x7fb34815b3d0 2024-03-30T13:14:02.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.330+0000 7fb34ee00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3480c6470 con 0x7fb3480ca950 2024-03-30T13:14:02.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.330+0000 7fb34ee00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb3480c6240 con 0x7fb3480b28c0 2024-03-30T13:14:02.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.331+0000 7fb347e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb34815b3d0 0x7fb3480b49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33442/0 (socket says 172.21.15.99:33442) 2024-03-30T13:14:02.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.331+0000 7fb347e00640 1 -- 172.21.15.99:0/1897086651 learned_addr learned my addr 172.21.15.99:0/1897086651 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.331+0000 7fb34ce00640 1 --2- 172.21.15.99:0/1897086651 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3480b28c0 0x7fb34815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.331+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014057468 0 0) 0x7fb3480cade0 con 0x7fb34815b3d0 2024-03-30T13:14:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.331+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb32c003520 con 0x7fb34815b3d0 2024-03-30T13:14:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.331+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1640817572 0 0) 0x7fb32c003520 con 0x7fb34815b3d0 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.331+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3480b28c0 msgr2=0x7fb34815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.331+0000 7fb346a00640 1 --2- 172.21.15.99:0/1897086651 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3480b28c0 0x7fb34815be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.331+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 >> v1:172.21.15.181:6789/0 conn(0x7fb3480ca950 legacy=0x7fb3480b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.331+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3480c6750 con 0x7fb34815b3d0 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.331+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fb338001670 con 0x7fb34815b3d0 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 >> v1:172.21.15.99:6789/0 conn(0x7fb34815b3d0 legacy=0x7fb3480b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb346a00640 1 --2- 172.21.15.99:0/1897086651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32c0039e0 0x7fb32c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb346a00640 1 --2- 172.21.15.99:0/1897086651 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3480b28c0 0x7fb32c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb346a00640 1 --2- 172.21.15.99:0/1897086651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb32c004d40 0x7fb32c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c00bad0 con 0x7fb32c0039e0 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c00bc80 con 0x7fb32c004d40 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb32c00be80 con 0x7fb3480b28c0 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb347e00640 1 --2- 172.21.15.99:0/1897086651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32c0039e0 0x7fb32c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb347e00640 1 -- 172.21.15.99:0/1897086651 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3480b28c0 msgr2=0x7fb32c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb347e00640 1 --2- 172.21.15.99:0/1897086651 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb3480b28c0 0x7fb32c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb347e00640 1 -- 172.21.15.99:0/1897086651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb32c004d40 msgr2=0x7fb32c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb34ce00640 1 --2- 172.21.15.99:0/1897086651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb32c004d40 0x7fb32c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb347e00640 1 --2- 172.21.15.99:0/1897086651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb32c004d40 0x7fb32c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.332+0000 7fb347e00640 1 -- 172.21.15.99:0/1897086651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c003520 con 0x7fb32c0039e0 2024-03-30T13:14:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.333+0000 7fb347e00640 1 --2- 172.21.15.99:0/1897086651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32c0039e0 0x7fb32c003e00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c0e0 tx=0x7fb32c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260498295731a125 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.334+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338007c20 con 0x7fb32c0039e0 2024-03-30T13:14:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.334+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb338030070 con 0x7fb32c0039e0 2024-03-30T13:14:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.334+0000 7fb346a00640 1 -- 172.21.15.99:0/1897086651 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338005d30 con 0x7fb32c0039e0 2024-03-30T13:14:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.334+0000 7fb34ee00640 1 -- 172.21.15.99:0/1897086651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32c0039e0 msgr2=0x7fb32c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.334+0000 7fb34ee00640 1 --2- 172.21.15.99:0/1897086651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32c0039e0 0x7fb32c003e00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c0e0 tx=0x7fb32c005830 comp rx=0 tx=0).stop 2024-03-30T13:14:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.334+0000 7fb34ce00640 1 -- 172.21.15.99:0/1897086651 reap_dead start 2024-03-30T13:14:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.334+0000 7fb34ee00640 1 -- 172.21.15.99:0/1897086651 shutdown_connections 2024-03-30T13:14:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.334+0000 7fb34ee00640 1 -- 172.21.15.99:0/1897086651 >> 172.21.15.99:0/1897086651 conn(0x7fb3480d0450 msgr2=0x7fb3480d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.334+0000 7fb34ee00640 1 -- 172.21.15.99:0/1897086651 shutdown_connections 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.334+0000 7fb34ee00640 1 -- 172.21.15.99:0/1897086651 wait complete. 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.336+0000 7fb34ee00640 1 Processor -- start 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.336+0000 7fb34ee00640 1 -- start start 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.337+0000 7fb34ee00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb32c0039e0 0x7fb3480ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.337+0000 7fb34ee00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3480717d0 0x7fb348071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.337+0000 7fb34ee00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3480c72b0 0x7fb3480c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.337+0000 7fb34ee00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb3480c6d10 con 0x7fb3480717d0 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.337+0000 7fb34ee00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb3480c7080 con 0x7fb3480c72b0 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.337+0000 7fb34ee00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb3480b5100 con 0x7fb32c0039e0 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.337+0000 7fb347400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3480717d0 0x7fb348071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.337+0000 7fb347400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3480717d0 0x7fb348071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55368/0 (socket says 172.21.15.99:55368) 2024-03-30T13:14:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.337+0000 7fb347400640 1 -- 172.21.15.99:0/1823413368 learned_addr learned my addr 172.21.15.99:0/1823413368 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb34ce00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3480c72b0 0x7fb3480c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb347e00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb32c0039e0 0x7fb3480ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb347400640 1 -- 172.21.15.99:0/1823413368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb32c0039e0 msgr2=0x7fb3480ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb347400640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb32c0039e0 0x7fb3480ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb347400640 1 -- 172.21.15.99:0/1823413368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3480c72b0 msgr2=0x7fb3480c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb347400640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3480c72b0 0x7fb3480c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb347400640 1 -- 172.21.15.99:0/1823413368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3480c94c0 con 0x7fb3480717d0 2024-03-30T13:14:02.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb34ce00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3480c72b0 0x7fb3480c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:02.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb347400640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3480717d0 0x7fb348071c30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c530 tx=0x7fb33400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb33fe00640 1 -- 172.21.15.99:0/1823413368 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3340052d0 con 0x7fb3480717d0 2024-03-30T13:14:02.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb33fe00640 1 -- 172.21.15.99:0/1823413368 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb334005470 con 0x7fb3480717d0 2024-03-30T13:14:02.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb33fe00640 1 -- 172.21.15.99:0/1823413368 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334012870 con 0x7fb3480717d0 2024-03-30T13:14:02.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.338+0000 7fb34ee00640 1 -- 172.21.15.99:0/1823413368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb348072320 con 0x7fb3480717d0 2024-03-30T13:14:02.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.339+0000 7fb34ee00640 1 -- 172.21.15.99:0/1823413368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3480728e0 con 0x7fb3480717d0 2024-03-30T13:14:02.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.340+0000 7fb33fe00640 1 -- 172.21.15.99:0/1823413368 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb334012a10 con 0x7fb3480717d0 2024-03-30T13:14:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.341+0000 7fb33fe00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb32806c560 0x7fb32806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.342+0000 7fb33fe00640 1 -- 172.21.15.99:0/1823413368 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7fb33408b450 con 0x7fb3480717d0 2024-03-30T13:14:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.342+0000 7fb347e00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb32806c560 0x7fb32806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.342+0000 7fb351c02740 1 Processor -- start 2024-03-30T13:14:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.342+0000 7fb347e00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb32806c560 0x7fb32806ea20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb338034000 tx=0x7fb338007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.342+0000 7fb351c02740 1 -- start start 2024-03-30T13:14:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.343+0000 7fb351c02740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44290 0x556905f6adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.343+0000 7fb351c02740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f6b300 0x556905f432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.343+0000 7fb351c02740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44670 0x556905f43810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.343+0000 7fb351c02740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556905ea7330 con 0x556905f6b300 2024-03-30T13:14:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.343+0000 7fb351c02740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556905e4f620 con 0x556905f44290 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.343+0000 7fb351c02740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x556905ea3440 con 0x556905f44670 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.343+0000 7fb347400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f6b300 0x556905f432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.343+0000 7fb347400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f6b300 0x556905f432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55380/0 (socket says 172.21.15.99:55380) 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.343+0000 7fb347400640 1 -- 172.21.15.99:0/4190011659 learned_addr learned my addr 172.21.15.99:0/4190011659 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.344+0000 7fb347e00640 1 --2- 172.21.15.99:0/4190011659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44290 0x556905f6adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.344+0000 7fb347400640 1 -- 172.21.15.99:0/4190011659 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44670 msgr2=0x556905f43810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.344+0000 7fb347400640 1 --2- 172.21.15.99:0/4190011659 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44670 0x556905f43810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.344+0000 7fb347400640 1 -- 172.21.15.99:0/4190011659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44290 msgr2=0x556905f6adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.344+0000 7fb347400640 1 --2- 172.21.15.99:0/4190011659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44290 0x556905f6adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.344+0000 7fb347400640 1 -- 172.21.15.99:0/4190011659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556905c87920 con 0x556905f6b300 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.344+0000 7fb347e00640 1 --2- 172.21.15.99:0/4190011659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44290 0x556905f6adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.344+0000 7fb347400640 1 --2- 172.21.15.99:0/4190011659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f6b300 0x556905f432d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb334058f00 tx=0x7fb3340599c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ada31d76a96192d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.344+0000 7fb33cc00640 1 -- 172.21.15.99:0/4190011659 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334084020 con 0x556905f6b300 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.344+0000 7fb33cc00640 1 -- 172.21.15.99:0/4190011659 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb334061de0 con 0x556905f6b300 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.344+0000 7fb33cc00640 1 -- 172.21.15.99:0/4190011659 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334055870 con 0x556905f6b300 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.345+0000 7fb351c02740 1 -- 172.21.15.99:0/4190011659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f6b300 msgr2=0x556905f432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.345+0000 7fb351c02740 1 --2- 172.21.15.99:0/4190011659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f6b300 0x556905f432d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb334058f00 tx=0x7fb3340599c0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.345+0000 7fb351c02740 1 -- 172.21.15.99:0/4190011659 shutdown_connections 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.345+0000 7fb351c02740 1 --2- 172.21.15.99:0/4190011659 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44670 0x556905f43810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.345+0000 7fb351c02740 1 --2- 172.21.15.99:0/4190011659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f6b300 0x556905f432d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.345+0000 7fb351c02740 1 --2- 172.21.15.99:0/4190011659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44290 0x556905f6adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.345+0000 7fb351c02740 1 -- 172.21.15.99:0/4190011659 >> 172.21.15.99:0/4190011659 conn(0x556905f0abe0 msgr2=0x556905f88fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.345+0000 7fb351c02740 1 -- 172.21.15.99:0/4190011659 shutdown_connections 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.345+0000 7fb351c02740 1 -- 172.21.15.99:0/4190011659 wait complete. 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.346+0000 7fb351c02740 1 -- start start 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.346+0000 7fb351c02740 1 Processor -- start 2024-03-30T13:14:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.347+0000 7fb351c02740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44290 0x556905f6a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.347+0000 7fb351c02740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44670 0x556905f98830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.347+0000 7fb351c02740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f81e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.347+0000 7fb351c02740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556905f6a930 con 0x556905f620e0 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.347+0000 7fb351c02740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556905e629d0 con 0x556905f44670 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.347+0000 7fb351c02740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x556905f636b0 con 0x556905f44290 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.347+0000 7fb351c02740 10 client.0 _ll_register_callbacks cb 0x556905e9efd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.347+0000 7fb34ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f81e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.347+0000 7fb34ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f81e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55394/0 (socket says 172.21.15.99:55394) 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.347+0000 7fb34ce00640 1 -- 172.21.15.99:0/3290754194 learned_addr learned my addr 172.21.15.99:0/3290754194 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb347e00640 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44290 0x556905f6a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb347400640 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44670 0x556905f98830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb34ce00640 1 -- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44290 msgr2=0x556905f6a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb34ce00640 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44290 0x556905f6a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb34ce00640 1 -- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44670 msgr2=0x556905f98830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb34ce00640 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44670 0x556905f98830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb34ce00640 1 -- 172.21.15.99:0/3290754194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556905b7b210 con 0x556905f620e0 2024-03-30T13:14:02.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb347e00640 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44290 0x556905f6a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:02.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb34ce00640 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f81e40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb3480b63e0 tx=0x7fb340004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72f2efef8b2cb64 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb331600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:02.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb331600640 1 -- 172.21.15.99:0/3290754194 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34001b060 con 0x556905f620e0 2024-03-30T13:14:02.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb331600640 1 -- 172.21.15.99:0/3290754194 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7fb340007b90 con 0x556905f620e0 2024-03-30T13:14:02.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb351c02740 1 -- 172.21.15.99:0/3290754194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb334061de0 con 0x556905f620e0 2024-03-30T13:14:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.348+0000 7fb331600640 1 -- 172.21.15.99:0/3290754194 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb340021050 con 0x556905f620e0 2024-03-30T13:14:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.349+0000 7fb351c02740 10 client.6108 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.349+0000 7fb351c02740 1 -- 172.21.15.99:0/3290754194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x556905ce80b0 con 0x556905f620e0 2024-03-30T13:14:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.349+0000 7fb331600640 1 -- 172.21.15.99:0/3290754194 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb334061de0 con 0x556905f620e0 2024-03-30T13:14:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.349+0000 7fb331600640 1 -- 172.21.15.99:0/3290754194 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fb340024020 con 0x556905f620e0 2024-03-30T13:14:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.349+0000 7fb351c02740 10 client.6108 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.349+0000 7fb351c02740 10 client.6108 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.349+0000 7fb351c02740 20 client.6108 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.349+0000 7fb351c02740 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556905f85ec0 0x556905f7fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.349+0000 7fb351c02740 4 client.6108 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.349+0000 7fb351c02740 1 -- 172.21.15.99:0/3290754194 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556905eb4870 con 0x556905f85ec0 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.350+0000 7fb347e00640 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556905f85ec0 0x556905f7fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.350+0000 7fb347e00640 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556905f85ec0 0x556905f7fc60 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2e1339a7284c56e server_cookie=943bb46ee69958ae in_seq=0 out_seq=0 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.350+0000 7fb331600640 10 client.6108 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb331600640 1 -- 172.21.15.99:0/3290754194 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x556905eb4870 con 0x556905f85ec0 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb331600640 10 client.6108 handle_command_reply: tid=0 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 1 client.6108 shutdown 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 1 -- 172.21.15.99:0/3290754194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 msgr2=0x556905f81e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f81e40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb3480b63e0 tx=0x7fb340004700 comp rx=0 tx=0).stop 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 1 -- 172.21.15.99:0/3290754194 shutdown_connections 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f81e40 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556905f85ec0 0x556905f7fc60 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44670 0x556905f98830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 1 --2- 172.21.15.99:0/3290754194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44290 0x556905f6a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb331600640 0 client.6108 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 1 -- 172.21.15.99:0/3290754194 >> 172.21.15.99:0/3290754194 conn(0x556905f0abe0 msgr2=0x556905f6dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 1 -- 172.21.15.99:0/3290754194 shutdown_connections 2024-03-30T13:14:02.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 1 -- 172.21.15.99:0/3290754194 wait complete. 2024-03-30T13:14:02.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.352+0000 7fb351c02740 20 client.6108 trim_cache size 0 max 16384 2024-03-30T13:14:02.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.368+0000 7fb351c02740 1 Processor -- start 2024-03-30T13:14:02.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.368+0000 7fb351c02740 1 -- start start 2024-03-30T13:14:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.369+0000 7fb351c02740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f44290 0x556905f98610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.369+0000 7fb351c02740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44670 0x556905f7fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.369+0000 7fb351c02740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f620e0 0x556905f801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.369+0000 7fb351c02740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb3481ff4b0 con 0x556905f44290 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.369+0000 7fb351c02740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb3481fe4f0 con 0x556905f620e0 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.369+0000 7fb351c02740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb34815d500 con 0x556905f44670 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.369+0000 7fb347e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f44290 0x556905f98610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.369+0000 7fb347e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f44290 0x556905f98610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55408/0 (socket says 172.21.15.99:55408) 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.369+0000 7fb347e00640 1 -- 172.21.15.99:0/892523782 learned_addr learned my addr 172.21.15.99:0/892523782 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.370+0000 7fb347400640 1 --2- 172.21.15.99:0/892523782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44670 0x556905f7fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.370+0000 7fb34ce00640 1 --2- 172.21.15.99:0/892523782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f620e0 0x556905f801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.370+0000 7fb347e00640 1 -- 172.21.15.99:0/892523782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44670 msgr2=0x556905f7fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.370+0000 7fb347e00640 1 --2- 172.21.15.99:0/892523782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44670 0x556905f7fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.370+0000 7fb347e00640 1 -- 172.21.15.99:0/892523782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f620e0 msgr2=0x556905f801a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.370+0000 7fb347e00640 1 --2- 172.21.15.99:0/892523782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f620e0 0x556905f801a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.370+0000 7fb347e00640 1 -- 172.21.15.99:0/892523782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556905b542d0 con 0x556905f44290 2024-03-30T13:14:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.370+0000 7fb347e00640 1 --2- 172.21.15.99:0/892523782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f44290 0x556905f98610 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c140 tx=0x7fb33802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b943c14739804065 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.370+0000 7fb333e00640 1 -- 172.21.15.99:0/892523782 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338054070 con 0x556905f44290 2024-03-30T13:14:02.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.370+0000 7fb333e00640 1 -- 172.21.15.99:0/892523782 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb338030040 con 0x556905f44290 2024-03-30T13:14:02.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.370+0000 7fb333e00640 1 -- 172.21.15.99:0/892523782 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33804f440 con 0x556905f44290 2024-03-30T13:14:02.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.371+0000 7fb351c02740 1 -- 172.21.15.99:0/892523782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f44290 msgr2=0x556905f98610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.371+0000 7fb351c02740 1 --2- 172.21.15.99:0/892523782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f44290 0x556905f98610 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c140 tx=0x7fb33802e000 comp rx=0 tx=0).stop 2024-03-30T13:14:02.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.371+0000 7fb351c02740 1 -- 172.21.15.99:0/892523782 shutdown_connections 2024-03-30T13:14:02.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.371+0000 7fb351c02740 1 --2- 172.21.15.99:0/892523782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f620e0 0x556905f801a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.371+0000 7fb351c02740 1 --2- 172.21.15.99:0/892523782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44670 0x556905f7fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.371+0000 7fb351c02740 1 --2- 172.21.15.99:0/892523782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f44290 0x556905f98610 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.371+0000 7fb351c02740 1 -- 172.21.15.99:0/892523782 >> 172.21.15.99:0/892523782 conn(0x556905f0abe0 msgr2=0x556905f425b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.371+0000 7fb351c02740 1 -- 172.21.15.99:0/892523782 shutdown_connections 2024-03-30T13:14:02.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.371+0000 7fb351c02740 1 -- 172.21.15.99:0/892523782 wait complete. 2024-03-30T13:14:02.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.372+0000 7fb351c02740 1 -- start start 2024-03-30T13:14:02.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.372+0000 7fb351c02740 1 Processor -- start 2024-03-30T13:14:02.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb351c02740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44290 0x556905fab110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb351c02740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44670 0x556905fab650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb351c02740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f96fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb351c02740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556905f45370 con 0x556905f620e0 2024-03-30T13:14:02.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb351c02740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb3481fded0 con 0x556905f44670 2024-03-30T13:14:02.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb351c02740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x556905f83070 con 0x556905f44290 2024-03-30T13:14:02.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb351c02740 10 client.0 _ll_register_callbacks cb 0x7fb340009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:02.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb34ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f96fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb34ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f96fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55418/0 (socket says 172.21.15.99:55418) 2024-03-30T13:14:02.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb34ce00640 1 -- 172.21.15.99:0/711263057 learned_addr learned my addr 172.21.15.99:0/711263057 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb347400640 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44670 0x556905fab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.373+0000 7fb347e00640 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44290 0x556905fab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.374+0000 7fb34ce00640 1 -- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44290 msgr2=0x556905fab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.374+0000 7fb34ce00640 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44290 0x556905fab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.374+0000 7fb34ce00640 1 -- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44670 msgr2=0x556905fab650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.374+0000 7fb34ce00640 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44670 0x556905fab650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.374+0000 7fb34ce00640 1 -- 172.21.15.99:0/711263057 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556905f8b0e0 con 0x556905f620e0 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.374+0000 7fb347400640 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44670 0x556905fab650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.374+0000 7fb34ce00640 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f96fc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb340007100 tx=0x7fb340004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d928e978b555fed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.374+0000 7fb331600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.374+0000 7fb331600640 1 -- 172.21.15.99:0/711263057 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb340029070 con 0x556905f620e0 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.374+0000 7fb331600640 1 -- 172.21.15.99:0/711263057 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7fb3400168e0 con 0x556905f620e0 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.374+0000 7fb351c02740 1 -- 172.21.15.99:0/711263057 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb338030040 con 0x556905f620e0 2024-03-30T13:14:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.375+0000 7fb331600640 1 -- 172.21.15.99:0/711263057 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb340033050 con 0x556905f620e0 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.375+0000 7fb351c02740 10 client.6114 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.375+0000 7fb351c02740 1 -- 172.21.15.99:0/711263057 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x556905f699f0 con 0x556905f620e0 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.375+0000 7fb331600640 1 -- 172.21.15.99:0/711263057 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb338030040 con 0x556905f620e0 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.375+0000 7fb331600640 1 -- 172.21.15.99:0/711263057 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fb340036020 con 0x556905f620e0 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.375+0000 7fb351c02740 10 client.6114 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.375+0000 7fb351c02740 10 client.6114 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.375+0000 7fb351c02740 20 client.6114 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.375+0000 7fb351c02740 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556905f97500 0x556905f978e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.375+0000 7fb351c02740 4 client.6114 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628403}] 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.375+0000 7fb351c02740 1 -- 172.21.15.99:0/711263057 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628403}) -- 0x556905eaebc0 con 0x556905f97500 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.376+0000 7fb347e00640 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556905f97500 0x556905f978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.376+0000 7fb347e00640 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556905f97500 0x556905f978e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d942bcfdf4040ac4 server_cookie=a1b3dfe7c994e279 in_seq=0 out_seq=0 2024-03-30T13:14:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.376+0000 7fb331600640 10 client.6114 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb331600640 1 -- 172.21.15.99:0/711263057 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4764 (crc 0 0 0) 0x556905eaebc0 con 0x556905f97500 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb331600640 10 client.6114 handle_command_reply: tid=0 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb351c02740 1 client.6114 shutdown 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb351c02740 1 -- 172.21.15.99:0/711263057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 msgr2=0x556905f96fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb351c02740 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f96fc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb340007100 tx=0x7fb340004ab0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb351c02740 1 -- 172.21.15.99:0/711263057 shutdown_connections 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb351c02740 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556905f620e0 0x556905f96fc0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb351c02740 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x556905f97500 0x556905f978e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb351c02740 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556905f44670 0x556905fab650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb351c02740 1 --2- 172.21.15.99:0/711263057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x556905f44290 0x556905fab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb331600640 0 client.6114 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb351c02740 1 -- 172.21.15.99:0/711263057 >> 172.21.15.99:0/711263057 conn(0x556905f0abe0 msgr2=0x556905f3d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb351c02740 1 -- 172.21.15.99:0/711263057 shutdown_connections 2024-03-30T13:14:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.377+0000 7fb351c02740 1 -- 172.21.15.99:0/711263057 wait complete. 2024-03-30T13:14:02.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.378+0000 7fb351c02740 20 client.6114 trim_cache size 0 max 16384 2024-03-30T13:14:02.386 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/xattr_trusted.c", 2024-03-30T13:14:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628403, 2024-03-30T13:14:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.585491+0000", 2024-03-30T13:14:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.673875+0000", 2024-03-30T13:14:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 1094, 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.673875+0000", 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1094, 2024-03-30T13:14:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.585491+0000" 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 1094, 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.585491+0000" 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 188, 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 36, 2024-03-30T13:14:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.398 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.399 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:02.400 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:02.401 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:02.402 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:02.402 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:02.402 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.378+0000 7fb34ee00640 1 -- 172.21.15.99:0/1823413368 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb32806c560 msgr2=0x7fb32806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.378+0000 7fb34ee00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb32806c560 0x7fb32806ea20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb338034000 tx=0x7fb338007000 comp rx=0 tx=0).stop 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.378+0000 7fb34ee00640 1 -- 172.21.15.99:0/1823413368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3480717d0 msgr2=0x7fb348071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.378+0000 7fb34ee00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3480717d0 0x7fb348071c30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c530 tx=0x7fb33400c9f0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.378+0000 7fb34ee00640 1 -- 172.21.15.99:0/1823413368 shutdown_connections 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.378+0000 7fb34ee00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb32806c560 0x7fb32806ea20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.378+0000 7fb34ee00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3480c72b0 0x7fb3480c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.378+0000 7fb34ee00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3480717d0 0x7fb348071c30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.378+0000 7fb34ee00640 1 --2- 172.21.15.99:0/1823413368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb32c0039e0 0x7fb3480ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.378+0000 7fb34ee00640 1 -- 172.21.15.99:0/1823413368 >> 172.21.15.99:0/1823413368 conn(0x7fb3480d0450 msgr2=0x7fb3480cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.379+0000 7fb34ee00640 1 -- 172.21.15.99:0/1823413368 shutdown_connections 2024-03-30T13:14:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.379+0000 7fb34ee00640 1 -- 172.21.15.99:0/1823413368 wait complete. 2024-03-30T13:14:02.405 DEBUG:tasks.cephfs.test_uninlining:getting inode info #13 of 23:1099511628401 2024-03-30T13:14:02.405 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628401 2024-03-30T13:14:02.405 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628401 2024-03-30T13:14:02.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.609+0000 7ff57e200640 1 Processor -- start 2024-03-30T13:14:02.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.610+0000 7ff57e200640 1 -- start start 2024-03-30T13:14:02.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.611+0000 7ff57e200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff578162e50 0x7ff578099730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.611+0000 7ff57e200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff5780cddb0 0x7ff5780ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.611+0000 7ff57e200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5780c56e0 con 0x7ff578099c70 2024-03-30T13:14:02.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.611+0000 7ff57e200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff5780c59c0 con 0x7ff578162e50 2024-03-30T13:14:02.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.611+0000 7ff57e200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff5780c5ca0 con 0x7ff5780cddb0 2024-03-30T13:14:02.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.611+0000 7ff577400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff578162e50 0x7ff578099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.612+0000 7ff577400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff578162e50 0x7ff578099730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55434/0 (socket says 172.21.15.99:55434) 2024-03-30T13:14:02.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.612+0000 7ff577400640 1 -- 172.21.15.99:0/1285865986 learned_addr learned my addr 172.21.15.99:0/1285865986 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.612+0000 7ff577e00640 1 --2- 172.21.15.99:0/1285865986 >> v2:172.21.15.181:3300/0 conn(0x7ff5780cddb0 0x7ff5780ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.612+0000 7ff577400640 1 -- 172.21.15.99:0/1285865986 >> v2:172.21.15.181:3300/0 conn(0x7ff5780cddb0 msgr2=0x7ff5780ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.612+0000 7ff577400640 1 --2- 172.21.15.99:0/1285865986 >> v2:172.21.15.181:3300/0 conn(0x7ff5780cddb0 0x7ff5780ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.612+0000 7ff577400640 1 -- 172.21.15.99:0/1285865986 >> v1:172.21.15.181:6789/0 conn(0x7ff578099c70 legacy=0x7ff5780c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.612+0000 7ff577400640 1 -- 172.21.15.99:0/1285865986 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5780c5f80 con 0x7ff578162e50 2024-03-30T13:14:02.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.613+0000 7ff577400640 1 --2- 172.21.15.99:0/1285865986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff578162e50 0x7ff578099730 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff578071690 tx=0x7ff56802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed3ba53418dfe81 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.613+0000 7ff576a00640 1 -- 172.21.15.99:0/1285865986 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56802e070 con 0x7ff578162e50 2024-03-30T13:14:02.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.614+0000 7ff576a00640 1 -- 172.21.15.99:0/1285865986 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff568037070 con 0x7ff578162e50 2024-03-30T13:14:02.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.614+0000 7ff576a00640 1 -- 172.21.15.99:0/1285865986 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568031a00 con 0x7ff578162e50 2024-03-30T13:14:02.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.614+0000 7ff57e200640 1 -- 172.21.15.99:0/1285865986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff578162e50 msgr2=0x7ff578099730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.614+0000 7ff57e200640 1 --2- 172.21.15.99:0/1285865986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff578162e50 0x7ff578099730 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff578071690 tx=0x7ff56802b880 comp rx=0 tx=0).stop 2024-03-30T13:14:02.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.614+0000 7ff57e200640 1 -- 172.21.15.99:0/1285865986 shutdown_connections 2024-03-30T13:14:02.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.614+0000 7ff57e200640 1 --2- 172.21.15.99:0/1285865986 >> v2:172.21.15.181:3300/0 conn(0x7ff5780cddb0 0x7ff5780ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.614+0000 7ff57e200640 1 --2- 172.21.15.99:0/1285865986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff578162e50 0x7ff578099730 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.614+0000 7ff57e200640 1 -- 172.21.15.99:0/1285865986 >> 172.21.15.99:0/1285865986 conn(0x7ff5780d0450 msgr2=0x7ff5780d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.614+0000 7ff57e200640 1 -- 172.21.15.99:0/1285865986 shutdown_connections 2024-03-30T13:14:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.614+0000 7ff57e200640 1 -- 172.21.15.99:0/1285865986 wait complete. 2024-03-30T13:14:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.616+0000 7ff57e200640 1 Processor -- start 2024-03-30T13:14:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.616+0000 7ff57e200640 1 -- start start 2024-03-30T13:14:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.617+0000 7ff57e200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff578099c70 0x7ff5781fbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.617+0000 7ff57e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5780cddb0 0x7ff5780c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.617+0000 7ff57e200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff578162e50 0x7ff57815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.617+0000 7ff57e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff5780cfd70 con 0x7ff5780cddb0 2024-03-30T13:14:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.617+0000 7ff57e200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff5780c6e90 con 0x7ff578099c70 2024-03-30T13:14:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.617+0000 7ff57e200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff5780cfef0 con 0x7ff578162e50 2024-03-30T13:14:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.617+0000 7ff56fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5780cddb0 0x7ff5780c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.617+0000 7ff56fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5780cddb0 0x7ff5780c9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55440/0 (socket says 172.21.15.99:55440) 2024-03-30T13:14:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.617+0000 7ff56fe00640 1 -- 172.21.15.99:0/3103529099 learned_addr learned my addr 172.21.15.99:0/3103529099 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.618+0000 7ff577e00640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff578162e50 0x7ff57815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.618+0000 7ff56fe00640 1 -- 172.21.15.99:0/3103529099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff578162e50 msgr2=0x7ff57815ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.618+0000 7ff577400640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff578099c70 0x7ff5781fbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.618+0000 7ff56fe00640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff578162e50 0x7ff57815ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.618+0000 7ff56fe00640 1 -- 172.21.15.99:0/3103529099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff578099c70 msgr2=0x7ff5781fbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.618+0000 7ff56fe00640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff578099c70 0x7ff5781fbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.618+0000 7ff56fe00640 1 -- 172.21.15.99:0/3103529099 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff578160e20 con 0x7ff5780cddb0 2024-03-30T13:14:02.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.618+0000 7ff56fe00640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5780cddb0 0x7ff5780c9050 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ff56000c400 tx=0x7ff56000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.618+0000 7ff56f400640 1 -- 172.21.15.99:0/3103529099 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560011790 con 0x7ff5780cddb0 2024-03-30T13:14:02.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.618+0000 7ff56f400640 1 -- 172.21.15.99:0/3103529099 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff560017070 con 0x7ff5780cddb0 2024-03-30T13:14:02.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.618+0000 7ff57e200640 1 -- 172.21.15.99:0/3103529099 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5780c8570 con 0x7ff5780cddb0 2024-03-30T13:14:02.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.619+0000 7ff56f400640 1 -- 172.21.15.99:0/3103529099 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560011bb0 con 0x7ff5780cddb0 2024-03-30T13:14:02.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.619+0000 7ff57e200640 1 -- 172.21.15.99:0/3103529099 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5780c8b30 con 0x7ff5780cddb0 2024-03-30T13:14:02.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.621+0000 7ff56f400640 1 -- 172.21.15.99:0/3103529099 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff56001c460 con 0x7ff5780cddb0 2024-03-30T13:14:02.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.622+0000 7ff56f400640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff55406c530 0x7ff55406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.622+0000 7ff56f400640 1 -- 172.21.15.99:0/3103529099 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7ff56008b660 con 0x7ff5780cddb0 2024-03-30T13:14:02.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.622+0000 7ff577400640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff55406c530 0x7ff55406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.623+0000 7ff580e17740 1 Processor -- start 2024-03-30T13:14:02.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.623+0000 7ff580e17740 1 -- start start 2024-03-30T13:14:02.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.623+0000 7ff577400640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff55406c530 0x7ff55406e9f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff568036000 tx=0x7ff568008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff580e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 0x56368aae3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff580e17740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aae4300 0x56368aabc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff580e17740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368aabc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff580e17740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56368aa20330 con 0x56368aabd670 2024-03-30T13:14:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff580e17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56368a9c8620 con 0x56368aabd290 2024-03-30T13:14:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff580e17740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56368aa1c440 con 0x56368aae4300 2024-03-30T13:14:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff577e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368aabc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff577e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368aabc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55446/0 (socket says 172.21.15.99:55446) 2024-03-30T13:14:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff577e00640 1 -- 172.21.15.99:0/660027897 learned_addr learned my addr 172.21.15.99:0/660027897 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff577400640 1 --2- 172.21.15.99:0/660027897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 0x56368aae3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff56fe00640 1 --2- 172.21.15.99:0/660027897 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aae4300 0x56368aabc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff577e00640 1 -- 172.21.15.99:0/660027897 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aae4300 msgr2=0x56368aabc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff577e00640 1 --2- 172.21.15.99:0/660027897 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aae4300 0x56368aabc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff577e00640 1 -- 172.21.15.99:0/660027897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 msgr2=0x56368aae3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff577e00640 1 --2- 172.21.15.99:0/660027897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 0x56368aae3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.624+0000 7ff577e00640 1 -- 172.21.15.99:0/660027897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56368a800920 con 0x56368aabd670 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.625+0000 7ff577e00640 1 --2- 172.21.15.99:0/660027897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368aabc810 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff570007330 tx=0x7ff5700077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6622d7ef5acf293 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.625+0000 7ff567400640 1 -- 172.21.15.99:0/660027897 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570013780 con 0x56368aabd670 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.625+0000 7ff567400640 1 -- 172.21.15.99:0/660027897 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff570019070 con 0x56368aabd670 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.625+0000 7ff567400640 1 -- 172.21.15.99:0/660027897 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570013b40 con 0x56368aabd670 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.626+0000 7ff580e17740 1 -- 172.21.15.99:0/660027897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 msgr2=0x56368aabc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.626+0000 7ff580e17740 1 --2- 172.21.15.99:0/660027897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368aabc810 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff570007330 tx=0x7ff5700077f0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.626+0000 7ff580e17740 1 -- 172.21.15.99:0/660027897 shutdown_connections 2024-03-30T13:14:02.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.626+0000 7ff580e17740 1 --2- 172.21.15.99:0/660027897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368aabc810 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.626+0000 7ff580e17740 1 --2- 172.21.15.99:0/660027897 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aae4300 0x56368aabc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.626+0000 7ff580e17740 1 --2- 172.21.15.99:0/660027897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 0x56368aae3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.626+0000 7ff580e17740 1 -- 172.21.15.99:0/660027897 >> 172.21.15.99:0/660027897 conn(0x56368aa83be0 msgr2=0x56368ab01fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.626+0000 7ff580e17740 1 -- 172.21.15.99:0/660027897 shutdown_connections 2024-03-30T13:14:02.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.626+0000 7ff580e17740 1 -- 172.21.15.99:0/660027897 wait complete. 2024-03-30T13:14:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.627+0000 7ff580e17740 1 -- start start 2024-03-30T13:14:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.627+0000 7ff580e17740 1 Processor -- start 2024-03-30T13:14:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.628+0000 7ff580e17740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd290 0x56368ab002d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.628+0000 7ff580e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd670 0x56368ab11850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.628+0000 7ff580e17740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aadab70 0x56368aaea420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.628+0000 7ff580e17740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56368aae3930 con 0x56368aabd290 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.628+0000 7ff580e17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56368a9db9d0 con 0x56368aabd670 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.628+0000 7ff580e17740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56368aadc6b0 con 0x56368aadab70 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.628+0000 7ff580e17740 10 client.0 _ll_register_callbacks cb 0x56368aa17fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.628+0000 7ff577400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd290 0x56368ab002d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.628+0000 7ff577400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd290 0x56368ab002d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55452/0 (socket says 172.21.15.99:55452) 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.628+0000 7ff577400640 1 -- 172.21.15.99:0/4182280287 learned_addr learned my addr 172.21.15.99:0/4182280287 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.629+0000 7ff577400640 1 -- 172.21.15.99:0/4182280287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aadab70 msgr2=0x56368aaea420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.629+0000 7ff577400640 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aadab70 0x56368aaea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.629+0000 7ff577400640 1 -- 172.21.15.99:0/4182280287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd670 msgr2=0x56368ab11850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.629+0000 7ff56fe00640 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd670 0x56368ab11850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.629+0000 7ff577400640 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd670 0x56368ab11850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.629+0000 7ff577400640 1 -- 172.21.15.99:0/4182280287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56368a6f4210 con 0x56368aabd290 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.629+0000 7ff577400640 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd290 0x56368ab002d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff568009930 tx=0x7ff568004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edac68cfed945b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.629+0000 7ff55be00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.629+0000 7ff55be00640 1 -- 172.21.15.99:0/4182280287 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568053060 con 0x56368aabd290 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.629+0000 7ff55be00640 1 -- 172.21.15.99:0/4182280287 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7ff568032e00 con 0x56368aabd290 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.629+0000 7ff580e17740 1 -- 172.21.15.99:0/4182280287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff570019070 con 0x56368aabd290 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.630+0000 7ff55be00640 1 -- 172.21.15.99:0/4182280287 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff568059050 con 0x56368aabd290 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.630+0000 7ff580e17740 10 client.6126 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.630+0000 7ff580e17740 1 -- 172.21.15.99:0/4182280287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x56368a8610b0 con 0x56368aabd290 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.630+0000 7ff55be00640 1 -- 172.21.15.99:0/4182280287 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff570019070 con 0x56368aabd290 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.630+0000 7ff55be00640 1 -- 172.21.15.99:0/4182280287 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7ff56805c020 con 0x56368aabd290 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.630+0000 7ff580e17740 10 client.6126 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.630+0000 7ff580e17740 10 client.6126 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:02.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.630+0000 7ff580e17740 20 client.6126 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:02.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.630+0000 7ff580e17740 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56368ab01f40 0x56368ab023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.630+0000 7ff580e17740 4 client.6126 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:02.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.630+0000 7ff580e17740 1 -- 172.21.15.99:0/4182280287 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56368aa2d870 con 0x56368ab01f40 2024-03-30T13:14:02.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.631+0000 7ff56fe00640 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56368ab01f40 0x56368ab023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.631+0000 7ff56fe00640 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56368ab01f40 0x56368ab023a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9fa1cba3f02895e server_cookie=f2a2ebb481b94ab2 in_seq=0 out_seq=0 2024-03-30T13:14:02.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.632+0000 7ff55be00640 10 client.6126 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff55be00640 1 -- 172.21.15.99:0/4182280287 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x56368aa2d870 con 0x56368ab01f40 2024-03-30T13:14:02.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff55be00640 10 client.6126 handle_command_reply: tid=0 2024-03-30T13:14:02.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 1 client.6126 shutdown 2024-03-30T13:14:02.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 1 -- 172.21.15.99:0/4182280287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd290 msgr2=0x56368ab002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd290 0x56368ab002d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff568009930 tx=0x7ff568004730 comp rx=0 tx=0).stop 2024-03-30T13:14:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 1 -- 172.21.15.99:0/4182280287 shutdown_connections 2024-03-30T13:14:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aadab70 0x56368aaea420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56368ab01f40 0x56368ab023a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd670 0x56368ab11850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 1 --2- 172.21.15.99:0/4182280287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd290 0x56368ab002d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff55be00640 0 client.6126 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 1 -- 172.21.15.99:0/4182280287 >> 172.21.15.99:0/4182280287 conn(0x56368aa83be0 msgr2=0x56368aae2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 1 -- 172.21.15.99:0/4182280287 shutdown_connections 2024-03-30T13:14:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 1 -- 172.21.15.99:0/4182280287 wait complete. 2024-03-30T13:14:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.633+0000 7ff580e17740 20 client.6126 trim_cache size 0 max 16384 2024-03-30T13:14:02.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.649+0000 7ff580e17740 1 Processor -- start 2024-03-30T13:14:02.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.649+0000 7ff580e17740 1 -- start start 2024-03-30T13:14:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.650+0000 7ff580e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 0x56368ab05c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.650+0000 7ff580e17740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aabd670 0x56368ab1a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.650+0000 7ff580e17740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aadab70 0x56368ab1aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.650+0000 7ff580e17740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff578205210 con 0x56368aadab70 2024-03-30T13:14:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.650+0000 7ff580e17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff5780c7f50 con 0x56368aabd290 2024-03-30T13:14:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.650+0000 7ff580e17740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff5780c72b0 con 0x56368aabd670 2024-03-30T13:14:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.650+0000 7ff577e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aadab70 0x56368ab1aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.650+0000 7ff577e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aadab70 0x56368ab1aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55468/0 (socket says 172.21.15.99:55468) 2024-03-30T13:14:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.650+0000 7ff577e00640 1 -- 172.21.15.99:0/933062754 learned_addr learned my addr 172.21.15.99:0/933062754 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.651+0000 7ff577e00640 1 -- 172.21.15.99:0/933062754 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aabd670 msgr2=0x56368ab1a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.651+0000 7ff577e00640 1 --2- 172.21.15.99:0/933062754 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aabd670 0x56368ab1a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.651+0000 7ff577e00640 1 -- 172.21.15.99:0/933062754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 msgr2=0x56368ab05c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.651+0000 7ff577400640 1 --2- 172.21.15.99:0/933062754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 0x56368ab05c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.651+0000 7ff577e00640 1 --2- 172.21.15.99:0/933062754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 0x56368ab05c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.651+0000 7ff577e00640 1 -- 172.21.15.99:0/933062754 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56368a6cd2d0 con 0x56368aadab70 2024-03-30T13:14:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.651+0000 7ff577e00640 1 --2- 172.21.15.99:0/933062754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aadab70 0x56368ab1aaf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff570015000 tx=0x7ff570012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acc276a1730fc8e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.651+0000 7ff566a00640 1 -- 172.21.15.99:0/933062754 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570022070 con 0x56368aadab70 2024-03-30T13:14:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.651+0000 7ff566a00640 1 -- 172.21.15.99:0/933062754 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff570019070 con 0x56368aadab70 2024-03-30T13:14:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.651+0000 7ff566a00640 1 -- 172.21.15.99:0/933062754 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570003dd0 con 0x56368aadab70 2024-03-30T13:14:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.652+0000 7ff580e17740 1 -- 172.21.15.99:0/933062754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aadab70 msgr2=0x56368ab1aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.652+0000 7ff580e17740 1 --2- 172.21.15.99:0/933062754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aadab70 0x56368ab1aaf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff570015000 tx=0x7ff570012000 comp rx=0 tx=0).stop 2024-03-30T13:14:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.652+0000 7ff580e17740 1 -- 172.21.15.99:0/933062754 shutdown_connections 2024-03-30T13:14:02.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.652+0000 7ff580e17740 1 --2- 172.21.15.99:0/933062754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aadab70 0x56368ab1aaf0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.652+0000 7ff580e17740 1 --2- 172.21.15.99:0/933062754 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aabd670 0x56368ab1a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.652+0000 7ff580e17740 1 --2- 172.21.15.99:0/933062754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 0x56368ab05c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.652+0000 7ff580e17740 1 -- 172.21.15.99:0/933062754 >> 172.21.15.99:0/933062754 conn(0x56368aa83be0 msgr2=0x56368aae38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.652+0000 7ff580e17740 1 -- 172.21.15.99:0/933062754 shutdown_connections 2024-03-30T13:14:02.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.652+0000 7ff580e17740 1 -- 172.21.15.99:0/933062754 wait complete. 2024-03-30T13:14:02.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.653+0000 7ff580e17740 1 -- start start 2024-03-30T13:14:02.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.653+0000 7ff580e17740 1 Processor -- start 2024-03-30T13:14:02.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.654+0000 7ff580e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 0x56368ab7e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.654+0000 7ff580e17740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368ab247e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.654+0000 7ff580e17740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aadab70 0x56368ab1ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.654+0000 7ff580e17740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff5780c7900 con 0x56368aabd670 2024-03-30T13:14:02.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.654+0000 7ff580e17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56368aae3ff0 con 0x56368aabd290 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.654+0000 7ff580e17740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56368ab25150 con 0x56368aadab70 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.654+0000 7ff580e17740 10 client.0 _ll_register_callbacks cb 0x7ff5680096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.654+0000 7ff56fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368ab247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.654+0000 7ff56fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368ab247e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55484/0 (socket says 172.21.15.99:55484) 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.654+0000 7ff56fe00640 1 -- 172.21.15.99:0/2905855443 learned_addr learned my addr 172.21.15.99:0/2905855443 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff56fe00640 1 -- 172.21.15.99:0/2905855443 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aadab70 msgr2=0x56368ab1ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff56fe00640 1 --2- 172.21.15.99:0/2905855443 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aadab70 0x56368ab1ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff56fe00640 1 -- 172.21.15.99:0/2905855443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 msgr2=0x56368ab7e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff56fe00640 1 --2- 172.21.15.99:0/2905855443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 0x56368ab7e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff56fe00640 1 -- 172.21.15.99:0/2905855443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56368ab04be0 con 0x56368aabd670 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff56fe00640 1 --2- 172.21.15.99:0/2905855443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368ab247e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff560059430 tx=0x7ff5600036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0c74b5cf55aebe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff55be00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff55be00640 1 -- 172.21.15.99:0/2905855443 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560087020 con 0x56368aabd670 2024-03-30T13:14:02.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff55be00640 1 -- 172.21.15.99:0/2905855443 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5913+0+0 (secure 0 0 0) 0x7ff560011d50 con 0x56368aabd670 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff580e17740 1 -- 172.21.15.99:0/2905855443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff570019070 con 0x56368aabd670 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff55be00640 1 -- 172.21.15.99:0/2905855443 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff560055b10 con 0x56368aabd670 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff580e17740 10 client.6132 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff580e17740 1 -- 172.21.15.99:0/2905855443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x56368ab1b6e0 con 0x56368aabd670 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.655+0000 7ff55be00640 1 -- 172.21.15.99:0/2905855443 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff570019070 con 0x56368aabd670 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.656+0000 7ff55be00640 1 -- 172.21.15.99:0/2905855443 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7ff560061bf0 con 0x56368aabd670 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.656+0000 7ff580e17740 10 client.6132 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.656+0000 7ff580e17740 10 client.6132 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.656+0000 7ff580e17740 20 client.6132 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.656+0000 7ff580e17740 1 --2- 172.21.15.99:0/2905855443 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56368ab1b1b0 0x56368aad8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.656+0000 7ff580e17740 4 client.6132 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628401}] 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.656+0000 7ff580e17740 1 -- 172.21.15.99:0/2905855443 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628401}) -- 0x56368aadb360 con 0x56368ab1b1b0 2024-03-30T13:14:02.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.656+0000 7ff577400640 1 --2- 172.21.15.99:0/2905855443 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56368ab1b1b0 0x56368aad8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.657+0000 7ff577400640 1 --2- 172.21.15.99:0/2905855443 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56368ab1b1b0 0x56368aad8fe0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9326102f037f2bc server_cookie=9bc726057008396c in_seq=0 out_seq=0 2024-03-30T13:14:02.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.657+0000 7ff55be00640 10 client.6132 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff55be00640 1 -- 172.21.15.99:0/2905855443 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4756 (crc 0 0 0) 0x56368aadb360 con 0x56368ab1b1b0 2024-03-30T13:14:02.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff55be00640 10 client.6132 handle_command_reply: tid=0 2024-03-30T13:14:02.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff580e17740 1 client.6132 shutdown 2024-03-30T13:14:02.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff580e17740 1 -- 172.21.15.99:0/2905855443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 msgr2=0x56368ab247e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff580e17740 1 --2- 172.21.15.99:0/2905855443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368ab247e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff560059430 tx=0x7ff5600036f0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff580e17740 1 -- 172.21.15.99:0/2905855443 shutdown_connections 2024-03-30T13:14:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff580e17740 1 --2- 172.21.15.99:0/2905855443 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56368aadab70 0x56368ab1ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff580e17740 1 --2- 172.21.15.99:0/2905855443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56368aabd670 0x56368ab247e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff580e17740 1 --2- 172.21.15.99:0/2905855443 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x56368ab1b1b0 0x56368aad8fe0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff580e17740 1 --2- 172.21.15.99:0/2905855443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56368aabd290 0x56368ab7e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff55be00640 0 client.6132 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.658+0000 7ff580e17740 1 -- 172.21.15.99:0/2905855443 >> 172.21.15.99:0/2905855443 conn(0x56368aa83be0 msgr2=0x56368ab05c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff580e17740 1 -- 172.21.15.99:0/2905855443 shutdown_connections 2024-03-30T13:14:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff580e17740 1 -- 172.21.15.99:0/2905855443 wait complete. 2024-03-30T13:14:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff580e17740 20 client.6132 trim_cache size 0 max 16384 2024-03-30T13:14:02.667 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:02.667 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/ext2/xattr.h", 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628401, 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.587111+0000", 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.667875+0000", 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:02.668 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 3340, 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:02.669 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.667875+0000", 2024-03-30T13:14:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3340, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.587111+0000" 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3340, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.587111+0000" 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 186, 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 32, 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.673 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:02.674 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.677 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.678 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:02.679 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:02.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:02.682 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:02.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff57e200640 1 -- 172.21.15.99:0/3103529099 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff55406c530 msgr2=0x7ff55406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff57e200640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff55406c530 0x7ff55406e9f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff568036000 tx=0x7ff568008030 comp rx=0 tx=0).stop 2024-03-30T13:14:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff57e200640 1 -- 172.21.15.99:0/3103529099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5780cddb0 msgr2=0x7ff5780c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff57e200640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5780cddb0 0x7ff5780c9050 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ff56000c400 tx=0x7ff56000c8c0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff57e200640 1 -- 172.21.15.99:0/3103529099 shutdown_connections 2024-03-30T13:14:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff57e200640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff55406c530 0x7ff55406e9f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff57e200640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff578162e50 0x7ff57815ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff57e200640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5780cddb0 0x7ff5780c9050 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff57e200640 1 --2- 172.21.15.99:0/3103529099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff578099c70 0x7ff5781fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.659+0000 7ff57e200640 1 -- 172.21.15.99:0/3103529099 >> 172.21.15.99:0/3103529099 conn(0x7ff5780d0450 msgr2=0x7ff5780cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.660+0000 7ff57e200640 1 -- 172.21.15.99:0/3103529099 shutdown_connections 2024-03-30T13:14:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.660+0000 7ff57e200640 1 -- 172.21.15.99:0/3103529099 wait complete. 2024-03-30T13:14:02.685 DEBUG:tasks.cephfs.test_uninlining:getting inode info #14 of 23:1099511628406 2024-03-30T13:14:02.685 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628406 2024-03-30T13:14:02.685 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628406 2024-03-30T13:14:02.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.891+0000 7f5152e00640 1 Processor -- start 2024-03-30T13:14:02.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.892+0000 7f5152e00640 1 -- start start 2024-03-30T13:14:02.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.893+0000 7f5152e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f514c0b2810 0x7f514c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.893+0000 7f5152e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f514c1604d0 con 0x7f514c0c6820 2024-03-30T13:14:02.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.893+0000 7f5152e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f514c1607b0 con 0x7f514c0b4e40 2024-03-30T13:14:02.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.893+0000 7f5152e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f514c0cba20 con 0x7f514c0b2810 2024-03-30T13:14:02.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.893+0000 7f514b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f514c0c6820 0x7f514c0b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33446/0 (socket says 172.21.15.99:33446) 2024-03-30T13:14:02.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.893+0000 7f514b400640 1 -- 172.21.15.99:0/3072976892 learned_addr learned my addr 172.21.15.99:0/3072976892 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:02.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f5150e00640 1 --2- 172.21.15.99:0/3072976892 >> v2:172.21.15.181:3300/0 conn(0x7f514c0b2810 0x7f514c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372314083 0 0) 0x7f514c1604d0 con 0x7f514c0c6820 2024-03-30T13:14:02.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5130003520 con 0x7f514c0c6820 2024-03-30T13:14:02.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3842182010 0 0) 0x7f5130003520 con 0x7f514c0c6820 2024-03-30T13:14:02.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 >> v2:172.21.15.181:3300/0 conn(0x7f514c0b2810 msgr2=0x7f514c0cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 --2- 172.21.15.99:0/3072976892 >> v2:172.21.15.181:3300/0 conn(0x7f514c0b2810 0x7f514c0cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 >> v1:172.21.15.181:6789/0 conn(0x7f514c0b4e40 legacy=0x7f514c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514c160a90 con 0x7f514c0c6820 2024-03-30T13:14:02.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f5138001670 con 0x7f514c0c6820 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 >> v1:172.21.15.99:6789/0 conn(0x7f514c0c6820 legacy=0x7f514c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5130003a00 0x7f5130003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 0x7f5130004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5130005210 0x7f513000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f514c0cba20 con 0x7f5130004800 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f513000c160 con 0x7f5130005210 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.894+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f513000c360 con 0x7f5130003a00 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.895+0000 7f514b400640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 0x7f5130004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.895+0000 7f514be00640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5130003a00 0x7f5130003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.895+0000 7f5150e00640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5130005210 0x7f513000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.895+0000 7f514b400640 1 -- 172.21.15.99:0/3072976892 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5130003a00 msgr2=0x7f5130003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.895+0000 7f514b400640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5130003a00 0x7f5130003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.895+0000 7f514b400640 1 -- 172.21.15.99:0/3072976892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5130005210 msgr2=0x7f513000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.895+0000 7f514b400640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5130005210 0x7f513000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.895+0000 7f514b400640 1 -- 172.21.15.99:0/3072976892 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5130003520 con 0x7f5130004800 2024-03-30T13:14:02.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.895+0000 7f514be00640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5130003a00 0x7f5130003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:02.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.895+0000 7f5150e00640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5130005210 0x7f513000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:02.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.895+0000 7f5150e00640 1 -- 172.21.15.99:0/3072976892 reap_dead start 2024-03-30T13:14:02.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.896+0000 7f514b400640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 0x7f5130004c80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f513800c0e0 tx=0x7f5130005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ced0ddeca9f8f32 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.896+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138007c40 con 0x7f5130004800 2024-03-30T13:14:02.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.896+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5138030070 con 0x7f5130004800 2024-03-30T13:14:02.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.896+0000 7f514aa00640 1 -- 172.21.15.99:0/3072976892 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138005d70 con 0x7f5130004800 2024-03-30T13:14:02.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.897+0000 7f5152e00640 1 -- 172.21.15.99:0/3072976892 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 msgr2=0x7f5130004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.897+0000 7f5152e00640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 0x7f5130004c80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f513800c0e0 tx=0x7f5130005830 comp rx=0 tx=0).stop 2024-03-30T13:14:02.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.897+0000 7f5152e00640 1 -- 172.21.15.99:0/3072976892 shutdown_connections 2024-03-30T13:14:02.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.897+0000 7f5152e00640 1 --2- 172.21.15.99:0/3072976892 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 0x7f5130004c80 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.897+0000 7f5152e00640 1 -- 172.21.15.99:0/3072976892 >> 172.21.15.99:0/3072976892 conn(0x7f514c0d0450 msgr2=0x7f514c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.897+0000 7f5152e00640 1 -- 172.21.15.99:0/3072976892 shutdown_connections 2024-03-30T13:14:02.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.897+0000 7f5152e00640 1 -- 172.21.15.99:0/3072976892 wait complete. 2024-03-30T13:14:02.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.899+0000 7f5152e00640 1 Processor -- start 2024-03-30T13:14:02.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.899+0000 7f5152e00640 1 -- start start 2024-03-30T13:14:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.900+0000 7f5152e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 0x7f514c0b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.900+0000 7f5152e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f514c1462a0 0x7f514c146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.900+0000 7f5152e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c072de0 0x7f514c073260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.900+0000 7f5152e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f514c0c60f0 con 0x7f5130004800 2024-03-30T13:14:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.900+0000 7f5152e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f514c0c6cb0 con 0x7f514c072de0 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.900+0000 7f5152e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f514c1600f0 con 0x7f514c1462a0 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.900+0000 7f514be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 0x7f514c0b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.900+0000 7f514be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 0x7f514c0b0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55508/0 (socket says 172.21.15.99:55508) 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.900+0000 7f514be00640 1 -- 172.21.15.99:0/398724304 learned_addr learned my addr 172.21.15.99:0/398724304 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f514b400640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f514c1462a0 0x7f514c146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f514be00640 1 -- 172.21.15.99:0/398724304 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f514c1462a0 msgr2=0x7f514c146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f514be00640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f514c1462a0 0x7f514c146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f5150e00640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c072de0 0x7f514c073260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f514be00640 1 -- 172.21.15.99:0/398724304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c072de0 msgr2=0x7f514c073260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f514be00640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c072de0 0x7f514c073260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f514be00640 1 -- 172.21.15.99:0/398724304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514c1549c0 con 0x7f5130004800 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f514b400640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f514c1462a0 0x7f514c146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f514be00640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 0x7f514c0b0d50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f513c00d480 tx=0x7f513c00d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f5143e00640 1 -- 172.21.15.99:0/398724304 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c005480 con 0x7f5130004800 2024-03-30T13:14:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f5143e00640 1 -- 172.21.15.99:0/398724304 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513c017070 con 0x7f5130004800 2024-03-30T13:14:02.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f5152e00640 1 -- 172.21.15.99:0/398724304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514c154ca0 con 0x7f5130004800 2024-03-30T13:14:02.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.901+0000 7f5143e00640 1 -- 172.21.15.99:0/398724304 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c003830 con 0x7f5130004800 2024-03-30T13:14:02.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.902+0000 7f5152e00640 1 -- 172.21.15.99:0/398724304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f514c0737a0 con 0x7f5130004800 2024-03-30T13:14:02.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.904+0000 7f5143e00640 1 -- 172.21.15.99:0/398724304 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f513c0039d0 con 0x7f5130004800 2024-03-30T13:14:02.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.905+0000 7f5143e00640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f512c06c530 0x7f512c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.905+0000 7f5143e00640 1 -- 172.21.15.99:0/398724304 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f513c08b510 con 0x7f5130004800 2024-03-30T13:14:02.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.905+0000 7f514b400640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f512c06c530 0x7f512c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.906+0000 7f51559f1740 1 Processor -- start 2024-03-30T13:14:02.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.906+0000 7f514b400640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f512c06c530 0x7f512c06e9f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5138034000 tx=0x7f5138039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.906+0000 7f51559f1740 1 -- start start 2024-03-30T13:14:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.907+0000 7f51559f1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e42396a0 0x55d8e42601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.907+0000 7f51559f1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4260710 0x55d8e42386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.908+0000 7f51559f1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4239a80 0x55d8e4238c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.908+0000 7f51559f1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d8e4198330 con 0x55d8e4239a80 2024-03-30T13:14:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.908+0000 7f51559f1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d8e4140620 con 0x55d8e4260710 2024-03-30T13:14:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.908+0000 7f51559f1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55d8e4194440 con 0x55d8e42396a0 2024-03-30T13:14:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.908+0000 7f514be00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e42396a0 0x55d8e42601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.908+0000 7f514b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4260710 0x55d8e42386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.908+0000 7f514be00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e42396a0 0x55d8e42601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:35788/0 (socket says 172.21.15.99:35788) 2024-03-30T13:14:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.908+0000 7f514be00640 1 -- 172.21.15.99:0/1808483863 learned_addr learned my addr 172.21.15.99:0/1808483863 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.909+0000 7f5150e00640 1 --2- 172.21.15.99:0/1808483863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4239a80 0x55d8e4238c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.909+0000 7f5150e00640 1 -- 172.21.15.99:0/1808483863 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e42396a0 msgr2=0x55d8e42601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.909+0000 7f5150e00640 1 --2- 172.21.15.99:0/1808483863 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e42396a0 0x55d8e42601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.909+0000 7f5150e00640 1 -- 172.21.15.99:0/1808483863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4260710 msgr2=0x55d8e42386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.909+0000 7f5150e00640 1 --2- 172.21.15.99:0/1808483863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4260710 0x55d8e42386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.909+0000 7f5150e00640 1 -- 172.21.15.99:0/1808483863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8e3f78920 con 0x55d8e4239a80 2024-03-30T13:14:02.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.910+0000 7f5150e00640 1 --2- 172.21.15.99:0/1808483863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4239a80 0x55d8e4238c20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f514c0c6c00 tx=0x7f5144009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e6a920693bff27 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.910+0000 7f5140c00640 1 -- 172.21.15.99:0/1808483863 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144004720 con 0x55d8e4239a80 2024-03-30T13:14:02.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.910+0000 7f5140c00640 1 -- 172.21.15.99:0/1808483863 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514401a070 con 0x55d8e4239a80 2024-03-30T13:14:02.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.910+0000 7f5140c00640 1 -- 172.21.15.99:0/1808483863 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144015620 con 0x55d8e4239a80 2024-03-30T13:14:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.911+0000 7f51559f1740 1 -- 172.21.15.99:0/1808483863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4239a80 msgr2=0x55d8e4238c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.911+0000 7f51559f1740 1 --2- 172.21.15.99:0/1808483863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4239a80 0x55d8e4238c20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f514c0c6c00 tx=0x7f5144009750 comp rx=0 tx=0).stop 2024-03-30T13:14:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.911+0000 7f51559f1740 1 -- 172.21.15.99:0/1808483863 shutdown_connections 2024-03-30T13:14:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.911+0000 7f51559f1740 1 --2- 172.21.15.99:0/1808483863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4239a80 0x55d8e4238c20 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.911+0000 7f51559f1740 1 --2- 172.21.15.99:0/1808483863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4260710 0x55d8e42386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.911+0000 7f51559f1740 1 --2- 172.21.15.99:0/1808483863 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e42396a0 0x55d8e42601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.911+0000 7f51559f1740 1 -- 172.21.15.99:0/1808483863 >> 172.21.15.99:0/1808483863 conn(0x55d8e41fbbe0 msgr2=0x55d8e427e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.911+0000 7f51559f1740 1 -- 172.21.15.99:0/1808483863 shutdown_connections 2024-03-30T13:14:02.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.912+0000 7f51559f1740 1 -- 172.21.15.99:0/1808483863 wait complete. 2024-03-30T13:14:02.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.912+0000 7f51559f1740 1 -- start start 2024-03-30T13:14:02.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.913+0000 7f51559f1740 1 Processor -- start 2024-03-30T13:14:02.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f51559f1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e42396a0 0x55d8e4291b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f51559f1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4239a80 0x55d8e4266c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f51559f1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e4246410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f51559f1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d8e425fd40 con 0x55d8e4248460 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f51559f1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d8e41539d0 con 0x55d8e4239a80 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f51559f1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55d8e4258ac0 con 0x55d8e42396a0 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f51559f1740 10 client.0 _ll_register_callbacks cb 0x55d8e418ffd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f5150e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e4246410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f5150e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e4246410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55520/0 (socket says 172.21.15.99:55520) 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f5150e00640 1 -- 172.21.15.99:0/3120296745 learned_addr learned my addr 172.21.15.99:0/3120296745 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f514be00640 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e42396a0 0x55d8e4291b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f514b400640 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4239a80 0x55d8e4266c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f5150e00640 1 -- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e42396a0 msgr2=0x55d8e4291b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f5150e00640 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e42396a0 0x55d8e4291b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f5150e00640 1 -- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4239a80 msgr2=0x55d8e4266c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f5150e00640 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4239a80 0x55d8e4266c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f5150e00640 1 -- 172.21.15.99:0/3120296745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8e3e6c210 con 0x55d8e4248460 2024-03-30T13:14:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.914+0000 7f514b400640 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4239a80 0x55d8e4266c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.915+0000 7f5150e00640 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e4246410 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5144009790 tx=0x7f5144004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb05bd9dffb47d4b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.915+0000 7f5135600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.915+0000 7f5135600640 1 -- 172.21.15.99:0/3120296745 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144015630 con 0x55d8e4248460 2024-03-30T13:14:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.915+0000 7f5135600640 1 -- 172.21.15.99:0/3120296745 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f51440157d0 con 0x55d8e4248460 2024-03-30T13:14:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.915+0000 7f51559f1740 1 -- 172.21.15.99:0/3120296745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f514401a070 con 0x55d8e4248460 2024-03-30T13:14:02.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.915+0000 7f5135600640 1 -- 172.21.15.99:0/3120296745 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5144032050 con 0x55d8e4248460 2024-03-30T13:14:02.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.916+0000 7f51559f1740 10 client.6144 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:02.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.916+0000 7f51559f1740 1 -- 172.21.15.99:0/3120296745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55d8e3fd90b0 con 0x55d8e4248460 2024-03-30T13:14:02.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.916+0000 7f5135600640 1 -- 172.21.15.99:0/3120296745 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514401a070 con 0x55d8e4248460 2024-03-30T13:14:02.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.916+0000 7f5135600640 1 -- 172.21.15.99:0/3120296745 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f5144035020 con 0x55d8e4248460 2024-03-30T13:14:02.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.916+0000 7f51559f1740 10 client.6144 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:02.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.916+0000 7f51559f1740 10 client.6144 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:02.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.916+0000 7f51559f1740 20 client.6144 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:02.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.916+0000 7f51559f1740 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8e425d6c0 0x55d8e425dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.916+0000 7f51559f1740 4 client.6144 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:02.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.916+0000 7f51559f1740 1 -- 172.21.15.99:0/3120296745 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8e41a5870 con 0x55d8e425d6c0 2024-03-30T13:14:02.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.918+0000 7f514be00640 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8e425d6c0 0x55d8e425dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.919+0000 7f514be00640 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8e425d6c0 0x55d8e425dad0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee6f2037c9a1073 server_cookie=b6090d5340725c8d in_seq=0 out_seq=0 2024-03-30T13:14:02.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.919+0000 7f5135600640 10 client.6144 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f5135600640 1 -- 172.21.15.99:0/3120296745 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55d8e41a5870 con 0x55d8e425d6c0 2024-03-30T13:14:02.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f5135600640 10 client.6144 handle_command_reply: tid=0 2024-03-30T13:14:02.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f51559f1740 1 client.6144 shutdown 2024-03-30T13:14:02.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f51559f1740 1 -- 172.21.15.99:0/3120296745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 msgr2=0x55d8e4246410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f51559f1740 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e4246410 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5144009790 tx=0x7f5144004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:02.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f51559f1740 1 -- 172.21.15.99:0/3120296745 shutdown_connections 2024-03-30T13:14:02.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f51559f1740 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e4246410 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f51559f1740 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8e425d6c0 0x55d8e425dad0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f51559f1740 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4239a80 0x55d8e4266c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f51559f1740 1 --2- 172.21.15.99:0/3120296745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e42396a0 0x55d8e4291b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f51559f1740 1 -- 172.21.15.99:0/3120296745 >> 172.21.15.99:0/3120296745 conn(0x55d8e41fbbe0 msgr2=0x55d8e425f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.922+0000 7f5135600640 0 client.6144 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.923+0000 7f51559f1740 1 -- 172.21.15.99:0/3120296745 shutdown_connections 2024-03-30T13:14:02.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.923+0000 7f51559f1740 1 -- 172.21.15.99:0/3120296745 wait complete. 2024-03-30T13:14:02.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.923+0000 7f51559f1740 20 client.6144 trim_cache size 0 max 16384 2024-03-30T13:14:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.939+0000 7f51559f1740 1 Processor -- start 2024-03-30T13:14:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.939+0000 7f51559f1740 1 -- start start 2024-03-30T13:14:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.940+0000 7f51559f1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e42396a0 0x55d8e42a2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.940+0000 7f51559f1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e4239a80 0x55d8e4280ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.940+0000 7f51559f1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e42811e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.940+0000 7f51559f1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1fd3d0 con 0x55d8e4248460 2024-03-30T13:14:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.940+0000 7f51559f1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f514c0cf650 con 0x55d8e42396a0 2024-03-30T13:14:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.940+0000 7f51559f1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f514c1564f0 con 0x55d8e4239a80 2024-03-30T13:14:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f5150e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e42811e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f5150e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e42811e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55524/0 (socket says 172.21.15.99:55524) 2024-03-30T13:14:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f5150e00640 1 -- 172.21.15.99:0/3900273768 learned_addr learned my addr 172.21.15.99:0/3900273768 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f514be00640 1 --2- 172.21.15.99:0/3900273768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e42396a0 0x55d8e42a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f514b400640 1 --2- 172.21.15.99:0/3900273768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e4239a80 0x55d8e4280ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f5150e00640 1 -- 172.21.15.99:0/3900273768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e4239a80 msgr2=0x55d8e4280ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f5150e00640 1 --2- 172.21.15.99:0/3900273768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e4239a80 0x55d8e4280ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f5150e00640 1 -- 172.21.15.99:0/3900273768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e42396a0 msgr2=0x55d8e42a2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f5150e00640 1 --2- 172.21.15.99:0/3900273768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e42396a0 0x55d8e42a2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f5150e00640 1 -- 172.21.15.99:0/3900273768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8e3e452d0 con 0x55d8e4248460 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f514b400640 1 --2- 172.21.15.99:0/3900273768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e4239a80 0x55d8e4280ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.941+0000 7f5150e00640 1 --2- 172.21.15.99:0/3900273768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e42811e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f51440158f0 tx=0x7f5144021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e076efe3bf41a96 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.942+0000 7f5137e00640 1 -- 172.21.15.99:0/3900273768 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514402a480 con 0x55d8e4248460 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.942+0000 7f5137e00640 1 -- 172.21.15.99:0/3900273768 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514401a070 con 0x55d8e4248460 2024-03-30T13:14:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.942+0000 7f5137e00640 1 -- 172.21.15.99:0/3900273768 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514402a860 con 0x55d8e4248460 2024-03-30T13:14:02.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.942+0000 7f51559f1740 1 -- 172.21.15.99:0/3900273768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 msgr2=0x55d8e42811e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.942+0000 7f51559f1740 1 --2- 172.21.15.99:0/3900273768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e42811e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f51440158f0 tx=0x7f5144021070 comp rx=0 tx=0).stop 2024-03-30T13:14:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.942+0000 7f51559f1740 1 -- 172.21.15.99:0/3900273768 shutdown_connections 2024-03-30T13:14:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.942+0000 7f51559f1740 1 --2- 172.21.15.99:0/3900273768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e4248460 0x55d8e42811e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.942+0000 7f51559f1740 1 --2- 172.21.15.99:0/3900273768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e4239a80 0x55d8e4280ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.942+0000 7f51559f1740 1 --2- 172.21.15.99:0/3900273768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e42396a0 0x55d8e42a2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.942+0000 7f51559f1740 1 -- 172.21.15.99:0/3900273768 >> 172.21.15.99:0/3900273768 conn(0x55d8e41fbbe0 msgr2=0x55d8e424b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.943+0000 7f51559f1740 1 -- 172.21.15.99:0/3900273768 shutdown_connections 2024-03-30T13:14:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.943+0000 7f51559f1740 1 -- 172.21.15.99:0/3900273768 wait complete. 2024-03-30T13:14:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.943+0000 7f51559f1740 1 -- start start 2024-03-30T13:14:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.943+0000 7f51559f1740 1 Processor -- start 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.944+0000 7f51559f1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e42396a0 0x55d8e42f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.944+0000 7f51559f1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e4239a80 0x55d8e4259310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.944+0000 7f51559f1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4248460 0x55d8e422e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.944+0000 7f51559f1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d8e41a5fa0 con 0x55d8e42396a0 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.944+0000 7f51559f1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f514c0cefa0 con 0x55d8e4248460 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.944+0000 7f51559f1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55d8e423a110 con 0x55d8e4239a80 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.944+0000 7f51559f1740 10 client.0 _ll_register_callbacks cb 0x7f51300036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f514be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e42396a0 0x55d8e42f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f514be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e42396a0 0x55d8e42f86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55526/0 (socket says 172.21.15.99:55526) 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f514be00640 1 -- 172.21.15.99:0/2305610813 learned_addr learned my addr 172.21.15.99:0/2305610813 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f514b400640 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e4239a80 0x55d8e4259310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f5150e00640 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4248460 0x55d8e422e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f514be00640 1 -- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e4239a80 msgr2=0x55d8e4259310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f514be00640 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e4239a80 0x55d8e4259310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f514be00640 1 -- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4248460 msgr2=0x55d8e422e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f514be00640 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4248460 0x55d8e422e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f514be00640 1 -- 172.21.15.99:0/2305610813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8e4265460 con 0x55d8e42396a0 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f514be00640 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e42396a0 0x55d8e42f86c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f513c005620 tx=0x7f513c0898e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cb8d95744b1adc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f5135600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f5135600640 1 -- 172.21.15.99:0/2305610813 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c08b0b0 con 0x55d8e42396a0 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f5135600640 1 -- 172.21.15.99:0/2305610813 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f513c08b250 con 0x55d8e42396a0 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.945+0000 7f51559f1740 1 -- 172.21.15.99:0/2305610813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f514401a070 con 0x55d8e42396a0 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.946+0000 7f5135600640 1 -- 172.21.15.99:0/2305610813 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f513c078b30 con 0x55d8e42396a0 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.946+0000 7f51559f1740 10 client.6150 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.946+0000 7f51559f1740 1 -- 172.21.15.99:0/2305610813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55d8e422ec00 con 0x55d8e42396a0 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.946+0000 7f5135600640 1 -- 172.21.15.99:0/2305610813 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514401a070 con 0x55d8e42396a0 2024-03-30T13:14:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.946+0000 7f5135600640 1 -- 172.21.15.99:0/2305610813 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f513c078020 con 0x55d8e42396a0 2024-03-30T13:14:02.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.946+0000 7f51559f1740 10 client.6150 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:02.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.946+0000 7f51559f1740 10 client.6150 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:02.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.946+0000 7f51559f1740 20 client.6150 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:02.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.946+0000 7f51559f1740 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8e425c6a0 0x55d8e422e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:02.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.946+0000 7f51559f1740 4 client.6150 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628406}] 2024-03-30T13:14:02.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.946+0000 7f51559f1740 1 -- 172.21.15.99:0/2305610813 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628406}) -- 0x55d8e419fbc0 con 0x55d8e425c6a0 2024-03-30T13:14:02.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.947+0000 7f514b400640 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8e425c6a0 0x55d8e422e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:02.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.947+0000 7f514b400640 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8e425c6a0 0x55d8e422e5b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86166c873c06c91b server_cookie=85bb99eba800554b in_seq=0 out_seq=0 2024-03-30T13:14:02.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.947+0000 7f5135600640 10 client.6150 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f5135600640 1 -- 172.21.15.99:0/2305610813 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4756 (crc 0 0 0) 0x55d8e419fbc0 con 0x55d8e425c6a0 2024-03-30T13:14:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f5135600640 10 client.6150 handle_command_reply: tid=0 2024-03-30T13:14:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 1 client.6150 shutdown 2024-03-30T13:14:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 1 -- 172.21.15.99:0/2305610813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e42396a0 msgr2=0x55d8e42f86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e42396a0 0x55d8e42f86c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f513c005620 tx=0x7f513c0898e0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 1 -- 172.21.15.99:0/2305610813 shutdown_connections 2024-03-30T13:14:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8e425c6a0 0x55d8e422e5b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d8e4248460 0x55d8e422e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8e4239a80 0x55d8e4259310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 1 --2- 172.21.15.99:0/2305610813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8e42396a0 0x55d8e42f86c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f5135600640 0 client.6150 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 1 -- 172.21.15.99:0/2305610813 >> 172.21.15.99:0/2305610813 conn(0x55d8e41fbbe0 msgr2=0x55d8e4259b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 1 -- 172.21.15.99:0/2305610813 shutdown_connections 2024-03-30T13:14:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 1 -- 172.21.15.99:0/2305610813 wait complete. 2024-03-30T13:14:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.948+0000 7f51559f1740 20 client.6150 trim_cache size 0 max 16384 2024-03-30T13:14:02.961 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:02.961 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/Kconfig", 2024-03-30T13:14:02.961 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628406, 2024-03-30T13:14:02.961 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:02.961 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.600006+0000", 2024-03-30T13:14:02.961 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.830871+0000", 2024-03-30T13:14:02.962 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:02.962 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:02.962 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:02.962 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:02.962 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:02.962 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:02.962 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:02.962 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:02.962 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:02.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.962 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:02.963 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:02.963 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:02.963 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:02.963 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:02.963 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:02.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.963 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:02.963 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 228, 2024-03-30T13:14:02.963 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:02.963 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:02.964 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:02.964 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:02.964 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:02.964 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.830871+0000", 2024-03-30T13:14:02.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:02.964 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:02.964 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:02.965 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:02.965 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:02.965 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:02.965 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:02.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.965 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:02.966 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:02.966 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:02.966 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:02.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.966 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:02.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.967 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.967 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:02.967 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.967 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:02.967 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:02.967 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:02.968 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:02.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.968 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:02.968 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.968 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 228, 2024-03-30T13:14:02.968 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:02.968 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:02.968 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:02.969 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.600006+0000" 2024-03-30T13:14:02.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.969 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:02.969 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:02.969 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 228, 2024-03-30T13:14:02.969 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:02.969 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:02.969 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:02.970 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.600006+0000" 2024-03-30T13:14:02.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.970 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 200, 2024-03-30T13:14:02.970 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:02.970 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:02.970 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 2, 2024-03-30T13:14:02.970 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:02.971 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:02.971 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:02.971 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:02.971 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:02.971 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:02.971 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:02.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.972 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:02.972 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:02.972 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:02.972 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:02.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.973 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:02.973 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:02.973 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.973 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.973 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:02.973 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:02.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.974 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:02.974 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:02.974 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:02.974 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:02.974 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:02.975 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:02.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.975 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:02.975 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:02.975 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:02.975 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:02.976 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.976 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:02.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.976 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:02.976 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:02.976 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:02.977 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:02.977 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:02.977 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:02.977 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:02.977 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:02.977 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:02.978 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:02.978 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:02.978 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:02.978 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:02.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.978 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:02.978 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:02.979 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.979 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.979 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:02.979 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.979 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.979 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.980 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.980 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.980 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:02.980 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.980 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.981 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:02.981 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.981 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.981 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.981 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.981 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.982 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:02.982 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:02.982 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:02.982 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.982 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.983 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:02.983 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.983 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.983 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.983 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.983 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.984 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:02.984 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.984 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:02.984 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:02.984 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.984 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.984 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.985 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.985 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.985 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:02.985 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:02.985 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.985 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.985 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:02.986 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.986 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.986 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.986 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.986 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.986 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:02.986 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:02.986 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:02.986 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:02.987 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:02.987 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:02.987 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:02.987 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:02.987 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:02.987 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:02.987 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:02.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:02.987 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:02.987 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:02.987 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:02.988 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:02.988 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:02.988 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.988 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:02.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:02.988 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:02.988 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:02.988 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:02.988 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:02.988 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:02.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:02.989 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:02.989 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:02.989 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:02.989 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:02.989 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:02.989 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 -- 172.21.15.99:0/398724304 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f512c06c530 msgr2=0x7f512c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f512c06c530 0x7f512c06e9f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5138034000 tx=0x7f5138039040 comp rx=0 tx=0).stop 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 -- 172.21.15.99:0/398724304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 msgr2=0x7f514c0b0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 0x7f514c0b0d50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f513c00d480 tx=0x7f513c00d940 comp rx=0 tx=0).stop 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 -- 172.21.15.99:0/398724304 shutdown_connections 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f512c06c530 0x7f512c06e9f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514c072de0 0x7f514c073260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f514c1462a0 0x7f514c146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 --2- 172.21.15.99:0/398724304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5130004800 0x7f514c0b0d50 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 -- 172.21.15.99:0/398724304 >> 172.21.15.99:0/398724304 conn(0x7f514c0d0450 msgr2=0x7f514c0b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 -- 172.21.15.99:0/398724304 shutdown_connections 2024-03-30T13:14:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:02.949+0000 7f5152e00640 1 -- 172.21.15.99:0/398724304 wait complete. 2024-03-30T13:14:02.992 DEBUG:tasks.cephfs.test_uninlining:getting inode info #15 of 23:1099511628419 2024-03-30T13:14:02.992 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628419 2024-03-30T13:14:02.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628419 2024-03-30T13:14:03.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.193+0000 7f4f3c600640 1 Processor -- start 2024-03-30T13:14:03.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.193+0000 7f4f3c600640 1 -- start start 2024-03-30T13:14:03.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.194+0000 7f4f3c600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3415b3d0 0x7f4f340ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.194+0000 7f4f3c600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4f340b28c0 0x7f4f340b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.194+0000 7f4f3c600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f340c6470 con 0x7f4f340b49f0 2024-03-30T13:14:03.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.194+0000 7f4f3c600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4f340c6240 con 0x7f4f340b28c0 2024-03-30T13:14:03.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.194+0000 7f4f3c600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4f340c7080 con 0x7f4f3415b3d0 2024-03-30T13:14:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.195+0000 7f4f3a600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4f340b28c0 0x7f4f340b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.195+0000 7f4f39200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4f340b49f0 0x7f4f340b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33448/0 (socket says 172.21.15.99:33448) 2024-03-30T13:14:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.195+0000 7f4f39200640 1 -- 172.21.15.99:0/3775917788 learned_addr learned my addr 172.21.15.99:0/3775917788 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.195+0000 7f4f39c00640 1 --2- 172.21.15.99:0/3775917788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3415b3d0 0x7f4f340ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.195+0000 7f4f3a600640 1 -- 172.21.15.99:0/3775917788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3415b3d0 msgr2=0x7f4f340ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.195+0000 7f4f3a600640 1 --2- 172.21.15.99:0/3775917788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3415b3d0 0x7f4f340ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.195+0000 7f4f3a600640 1 -- 172.21.15.99:0/3775917788 >> v1:172.21.15.99:6789/0 conn(0x7f4f340b49f0 legacy=0x7f4f340b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.195+0000 7f4f3a600640 1 -- 172.21.15.99:0/3775917788 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f340c6750 con 0x7f4f340b28c0 2024-03-30T13:14:03.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.196+0000 7f4f3a600640 1 --2- 172.21.15.99:0/3775917788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340b28c0 0x7f4f340b4e50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009d90 tx=0x7f4f2c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8874e0a240be2c57 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.197+0000 7f4f33e00640 1 -- 172.21.15.99:0/3775917788 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c039070 con 0x7f4f340b28c0 2024-03-30T13:14:03.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.197+0000 7f4f33e00640 1 -- 172.21.15.99:0/3775917788 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c02cc60 con 0x7f4f340b28c0 2024-03-30T13:14:03.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.197+0000 7f4f33e00640 1 -- 172.21.15.99:0/3775917788 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c034660 con 0x7f4f340b28c0 2024-03-30T13:14:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.197+0000 7f4f3c600640 1 -- 172.21.15.99:0/3775917788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340b28c0 msgr2=0x7f4f340b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.197+0000 7f4f3c600640 1 --2- 172.21.15.99:0/3775917788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340b28c0 0x7f4f340b4e50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009d90 tx=0x7f4f2c02beb0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.197+0000 7f4f3c600640 1 -- 172.21.15.99:0/3775917788 shutdown_connections 2024-03-30T13:14:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.197+0000 7f4f3c600640 1 --2- 172.21.15.99:0/3775917788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340b28c0 0x7f4f340b4e50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.197+0000 7f4f3c600640 1 --2- 172.21.15.99:0/3775917788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3415b3d0 0x7f4f340ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.197+0000 7f4f3c600640 1 -- 172.21.15.99:0/3775917788 >> 172.21.15.99:0/3775917788 conn(0x7f4f340d0450 msgr2=0x7f4f340d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.198+0000 7f4f3c600640 1 -- 172.21.15.99:0/3775917788 shutdown_connections 2024-03-30T13:14:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.198+0000 7f4f3c600640 1 -- 172.21.15.99:0/3775917788 wait complete. 2024-03-30T13:14:03.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.199+0000 7f4f3c600640 1 Processor -- start 2024-03-30T13:14:03.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.199+0000 7f4f3c600640 1 -- start start 2024-03-30T13:14:03.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.200+0000 7f4f3c600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f340b28c0 0x7f4f340af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.200+0000 7f4f3c600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340b49f0 0x7f4f34155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.200+0000 7f4f3c600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3415b3d0 0x7f4f340ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.200+0000 7f4f3c600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3415b7b0 con 0x7f4f340b49f0 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.200+0000 7f4f3c600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4f340c6d10 con 0x7f4f3415b3d0 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.200+0000 7f4f3c600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4f3415b930 con 0x7f4f340b28c0 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.201+0000 7f4f39200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340b49f0 0x7f4f34155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.201+0000 7f4f39200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340b49f0 0x7f4f34155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55546/0 (socket says 172.21.15.99:55546) 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.201+0000 7f4f39200640 1 -- 172.21.15.99:0/3686012457 learned_addr learned my addr 172.21.15.99:0/3686012457 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.201+0000 7f4f39c00640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f340b28c0 0x7f4f340af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.201+0000 7f4f3a600640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3415b3d0 0x7f4f340ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.201+0000 7f4f39200640 1 -- 172.21.15.99:0/3686012457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f340b28c0 msgr2=0x7f4f340af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.201+0000 7f4f39200640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f340b28c0 0x7f4f340af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.201+0000 7f4f39200640 1 -- 172.21.15.99:0/3686012457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3415b3d0 msgr2=0x7f4f340ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.201+0000 7f4f39200640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3415b3d0 0x7f4f340ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.201+0000 7f4f39200640 1 -- 172.21.15.99:0/3686012457 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f341e5990 con 0x7f4f340b49f0 2024-03-30T13:14:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.201+0000 7f4f39200640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340b49f0 0x7f4f34155dc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c400 tx=0x7f4f2400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.202+0000 7f4f31600640 1 -- 172.21.15.99:0/3686012457 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24017070 con 0x7f4f340b49f0 2024-03-30T13:14:03.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.202+0000 7f4f31600640 1 -- 172.21.15.99:0/3686012457 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f24005ce0 con 0x7f4f340b49f0 2024-03-30T13:14:03.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.202+0000 7f4f31600640 1 -- 172.21.15.99:0/3686012457 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f240072f0 con 0x7f4f340b49f0 2024-03-30T13:14:03.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.202+0000 7f4f3c600640 1 -- 172.21.15.99:0/3686012457 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f341e5c70 con 0x7f4f340b49f0 2024-03-30T13:14:03.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.202+0000 7f4f3c600640 1 -- 172.21.15.99:0/3686012457 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f341e6230 con 0x7f4f340b49f0 2024-03-30T13:14:03.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.204+0000 7f4f31600640 1 -- 172.21.15.99:0/3686012457 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4f2401a070 con 0x7f4f340b49f0 2024-03-30T13:14:03.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.205+0000 7f4f31600640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4f1806c560 0x7f4f1806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.205+0000 7f4f31600640 1 -- 172.21.15.99:0/3686012457 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f4f2408ac70 con 0x7f4f340b49f0 2024-03-30T13:14:03.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.205+0000 7f4f39c00640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4f1806c560 0x7f4f1806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.205+0000 7f4f3f21d740 1 Processor -- start 2024-03-30T13:14:03.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.206+0000 7f4f3f21d740 1 -- start start 2024-03-30T13:14:03.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.206+0000 7f4f39c00640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4f1806c560 0x7f4f1806ea20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009ad0 tx=0x7f4f28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.206+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d4364290 0x55f1d438adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.206+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d438b300 0x55f1d43632d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.206+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d4363810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.206+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f1d42c7330 con 0x55f1d4364670 2024-03-30T13:14:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.206+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f1d426f620 con 0x55f1d438b300 2024-03-30T13:14:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.206+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55f1d42c3440 con 0x55f1d4364290 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.207+0000 7f4f3a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d4363810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.207+0000 7f4f3a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d4363810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55558/0 (socket says 172.21.15.99:55558) 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.207+0000 7f4f3a600640 1 -- 172.21.15.99:0/192798719 learned_addr learned my addr 172.21.15.99:0/192798719 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.207+0000 7f4f39c00640 1 --2- 172.21.15.99:0/192798719 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d4364290 0x55f1d438adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.207+0000 7f4f39200640 1 --2- 172.21.15.99:0/192798719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d438b300 0x55f1d43632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.207+0000 7f4f3a600640 1 -- 172.21.15.99:0/192798719 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d4364290 msgr2=0x55f1d438adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.207+0000 7f4f3a600640 1 --2- 172.21.15.99:0/192798719 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d4364290 0x55f1d438adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.207+0000 7f4f3a600640 1 -- 172.21.15.99:0/192798719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d438b300 msgr2=0x55f1d43632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.207+0000 7f4f3a600640 1 --2- 172.21.15.99:0/192798719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d438b300 0x55f1d43632d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.207+0000 7f4f3a600640 1 -- 172.21.15.99:0/192798719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1d40a7920 con 0x55f1d4364670 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.207+0000 7f4f39200640 1 --2- 172.21.15.99:0/192798719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d438b300 0x55f1d43632d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.208+0000 7f4f3a600640 1 --2- 172.21.15.99:0/192798719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d4363810 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009d90 tx=0x7f4f2c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5e50240a473f73 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.208+0000 7f4f22000640 1 -- 172.21.15.99:0/192798719 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c039040 con 0x55f1d4364670 2024-03-30T13:14:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.208+0000 7f4f22000640 1 -- 172.21.15.99:0/192798719 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c03f440 con 0x55f1d4364670 2024-03-30T13:14:03.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.208+0000 7f4f22000640 1 -- 172.21.15.99:0/192798719 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c03f830 con 0x55f1d4364670 2024-03-30T13:14:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.208+0000 7f4f3f21d740 1 -- 172.21.15.99:0/192798719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 msgr2=0x55f1d4363810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.208+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/192798719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d4363810 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009d90 tx=0x7f4f2c02e000 comp rx=0 tx=0).stop 2024-03-30T13:14:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.208+0000 7f4f3f21d740 1 -- 172.21.15.99:0/192798719 shutdown_connections 2024-03-30T13:14:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.209+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/192798719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d4363810 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.209+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/192798719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d438b300 0x55f1d43632d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.209+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/192798719 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d4364290 0x55f1d438adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.209+0000 7f4f3f21d740 1 -- 172.21.15.99:0/192798719 >> 172.21.15.99:0/192798719 conn(0x55f1d432abe0 msgr2=0x55f1d43a8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.209+0000 7f4f3f21d740 1 -- 172.21.15.99:0/192798719 shutdown_connections 2024-03-30T13:14:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.209+0000 7f4f3f21d740 1 -- 172.21.15.99:0/192798719 wait complete. 2024-03-30T13:14:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.209+0000 7f4f3f21d740 1 -- start start 2024-03-30T13:14:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.209+0000 7f4f3f21d740 1 Processor -- start 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.210+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d4382150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.210+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d4364670 0x55f1d43aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.210+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d43bc1e0 0x55f1d43bc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.210+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f1d438a930 con 0x55f1d4364290 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.210+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f1d42829d0 con 0x55f1d4364670 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.210+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55f1d43836b0 con 0x55f1d43bc1e0 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.210+0000 7f4f3f21d740 10 client.0 _ll_register_callbacks cb 0x55f1d42befd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.211+0000 7f4f39c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d4382150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.211+0000 7f4f39c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d4382150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55570/0 (socket says 172.21.15.99:55570) 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.211+0000 7f4f39c00640 1 -- 172.21.15.99:0/833946883 learned_addr learned my addr 172.21.15.99:0/833946883 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.211+0000 7f4f39c00640 1 -- 172.21.15.99:0/833946883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d43bc1e0 msgr2=0x55f1d43bc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.211+0000 7f4f39c00640 1 --2- 172.21.15.99:0/833946883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d43bc1e0 0x55f1d43bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.211+0000 7f4f39c00640 1 -- 172.21.15.99:0/833946883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d4364670 msgr2=0x55f1d43aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.211+0000 7f4f39c00640 1 --2- 172.21.15.99:0/833946883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d4364670 0x55f1d43aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.211+0000 7f4f39c00640 1 -- 172.21.15.99:0/833946883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1d3f9b210 con 0x55f1d4364290 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.211+0000 7f4f39c00640 1 --2- 172.21.15.99:0/833946883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d4382150 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4f280156f0 tx=0x7f4f280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29cfe6cd795c4da server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.211+0000 7f4f16a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f16a00640 1 -- 172.21.15.99:0/833946883 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f28025070 con 0x55f1d4364290 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f16a00640 1 -- 172.21.15.99:0/833946883 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f4f28014600 con 0x55f1d4364290 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f3f21d740 1 -- 172.21.15.99:0/833946883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f2c03f440 con 0x55f1d4364290 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f16a00640 1 -- 172.21.15.99:0/833946883 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4f28030050 con 0x55f1d4364290 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f3f21d740 10 client.6165 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f3f21d740 1 -- 172.21.15.99:0/833946883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55f1d41080b0 con 0x55f1d4364290 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f16a00640 1 -- 172.21.15.99:0/833946883 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c03f440 con 0x55f1d4364290 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f16a00640 1 -- 172.21.15.99:0/833946883 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f4f28033020 con 0x55f1d4364290 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f3f21d740 10 client.6165 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f3f21d740 10 client.6165 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f3f21d740 20 client.6165 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/833946883 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1d43a9380 0x55f1d43a9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f3f21d740 4 client.6165 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.212+0000 7f4f3f21d740 1 -- 172.21.15.99:0/833946883 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1d42d4870 con 0x55f1d43a9380 2024-03-30T13:14:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.213+0000 7f4f39200640 1 --2- 172.21.15.99:0/833946883 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1d43a9380 0x55f1d43a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.214+0000 7f4f39200640 1 --2- 172.21.15.99:0/833946883 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1d43a9380 0x55f1d43a9800 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91c054878cdeb74 server_cookie=7657a9d49140968f in_seq=0 out_seq=0 2024-03-30T13:14:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.214+0000 7f4f16a00640 10 client.6165 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.215+0000 7f4f16a00640 1 -- 172.21.15.99:0/833946883 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55f1d42d4870 con 0x55f1d43a9380 2024-03-30T13:14:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.215+0000 7f4f16a00640 10 client.6165 handle_command_reply: tid=0 2024-03-30T13:14:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 1 client.6165 shutdown 2024-03-30T13:14:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 1 -- 172.21.15.99:0/833946883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 msgr2=0x55f1d4382150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/833946883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d4382150 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4f280156f0 tx=0x7f4f280046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 1 -- 172.21.15.99:0/833946883 shutdown_connections 2024-03-30T13:14:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/833946883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d43bc1e0 0x55f1d43bc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/833946883 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1d43a9380 0x55f1d43a9800 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/833946883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d4364670 0x55f1d43aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/833946883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d4382150 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f16a00640 0 client.6165 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 1 -- 172.21.15.99:0/833946883 >> 172.21.15.99:0/833946883 conn(0x55f1d432abe0 msgr2=0x55f1d438dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 1 -- 172.21.15.99:0/833946883 shutdown_connections 2024-03-30T13:14:03.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 1 -- 172.21.15.99:0/833946883 wait complete. 2024-03-30T13:14:03.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.216+0000 7f4f3f21d740 20 client.6165 trim_cache size 0 max 16384 2024-03-30T13:14:03.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.232+0000 7f4f3f21d740 1 Processor -- start 2024-03-30T13:14:03.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.232+0000 7f4f3f21d740 1 -- start start 2024-03-30T13:14:03.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.233+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d4364290 0x55f1d4391100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.233+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d43b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.233+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d43bc1e0 0x55f1d43b7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.233+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4f34200c90 con 0x55f1d4364670 2024-03-30T13:14:03.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.233+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4f341554f0 con 0x55f1d43bc1e0 2024-03-30T13:14:03.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.233+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4f34147bc0 con 0x55f1d4364290 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f39c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d4364290 0x55f1d4391100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f3a600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d43bc1e0 0x55f1d43b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f39200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d43b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f39200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d43b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55578/0 (socket says 172.21.15.99:55578) 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f39200640 1 -- 172.21.15.99:0/1431739070 learned_addr learned my addr 172.21.15.99:0/1431739070 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f39c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d4364290 0x55f1d4391100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:35856/0 (socket says 172.21.15.99:35856) 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f39200640 1 -- 172.21.15.99:0/1431739070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d4364290 msgr2=0x55f1d4391100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f39200640 1 --2- 172.21.15.99:0/1431739070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d4364290 0x55f1d4391100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f39200640 1 -- 172.21.15.99:0/1431739070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d43bc1e0 msgr2=0x55f1d43b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f39200640 1 --2- 172.21.15.99:0/1431739070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d43bc1e0 0x55f1d43b7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f39200640 1 -- 172.21.15.99:0/1431739070 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1d43bc9d0 con 0x55f1d4364670 2024-03-30T13:14:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f3a600640 1 --2- 172.21.15.99:0/1431739070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d43bc1e0 0x55f1d43b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:03.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.234+0000 7f4f39200640 1 --2- 172.21.15.99:0/1431739070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d43b6fc0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4f24054e90 tx=0x7f4f24088f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5818e90f3677adf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f21600640 1 -- 172.21.15.99:0/1431739070 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24087070 con 0x55f1d4364670 2024-03-30T13:14:03.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f21600640 1 -- 172.21.15.99:0/1431739070 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f24089150 con 0x55f1d4364670 2024-03-30T13:14:03.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f21600640 1 -- 172.21.15.99:0/1431739070 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f240550a0 con 0x55f1d4364670 2024-03-30T13:14:03.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1431739070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 msgr2=0x55f1d43b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/1431739070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d43b6fc0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4f24054e90 tx=0x7f4f24088f10 comp rx=0 tx=0).stop 2024-03-30T13:14:03.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1431739070 shutdown_connections 2024-03-30T13:14:03.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/1431739070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d43bc1e0 0x55f1d43b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/1431739070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364670 0x55f1d43b6fc0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/1431739070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d4364290 0x55f1d4391100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1431739070 >> 172.21.15.99:0/1431739070 conn(0x55f1d432abe0 msgr2=0x55f1d4382bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1431739070 shutdown_connections 2024-03-30T13:14:03.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.235+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1431739070 wait complete. 2024-03-30T13:14:03.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.236+0000 7f4f3f21d740 1 -- start start 2024-03-30T13:14:03.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.236+0000 7f4f3f21d740 1 Processor -- start 2024-03-30T13:14:03.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.237+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d439f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.237+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d4364670 0x55f1d4422af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.237+0000 7f4f3f21d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d43bc1e0 0x55f1d43a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.237+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f1d42829d0 con 0x55f1d4364290 2024-03-30T13:14:03.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.237+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4f34154ea0 con 0x55f1d4364670 2024-03-30T13:14:03.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.237+0000 7f4f3f21d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55f1d439eed0 con 0x55f1d43bc1e0 2024-03-30T13:14:03.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.237+0000 7f4f3f21d740 10 client.0 _ll_register_callbacks cb 0x7f4f280098e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:03.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.237+0000 7f4f39c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d439f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.237+0000 7f4f39c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d439f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55592/0 (socket says 172.21.15.99:55592) 2024-03-30T13:14:03.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.237+0000 7f4f39c00640 1 -- 172.21.15.99:0/1616916243 learned_addr learned my addr 172.21.15.99:0/1616916243 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.238+0000 7f4f39c00640 1 -- 172.21.15.99:0/1616916243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d43bc1e0 msgr2=0x55f1d43a7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.238+0000 7f4f39c00640 1 --2- 172.21.15.99:0/1616916243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d43bc1e0 0x55f1d43a7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.238+0000 7f4f39c00640 1 -- 172.21.15.99:0/1616916243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d4364670 msgr2=0x55f1d4422af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.238+0000 7f4f39c00640 1 --2- 172.21.15.99:0/1616916243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d4364670 0x55f1d4422af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.238+0000 7f4f39c00640 1 -- 172.21.15.99:0/1616916243 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1d3f742d0 con 0x55f1d4364290 2024-03-30T13:14:03.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.238+0000 7f4f39c00640 1 --2- 172.21.15.99:0/1616916243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d439f510 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4f280156f0 tx=0x7f4f28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bdced8ebb8e5bb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.238+0000 7f4f16a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.238+0000 7f4f16a00640 1 -- 172.21.15.99:0/1616916243 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f28025040 con 0x55f1d4364290 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.238+0000 7f4f16a00640 1 -- 172.21.15.99:0/1616916243 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f4f2802a440 con 0x55f1d4364290 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.238+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1616916243 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f24089150 con 0x55f1d4364290 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.239+0000 7f4f16a00640 1 -- 172.21.15.99:0/1616916243 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4f2802a640 con 0x55f1d4364290 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.239+0000 7f4f3f21d740 10 client.6171 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.239+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1616916243 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55f1d4386380 con 0x55f1d4364290 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.239+0000 7f4f16a00640 1 -- 172.21.15.99:0/1616916243 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f24089150 con 0x55f1d4364290 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.239+0000 7f4f16a00640 1 -- 172.21.15.99:0/1616916243 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f4f28047020 con 0x55f1d4364290 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.239+0000 7f4f3f21d740 10 client.6171 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.239+0000 7f4f3f21d740 10 client.6171 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.239+0000 7f4f3f21d740 20 client.6171 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.239+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/1616916243 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1d43a8260 0x55f1d43bacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.239+0000 7f4f3f21d740 4 client.6171 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628419}] 2024-03-30T13:14:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.239+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1616916243 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628419}) -- 0x55f1d42cebc0 con 0x55f1d43a8260 2024-03-30T13:14:03.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.240+0000 7f4f39200640 1 --2- 172.21.15.99:0/1616916243 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1d43a8260 0x55f1d43bacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.241+0000 7f4f39200640 1 --2- 172.21.15.99:0/1616916243 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1d43a8260 0x55f1d43bacf0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17c8eb3630713b4e server_cookie=202079a067a0ac80 in_seq=0 out_seq=0 2024-03-30T13:14:03.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.241+0000 7f4f16a00640 10 client.6171 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f16a00640 1 -- 172.21.15.99:0/1616916243 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4769 (crc 0 0 0) 0x55f1d42cebc0 con 0x55f1d43a8260 2024-03-30T13:14:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f16a00640 10 client.6171 handle_command_reply: tid=0 2024-03-30T13:14:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 1 client.6171 shutdown 2024-03-30T13:14:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1616916243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 msgr2=0x55f1d439f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/1616916243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d439f510 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4f280156f0 tx=0x7f4f28017000 comp rx=0 tx=0).stop 2024-03-30T13:14:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1616916243 shutdown_connections 2024-03-30T13:14:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/1616916243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55f1d43bc1e0 0x55f1d43a7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/1616916243 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55f1d43a8260 0x55f1d43bacf0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/1616916243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1d4364670 0x55f1d4422af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 1 --2- 172.21.15.99:0/1616916243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1d4364290 0x55f1d439f510 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f16a00640 0 client.6171 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1616916243 >> 172.21.15.99:0/1616916243 conn(0x55f1d432abe0 msgr2=0x55f1d438a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1616916243 shutdown_connections 2024-03-30T13:14:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 1 -- 172.21.15.99:0/1616916243 wait complete. 2024-03-30T13:14:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.242+0000 7f4f3f21d740 20 client.6171 trim_cache size 0 max 16384 2024-03-30T13:14:03.250 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debug.h", 2024-03-30T13:14:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628419, 2024-03-30T13:14:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.603759+0000", 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.868870+0000", 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2579, 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.868870+0000", 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 4, 2024-03-30T13:14:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2579, 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.603759+0000" 2024-03-30T13:14:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2579, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.603759+0000" 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 204, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 28, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:03.265 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:03.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 -- 172.21.15.99:0/3686012457 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4f1806c560 msgr2=0x7f4f1806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4f1806c560 0x7f4f1806ea20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009ad0 tx=0x7f4f28008040 comp rx=0 tx=0).stop 2024-03-30T13:14:03.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 -- 172.21.15.99:0/3686012457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340b49f0 msgr2=0x7f4f34155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340b49f0 0x7f4f34155dc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c400 tx=0x7f4f2400c8c0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 -- 172.21.15.99:0/3686012457 shutdown_connections 2024-03-30T13:14:03.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4f1806c560 0x7f4f1806ea20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3415b3d0 0x7f4f340ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340b49f0 0x7f4f34155dc0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 --2- 172.21.15.99:0/3686012457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f340b28c0 0x7f4f340af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 -- 172.21.15.99:0/3686012457 >> 172.21.15.99:0/3686012457 conn(0x7f4f340d0450 msgr2=0x7f4f340b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 -- 172.21.15.99:0/3686012457 shutdown_connections 2024-03-30T13:14:03.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.243+0000 7f4f3c600640 1 -- 172.21.15.99:0/3686012457 wait complete. 2024-03-30T13:14:03.268 DEBUG:tasks.cephfs.test_uninlining:getting inode info #16 of 23:1099511628426 2024-03-30T13:14:03.268 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628426 2024-03-30T13:14:03.268 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628426 2024-03-30T13:14:03.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.479+0000 7f48eb200640 1 Processor -- start 2024-03-30T13:14:03.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.480+0000 7f48eb200640 1 -- start start 2024-03-30T13:14:03.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.481+0000 7f48eb200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e415e920 0x7f48e40d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.481+0000 7f48eb200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f48e40cfde0 0x7f48e40d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.481+0000 7f48eb200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f48e40d0f90 0x7f48e40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.481+0000 7f48eb200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f48e40d37c0 con 0x7f48e40d0f90 2024-03-30T13:14:03.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.481+0000 7f48eb200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f48e415ed00 con 0x7f48e40cfde0 2024-03-30T13:14:03.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.481+0000 7f48eb200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f48e40d21e0 con 0x7f48e415e920 2024-03-30T13:14:03.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.481+0000 7f48e9200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f48e40d0f90 0x7f48e40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.481+0000 7f48e9200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f48e40d0f90 0x7f48e40d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55608/0 (socket says 172.21.15.99:55608) 2024-03-30T13:14:03.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.481+0000 7f48e9200640 1 -- 172.21.15.99:0/1118659210 learned_addr learned my addr 172.21.15.99:0/1118659210 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.481+0000 7f48e3e00640 1 --2- 172.21.15.99:0/1118659210 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e415e920 0x7f48e40d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.481+0000 7f48db400640 1 --2- 172.21.15.99:0/1118659210 >> v2:172.21.15.181:3300/0 conn(0x7f48e40cfde0 0x7f48e40d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.482+0000 7f48e9200640 1 -- 172.21.15.99:0/1118659210 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e415e920 msgr2=0x7f48e40d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.482+0000 7f48e9200640 1 --2- 172.21.15.99:0/1118659210 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e415e920 0x7f48e40d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.482+0000 7f48e9200640 1 -- 172.21.15.99:0/1118659210 >> v2:172.21.15.181:3300/0 conn(0x7f48e40cfde0 msgr2=0x7f48e40d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.482+0000 7f48e9200640 1 --2- 172.21.15.99:0/1118659210 >> v2:172.21.15.181:3300/0 conn(0x7f48e40cfde0 0x7f48e40d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.482+0000 7f48e9200640 1 -- 172.21.15.99:0/1118659210 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e40d24c0 con 0x7f48e40d0f90 2024-03-30T13:14:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.482+0000 7f48db400640 1 --2- 172.21.15.99:0/1118659210 >> v2:172.21.15.181:3300/0 conn(0x7f48e40cfde0 0x7f48e40d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.483+0000 7f48e9200640 1 --2- 172.21.15.99:0/1118659210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e40d0f90 0x7f48e40d1420 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f48e408cdb0 tx=0x7f48dc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bf0a9137a44820 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.483+0000 7f48e3400640 1 -- 172.21.15.99:0/1118659210 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc02ca80 con 0x7f48e40d0f90 2024-03-30T13:14:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.483+0000 7f48e3400640 1 -- 172.21.15.99:0/1118659210 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48dc02cc20 con 0x7f48e40d0f90 2024-03-30T13:14:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.483+0000 7f48e3400640 1 -- 172.21.15.99:0/1118659210 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc0343f0 con 0x7f48e40d0f90 2024-03-30T13:14:03.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.483+0000 7f48eb200640 1 -- 172.21.15.99:0/1118659210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e40d0f90 msgr2=0x7f48e40d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.483+0000 7f48eb200640 1 --2- 172.21.15.99:0/1118659210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e40d0f90 0x7f48e40d1420 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f48e408cdb0 tx=0x7f48dc02bee0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.484+0000 7f48eb200640 1 -- 172.21.15.99:0/1118659210 shutdown_connections 2024-03-30T13:14:03.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.484+0000 7f48eb200640 1 --2- 172.21.15.99:0/1118659210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e40d0f90 0x7f48e40d1420 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.484+0000 7f48eb200640 1 --2- 172.21.15.99:0/1118659210 >> v2:172.21.15.181:3300/0 conn(0x7f48e40cfde0 0x7f48e40d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.484+0000 7f48eb200640 1 --2- 172.21.15.99:0/1118659210 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e415e920 0x7f48e40d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.484+0000 7f48eb200640 1 -- 172.21.15.99:0/1118659210 >> 172.21.15.99:0/1118659210 conn(0x7f48e408bfc0 msgr2=0x7f48e40d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.484+0000 7f48eb200640 1 -- 172.21.15.99:0/1118659210 shutdown_connections 2024-03-30T13:14:03.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.484+0000 7f48eb200640 1 -- 172.21.15.99:0/1118659210 wait complete. 2024-03-30T13:14:03.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.485+0000 7f48eb200640 1 Processor -- start 2024-03-30T13:14:03.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.486+0000 7f48eb200640 1 -- start start 2024-03-30T13:14:03.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.486+0000 7f48eb200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e40cfde0 0x7f48e415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.486+0000 7f48eb200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48e40d0f90 0x7f48e40b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.486+0000 7f48eb200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e415e920 0x7f48e41f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.486+0000 7f48eb200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f48e40d2d60 con 0x7f48e40cfde0 2024-03-30T13:14:03.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.486+0000 7f48eb200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f48e40d2a80 con 0x7f48e40d0f90 2024-03-30T13:14:03.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.486+0000 7f48eb200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f48e40d4f50 con 0x7f48e415e920 2024-03-30T13:14:03.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.487+0000 7f48e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e40cfde0 0x7f48e415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.487+0000 7f48e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e40cfde0 0x7f48e415bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55616/0 (socket says 172.21.15.99:55616) 2024-03-30T13:14:03.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.487+0000 7f48e3e00640 1 -- 172.21.15.99:0/825948908 learned_addr learned my addr 172.21.15.99:0/825948908 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.487+0000 7f48e9200640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e415e920 0x7f48e41f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.487+0000 7f48db400640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48e40d0f90 0x7f48e40b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.487+0000 7f48e3e00640 1 -- 172.21.15.99:0/825948908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e415e920 msgr2=0x7f48e41f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.487+0000 7f48e3e00640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e415e920 0x7f48e41f8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.487+0000 7f48e3e00640 1 -- 172.21.15.99:0/825948908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48e40d0f90 msgr2=0x7f48e40b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.487+0000 7f48e3e00640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48e40d0f90 0x7f48e40b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.487+0000 7f48e3e00640 1 -- 172.21.15.99:0/825948908 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e41f9210 con 0x7f48e40cfde0 2024-03-30T13:14:03.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.487+0000 7f48db400640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48e40d0f90 0x7f48e40b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:03.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.488+0000 7f48e3e00640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e40cfde0 0x7f48e415bc00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f48d400d800 tx=0x7f48d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.488+0000 7f48e0c00640 1 -- 172.21.15.99:0/825948908 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d400b6c0 con 0x7f48e40cfde0 2024-03-30T13:14:03.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.488+0000 7f48e0c00640 1 -- 172.21.15.99:0/825948908 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d4019070 con 0x7f48e40cfde0 2024-03-30T13:14:03.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.488+0000 7f48e0c00640 1 -- 172.21.15.99:0/825948908 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d400ba80 con 0x7f48e40cfde0 2024-03-30T13:14:03.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.488+0000 7f48eb200640 1 -- 172.21.15.99:0/825948908 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e41f94f0 con 0x7f48e40cfde0 2024-03-30T13:14:03.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.488+0000 7f48eb200640 1 -- 172.21.15.99:0/825948908 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e40ca3c0 con 0x7f48e40cfde0 2024-03-30T13:14:03.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.490+0000 7f48e0c00640 1 -- 172.21.15.99:0/825948908 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f48d400bc20 con 0x7f48e40cfde0 2024-03-30T13:14:03.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.491+0000 7f48e0c00640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c006c530 0x7f48c006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.491+0000 7f48e0c00640 1 -- 172.21.15.99:0/825948908 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f48d408bc50 con 0x7f48e40cfde0 2024-03-30T13:14:03.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.491+0000 7f48db400640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c006c530 0x7f48c006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.492+0000 7f48db400640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c006c530 0x7f48c006e9f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f48e40cb120 tx=0x7f48cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.492+0000 7f48ede77740 1 Processor -- start 2024-03-30T13:14:03.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.492+0000 7f48ede77740 1 -- start start 2024-03-30T13:14:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.493+0000 7f48ede77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe290 0x559e33c24dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.493+0000 7f48ede77740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33c25300 0x559e33bfd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.493+0000 7f48ede77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe670 0x559e33bfd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.493+0000 7f48ede77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559e33b61330 con 0x559e33bfe670 2024-03-30T13:14:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.493+0000 7f48ede77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559e33b09620 con 0x559e33bfe290 2024-03-30T13:14:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.493+0000 7f48ede77740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x559e33b5d440 con 0x559e33c25300 2024-03-30T13:14:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.493+0000 7f48e9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe670 0x559e33bfd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.493+0000 7f48e9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe670 0x559e33bfd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55626/0 (socket says 172.21.15.99:55626) 2024-03-30T13:14:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.493+0000 7f48e9200640 1 -- 172.21.15.99:0/3676990541 learned_addr learned my addr 172.21.15.99:0/3676990541 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48db400640 1 --2- 172.21.15.99:0/3676990541 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33c25300 0x559e33bfd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48e3e00640 1 --2- 172.21.15.99:0/3676990541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe290 0x559e33c24dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48e9200640 1 -- 172.21.15.99:0/3676990541 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33c25300 msgr2=0x559e33bfd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48e9200640 1 --2- 172.21.15.99:0/3676990541 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33c25300 0x559e33bfd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48e9200640 1 -- 172.21.15.99:0/3676990541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe290 msgr2=0x559e33c24dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48e9200640 1 --2- 172.21.15.99:0/3676990541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe290 0x559e33c24dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48e9200640 1 -- 172.21.15.99:0/3676990541 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e33941920 con 0x559e33bfe670 2024-03-30T13:14:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48db400640 1 --2- 172.21.15.99:0/3676990541 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33c25300 0x559e33bfd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48e9200640 1 --2- 172.21.15.99:0/3676990541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe670 0x559e33bfd810 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009e20 tx=0x7f48dc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ad3ebdd3322892 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48d8c00640 1 -- 172.21.15.99:0/3676990541 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc02ca80 con 0x559e33bfe670 2024-03-30T13:14:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48d8c00640 1 -- 172.21.15.99:0/3676990541 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48dc03e430 con 0x559e33bfe670 2024-03-30T13:14:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.494+0000 7f48d8c00640 1 -- 172.21.15.99:0/3676990541 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc03e820 con 0x559e33bfe670 2024-03-30T13:14:03.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.495+0000 7f48ede77740 1 -- 172.21.15.99:0/3676990541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe670 msgr2=0x559e33bfd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.495+0000 7f48ede77740 1 --2- 172.21.15.99:0/3676990541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe670 0x559e33bfd810 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009e20 tx=0x7f48dc02e000 comp rx=0 tx=0).stop 2024-03-30T13:14:03.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.495+0000 7f48ede77740 1 -- 172.21.15.99:0/3676990541 shutdown_connections 2024-03-30T13:14:03.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.495+0000 7f48ede77740 1 --2- 172.21.15.99:0/3676990541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe670 0x559e33bfd810 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.495+0000 7f48ede77740 1 --2- 172.21.15.99:0/3676990541 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33c25300 0x559e33bfd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.495+0000 7f48ede77740 1 --2- 172.21.15.99:0/3676990541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe290 0x559e33c24dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.495+0000 7f48ede77740 1 -- 172.21.15.99:0/3676990541 >> 172.21.15.99:0/3676990541 conn(0x559e33bc4be0 msgr2=0x559e33c42fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.495+0000 7f48ede77740 1 -- 172.21.15.99:0/3676990541 shutdown_connections 2024-03-30T13:14:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.495+0000 7f48ede77740 1 -- 172.21.15.99:0/3676990541 wait complete. 2024-03-30T13:14:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.496+0000 7f48ede77740 1 -- start start 2024-03-30T13:14:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.496+0000 7f48ede77740 1 Processor -- start 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.497+0000 7f48ede77740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33bfe290 0x559e33c1c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.497+0000 7f48ede77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe670 0x559e33c52bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.497+0000 7f48ede77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33c3ee80 0x559e33c3cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.497+0000 7f48ede77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559e33c24930 con 0x559e33c3ee80 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.497+0000 7f48ede77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559e33b1c9d0 con 0x559e33bfe670 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.497+0000 7f48ede77740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x559e33c1d6b0 con 0x559e33bfe290 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.497+0000 7f48ede77740 10 client.0 _ll_register_callbacks cb 0x559e33b58fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.497+0000 7f48e9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33c3ee80 0x559e33c3cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48e9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33c3ee80 0x559e33c3cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55638/0 (socket says 172.21.15.99:55638) 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48e9200640 1 -- 172.21.15.99:0/2418153978 learned_addr learned my addr 172.21.15.99:0/2418153978 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48e3e00640 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33bfe290 0x559e33c1c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48db400640 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe670 0x559e33c52bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48e9200640 1 -- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33bfe290 msgr2=0x559e33c1c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48e9200640 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33bfe290 0x559e33c1c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48e9200640 1 -- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe670 msgr2=0x559e33c52bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48e9200640 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe670 0x559e33c52bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48e9200640 1 -- 172.21.15.99:0/2418153978 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e33835210 con 0x559e33c3ee80 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48db400640 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe670 0x559e33c52bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48e9200640 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33c3ee80 0x559e33c3cec0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009f10 tx=0x7f48dc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9debe4e45c538515 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48d1600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48d1600640 1 -- 172.21.15.99:0/2418153978 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc03edd0 con 0x559e33c3ee80 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.498+0000 7f48d1600640 1 -- 172.21.15.99:0/2418153978 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f48dc003990 con 0x559e33c3ee80 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48ede77740 1 -- 172.21.15.99:0/2418153978 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48dc03e430 con 0x559e33c3ee80 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48d1600640 1 -- 172.21.15.99:0/2418153978 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f48dc057050 con 0x559e33c3ee80 2024-03-30T13:14:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48ede77740 10 client.6183 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:03.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48ede77740 1 -- 172.21.15.99:0/2418153978 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x559e339a20b0 con 0x559e33c3ee80 2024-03-30T13:14:03.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48d1600640 1 -- 172.21.15.99:0/2418153978 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48dc03e430 con 0x559e33c3ee80 2024-03-30T13:14:03.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48d1600640 1 -- 172.21.15.99:0/2418153978 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f48dc05a020 con 0x559e33c3ee80 2024-03-30T13:14:03.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48ede77740 10 client.6183 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:03.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48ede77740 10 client.6183 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:03.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48ede77740 20 client.6183 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:03.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48ede77740 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559e33c3f2e0 0x559e33c2b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48ede77740 4 client.6183 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:03.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.499+0000 7f48ede77740 1 -- 172.21.15.99:0/2418153978 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e33b6e870 con 0x559e33c3f2e0 2024-03-30T13:14:03.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.500+0000 7f48e3e00640 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559e33c3f2e0 0x559e33c2b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.501+0000 7f48e3e00640 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559e33c3f2e0 0x559e33c2b8f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1e8d8597407ce96 server_cookie=b79cba7c46be6705 in_seq=0 out_seq=0 2024-03-30T13:14:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.501+0000 7f48d1600640 10 client.6183 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.502+0000 7f48d1600640 1 -- 172.21.15.99:0/2418153978 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x559e33b6e870 con 0x559e33c3f2e0 2024-03-30T13:14:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.502+0000 7f48d1600640 10 client.6183 handle_command_reply: tid=0 2024-03-30T13:14:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.502+0000 7f48ede77740 1 client.6183 shutdown 2024-03-30T13:14:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48ede77740 1 -- 172.21.15.99:0/2418153978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33c3ee80 msgr2=0x559e33c3cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48ede77740 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33c3ee80 0x559e33c3cec0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009f10 tx=0x7f48dc004ab0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48ede77740 1 -- 172.21.15.99:0/2418153978 shutdown_connections 2024-03-30T13:14:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48ede77740 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33c3ee80 0x559e33c3cec0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48ede77740 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559e33c3f2e0 0x559e33c2b8f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48ede77740 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe670 0x559e33c52bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48ede77740 1 --2- 172.21.15.99:0/2418153978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33bfe290 0x559e33c1c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48d1600640 0 client.6183 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48ede77740 1 -- 172.21.15.99:0/2418153978 >> 172.21.15.99:0/2418153978 conn(0x559e33bc4be0 msgr2=0x559e33c24000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48ede77740 1 -- 172.21.15.99:0/2418153978 shutdown_connections 2024-03-30T13:14:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48ede77740 1 -- 172.21.15.99:0/2418153978 wait complete. 2024-03-30T13:14:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.503+0000 7f48ede77740 20 client.6183 trim_cache size 0 max 16384 2024-03-30T13:14:03.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.519+0000 7f48ede77740 1 Processor -- start 2024-03-30T13:14:03.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.519+0000 7f48ede77740 1 -- start start 2024-03-30T13:14:03.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.519+0000 7f48ede77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c3cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48ede77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe670 0x559e33c3b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48ede77740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33c3ee80 0x559e33c654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48ede77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f48e4200dd0 con 0x559e33bfe290 2024-03-30T13:14:03.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48ede77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f48e41e9500 con 0x559e33bfe670 2024-03-30T13:14:03.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48ede77740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f48e40c8dc0 con 0x559e33c3ee80 2024-03-30T13:14:03.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c3cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c3cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55644/0 (socket says 172.21.15.99:55644) 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48e3e00640 1 -- 172.21.15.99:0/1928452592 learned_addr learned my addr 172.21.15.99:0/1928452592 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48e9200640 1 --2- 172.21.15.99:0/1928452592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33c3ee80 0x559e33c654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48e3e00640 1 -- 172.21.15.99:0/1928452592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33c3ee80 msgr2=0x559e33c654e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48e3e00640 1 --2- 172.21.15.99:0/1928452592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33c3ee80 0x559e33c654e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48e3e00640 1 -- 172.21.15.99:0/1928452592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe670 msgr2=0x559e33c3b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48e3e00640 1 --2- 172.21.15.99:0/1928452592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe670 0x559e33c3b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.520+0000 7f48e3e00640 1 -- 172.21.15.99:0/1928452592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e33c24d90 con 0x559e33bfe290 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.521+0000 7f48e3e00640 1 --2- 172.21.15.99:0/1928452592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c3cdd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f48d4006fd0 tx=0x7f48d4055dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd78b2e008a3b64 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.521+0000 7f48d3e00640 1 -- 172.21.15.99:0/1928452592 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4087070 con 0x559e33bfe290 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.521+0000 7f48d3e00640 1 -- 172.21.15.99:0/1928452592 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d4075070 con 0x559e33bfe290 2024-03-30T13:14:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.521+0000 7f48d3e00640 1 -- 172.21.15.99:0/1928452592 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4059aa0 con 0x559e33bfe290 2024-03-30T13:14:03.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.521+0000 7f48ede77740 1 -- 172.21.15.99:0/1928452592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 msgr2=0x559e33c3cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.521+0000 7f48ede77740 1 --2- 172.21.15.99:0/1928452592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c3cdd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f48d4006fd0 tx=0x7f48d4055dd0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.522+0000 7f48ede77740 1 -- 172.21.15.99:0/1928452592 shutdown_connections 2024-03-30T13:14:03.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.522+0000 7f48ede77740 1 --2- 172.21.15.99:0/1928452592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33c3ee80 0x559e33c654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.522+0000 7f48ede77740 1 --2- 172.21.15.99:0/1928452592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33bfe670 0x559e33c3b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.522+0000 7f48ede77740 1 --2- 172.21.15.99:0/1928452592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c3cdd0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.522+0000 7f48ede77740 1 -- 172.21.15.99:0/1928452592 >> 172.21.15.99:0/1928452592 conn(0x559e33bc4be0 msgr2=0x559e33c52950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.522+0000 7f48ede77740 1 -- 172.21.15.99:0/1928452592 shutdown_connections 2024-03-30T13:14:03.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.522+0000 7f48ede77740 1 -- 172.21.15.99:0/1928452592 wait complete. 2024-03-30T13:14:03.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.522+0000 7f48ede77740 1 -- start start 2024-03-30T13:14:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.523+0000 7f48ede77740 1 Processor -- start 2024-03-30T13:14:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48ede77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c65780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48ede77740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33bfe670 0x559e33c1c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48ede77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33c3ee80 0x559e33c1c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48ede77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f48e40c9410 con 0x559e33bfe290 2024-03-30T13:14:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48ede77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559e33c2c2d0 con 0x559e33c3ee80 2024-03-30T13:14:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48ede77740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x559e33cbec30 con 0x559e33bfe670 2024-03-30T13:14:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48ede77740 10 client.0 _ll_register_callbacks cb 0x7f48dc009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c65780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c65780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55652/0 (socket says 172.21.15.99:55652) 2024-03-30T13:14:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48e3e00640 1 -- 172.21.15.99:0/3398124492 learned_addr learned my addr 172.21.15.99:0/3398124492 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48db400640 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33bfe670 0x559e33c1c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48e3e00640 1 -- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33bfe670 msgr2=0x559e33c1c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48e3e00640 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33bfe670 0x559e33c1c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48e3e00640 1 -- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33c3ee80 msgr2=0x559e33c1c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48e3e00640 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33c3ee80 0x559e33c1c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48e3e00640 1 -- 172.21.15.99:0/3398124492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e3380e2d0 con 0x559e33bfe290 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.524+0000 7f48db400640 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33bfe670 0x559e33c1c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48e3e00640 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c65780 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f48d4006fd0 tx=0x7f48d4060040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2991fffdbda85f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48d1600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48d1600640 1 -- 172.21.15.99:0/3398124492 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4087040 con 0x559e33bfe290 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48d1600640 1 -- 172.21.15.99:0/3398124492 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f48d408a130 con 0x559e33bfe290 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48ede77740 1 -- 172.21.15.99:0/3398124492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48d4075070 con 0x559e33bfe290 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48d1600640 1 -- 172.21.15.99:0/3398124492 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f48d4062680 con 0x559e33bfe290 2024-03-30T13:14:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48ede77740 10 client.6189 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48ede77740 1 -- 172.21.15.99:0/3398124492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x559e33cbe970 con 0x559e33bfe290 2024-03-30T13:14:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48d1600640 1 -- 172.21.15.99:0/3398124492 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d4075070 con 0x559e33bfe290 2024-03-30T13:14:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48d1600640 1 -- 172.21.15.99:0/3398124492 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f48d4013070 con 0x559e33bfe290 2024-03-30T13:14:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48ede77740 10 client.6189 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48ede77740 10 client.6189 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48ede77740 20 client.6189 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48ede77740 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559e33c65cc0 0x559e33cbdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48ede77740 4 client.6189 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628426}] 2024-03-30T13:14:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.525+0000 7f48ede77740 1 -- 172.21.15.99:0/3398124492 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628426}) -- 0x559e33b68bc0 con 0x559e33c65cc0 2024-03-30T13:14:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.526+0000 7f48db400640 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559e33c65cc0 0x559e33cbdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.527+0000 7f48db400640 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559e33c65cc0 0x559e33cbdb50 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cc4becb5e83a543 server_cookie=bdc0f2cc9607e617 in_seq=0 out_seq=0 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.527+0000 7f48d1600640 10 client.6189 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48d1600640 1 -- 172.21.15.99:0/3398124492 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4763 (crc 0 0 0) 0x559e33b68bc0 con 0x559e33c65cc0 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48d1600640 10 client.6189 handle_command_reply: tid=0 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 1 client.6189 shutdown 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 1 -- 172.21.15.99:0/3398124492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 msgr2=0x559e33c65780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c65780 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f48d4006fd0 tx=0x7f48d4060040 comp rx=0 tx=0).stop 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 1 -- 172.21.15.99:0/3398124492 shutdown_connections 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x559e33c65cc0 0x559e33cbdb50 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e33c3ee80 0x559e33c1c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x559e33bfe670 0x559e33c1c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 1 --2- 172.21.15.99:0/3398124492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e33bfe290 0x559e33c65780 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48d1600640 0 client.6189 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 1 -- 172.21.15.99:0/3398124492 >> 172.21.15.99:0/3398124492 conn(0x559e33bc4be0 msgr2=0x559e33c5ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 1 -- 172.21.15.99:0/3398124492 shutdown_connections 2024-03-30T13:14:03.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 1 -- 172.21.15.99:0/3398124492 wait complete. 2024-03-30T13:14:03.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.528+0000 7f48ede77740 20 client.6189 trim_cache size 0 max 16384 2024-03-30T13:14:03.536 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:03.536 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-sysfs.h", 2024-03-30T13:14:03.536 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628426, 2024-03-30T13:14:03.536 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:03.536 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.605135+0000", 2024-03-30T13:14:03.536 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.886870+0000", 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:03.537 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 77, 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.886870+0000", 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:03.538 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 77, 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.605135+0000" 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.540 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 77, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.605135+0000" 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 210, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 42, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:03.541 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:03.542 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.543 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:03.543 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:03.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.543 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:03.543 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:03.543 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:03.543 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:03.543 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:03.544 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:03.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.544 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:03.544 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:03.544 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:03.544 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:03.544 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.544 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:03.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.545 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.546 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.547 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:03.550 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:03.551 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 -- 172.21.15.99:0/825948908 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c006c530 msgr2=0x7f48c006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c006c530 0x7f48c006e9f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f48e40cb120 tx=0x7f48cc008040 comp rx=0 tx=0).stop 2024-03-30T13:14:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 -- 172.21.15.99:0/825948908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e40cfde0 msgr2=0x7f48e415bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e40cfde0 0x7f48e415bc00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f48d400d800 tx=0x7f48d400dcc0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 -- 172.21.15.99:0/825948908 shutdown_connections 2024-03-30T13:14:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f48c006c530 0x7f48c006e9f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48e415e920 0x7f48e41f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48e40d0f90 0x7f48e40b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 --2- 172.21.15.99:0/825948908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48e40cfde0 0x7f48e415bc00 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 -- 172.21.15.99:0/825948908 >> 172.21.15.99:0/825948908 conn(0x7f48e408bfc0 msgr2=0x7f48e406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 -- 172.21.15.99:0/825948908 shutdown_connections 2024-03-30T13:14:03.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.529+0000 7f48eb200640 1 -- 172.21.15.99:0/825948908 wait complete. 2024-03-30T13:14:03.554 DEBUG:tasks.cephfs.test_uninlining:getting inode info #17 of 23:1099511628409 2024-03-30T13:14:03.554 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628409 2024-03-30T13:14:03.554 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628409 2024-03-30T13:14:03.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.757+0000 7f73c0a00640 1 Processor -- start 2024-03-30T13:14:03.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.758+0000 7f73c0a00640 1 -- start start 2024-03-30T13:14:03.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.759+0000 7f73c0a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73bc0ad630 0x7f73bc15dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.759+0000 7f73c0a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73bc15d7b0 con 0x7f73bc0cf330 2024-03-30T13:14:03.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.759+0000 7f73c0a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73bc06d840 con 0x7f73bc15ca80 2024-03-30T13:14:03.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.759+0000 7f73c0a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f73bc06db20 con 0x7f73bc0ad630 2024-03-30T13:14:03.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.760+0000 7f73bb400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f73bc0cf330 0x7f73bc0acf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33464/0 (socket says 172.21.15.99:33464) 2024-03-30T13:14:03.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.760+0000 7f73bb400640 1 -- 172.21.15.99:0/2003672404 learned_addr learned my addr 172.21.15.99:0/2003672404 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:03.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.760+0000 7f73b3e00640 1 --2- 172.21.15.99:0/2003672404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73bc0ad630 0x7f73bc15dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.760+0000 7f73baa00640 1 -- 172.21.15.99:0/2003672404 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883225715 0 0) 0x7f73bc15d7b0 con 0x7f73bc0cf330 2024-03-30T13:14:03.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.760+0000 7f73baa00640 1 -- 172.21.15.99:0/2003672404 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f739c003520 con 0x7f73bc0cf330 2024-03-30T13:14:03.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.760+0000 7f73baa00640 1 -- 172.21.15.99:0/2003672404 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264891426 0 0) 0x7f73bc06d840 con 0x7f73bc15ca80 2024-03-30T13:14:03.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.760+0000 7f73baa00640 1 -- 172.21.15.99:0/2003672404 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73bc15d7b0 con 0x7f73bc15ca80 2024-03-30T13:14:03.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.761+0000 7f73b3e00640 1 -- 172.21.15.99:0/2003672404 >> v1:172.21.15.181:6789/0 conn(0x7f73bc15ca80 legacy=0x7f73bc15cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.761+0000 7f73b3e00640 1 -- 172.21.15.99:0/2003672404 >> v1:172.21.15.99:6789/0 conn(0x7f73bc0cf330 legacy=0x7f73bc0acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.761+0000 7f73b3e00640 1 -- 172.21.15.99:0/2003672404 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc06de00 con 0x7f73bc0ad630 2024-03-30T13:14:03.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.762+0000 7f73b3e00640 1 --2- 172.21.15.99:0/2003672404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73bc0ad630 0x7f73bc15dd70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f73a40097d0 tx=0x7f73a402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=759f16ace898d5e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.762+0000 7f73baa00640 1 -- 172.21.15.99:0/2003672404 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4035020 con 0x7f73bc0ad630 2024-03-30T13:14:03.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.762+0000 7f73baa00640 1 -- 172.21.15.99:0/2003672404 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a4031890 con 0x7f73bc0ad630 2024-03-30T13:14:03.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.762+0000 7f73baa00640 1 -- 172.21.15.99:0/2003672404 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4031c60 con 0x7f73bc0ad630 2024-03-30T13:14:03.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.763+0000 7f73c0a00640 1 -- 172.21.15.99:0/2003672404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73bc0ad630 msgr2=0x7f73bc15dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.763+0000 7f73c0a00640 1 --2- 172.21.15.99:0/2003672404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73bc0ad630 0x7f73bc15dd70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f73a40097d0 tx=0x7f73a402b930 comp rx=0 tx=0).stop 2024-03-30T13:14:03.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.763+0000 7f73c0a00640 1 -- 172.21.15.99:0/2003672404 shutdown_connections 2024-03-30T13:14:03.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.763+0000 7f73c0a00640 1 --2- 172.21.15.99:0/2003672404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73bc0ad630 0x7f73bc15dd70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.763+0000 7f73c0a00640 1 -- 172.21.15.99:0/2003672404 >> 172.21.15.99:0/2003672404 conn(0x7f73bc06bb40 msgr2=0x7f73bc0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.763+0000 7f73c0a00640 1 -- 172.21.15.99:0/2003672404 shutdown_connections 2024-03-30T13:14:03.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.763+0000 7f73c0a00640 1 -- 172.21.15.99:0/2003672404 wait complete. 2024-03-30T13:14:03.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.765+0000 7f73c0a00640 1 Processor -- start 2024-03-30T13:14:03.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.766+0000 7f73c0a00640 1 -- start start 2024-03-30T13:14:03.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.767+0000 7f73c0a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73bc0ad630 0x7f73bc09bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.767+0000 7f73c0a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73bc0cf330 0x7f73bc0b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.767+0000 7f73c0a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc15ca80 0x7f73bc13b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.767+0000 7f73c0a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc06e6f0 con 0x7f73bc15ca80 2024-03-30T13:14:03.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.767+0000 7f73c0a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc06e570 con 0x7f73bc0ad630 2024-03-30T13:14:03.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.767+0000 7f73c0a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f73bc06e870 con 0x7f73bc0cf330 2024-03-30T13:14:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.767+0000 7f73bbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc15ca80 0x7f73bc13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.767+0000 7f73bbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc15ca80 0x7f73bc13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55654/0 (socket says 172.21.15.99:55654) 2024-03-30T13:14:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.767+0000 7f73bbe00640 1 -- 172.21.15.99:0/3906793034 learned_addr learned my addr 172.21.15.99:0/3906793034 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.767+0000 7f73bb400640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73bc0ad630 0x7f73bc09bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.767+0000 7f73b3e00640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73bc0cf330 0x7f73bc0b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.768+0000 7f73bbe00640 1 -- 172.21.15.99:0/3906793034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73bc0cf330 msgr2=0x7f73bc0b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.768+0000 7f73bbe00640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73bc0cf330 0x7f73bc0b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.768+0000 7f73bbe00640 1 -- 172.21.15.99:0/3906793034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73bc0ad630 msgr2=0x7f73bc09bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.768+0000 7f73bbe00640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73bc0ad630 0x7f73bc09bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.768+0000 7f73bbe00640 1 -- 172.21.15.99:0/3906793034 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc09c260 con 0x7f73bc15ca80 2024-03-30T13:14:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.768+0000 7f73bbe00640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc15ca80 0x7f73bc13b660 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c710 tx=0x7f73b400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.768+0000 7f73b3400640 1 -- 172.21.15.99:0/3906793034 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4003b70 con 0x7f73bc15ca80 2024-03-30T13:14:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.768+0000 7f73b3400640 1 -- 172.21.15.99:0/3906793034 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b4003d10 con 0x7f73bc15ca80 2024-03-30T13:14:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.768+0000 7f73b3400640 1 -- 172.21.15.99:0/3906793034 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b400aa50 con 0x7f73bc15ca80 2024-03-30T13:14:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.768+0000 7f73c0a00640 1 -- 172.21.15.99:0/3906793034 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73bc09ac80 con 0x7f73bc15ca80 2024-03-30T13:14:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.769+0000 7f73c0a00640 1 -- 172.21.15.99:0/3906793034 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73bc09b240 con 0x7f73bc15ca80 2024-03-30T13:14:03.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.771+0000 7f73b3400640 1 -- 172.21.15.99:0/3906793034 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f73b400abf0 con 0x7f73bc15ca80 2024-03-30T13:14:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.771+0000 7f73b3400640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f739806c530 0x7f739806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.771+0000 7f73b3400640 1 -- 172.21.15.99:0/3906793034 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f73b408b6b0 con 0x7f73bc15ca80 2024-03-30T13:14:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.772+0000 7f73bb400640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f739806c530 0x7f739806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.772+0000 7f73c4d77740 1 Processor -- start 2024-03-30T13:14:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.772+0000 7f73c4d77740 1 -- start start 2024-03-30T13:14:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.773+0000 7f73bb400640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f739806c530 0x7f739806e9f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0011e0 tx=0x7f73ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.773+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 0x5617971d6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.773+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797217d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.773+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff760 0x5617971f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.773+0000 7f73c4d77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561797138330 con 0x5617971fc410 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.773+0000 7f73c4d77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5617970e0620 con 0x5617971ff760 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.773+0000 7f73c4d77740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x561797134440 con 0x5617971ff380 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797217d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797217d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55668/0 (socket says 172.21.15.99:55668) 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73b3e00640 1 -- 172.21.15.99:0/3119709082 learned_addr learned my addr 172.21.15.99:0/3119709082 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73bb400640 1 --2- 172.21.15.99:0/3119709082 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 0x5617971d6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73bbe00640 1 --2- 172.21.15.99:0/3119709082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff760 0x5617971f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73b3e00640 1 -- 172.21.15.99:0/3119709082 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 msgr2=0x5617971d6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73b3e00640 1 --2- 172.21.15.99:0/3119709082 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 0x5617971d6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73b3e00640 1 -- 172.21.15.99:0/3119709082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff760 msgr2=0x5617971f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73b3e00640 1 --2- 172.21.15.99:0/3119709082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff760 0x5617971f81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73b3e00640 1 -- 172.21.15.99:0/3119709082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561796f18920 con 0x5617971fc410 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73bb400640 1 --2- 172.21.15.99:0/3119709082 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 0x5617971d6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.774+0000 7f73b3e00640 1 --2- 172.21.15.99:0/3119709082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797217d60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f73a40098f0 tx=0x7f73a4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f179458adba80502 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.775+0000 7f73ab400640 1 -- 172.21.15.99:0/3119709082 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4035040 con 0x5617971fc410 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.775+0000 7f73ab400640 1 -- 172.21.15.99:0/3119709082 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a40317d0 con 0x5617971fc410 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.775+0000 7f73ab400640 1 -- 172.21.15.99:0/3119709082 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4031bc0 con 0x5617971fc410 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.775+0000 7f73c4d77740 1 -- 172.21.15.99:0/3119709082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 msgr2=0x561797217d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.775+0000 7f73c4d77740 1 --2- 172.21.15.99:0/3119709082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797217d60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f73a40098f0 tx=0x7f73a4030000 comp rx=0 tx=0).stop 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.776+0000 7f73c4d77740 1 -- 172.21.15.99:0/3119709082 shutdown_connections 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.776+0000 7f73c4d77740 1 --2- 172.21.15.99:0/3119709082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff760 0x5617971f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.776+0000 7f73c4d77740 1 --2- 172.21.15.99:0/3119709082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797217d60 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.776+0000 7f73c4d77740 1 --2- 172.21.15.99:0/3119709082 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 0x5617971d6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.776+0000 7f73c4d77740 1 -- 172.21.15.99:0/3119709082 >> 172.21.15.99:0/3119709082 conn(0x56179719bbe0 msgr2=0x56179721a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.776+0000 7f73c4d77740 1 -- 172.21.15.99:0/3119709082 shutdown_connections 2024-03-30T13:14:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.776+0000 7f73c4d77740 1 -- 172.21.15.99:0/3119709082 wait complete. 2024-03-30T13:14:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.776+0000 7f73c4d77740 1 -- start start 2024-03-30T13:14:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.777+0000 7f73c4d77740 1 Processor -- start 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.777+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971fc410 0x5617972121d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.777+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff380 0x5617971fdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.777+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff760 0x5617971fe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.777+0000 7f73c4d77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5617971cf3a0 con 0x5617971ff760 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73c4d77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5617970f39d0 con 0x5617971ff380 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73c4d77740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5617971cf640 con 0x5617971fc410 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73c4d77740 10 client.0 _ll_register_callbacks cb 0x56179712ffd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73bbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff760 0x5617971fe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73bbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff760 0x5617971fe450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55680/0 (socket says 172.21.15.99:55680) 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73bbe00640 1 -- 172.21.15.99:0/1605722470 learned_addr learned my addr 172.21.15.99:0/1605722470 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73bb400640 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971fc410 0x5617972121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73bbe00640 1 -- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971fc410 msgr2=0x5617972121d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73bbe00640 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971fc410 0x5617972121d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73b3e00640 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff380 0x5617971fdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73bbe00640 1 -- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff380 msgr2=0x5617971fdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73bbe00640 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff380 0x5617971fdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73bbe00640 1 -- 172.21.15.99:0/1605722470 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561796e0c210 con 0x5617971ff760 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73b3e00640 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff380 0x5617971fdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73bbe00640 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff760 0x5617971fe450 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c6e0 tx=0x7f73b4059c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae78df86c955722e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.778+0000 7f73a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73a3e00640 1 -- 172.21.15.99:0/1605722470 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b405d8b0 con 0x5617971ff760 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73a3e00640 1 -- 172.21.15.99:0/1605722470 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f73b4061c50 con 0x5617971ff760 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73c4d77740 1 -- 172.21.15.99:0/1605722470 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73a40317d0 con 0x5617971ff760 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73a3e00640 1 -- 172.21.15.99:0/1605722470 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f73b40620e0 con 0x5617971ff760 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73c4d77740 10 client.6201 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73c4d77740 1 -- 172.21.15.99:0/1605722470 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x561796f790b0 con 0x5617971ff760 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73a3e00640 1 -- 172.21.15.99:0/1605722470 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a40317d0 con 0x5617971ff760 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73a3e00640 1 -- 172.21.15.99:0/1605722470 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f73b4058950 con 0x5617971ff760 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73c4d77740 10 client.6201 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73c4d77740 10 client.6201 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73c4d77740 20 client.6201 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73c4d77740 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5617971f8730 0x5617972110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73c4d77740 4 client.6201 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.779+0000 7f73c4d77740 1 -- 172.21.15.99:0/1605722470 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561797145870 con 0x5617971f8730 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.780+0000 7f73bb400640 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5617971f8730 0x5617972110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.781+0000 7f73bb400640 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5617971f8730 0x5617972110f0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac78ef283d5957aa server_cookie=2ca7ea07d54c6f6b in_seq=0 out_seq=0 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.781+0000 7f73a3e00640 10 client.6201 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.782+0000 7f73a3e00640 1 -- 172.21.15.99:0/1605722470 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x561797145870 con 0x5617971f8730 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.782+0000 7f73a3e00640 10 client.6201 handle_command_reply: tid=0 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 1 client.6201 shutdown 2024-03-30T13:14:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 1 -- 172.21.15.99:0/1605722470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff760 msgr2=0x5617971fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff760 0x5617971fe450 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c6e0 tx=0x7f73b4059c00 comp rx=0 tx=0).stop 2024-03-30T13:14:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 1 -- 172.21.15.99:0/1605722470 shutdown_connections 2024-03-30T13:14:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff760 0x5617971fe450 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5617971f8730 0x5617972110f0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff380 0x5617971fdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 1 --2- 172.21.15.99:0/1605722470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971fc410 0x5617972121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73a3e00640 0 client.6201 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 1 -- 172.21.15.99:0/1605722470 >> 172.21.15.99:0/1605722470 conn(0x56179719bbe0 msgr2=0x5617971fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 1 -- 172.21.15.99:0/1605722470 shutdown_connections 2024-03-30T13:14:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 1 -- 172.21.15.99:0/1605722470 wait complete. 2024-03-30T13:14:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.783+0000 7f73c4d77740 20 client.6201 trim_cache size 0 max 16384 2024-03-30T13:14:03.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.799+0000 7f73c4d77740 1 Processor -- start 2024-03-30T13:14:03.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.799+0000 7f73c4d77740 1 -- start start 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797225ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 0x561797226430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff760 0x561797212bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73c4d77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc1fc7e0 con 0x5617971fc410 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73c4d77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc15a5d0 con 0x5617971ff760 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73c4d77740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f73bc072b50 con 0x5617971ff380 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73bb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797225ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73bb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797225ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55688/0 (socket says 172.21.15.99:55688) 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73bb400640 1 -- 172.21.15.99:0/3793578489 learned_addr learned my addr 172.21.15.99:0/3793578489 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73b3e00640 1 --2- 172.21.15.99:0/3793578489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 0x561797226430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73bbe00640 1 --2- 172.21.15.99:0/3793578489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff760 0x561797212bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73bb400640 1 -- 172.21.15.99:0/3793578489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 msgr2=0x561797226430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73bb400640 1 --2- 172.21.15.99:0/3793578489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 0x561797226430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73bb400640 1 -- 172.21.15.99:0/3793578489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff760 msgr2=0x561797212bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73bb400640 1 --2- 172.21.15.99:0/3793578489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff760 0x561797212bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.800+0000 7f73bb400640 1 -- 172.21.15.99:0/3793578489 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561796de52d0 con 0x5617971fc410 2024-03-30T13:14:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.801+0000 7f73b3e00640 1 --2- 172.21.15.99:0/3793578489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 0x561797226430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.801+0000 7f73bb400640 1 --2- 172.21.15.99:0/3793578489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797225ef0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0014a0 tx=0x7f73ac017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af203240192ae79 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.801+0000 7f73aaa00640 1 -- 172.21.15.99:0/3793578489 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac01e040 con 0x5617971fc410 2024-03-30T13:14:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.801+0000 7f73aaa00640 1 -- 172.21.15.99:0/3793578489 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac02a070 con 0x5617971fc410 2024-03-30T13:14:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.801+0000 7f73aaa00640 1 -- 172.21.15.99:0/3793578489 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac00ee30 con 0x5617971fc410 2024-03-30T13:14:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.802+0000 7f73c4d77740 1 -- 172.21.15.99:0/3793578489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 msgr2=0x561797225ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.802+0000 7f73c4d77740 1 --2- 172.21.15.99:0/3793578489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797225ef0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0014a0 tx=0x7f73ac017040 comp rx=0 tx=0).stop 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.802+0000 7f73c4d77740 1 -- 172.21.15.99:0/3793578489 shutdown_connections 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.802+0000 7f73c4d77740 1 --2- 172.21.15.99:0/3793578489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971ff760 0x561797212bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.802+0000 7f73c4d77740 1 --2- 172.21.15.99:0/3793578489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff380 0x561797226430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.802+0000 7f73c4d77740 1 --2- 172.21.15.99:0/3793578489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971fc410 0x561797225ef0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.802+0000 7f73c4d77740 1 -- 172.21.15.99:0/3793578489 >> 172.21.15.99:0/3793578489 conn(0x56179719bbe0 msgr2=0x5617971caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.802+0000 7f73c4d77740 1 -- 172.21.15.99:0/3793578489 shutdown_connections 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.802+0000 7f73c4d77740 1 -- 172.21.15.99:0/3793578489 wait complete. 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.802+0000 7f73c4d77740 1 -- start start 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.803+0000 7f73c4d77740 1 Processor -- start 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971fc410 0x561797299670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff380 0x56179729dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73c4d77740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff760 0x561797218ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73c4d77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc0731a0 con 0x5617971ff380 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73c4d77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561797217d70 con 0x5617971fc410 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73c4d77740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5617971f6690 con 0x5617971ff760 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73c4d77740 10 client.0 _ll_register_callbacks cb 0x7f73b4055820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff380 0x56179729dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff380 0x56179729dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55698/0 (socket says 172.21.15.99:55698) 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73b3e00640 1 -- 172.21.15.99:0/399810674 learned_addr learned my addr 172.21.15.99:0/399810674 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73bbe00640 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff760 0x561797218ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73b3e00640 1 -- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff760 msgr2=0x561797218ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73b3e00640 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff760 0x561797218ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73b3e00640 1 -- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971fc410 msgr2=0x561797299670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73b3e00640 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971fc410 0x561797299670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73b3e00640 1 -- 172.21.15.99:0/399810674 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617971ffc40 con 0x5617971ff380 2024-03-30T13:14:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.804+0000 7f73bbe00640 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff760 0x561797218ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73b3e00640 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff380 0x56179729dad0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f73a4000c00 tx=0x7f73a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103ddb8659379ab1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73a3e00640 1 -- 172.21.15.99:0/399810674 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4035030 con 0x5617971ff380 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73a3e00640 1 -- 172.21.15.99:0/399810674 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f73a4031b20 con 0x5617971ff380 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73c4d77740 1 -- 172.21.15.99:0/399810674 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73ac02a070 con 0x5617971ff380 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73a3e00640 1 -- 172.21.15.99:0/399810674 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f73a40093c0 con 0x5617971ff380 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73c4d77740 10 client.6207 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73c4d77740 1 -- 172.21.15.99:0/399810674 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x561797201010 con 0x5617971ff380 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73a3e00640 1 -- 172.21.15.99:0/399810674 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac02a070 con 0x5617971ff380 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73a3e00640 1 -- 172.21.15.99:0/399810674 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f73a4042070 con 0x5617971ff380 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73c4d77740 10 client.6207 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73c4d77740 10 client.6207 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.805+0000 7f73c4d77740 20 client.6207 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.806+0000 7f73c4d77740 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561797225300 0x5617971fcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.806+0000 7f73c4d77740 4 client.6207 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628409}] 2024-03-30T13:14:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.806+0000 7f73c4d77740 1 -- 172.21.15.99:0/399810674 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628409}) -- 0x56179713fbc0 con 0x561797225300 2024-03-30T13:14:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.806+0000 7f73bb400640 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561797225300 0x5617971fcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.807+0000 7f73bb400640 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561797225300 0x5617971fcb50 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b7c9a783511b4c6 server_cookie=79c071822bb85c5b in_seq=0 out_seq=0 2024-03-30T13:14:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.807+0000 7f73a3e00640 10 client.6207 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73a3e00640 1 -- 172.21.15.99:0/399810674 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4760 (crc 0 0 0) 0x56179713fbc0 con 0x561797225300 2024-03-30T13:14:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73a3e00640 10 client.6207 handle_command_reply: tid=0 2024-03-30T13:14:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73c4d77740 1 client.6207 shutdown 2024-03-30T13:14:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73c4d77740 1 -- 172.21.15.99:0/399810674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff380 msgr2=0x56179729dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73c4d77740 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff380 0x56179729dad0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f73a4000c00 tx=0x7f73a4004730 comp rx=0 tx=0).stop 2024-03-30T13:14:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73c4d77740 1 -- 172.21.15.99:0/399810674 shutdown_connections 2024-03-30T13:14:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73c4d77740 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5617971ff760 0x561797218ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73c4d77740 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5617971ff380 0x56179729dad0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73c4d77740 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x561797225300 0x5617971fcb50 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73c4d77740 1 --2- 172.21.15.99:0/399810674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617971fc410 0x561797299670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73a3e00640 0 client.6207 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73c4d77740 1 -- 172.21.15.99:0/399810674 >> 172.21.15.99:0/399810674 conn(0x56179719bbe0 msgr2=0x5617971fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.808+0000 7f73c4d77740 1 -- 172.21.15.99:0/399810674 shutdown_connections 2024-03-30T13:14:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c4d77740 1 -- 172.21.15.99:0/399810674 wait complete. 2024-03-30T13:14:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c4d77740 20 client.6207 trim_cache size 0 max 16384 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/dcache.c", 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628409, 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.606596+0000", 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.839871+0000", 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:03.817 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 3670, 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:03.818 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.839871+0000", 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 4, 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:03.819 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:03.820 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3670, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.606596+0000" 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 3670, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.606596+0000" 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 214, 2024-03-30T13:14:03.821 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 8, 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:03.822 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:03.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:03.824 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.825 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.826 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.828 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:03.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:03.831 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:03.831 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:03.831 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:03.831 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:03.831 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:03.831 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 -- 172.21.15.99:0/3906793034 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f739806c530 msgr2=0x7f739806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f739806c530 0x7f739806e9f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0011e0 tx=0x7f73ac009040 comp rx=0 tx=0).stop 2024-03-30T13:14:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 -- 172.21.15.99:0/3906793034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc15ca80 msgr2=0x7f73bc13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc15ca80 0x7f73bc13b660 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c710 tx=0x7f73b400cbd0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 -- 172.21.15.99:0/3906793034 shutdown_connections 2024-03-30T13:14:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f739806c530 0x7f739806e9f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc15ca80 0x7f73bc13b660 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73bc0cf330 0x7f73bc0b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 --2- 172.21.15.99:0/3906793034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73bc0ad630 0x7f73bc09bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 -- 172.21.15.99:0/3906793034 >> 172.21.15.99:0/3906793034 conn(0x7f73bc06bb40 msgr2=0x7f73bc0acf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 -- 172.21.15.99:0/3906793034 shutdown_connections 2024-03-30T13:14:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:03.809+0000 7f73c0a00640 1 -- 172.21.15.99:0/3906793034 wait complete. 2024-03-30T13:14:03.833 DEBUG:tasks.cephfs.test_uninlining:getting inode info #18 of 23:1099511628417 2024-03-30T13:14:03.834 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628417 2024-03-30T13:14:03.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628417 2024-03-30T13:14:04.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.033+0000 7f0f4b200640 1 Processor -- start 2024-03-30T13:14:04.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.033+0000 7f0f4b200640 1 -- start start 2024-03-30T13:14:04.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.035+0000 7f0f4b200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f4c15e7f0 0x7f0f4c0d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.035+0000 7f0f4b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0f4c0b5f60 0x7f0f4c0b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.035+0000 7f0f4b200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4c06cce0 con 0x7f0f4c0cf540 2024-03-30T13:14:04.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.035+0000 7f0f4b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4c0d2c30 con 0x7f0f4c0b5f60 2024-03-30T13:14:04.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.035+0000 7f0f4b200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c0cfae0 con 0x7f0f4c15e7f0 2024-03-30T13:14:04.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.035+0000 7f0f4a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0f4c0b5f60 0x7f0f4c0b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.035+0000 7f0f41400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0f4c0cf540 0x7f0f4c06c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33478/0 (socket says 172.21.15.99:33478) 2024-03-30T13:14:04.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.035+0000 7f0f41400640 1 -- 172.21.15.99:0/2983190035 learned_addr learned my addr 172.21.15.99:0/2983190035 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:04.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.035+0000 7f0f49e00640 1 --2- 172.21.15.99:0/2983190035 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f4c15e7f0 0x7f0f4c0d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.036+0000 7f0f4a800640 1 -- 172.21.15.99:0/2983190035 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f4c15e7f0 msgr2=0x7f0f4c0d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.036+0000 7f0f4a800640 1 --2- 172.21.15.99:0/2983190035 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f4c15e7f0 0x7f0f4c0d4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.036+0000 7f0f4a800640 1 -- 172.21.15.99:0/2983190035 >> v1:172.21.15.99:6789/0 conn(0x7f0f4c0cf540 legacy=0x7f0f4c06c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.036+0000 7f0f4a800640 1 -- 172.21.15.99:0/2983190035 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c0cfdc0 con 0x7f0f4c0b5f60 2024-03-30T13:14:04.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.037+0000 7f0f4a800640 1 --2- 172.21.15.99:0/2983190035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4c0b5f60 0x7f0f4c0b63f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009d90 tx=0x7f0f4402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b07666459b24ae server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.037+0000 7f0f49400640 1 -- 172.21.15.99:0/2983190035 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44039070 con 0x7f0f4c0b5f60 2024-03-30T13:14:04.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.037+0000 7f0f49400640 1 -- 172.21.15.99:0/2983190035 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4402cc60 con 0x7f0f4c0b5f60 2024-03-30T13:14:04.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.037+0000 7f0f49400640 1 -- 172.21.15.99:0/2983190035 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44034660 con 0x7f0f4c0b5f60 2024-03-30T13:14:04.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.038+0000 7f0f4b200640 1 -- 172.21.15.99:0/2983190035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4c0b5f60 msgr2=0x7f0f4c0b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.038+0000 7f0f4b200640 1 --2- 172.21.15.99:0/2983190035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4c0b5f60 0x7f0f4c0b63f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009d90 tx=0x7f0f4402beb0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.038+0000 7f0f4b200640 1 -- 172.21.15.99:0/2983190035 shutdown_connections 2024-03-30T13:14:04.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.038+0000 7f0f4b200640 1 --2- 172.21.15.99:0/2983190035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4c0b5f60 0x7f0f4c0b63f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.038+0000 7f0f4b200640 1 --2- 172.21.15.99:0/2983190035 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f4c15e7f0 0x7f0f4c0d4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.038+0000 7f0f4b200640 1 -- 172.21.15.99:0/2983190035 >> 172.21.15.99:0/2983190035 conn(0x7f0f4c09d7f0 msgr2=0x7f0f4c0d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.038+0000 7f0f4b200640 1 -- 172.21.15.99:0/2983190035 shutdown_connections 2024-03-30T13:14:04.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.038+0000 7f0f4b200640 1 -- 172.21.15.99:0/2983190035 wait complete. 2024-03-30T13:14:04.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.040+0000 7f0f4b200640 1 Processor -- start 2024-03-30T13:14:04.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.040+0000 7f0f4b200640 1 -- start start 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.041+0000 7f0f4b200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f4c0b5f60 0x7f0f4c14e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.041+0000 7f0f4b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f4c0cf540 0x7f0f4c161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.041+0000 7f0f4b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4c15e7f0 0x7f0f4c0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.041+0000 7f0f4b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c0d5300 con 0x7f0f4c15e7f0 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.041+0000 7f0f4b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c15ebd0 con 0x7f0f4c0cf540 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.041+0000 7f0f4b200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c0d2570 con 0x7f0f4c0b5f60 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.041+0000 7f0f4a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4c15e7f0 0x7f0f4c0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.041+0000 7f0f4a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4c15e7f0 0x7f0f4c0c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55708/0 (socket says 172.21.15.99:55708) 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.041+0000 7f0f4a800640 1 -- 172.21.15.99:0/3343477285 learned_addr learned my addr 172.21.15.99:0/3343477285 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.042+0000 7f0f4a800640 1 -- 172.21.15.99:0/3343477285 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f4c0b5f60 msgr2=0x7f0f4c14e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.042+0000 7f0f4a800640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f4c0b5f60 0x7f0f4c14e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.042+0000 7f0f4a800640 1 -- 172.21.15.99:0/3343477285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f4c0cf540 msgr2=0x7f0f4c161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.042+0000 7f0f4a800640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f4c0cf540 0x7f0f4c161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.042+0000 7f0f4a800640 1 -- 172.21.15.99:0/3343477285 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c15fff0 con 0x7f0f4c15e7f0 2024-03-30T13:14:04.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.042+0000 7f0f4a800640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4c15e7f0 0x7f0f4c0c7b70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009eb0 tx=0x7f0f44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.042+0000 7f0f42a00640 1 -- 172.21.15.99:0/3343477285 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44039050 con 0x7f0f4c15e7f0 2024-03-30T13:14:04.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.042+0000 7f0f42a00640 1 -- 172.21.15.99:0/3343477285 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f44045070 con 0x7f0f4c15e7f0 2024-03-30T13:14:04.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.042+0000 7f0f4b200640 1 -- 172.21.15.99:0/3343477285 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4c1602d0 con 0x7f0f4c15e7f0 2024-03-30T13:14:04.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.042+0000 7f0f42a00640 1 -- 172.21.15.99:0/3343477285 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4403e850 con 0x7f0f4c15e7f0 2024-03-30T13:14:04.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.042+0000 7f0f4b200640 1 -- 172.21.15.99:0/3343477285 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4c160890 con 0x7f0f4c15e7f0 2024-03-30T13:14:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.044+0000 7f0f42a00640 1 -- 172.21.15.99:0/3343477285 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0f4403e9f0 con 0x7f0f4c15e7f0 2024-03-30T13:14:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.045+0000 7f0f42a00640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f2806c530 0x7f0f2806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.045+0000 7f0f42a00640 1 -- 172.21.15.99:0/3343477285 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f0f440ae790 con 0x7f0f4c15e7f0 2024-03-30T13:14:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.046+0000 7f0f49e00640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f2806c530 0x7f0f2806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.046+0000 7f0f53f88740 1 Processor -- start 2024-03-30T13:14:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.046+0000 7f0f49e00640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f2806c530 0x7f0f2806e9f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c006fd0 tx=0x7f0f3c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.046+0000 7f0f53f88740 1 -- start start 2024-03-30T13:14:04.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.047+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.047+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15ed4e0 0x555fd15c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.047+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd15c6850 0x555fd15c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.047+0000 7f0f53f88740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555fd1529330 con 0x555fd15c6470 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.047+0000 7f0f53f88740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555fd14d1620 con 0x555fd15ed4e0 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.047+0000 7f0f53f88740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555fd1525440 con 0x555fd15c6850 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.047+0000 7f0f49e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.047+0000 7f0f49e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15ecfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55718/0 (socket says 172.21.15.99:55718) 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.047+0000 7f0f49e00640 1 -- 172.21.15.99:0/3760107568 learned_addr learned my addr 172.21.15.99:0/3760107568 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.048+0000 7f0f49e00640 1 -- 172.21.15.99:0/3760107568 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd15c6850 msgr2=0x555fd15c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.048+0000 7f0f49e00640 1 --2- 172.21.15.99:0/3760107568 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd15c6850 0x555fd15c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.048+0000 7f0f49e00640 1 -- 172.21.15.99:0/3760107568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15ed4e0 msgr2=0x555fd15c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.048+0000 7f0f49e00640 1 --2- 172.21.15.99:0/3760107568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15ed4e0 0x555fd15c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.048+0000 7f0f49e00640 1 -- 172.21.15.99:0/3760107568 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fd1309920 con 0x555fd15c6470 2024-03-30T13:14:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.048+0000 7f0f49e00640 1 --2- 172.21.15.99:0/3760107568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15ecfa0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00d910 tx=0x7f0f3c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872d9409e5f03f18 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.048+0000 7f0f3aa00640 1 -- 172.21.15.99:0/3760107568 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c024070 con 0x555fd15c6470 2024-03-30T13:14:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.048+0000 7f0f3aa00640 1 -- 172.21.15.99:0/3760107568 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c01b040 con 0x555fd15c6470 2024-03-30T13:14:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.048+0000 7f0f3aa00640 1 -- 172.21.15.99:0/3760107568 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c014bd0 con 0x555fd15c6470 2024-03-30T13:14:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.049+0000 7f0f53f88740 1 -- 172.21.15.99:0/3760107568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 msgr2=0x555fd15ecfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.049+0000 7f0f53f88740 1 --2- 172.21.15.99:0/3760107568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15ecfa0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00d910 tx=0x7f0f3c010000 comp rx=0 tx=0).stop 2024-03-30T13:14:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.049+0000 7f0f53f88740 1 -- 172.21.15.99:0/3760107568 shutdown_connections 2024-03-30T13:14:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.049+0000 7f0f53f88740 1 --2- 172.21.15.99:0/3760107568 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd15c6850 0x555fd15c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.049+0000 7f0f53f88740 1 --2- 172.21.15.99:0/3760107568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15ed4e0 0x555fd15c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.049+0000 7f0f53f88740 1 --2- 172.21.15.99:0/3760107568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15ecfa0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.049+0000 7f0f53f88740 1 -- 172.21.15.99:0/3760107568 >> 172.21.15.99:0/3760107568 conn(0x555fd158cbe0 msgr2=0x555fd160b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.049+0000 7f0f53f88740 1 -- 172.21.15.99:0/3760107568 shutdown_connections 2024-03-30T13:14:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.049+0000 7f0f53f88740 1 -- 172.21.15.99:0/3760107568 wait complete. 2024-03-30T13:14:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.050+0000 7f0f53f88740 1 -- start start 2024-03-30T13:14:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.050+0000 7f0f53f88740 1 Processor -- start 2024-03-30T13:14:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.051+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd15c6470 0x555fd15e4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.051+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6850 0x555fd160ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.051+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd160c2c0 0x555fd160e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.051+0000 7f0f53f88740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555fd15ecb10 con 0x555fd15c6850 2024-03-30T13:14:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.051+0000 7f0f53f88740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555fd14e49d0 con 0x555fd160c2c0 2024-03-30T13:14:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.051+0000 7f0f53f88740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555fd15e5890 con 0x555fd15c6470 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.051+0000 7f0f53f88740 10 client.0 _ll_register_callbacks cb 0x555fd1520fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f41400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6850 0x555fd160ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f41400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6850 0x555fd160ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55728/0 (socket says 172.21.15.99:55728) 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f41400640 1 -- 172.21.15.99:0/776917145 learned_addr learned my addr 172.21.15.99:0/776917145 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f49e00640 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd15c6470 0x555fd15e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f4a800640 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd160c2c0 0x555fd160e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f41400640 1 -- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd15c6470 msgr2=0x555fd15e4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f41400640 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd15c6470 0x555fd15e4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f41400640 1 -- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd160c2c0 msgr2=0x555fd160e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f41400640 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd160c2c0 0x555fd160e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f41400640 1 -- 172.21.15.99:0/776917145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fd11fd210 con 0x555fd15c6850 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f41400640 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6850 0x555fd160ddf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0b3cc0 tx=0x7f0f3400c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1895f76e58f76c50 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.052+0000 7f0f2f400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f2f400640 1 -- 172.21.15.99:0/776917145 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34017060 con 0x555fd15c6850 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f53f88740 1 -- 172.21.15.99:0/776917145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f3c01b040 con 0x555fd15c6850 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f2f400640 1 -- 172.21.15.99:0/776917145 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f0f340058b0 con 0x555fd15c6850 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f2f400640 1 -- 172.21.15.99:0/776917145 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0f3401d050 con 0x555fd15c6850 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f53f88740 10 client.6222 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f53f88740 1 -- 172.21.15.99:0/776917145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x555fd136a0b0 con 0x555fd15c6850 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f2f400640 1 -- 172.21.15.99:0/776917145 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c01b040 con 0x555fd15c6850 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f2f400640 1 -- 172.21.15.99:0/776917145 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f0f34020020 con 0x555fd15c6850 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f53f88740 10 client.6222 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f53f88740 10 client.6222 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f53f88740 20 client.6222 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f53f88740 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555fd161e890 0x555fd161eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f53f88740 4 client.6222 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:04.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.053+0000 7f0f53f88740 1 -- 172.21.15.99:0/776917145 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fd1536870 con 0x555fd161e890 2024-03-30T13:14:04.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.054+0000 7f0f49e00640 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555fd161e890 0x555fd161eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.055+0000 7f0f49e00640 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555fd161e890 0x555fd161eca0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e63a301253a473 server_cookie=b4323f0bcccc237f in_seq=0 out_seq=0 2024-03-30T13:14:04.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.055+0000 7f0f2f400640 10 client.6222 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f2f400640 1 -- 172.21.15.99:0/776917145 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x555fd1536870 con 0x555fd161e890 2024-03-30T13:14:04.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f2f400640 10 client.6222 handle_command_reply: tid=0 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f53f88740 1 client.6222 shutdown 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f53f88740 1 -- 172.21.15.99:0/776917145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6850 msgr2=0x555fd160ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f53f88740 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6850 0x555fd160ddf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0b3cc0 tx=0x7f0f3400c4b0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f53f88740 1 -- 172.21.15.99:0/776917145 shutdown_connections 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f53f88740 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555fd161e890 0x555fd161eca0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f53f88740 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd160c2c0 0x555fd160e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f53f88740 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6850 0x555fd160ddf0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f2f400640 0 client.6222 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f53f88740 1 --2- 172.21.15.99:0/776917145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd15c6470 0x555fd15e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f53f88740 1 -- 172.21.15.99:0/776917145 >> 172.21.15.99:0/776917145 conn(0x555fd158cbe0 msgr2=0x555fd15ec350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f53f88740 1 -- 172.21.15.99:0/776917145 shutdown_connections 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.057+0000 7f0f53f88740 1 -- 172.21.15.99:0/776917145 wait complete. 2024-03-30T13:14:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.058+0000 7f0f53f88740 20 client.6222 trim_cache size 0 max 16384 2024-03-30T13:14:04.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.073+0000 7f0f53f88740 1 Processor -- start 2024-03-30T13:14:04.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.073+0000 7f0f53f88740 1 -- start start 2024-03-30T13:14:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.074+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.074+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15c6850 0x555fd1600b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.074+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd160c2c0 0x555fd1604dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.074+0000 7f0f53f88740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c200ed0 con 0x555fd15c6470 2024-03-30T13:14:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.074+0000 7f0f53f88740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c1fff40 con 0x555fd15c6850 2024-03-30T13:14:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.074+0000 7f0f53f88740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c150fc0 con 0x555fd160c2c0 2024-03-30T13:14:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.074+0000 7f0f49e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.074+0000 7f0f49e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15f0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55736/0 (socket says 172.21.15.99:55736) 2024-03-30T13:14:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.074+0000 7f0f49e00640 1 -- 172.21.15.99:0/1811834457 learned_addr learned my addr 172.21.15.99:0/1811834457 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.075+0000 7f0f4a800640 1 --2- 172.21.15.99:0/1811834457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd160c2c0 0x555fd1604dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.075+0000 7f0f49e00640 1 -- 172.21.15.99:0/1811834457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd160c2c0 msgr2=0x555fd1604dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.075+0000 7f0f49e00640 1 --2- 172.21.15.99:0/1811834457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd160c2c0 0x555fd1604dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.075+0000 7f0f49e00640 1 -- 172.21.15.99:0/1811834457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15c6850 msgr2=0x555fd1600b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.075+0000 7f0f49e00640 1 --2- 172.21.15.99:0/1811834457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15c6850 0x555fd1600b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.075+0000 7f0f49e00640 1 -- 172.21.15.99:0/1811834457 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fd11d62d0 con 0x555fd15c6470 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.075+0000 7f0f49e00640 1 --2- 172.21.15.99:0/1811834457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15f0a30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c006e80 tx=0x7f0f3c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc02befc609f986 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.075+0000 7f0f3a000640 1 -- 172.21.15.99:0/1811834457 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c024040 con 0x555fd15c6470 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.075+0000 7f0f3a000640 1 -- 172.21.15.99:0/1811834457 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c01b050 con 0x555fd15c6470 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.075+0000 7f0f3a000640 1 -- 172.21.15.99:0/1811834457 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c02e4f0 con 0x555fd15c6470 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.076+0000 7f0f53f88740 1 -- 172.21.15.99:0/1811834457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 msgr2=0x555fd15f0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.076+0000 7f0f53f88740 1 --2- 172.21.15.99:0/1811834457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15f0a30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c006e80 tx=0x7f0f3c012000 comp rx=0 tx=0).stop 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.076+0000 7f0f53f88740 1 -- 172.21.15.99:0/1811834457 shutdown_connections 2024-03-30T13:14:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.076+0000 7f0f53f88740 1 --2- 172.21.15.99:0/1811834457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd160c2c0 0x555fd1604dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.076+0000 7f0f53f88740 1 --2- 172.21.15.99:0/1811834457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15c6850 0x555fd1600b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.076+0000 7f0f53f88740 1 --2- 172.21.15.99:0/1811834457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15f0a30 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.076+0000 7f0f53f88740 1 -- 172.21.15.99:0/1811834457 >> 172.21.15.99:0/1811834457 conn(0x555fd158cbe0 msgr2=0x555fd15bbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.076+0000 7f0f53f88740 1 -- 172.21.15.99:0/1811834457 shutdown_connections 2024-03-30T13:14:04.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.076+0000 7f0f53f88740 1 -- 172.21.15.99:0/1811834457 wait complete. 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.077+0000 7f0f53f88740 1 -- start start 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.077+0000 7f0f53f88740 1 Processor -- start 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15bf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15c6850 0x555fd1686390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f53f88740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd160c2c0 0x555fd15eaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f53f88740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555fd15ec590 con 0x555fd15c6470 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f53f88740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c151610 con 0x555fd15c6850 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f53f88740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x555fd1690390 con 0x555fd160c2c0 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f53f88740 10 client.0 _ll_register_callbacks cb 0x7f0f34007c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f49e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f49e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15bf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55742/0 (socket says 172.21.15.99:55742) 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f49e00640 1 -- 172.21.15.99:0/2291523032 learned_addr learned my addr 172.21.15.99:0/2291523032 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f49e00640 1 -- 172.21.15.99:0/2291523032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd160c2c0 msgr2=0x555fd15eaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f49e00640 1 --2- 172.21.15.99:0/2291523032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd160c2c0 0x555fd15eaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f49e00640 1 -- 172.21.15.99:0/2291523032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15c6850 msgr2=0x555fd1686390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f49e00640 1 --2- 172.21.15.99:0/2291523032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15c6850 0x555fd1686390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.078+0000 7f0f49e00640 1 -- 172.21.15.99:0/2291523032 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fd15c4a80 con 0x555fd15c6470 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f49e00640 1 --2- 172.21.15.99:0/2291523032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15bf760 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c01f000 tx=0x7f0f3c006e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330a458f0290fffd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f2f400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f2f400640 1 -- 172.21.15.99:0/2291523032 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c032070 con 0x555fd15c6470 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f2f400640 1 -- 172.21.15.99:0/2291523032 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f0f3c02e390 con 0x555fd15c6470 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f53f88740 1 -- 172.21.15.99:0/2291523032 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f3c01b050 con 0x555fd15c6470 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f2f400640 1 -- 172.21.15.99:0/2291523032 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0f3c024040 con 0x555fd15c6470 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f53f88740 10 client.6228 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f53f88740 1 -- 172.21.15.99:0/2291523032 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x555fd15c77d0 con 0x555fd15c6470 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f2f400640 1 -- 172.21.15.99:0/2291523032 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c01b050 con 0x555fd15c6470 2024-03-30T13:14:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f2f400640 1 -- 172.21.15.99:0/2291523032 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f0f3c013050 con 0x555fd15c6470 2024-03-30T13:14:04.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f53f88740 10 client.6228 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:04.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f53f88740 10 client.6228 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:04.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f53f88740 20 client.6228 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:04.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f53f88740 1 --2- 172.21.15.99:0/2291523032 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555fd160d870 0x555fd15eb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f53f88740 4 client.6228 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628417}] 2024-03-30T13:14:04.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.079+0000 7f0f53f88740 1 -- 172.21.15.99:0/2291523032 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628417}) -- 0x555fd1530bc0 con 0x555fd160d870 2024-03-30T13:14:04.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.080+0000 7f0f41400640 1 --2- 172.21.15.99:0/2291523032 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555fd160d870 0x555fd15eb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.081+0000 7f0f41400640 1 --2- 172.21.15.99:0/2291523032 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555fd160d870 0x555fd15eb490 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec4a123e34c2c46e server_cookie=5d8e770572179ea7 in_seq=0 out_seq=0 2024-03-30T13:14:04.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.081+0000 7f0f2f400640 10 client.6228 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f2f400640 1 -- 172.21.15.99:0/2291523032 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4767 (crc 0 0 0) 0x555fd1530bc0 con 0x555fd160d870 2024-03-30T13:14:04.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f2f400640 10 client.6228 handle_command_reply: tid=0 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f53f88740 1 client.6228 shutdown 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f53f88740 1 -- 172.21.15.99:0/2291523032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 msgr2=0x555fd15bf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f53f88740 1 --2- 172.21.15.99:0/2291523032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15bf760 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c01f000 tx=0x7f0f3c006e10 comp rx=0 tx=0).stop 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f53f88740 1 -- 172.21.15.99:0/2291523032 shutdown_connections 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f53f88740 1 --2- 172.21.15.99:0/2291523032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x555fd160c2c0 0x555fd15eaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f53f88740 1 --2- 172.21.15.99:0/2291523032 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x555fd160d870 0x555fd15eb490 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f53f88740 1 --2- 172.21.15.99:0/2291523032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555fd15c6850 0x555fd1686390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f53f88740 1 --2- 172.21.15.99:0/2291523032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555fd15c6470 0x555fd15bf760 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f53f88740 1 -- 172.21.15.99:0/2291523032 >> 172.21.15.99:0/2291523032 conn(0x555fd158cbe0 msgr2=0x555fd160dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.082+0000 7f0f2f400640 0 client.6228 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f53f88740 1 -- 172.21.15.99:0/2291523032 shutdown_connections 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f53f88740 1 -- 172.21.15.99:0/2291523032 wait complete. 2024-03-30T13:14:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f53f88740 20 client.6228 trim_cache size 0 max 16384 2024-03-30T13:14:04.090 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-bufmap.h", 2024-03-30T13:14:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628417, 2024-03-30T13:14:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.609228+0000", 2024-03-30T13:14:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.862870+0000", 2024-03-30T13:14:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 925, 2024-03-30T13:14:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.862870+0000", 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 925, 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.609228+0000" 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 925, 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.609228+0000" 2024-03-30T13:14:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 216, 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 24, 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:04.104 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f4b200640 1 -- 172.21.15.99:0/3343477285 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f2806c530 msgr2=0x7f0f2806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f4b200640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f2806c530 0x7f0f2806e9f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c006fd0 tx=0x7f0f3c008040 comp rx=0 tx=0).stop 2024-03-30T13:14:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f4b200640 1 -- 172.21.15.99:0/3343477285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4c15e7f0 msgr2=0x7f0f4c0c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f4b200640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4c15e7f0 0x7f0f4c0c7b70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009eb0 tx=0x7f0f44004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f4b200640 1 -- 172.21.15.99:0/3343477285 shutdown_connections 2024-03-30T13:14:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f4b200640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0f2806c530 0x7f0f2806e9f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f4b200640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4c15e7f0 0x7f0f4c0c7b70 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f4b200640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f4c0cf540 0x7f0f4c161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f4b200640 1 --2- 172.21.15.99:0/3343477285 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0f4c0b5f60 0x7f0f4c14e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f4b200640 1 -- 172.21.15.99:0/3343477285 >> 172.21.15.99:0/3343477285 conn(0x7f0f4c09d7f0 msgr2=0x7f0f4c0b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.083+0000 7f0f4b200640 1 -- 172.21.15.99:0/3343477285 shutdown_connections 2024-03-30T13:14:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.084+0000 7f0f4b200640 1 -- 172.21.15.99:0/3343477285 wait complete. 2024-03-30T13:14:04.106 DEBUG:tasks.cephfs.test_uninlining:getting inode info #19 of 23:1099511628421 2024-03-30T13:14:04.106 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628421 2024-03-30T13:14:04.106 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628421 2024-03-30T13:14:04.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.298+0000 7f86ebe00640 1 Processor -- start 2024-03-30T13:14:04.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.298+0000 7f86ebe00640 1 -- start start 2024-03-30T13:14:04.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.300+0000 7f86ebe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f86ec0ad630 0x7f86ec15dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.300+0000 7f86ebe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86ec15ca80 0x7f86ec15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.300+0000 7f86ebe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86ec15d7b0 con 0x7f86ec0cf330 2024-03-30T13:14:04.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.300+0000 7f86ebe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f86ec06d840 con 0x7f86ec0ad630 2024-03-30T13:14:04.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.300+0000 7f86ebe00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f86ec06db20 con 0x7f86ec15ca80 2024-03-30T13:14:04.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.300+0000 7f86eaa00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f86ec0cf330 0x7f86ec0acf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:38626/0 (socket says 172.21.15.99:38626) 2024-03-30T13:14:04.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.300+0000 7f86eaa00640 1 -- 172.21.15.99:0/3150003604 learned_addr learned my addr 172.21.15.99:0/3150003604 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:04.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.300+0000 7f86eb400640 1 --2- 172.21.15.99:0/3150003604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86ec15ca80 0x7f86ec15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.301+0000 7f86ea000640 1 --2- 172.21.15.99:0/3150003604 >> v2:172.21.15.181:3300/0 conn(0x7f86ec0ad630 0x7f86ec15dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.301+0000 7f86e9600640 1 -- 172.21.15.99:0/3150003604 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656931595 0 0) 0x7f86ec15d7b0 con 0x7f86ec0cf330 2024-03-30T13:14:04.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.301+0000 7f86e9600640 1 -- 172.21.15.99:0/3150003604 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86d0003520 con 0x7f86ec0cf330 2024-03-30T13:14:04.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.301+0000 7f86eb400640 1 -- 172.21.15.99:0/3150003604 >> v2:172.21.15.181:3300/0 conn(0x7f86ec0ad630 msgr2=0x7f86ec15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.301+0000 7f86eb400640 1 --2- 172.21.15.99:0/3150003604 >> v2:172.21.15.181:3300/0 conn(0x7f86ec0ad630 0x7f86ec15dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.301+0000 7f86eb400640 1 -- 172.21.15.99:0/3150003604 >> v1:172.21.15.181:6789/0 conn(0x7f86ec0cf330 legacy=0x7f86ec0acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.301+0000 7f86eb400640 1 -- 172.21.15.99:0/3150003604 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ec06de00 con 0x7f86ec15ca80 2024-03-30T13:14:04.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.301+0000 7f86ea000640 1 --2- 172.21.15.99:0/3150003604 >> v2:172.21.15.181:3300/0 conn(0x7f86ec0ad630 0x7f86ec15dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:14:04.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.303+0000 7f86eb400640 1 --2- 172.21.15.99:0/3150003604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86ec15ca80 0x7f86ec15cf30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009d90 tx=0x7f86e402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b26ffbbce3b573 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.303+0000 7f86e9600640 1 -- 172.21.15.99:0/3150003604 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4039070 con 0x7f86ec15ca80 2024-03-30T13:14:04.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.303+0000 7f86e9600640 1 -- 172.21.15.99:0/3150003604 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e402cc60 con 0x7f86ec15ca80 2024-03-30T13:14:04.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.303+0000 7f86e9600640 1 -- 172.21.15.99:0/3150003604 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4034660 con 0x7f86ec15ca80 2024-03-30T13:14:04.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.304+0000 7f86ebe00640 1 -- 172.21.15.99:0/3150003604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86ec15ca80 msgr2=0x7f86ec15cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.304+0000 7f86ebe00640 1 --2- 172.21.15.99:0/3150003604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86ec15ca80 0x7f86ec15cf30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009d90 tx=0x7f86e402beb0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.304+0000 7f86ebe00640 1 -- 172.21.15.99:0/3150003604 shutdown_connections 2024-03-30T13:14:04.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.304+0000 7f86ebe00640 1 --2- 172.21.15.99:0/3150003604 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86ec15ca80 0x7f86ec15cf30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.304+0000 7f86ebe00640 1 --2- 172.21.15.99:0/3150003604 >> v2:172.21.15.181:3300/0 conn(0x7f86ec0ad630 0x7f86ec15dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.304+0000 7f86ebe00640 1 -- 172.21.15.99:0/3150003604 >> 172.21.15.99:0/3150003604 conn(0x7f86ec06bb40 msgr2=0x7f86ec0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.304+0000 7f86ebe00640 1 -- 172.21.15.99:0/3150003604 shutdown_connections 2024-03-30T13:14:04.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.304+0000 7f86ebe00640 1 -- 172.21.15.99:0/3150003604 wait complete. 2024-03-30T13:14:04.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.307+0000 7f86ebe00640 1 Processor -- start 2024-03-30T13:14:04.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.307+0000 7f86ebe00640 1 -- start start 2024-03-30T13:14:04.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.308+0000 7f86ebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86ec0ad630 0x7f86ec151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.308+0000 7f86ebe00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86ec0cf330 0x7f86ec09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.308+0000 7f86ebe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ec15ca80 0x7f86ec0b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.308+0000 7f86ebe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec06e4a0 con 0x7f86ec0ad630 2024-03-30T13:14:04.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.308+0000 7f86ebe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec06e320 con 0x7f86ec15ca80 2024-03-30T13:14:04.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.308+0000 7f86ebe00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f86ec06e620 con 0x7f86ec0cf330 2024-03-30T13:14:04.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.308+0000 7f86eaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86ec0ad630 0x7f86ec151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.308+0000 7f86eaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86ec0ad630 0x7f86ec151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55758/0 (socket says 172.21.15.99:55758) 2024-03-30T13:14:04.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.308+0000 7f86eaa00640 1 -- 172.21.15.99:0/1154189462 learned_addr learned my addr 172.21.15.99:0/1154189462 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86eb400640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ec15ca80 0x7f86ec0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86ea000640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86ec0cf330 0x7f86ec09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86eaa00640 1 -- 172.21.15.99:0/1154189462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86ec0cf330 msgr2=0x7f86ec09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86eaa00640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86ec0cf330 0x7f86ec09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86eaa00640 1 -- 172.21.15.99:0/1154189462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ec15ca80 msgr2=0x7f86ec0b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86eaa00640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ec15ca80 0x7f86ec0b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86eaa00640 1 -- 172.21.15.99:0/1154189462 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ec09b3a0 con 0x7f86ec0ad630 2024-03-30T13:14:04.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86eaa00640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86ec0ad630 0x7f86ec151ad0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c460 tx=0x7f86dc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86e2a00640 1 -- 172.21.15.99:0/1154189462 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc017070 con 0x7f86ec0ad630 2024-03-30T13:14:04.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86e2a00640 1 -- 172.21.15.99:0/1154189462 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc005ce0 con 0x7f86ec0ad630 2024-03-30T13:14:04.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86e2a00640 1 -- 172.21.15.99:0/1154189462 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc007290 con 0x7f86ec0ad630 2024-03-30T13:14:04.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.309+0000 7f86ebe00640 1 -- 172.21.15.99:0/1154189462 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ec09b680 con 0x7f86ec0ad630 2024-03-30T13:14:04.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.310+0000 7f86ebe00640 1 -- 172.21.15.99:0/1154189462 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ec09bc40 con 0x7f86ec0ad630 2024-03-30T13:14:04.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.312+0000 7f86e2a00640 1 -- 172.21.15.99:0/1154189462 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f86dc01a070 con 0x7f86ec0ad630 2024-03-30T13:14:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.313+0000 7f86e2a00640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86cc06c530 0x7f86cc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.313+0000 7f86e2a00640 1 -- 172.21.15.99:0/1154189462 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f86dc08aba0 con 0x7f86ec0ad630 2024-03-30T13:14:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.314+0000 7f86ea000640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86cc06c530 0x7f86cc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.314+0000 7f86f4465740 1 Processor -- start 2024-03-30T13:14:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.314+0000 7f86f4465740 1 -- start start 2024-03-30T13:14:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.314+0000 7f86ea000640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86cc06c530 0x7f86cc06e9f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009560 tx=0x7f86d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.315+0000 7f86f4465740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b6851bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.315+0000 7f86f4465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b6851c4e0 0x560b684f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.315+0000 7f86f4465740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5850 0x560b684f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.315+0000 7f86f4465740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x560b68458330 con 0x560b684f5470 2024-03-30T13:14:04.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.315+0000 7f86f4465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560b68400620 con 0x560b6851c4e0 2024-03-30T13:14:04.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.315+0000 7f86f4465740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x560b68454440 con 0x560b684f5850 2024-03-30T13:14:04.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.315+0000 7f86eaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b6851bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.315+0000 7f86eaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b6851bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55770/0 (socket says 172.21.15.99:55770) 2024-03-30T13:14:04.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.315+0000 7f86eaa00640 1 -- 172.21.15.99:0/1069372375 learned_addr learned my addr 172.21.15.99:0/1069372375 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.316+0000 7f86eaa00640 1 -- 172.21.15.99:0/1069372375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5850 msgr2=0x560b684f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.316+0000 7f86eaa00640 1 --2- 172.21.15.99:0/1069372375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5850 0x560b684f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.316+0000 7f86ea000640 1 --2- 172.21.15.99:0/1069372375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b6851c4e0 0x560b684f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.316+0000 7f86eaa00640 1 -- 172.21.15.99:0/1069372375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b6851c4e0 msgr2=0x560b684f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.316+0000 7f86eaa00640 1 --2- 172.21.15.99:0/1069372375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b6851c4e0 0x560b684f44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.316+0000 7f86eaa00640 1 -- 172.21.15.99:0/1069372375 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b68238920 con 0x560b684f5470 2024-03-30T13:14:04.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.316+0000 7f86eaa00640 1 --2- 172.21.15.99:0/1069372375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b6851bfa0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f86dc054dc0 tx=0x7f86dc058aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597d343defee3650 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.316+0000 7f86d7400640 1 -- 172.21.15.99:0/1069372375 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc056c60 con 0x560b684f5470 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.316+0000 7f86d7400640 1 -- 172.21.15.99:0/1069372375 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc06e030 con 0x560b684f5470 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.316+0000 7f86d7400640 1 -- 172.21.15.99:0/1069372375 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc05f0c0 con 0x560b684f5470 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.317+0000 7f86f4465740 1 -- 172.21.15.99:0/1069372375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 msgr2=0x560b6851bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.317+0000 7f86f4465740 1 --2- 172.21.15.99:0/1069372375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b6851bfa0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f86dc054dc0 tx=0x7f86dc058aa0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.317+0000 7f86f4465740 1 -- 172.21.15.99:0/1069372375 shutdown_connections 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.317+0000 7f86f4465740 1 --2- 172.21.15.99:0/1069372375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5850 0x560b684f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.317+0000 7f86f4465740 1 --2- 172.21.15.99:0/1069372375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b6851c4e0 0x560b684f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.317+0000 7f86f4465740 1 --2- 172.21.15.99:0/1069372375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b6851bfa0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.317+0000 7f86f4465740 1 -- 172.21.15.99:0/1069372375 >> 172.21.15.99:0/1069372375 conn(0x560b684bbbe0 msgr2=0x560b6853a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.317+0000 7f86f4465740 1 -- 172.21.15.99:0/1069372375 shutdown_connections 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.317+0000 7f86f4465740 1 -- 172.21.15.99:0/1069372375 wait complete. 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.318+0000 7f86f4465740 1 -- start start 2024-03-30T13:14:04.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.318+0000 7f86f4465740 1 Processor -- start 2024-03-30T13:14:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.319+0000 7f86f4465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b684f5470 0x560b685058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.319+0000 7f86f4465740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5850 0x560b68532cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.319+0000 7f86f4465740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b6851f040 0x560b6851f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.319+0000 7f86f4465740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x560b6851bb10 con 0x560b6851f040 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.319+0000 7f86f4465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560b684139d0 con 0x560b684f5470 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.319+0000 7f86f4465740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x560b68514890 con 0x560b684f5850 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.319+0000 7f86f4465740 10 client.0 _ll_register_callbacks cb 0x560b6844ffd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.319+0000 7f86eb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b6851f040 0x560b6851f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.319+0000 7f86eb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b6851f040 0x560b6851f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55772/0 (socket says 172.21.15.99:55772) 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.319+0000 7f86eb400640 1 -- 172.21.15.99:0/989717267 learned_addr learned my addr 172.21.15.99:0/989717267 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86eaa00640 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b684f5470 0x560b685058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86ea000640 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5850 0x560b68532cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86eb400640 1 -- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5850 msgr2=0x560b68532cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86eb400640 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5850 0x560b68532cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86eb400640 1 -- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b684f5470 msgr2=0x560b685058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86eb400640 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b684f5470 0x560b685058b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86eb400640 1 -- 172.21.15.99:0/989717267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b6812c210 con 0x560b6851f040 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86eb400640 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b6851f040 0x560b6851f4c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f86e402c4c0 tx=0x7f86e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25da0969840c6dd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86cbe00640 1 -- 172.21.15.99:0/989717267 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4044070 con 0x560b6851f040 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86cbe00640 1 -- 172.21.15.99:0/989717267 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f86e403f850 con 0x560b6851f040 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.320+0000 7f86f4465740 1 -- 172.21.15.99:0/989717267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86dc06e030 con 0x560b6851f040 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.321+0000 7f86cbe00640 1 -- 172.21.15.99:0/989717267 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f86e404e050 con 0x560b6851f040 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.321+0000 7f86f4465740 10 client.6237 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.321+0000 7f86f4465740 1 -- 172.21.15.99:0/989717267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x560b682990b0 con 0x560b6851f040 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.321+0000 7f86cbe00640 1 -- 172.21.15.99:0/989717267 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc06e030 con 0x560b6851f040 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.321+0000 7f86cbe00640 1 -- 172.21.15.99:0/989717267 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f86e4051020 con 0x560b6851f040 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.321+0000 7f86f4465740 10 client.6237 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.321+0000 7f86f4465740 10 client.6237 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.321+0000 7f86f4465740 20 client.6237 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.321+0000 7f86f4465740 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560b68506070 0x560b68533b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.321+0000 7f86f4465740 4 client.6237 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.321+0000 7f86f4465740 1 -- 172.21.15.99:0/989717267 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b68465870 con 0x560b68506070 2024-03-30T13:14:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.322+0000 7f86eaa00640 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560b68506070 0x560b68533b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.322+0000 7f86eaa00640 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560b68506070 0x560b68533b10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=579a9b4670275656 server_cookie=b2c988a04f2e647a in_seq=0 out_seq=0 2024-03-30T13:14:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.322+0000 7f86cbe00640 10 client.6237 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.324+0000 7f86cbe00640 1 -- 172.21.15.99:0/989717267 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x560b68465870 con 0x560b68506070 2024-03-30T13:14:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.324+0000 7f86cbe00640 10 client.6237 handle_command_reply: tid=0 2024-03-30T13:14:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.324+0000 7f86f4465740 1 client.6237 shutdown 2024-03-30T13:14:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.324+0000 7f86f4465740 1 -- 172.21.15.99:0/989717267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b6851f040 msgr2=0x560b6851f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.324+0000 7f86f4465740 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b6851f040 0x560b6851f4c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f86e402c4c0 tx=0x7f86e4004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.325+0000 7f86f4465740 1 -- 172.21.15.99:0/989717267 shutdown_connections 2024-03-30T13:14:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.325+0000 7f86f4465740 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b6851f040 0x560b6851f4c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.325+0000 7f86f4465740 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5850 0x560b68532cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.325+0000 7f86f4465740 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560b68506070 0x560b68533b10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.325+0000 7f86f4465740 1 --2- 172.21.15.99:0/989717267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b684f5470 0x560b685058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.325+0000 7f86f4465740 1 -- 172.21.15.99:0/989717267 >> 172.21.15.99:0/989717267 conn(0x560b684bbbe0 msgr2=0x560b684eeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.325+0000 7f86cbe00640 0 client.6237 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.325+0000 7f86f4465740 1 -- 172.21.15.99:0/989717267 shutdown_connections 2024-03-30T13:14:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.325+0000 7f86f4465740 1 -- 172.21.15.99:0/989717267 wait complete. 2024-03-30T13:14:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.325+0000 7f86f4465740 20 client.6237 trim_cache size 0 max 16384 2024-03-30T13:14:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.341+0000 7f86f4465740 1 Processor -- start 2024-03-30T13:14:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.341+0000 7f86f4465740 1 -- start start 2024-03-30T13:14:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.341+0000 7f86f4465740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b685b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86f4465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b684f5850 0x560b68533b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86f4465740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b6851f040 0x560b68534050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86f4465740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec200b50 con 0x560b684f5470 2024-03-30T13:14:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86f4465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec1ffd30 con 0x560b684f5850 2024-03-30T13:14:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86f4465740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f86ec0c9820 con 0x560b6851f040 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86eaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b685b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86eaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b685b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55778/0 (socket says 172.21.15.99:55778) 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86eaa00640 1 -- 172.21.15.99:0/1937700452 learned_addr learned my addr 172.21.15.99:0/1937700452 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86eaa00640 1 -- 172.21.15.99:0/1937700452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b6851f040 msgr2=0x560b68534050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86eaa00640 1 --2- 172.21.15.99:0/1937700452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b6851f040 0x560b68534050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86eaa00640 1 -- 172.21.15.99:0/1937700452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b684f5850 msgr2=0x560b68533b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86eaa00640 1 --2- 172.21.15.99:0/1937700452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b684f5850 0x560b68533b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86eaa00640 1 -- 172.21.15.99:0/1937700452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b68505c20 con 0x560b684f5470 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.342+0000 7f86eaa00640 1 --2- 172.21.15.99:0/1937700452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b685b62f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00ce20 tx=0x7f86dc05a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde6908fe0a35033 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86d6a00640 1 -- 172.21.15.99:0/1937700452 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc074030 con 0x560b684f5470 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86d6a00640 1 -- 172.21.15.99:0/1937700452 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc07b070 con 0x560b684f5470 2024-03-30T13:14:04.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86d6a00640 1 -- 172.21.15.99:0/1937700452 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc05f0c0 con 0x560b684f5470 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86f4465740 1 -- 172.21.15.99:0/1937700452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 msgr2=0x560b685b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86f4465740 1 --2- 172.21.15.99:0/1937700452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b685b62f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00ce20 tx=0x7f86dc05a000 comp rx=0 tx=0).stop 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86f4465740 1 -- 172.21.15.99:0/1937700452 shutdown_connections 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86f4465740 1 --2- 172.21.15.99:0/1937700452 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b6851f040 0x560b68534050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86f4465740 1 --2- 172.21.15.99:0/1937700452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b684f5850 0x560b68533b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86f4465740 1 --2- 172.21.15.99:0/1937700452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5470 0x560b685b62f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86f4465740 1 -- 172.21.15.99:0/1937700452 >> 172.21.15.99:0/1937700452 conn(0x560b684bbbe0 msgr2=0x560b684ee3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86f4465740 1 -- 172.21.15.99:0/1937700452 shutdown_connections 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.343+0000 7f86f4465740 1 -- 172.21.15.99:0/1937700452 wait complete. 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.344+0000 7f86f4465740 1 -- start start 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.344+0000 7f86f4465740 1 Processor -- start 2024-03-30T13:14:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.345+0000 7f86f4465740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5470 0x560b685a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.345+0000 7f86f4465740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5850 0x560b685a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.345+0000 7f86f4465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b6851f040 0x560b6855d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.345+0000 7f86f4465740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x560b684e9fe0 con 0x560b684f5850 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.345+0000 7f86f4465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec0c9e70 con 0x560b6851f040 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.345+0000 7f86f4465740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x560b684f69e0 con 0x560b684f5470 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.345+0000 7f86f4465740 10 client.0 _ll_register_callbacks cb 0x7f86e4037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86ea000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5850 0x560b685a2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86ea000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5850 0x560b685a2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55780/0 (socket says 172.21.15.99:55780) 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86ea000640 1 -- 172.21.15.99:0/2231800248 learned_addr learned my addr 172.21.15.99:0/2231800248 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86eaa00640 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5470 0x560b685a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86eb400640 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b6851f040 0x560b6855d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86ea000640 1 -- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5470 msgr2=0x560b685a25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86ea000640 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5470 0x560b685a25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86ea000640 1 -- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b6851f040 msgr2=0x560b6855d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86ea000640 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b6851f040 0x560b6855d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86ea000640 1 -- 172.21.15.99:0/2231800248 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b68508990 con 0x560b684f5850 2024-03-30T13:14:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86eb400640 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b6851f040 0x560b6855d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86ea000640 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5850 0x560b685a2e20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009160 tx=0x7f86d8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad08c2217fe200dd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.346+0000 7f86cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:04.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86cbe00640 1 -- 172.21.15.99:0/2231800248 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8024070 con 0x560b684f5850 2024-03-30T13:14:04.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86f4465740 1 -- 172.21.15.99:0/2231800248 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86dc07b070 con 0x560b684f5850 2024-03-30T13:14:04.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86cbe00640 1 -- 172.21.15.99:0/2231800248 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f86d8020610 con 0x560b684f5850 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86cbe00640 1 -- 172.21.15.99:0/2231800248 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f86d802f050 con 0x560b684f5850 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86f4465740 10 client.6243 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86f4465740 1 -- 172.21.15.99:0/2231800248 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x560b681052d0 con 0x560b684f5850 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86cbe00640 1 -- 172.21.15.99:0/2231800248 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc07b070 con 0x560b684f5850 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86cbe00640 1 -- 172.21.15.99:0/2231800248 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f86d8032020 con 0x560b684f5850 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86f4465740 10 client.6243 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86f4465740 10 client.6243 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86f4465740 20 client.6243 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86f4465740 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560b685326f0 0x560b68533b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86f4465740 4 client.6243 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628421}] 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.347+0000 7f86f4465740 1 -- 172.21.15.99:0/2231800248 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628421}) -- 0x560b6853e2d0 con 0x560b685326f0 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.348+0000 7f86eaa00640 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560b685326f0 0x560b68533b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.349+0000 7f86eaa00640 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560b685326f0 0x560b68533b10 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c4cc3a7565099c8 server_cookie=59528d79904373d7 in_seq=0 out_seq=0 2024-03-30T13:14:04.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.349+0000 7f86cbe00640 10 client.6243 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86cbe00640 1 -- 172.21.15.99:0/2231800248 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4768 (crc 0 0 0) 0x560b6853e2d0 con 0x560b685326f0 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86cbe00640 10 client.6243 handle_command_reply: tid=0 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 1 client.6243 shutdown 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 1 -- 172.21.15.99:0/2231800248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5850 msgr2=0x560b685a2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5850 0x560b685a2e20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009160 tx=0x7f86d8009190 comp rx=0 tx=0).stop 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 1 -- 172.21.15.99:0/2231800248 shutdown_connections 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x560b685326f0 0x560b68533b10 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b6851f040 0x560b6855d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b684f5850 0x560b685a2e20 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86cbe00640 0 client.6243 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 1 --2- 172.21.15.99:0/2231800248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x560b684f5470 0x560b685a25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 1 -- 172.21.15.99:0/2231800248 >> 172.21.15.99:0/2231800248 conn(0x560b684bbbe0 msgr2=0x560b6855ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 1 -- 172.21.15.99:0/2231800248 shutdown_connections 2024-03-30T13:14:04.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 1 -- 172.21.15.99:0/2231800248 wait complete. 2024-03-30T13:14:04.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.350+0000 7f86f4465740 20 client.6243 trim_cache size 0 max 16384 2024-03-30T13:14:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debugfs.h", 2024-03-30T13:14:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628421, 2024-03-30T13:14:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.644544+0000", 2024-03-30T13:14:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.873870+0000", 2024-03-30T13:14:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 311, 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.873870+0000", 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 311, 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.644544+0000" 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 311, 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.644544+0000" 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 256, 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 32, 2024-03-30T13:14:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:04.374 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 -- 172.21.15.99:0/1154189462 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86cc06c530 msgr2=0x7f86cc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86cc06c530 0x7f86cc06e9f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009560 tx=0x7f86d8008040 comp rx=0 tx=0).stop 2024-03-30T13:14:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 -- 172.21.15.99:0/1154189462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86ec0ad630 msgr2=0x7f86ec151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86ec0ad630 0x7f86ec151ad0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c460 tx=0x7f86dc00c920 comp rx=0 tx=0).stop 2024-03-30T13:14:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 -- 172.21.15.99:0/1154189462 shutdown_connections 2024-03-30T13:14:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86cc06c530 0x7f86cc06e9f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ec15ca80 0x7f86ec0b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86ec0cf330 0x7f86ec09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 --2- 172.21.15.99:0/1154189462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86ec0ad630 0x7f86ec151ad0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 -- 172.21.15.99:0/1154189462 >> 172.21.15.99:0/1154189462 conn(0x7f86ec06bb40 msgr2=0x7f86ec0adbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 -- 172.21.15.99:0/1154189462 shutdown_connections 2024-03-30T13:14:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.351+0000 7f86ebe00640 1 -- 172.21.15.99:0/1154189462 wait complete. 2024-03-30T13:14:04.376 DEBUG:tasks.cephfs.test_uninlining:getting inode info #20 of 23:1099511628422 2024-03-30T13:14:04.376 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628422 2024-03-30T13:14:04.376 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628422 2024-03-30T13:14:04.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.583+0000 7faa15e00640 1 Processor -- start 2024-03-30T13:14:04.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.583+0000 7faa15e00640 1 -- start start 2024-03-30T13:14:04.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.584+0000 7faa15e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa100b4e40 0x7faa100c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.584+0000 7faa15e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7faa100b31c0 0x7faa100b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.584+0000 7faa15e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa100b2640 0x7faa100cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.584+0000 7faa15e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7faa100c6d60 con 0x7faa100b4e40 2024-03-30T13:14:04.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.584+0000 7faa15e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7faa100cba20 con 0x7faa100b31c0 2024-03-30T13:14:04.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.584+0000 7faa15e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7faa100b2a70 con 0x7faa100b2640 2024-03-30T13:14:04.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.584+0000 7faa0ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa100b4e40 0x7faa100c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.585+0000 7faa0ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa100b4e40 0x7faa100c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55796/0 (socket says 172.21.15.99:55796) 2024-03-30T13:14:04.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.585+0000 7faa0ea00640 1 -- 172.21.15.99:0/4084441552 learned_addr learned my addr 172.21.15.99:0/4084441552 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.585+0000 7faa07e00640 1 --2- 172.21.15.99:0/4084441552 >> v2:172.21.15.181:3300/0 conn(0x7faa100b31c0 0x7faa100b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.585+0000 7faa0f400640 1 --2- 172.21.15.99:0/4084441552 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa100b2640 0x7faa100cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.585+0000 7faa0ea00640 1 -- 172.21.15.99:0/4084441552 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa100b2640 msgr2=0x7faa100cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.585+0000 7faa0ea00640 1 --2- 172.21.15.99:0/4084441552 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa100b2640 0x7faa100cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.585+0000 7faa0ea00640 1 -- 172.21.15.99:0/4084441552 >> v2:172.21.15.181:3300/0 conn(0x7faa100b31c0 msgr2=0x7faa100b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.585+0000 7faa0ea00640 1 --2- 172.21.15.99:0/4084441552 >> v2:172.21.15.181:3300/0 conn(0x7faa100b31c0 0x7faa100b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.585+0000 7faa0ea00640 1 -- 172.21.15.99:0/4084441552 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa101604d0 con 0x7faa100b4e40 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.586+0000 7faa0ea00640 1 --2- 172.21.15.99:0/4084441552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa100b4e40 0x7faa100c6820 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7faa100c59c0 tx=0x7faa0002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6056c2483eb4ba9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.586+0000 7faa0e000640 1 -- 172.21.15.99:0/4084441552 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa000317c0 con 0x7faa100b4e40 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.586+0000 7faa0e000640 1 -- 172.21.15.99:0/4084441552 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa00037070 con 0x7faa100b4e40 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.586+0000 7faa0e000640 1 -- 172.21.15.99:0/4084441552 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00031b80 con 0x7faa100b4e40 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.587+0000 7faa15e00640 1 -- 172.21.15.99:0/4084441552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa100b4e40 msgr2=0x7faa100c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.587+0000 7faa15e00640 1 --2- 172.21.15.99:0/4084441552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa100b4e40 0x7faa100c6820 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7faa100c59c0 tx=0x7faa0002b860 comp rx=0 tx=0).stop 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.587+0000 7faa15e00640 1 -- 172.21.15.99:0/4084441552 shutdown_connections 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.587+0000 7faa15e00640 1 --2- 172.21.15.99:0/4084441552 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa100b2640 0x7faa100cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.587+0000 7faa15e00640 1 --2- 172.21.15.99:0/4084441552 >> v2:172.21.15.181:3300/0 conn(0x7faa100b31c0 0x7faa100b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.587+0000 7faa15e00640 1 --2- 172.21.15.99:0/4084441552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa100b4e40 0x7faa100c6820 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.587+0000 7faa15e00640 1 -- 172.21.15.99:0/4084441552 >> 172.21.15.99:0/4084441552 conn(0x7faa100d0450 msgr2=0x7faa100d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.587+0000 7faa15e00640 1 -- 172.21.15.99:0/4084441552 shutdown_connections 2024-03-30T13:14:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.587+0000 7faa15e00640 1 -- 172.21.15.99:0/4084441552 wait complete. 2024-03-30T13:14:04.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.589+0000 7faa15e00640 1 Processor -- start 2024-03-30T13:14:04.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.589+0000 7faa15e00640 1 -- start start 2024-03-30T13:14:04.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.590+0000 7faa15e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa100b2640 0x7faa100ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.590+0000 7faa15e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa100b31c0 0x7faa100ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.590+0000 7faa15e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa100b4e40 0x7faa100cee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.590+0000 7faa15e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faa10160d70 con 0x7faa100b2640 2024-03-30T13:14:04.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.590+0000 7faa15e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faa10160a90 con 0x7faa100b4e40 2024-03-30T13:14:04.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.590+0000 7faa15e00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7faa100b3650 con 0x7faa100b31c0 2024-03-30T13:14:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.590+0000 7faa0ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa100b2640 0x7faa100ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.590+0000 7faa0ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa100b2640 0x7faa100ae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55798/0 (socket says 172.21.15.99:55798) 2024-03-30T13:14:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.590+0000 7faa0ea00640 1 -- 172.21.15.99:0/1087135936 learned_addr learned my addr 172.21.15.99:0/1087135936 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa07e00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa100b31c0 0x7faa100ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa0ea00640 1 -- 172.21.15.99:0/1087135936 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa100b31c0 msgr2=0x7faa100ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa0ea00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa100b31c0 0x7faa100ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa0ea00640 1 -- 172.21.15.99:0/1087135936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa100b4e40 msgr2=0x7faa100cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa0ea00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa100b4e40 0x7faa100cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa0ea00640 1 -- 172.21.15.99:0/1087135936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1015e6e0 con 0x7faa100b2640 2024-03-30T13:14:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa0ea00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa100b2640 0x7faa100ae320 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7faa00000c00 tx=0x7faa000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa07400640 1 -- 172.21.15.99:0/1087135936 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00032650 con 0x7faa100b2640 2024-03-30T13:14:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa07400640 1 -- 172.21.15.99:0/1087135936 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa00032810 con 0x7faa100b2640 2024-03-30T13:14:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa07400640 1 -- 172.21.15.99:0/1087135936 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00032c00 con 0x7faa100b2640 2024-03-30T13:14:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa15e00640 1 -- 172.21.15.99:0/1087135936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa101f9e20 con 0x7faa100b2640 2024-03-30T13:14:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.591+0000 7faa15e00640 1 -- 172.21.15.99:0/1087135936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1015cfa0 con 0x7faa100b2640 2024-03-30T13:14:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.594+0000 7faa07400640 1 -- 172.21.15.99:0/1087135936 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faa0004c060 con 0x7faa100b2640 2024-03-30T13:14:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.595+0000 7faa07400640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9ec06c530 0x7fa9ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.595+0000 7faa07400640 1 -- 172.21.15.99:0/1087135936 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7faa000ad230 con 0x7faa100b2640 2024-03-30T13:14:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.595+0000 7faa07e00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9ec06c530 0x7fa9ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.595+0000 7faa18a3d740 1 Processor -- start 2024-03-30T13:14:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.595+0000 7faa18a3d740 1 -- start start 2024-03-30T13:14:04.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.596+0000 7faa07e00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9ec06c530 0x7fa9ec06e9f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faa100af170 tx=0x7fa9f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.596+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317290 0x55fa2133ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.596+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa2133e300 0x55fa213162d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.596+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317670 0x55fa21316810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.596+0000 7faa18a3d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55fa2127a330 con 0x55fa2133e300 2024-03-30T13:14:04.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.596+0000 7faa18a3d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fa21222620 con 0x55fa21317670 2024-03-30T13:14:04.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.596+0000 7faa18a3d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55fa21276440 con 0x55fa21317290 2024-03-30T13:14:04.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.597+0000 7faa07e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa2133e300 0x55fa213162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.597+0000 7faa07e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa2133e300 0x55fa213162d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55808/0 (socket says 172.21.15.99:55808) 2024-03-30T13:14:04.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.597+0000 7faa07e00640 1 -- 172.21.15.99:0/1584239084 learned_addr learned my addr 172.21.15.99:0/1584239084 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.597+0000 7faa0ea00640 1 --2- 172.21.15.99:0/1584239084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317290 0x55fa2133ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.597+0000 7faa07e00640 1 -- 172.21.15.99:0/1584239084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317290 msgr2=0x55fa2133ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.597+0000 7faa07e00640 1 --2- 172.21.15.99:0/1584239084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317290 0x55fa2133ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.597+0000 7faa07e00640 1 -- 172.21.15.99:0/1584239084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317670 msgr2=0x55fa21316810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.597+0000 7faa07e00640 1 --2- 172.21.15.99:0/1584239084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317670 0x55fa21316810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.597+0000 7faa07e00640 1 -- 172.21.15.99:0/1584239084 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa2105a920 con 0x55fa2133e300 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.597+0000 7faa07e00640 1 --2- 172.21.15.99:0/1584239084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa2133e300 0x55fa213162d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800e8f0 tx=0x7fa9f8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f24729e67310162 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7fa9ff400640 1 -- 172.21.15.99:0/1584239084 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8025070 con 0x55fa2133e300 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7fa9ff400640 1 -- 172.21.15.99:0/1584239084 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f8015700 con 0x55fa2133e300 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7fa9ff400640 1 -- 172.21.15.99:0/1584239084 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800f040 con 0x55fa2133e300 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7faa18a3d740 1 -- 172.21.15.99:0/1584239084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa2133e300 msgr2=0x55fa213162d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7faa18a3d740 1 --2- 172.21.15.99:0/1584239084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa2133e300 0x55fa213162d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800e8f0 tx=0x7fa9f8011000 comp rx=0 tx=0).stop 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7faa18a3d740 1 -- 172.21.15.99:0/1584239084 shutdown_connections 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7faa18a3d740 1 --2- 172.21.15.99:0/1584239084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317670 0x55fa21316810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7faa18a3d740 1 --2- 172.21.15.99:0/1584239084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa2133e300 0x55fa213162d0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7faa18a3d740 1 --2- 172.21.15.99:0/1584239084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317290 0x55fa2133ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7faa18a3d740 1 -- 172.21.15.99:0/1584239084 >> 172.21.15.99:0/1584239084 conn(0x55fa212ddbe0 msgr2=0x55fa2135bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7faa18a3d740 1 -- 172.21.15.99:0/1584239084 shutdown_connections 2024-03-30T13:14:04.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.598+0000 7faa18a3d740 1 -- 172.21.15.99:0/1584239084 wait complete. 2024-03-30T13:14:04.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.599+0000 7faa18a3d740 1 -- start start 2024-03-30T13:14:04.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.599+0000 7faa18a3d740 1 Processor -- start 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.600+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317290 0x55fa2135b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.600+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa21335130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.600+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21344430 0x55fa2136b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.600+0000 7faa18a3d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55fa2133d930 con 0x55fa21317670 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.600+0000 7faa18a3d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fa212359d0 con 0x55fa21344430 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.600+0000 7faa18a3d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55fa213366b0 con 0x55fa21317290 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.600+0000 7faa18a3d740 10 client.0 _ll_register_callbacks cb 0x55fa21271fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.600+0000 7faa07e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa21335130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.601+0000 7faa07e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa21335130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55812/0 (socket says 172.21.15.99:55812) 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.601+0000 7faa07e00640 1 -- 172.21.15.99:0/452146356 learned_addr learned my addr 172.21.15.99:0/452146356 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.601+0000 7faa07e00640 1 -- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317290 msgr2=0x55fa2135b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.601+0000 7faa0ea00640 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317290 0x55fa2135b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.601+0000 7faa0f400640 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21344430 0x55fa2136b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.601+0000 7faa07e00640 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317290 0x55fa2135b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.601+0000 7faa07e00640 1 -- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21344430 msgr2=0x55fa2136b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.601+0000 7faa07e00640 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21344430 0x55fa2136b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.601+0000 7faa07e00640 1 -- 172.21.15.99:0/452146356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa20f4e210 con 0x55fa21317670 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.601+0000 7faa07e00640 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa21335130 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8006fd0 tx=0x7fa9f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da5ba4ec03f5c6f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.601+0000 7fa9f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7fa9f3e00640 1 -- 172.21.15.99:0/452146356 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8030060 con 0x55fa21317670 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7fa9f3e00640 1 -- 172.21.15.99:0/452146356 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7fa9f8029430 con 0x55fa21317670 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7faa18a3d740 1 -- 172.21.15.99:0/452146356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9f8015700 con 0x55fa21317670 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7fa9f3e00640 1 -- 172.21.15.99:0/452146356 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa9f8036050 con 0x55fa21317670 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7faa18a3d740 10 client.6255 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7faa18a3d740 1 -- 172.21.15.99:0/452146356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55fa210bb0b0 con 0x55fa21317670 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7fa9f3e00640 1 -- 172.21.15.99:0/452146356 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f8015700 con 0x55fa21317670 2024-03-30T13:14:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7fa9f3e00640 1 -- 172.21.15.99:0/452146356 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fa9f8039020 con 0x55fa21317670 2024-03-30T13:14:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7faa18a3d740 10 client.6255 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7faa18a3d740 10 client.6255 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7faa18a3d740 20 client.6255 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7faa18a3d740 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55fa21343280 0x55fa21343690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7faa18a3d740 4 client.6255 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.602+0000 7faa18a3d740 1 -- 172.21.15.99:0/452146356 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa21287870 con 0x55fa21343280 2024-03-30T13:14:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.603+0000 7faa0ea00640 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55fa21343280 0x55fa21343690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.604+0000 7faa0ea00640 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55fa21343280 0x55fa21343690 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50aca1caa8b2bd62 server_cookie=64cf7e6e51ae8572 in_seq=0 out_seq=0 2024-03-30T13:14:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.604+0000 7fa9f3e00640 10 client.6255 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.605+0000 7fa9f3e00640 1 -- 172.21.15.99:0/452146356 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55fa21287870 con 0x55fa21343280 2024-03-30T13:14:04.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.605+0000 7fa9f3e00640 10 client.6255 handle_command_reply: tid=0 2024-03-30T13:14:04.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.605+0000 7faa18a3d740 1 client.6255 shutdown 2024-03-30T13:14:04.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7faa18a3d740 1 -- 172.21.15.99:0/452146356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 msgr2=0x55fa21335130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7faa18a3d740 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa21335130 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8006fd0 tx=0x7fa9f8004730 comp rx=0 tx=0).stop 2024-03-30T13:14:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7faa18a3d740 1 -- 172.21.15.99:0/452146356 shutdown_connections 2024-03-30T13:14:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7faa18a3d740 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55fa21343280 0x55fa21343690 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7faa18a3d740 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21344430 0x55fa2136b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7faa18a3d740 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa21335130 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7faa18a3d740 1 --2- 172.21.15.99:0/452146356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317290 0x55fa2135b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7faa18a3d740 1 -- 172.21.15.99:0/452146356 >> 172.21.15.99:0/452146356 conn(0x55fa212ddbe0 msgr2=0x55fa2133d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7fa9f3e00640 0 client.6255 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7faa18a3d740 1 -- 172.21.15.99:0/452146356 shutdown_connections 2024-03-30T13:14:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7faa18a3d740 1 -- 172.21.15.99:0/452146356 wait complete. 2024-03-30T13:14:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.606+0000 7faa18a3d740 20 client.6255 trim_cache size 0 max 16384 2024-03-30T13:14:04.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.622+0000 7faa18a3d740 1 Processor -- start 2024-03-30T13:14:04.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.622+0000 7faa18a3d740 1 -- start start 2024-03-30T13:14:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317290 0x55fa2135ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317670 0x55fa2135f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21344430 0x55fa2135f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa18a3d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faa102051f0 con 0x55fa21344430 2024-03-30T13:14:04.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa18a3d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faa10204250 con 0x55fa21317290 2024-03-30T13:14:04.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa18a3d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7faa10203610 con 0x55fa21317670 2024-03-30T13:14:04.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa0f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21344430 0x55fa2135f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa0f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21344430 0x55fa2135f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55818/0 (socket says 172.21.15.99:55818) 2024-03-30T13:14:04.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa0f400640 1 -- 172.21.15.99:0/2682389349 learned_addr learned my addr 172.21.15.99:0/2682389349 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa0f400640 1 -- 172.21.15.99:0/2682389349 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317670 msgr2=0x55fa2135f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa07e00640 1 --2- 172.21.15.99:0/2682389349 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317670 0x55fa2135f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.623+0000 7faa0ea00640 1 --2- 172.21.15.99:0/2682389349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317290 0x55fa2135ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.624+0000 7faa0f400640 1 --2- 172.21.15.99:0/2682389349 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317670 0x55fa2135f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.624+0000 7faa0f400640 1 -- 172.21.15.99:0/2682389349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317290 msgr2=0x55fa2135ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.624+0000 7faa0f400640 1 --2- 172.21.15.99:0/2682389349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317290 0x55fa2135ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.624+0000 7faa0f400640 1 -- 172.21.15.99:0/2682389349 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa2136bd20 con 0x55fa21344430 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.624+0000 7faa07e00640 1 --2- 172.21.15.99:0/2682389349 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317670 0x55fa2135f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.624+0000 7faa0f400640 1 --2- 172.21.15.99:0/2682389349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21344430 0x55fa2135f540 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7faa08009d50 tx=0x7faa08007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb2e281cba1d3e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.624+0000 7fa9fea00640 1 -- 172.21.15.99:0/2682389349 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08014610 con 0x55fa21344430 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.624+0000 7fa9fea00640 1 -- 172.21.15.99:0/2682389349 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa08019070 con 0x55fa21344430 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.624+0000 7fa9fea00640 1 -- 172.21.15.99:0/2682389349 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080149f0 con 0x55fa21344430 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.625+0000 7faa18a3d740 1 -- 172.21.15.99:0/2682389349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21344430 msgr2=0x55fa2135f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.625+0000 7faa18a3d740 1 --2- 172.21.15.99:0/2682389349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21344430 0x55fa2135f540 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7faa08009d50 tx=0x7faa08007700 comp rx=0 tx=0).stop 2024-03-30T13:14:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.625+0000 7faa18a3d740 1 -- 172.21.15.99:0/2682389349 shutdown_connections 2024-03-30T13:14:04.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.625+0000 7faa18a3d740 1 --2- 172.21.15.99:0/2682389349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21344430 0x55fa2135f540 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.625+0000 7faa18a3d740 1 --2- 172.21.15.99:0/2682389349 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21317670 0x55fa2135f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.625+0000 7faa18a3d740 1 --2- 172.21.15.99:0/2682389349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317290 0x55fa2135ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.625+0000 7faa18a3d740 1 -- 172.21.15.99:0/2682389349 >> 172.21.15.99:0/2682389349 conn(0x55fa212ddbe0 msgr2=0x55fa21343660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.625+0000 7faa18a3d740 1 -- 172.21.15.99:0/2682389349 shutdown_connections 2024-03-30T13:14:04.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.625+0000 7faa18a3d740 1 -- 172.21.15.99:0/2682389349 wait complete. 2024-03-30T13:14:04.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.626+0000 7faa18a3d740 1 -- start start 2024-03-30T13:14:04.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.626+0000 7faa18a3d740 1 Processor -- start 2024-03-30T13:14:04.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317290 0x55fa213d7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa213745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa18a3d740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21344430 0x55fa21374b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa18a3d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faa10203c30 con 0x55fa21317670 2024-03-30T13:14:04.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa18a3d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fa21287870 con 0x55fa21317290 2024-03-30T13:14:04.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa18a3d740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55fa213db160 con 0x55fa21344430 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa18a3d740 10 client.0 _ll_register_callbacks cb 0x7fa9f8023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa07e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa213745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa07e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa213745c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55828/0 (socket says 172.21.15.99:55828) 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa07e00640 1 -- 172.21.15.99:0/4277812959 learned_addr learned my addr 172.21.15.99:0/4277812959 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa0ea00640 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317290 0x55fa213d7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa07e00640 1 -- 172.21.15.99:0/4277812959 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21344430 msgr2=0x55fa21374b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa07e00640 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21344430 0x55fa21374b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa07e00640 1 -- 172.21.15.99:0/4277812959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317290 msgr2=0x55fa213d7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa07e00640 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317290 0x55fa213d7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.627+0000 7faa07e00640 1 -- 172.21.15.99:0/4277812959 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa20f272d0 con 0x55fa21317670 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.628+0000 7faa07e00640 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa213745c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8015ca0 tx=0x7fa9f801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8167de5c0ed1aae0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.628+0000 7fa9f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.628+0000 7fa9f3e00640 1 -- 172.21.15.99:0/4277812959 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f803f060 con 0x55fa21317670 2024-03-30T13:14:04.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.628+0000 7fa9f3e00640 1 -- 172.21.15.99:0/4277812959 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7fa9f8029430 con 0x55fa21317670 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.628+0000 7faa18a3d740 1 -- 172.21.15.99:0/4277812959 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa08019070 con 0x55fa21317670 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.628+0000 7fa9f3e00640 1 -- 172.21.15.99:0/4277812959 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa9f8045050 con 0x55fa21317670 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.628+0000 7faa18a3d740 10 client.6261 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.628+0000 7faa18a3d740 1 -- 172.21.15.99:0/4277812959 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55fa213daea0 con 0x55fa21317670 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.628+0000 7fa9f3e00640 1 -- 172.21.15.99:0/4277812959 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa08019070 con 0x55fa21317670 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.629+0000 7fa9f3e00640 1 -- 172.21.15.99:0/4277812959 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fa9f8048020 con 0x55fa21317670 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.629+0000 7faa18a3d740 10 client.6261 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.629+0000 7faa18a3d740 10 client.6261 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.629+0000 7faa18a3d740 20 client.6261 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.629+0000 7faa18a3d740 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55fa2135ab40 0x55fa213d7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.629+0000 7faa18a3d740 4 client.6261 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628422}] 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.629+0000 7faa18a3d740 1 -- 172.21.15.99:0/4277812959 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628422}) -- 0x55fa21281bc0 con 0x55fa2135ab40 2024-03-30T13:14:04.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.629+0000 7faa0ea00640 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55fa2135ab40 0x55fa213d7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.630+0000 7faa0ea00640 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55fa2135ab40 0x55fa213d7930 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b52f496d1240c78c server_cookie=fb6d8af23bc815a3 in_seq=0 out_seq=0 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.630+0000 7fa9f3e00640 10 client.6261 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7fa9f3e00640 1 -- 172.21.15.99:0/4277812959 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4773 (crc 0 0 0) 0x55fa21281bc0 con 0x55fa2135ab40 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7fa9f3e00640 10 client.6261 handle_command_reply: tid=0 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7faa18a3d740 1 client.6261 shutdown 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7faa18a3d740 1 -- 172.21.15.99:0/4277812959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 msgr2=0x55fa213745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7faa18a3d740 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa213745c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8015ca0 tx=0x7fa9f801e000 comp rx=0 tx=0).stop 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7faa18a3d740 1 -- 172.21.15.99:0/4277812959 shutdown_connections 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7faa18a3d740 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55fa21344430 0x55fa21374b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7faa18a3d740 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa21317670 0x55fa213745c0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7faa18a3d740 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55fa2135ab40 0x55fa213d7930 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7faa18a3d740 1 --2- 172.21.15.99:0/4277812959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa21317290 0x55fa213d7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7faa18a3d740 1 -- 172.21.15.99:0/4277812959 >> 172.21.15.99:0/4277812959 conn(0x55fa212ddbe0 msgr2=0x55fa21343660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.631+0000 7fa9f3e00640 0 client.6261 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa18a3d740 1 -- 172.21.15.99:0/4277812959 shutdown_connections 2024-03-30T13:14:04.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa18a3d740 1 -- 172.21.15.99:0/4277812959 wait complete. 2024-03-30T13:14:04.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa18a3d740 20 client.6261 trim_cache size 0 max 16384 2024-03-30T13:14:04.639 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:04.639 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-dev-proto.h", 2024-03-30T13:14:04.639 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628422, 2024-03-30T13:14:04.639 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:04.639 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.651086+0000", 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.876870+0000", 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:04.640 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2111, 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.876870+0000", 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 4, 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:04.642 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2111, 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.651086+0000" 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:04.643 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2111, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.651086+0000" 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 258, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 34, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:04.644 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:04.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.646 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.648 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.649 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:04.650 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:04.651 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.651 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.651 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:04.651 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.651 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.651 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.651 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.651 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.651 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:04.651 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:04.652 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:04.653 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:04.654 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:04.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa15e00640 1 -- 172.21.15.99:0/1087135936 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9ec06c530 msgr2=0x7fa9ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa15e00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9ec06c530 0x7fa9ec06e9f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faa100af170 tx=0x7fa9f8008040 comp rx=0 tx=0).stop 2024-03-30T13:14:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa15e00640 1 -- 172.21.15.99:0/1087135936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa100b2640 msgr2=0x7faa100ae320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa15e00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa100b2640 0x7faa100ae320 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7faa00000c00 tx=0x7faa000046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa15e00640 1 -- 172.21.15.99:0/1087135936 shutdown_connections 2024-03-30T13:14:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa15e00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9ec06c530 0x7fa9ec06e9f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa15e00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa100b4e40 0x7faa100cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa15e00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa100b31c0 0x7faa100ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa15e00640 1 --2- 172.21.15.99:0/1087135936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa100b2640 0x7faa100ae320 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.632+0000 7faa15e00640 1 -- 172.21.15.99:0/1087135936 >> 172.21.15.99:0/1087135936 conn(0x7faa100d0450 msgr2=0x7faa1015be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.633+0000 7faa15e00640 1 -- 172.21.15.99:0/1087135936 shutdown_connections 2024-03-30T13:14:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.633+0000 7faa15e00640 1 -- 172.21.15.99:0/1087135936 wait complete. 2024-03-30T13:14:04.656 DEBUG:tasks.cephfs.test_uninlining:getting inode info #21 of 23:1099511628407 2024-03-30T13:14:04.656 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628407 2024-03-30T13:14:04.657 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628407 2024-03-30T13:14:04.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.861+0000 7f6f64c00640 1 Processor -- start 2024-03-30T13:14:04.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.861+0000 7f6f64c00640 1 -- start start 2024-03-30T13:14:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.863+0000 7f6f64c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f6015b3d0 0x7f6f600ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.863+0000 7f6f64c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f600b49f0 0x7f6f600b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.863+0000 7f6f64c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f600c6470 con 0x7f6f600b21b0 2024-03-30T13:14:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.863+0000 7f6f64c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6f600c6240 con 0x7f6f6015b3d0 2024-03-30T13:14:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.863+0000 7f6f64c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f600c7080 con 0x7f6f600b49f0 2024-03-30T13:14:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.863+0000 7f6f5de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f6015b3d0 0x7f6f600ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.863+0000 7f6f5de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f6015b3d0 0x7f6f600ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52174/0 (socket says 172.21.15.99:52174) 2024-03-30T13:14:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.863+0000 7f6f5de00640 1 -- 172.21.15.99:0/3609878522 learned_addr learned my addr 172.21.15.99:0/3609878522 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.864+0000 7f6f57e00640 1 --2- 172.21.15.99:0/3609878522 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f600b49f0 0x7f6f600b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.864+0000 7f6f5de00640 1 -- 172.21.15.99:0/3609878522 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f600b49f0 msgr2=0x7f6f600b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.864+0000 7f6f5de00640 1 --2- 172.21.15.99:0/3609878522 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f600b49f0 0x7f6f600b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.864+0000 7f6f5de00640 1 -- 172.21.15.99:0/3609878522 >> v1:172.21.15.181:6789/0 conn(0x7f6f600b21b0 legacy=0x7f6f6015be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.864+0000 7f6f5de00640 1 -- 172.21.15.99:0/3609878522 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f600c6750 con 0x7f6f6015b3d0 2024-03-30T13:14:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.865+0000 7f6f5de00640 1 --2- 172.21.15.99:0/3609878522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f6015b3d0 0x7f6f600ca950 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000bb10 tx=0x7f6f5002e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fb622427e52068 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.865+0000 7f6f5d400640 1 -- 172.21.15.99:0/3609878522 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5003b070 con 0x7f6f6015b3d0 2024-03-30T13:14:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.865+0000 7f6f5d400640 1 -- 172.21.15.99:0/3609878522 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f50036440 con 0x7f6f6015b3d0 2024-03-30T13:14:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.865+0000 7f6f5d400640 1 -- 172.21.15.99:0/3609878522 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50036810 con 0x7f6f6015b3d0 2024-03-30T13:14:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.866+0000 7f6f64c00640 1 -- 172.21.15.99:0/3609878522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f6015b3d0 msgr2=0x7f6f600ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.866+0000 7f6f64c00640 1 --2- 172.21.15.99:0/3609878522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f6015b3d0 0x7f6f600ca950 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000bb10 tx=0x7f6f5002e0c0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.866+0000 7f6f64c00640 1 -- 172.21.15.99:0/3609878522 shutdown_connections 2024-03-30T13:14:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.866+0000 7f6f64c00640 1 --2- 172.21.15.99:0/3609878522 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f600b49f0 0x7f6f600b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.866+0000 7f6f64c00640 1 --2- 172.21.15.99:0/3609878522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f6015b3d0 0x7f6f600ca950 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.866+0000 7f6f64c00640 1 -- 172.21.15.99:0/3609878522 >> 172.21.15.99:0/3609878522 conn(0x7f6f600d0450 msgr2=0x7f6f600d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.866+0000 7f6f64c00640 1 -- 172.21.15.99:0/3609878522 shutdown_connections 2024-03-30T13:14:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.866+0000 7f6f64c00640 1 -- 172.21.15.99:0/3609878522 wait complete. 2024-03-30T13:14:04.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.868+0000 7f6f64c00640 1 Processor -- start 2024-03-30T13:14:04.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.868+0000 7f6f64c00640 1 -- start start 2024-03-30T13:14:04.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.869+0000 7f6f64c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f600b21b0 0x7f6f600afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.869+0000 7f6f64c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f600b49f0 0x7f6f600b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.869+0000 7f6f64c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f6015b3d0 0x7f6f600c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.869+0000 7f6f64c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6015b7b0 con 0x7f6f600b21b0 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.869+0000 7f6f64c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f600c6d10 con 0x7f6f6015b3d0 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.869+0000 7f6f64c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6015b930 con 0x7f6f600b49f0 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.869+0000 7f6f5de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f600b21b0 0x7f6f600afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.869+0000 7f6f5de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f600b21b0 0x7f6f600afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52180/0 (socket says 172.21.15.99:52180) 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.869+0000 7f6f5de00640 1 -- 172.21.15.99:0/1456679080 learned_addr learned my addr 172.21.15.99:0/1456679080 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f57e00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f600b49f0 0x7f6f600b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f5de00640 1 -- 172.21.15.99:0/1456679080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f600b49f0 msgr2=0x7f6f600b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f5de00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f600b49f0 0x7f6f600b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f5e800640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f6015b3d0 0x7f6f600c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f5de00640 1 -- 172.21.15.99:0/1456679080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f6015b3d0 msgr2=0x7f6f600c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f5de00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f6015b3d0 0x7f6f600c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f5de00640 1 -- 172.21.15.99:0/1456679080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f600aeed0 con 0x7f6f600b21b0 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f57e00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f600b49f0 0x7f6f600b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f5de00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f600b21b0 0x7f6f600afd30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6f50000c00 tx=0x7f6f500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f56000640 1 -- 172.21.15.99:0/1456679080 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50045020 con 0x7f6f600b21b0 2024-03-30T13:14:04.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f56000640 1 -- 172.21.15.99:0/1456679080 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f500346e0 con 0x7f6f600b21b0 2024-03-30T13:14:04.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.870+0000 7f6f56000640 1 -- 172.21.15.99:0/1456679080 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5003b040 con 0x7f6f600b21b0 2024-03-30T13:14:04.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.871+0000 7f6f64c00640 1 -- 172.21.15.99:0/1456679080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f600b08a0 con 0x7f6f600b21b0 2024-03-30T13:14:04.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.871+0000 7f6f64c00640 1 -- 172.21.15.99:0/1456679080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f600b0e60 con 0x7f6f600b21b0 2024-03-30T13:14:04.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.873+0000 7f6f56000640 1 -- 172.21.15.99:0/1456679080 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6f50048020 con 0x7f6f600b21b0 2024-03-30T13:14:04.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.873+0000 7f6f56000640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f3c06c530 0x7f6f3c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.874+0000 7f6f56000640 1 -- 172.21.15.99:0/1456679080 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f6f500aff40 con 0x7f6f600b21b0 2024-03-30T13:14:04.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.874+0000 7f6f57e00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f3c06c530 0x7f6f3c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.875+0000 7f6f57e00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f3c06c530 0x7f6f3c06e9f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f600d08a0 tx=0x7f6f48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.875+0000 7f6f67990740 1 Processor -- start 2024-03-30T13:14:04.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.875+0000 7f6f67990740 1 -- start start 2024-03-30T13:14:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f67990740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 0x5576fa757dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f67990740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa758300 0x5576fa7302d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f67990740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa730810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f67990740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5576fa694330 con 0x5576fa731670 2024-03-30T13:14:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f67990740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5576fa63c620 con 0x5576fa758300 2024-03-30T13:14:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f67990740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5576fa690440 con 0x5576fa731290 2024-03-30T13:14:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f5e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa730810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f5e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa730810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52186/0 (socket says 172.21.15.99:52186) 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f5e800640 1 -- 172.21.15.99:0/1340398106 learned_addr learned my addr 172.21.15.99:0/1340398106 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f5de00640 1 --2- 172.21.15.99:0/1340398106 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 0x5576fa757dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f57e00640 1 --2- 172.21.15.99:0/1340398106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa758300 0x5576fa7302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f5e800640 1 -- 172.21.15.99:0/1340398106 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 msgr2=0x5576fa757dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f5e800640 1 --2- 172.21.15.99:0/1340398106 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 0x5576fa757dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f5e800640 1 -- 172.21.15.99:0/1340398106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa758300 msgr2=0x5576fa7302d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.876+0000 7f6f5e800640 1 --2- 172.21.15.99:0/1340398106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa758300 0x5576fa7302d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.877+0000 7f6f5e800640 1 -- 172.21.15.99:0/1340398106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576fa474920 con 0x5576fa731670 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.877+0000 7f6f57e00640 1 --2- 172.21.15.99:0/1340398106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa758300 0x5576fa7302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.877+0000 7f6f5de00640 1 --2- 172.21.15.99:0/1340398106 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 0x5576fa757dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:04.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.877+0000 7f6f5e800640 1 --2- 172.21.15.99:0/1340398106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa730810 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007d60 tx=0x7f6f5800c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56cba1a64a964d42 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.877+0000 7f6f4e600640 1 -- 172.21.15.99:0/1340398106 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58015030 con 0x5576fa731670 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.877+0000 7f6f4e600640 1 -- 172.21.15.99:0/1340398106 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5800ce20 con 0x5576fa731670 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.877+0000 7f6f4e600640 1 -- 172.21.15.99:0/1340398106 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58003b90 con 0x5576fa731670 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.878+0000 7f6f67990740 1 -- 172.21.15.99:0/1340398106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 msgr2=0x5576fa730810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.878+0000 7f6f67990740 1 --2- 172.21.15.99:0/1340398106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa730810 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007d60 tx=0x7f6f5800c560 comp rx=0 tx=0).stop 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.878+0000 7f6f67990740 1 -- 172.21.15.99:0/1340398106 shutdown_connections 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.878+0000 7f6f67990740 1 --2- 172.21.15.99:0/1340398106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa730810 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.878+0000 7f6f67990740 1 --2- 172.21.15.99:0/1340398106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa758300 0x5576fa7302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.878+0000 7f6f67990740 1 --2- 172.21.15.99:0/1340398106 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 0x5576fa757dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.878+0000 7f6f67990740 1 -- 172.21.15.99:0/1340398106 >> 172.21.15.99:0/1340398106 conn(0x5576fa6f7be0 msgr2=0x5576fa775fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.878+0000 7f6f67990740 1 -- 172.21.15.99:0/1340398106 shutdown_connections 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.878+0000 7f6f67990740 1 -- 172.21.15.99:0/1340398106 wait complete. 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.879+0000 7f6f67990740 1 -- start start 2024-03-30T13:14:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.879+0000 7f6f67990740 1 Processor -- start 2024-03-30T13:14:04.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.880+0000 7f6f67990740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 0x5576fa7860b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.880+0000 7f6f67990740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731670 0x5576fa778540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.880+0000 7f6f67990740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa7731a0 0x5576fa778a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.880+0000 7f6f67990740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5576fa757930 con 0x5576fa7731a0 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.880+0000 7f6f67990740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5576fa64f9d0 con 0x5576fa731670 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.880+0000 7f6f67990740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5576fa7506b0 con 0x5576fa731290 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.880+0000 7f6f67990740 10 client.0 _ll_register_callbacks cb 0x5576fa68bfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.880+0000 7f6f5e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa7731a0 0x5576fa778a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.880+0000 7f6f5e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa7731a0 0x5576fa778a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52190/0 (socket says 172.21.15.99:52190) 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.880+0000 7f6f5e800640 1 -- 172.21.15.99:0/3193149990 learned_addr learned my addr 172.21.15.99:0/3193149990 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.880+0000 7f6f5de00640 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 0x5576fa7860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f5e800640 1 -- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 msgr2=0x5576fa7860b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f5e800640 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 0x5576fa7860b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f57e00640 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731670 0x5576fa778540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f5e800640 1 -- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731670 msgr2=0x5576fa778540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f5e800640 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731670 0x5576fa778540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f5e800640 1 -- 172.21.15.99:0/3193149990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576fa368210 con 0x5576fa7731a0 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f5de00640 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 0x5576fa7860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f5e800640 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa7731a0 0x5576fa778a80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800d010 tx=0x7f6f58004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3f9e696e77387 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f46a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f46a00640 1 -- 172.21.15.99:0/3193149990 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f580045f0 con 0x5576fa7731a0 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f46a00640 1 -- 172.21.15.99:0/3193149990 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f6f58004790 con 0x5576fa7731a0 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f67990740 1 -- 172.21.15.99:0/3193149990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f5800ce20 con 0x5576fa7731a0 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f46a00640 1 -- 172.21.15.99:0/3193149990 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6f5802c050 con 0x5576fa7731a0 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f67990740 10 client.6273 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.881+0000 7f6f67990740 1 -- 172.21.15.99:0/3193149990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5576fa4d50b0 con 0x5576fa7731a0 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.882+0000 7f6f46a00640 1 -- 172.21.15.99:0/3193149990 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5800ce20 con 0x5576fa7731a0 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.882+0000 7f6f46a00640 1 -- 172.21.15.99:0/3193149990 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f6f5802f020 con 0x5576fa7731a0 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.882+0000 7f6f67990740 10 client.6273 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.882+0000 7f6f67990740 10 client.6273 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.882+0000 7f6f67990740 20 client.6273 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.882+0000 7f6f67990740 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5576fa776620 0x5576fa7890f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.882+0000 7f6f67990740 4 client.6273 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.882+0000 7f6f67990740 1 -- 172.21.15.99:0/3193149990 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576fa6a1870 con 0x5576fa776620 2024-03-30T13:14:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.883+0000 7f6f5de00640 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5576fa776620 0x5576fa7890f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.883+0000 7f6f5de00640 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5576fa776620 0x5576fa7890f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=427589d25b819778 server_cookie=4e7c5e92d459e699 in_seq=0 out_seq=0 2024-03-30T13:14:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.883+0000 7f6f46a00640 10 client.6273 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.885+0000 7f6f46a00640 1 -- 172.21.15.99:0/3193149990 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5576fa6a1870 con 0x5576fa776620 2024-03-30T13:14:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.885+0000 7f6f46a00640 10 client.6273 handle_command_reply: tid=0 2024-03-30T13:14:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.885+0000 7f6f67990740 1 client.6273 shutdown 2024-03-30T13:14:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.885+0000 7f6f67990740 1 -- 172.21.15.99:0/3193149990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa7731a0 msgr2=0x5576fa778a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.885+0000 7f6f67990740 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa7731a0 0x5576fa778a80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800d010 tx=0x7f6f58004a00 comp rx=0 tx=0).stop 2024-03-30T13:14:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.886+0000 7f6f67990740 1 -- 172.21.15.99:0/3193149990 shutdown_connections 2024-03-30T13:14:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.886+0000 7f6f67990740 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa7731a0 0x5576fa778a80 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.886+0000 7f6f67990740 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5576fa776620 0x5576fa7890f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.886+0000 7f6f67990740 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731670 0x5576fa778540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.886+0000 7f6f67990740 1 --2- 172.21.15.99:0/3193149990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa731290 0x5576fa7860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.886+0000 7f6f46a00640 0 client.6273 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.886+0000 7f6f67990740 1 -- 172.21.15.99:0/3193149990 >> 172.21.15.99:0/3193149990 conn(0x5576fa6f7be0 msgr2=0x5576fa75afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.886+0000 7f6f67990740 1 -- 172.21.15.99:0/3193149990 shutdown_connections 2024-03-30T13:14:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.886+0000 7f6f67990740 1 -- 172.21.15.99:0/3193149990 wait complete. 2024-03-30T13:14:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.886+0000 7f6f67990740 20 client.6273 trim_cache size 0 max 16384 2024-03-30T13:14:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.902+0000 7f6f67990740 1 Processor -- start 2024-03-30T13:14:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.902+0000 7f6f67990740 1 -- start start 2024-03-30T13:14:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.902+0000 7f6f67990740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731290 0x5576fa7ec040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.902+0000 7f6f67990740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731670 0x5576fa78f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.902+0000 7f6f67990740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa7731a0 0x5576fa75ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.902+0000 7f6f67990740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5576fa732470 con 0x5576fa731290 2024-03-30T13:14:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.902+0000 7f6f67990740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f601fcca0 con 0x5576fa731670 2024-03-30T13:14:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.902+0000 7f6f67990740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f601fbeb0 con 0x5576fa7731a0 2024-03-30T13:14:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.903+0000 7f6f5de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731290 0x5576fa7ec040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.903+0000 7f6f5de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731290 0x5576fa7ec040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52192/0 (socket says 172.21.15.99:52192) 2024-03-30T13:14:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.903+0000 7f6f5de00640 1 -- 172.21.15.99:0/4270477055 learned_addr learned my addr 172.21.15.99:0/4270477055 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.903+0000 7f6f5de00640 1 -- 172.21.15.99:0/4270477055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa7731a0 msgr2=0x5576fa75ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.903+0000 7f6f5de00640 1 --2- 172.21.15.99:0/4270477055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa7731a0 0x5576fa75ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.903+0000 7f6f5de00640 1 -- 172.21.15.99:0/4270477055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731670 msgr2=0x5576fa78f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.903+0000 7f6f5de00640 1 --2- 172.21.15.99:0/4270477055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731670 0x5576fa78f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.903+0000 7f6f5de00640 1 -- 172.21.15.99:0/4270477055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576fa3412d0 con 0x5576fa731290 2024-03-30T13:14:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.903+0000 7f6f5de00640 1 --2- 172.21.15.99:0/4270477055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731290 0x5576fa7ec040 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6f5007dd30 tx=0x7f6f5004c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb77adb70eaa4b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f4dc00640 1 -- 172.21.15.99:0/4270477055 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50086980 con 0x5576fa731290 2024-03-30T13:14:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f4dc00640 1 -- 172.21.15.99:0/4270477055 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5007be40 con 0x5576fa731290 2024-03-30T13:14:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f4dc00640 1 -- 172.21.15.99:0/4270477055 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5007a410 con 0x5576fa731290 2024-03-30T13:14:04.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f67990740 1 -- 172.21.15.99:0/4270477055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731290 msgr2=0x5576fa7ec040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f67990740 1 --2- 172.21.15.99:0/4270477055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731290 0x5576fa7ec040 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6f5007dd30 tx=0x7f6f5004c040 comp rx=0 tx=0).stop 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f67990740 1 -- 172.21.15.99:0/4270477055 shutdown_connections 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f67990740 1 --2- 172.21.15.99:0/4270477055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa7731a0 0x5576fa75ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f67990740 1 --2- 172.21.15.99:0/4270477055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731670 0x5576fa78f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f67990740 1 --2- 172.21.15.99:0/4270477055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731290 0x5576fa7ec040 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f67990740 1 -- 172.21.15.99:0/4270477055 >> 172.21.15.99:0/4270477055 conn(0x5576fa6f7be0 msgr2=0x5576fa756b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f67990740 1 -- 172.21.15.99:0/4270477055 shutdown_connections 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.904+0000 7f6f67990740 1 -- 172.21.15.99:0/4270477055 wait complete. 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.905+0000 7f6f67990740 1 -- start start 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.905+0000 7f6f67990740 1 Processor -- start 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.906+0000 7f6f67990740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731290 0x5576fa72a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.906+0000 7f6f67990740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa75e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.906+0000 7f6f67990740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa7731a0 0x5576fa771660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.906+0000 7f6f67990740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6009c1b0 con 0x5576fa731670 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.906+0000 7f6f67990740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6009bb60 con 0x5576fa731290 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.906+0000 7f6f67990740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x5576fa7722e0 con 0x5576fa7731a0 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.906+0000 7f6f67990740 10 client.0 _ll_register_callbacks cb 0x7f6f58007bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.906+0000 7f6f57e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa75e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.906+0000 7f6f57e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa75e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52200/0 (socket says 172.21.15.99:52200) 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.906+0000 7f6f57e00640 1 -- 172.21.15.99:0/3775519109 learned_addr learned my addr 172.21.15.99:0/3775519109 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f5de00640 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731290 0x5576fa72a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f5e800640 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa7731a0 0x5576fa771660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f57e00640 1 -- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa7731a0 msgr2=0x5576fa771660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f57e00640 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa7731a0 0x5576fa771660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f57e00640 1 -- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731290 msgr2=0x5576fa72a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f57e00640 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731290 0x5576fa72a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f57e00640 1 -- 172.21.15.99:0/3775519109 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576fa75e710 con 0x5576fa731670 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f57e00640 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa75e1d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6f48006fd0 tx=0x7f6f480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa47d0edf900fb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f46a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f46a00640 1 -- 172.21.15.99:0/3775519109 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48027060 con 0x5576fa731670 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f46a00640 1 -- 172.21.15.99:0/3775519109 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f6f48022470 con 0x5576fa731670 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.907+0000 7f6f67990740 1 -- 172.21.15.99:0/3775519109 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f5007be40 con 0x5576fa731670 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.908+0000 7f6f46a00640 1 -- 172.21.15.99:0/3775519109 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6f4800f040 con 0x5576fa731670 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.908+0000 7f6f67990740 10 client.6279 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.908+0000 7f6f67990740 1 -- 172.21.15.99:0/3775519109 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5576fa7eb630 con 0x5576fa731670 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.908+0000 7f6f46a00640 1 -- 172.21.15.99:0/3775519109 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5007be40 con 0x5576fa731670 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.908+0000 7f6f46a00640 1 -- 172.21.15.99:0/3775519109 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f6f48030020 con 0x5576fa731670 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.908+0000 7f6f67990740 10 client.6279 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.908+0000 7f6f67990740 10 client.6279 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.908+0000 7f6f67990740 20 client.6279 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:04.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.908+0000 7f6f67990740 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5576fa771ba0 0x5576fa76b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:04.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.908+0000 7f6f67990740 4 client.6279 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628407}] 2024-03-30T13:14:04.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.908+0000 7f6f67990740 1 -- 172.21.15.99:0/3775519109 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628407}) -- 0x5576fa757ad0 con 0x5576fa771ba0 2024-03-30T13:14:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.909+0000 7f6f5de00640 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5576fa771ba0 0x5576fa76b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.910+0000 7f6f5de00640 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5576fa771ba0 0x5576fa76b940 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32723ac309177c69 server_cookie=5000b0967a9167aa in_seq=0 out_seq=0 2024-03-30T13:14:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.910+0000 7f6f46a00640 10 client.6279 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.910+0000 7f6f46a00640 1 -- 172.21.15.99:0/3775519109 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4757 (crc 0 0 0) 0x5576fa757ad0 con 0x5576fa771ba0 2024-03-30T13:14:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.910+0000 7f6f46a00640 10 client.6279 handle_command_reply: tid=0 2024-03-30T13:14:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.910+0000 7f6f67990740 1 client.6279 shutdown 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f67990740 1 -- 172.21.15.99:0/3775519109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 msgr2=0x5576fa75e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f67990740 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa75e1d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6f48006fd0 tx=0x7f6f480046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f67990740 1 -- 172.21.15.99:0/3775519109 shutdown_connections 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f67990740 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5576fa7731a0 0x5576fa771660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f67990740 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576fa731670 0x5576fa75e1d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f67990740 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x5576fa771ba0 0x5576fa76b940 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f67990740 1 --2- 172.21.15.99:0/3775519109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576fa731290 0x5576fa72a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f67990740 1 -- 172.21.15.99:0/3775519109 >> 172.21.15.99:0/3775519109 conn(0x5576fa6f7be0 msgr2=0x5576fa777450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f46a00640 0 client.6279 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f67990740 1 -- 172.21.15.99:0/3775519109 shutdown_connections 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f67990740 1 -- 172.21.15.99:0/3775519109 wait complete. 2024-03-30T13:14:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.911+0000 7f6f67990740 20 client.6279 trim_cache size 0 max 16384 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/Makefile", 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628407, 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.652270+0000", 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.833871+0000", 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 356, 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.833871+0000", 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 356, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.652270+0000" 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 356, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.652270+0000" 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.923 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 262, 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 4, 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:04.924 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:04.925 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:04.926 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.927 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.929 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:04.930 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:04.931 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:04.932 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:04.933 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:04.933 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:04.933 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:04.933 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:04.933 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:04.933 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:04.933 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:04.933 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:04.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 -- 172.21.15.99:0/1456679080 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f3c06c530 msgr2=0x7f6f3c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f3c06c530 0x7f6f3c06e9f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f600d08a0 tx=0x7f6f48008040 comp rx=0 tx=0).stop 2024-03-30T13:14:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 -- 172.21.15.99:0/1456679080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f600b21b0 msgr2=0x7f6f600afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f600b21b0 0x7f6f600afd30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6f50000c00 tx=0x7f6f500046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 -- 172.21.15.99:0/1456679080 shutdown_connections 2024-03-30T13:14:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6f3c06c530 0x7f6f3c06e9f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f6015b3d0 0x7f6f600c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f600b49f0 0x7f6f600b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 --2- 172.21.15.99:0/1456679080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f600b21b0 0x7f6f600afd30 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 -- 172.21.15.99:0/1456679080 >> 172.21.15.99:0/1456679080 conn(0x7f6f600d0450 msgr2=0x7f6f600af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 -- 172.21.15.99:0/1456679080 shutdown_connections 2024-03-30T13:14:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:04.912+0000 7f6f64c00640 1 -- 172.21.15.99:0/1456679080 wait complete. 2024-03-30T13:14:04.936 DEBUG:tasks.cephfs.test_uninlining:getting inode info #22 of 23:1099511628430 2024-03-30T13:14:04.936 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628430 2024-03-30T13:14:04.936 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628430 2024-03-30T13:14:05.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.130+0000 7f57d5600640 1 Processor -- start 2024-03-30T13:14:05.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.130+0000 7f57d5600640 1 -- start start 2024-03-30T13:14:05.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.131+0000 7f57d5600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d015b3d0 0x7f57d00ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.131+0000 7f57d5600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f57d00b49f0 0x7f57d00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.131+0000 7f57d5600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d00c6470 con 0x7f57d00b21b0 2024-03-30T13:14:05.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.131+0000 7f57d5600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f57d00c6240 con 0x7f57d00b49f0 2024-03-30T13:14:05.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.131+0000 7f57d5600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f57d00c7080 con 0x7f57d015b3d0 2024-03-30T13:14:05.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.132+0000 7f57cf400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f57d00b21b0 0x7f57d015be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55930/0 (socket says 172.21.15.99:55930) 2024-03-30T13:14:05.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.132+0000 7f57cf400640 1 -- 172.21.15.99:0/2488640032 learned_addr learned my addr 172.21.15.99:0/2488640032 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:05.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.132+0000 7f57cea00640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d015b3d0 0x7f57d00ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.132+0000 7f57c6000640 1 --2- 172.21.15.99:0/2488640032 >> v2:172.21.15.181:3300/0 conn(0x7f57d00b49f0 0x7f57d00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.132+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1685067440 0 0) 0x7f57d00c6470 con 0x7f57d00b21b0 2024-03-30T13:14:05.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.132+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57b4003520 con 0x7f57d00b21b0 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 993467724 0 0) 0x7f57b4003520 con 0x7f57d00b21b0 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d015b3d0 msgr2=0x7f57d00ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d015b3d0 0x7f57d00ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 >> v2:172.21.15.181:3300/0 conn(0x7f57d00b49f0 msgr2=0x7f57d00b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 --2- 172.21.15.99:0/2488640032 >> v2:172.21.15.181:3300/0 conn(0x7f57d00b49f0 0x7f57d00b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d00c6750 con 0x7f57d00b21b0 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f57c80019f0 con 0x7f57d00b21b0 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 >> v1:172.21.15.99:6789/0 conn(0x7f57d00b21b0 legacy=0x7f57d015be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 0x7f57b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57b4004800 0x7f57b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d015b3d0 0x7f57b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f57d00c7080 con 0x7f57b40039b0 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f57b400dbd0 con 0x7f57b4004800 2024-03-30T13:14:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f57b400dd50 con 0x7f57d015b3d0 2024-03-30T13:14:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57cea00640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 0x7f57b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57c6000640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57b4004800 0x7f57b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.133+0000 7f57cea00640 1 -- 172.21.15.99:0/2488640032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d015b3d0 msgr2=0x7f57b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.134+0000 7f57cea00640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d015b3d0 0x7f57b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.134+0000 7f57cea00640 1 -- 172.21.15.99:0/2488640032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57b4004800 msgr2=0x7f57b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.134+0000 7f57cea00640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57b4004800 0x7f57b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.134+0000 7f57cea00640 1 -- 172.21.15.99:0/2488640032 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b4003520 con 0x7f57b40039b0 2024-03-30T13:14:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.134+0000 7f57c6000640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57b4004800 0x7f57b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:05.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.135+0000 7f57cea00640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 0x7f57b4003dd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009ac0 tx=0x7f57b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a32bfe0aae0a4b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.135+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0039070 con 0x7f57b40039b0 2024-03-30T13:14:05.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.135+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c002c6d0 con 0x7f57b40039b0 2024-03-30T13:14:05.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.135+0000 7f57ce000640 1 -- 172.21.15.99:0/2488640032 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0009690 con 0x7f57b40039b0 2024-03-30T13:14:05.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.135+0000 7f57d5600640 1 -- 172.21.15.99:0/2488640032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 msgr2=0x7f57b4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.135+0000 7f57d5600640 1 --2- 172.21.15.99:0/2488640032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 0x7f57b4003dd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009ac0 tx=0x7f57b4005830 comp rx=0 tx=0).stop 2024-03-30T13:14:05.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.135+0000 7f57cf400640 1 -- 172.21.15.99:0/2488640032 reap_dead start 2024-03-30T13:14:05.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.136+0000 7f57d5600640 1 -- 172.21.15.99:0/2488640032 shutdown_connections 2024-03-30T13:14:05.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.136+0000 7f57d5600640 1 -- 172.21.15.99:0/2488640032 >> 172.21.15.99:0/2488640032 conn(0x7f57d00d0450 msgr2=0x7f57d00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.136+0000 7f57d5600640 1 -- 172.21.15.99:0/2488640032 shutdown_connections 2024-03-30T13:14:05.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.136+0000 7f57d5600640 1 -- 172.21.15.99:0/2488640032 wait complete. 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.137+0000 7f57d5600640 1 Processor -- start 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.137+0000 7f57d5600640 1 -- start start 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.138+0000 7f57d5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 0x7f57d0157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.138+0000 7f57d5600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57d0152d70 0x7f57d0072850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.138+0000 7f57d5600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d0072d90 0x7f57d00717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.138+0000 7f57d5600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f57d015b7b0 con 0x7f57b40039b0 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.138+0000 7f57d5600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f57d00c6d10 con 0x7f57d0152d70 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.138+0000 7f57d5600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f57d015b930 con 0x7f57d0072d90 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57cea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 0x7f57d0157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57cea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 0x7f57d0157aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52216/0 (socket says 172.21.15.99:52216) 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57cea00640 1 -- 172.21.15.99:0/3496840603 learned_addr learned my addr 172.21.15.99:0/3496840603 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57cf400640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d0072d90 0x7f57d00717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57cea00640 1 -- 172.21.15.99:0/3496840603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d0072d90 msgr2=0x7f57d00717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57cea00640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d0072d90 0x7f57d00717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57c6000640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57d0152d70 0x7f57d0072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57cea00640 1 -- 172.21.15.99:0/3496840603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57d0152d70 msgr2=0x7f57d0072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57cea00640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57d0152d70 0x7f57d0072850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57cea00640 1 -- 172.21.15.99:0/3496840603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d015dce0 con 0x7f57b40039b0 2024-03-30T13:14:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57cf400640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d0072d90 0x7f57d00717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.139+0000 7f57cea00640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 0x7f57d0157aa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f57c0037040 tx=0x7f57c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.140+0000 7f57c7400640 1 -- 172.21.15.99:0/3496840603 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0042020 con 0x7f57b40039b0 2024-03-30T13:14:05.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.140+0000 7f57c7400640 1 -- 172.21.15.99:0/3496840603 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c003a040 con 0x7f57b40039b0 2024-03-30T13:14:05.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.140+0000 7f57c7400640 1 -- 172.21.15.99:0/3496840603 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0039070 con 0x7f57b40039b0 2024-03-30T13:14:05.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.140+0000 7f57d5600640 1 -- 172.21.15.99:0/3496840603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d015cc40 con 0x7f57b40039b0 2024-03-30T13:14:05.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.140+0000 7f57d5600640 1 -- 172.21.15.99:0/3496840603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d015d200 con 0x7f57b40039b0 2024-03-30T13:14:05.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.143+0000 7f57c7400640 1 -- 172.21.15.99:0/3496840603 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f57c0045020 con 0x7f57b40039b0 2024-03-30T13:14:05.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.144+0000 7f57c7400640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f57ac06c530 0x7f57ac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.144+0000 7f57c7400640 1 -- 172.21.15.99:0/3496840603 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f57c00acca0 con 0x7f57b40039b0 2024-03-30T13:14:05.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.144+0000 7f57c6000640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f57ac06c530 0x7f57ac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.144+0000 7f57d8276740 1 Processor -- start 2024-03-30T13:14:05.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.144+0000 7f57d8276740 1 -- start start 2024-03-30T13:14:05.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.145+0000 7f57c6000640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f57ac06c530 0x7f57ac06e9f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f57d0073c60 tx=0x7f57b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.145+0000 7f57d8276740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25290 0x55ad97e4bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.145+0000 7f57d8276740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e4c300 0x55ad97e242d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.145+0000 7f57d8276740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25670 0x55ad97e24810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.145+0000 7f57d8276740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55ad97d88330 con 0x55ad97e25290 2024-03-30T13:14:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.145+0000 7f57d8276740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ad97d30620 con 0x55ad97e4c300 2024-03-30T13:14:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.145+0000 7f57d8276740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ad97d84440 con 0x55ad97e25670 2024-03-30T13:14:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57cea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25290 0x55ad97e4bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57cea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25290 0x55ad97e4bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52222/0 (socket says 172.21.15.99:52222) 2024-03-30T13:14:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57cea00640 1 -- 172.21.15.99:0/4278764359 learned_addr learned my addr 172.21.15.99:0/4278764359 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57cea00640 1 -- 172.21.15.99:0/4278764359 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25670 msgr2=0x55ad97e24810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57cea00640 1 --2- 172.21.15.99:0/4278764359 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25670 0x55ad97e24810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57cea00640 1 -- 172.21.15.99:0/4278764359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e4c300 msgr2=0x55ad97e242d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57cea00640 1 --2- 172.21.15.99:0/4278764359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e4c300 0x55ad97e242d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57cea00640 1 -- 172.21.15.99:0/4278764359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad97b68920 con 0x55ad97e25290 2024-03-30T13:14:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57cea00640 1 --2- 172.21.15.99:0/4278764359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25290 0x55ad97e4bdc0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f57c00091d0 tx=0x7f57c0009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0eb0f50ccff5fb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57bf000640 1 -- 172.21.15.99:0/4278764359 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c007aa60 con 0x55ad97e25290 2024-03-30T13:14:05.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57bf000640 1 -- 172.21.15.99:0/4278764359 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c007ee10 con 0x55ad97e25290 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.146+0000 7f57bf000640 1 -- 172.21.15.99:0/4278764359 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0083640 con 0x55ad97e25290 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.147+0000 7f57d8276740 1 -- 172.21.15.99:0/4278764359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25290 msgr2=0x55ad97e4bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.147+0000 7f57d8276740 1 --2- 172.21.15.99:0/4278764359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25290 0x55ad97e4bdc0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f57c00091d0 tx=0x7f57c0009830 comp rx=0 tx=0).stop 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.147+0000 7f57d8276740 1 -- 172.21.15.99:0/4278764359 shutdown_connections 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.147+0000 7f57d8276740 1 --2- 172.21.15.99:0/4278764359 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25670 0x55ad97e24810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.147+0000 7f57d8276740 1 --2- 172.21.15.99:0/4278764359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e4c300 0x55ad97e242d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.147+0000 7f57d8276740 1 --2- 172.21.15.99:0/4278764359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25290 0x55ad97e4bdc0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.147+0000 7f57d8276740 1 -- 172.21.15.99:0/4278764359 >> 172.21.15.99:0/4278764359 conn(0x55ad97debbe0 msgr2=0x55ad97e69fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.147+0000 7f57d8276740 1 -- 172.21.15.99:0/4278764359 shutdown_connections 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.147+0000 7f57d8276740 1 -- 172.21.15.99:0/4278764359 wait complete. 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.148+0000 7f57d8276740 1 -- start start 2024-03-30T13:14:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.148+0000 7f57d8276740 1 Processor -- start 2024-03-30T13:14:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.149+0000 7f57d8276740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25290 0x55ad97e60d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.149+0000 7f57d8276740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25670 0x55ad97e52bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.149+0000 7f57d8276740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e4a050 0x55ad97e7d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.149+0000 7f57d8276740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55ad97d84440 con 0x55ad97e25670 2024-03-30T13:14:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.149+0000 7f57d8276740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ad97d439d0 con 0x55ad97e4a050 2024-03-30T13:14:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.149+0000 7f57d8276740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ad97d88330 con 0x55ad97e25290 2024-03-30T13:14:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.149+0000 7f57d8276740 10 client.0 _ll_register_callbacks cb 0x55ad97d7ffd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.149+0000 7f57c6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25670 0x55ad97e52bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.149+0000 7f57c6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25670 0x55ad97e52bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52230/0 (socket says 172.21.15.99:52230) 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.149+0000 7f57c6000640 1 -- 172.21.15.99:0/121114928 learned_addr learned my addr 172.21.15.99:0/121114928 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57c6000640 1 -- 172.21.15.99:0/121114928 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25290 msgr2=0x55ad97e60d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57c6000640 1 --2- 172.21.15.99:0/121114928 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25290 0x55ad97e60d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57c6000640 1 -- 172.21.15.99:0/121114928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e4a050 msgr2=0x55ad97e7d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57c6000640 1 --2- 172.21.15.99:0/121114928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e4a050 0x55ad97e7d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57c6000640 1 -- 172.21.15.99:0/121114928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad97a5c210 con 0x55ad97e25670 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57c6000640 1 --2- 172.21.15.99:0/121114928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25670 0x55ad97e52bc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f57b8011b90 tx=0x7f57b8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6519a83d5aaee0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57b3400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57b3400640 1 -- 172.21.15.99:0/121114928 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b801c070 con 0x55ad97e25670 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57b3400640 1 -- 172.21.15.99:0/121114928 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f57b8015480 con 0x55ad97e25670 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57d8276740 1 -- 172.21.15.99:0/121114928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57c007ee10 con 0x55ad97e25670 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57b3400640 1 -- 172.21.15.99:0/121114928 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f57b8011e90 con 0x55ad97e25670 2024-03-30T13:14:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57d8276740 10 client.6291 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.150+0000 7f57d8276740 1 -- 172.21.15.99:0/121114928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55ad97bc90b0 con 0x55ad97e25670 2024-03-30T13:14:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.151+0000 7f57b3400640 1 -- 172.21.15.99:0/121114928 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c007ee10 con 0x55ad97e25670 2024-03-30T13:14:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.151+0000 7f57b3400640 1 -- 172.21.15.99:0/121114928 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f57b8015680 con 0x55ad97e25670 2024-03-30T13:14:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.151+0000 7f57d8276740 10 client.6291 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.151+0000 7f57d8276740 10 client.6291 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.151+0000 7f57d8276740 20 client.6291 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.151+0000 7f57d8276740 1 --2- 172.21.15.99:0/121114928 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad97e661f0 0x55ad97e79480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.151+0000 7f57d8276740 4 client.6291 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.151+0000 7f57d8276740 1 -- 172.21.15.99:0/121114928 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad97d95870 con 0x55ad97e661f0 2024-03-30T13:14:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.152+0000 7f57cea00640 1 --2- 172.21.15.99:0/121114928 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad97e661f0 0x55ad97e79480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.152+0000 7f57cea00640 1 --2- 172.21.15.99:0/121114928 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad97e661f0 0x55ad97e79480 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cd5e81c4b9c0cf8 server_cookie=f0b2f8b529044c5a in_seq=0 out_seq=0 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.152+0000 7f57b3400640 10 client.6291 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57b3400640 1 -- 172.21.15.99:0/121114928 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55ad97d95870 con 0x55ad97e661f0 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57b3400640 10 client.6291 handle_command_reply: tid=0 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57d8276740 1 client.6291 shutdown 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57d8276740 1 -- 172.21.15.99:0/121114928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25670 msgr2=0x55ad97e52bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57d8276740 1 --2- 172.21.15.99:0/121114928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25670 0x55ad97e52bc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f57b8011b90 tx=0x7f57b8009190 comp rx=0 tx=0).stop 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57d8276740 1 -- 172.21.15.99:0/121114928 shutdown_connections 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57d8276740 1 --2- 172.21.15.99:0/121114928 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad97e661f0 0x55ad97e79480 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57d8276740 1 --2- 172.21.15.99:0/121114928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e4a050 0x55ad97e7d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57d8276740 1 --2- 172.21.15.99:0/121114928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e25670 0x55ad97e52bc0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57b3400640 0 client.6291 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57d8276740 1 --2- 172.21.15.99:0/121114928 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25290 0x55ad97e60d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.154+0000 7f57d8276740 1 -- 172.21.15.99:0/121114928 >> 172.21.15.99:0/121114928 conn(0x55ad97debbe0 msgr2=0x55ad97e4af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.155+0000 7f57d8276740 1 -- 172.21.15.99:0/121114928 shutdown_connections 2024-03-30T13:14:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.155+0000 7f57d8276740 1 -- 172.21.15.99:0/121114928 wait complete. 2024-03-30T13:14:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.155+0000 7f57d8276740 20 client.6291 trim_cache size 0 max 16384 2024-03-30T13:14:05.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.170+0000 7f57d8276740 1 Processor -- start 2024-03-30T13:14:05.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.170+0000 7f57d8276740 1 -- start start 2024-03-30T13:14:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.171+0000 7f57d8276740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25290 0x55ad97e49510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.171+0000 7f57d8276740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e25670 0x55ad97e6d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.171+0000 7f57d8276740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e6de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.171+0000 7f57d8276740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f57d01fd330 con 0x55ad97e4a050 2024-03-30T13:14:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.171+0000 7f57d8276740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f57d01fc310 con 0x55ad97e25670 2024-03-30T13:14:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.171+0000 7f57d8276740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f57d00b0d80 con 0x55ad97e25290 2024-03-30T13:14:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.171+0000 7f57cf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e6de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.171+0000 7f57cf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e6de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52244/0 (socket says 172.21.15.99:52244) 2024-03-30T13:14:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.171+0000 7f57cf400640 1 -- 172.21.15.99:0/50116735 learned_addr learned my addr 172.21.15.99:0/50116735 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.172+0000 7f57c6000640 1 --2- 172.21.15.99:0/50116735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e25670 0x55ad97e6d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.172+0000 7f57cf400640 1 -- 172.21.15.99:0/50116735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25290 msgr2=0x55ad97e49510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.172+0000 7f57cf400640 1 --2- 172.21.15.99:0/50116735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25290 0x55ad97e49510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.172+0000 7f57cf400640 1 -- 172.21.15.99:0/50116735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e25670 msgr2=0x55ad97e6d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.172+0000 7f57cf400640 1 --2- 172.21.15.99:0/50116735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e25670 0x55ad97e6d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.172+0000 7f57cf400640 1 -- 172.21.15.99:0/50116735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad97a352d0 con 0x55ad97e4a050 2024-03-30T13:14:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.172+0000 7f57c6000640 1 --2- 172.21.15.99:0/50116735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e25670 0x55ad97e6d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.172+0000 7f57cf400640 1 --2- 172.21.15.99:0/50116735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e6de30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f57d00b2ee0 tx=0x7f57c800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57636cd2a36ece3b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.172+0000 7f57be600640 1 -- 172.21.15.99:0/50116735 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8002080 con 0x55ad97e4a050 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.172+0000 7f57be600640 1 -- 172.21.15.99:0/50116735 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c800db80 con 0x55ad97e4a050 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.172+0000 7f57be600640 1 -- 172.21.15.99:0/50116735 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8007110 con 0x55ad97e4a050 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.173+0000 7f57d8276740 1 -- 172.21.15.99:0/50116735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 msgr2=0x55ad97e6de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.173+0000 7f57d8276740 1 --2- 172.21.15.99:0/50116735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e6de30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f57d00b2ee0 tx=0x7f57c800d520 comp rx=0 tx=0).stop 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.173+0000 7f57d8276740 1 -- 172.21.15.99:0/50116735 shutdown_connections 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.173+0000 7f57d8276740 1 --2- 172.21.15.99:0/50116735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e6de30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.173+0000 7f57d8276740 1 --2- 172.21.15.99:0/50116735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e25670 0x55ad97e6d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.173+0000 7f57d8276740 1 --2- 172.21.15.99:0/50116735 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25290 0x55ad97e49510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.173+0000 7f57d8276740 1 -- 172.21.15.99:0/50116735 >> 172.21.15.99:0/50116735 conn(0x55ad97debbe0 msgr2=0x55ad97e62950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.173+0000 7f57d8276740 1 -- 172.21.15.99:0/50116735 shutdown_connections 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.173+0000 7f57d8276740 1 -- 172.21.15.99:0/50116735 wait complete. 2024-03-30T13:14:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.174+0000 7f57d8276740 1 -- start start 2024-03-30T13:14:05.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.174+0000 7f57d8276740 1 Processor -- start 2024-03-30T13:14:05.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.175+0000 7f57d8276740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e25290 0x55ad97edf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.175+0000 7f57d8276740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25670 0x55ad97ee56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.175+0000 7f57d8276740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e51620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.175+0000 7f57d8276740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55ad97d30620 con 0x55ad97e4a050 2024-03-30T13:14:05.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.175+0000 7f57d8276740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f57d01fbc60 con 0x55ad97e25290 2024-03-30T13:14:05.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.175+0000 7f57d8276740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55ad97e4b800 con 0x55ad97e25670 2024-03-30T13:14:05.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.175+0000 7f57d8276740 10 client.0 _ll_register_callbacks cb 0x7f57b8006c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:05.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.175+0000 7f57cf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e51620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.175+0000 7f57cf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e51620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52258/0 (socket says 172.21.15.99:52258) 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.175+0000 7f57cf400640 1 -- 172.21.15.99:0/399061420 learned_addr learned my addr 172.21.15.99:0/399061420 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57cea00640 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e25290 0x55ad97edf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57c6000640 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25670 0x55ad97ee56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57cf400640 1 -- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25670 msgr2=0x55ad97ee56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57cf400640 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25670 0x55ad97ee56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57cf400640 1 -- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e25290 msgr2=0x55ad97edf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57cf400640 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e25290 0x55ad97edf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57cf400640 1 -- 172.21.15.99:0/399061420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad97e49aa0 con 0x55ad97e4a050 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57cf400640 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e51620 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f57c8007fd0 tx=0x7f57c80017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7ad63c97238380 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57b3400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57b3400640 1 -- 172.21.15.99:0/399061420 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8025060 con 0x55ad97e4a050 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57b3400640 1 -- 172.21.15.99:0/399061420 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f57c8020650 con 0x55ad97e4a050 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57d8276740 1 -- 172.21.15.99:0/399061420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57c800db80 con 0x55ad97e4a050 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57b3400640 1 -- 172.21.15.99:0/399061420 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f57c802b050 con 0x55ad97e4a050 2024-03-30T13:14:05.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.176+0000 7f57d8276740 10 client.6297 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:05.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.177+0000 7f57d8276740 1 -- 172.21.15.99:0/399061420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55ad97e8d320 con 0x55ad97e4a050 2024-03-30T13:14:05.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.177+0000 7f57b3400640 1 -- 172.21.15.99:0/399061420 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c800db80 con 0x55ad97e4a050 2024-03-30T13:14:05.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.177+0000 7f57b3400640 1 -- 172.21.15.99:0/399061420 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f57c802e020 con 0x55ad97e4a050 2024-03-30T13:14:05.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.177+0000 7f57d8276740 10 client.6297 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:05.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.177+0000 7f57d8276740 10 client.6297 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:05.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.177+0000 7f57d8276740 20 client.6297 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:05.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.177+0000 7f57d8276740 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad97e51b60 0x55ad97e4ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.177+0000 7f57d8276740 4 client.6297 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628430}] 2024-03-30T13:14:05.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.177+0000 7f57d8276740 1 -- 172.21.15.99:0/399061420 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628430}) -- 0x55ad97e66ab0 con 0x55ad97e51b60 2024-03-30T13:14:05.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.178+0000 7f57cea00640 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad97e51b60 0x55ad97e4ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.179+0000 7f57b3400640 10 client.6297 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:05.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.179+0000 7f57cea00640 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad97e51b60 0x55ad97e4ef90 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=732835dedd326dd4 server_cookie=7a0343887082245b in_seq=0 out_seq=0 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.179+0000 7f57b3400640 1 -- 172.21.15.99:0/399061420 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4759 (crc 0 0 0) 0x55ad97e66ab0 con 0x55ad97e51b60 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.179+0000 7f57b3400640 10 client.6297 handle_command_reply: tid=0 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 1 client.6297 shutdown 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 1 -- 172.21.15.99:0/399061420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 msgr2=0x55ad97e51620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e51620 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f57c8007fd0 tx=0x7f57c80017b0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 1 -- 172.21.15.99:0/399061420 shutdown_connections 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ad97e4a050 0x55ad97e51620 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55ad97e25670 0x55ad97ee56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55ad97e51b60 0x55ad97e4ef90 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 1 --2- 172.21.15.99:0/399061420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ad97e25290 0x55ad97edf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 1 -- 172.21.15.99:0/399061420 >> 172.21.15.99:0/399061420 conn(0x55ad97debbe0 msgr2=0x55ad97e628e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57b3400640 0 client.6297 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 1 -- 172.21.15.99:0/399061420 shutdown_connections 2024-03-30T13:14:05.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 1 -- 172.21.15.99:0/399061420 wait complete. 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.180+0000 7f57d8276740 20 client.6297 trim_cache size 0 max 16384 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/symlink.c", 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628430, 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.655514+0000", 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.897869+0000", 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:05.187 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:05.188 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 497, 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.897869+0000", 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.190 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 497, 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.655514+0000" 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 497, 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.655514+0000" 2024-03-30T13:14:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 264, 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 50, 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:05.201 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:05.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 -- 172.21.15.99:0/3496840603 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f57ac06c530 msgr2=0x7f57ac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f57ac06c530 0x7f57ac06e9f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f57d0073c60 tx=0x7f57b8008040 comp rx=0 tx=0).stop 2024-03-30T13:14:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 -- 172.21.15.99:0/3496840603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 msgr2=0x7f57d0157aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 0x7f57d0157aa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f57c0037040 tx=0x7f57c0004730 comp rx=0 tx=0).stop 2024-03-30T13:14:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 -- 172.21.15.99:0/3496840603 shutdown_connections 2024-03-30T13:14:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f57ac06c530 0x7f57ac06e9f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f57d0072d90 0x7f57d00717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57d0152d70 0x7f57d0072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 --2- 172.21.15.99:0/3496840603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57b40039b0 0x7f57d0157aa0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 -- 172.21.15.99:0/3496840603 >> 172.21.15.99:0/3496840603 conn(0x7f57d00d0450 msgr2=0x7f57d00cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 -- 172.21.15.99:0/3496840603 shutdown_connections 2024-03-30T13:14:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.181+0000 7f57d5600640 1 -- 172.21.15.99:0/3496840603 wait complete. 2024-03-30T13:14:05.205 DEBUG:tasks.cephfs.test_uninlining:getting inode info #23 of 23:1099511628412 2024-03-30T13:14:05.205 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628412 2024-03-30T13:14:05.206 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628412 2024-03-30T13:14:05.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.403+0000 7f22c5200640 1 Processor -- start 2024-03-30T13:14:05.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.403+0000 7f22c5200640 1 -- start start 2024-03-30T13:14:05.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.405+0000 7f22c5200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22c00b4e40 0x7f22c00c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.405+0000 7f22c5200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f22c00b2810 0x7f22c00cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.405+0000 7f22c5200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22c01604d0 con 0x7f22c00b31c0 2024-03-30T13:14:05.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.405+0000 7f22c5200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f22c00c6d60 con 0x7f22c00b2810 2024-03-30T13:14:05.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.405+0000 7f22c5200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f22c00cba20 con 0x7f22c00b4e40 2024-03-30T13:14:05.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.405+0000 7f22be800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f22c00b2810 0x7f22c00cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.405+0000 7f22be800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f22c00b2810 0x7f22c00cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52268/0 (socket says 172.21.15.99:52268) 2024-03-30T13:14:05.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.405+0000 7f22be800640 1 -- 172.21.15.99:0/2200384382 learned_addr learned my addr 172.21.15.99:0/2200384382 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:05.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.405+0000 7f22bde00640 1 --2- 172.21.15.99:0/2200384382 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22c00b4e40 0x7f22c00c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.405+0000 7f22be800640 1 -- 172.21.15.99:0/2200384382 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22c00b4e40 msgr2=0x7f22c00c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.406+0000 7f22be800640 1 --2- 172.21.15.99:0/2200384382 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22c00b4e40 0x7f22c00c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.406+0000 7f22be800640 1 -- 172.21.15.99:0/2200384382 >> v1:172.21.15.181:6789/0 conn(0x7f22c00b31c0 legacy=0x7f22c00b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.406+0000 7f22be800640 1 -- 172.21.15.99:0/2200384382 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c01607b0 con 0x7f22c00b2810 2024-03-30T13:14:05.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.407+0000 7f22be800640 1 --2- 172.21.15.99:0/2200384382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c00b2810 0x7f22c00cbec0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009e50 tx=0x7f22b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3838a3e13c664d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.407+0000 7f22bd400640 1 -- 172.21.15.99:0/2200384382 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b802ca70 con 0x7f22c00b2810 2024-03-30T13:14:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.407+0000 7f22bd400640 1 -- 172.21.15.99:0/2200384382 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b802cc10 con 0x7f22c00b2810 2024-03-30T13:14:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.407+0000 7f22bd400640 1 -- 172.21.15.99:0/2200384382 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b80343f0 con 0x7f22c00b2810 2024-03-30T13:14:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.408+0000 7f22c5200640 1 -- 172.21.15.99:0/2200384382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c00b2810 msgr2=0x7f22c00cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.408+0000 7f22c5200640 1 --2- 172.21.15.99:0/2200384382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c00b2810 0x7f22c00cbec0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009e50 tx=0x7f22b802bed0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.408+0000 7f22c5200640 1 -- 172.21.15.99:0/2200384382 shutdown_connections 2024-03-30T13:14:05.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.408+0000 7f22c5200640 1 --2- 172.21.15.99:0/2200384382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c00b2810 0x7f22c00cbec0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.408+0000 7f22c5200640 1 --2- 172.21.15.99:0/2200384382 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22c00b4e40 0x7f22c00c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.408+0000 7f22c5200640 1 -- 172.21.15.99:0/2200384382 >> 172.21.15.99:0/2200384382 conn(0x7f22c00d0450 msgr2=0x7f22c00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.408+0000 7f22c5200640 1 -- 172.21.15.99:0/2200384382 shutdown_connections 2024-03-30T13:14:05.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.408+0000 7f22c5200640 1 -- 172.21.15.99:0/2200384382 wait complete. 2024-03-30T13:14:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.409+0000 7f22c5200640 1 Processor -- start 2024-03-30T13:14:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.410+0000 7f22c5200640 1 -- start start 2024-03-30T13:14:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22c5200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22c00b2810 0x7f22c015bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22c5200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22c00b31c0 0x7f22c00b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22c5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c00b4e40 0x7f22c00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22c5200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f22c00b3620 con 0x7f22c00b4e40 2024-03-30T13:14:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22c5200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f22c0160d70 con 0x7f22c00b2810 2024-03-30T13:14:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22c5200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f22c00c60f0 con 0x7f22c00b31c0 2024-03-30T13:14:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22be800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c00b4e40 0x7f22c00b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22be800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c00b4e40 0x7f22c00b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52274/0 (socket says 172.21.15.99:52274) 2024-03-30T13:14:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22be800640 1 -- 172.21.15.99:0/2916230932 learned_addr learned my addr 172.21.15.99:0/2916230932 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22bde00640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22c00b2810 0x7f22c015bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22b5400640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22c00b31c0 0x7f22c00b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22be800640 1 -- 172.21.15.99:0/2916230932 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22c00b31c0 msgr2=0x7f22c00b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22be800640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22c00b31c0 0x7f22c00b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22be800640 1 -- 172.21.15.99:0/2916230932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22c00b2810 msgr2=0x7f22c015bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22be800640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22c00b2810 0x7f22c015bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.411+0000 7f22be800640 1 -- 172.21.15.99:0/2916230932 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c015a830 con 0x7f22c00b4e40 2024-03-30T13:14:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.412+0000 7f22be800640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c00b4e40 0x7f22c00b0700 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009e50 tx=0x7f22b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.412+0000 7f22b6a00640 1 -- 172.21.15.99:0/2916230932 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8043020 con 0x7f22c00b4e40 2024-03-30T13:14:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.412+0000 7f22b6a00640 1 -- 172.21.15.99:0/2916230932 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b803e450 con 0x7f22c00b4e40 2024-03-30T13:14:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.412+0000 7f22b6a00640 1 -- 172.21.15.99:0/2916230932 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8009510 con 0x7f22c00b4e40 2024-03-30T13:14:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.412+0000 7f22c5200640 1 -- 172.21.15.99:0/2916230932 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c015aad0 con 0x7f22c00b4e40 2024-03-30T13:14:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.412+0000 7f22c5200640 1 -- 172.21.15.99:0/2916230932 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c015b090 con 0x7f22c00b4e40 2024-03-30T13:14:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.415+0000 7f22b6a00640 1 -- 172.21.15.99:0/2916230932 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f22b8046020 con 0x7f22c00b4e40 2024-03-30T13:14:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.416+0000 7f22b6a00640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f229c06c530 0x7f229c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.416+0000 7f22b6a00640 1 -- 172.21.15.99:0/2916230932 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f22b80adff0 con 0x7f22c00b4e40 2024-03-30T13:14:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.417+0000 7f22bde00640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f229c06c530 0x7f229c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.417+0000 7f22c7fdf740 1 Processor -- start 2024-03-30T13:14:05.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.417+0000 7f22c7fdf740 1 -- start start 2024-03-30T13:14:05.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.417+0000 7f22bde00640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f229c06c530 0x7f229c06e9f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f22b0006fd0 tx=0x7f22b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.418+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.418+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751c5300 0x55d87519d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.418+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d87519d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.418+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d875101330 con 0x55d8751c5300 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.418+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d8750a9620 con 0x55d87519e670 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.418+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55d8750fd440 con 0x55d87519e290 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.418+0000 7f22b5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751c5300 0x55d87519d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.418+0000 7f22b5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751c5300 0x55d87519d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52286/0 (socket says 172.21.15.99:52286) 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.418+0000 7f22b5400640 1 -- 172.21.15.99:0/2203215555 learned_addr learned my addr 172.21.15.99:0/2203215555 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.419+0000 7f22be800640 1 --2- 172.21.15.99:0/2203215555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d87519d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.419+0000 7f22bde00640 1 --2- 172.21.15.99:0/2203215555 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.419+0000 7f22b5400640 1 -- 172.21.15.99:0/2203215555 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 msgr2=0x55d8751c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.419+0000 7f22b5400640 1 --2- 172.21.15.99:0/2203215555 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.419+0000 7f22b5400640 1 -- 172.21.15.99:0/2203215555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 msgr2=0x55d87519d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.419+0000 7f22b5400640 1 --2- 172.21.15.99:0/2203215555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d87519d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.419+0000 7f22b5400640 1 -- 172.21.15.99:0/2203215555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d874ee1920 con 0x55d8751c5300 2024-03-30T13:14:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.419+0000 7f22b5400640 1 --2- 172.21.15.99:0/2203215555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751c5300 0x55d87519d2d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f22a80016b0 tx=0x7f22a8001b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf386759a333bf5a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.419+0000 7f22aea00640 1 -- 172.21.15.99:0/2203215555 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8018070 con 0x55d8751c5300 2024-03-30T13:14:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.419+0000 7f22aea00640 1 -- 172.21.15.99:0/2203215555 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a800d6d0 con 0x55d8751c5300 2024-03-30T13:14:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.419+0000 7f22aea00640 1 -- 172.21.15.99:0/2203215555 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a800da80 con 0x55d8751c5300 2024-03-30T13:14:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.420+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2203215555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751c5300 msgr2=0x55d87519d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.420+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2203215555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751c5300 0x55d87519d2d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f22a80016b0 tx=0x7f22a8001b70 comp rx=0 tx=0).stop 2024-03-30T13:14:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.420+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2203215555 shutdown_connections 2024-03-30T13:14:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.420+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2203215555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d87519d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.420+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2203215555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751c5300 0x55d87519d2d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.420+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2203215555 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.420+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2203215555 >> 172.21.15.99:0/2203215555 conn(0x55d875164be0 msgr2=0x55d8751e2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.420+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2203215555 shutdown_connections 2024-03-30T13:14:05.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.420+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2203215555 wait complete. 2024-03-30T13:14:05.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.421+0000 7f22c7fdf740 1 -- start start 2024-03-30T13:14:05.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.421+0000 7f22c7fdf740 1 Processor -- start 2024-03-30T13:14:05.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.422+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751bbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.422+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d8751e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.422+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.422+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d8751c4930 con 0x55d8751bca80 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.422+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d8750bc9d0 con 0x55d87519e670 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.422+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55d8751bd6b0 con 0x55d87519e290 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.422+0000 7f22c7fdf740 10 client.0 _ll_register_callbacks cb 0x55d8750f8fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.422+0000 7f22be800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.422+0000 7f22be800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52302/0 (socket says 172.21.15.99:52302) 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.422+0000 7f22be800640 1 -- 172.21.15.99:0/2076196042 learned_addr learned my addr 172.21.15.99:0/2076196042 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22bde00640 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751bbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22b5400640 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d8751e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22be800640 1 -- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 msgr2=0x55d8751bbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22be800640 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751bbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22be800640 1 -- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 msgr2=0x55d8751e69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22be800640 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d8751e69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22be800640 1 -- 172.21.15.99:0/2076196042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d874dd5210 con 0x55d8751bca80 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22be800640 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6ef0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f22b802bf10 tx=0x7f22b807bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8988563f058d83d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22a3400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22a3400640 1 -- 172.21.15.99:0/2076196042 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8094020 con 0x55d8751bca80 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22a3400640 1 -- 172.21.15.99:0/2076196042 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f22b80941c0 con 0x55d8751bca80 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2076196042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22a800d6d0 con 0x55d8751bca80 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22a3400640 1 -- 172.21.15.99:0/2076196042 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f22b807e030 con 0x55d8751bca80 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22c7fdf740 10 client.6309 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.423+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2076196042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55d874f420b0 con 0x55d8751bca80 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.424+0000 7f22a3400640 1 -- 172.21.15.99:0/2076196042 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a800d6d0 con 0x55d8751bca80 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.424+0000 7f22a3400640 1 -- 172.21.15.99:0/2076196042 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f22b802ca80 con 0x55d8751bca80 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.424+0000 7f22c7fdf740 10 client.6309 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.424+0000 7f22c7fdf740 10 client.6309 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:05.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.424+0000 7f22c7fdf740 20 client.6309 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:05.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.424+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8751c95d0 0x55d8751c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.424+0000 7f22c7fdf740 4 client.6309 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:05.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.424+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2076196042 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d87510e870 con 0x55d8751c95d0 2024-03-30T13:14:05.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.425+0000 7f22bde00640 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8751c95d0 0x55d8751c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.426+0000 7f22bde00640 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8751c95d0 0x55d8751c99b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52815e3c8c9f8e37 server_cookie=62b42ce6bb109b9e in_seq=0 out_seq=0 2024-03-30T13:14:05.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.426+0000 7f22a3400640 10 client.6309 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:05.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.427+0000 7f22a3400640 1 -- 172.21.15.99:0/2076196042 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55d87510e870 con 0x55d8751c95d0 2024-03-30T13:14:05.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.427+0000 7f22a3400640 10 client.6309 handle_command_reply: tid=0 2024-03-30T13:14:05.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.427+0000 7f22c7fdf740 1 client.6309 shutdown 2024-03-30T13:14:05.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2076196042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 msgr2=0x55d8751e6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6ef0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f22b802bf10 tx=0x7f22b807bf80 comp rx=0 tx=0).stop 2024-03-30T13:14:05.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2076196042 shutdown_connections 2024-03-30T13:14:05.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6ef0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d8751c95d0 0x55d8751c99b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d8751e69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2076196042 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751bbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22a3400640 0 client.6309 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:05.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2076196042 >> 172.21.15.99:0/2076196042 conn(0x55d875164be0 msgr2=0x55d8751c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2076196042 shutdown_connections 2024-03-30T13:14:05.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2076196042 wait complete. 2024-03-30T13:14:05.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.428+0000 7f22c7fdf740 20 client.6309 trim_cache size 0 max 16384 2024-03-30T13:14:05.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.444+0000 7f22c7fdf740 1 Processor -- start 2024-03-30T13:14:05.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.444+0000 7f22c7fdf740 1 -- start start 2024-03-30T13:14:05.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.444+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d87519e290 0x55d8751e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.444+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d875259920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8751bca80 0x55d875259e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f22c01fedc0 con 0x55d87519e290 2024-03-30T13:14:05.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f22c006ec90 con 0x55d87519e670 2024-03-30T13:14:05.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f22c01f35e0 con 0x55d8751bca80 2024-03-30T13:14:05.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22bde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d87519e290 0x55d8751e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22bde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d87519e290 0x55d8751e2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52310/0 (socket says 172.21.15.99:52310) 2024-03-30T13:14:05.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22bde00640 1 -- 172.21.15.99:0/2026804084 learned_addr learned my addr 172.21.15.99:0/2026804084 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:05.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22bde00640 1 -- 172.21.15.99:0/2026804084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8751bca80 msgr2=0x55d875259e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22bde00640 1 --2- 172.21.15.99:0/2026804084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8751bca80 0x55d875259e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22bde00640 1 -- 172.21.15.99:0/2026804084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 msgr2=0x55d875259920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22bde00640 1 --2- 172.21.15.99:0/2026804084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d875259920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22bde00640 1 -- 172.21.15.99:0/2026804084 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8751c9d20 con 0x55d87519e290 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.445+0000 7f22bde00640 1 --2- 172.21.15.99:0/2026804084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d87519e290 0x55d8751e2d70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55d8751f2ad0 tx=0x7f22b0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed96c1b152b597a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22ae000640 1 -- 172.21.15.99:0/2026804084 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b002c070 con 0x55d87519e290 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22ae000640 1 -- 172.21.15.99:0/2026804084 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b000ee80 con 0x55d87519e290 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22ae000640 1 -- 172.21.15.99:0/2026804084 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b000f040 con 0x55d87519e290 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2026804084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d87519e290 msgr2=0x55d8751e2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2026804084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d87519e290 0x55d8751e2d70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55d8751f2ad0 tx=0x7f22b0014000 comp rx=0 tx=0).stop 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2026804084 shutdown_connections 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2026804084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d8751bca80 0x55d875259e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2026804084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d875259920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/2026804084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d87519e290 0x55d8751e2d70 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2026804084 >> 172.21.15.99:0/2026804084 conn(0x55d875164be0 msgr2=0x55d8751c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2026804084 shutdown_connections 2024-03-30T13:14:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.446+0000 7f22c7fdf740 1 -- 172.21.15.99:0/2026804084 wait complete. 2024-03-30T13:14:05.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.447+0000 7f22c7fdf740 1 -- start start 2024-03-30T13:14:05.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.447+0000 7f22c7fdf740 1 Processor -- start 2024-03-30T13:14:05.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.448+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751e3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.448+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d8751e6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.448+0000 7f22c7fdf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.448+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f22c006e640 con 0x55d8751bca80 2024-03-30T13:14:05.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.448+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d8751bcf60 con 0x55d87519e670 2024-03-30T13:14:05.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.448+0000 7f22c7fdf740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55d875248460 con 0x55d87519e290 2024-03-30T13:14:05.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.448+0000 7f22c7fdf740 10 client.0 _ll_register_callbacks cb 0x7f22b807c5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.448+0000 7f22be800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.448+0000 7f22be800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52324/0 (socket says 172.21.15.99:52324) 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.448+0000 7f22be800640 1 -- 172.21.15.99:0/3447507223 learned_addr learned my addr 172.21.15.99:0/3447507223 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22b5400640 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d8751e6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22bde00640 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22be800640 1 -- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 msgr2=0x55d8751e3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22be800640 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751e3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22be800640 1 -- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 msgr2=0x55d8751e6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22be800640 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d8751e6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22be800640 1 -- 172.21.15.99:0/3447507223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d874dae2d0 con 0x55d8751bca80 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22b5400640 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d8751e6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22be800640 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6840 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f22b80782a0 tx=0x7f22b8009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a4354888bc3ac7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22a3400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-03-30T13:14:05.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22a3400640 1 -- 172.21.15.99:0/3447507223 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b80a0060 con 0x55d8751bca80 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22a3400640 1 -- 172.21.15.99:0/3447507223 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f22b803c470 con 0x55d8751bca80 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.449+0000 7f22c7fdf740 1 -- 172.21.15.99:0/3447507223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d875108bc0 con 0x55d8751bca80 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.450+0000 7f22a3400640 1 -- 172.21.15.99:0/3447507223 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f22b8094050 con 0x55d8751bca80 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.450+0000 7f22c7fdf740 10 client.6315 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.450+0000 7f22c7fdf740 1 -- 172.21.15.99:0/3447507223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55d875197970 con 0x55d8751bca80 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.450+0000 7f22a3400640 1 -- 172.21.15.99:0/3447507223 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d875108bc0 con 0x55d8751bca80 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.450+0000 7f22a3400640 1 -- 172.21.15.99:0/3447507223 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f22b802ca80 con 0x55d8751bca80 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.450+0000 7f22c7fdf740 10 client.6315 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.450+0000 7f22c7fdf740 10 client.6315 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.450+0000 7f22c7fdf740 20 client.6315 populate_metadata read hostname 'smithi099' 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.450+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d87524c060 0x55d8751b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.450+0000 7f22c7fdf740 4 client.6315 mds_command: new command op to 5121 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628412}] 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.450+0000 7f22c7fdf740 1 -- 172.21.15.99:0/3447507223 --> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628412}) -- 0x55d875086950 con 0x55d87524c060 2024-03-30T13:14:05.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.451+0000 7f22bde00640 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d87524c060 0x55d8751b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:05.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.452+0000 7f22bde00640 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d87524c060 0x55d8751b5c40 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c4827c45936d407 server_cookie=be0a620c3f2f8d3d in_seq=0 out_seq=0 2024-03-30T13:14:05.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.452+0000 7f22a3400640 10 client.6315 ms_handle_connect on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:05.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.452+0000 7f22a3400640 1 -- 172.21.15.99:0/3447507223 <== mds.0 v2:172.21.15.181:6833/1594018738 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4763 (crc 0 0 0) 0x55d875086950 con 0x55d87524c060 2024-03-30T13:14:05.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.452+0000 7f22a3400640 10 client.6315 handle_command_reply: tid=0 2024-03-30T13:14:05.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.452+0000 7f22c7fdf740 1 client.6315 shutdown 2024-03-30T13:14:05.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22c7fdf740 1 -- 172.21.15.99:0/3447507223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 msgr2=0x55d8751e6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6840 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f22b80782a0 tx=0x7f22b8009810 comp rx=0 tx=0).stop 2024-03-30T13:14:05.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22c7fdf740 1 -- 172.21.15.99:0/3447507223 shutdown_connections 2024-03-30T13:14:05.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d8751bca80 0x55d8751e6840 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:6833/1594018738,v1:172.21.15.181:6835/1594018738] conn(0x55d87524c060 0x55d8751b5c40 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d87519e670 0x55d8751e6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22c7fdf740 1 --2- 172.21.15.99:0/3447507223 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d87519e290 0x55d8751e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22a3400640 0 client.6315 ms_handle_reset on v2:172.21.15.181:6833/1594018738 2024-03-30T13:14:05.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22c7fdf740 1 -- 172.21.15.99:0/3447507223 >> 172.21.15.99:0/3447507223 conn(0x55d875164be0 msgr2=0x55d8751c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22c7fdf740 1 -- 172.21.15.99:0/3447507223 shutdown_connections 2024-03-30T13:14:05.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22c7fdf740 1 -- 172.21.15.99:0/3447507223 wait complete. 2024-03-30T13:14:05.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.453+0000 7f22c7fdf740 20 client.6315 trim_cache size 0 max 16384 2024-03-30T13:14:05.460 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:05.460 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/linux-5.4/fs/orangefs/downcall.h", 2024-03-30T13:14:05.460 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511628412, 2024-03-30T13:14:05.460 INFO:teuthology.orchestra.run.smithi099.stdout: "rdev": 0, 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "ctime": "2024-03-30T13:13:26.659219+0000", 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "btime": "2024-03-30T13:13:24.847870+0000", 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": 33188, 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "uid": 1000, 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 1301, 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "nlink": 1, 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_layout": { 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_hash": 0, 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "unused1": 0, 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "unused2": 0, 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "unused3": 0 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "layout": { 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_count": 1, 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "object_size": 4194304, 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_id": 5, 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ns": "" 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "old_pools": [], 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2953, 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_seq": 1, 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_from": 0, 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "truncate_pending": 0, 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "atime": "2024-03-30T13:13:24.847870+0000", 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time_warp_seq": 1, 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 3, 2024-03-30T13:14:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: "export_pin": -1, 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: "quiesce_block": false, 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: "client_ranges": [ 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: "client": 4855, 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: "byte range": { 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: "first": 0, 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: "last": 4194304 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: "follows": 7 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:05.463 INFO:teuthology.orchestra.run.smithi099.stdout: "dirstat": { 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "mtime": "0.000000", 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "num_files": 0, 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "num_subdirs": 0, 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "change_attr": 0 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "rstat": { 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2953, 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.659219+0000" 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.464 INFO:teuthology.orchestra.run.smithi099.stdout: "accounted_rstat": { 2024-03-30T13:14:05.465 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 0, 2024-03-30T13:14:05.465 INFO:teuthology.orchestra.run.smithi099.stdout: "rbytes": 2953, 2024-03-30T13:14:05.465 INFO:teuthology.orchestra.run.smithi099.stdout: "rfiles": 1, 2024-03-30T13:14:05.465 INFO:teuthology.orchestra.run.smithi099.stdout: "rsubdirs": 0, 2024-03-30T13:14:05.465 INFO:teuthology.orchestra.run.smithi099.stdout: "rsnaps": 0, 2024-03-30T13:14:05.465 INFO:teuthology.orchestra.run.smithi099.stdout: "rctime": "2024-03-30T13:13:26.659219+0000" 2024-03-30T13:14:05.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.465 INFO:teuthology.orchestra.run.smithi099.stdout: "version": 266, 2024-03-30T13:14:05.465 INFO:teuthology.orchestra.run.smithi099.stdout: "file_data_version": 0, 2024-03-30T13:14:05.465 INFO:teuthology.orchestra.run.smithi099.stdout: "xattr_version": 1, 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "backtrace_version": 14, 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "inline_data_length": 0, 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "stray_prior_path": "", 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_ever": 0, 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "max_bytes": 0, 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "max_files": 0 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "last_scrub_version": 0, 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "symlink": "", 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrs": [ 2024-03-30T13:14:05.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "security.selinux", 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtree": { 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: "splits": [] 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: "old_inodes": [], 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: "oldest_snap": 6, 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_flags": 0, 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: "is_auth": true, 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_state": { 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: "replicas": {} 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.467 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_state": { 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: "authority": [ 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: 0, 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: -2 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: "replica_nonce": 0 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_pins": 0, 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: "is_frozen": false, 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: "is_freezing": false, 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: "pins": { 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: "ptrwaiter": 0, 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: "lock": 0, 2024-03-30T13:14:05.468 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1, 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent": 1, 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty": 1, 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "waiter": 0, 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "authpin": 0, 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubqueue": 0 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "nref": 3, 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "versionlock": { 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iversion", 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.469 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "authlock": { 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iauth", 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "linklock": {}, 2024-03-30T13:14:05.470 INFO:teuthology.orchestra.run.smithi099.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "filelock": { 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ifile", 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "xattrlock": { 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "excl", 2024-03-30T13:14:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "ixattr", 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "snaplock": {}, 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "nestlock": { 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "inest", 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.472 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "flocklock": {}, 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "policylock": {}, 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "quiescelock": { 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "gather_set": [], 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "lock", 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "iquiesce", 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "is_leased": false, 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rdlocks": 0, 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "num_wrlocks": 0, 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "num_xlocks": 0, 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "xlock_by": {} 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:14:05.473 INFO:teuthology.orchestra.run.smithi099.stdout: "states": [ 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: "auth", 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: "dirty", 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtyparent", 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: "dirtypool" 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps": [ 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: "client_id": 4855, 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: "last_sent": 6 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:14:05.474 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:14:05.475 INFO:teuthology.orchestra.run.smithi099.stdout: "loner": 4855, 2024-03-30T13:14:05.475 INFO:teuthology.orchestra.run.smithi099.stdout: "want_loner": 4855, 2024-03-30T13:14:05.475 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:05.475 INFO:teuthology.orchestra.run.smithi099.stdout: "is_subvolume": false 2024-03-30T13:14:05.475 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:05.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 -- 172.21.15.99:0/2916230932 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f229c06c530 msgr2=0x7f229c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f229c06c530 0x7f229c06e9f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f22b0006fd0 tx=0x7f22b0008040 comp rx=0 tx=0).stop 2024-03-30T13:14:05.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 -- 172.21.15.99:0/2916230932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c00b4e40 msgr2=0x7f22c00b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:05.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c00b4e40 0x7f22c00b0700 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009e50 tx=0x7f22b8004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:05.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 -- 172.21.15.99:0/2916230932 shutdown_connections 2024-03-30T13:14:05.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f229c06c530 0x7f229c06e9f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c00b4e40 0x7f22c00b0700 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22c00b31c0 0x7f22c00b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 --2- 172.21.15.99:0/2916230932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22c00b2810 0x7f22c015bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:05.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 -- 172.21.15.99:0/2916230932 >> 172.21.15.99:0/2916230932 conn(0x7f22c00d0450 msgr2=0x7f22c01583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:05.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 -- 172.21.15.99:0/2916230932 shutdown_connections 2024-03-30T13:14:05.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:05.454+0000 7f22c5200640 1 -- 172.21.15.99:0/2916230932 wait complete. 2024-03-30T13:14:05.477 DEBUG:tasks.cephfs.test_uninlining:removing dir linux-5.4 2024-03-30T13:14:05.477 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && rm -rf linux-5.4/ 2024-03-30T13:14:06.073 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_length == 0 2024-03-30T13:14:06.073 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_version == CEPH_INLINE_NONE 2024-03-30T13:14:06.073 INFO:tasks.cephfs.test_uninlining:Running Data Uninlining test with: clear cache before scrub, without unmount client, without mount.open_background, without multimds, without snapshots 2024-03-30T13:14:06.073 DEBUG:tasks.cephfs.test_uninlining:setting max_mds:1 2024-03-30T13:14:06.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-03-30T13:14:06.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.291+0000 7f452a600640 1 Processor -- start 2024-03-30T13:14:06.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.291+0000 7f452a600640 1 -- start start 2024-03-30T13:14:06.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.292+0000 7f452a600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f45240c6820 0x7f45240b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.293+0000 7f452a600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45241604d0 con 0x7f45240b4e40 2024-03-30T13:14:06.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.293+0000 7f452a600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45241607b0 con 0x7f45240b2640 2024-03-30T13:14:06.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.293+0000 7f452a600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f45240cba20 con 0x7f45240c6820 2024-03-30T13:14:06.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.293+0000 7f4523400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f45240b4e40 0x7f45240b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55938/0 (socket says 172.21.15.99:55938) 2024-03-30T13:14:06.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.293+0000 7f4523400640 1 -- 172.21.15.99:0/2649377149 learned_addr learned my addr 172.21.15.99:0/2649377149 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:06.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.293+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775978087 0 0) 0x7f45241604d0 con 0x7f45240b4e40 2024-03-30T13:14:06.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.293+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4508003520 con 0x7f45240b4e40 2024-03-30T13:14:06.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.293+0000 7f451aa00640 1 --2- 172.21.15.99:0/2649377149 >> v2:172.21.15.181:3300/0 conn(0x7f45240c6820 0x7f45240b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3216175902 0 0) 0x7f4508003520 con 0x7f45240b4e40 2024-03-30T13:14:06.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 >> v2:172.21.15.181:3300/0 conn(0x7f45240c6820 msgr2=0x7f45240b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 --2- 172.21.15.99:0/2649377149 >> v2:172.21.15.181:3300/0 conn(0x7f45240c6820 0x7f45240b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 >> v1:172.21.15.181:6789/0 conn(0x7f45240b2640 legacy=0x7f45240cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4524160a90 con 0x7f45240b4e40 2024-03-30T13:14:06.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f4514001670 con 0x7f45240b4e40 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f451aa00640 1 --2- 172.21.15.99:0/2649377149 >> v2:172.21.15.181:3300/0 conn(0x7f45240c6820 0x7f45240b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 >> v1:172.21.15.99:6789/0 conn(0x7f45240b4e40 legacy=0x7f45240b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 --2- 172.21.15.99:0/2649377149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4508003a00 0x7f4508003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 --2- 172.21.15.99:0/2649377149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4508004800 0x7f4508004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 --2- 172.21.15.99:0/2649377149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4508005370 0x7f450800b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f45240cba20 con 0x7f4508003a00 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f450800c2c0 con 0x7f4508005370 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f450800c4c0 con 0x7f4508004800 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4523400640 1 --2- 172.21.15.99:0/2649377149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4508003a00 0x7f4508003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4523400640 1 -- 172.21.15.99:0/2649377149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4508004800 msgr2=0x7f4508004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4523e00640 1 --2- 172.21.15.99:0/2649377149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4508005370 0x7f450800b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4523400640 1 --2- 172.21.15.99:0/2649377149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4508004800 0x7f4508004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.294+0000 7f4523400640 1 -- 172.21.15.99:0/2649377149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4508005370 msgr2=0x7f450800b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.295+0000 7f4523400640 1 --2- 172.21.15.99:0/2649377149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4508005370 0x7f450800b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.295+0000 7f4523400640 1 -- 172.21.15.99:0/2649377149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4508003520 con 0x7f4508003a00 2024-03-30T13:14:06.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.295+0000 7f4523e00640 1 --2- 172.21.15.99:0/2649377149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4508005370 0x7f450800b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:06.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.295+0000 7f4523e00640 1 -- 172.21.15.99:0/2649377149 reap_dead start 2024-03-30T13:14:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.296+0000 7f4523400640 1 --2- 172.21.15.99:0/2649377149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4508003a00 0x7f4508003e00 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f451400c190 tx=0x7f4508005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4f069ebf3ec9d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.296+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514007c60 con 0x7f4508003a00 2024-03-30T13:14:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.296+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4514030070 con 0x7f4508003a00 2024-03-30T13:14:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.296+0000 7f4522a00640 1 -- 172.21.15.99:0/2649377149 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514005d50 con 0x7f4508003a00 2024-03-30T13:14:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.296+0000 7f452a600640 1 -- 172.21.15.99:0/2649377149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4508003a00 msgr2=0x7f4508003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.296+0000 7f452a600640 1 --2- 172.21.15.99:0/2649377149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4508003a00 0x7f4508003e00 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f451400c190 tx=0x7f4508005830 comp rx=0 tx=0).stop 2024-03-30T13:14:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.296+0000 7f452a600640 1 -- 172.21.15.99:0/2649377149 shutdown_connections 2024-03-30T13:14:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.296+0000 7f452a600640 1 --2- 172.21.15.99:0/2649377149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4508003a00 0x7f4508003e00 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.296+0000 7f452a600640 1 -- 172.21.15.99:0/2649377149 >> 172.21.15.99:0/2649377149 conn(0x7f45240d0450 msgr2=0x7f45240d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.297+0000 7f452a600640 1 -- 172.21.15.99:0/2649377149 shutdown_connections 2024-03-30T13:14:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.297+0000 7f452a600640 1 -- 172.21.15.99:0/2649377149 wait complete. 2024-03-30T13:14:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.298+0000 7f452a600640 1 Processor -- start 2024-03-30T13:14:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.298+0000 7f452a600640 1 -- start start 2024-03-30T13:14:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.299+0000 7f452a600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4508003a00 0x7f4524154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.299+0000 7f452a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4524152610 0x7f45240ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.299+0000 7f452a600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f452415b290 0x7f452415b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.299+0000 7f452a600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f45240c6cb0 con 0x7f4524152610 2024-03-30T13:14:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.299+0000 7f452a600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45240b2a70 con 0x7f452415b290 2024-03-30T13:14:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.299+0000 7f452a600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f45240c60f0 con 0x7f4508003a00 2024-03-30T13:14:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.300+0000 7f451aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4524152610 0x7f45240ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.300+0000 7f451aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4524152610 0x7f45240ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52340/0 (socket says 172.21.15.99:52340) 2024-03-30T13:14:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.300+0000 7f451aa00640 1 -- 172.21.15.99:0/4240517873 learned_addr learned my addr 172.21.15.99:0/4240517873 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.300+0000 7f4523400640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4508003a00 0x7f4524154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.300+0000 7f4523e00640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f452415b290 0x7f452415b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.300+0000 7f451aa00640 1 -- 172.21.15.99:0/4240517873 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4508003a00 msgr2=0x7f4524154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.300+0000 7f451aa00640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4508003a00 0x7f4524154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.300+0000 7f451aa00640 1 -- 172.21.15.99:0/4240517873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f452415b290 msgr2=0x7f452415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.300+0000 7f451aa00640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f452415b290 0x7f452415b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.300+0000 7f451aa00640 1 -- 172.21.15.99:0/4240517873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4524152a90 con 0x7f4524152610 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.300+0000 7f451aa00640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4524152610 0x7f45240ad1a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c850 tx=0x7f450c00cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.301+0000 7f451be00640 1 -- 172.21.15.99:0/4240517873 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c007a30 con 0x7f4524152610 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.301+0000 7f451be00640 1 -- 172.21.15.99:0/4240517873 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c007bd0 con 0x7f4524152610 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.301+0000 7f452a600640 1 -- 172.21.15.99:0/4240517873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4524072b20 con 0x7f4524152610 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.301+0000 7f451be00640 1 -- 172.21.15.99:0/4240517873 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c0113f0 con 0x7f4524152610 2024-03-30T13:14:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.301+0000 7f452a600640 1 -- 172.21.15.99:0/4240517873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45240730e0 con 0x7f4524152610 2024-03-30T13:14:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.302+0000 7f452a600640 1 -- 172.21.15.99:0/4240517873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45240cadc0 con 0x7f4524152610 2024-03-30T13:14:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.303+0000 7f451be00640 1 -- 172.21.15.99:0/4240517873 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f450c011590 con 0x7f4524152610 2024-03-30T13:14:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.304+0000 7f451be00640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f450006c530 0x7f450006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.305+0000 7f451be00640 1 -- 172.21.15.99:0/4240517873 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5897+0+0 (secure 0 0 0) 0x7f450c08b8e0 con 0x7f4524152610 2024-03-30T13:14:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.305+0000 7f4523400640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f450006c530 0x7f450006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.305+0000 7f4523400640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f450006c530 0x7f450006e9f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4514034000 tx=0x7f4514009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.310+0000 7f451be00640 1 -- 172.21.15.99:0/4240517873 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f45240cadc0 con 0x7f4524152610 2024-03-30T13:14:06.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.553+0000 7f452a600640 1 -- 172.21.15.99:0/4240517873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f452415bc50 con 0x7f4524152610 2024-03-30T13:14:06.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.756+0000 7f451be00640 1 -- 172.21.15.99:0/4240517873 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v21) ==== 105+0+0 (secure 0 0 0) 0x7f4524152a90 con 0x7f4524152610 2024-03-30T13:14:06.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.759+0000 7f452a600640 1 -- 172.21.15.99:0/4240517873 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f450006c530 msgr2=0x7f450006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.759+0000 7f452a600640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f450006c530 0x7f450006e9f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4514034000 tx=0x7f4514009030 comp rx=0 tx=0).stop 2024-03-30T13:14:06.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.759+0000 7f452a600640 1 -- 172.21.15.99:0/4240517873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4524152610 msgr2=0x7f45240ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.759+0000 7f452a600640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4524152610 0x7f45240ad1a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c850 tx=0x7f450c00cd10 comp rx=0 tx=0).stop 2024-03-30T13:14:06.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.759+0000 7f452a600640 1 -- 172.21.15.99:0/4240517873 shutdown_connections 2024-03-30T13:14:06.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.760+0000 7f452a600640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f450006c530 0x7f450006e9f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.760+0000 7f452a600640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f452415b290 0x7f452415b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.760+0000 7f452a600640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4524152610 0x7f45240ad1a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.760+0000 7f452a600640 1 --2- 172.21.15.99:0/4240517873 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4508003a00 0x7f4524154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.760+0000 7f452a600640 1 -- 172.21.15.99:0/4240517873 >> 172.21.15.99:0/4240517873 conn(0x7f45240d0450 msgr2=0x7f45240afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.760+0000 7f452a600640 1 -- 172.21.15.99:0/4240517873 shutdown_connections 2024-03-30T13:14:06.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:06.760+0000 7f452a600640 1 -- 172.21.15.99:0/4240517873 wait complete. 2024-03-30T13:14:06.788 DEBUG:tasks.cephfs.test_uninlining:getting client_max_inline_size 2024-03-30T13:14:06.789 DEBUG:tasks.cephfs.test_uninlining:got client_max_inline_size:4096 2024-03-30T13:14:06.789 DEBUG:tasks.cephfs.test_uninlining:extracting tarball 2024-03-30T13:14:06.789 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && tar -x -z -f linux-5.4.tar.gz linux-5.4/fs/ceph linux-5.4/fs/orangefs linux-5.4/fs/ext2 2024-03-30T13:14:11.726 DEBUG:tasks.cephfs.test_uninlining:fetching dir list 2024-03-30T13:14:11.727 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -mindepth 2 -maxdepth 2 -type d 2024-03-30T13:14:11.782 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph 2024-03-30T13:14:11.782 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2 2024-03-30T13:14:11.782 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs 2024-03-30T13:14:11.782 DEBUG:tasks.cephfs.test_uninlining:distributing dir pins 2024-03-30T13:14:11.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:11.783 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ceph) 2024-03-30T13:14:11.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:11.835 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ext2) 2024-03-30T13:14:11.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:11.886 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/orangefs) 2024-03-30T13:14:11.938 DEBUG:tasks.cephfs.test_uninlining:listing files with size <= 4096 2024-03-30T13:14:11.938 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -type f -size -4097c 2024-03-30T13:14:12.022 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:14:12.022 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/Makefile 2024-03-30T13:14:12.022 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:14:12.022 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/io.h 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/Makefile 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/acl.h 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:14:12.023 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:14:12.024 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:14:12.024 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:14:12.024 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:14:12.024 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:14:12.024 INFO:teuthology.orchestra.run.smithi099.stdout:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:14:12.024 INFO:tasks.cephfs.test_uninlining:Found 23 inlined files 2024-03-30T13:14:12.025 DEBUG:tasks.cephfs.test_uninlining:clearing cache 2024-03-30T13:14:12.025 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-30T13:14:12.025 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:14:12.152 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:14:12.274 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-30T13:14:12.274 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:14:12.274 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:14:12.274 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:14:12.333 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:14:12.333 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:14:12.387 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:14:12.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.601+0000 7fa2dc000640 1 Processor -- start 2024-03-30T13:14:12.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.601+0000 7fa2dc000640 1 -- start start 2024-03-30T13:14:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.602+0000 7fa2dc000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa2d406f3f0 0x7fa2d4072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2dc000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2d40730c0 0x7fa2d415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2dc000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2d4071ae0 con 0x7fa2d415b370 2024-03-30T13:14:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2dc000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa2d40b39d0 con 0x7fa2d406f3f0 2024-03-30T13:14:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2dc000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d4071dc0 con 0x7fa2d40730c0 2024-03-30T13:14:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2d8c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa2d406f3f0 0x7fa2d4072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2d8c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa2d406f3f0 0x7fa2d4072b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52348/0 (socket says 172.21.15.99:52348) 2024-03-30T13:14:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2d8c00640 1 -- 172.21.15.99:0/1933005616 learned_addr learned my addr 172.21.15.99:0/1933005616 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2da000640 1 --2- 172.21.15.99:0/1933005616 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2d40730c0 0x7fa2d415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2d8c00640 1 -- 172.21.15.99:0/1933005616 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2d40730c0 msgr2=0x7fa2d415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2d8c00640 1 --2- 172.21.15.99:0/1933005616 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2d40730c0 0x7fa2d415f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:12.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2d8c00640 1 -- 172.21.15.99:0/1933005616 >> v1:172.21.15.181:6789/0 conn(0x7fa2d415b370 legacy=0x7fa2d40b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:12.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.603+0000 7fa2d8c00640 1 -- 172.21.15.99:0/1933005616 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d40720a0 con 0x7fa2d406f3f0 2024-03-30T13:14:12.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.604+0000 7fa2d8c00640 1 --2- 172.21.15.99:0/1933005616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d406f3f0 0x7fa2d4072b80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000bb10 tx=0x7fa2c002e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482144d7dfd9bf06 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:12.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.605+0000 7fa2d3e00640 1 -- 172.21.15.99:0/1933005616 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c003b070 con 0x7fa2d406f3f0 2024-03-30T13:14:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.605+0000 7fa2d3e00640 1 -- 172.21.15.99:0/1933005616 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c0036440 con 0x7fa2d406f3f0 2024-03-30T13:14:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.605+0000 7fa2d3e00640 1 -- 172.21.15.99:0/1933005616 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0036810 con 0x7fa2d406f3f0 2024-03-30T13:14:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.605+0000 7fa2dc000640 1 -- 172.21.15.99:0/1933005616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d406f3f0 msgr2=0x7fa2d4072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.605+0000 7fa2dc000640 1 --2- 172.21.15.99:0/1933005616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d406f3f0 0x7fa2d4072b80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000bb10 tx=0x7fa2c002e0c0 comp rx=0 tx=0).stop 2024-03-30T13:14:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.606+0000 7fa2dc000640 1 -- 172.21.15.99:0/1933005616 shutdown_connections 2024-03-30T13:14:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.606+0000 7fa2dc000640 1 --2- 172.21.15.99:0/1933005616 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2d40730c0 0x7fa2d415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.606+0000 7fa2dc000640 1 --2- 172.21.15.99:0/1933005616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d406f3f0 0x7fa2d4072b80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.606+0000 7fa2dc000640 1 -- 172.21.15.99:0/1933005616 >> 172.21.15.99:0/1933005616 conn(0x7fa2d406b510 msgr2=0x7fa2d406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.606+0000 7fa2dc000640 1 -- 172.21.15.99:0/1933005616 shutdown_connections 2024-03-30T13:14:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.606+0000 7fa2dc000640 1 -- 172.21.15.99:0/1933005616 wait complete. 2024-03-30T13:14:12.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.607+0000 7fa2dc000640 1 Processor -- start 2024-03-30T13:14:12.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.607+0000 7fa2dc000640 1 -- start start 2024-03-30T13:14:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.608+0000 7fa2dc000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2d406f3f0 0x7fa2d414d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:12.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.608+0000 7fa2dc000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d40730c0 0x7fa2d41f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:12.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.608+0000 7fa2dc000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d415b370 0x7fa2d40ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:12.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.608+0000 7fa2dc000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4073550 con 0x7fa2d415b370 2024-03-30T13:14:12.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.608+0000 7fa2dc000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4072660 con 0x7fa2d40730c0 2024-03-30T13:14:12.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.608+0000 7fa2dc000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d415b750 con 0x7fa2d406f3f0 2024-03-30T13:14:12.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.609+0000 7fa2da000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d415b370 0x7fa2d40ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:12.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.609+0000 7fa2da000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d415b370 0x7fa2d40ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52350/0 (socket says 172.21.15.99:52350) 2024-03-30T13:14:12.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.609+0000 7fa2da000640 1 -- 172.21.15.99:0/3707491906 learned_addr learned my addr 172.21.15.99:0/3707491906 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:12.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.609+0000 7fa2d8c00640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d40730c0 0x7fa2d41f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.609+0000 7fa2d9600640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2d406f3f0 0x7fa2d414d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.609+0000 7fa2da000640 1 -- 172.21.15.99:0/3707491906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2d406f3f0 msgr2=0x7fa2d414d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.609+0000 7fa2da000640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2d406f3f0 0x7fa2d414d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.609+0000 7fa2da000640 1 -- 172.21.15.99:0/3707491906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d40730c0 msgr2=0x7fa2d41f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.609+0000 7fa2da000640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d40730c0 0x7fa2d41f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.609+0000 7fa2da000640 1 -- 172.21.15.99:0/3707491906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d4151d30 con 0x7fa2d415b370 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.609+0000 7fa2d8c00640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d40730c0 0x7fa2d41f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.610+0000 7fa2da000640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d415b370 0x7fa2d40ccca0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00c580 tx=0x7fa2cc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.610+0000 7fa2d1600640 1 -- 172.21.15.99:0/3707491906 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc015070 con 0x7fa2d415b370 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.610+0000 7fa2d1600640 1 -- 172.21.15.99:0/3707491906 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2cc004220 con 0x7fa2d415b370 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.610+0000 7fa2d1600640 1 -- 172.21.15.99:0/3707491906 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc003610 con 0x7fa2d415b370 2024-03-30T13:14:12.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.610+0000 7fa2dc000640 1 -- 172.21.15.99:0/3707491906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d4152010 con 0x7fa2d415b370 2024-03-30T13:14:12.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.610+0000 7fa2dc000640 1 -- 172.21.15.99:0/3707491906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d41525d0 con 0x7fa2d415b370 2024-03-30T13:14:12.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.611+0000 7fa2dc000640 1 -- 172.21.15.99:0/3707491906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d4068640 con 0x7fa2d415b370 2024-03-30T13:14:12.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.612+0000 7fa2d1600640 1 -- 172.21.15.99:0/3707491906 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa2cc0037b0 con 0x7fa2d415b370 2024-03-30T13:14:12.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.613+0000 7fa2d1600640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa2b406c530 0x7fa2b406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:12.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.613+0000 7fa2d1600640 1 -- 172.21.15.99:0/3707491906 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fa2cc08b5d0 con 0x7fa2d415b370 2024-03-30T13:14:12.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.613+0000 7fa2d9600640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa2b406c530 0x7fa2b406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:12.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.614+0000 7fa2d9600640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa2b406c530 0x7fa2b406e9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4005520 tx=0x7fa2c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:12.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.618+0000 7fa2d1600640 1 -- 172.21.15.99:0/3707491906 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa2cc059ad0 con 0x7fa2d415b370 2024-03-30T13:14:12.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.821+0000 7fa2dc000640 1 -- 172.21.15.99:0/3707491906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2d40d0000 con 0x7fa2d415b370 2024-03-30T13:14:12.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.824+0000 7fa2d1600640 1 -- 172.21.15.99:0/3707491906 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16926 (secure 0 0 0) 0x7fa2cc0593d0 con 0x7fa2d415b370 2024-03-30T13:14:12.829 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:12.829 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":40,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:14:10.165267+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:12:02.458079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:12:03.597299+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:14:12.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 -- 172.21.15.99:0/3707491906 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa2b406c530 msgr2=0x7fa2b406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:12.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa2b406c530 0x7fa2b406e9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4005520 tx=0x7fa2c4009040 comp rx=0 tx=0).stop 2024-03-30T13:14:12.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 -- 172.21.15.99:0/3707491906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d415b370 msgr2=0x7fa2d40ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:12.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d415b370 0x7fa2d40ccca0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00c580 tx=0x7fa2cc00ca40 comp rx=0 tx=0).stop 2024-03-30T13:14:12.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 -- 172.21.15.99:0/3707491906 shutdown_connections 2024-03-30T13:14:12.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa2b406c530 0x7fa2b406e9f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:12.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d415b370 0x7fa2d40ccca0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:12.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d40730c0 0x7fa2d41f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:12.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 --2- 172.21.15.99:0/3707491906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2d406f3f0 0x7fa2d414d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:12.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 -- 172.21.15.99:0/3707491906 >> 172.21.15.99:0/3707491906 conn(0x7fa2d406b510 msgr2=0x7fa2d406dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:12.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 -- 172.21.15.99:0/3707491906 shutdown_connections 2024-03-30T13:14:12.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:12.827+0000 7fa2dc000640 1 -- 172.21.15.99:0/3707491906 wait complete. 2024-03-30T13:14:12.851 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:12:02.458079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:12:03.597299+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 39, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:14:12.851 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:14:13.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.054+0000 7f7d99c00640 1 Processor -- start 2024-03-30T13:14:13.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.054+0000 7f7d99c00640 1 -- start start 2024-03-30T13:14:13.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.055+0000 7f7d99c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d9415fcd0 0x7f7d9409b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.056+0000 7f7d99c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7d940b2e20 0x7f7d940ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.056+0000 7f7d99c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d940b32b0 con 0x7f7d940b1380 2024-03-30T13:14:13.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.056+0000 7f7d99c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7d940d05c0 con 0x7f7d940b2e20 2024-03-30T13:14:13.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.056+0000 7f7d99c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7d940d08a0 con 0x7f7d9415fcd0 2024-03-30T13:14:13.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.056+0000 7f7d92000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7d940b1380 0x7f7d9409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55950/0 (socket says 172.21.15.99:55950) 2024-03-30T13:14:13.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.056+0000 7f7d92000640 1 -- 172.21.15.99:0/4171576551 learned_addr learned my addr 172.21.15.99:0/4171576551 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:13.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.056+0000 7f7d93400640 1 --2- 172.21.15.99:0/4171576551 >> v2:172.21.15.181:3300/0 conn(0x7f7d940b2e20 0x7f7d940ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.056+0000 7f7d92a00640 1 --2- 172.21.15.99:0/4171576551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d9415fcd0 0x7f7d9409b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.056+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568746645 0 0) 0x7f7d940b32b0 con 0x7f7d940b1380 2024-03-30T13:14:13.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d78003520 con 0x7f7d940b1380 2024-03-30T13:14:13.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3927428133 0 0) 0x7f7d78003520 con 0x7f7d940b1380 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d9415fcd0 msgr2=0x7f7d9409b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 --2- 172.21.15.99:0/4171576551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d9415fcd0 0x7f7d9409b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 >> v2:172.21.15.181:3300/0 conn(0x7f7d940b2e20 msgr2=0x7f7d940ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 --2- 172.21.15.99:0/4171576551 >> v2:172.21.15.181:3300/0 conn(0x7f7d940b2e20 0x7f7d940ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d940d0b80 con 0x7f7d940b1380 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f7d7c001670 con 0x7f7d940b1380 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d93400640 1 --2- 172.21.15.99:0/4171576551 >> v2:172.21.15.181:3300/0 conn(0x7f7d940b2e20 0x7f7d940ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 >> v1:172.21.15.99:6789/0 conn(0x7f7d940b1380 legacy=0x7f7d9409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 --2- 172.21.15.99:0/4171576551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d9415fcd0 0x7f7d780039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 --2- 172.21.15.99:0/4171576551 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d78003f30 0x7f7d78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 --2- 172.21.15.99:0/4171576551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d78004d40 0x7f7d780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7d940d05c0 con 0x7f7d78004d40 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d940d08a0 con 0x7f7d78003f30 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7d7800b9c0 con 0x7f7d9415fcd0 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.057+0000 7f7d93400640 1 --2- 172.21.15.99:0/4171576551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d78004d40 0x7f7d780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.058+0000 7f7d92a00640 1 --2- 172.21.15.99:0/4171576551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d9415fcd0 0x7f7d780039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.058+0000 7f7d93400640 1 -- 172.21.15.99:0/4171576551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d9415fcd0 msgr2=0x7f7d780039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.058+0000 7f7d93400640 1 --2- 172.21.15.99:0/4171576551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d9415fcd0 0x7f7d780039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.058+0000 7f7d93400640 1 -- 172.21.15.99:0/4171576551 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d78003f30 msgr2=0x7f7d78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.058+0000 7f7d93400640 1 --2- 172.21.15.99:0/4171576551 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d78003f30 0x7f7d78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.058+0000 7f7d93400640 1 -- 172.21.15.99:0/4171576551 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d78003520 con 0x7f7d78004d40 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.059+0000 7f7d93400640 1 --2- 172.21.15.99:0/4171576551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d78004d40 0x7f7d780051c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7d940b4b90 tx=0x7f7d78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6054f9e35499528 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.059+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c009de0 con 0x7f7d78004d40 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.059+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8c02cd80 con 0x7f7d78004d40 2024-03-30T13:14:13.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.059+0000 7f7d91600640 1 -- 172.21.15.99:0/4171576551 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c003b90 con 0x7f7d78004d40 2024-03-30T13:14:13.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.060+0000 7f7d99c00640 1 -- 172.21.15.99:0/4171576551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d78004d40 msgr2=0x7f7d780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.060+0000 7f7d99c00640 1 --2- 172.21.15.99:0/4171576551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d78004d40 0x7f7d780051c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7d940b4b90 tx=0x7f7d78005830 comp rx=0 tx=0).stop 2024-03-30T13:14:13.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.060+0000 7f7d93400640 1 -- 172.21.15.99:0/4171576551 reap_dead start 2024-03-30T13:14:13.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.060+0000 7f7d99c00640 1 -- 172.21.15.99:0/4171576551 shutdown_connections 2024-03-30T13:14:13.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.060+0000 7f7d99c00640 1 -- 172.21.15.99:0/4171576551 >> 172.21.15.99:0/4171576551 conn(0x7f7d940b3fa0 msgr2=0x7f7d940b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:13.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.060+0000 7f7d99c00640 1 -- 172.21.15.99:0/4171576551 shutdown_connections 2024-03-30T13:14:13.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.060+0000 7f7d99c00640 1 -- 172.21.15.99:0/4171576551 wait complete. 2024-03-30T13:14:13.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.062+0000 7f7d99c00640 1 Processor -- start 2024-03-30T13:14:13.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.062+0000 7f7d99c00640 1 -- start start 2024-03-30T13:14:13.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d99c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d78004d40 0x7f7d941522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d99c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d940cf990 0x7f7d940c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d99c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d940c9580 0x7f7d940c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d99c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7d94160230 con 0x7f7d940c9580 2024-03-30T13:14:13.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d99c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d941600b0 con 0x7f7d940cf990 2024-03-30T13:14:13.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d99c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9409b140 con 0x7f7d78004d40 2024-03-30T13:14:13.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d93400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d940c9580 0x7f7d940c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d93400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d940c9580 0x7f7d940c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52370/0 (socket says 172.21.15.99:52370) 2024-03-30T13:14:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d93400640 1 -- 172.21.15.99:0/1267795329 learned_addr learned my addr 172.21.15.99:0/1267795329 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d92000640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d940cf990 0x7f7d940c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d93400640 1 -- 172.21.15.99:0/1267795329 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d78004d40 msgr2=0x7f7d941522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d93400640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d78004d40 0x7f7d941522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d93400640 1 -- 172.21.15.99:0/1267795329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d940cf990 msgr2=0x7f7d940c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d93400640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d940cf990 0x7f7d940c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.063+0000 7f7d93400640 1 -- 172.21.15.99:0/1267795329 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d94152810 con 0x7f7d940c9580 2024-03-30T13:14:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.064+0000 7f7d93400640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d940c9580 0x7f7d940c8660 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c036040 tx=0x7f7d8c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.064+0000 7f7d8aa00640 1 -- 172.21.15.99:0/1267795329 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c009de0 con 0x7f7d940c9580 2024-03-30T13:14:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.064+0000 7f7d8aa00640 1 -- 172.21.15.99:0/1267795329 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8c02cb80 con 0x7f7d940c9580 2024-03-30T13:14:13.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.064+0000 7f7d8aa00640 1 -- 172.21.15.99:0/1267795329 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c034e60 con 0x7f7d940c9580 2024-03-30T13:14:13.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.064+0000 7f7d99c00640 1 -- 172.21.15.99:0/1267795329 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d940c7200 con 0x7f7d940c9580 2024-03-30T13:14:13.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.064+0000 7f7d99c00640 1 -- 172.21.15.99:0/1267795329 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d940cdf90 con 0x7f7d940c9580 2024-03-30T13:14:13.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.065+0000 7f7d99c00640 1 -- 172.21.15.99:0/1267795329 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d940a05c0 con 0x7f7d940c9580 2024-03-30T13:14:13.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.066+0000 7f7d8aa00640 1 -- 172.21.15.99:0/1267795329 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7d8c047030 con 0x7f7d940c9580 2024-03-30T13:14:13.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.067+0000 7f7d8aa00640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7d7006c560 0x7f7d7006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.068+0000 7f7d8aa00640 1 -- 172.21.15.99:0/1267795329 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f7d8c0adc50 con 0x7f7d940c9580 2024-03-30T13:14:13.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.068+0000 7f7d92a00640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7d7006c560 0x7f7d7006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.068+0000 7f7d92a00640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7d7006c560 0x7f7d7006ea20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009950 tx=0x7f7d84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:13.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.072+0000 7f7d8aa00640 1 -- 172.21.15.99:0/1267795329 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7d8c04e020 con 0x7f7d940c9580 2024-03-30T13:14:13.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.276+0000 7f7d99c00640 1 -- 172.21.15.99:0/1267795329 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7d940d02b0 con 0x7f7d940c9580 2024-03-30T13:14:13.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.277+0000 7f7d8aa00640 1 -- 172.21.15.99:0/1267795329 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f7d940c7200 con 0x7f7d940c9580 2024-03-30T13:14:13.282 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:14:13.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 -- 172.21.15.99:0/1267795329 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7d7006c560 msgr2=0x7f7d7006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7d7006c560 0x7f7d7006ea20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009950 tx=0x7f7d84008040 comp rx=0 tx=0).stop 2024-03-30T13:14:13.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 -- 172.21.15.99:0/1267795329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d940c9580 msgr2=0x7f7d940c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d940c9580 0x7f7d940c8660 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c036040 tx=0x7f7d8c009750 comp rx=0 tx=0).stop 2024-03-30T13:14:13.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 -- 172.21.15.99:0/1267795329 shutdown_connections 2024-03-30T13:14:13.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7d7006c560 0x7f7d7006ea20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d940c9580 0x7f7d940c8660 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d940cf990 0x7f7d940c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 --2- 172.21.15.99:0/1267795329 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d78004d40 0x7f7d941522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 -- 172.21.15.99:0/1267795329 >> 172.21.15.99:0/1267795329 conn(0x7f7d940b3fa0 msgr2=0x7f7d940b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:13.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 -- 172.21.15.99:0/1267795329 shutdown_connections 2024-03-30T13:14:13.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.280+0000 7f7d99c00640 1 -- 172.21.15.99:0/1267795329 wait complete. 2024-03-30T13:14:13.305 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:14:13.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.513+0000 7f800c400640 1 Processor -- start 2024-03-30T13:14:13.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.513+0000 7f800c400640 1 -- start start 2024-03-30T13:14:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.515+0000 7f800c400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80040ca950 0x7f80040b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.515+0000 7f800c400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80040cade0 con 0x7f800415b3d0 2024-03-30T13:14:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.515+0000 7f800c400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80040c6470 con 0x7f80040b26f0 2024-03-30T13:14:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.515+0000 7f800c400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f80040b2b60 con 0x7f80040ca950 2024-03-30T13:14:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.515+0000 7f8009000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80040ca950 0x7f80040b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.515+0000 7f8009a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f800415b3d0 0x7f80040b49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55964/0 (socket says 172.21.15.99:55964) 2024-03-30T13:14:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.515+0000 7f8009a00640 1 -- 172.21.15.99:0/2733169210 learned_addr learned my addr 172.21.15.99:0/2733169210 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:13.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.516+0000 7f8009000640 1 -- 172.21.15.99:0/2733169210 >> v1:172.21.15.181:6789/0 conn(0x7f80040b26f0 legacy=0x7f800415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.516+0000 7f8009000640 1 -- 172.21.15.99:0/2733169210 >> v1:172.21.15.99:6789/0 conn(0x7f800415b3d0 legacy=0x7f80040b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.516+0000 7f8009000640 1 -- 172.21.15.99:0/2733169210 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80040c6750 con 0x7f80040ca950 2024-03-30T13:14:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.516+0000 7f8003e00640 1 -- 172.21.15.99:0/2733169210 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228887538 0 0) 0x7f80040cade0 con 0x7f800415b3d0 2024-03-30T13:14:13.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.517+0000 7f8009000640 1 --2- 172.21.15.99:0/2733169210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80040ca950 0x7f80040b21b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00097a0 tx=0x7f7ff002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bb615f59017b1d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.517+0000 7f8003e00640 1 -- 172.21.15.99:0/2733169210 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0035020 con 0x7f80040ca950 2024-03-30T13:14:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.517+0000 7f8003e00640 1 -- 172.21.15.99:0/2733169210 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff0031830 con 0x7f80040ca950 2024-03-30T13:14:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.517+0000 7f8003e00640 1 -- 172.21.15.99:0/2733169210 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0031c00 con 0x7f80040ca950 2024-03-30T13:14:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.518+0000 7f800c400640 1 -- 172.21.15.99:0/2733169210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80040ca950 msgr2=0x7f80040b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.518+0000 7f800c400640 1 --2- 172.21.15.99:0/2733169210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80040ca950 0x7f80040b21b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00097a0 tx=0x7f7ff002b8d0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.518+0000 7f800c400640 1 -- 172.21.15.99:0/2733169210 shutdown_connections 2024-03-30T13:14:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.518+0000 7f800c400640 1 --2- 172.21.15.99:0/2733169210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80040ca950 0x7f80040b21b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.518+0000 7f800c400640 1 -- 172.21.15.99:0/2733169210 >> 172.21.15.99:0/2733169210 conn(0x7f80040d0450 msgr2=0x7f80040d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.518+0000 7f800c400640 1 -- 172.21.15.99:0/2733169210 shutdown_connections 2024-03-30T13:14:13.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.518+0000 7f800c400640 1 -- 172.21.15.99:0/2733169210 wait complete. 2024-03-30T13:14:13.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.520+0000 7f800c400640 1 Processor -- start 2024-03-30T13:14:13.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.520+0000 7f800c400640 1 -- start start 2024-03-30T13:14:13.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.521+0000 7f800c400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80040b26f0 0x7f80040c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.521+0000 7f800c400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80040ca950 0x7f800406f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.521+0000 7f800c400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800415b3d0 0x7f800406e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.521+0000 7f800c400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f80040c7080 con 0x7f80040b26f0 2024-03-30T13:14:13.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.521+0000 7f800c400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f80040c6d10 con 0x7f800415b3d0 2024-03-30T13:14:13.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.521+0000 7f800c400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f80040b5100 con 0x7f80040ca950 2024-03-30T13:14:13.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.521+0000 7f8009a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80040b26f0 0x7f80040c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.521+0000 7f8009a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80040b26f0 0x7f80040c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52378/0 (socket says 172.21.15.99:52378) 2024-03-30T13:14:13.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.521+0000 7f8009a00640 1 -- 172.21.15.99:0/2199847446 learned_addr learned my addr 172.21.15.99:0/2199847446 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:13.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f8009000640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80040ca950 0x7f800406f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f800a400640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800415b3d0 0x7f800406e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f8009a00640 1 -- 172.21.15.99:0/2199847446 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80040ca950 msgr2=0x7f800406f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f8009a00640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80040ca950 0x7f800406f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f8009a00640 1 -- 172.21.15.99:0/2199847446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800415b3d0 msgr2=0x7f800406e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f8009a00640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800415b3d0 0x7f800406e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f8009a00640 1 -- 172.21.15.99:0/2199847446 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80040ad240 con 0x7f80040b26f0 2024-03-30T13:14:13.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f800a400640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800415b3d0 0x7f800406e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:13.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f8009a00640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80040b26f0 0x7f80040c8860 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800c4d0 tx=0x7f7ff800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:13.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f8001600640 1 -- 172.21.15.99:0/2199847446 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8018070 con 0x7f80040b26f0 2024-03-30T13:14:13.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f8001600640 1 -- 172.21.15.99:0/2199847446 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff8007500 con 0x7f80040b26f0 2024-03-30T13:14:13.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f800c400640 1 -- 172.21.15.99:0/2199847446 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80040ad520 con 0x7f80040b26f0 2024-03-30T13:14:13.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f8001600640 1 -- 172.21.15.99:0/2199847446 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8004a20 con 0x7f80040b26f0 2024-03-30T13:14:13.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.522+0000 7f800c400640 1 -- 172.21.15.99:0/2199847446 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80040adae0 con 0x7f80040b26f0 2024-03-30T13:14:13.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.524+0000 7f800c400640 1 -- 172.21.15.99:0/2199847446 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f800409e520 con 0x7f80040b26f0 2024-03-30T13:14:13.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.524+0000 7f8001600640 1 -- 172.21.15.99:0/2199847446 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7ff801b070 con 0x7f80040b26f0 2024-03-30T13:14:13.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.526+0000 7f8001600640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fe406c530 0x7f7fe406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.526+0000 7f8001600640 1 -- 172.21.15.99:0/2199847446 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f7ff808aae0 con 0x7f80040b26f0 2024-03-30T13:14:13.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.526+0000 7f8009000640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fe406c530 0x7f7fe406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.527+0000 7f8009000640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fe406c530 0x7f7fe406e9f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0036000 tx=0x7f7ff0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:13.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.531+0000 7f8001600640 1 -- 172.21.15.99:0/2199847446 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7ff8059060 con 0x7f80040b26f0 2024-03-30T13:14:13.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.732+0000 7f800c400640 1 -- 172.21.15.99:0/2199847446 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f800404f9d0 con 0x7f80040b26f0 2024-03-30T13:14:13.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.733+0000 7f8001600640 1 -- 172.21.15.99:0/2199847446 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) ==== 104+0+11 (secure 0 0 0) 0x7f7ff8058960 con 0x7f80040b26f0 2024-03-30T13:14:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:14:13.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.735+0000 7f800c400640 1 -- 172.21.15.99:0/2199847446 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fe406c530 msgr2=0x7f7fe406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.735+0000 7f800c400640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fe406c530 0x7f7fe406e9f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0036000 tx=0x7f7ff0008030 comp rx=0 tx=0).stop 2024-03-30T13:14:13.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.735+0000 7f800c400640 1 -- 172.21.15.99:0/2199847446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80040b26f0 msgr2=0x7f80040c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.735+0000 7f800c400640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80040b26f0 0x7f80040c8860 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800c4d0 tx=0x7f7ff800c990 comp rx=0 tx=0).stop 2024-03-30T13:14:13.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.735+0000 7f800c400640 1 -- 172.21.15.99:0/2199847446 shutdown_connections 2024-03-30T13:14:13.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.735+0000 7f800c400640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7fe406c530 0x7f7fe406e9f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.735+0000 7f800c400640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800415b3d0 0x7f800406e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.735+0000 7f800c400640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80040ca950 0x7f800406f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.735+0000 7f800c400640 1 --2- 172.21.15.99:0/2199847446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80040b26f0 0x7f80040c8860 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.735+0000 7f800c400640 1 -- 172.21.15.99:0/2199847446 >> 172.21.15.99:0/2199847446 conn(0x7f80040d0450 msgr2=0x7f800415a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:13.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.736+0000 7f800c400640 1 -- 172.21.15.99:0/2199847446 shutdown_connections 2024-03-30T13:14:13.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.736+0000 7f800c400640 1 -- 172.21.15.99:0/2199847446 wait complete. 2024-03-30T13:14:13.760 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:14:13.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.967+0000 7f89d8600640 1 Processor -- start 2024-03-30T13:14:13.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.968+0000 7f89d8600640 1 -- start start 2024-03-30T13:14:13.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.969+0000 7f89d8600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f89d015a650 0x7f89d00b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.969+0000 7f89d8600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d00c6ac0 0x7f89d015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.969+0000 7f89d8600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d00c5130 con 0x7f89d00b4cd0 2024-03-30T13:14:13.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.969+0000 7f89d8600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f89d00c70e0 con 0x7f89d015a650 2024-03-30T13:14:13.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.969+0000 7f89d8600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f89d006ea70 con 0x7f89d00c6ac0 2024-03-30T13:14:13.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.969+0000 7f89d5200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f89d00b4cd0 0x7f89d00c63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55976/0 (socket says 172.21.15.99:55976) 2024-03-30T13:14:13.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.969+0000 7f89d5200640 1 -- 172.21.15.99:0/2510888518 learned_addr learned my addr 172.21.15.99:0/2510888518 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:13.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89d5c00640 1 --2- 172.21.15.99:0/2510888518 >> v2:172.21.15.181:3300/0 conn(0x7f89d015a650 0x7f89d00b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89d6600640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d00c6ac0 0x7f89d015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 423584635 0 0) 0x7f89d00c5130 con 0x7f89d00b4cd0 2024-03-30T13:14:13.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b8003520 con 0x7f89d00b4cd0 2024-03-30T13:14:13.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3436501617 0 0) 0x7f89b8003520 con 0x7f89d00b4cd0 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d00c6ac0 msgr2=0x7f89d015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d00c6ac0 0x7f89d015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 >> v2:172.21.15.181:3300/0 conn(0x7f89d015a650 msgr2=0x7f89d00b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 --2- 172.21.15.99:0/2510888518 >> v2:172.21.15.181:3300/0 conn(0x7f89d015a650 0x7f89d00b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d006ed50 con 0x7f89d00b4cd0 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f89bc001670 con 0x7f89d00b4cd0 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 >> v1:172.21.15.99:6789/0 conn(0x7f89d00b4cd0 legacy=0x7f89d00c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89b80039b0 0x7f89b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 0x7f89b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d00c6ac0 0x7f89b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f89d00c70e0 con 0x7f89b8004800 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.970+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f89d006ea70 con 0x7f89b80039b0 2024-03-30T13:14:13.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.971+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f89b800b9f0 con 0x7f89d00c6ac0 2024-03-30T13:14:13.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.971+0000 7f89d5200640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 0x7f89b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.971+0000 7f89d5c00640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89b80039b0 0x7f89b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.971+0000 7f89d6600640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d00c6ac0 0x7f89b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.971+0000 7f89d5200640 1 -- 172.21.15.99:0/2510888518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d00c6ac0 msgr2=0x7f89b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:13.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.971+0000 7f89d5200640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d00c6ac0 0x7f89b80051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.971+0000 7f89d5200640 1 -- 172.21.15.99:0/2510888518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89b80039b0 msgr2=0x7f89b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:13.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.971+0000 7f89d5200640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89b80039b0 0x7f89b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.971+0000 7f89d5200640 1 -- 172.21.15.99:0/2510888518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b8003520 con 0x7f89b8004800 2024-03-30T13:14:13.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.972+0000 7f89d5200640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 0x7f89b8004c80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00c210 tx=0x7f89b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c561b1d80ec6fc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:13.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.973+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc007d50 con 0x7f89b8004800 2024-03-30T13:14:13.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.973+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc030070 con 0x7f89b8004800 2024-03-30T13:14:13.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.973+0000 7f89cfe00640 1 -- 172.21.15.99:0/2510888518 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc02cd70 con 0x7f89b8004800 2024-03-30T13:14:13.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.973+0000 7f89d8600640 1 -- 172.21.15.99:0/2510888518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 msgr2=0x7f89b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.973+0000 7f89d8600640 1 --2- 172.21.15.99:0/2510888518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 0x7f89b8004c80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00c210 tx=0x7f89b8005830 comp rx=0 tx=0).stop 2024-03-30T13:14:13.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.973+0000 7f89d6600640 1 -- 172.21.15.99:0/2510888518 reap_dead start 2024-03-30T13:14:13.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.973+0000 7f89d8600640 1 -- 172.21.15.99:0/2510888518 shutdown_connections 2024-03-30T13:14:13.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.973+0000 7f89d8600640 1 -- 172.21.15.99:0/2510888518 >> 172.21.15.99:0/2510888518 conn(0x7f89d00d0450 msgr2=0x7f89d00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:13.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.973+0000 7f89d8600640 1 -- 172.21.15.99:0/2510888518 shutdown_connections 2024-03-30T13:14:13.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.973+0000 7f89d8600640 1 -- 172.21.15.99:0/2510888518 wait complete. 2024-03-30T13:14:13.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.975+0000 7f89d8600640 1 Processor -- start 2024-03-30T13:14:13.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.975+0000 7f89d8600640 1 -- start start 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.976+0000 7f89d8600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 0x7f89d0150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.976+0000 7f89d8600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89d0154d50 0x7f89d01532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.976+0000 7f89d8600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d0153810 0x7f89d00adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.976+0000 7f89d8600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f89d00b5130 con 0x7f89b8004800 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.976+0000 7f89d8600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f89d006f310 con 0x7f89d0154d50 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.976+0000 7f89d8600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f89d015aa30 con 0x7f89d0153810 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d5c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 0x7f89d0150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d5c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 0x7f89d0150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52390/0 (socket says 172.21.15.99:52390) 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d5c00640 1 -- 172.21.15.99:0/2326038902 learned_addr learned my addr 172.21.15.99:0/2326038902 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d5200640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89d0154d50 0x7f89d01532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d5c00640 1 -- 172.21.15.99:0/2326038902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d0153810 msgr2=0x7f89d00adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d6600640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d0153810 0x7f89d00adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d5c00640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d0153810 0x7f89d00adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d5c00640 1 -- 172.21.15.99:0/2326038902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89d0154d50 msgr2=0x7f89d01532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:13.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d5c00640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89d0154d50 0x7f89d01532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:13.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d5c00640 1 -- 172.21.15.99:0/2326038902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d0153cb0 con 0x7f89b8004800 2024-03-30T13:14:13.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d5200640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89d0154d50 0x7f89d01532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:13.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d6600640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d0153810 0x7f89d00adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:13.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.977+0000 7f89d5c00640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 0x7f89d0150c30 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f89c4011600 tx=0x7f89c4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:13.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.978+0000 7f89cd600640 1 -- 172.21.15.99:0/2326038902 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c400f8c0 con 0x7f89b8004800 2024-03-30T13:14:13.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.978+0000 7f89cd600640 1 -- 172.21.15.99:0/2326038902 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c400fa60 con 0x7f89b8004800 2024-03-30T13:14:13.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.978+0000 7f89cd600640 1 -- 172.21.15.99:0/2326038902 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c400fe10 con 0x7f89b8004800 2024-03-30T13:14:13.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.978+0000 7f89d8600640 1 -- 172.21.15.99:0/2326038902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d0153f90 con 0x7f89b8004800 2024-03-30T13:14:13.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.978+0000 7f89d8600640 1 -- 172.21.15.99:0/2326038902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d0154550 con 0x7f89b8004800 2024-03-30T13:14:13.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.979+0000 7f89d8600640 1 -- 172.21.15.99:0/2326038902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d009e520 con 0x7f89b8004800 2024-03-30T13:14:13.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.980+0000 7f89cd600640 1 -- 172.21.15.99:0/2326038902 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f89c4015460 con 0x7f89b8004800 2024-03-30T13:14:13.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.981+0000 7f89cd600640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f89b006c560 0x7f89b006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:13.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.981+0000 7f89cd600640 1 -- 172.21.15.99:0/2326038902 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f89c408c080 con 0x7f89b8004800 2024-03-30T13:14:13.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.981+0000 7f89d5200640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f89b006c560 0x7f89b006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:13.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.982+0000 7f89d5200640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f89b006c560 0x7f89b006ea20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f89bc034000 tx=0x7f89bc007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:13.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:13.985+0000 7f89cd600640 1 -- 172.21.15.99:0/2326038902 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f89c4019030 con 0x7f89b8004800 2024-03-30T13:14:14.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.186+0000 7f89d8600640 1 -- 172.21.15.99:0/2326038902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f89d004f9d0 con 0x7f89b8004800 2024-03-30T13:14:14.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.190+0000 7f89cd600640 1 -- 172.21.15.99:0/2326038902 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) ==== 100+0+11 (secure 0 0 0) 0x7f89c405a600 con 0x7f89b8004800 2024-03-30T13:14:14.195 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:14:14.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.193+0000 7f89d8600640 1 -- 172.21.15.99:0/2326038902 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f89b006c560 msgr2=0x7f89b006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:14.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.193+0000 7f89d8600640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f89b006c560 0x7f89b006ea20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f89bc034000 tx=0x7f89bc007000 comp rx=0 tx=0).stop 2024-03-30T13:14:14.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.193+0000 7f89d8600640 1 -- 172.21.15.99:0/2326038902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 msgr2=0x7f89d0150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:14.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.193+0000 7f89d8600640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 0x7f89d0150c30 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f89c4011600 tx=0x7f89c4011ac0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.194+0000 7f89d8600640 1 -- 172.21.15.99:0/2326038902 shutdown_connections 2024-03-30T13:14:14.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.194+0000 7f89d8600640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f89b006c560 0x7f89b006ea20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.194+0000 7f89d8600640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89d0153810 0x7f89d00adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.194+0000 7f89d8600640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89d0154d50 0x7f89d01532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.194+0000 7f89d8600640 1 --2- 172.21.15.99:0/2326038902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89b8004800 0x7f89d0150c30 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.194+0000 7f89d8600640 1 -- 172.21.15.99:0/2326038902 >> 172.21.15.99:0/2326038902 conn(0x7f89d00d0450 msgr2=0x7f89d00afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:14.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.194+0000 7f89d8600640 1 -- 172.21.15.99:0/2326038902 shutdown_connections 2024-03-30T13:14:14.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.194+0000 7f89d8600640 1 -- 172.21.15.99:0/2326038902 wait complete. 2024-03-30T13:14:14.217 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:14:14.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.420+0000 7fc84aa00640 1 Processor -- start 2024-03-30T13:14:14.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.421+0000 7fc84aa00640 1 -- start start 2024-03-30T13:14:14.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.422+0000 7fc84aa00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc844161c70 0x7fc8440d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:14.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.422+0000 7fc84aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc8440cfcb0 0x7fc8440d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:14.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.422+0000 7fc84aa00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8440d2350 con 0x7fc8440d0110 2024-03-30T13:14:14.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.422+0000 7fc84aa00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc8440d2c80 con 0x7fc8440cfcb0 2024-03-30T13:14:14.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.422+0000 7fc84aa00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc8440d2630 con 0x7fc844161c70 2024-03-30T13:14:14.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.422+0000 7fc843400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc8440cfcb0 0x7fc8440d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:14.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.422+0000 7fc843400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc8440cfcb0 0x7fc8440d0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52404/0 (socket says 172.21.15.99:52404) 2024-03-30T13:14:14.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.422+0000 7fc843400640 1 -- 172.21.15.99:0/119615405 learned_addr learned my addr 172.21.15.99:0/119615405 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:14.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.423+0000 7fc843e00640 1 --2- 172.21.15.99:0/119615405 >> v2:172.21.15.181:3300/0 conn(0x7fc844161c70 0x7fc8440d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:14.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.423+0000 7fc843400640 1 -- 172.21.15.99:0/119615405 >> v2:172.21.15.181:3300/0 conn(0x7fc844161c70 msgr2=0x7fc8440d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:14.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.423+0000 7fc843400640 1 --2- 172.21.15.99:0/119615405 >> v2:172.21.15.181:3300/0 conn(0x7fc844161c70 0x7fc8440d3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.423+0000 7fc843400640 1 -- 172.21.15.99:0/119615405 >> v1:172.21.15.181:6789/0 conn(0x7fc8440d0110 legacy=0x7fc8440b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:14.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.423+0000 7fc843400640 1 -- 172.21.15.99:0/119615405 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8440d2910 con 0x7fc8440cfcb0 2024-03-30T13:14:14.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.424+0000 7fc843400640 1 --2- 172.21.15.99:0/119615405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440cfcb0 0x7fc8440d0ed0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc8440d2e00 tx=0x7fc82c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba163b192aadedf1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:14.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.424+0000 7fc842a00640 1 -- 172.21.15.99:0/119615405 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c02e070 con 0x7fc8440cfcb0 2024-03-30T13:14:14.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.424+0000 7fc842a00640 1 -- 172.21.15.99:0/119615405 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c037070 con 0x7fc8440cfcb0 2024-03-30T13:14:14.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.424+0000 7fc842a00640 1 -- 172.21.15.99:0/119615405 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c031a00 con 0x7fc8440cfcb0 2024-03-30T13:14:14.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.425+0000 7fc84aa00640 1 -- 172.21.15.99:0/119615405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440cfcb0 msgr2=0x7fc8440d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:14.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.425+0000 7fc84aa00640 1 --2- 172.21.15.99:0/119615405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440cfcb0 0x7fc8440d0ed0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc8440d2e00 tx=0x7fc82c02b880 comp rx=0 tx=0).stop 2024-03-30T13:14:14.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.425+0000 7fc84aa00640 1 -- 172.21.15.99:0/119615405 shutdown_connections 2024-03-30T13:14:14.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.425+0000 7fc84aa00640 1 --2- 172.21.15.99:0/119615405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440cfcb0 0x7fc8440d0ed0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.425+0000 7fc84aa00640 1 --2- 172.21.15.99:0/119615405 >> v2:172.21.15.181:3300/0 conn(0x7fc844161c70 0x7fc8440d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.425+0000 7fc84aa00640 1 -- 172.21.15.99:0/119615405 >> 172.21.15.99:0/119615405 conn(0x7fc84408bfc0 msgr2=0x7fc8440d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:14.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.425+0000 7fc84aa00640 1 -- 172.21.15.99:0/119615405 shutdown_connections 2024-03-30T13:14:14.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.425+0000 7fc84aa00640 1 -- 172.21.15.99:0/119615405 wait complete. 2024-03-30T13:14:14.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.427+0000 7fc84aa00640 1 Processor -- start 2024-03-30T13:14:14.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.427+0000 7fc84aa00640 1 -- start start 2024-03-30T13:14:14.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.428+0000 7fc84aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440cfcb0 0x7fc8440b9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:14.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.428+0000 7fc84aa00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8440d0110 0x7fc844151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:14.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.428+0000 7fc84aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc844161c70 0x7fc8440c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:14.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.428+0000 7fc84aa00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc8440d53a0 con 0x7fc8440cfcb0 2024-03-30T13:14:14.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.428+0000 7fc84aa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc8440d5220 con 0x7fc844161c70 2024-03-30T13:14:14.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.428+0000 7fc84aa00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc8440d1410 con 0x7fc8440d0110 2024-03-30T13:14:14.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.428+0000 7fc843e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440cfcb0 0x7fc8440b9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:14.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.428+0000 7fc843e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440cfcb0 0x7fc8440b9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52408/0 (socket says 172.21.15.99:52408) 2024-03-30T13:14:14.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.428+0000 7fc843e00640 1 -- 172.21.15.99:0/1839293510 learned_addr learned my addr 172.21.15.99:0/1839293510 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:14.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc843e00640 1 -- 172.21.15.99:0/1839293510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8440d0110 msgr2=0x7fc844151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:14.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc843e00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8440d0110 0x7fc844151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc843e00640 1 -- 172.21.15.99:0/1839293510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc844161c70 msgr2=0x7fc8440c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:14.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc848a00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc844161c70 0x7fc8440c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:14.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc843e00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc844161c70 0x7fc8440c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc843e00640 1 -- 172.21.15.99:0/1839293510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8440b8d60 con 0x7fc8440cfcb0 2024-03-30T13:14:14.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc848a00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc844161c70 0x7fc8440c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:14.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc843e00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440cfcb0 0x7fc8440b9dc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc83400ccd0 tx=0x7fc83400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:14.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc83be00640 1 -- 172.21.15.99:0/1839293510 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834003990 con 0x7fc8440cfcb0 2024-03-30T13:14:14.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc83be00640 1 -- 172.21.15.99:0/1839293510 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc834003b30 con 0x7fc8440cfcb0 2024-03-30T13:14:14.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc84aa00640 1 -- 172.21.15.99:0/1839293510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8440b9000 con 0x7fc8440cfcb0 2024-03-30T13:14:14.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc83be00640 1 -- 172.21.15.99:0/1839293510 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834004020 con 0x7fc8440cfcb0 2024-03-30T13:14:14.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.429+0000 7fc84aa00640 1 -- 172.21.15.99:0/1839293510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8440b95c0 con 0x7fc8440cfcb0 2024-03-30T13:14:14.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.430+0000 7fc84aa00640 1 -- 172.21.15.99:0/1839293510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc844068640 con 0x7fc8440cfcb0 2024-03-30T13:14:14.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.431+0000 7fc83be00640 1 -- 172.21.15.99:0/1839293510 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc8340041c0 con 0x7fc8440cfcb0 2024-03-30T13:14:14.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.432+0000 7fc83be00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc82006c530 0x7fc82006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:14.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.432+0000 7fc83be00640 1 -- 172.21.15.99:0/1839293510 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fc83408bca0 con 0x7fc8440cfcb0 2024-03-30T13:14:14.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.433+0000 7fc843400640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc82006c530 0x7fc82006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:14.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.433+0000 7fc843400640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc82006c530 0x7fc82006e9f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc82c036000 tx=0x7fc82c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:14.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.437+0000 7fc83be00640 1 -- 172.21.15.99:0/1839293510 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc834014030 con 0x7fc8440cfcb0 2024-03-30T13:14:14.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.647+0000 7fc84aa00640 1 -- 172.21.15.99:0/1839293510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc8440b36f0 con 0x7fc8440cfcb0 2024-03-30T13:14:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.648+0000 7fc83be00640 1 -- 172.21.15.99:0/1839293510 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7fc83405a190 con 0x7fc8440cfcb0 2024-03-30T13:14:14.653 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-03-30T13:14:14.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.651+0000 7fc84aa00640 1 -- 172.21.15.99:0/1839293510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc82006c530 msgr2=0x7fc82006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:14.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.651+0000 7fc84aa00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc82006c530 0x7fc82006e9f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc82c036000 tx=0x7fc82c030000 comp rx=0 tx=0).stop 2024-03-30T13:14:14.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.651+0000 7fc84aa00640 1 -- 172.21.15.99:0/1839293510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440cfcb0 msgr2=0x7fc8440b9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:14.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.651+0000 7fc84aa00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440cfcb0 0x7fc8440b9dc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc83400ccd0 tx=0x7fc83400a5c0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.651+0000 7fc84aa00640 1 -- 172.21.15.99:0/1839293510 shutdown_connections 2024-03-30T13:14:14.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.651+0000 7fc84aa00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc82006c530 0x7fc82006e9f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.651+0000 7fc84aa00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc844161c70 0x7fc8440c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.651+0000 7fc84aa00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8440d0110 0x7fc844151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.651+0000 7fc84aa00640 1 --2- 172.21.15.99:0/1839293510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440cfcb0 0x7fc8440b9dc0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:14.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.651+0000 7fc84aa00640 1 -- 172.21.15.99:0/1839293510 >> 172.21.15.99:0/1839293510 conn(0x7fc84408bfc0 msgr2=0x7fc8440b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:14.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.652+0000 7fc84aa00640 1 -- 172.21.15.99:0/1839293510 shutdown_connections 2024-03-30T13:14:14.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:14.652+0000 7fc84aa00640 1 -- 172.21.15.99:0/1839293510 wait complete. 2024-03-30T13:14:14.675 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-30T13:14:14.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:14.676 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-30T13:14:14.909 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:14:14.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:14.910 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-30T13:14:14.950 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:14:14.950 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:14:14.951 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:14:14.988 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:14:14.988 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:14:15.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:14:15.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.271+0000 7fa508000640 1 Processor -- start 2024-03-30T13:14:15.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.271+0000 7fa508000640 1 -- start start 2024-03-30T13:14:15.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.272+0000 7fa508000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa500071fe0 0x7fa50006e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.273+0000 7fa508000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa50006d930 0x7fa5000adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.273+0000 7fa508000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa50006eee0 con 0x7fa500161e00 2024-03-30T13:14:15.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.273+0000 7fa508000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa5001621e0 con 0x7fa500071fe0 2024-03-30T13:14:15.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.273+0000 7fa508000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa50006f1c0 con 0x7fa50006d930 2024-03-30T13:14:15.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.273+0000 7fa504c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa500071fe0 0x7fa50006e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.273+0000 7fa504c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa500071fe0 0x7fa50006e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:60404/0 (socket says 172.21.15.99:60404) 2024-03-30T13:14:15.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.273+0000 7fa504c00640 1 -- 172.21.15.99:0/2301134537 learned_addr learned my addr 172.21.15.99:0/2301134537 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:15.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.273+0000 7fa506000640 1 --2- 172.21.15.99:0/2301134537 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa50006d930 0x7fa5000adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.274+0000 7fa504c00640 1 -- 172.21.15.99:0/2301134537 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa50006d930 msgr2=0x7fa5000adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:15.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.274+0000 7fa504c00640 1 --2- 172.21.15.99:0/2301134537 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa50006d930 0x7fa5000adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.274+0000 7fa504c00640 1 -- 172.21.15.99:0/2301134537 >> v1:172.21.15.181:6789/0 conn(0x7fa500161e00 legacy=0x7fa5000718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:15.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.274+0000 7fa504c00640 1 -- 172.21.15.99:0/2301134537 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5000ad3b0 con 0x7fa500071fe0 2024-03-30T13:14:15.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.275+0000 7fa504c00640 1 --2- 172.21.15.99:0/2301134537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa500071fe0 0x7fa50006e850 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009870 tx=0x7fa4ec02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=303e0aac3165ce80 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:15.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.275+0000 7fa4ffe00640 1 -- 172.21.15.99:0/2301134537 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec034070 con 0x7fa500071fe0 2024-03-30T13:14:15.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.276+0000 7fa4ffe00640 1 -- 172.21.15.99:0/2301134537 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ec030840 con 0x7fa500071fe0 2024-03-30T13:14:15.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.276+0000 7fa4ffe00640 1 -- 172.21.15.99:0/2301134537 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec030c10 con 0x7fa500071fe0 2024-03-30T13:14:15.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.276+0000 7fa508000640 1 -- 172.21.15.99:0/2301134537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa500071fe0 msgr2=0x7fa50006e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:15.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.276+0000 7fa508000640 1 --2- 172.21.15.99:0/2301134537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa500071fe0 0x7fa50006e850 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009870 tx=0x7fa4ec02b980 comp rx=0 tx=0).stop 2024-03-30T13:14:15.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.276+0000 7fa508000640 1 -- 172.21.15.99:0/2301134537 shutdown_connections 2024-03-30T13:14:15.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.276+0000 7fa508000640 1 --2- 172.21.15.99:0/2301134537 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa50006d930 0x7fa5000adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.276+0000 7fa508000640 1 --2- 172.21.15.99:0/2301134537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa500071fe0 0x7fa50006e850 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.276+0000 7fa508000640 1 -- 172.21.15.99:0/2301134537 >> 172.21.15.99:0/2301134537 conn(0x7fa50006b510 msgr2=0x7fa50006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:15.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.276+0000 7fa508000640 1 -- 172.21.15.99:0/2301134537 shutdown_connections 2024-03-30T13:14:15.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.276+0000 7fa508000640 1 -- 172.21.15.99:0/2301134537 wait complete. 2024-03-30T13:14:15.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.278+0000 7fa508000640 1 Processor -- start 2024-03-30T13:14:15.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.278+0000 7fa508000640 1 -- start start 2024-03-30T13:14:15.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.279+0000 7fa508000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa50006d930 0x7fa5001f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.279+0000 7fa508000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa500071fe0 0x7fa50015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.279+0000 7fa508000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa500161e00 0x7fa50015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.279+0000 7fa508000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa5000ae0f0 con 0x7fa500161e00 2024-03-30T13:14:15.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.279+0000 7fa508000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa5000b5270 con 0x7fa500071fe0 2024-03-30T13:14:15.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.279+0000 7fa508000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa5000ae270 con 0x7fa50006d930 2024-03-30T13:14:15.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.279+0000 7fa506000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa500161e00 0x7fa50015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.279+0000 7fa506000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa500161e00 0x7fa50015b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34668/0 (socket says 172.21.15.99:34668) 2024-03-30T13:14:15.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.279+0000 7fa506000640 1 -- 172.21.15.99:0/4283408843 learned_addr learned my addr 172.21.15.99:0/4283408843 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:15.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa504c00640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa500071fe0 0x7fa50015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa505600640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa50006d930 0x7fa5001f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa506000640 1 -- 172.21.15.99:0/4283408843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa50006d930 msgr2=0x7fa5001f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:15.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa506000640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa50006d930 0x7fa5001f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa506000640 1 -- 172.21.15.99:0/4283408843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa500071fe0 msgr2=0x7fa50015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:15.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa506000640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa500071fe0 0x7fa50015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa506000640 1 -- 172.21.15.99:0/4283408843 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5001f7ce0 con 0x7fa500161e00 2024-03-30T13:14:15.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa504c00640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa500071fe0 0x7fa50015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:15.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa506000640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa500161e00 0x7fa50015b9c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8007e70 tx=0x7fa4f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:15.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa4fd600640 1 -- 172.21.15.99:0/4283408843 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8014620 con 0x7fa500161e00 2024-03-30T13:14:15.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa4fd600640 1 -- 172.21.15.99:0/4283408843 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f8019070 con 0x7fa500161e00 2024-03-30T13:14:15.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa508000640 1 -- 172.21.15.99:0/4283408843 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa500158f70 con 0x7fa500161e00 2024-03-30T13:14:15.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.280+0000 7fa4fd600640 1 -- 172.21.15.99:0/4283408843 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8014a20 con 0x7fa500161e00 2024-03-30T13:14:15.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.281+0000 7fa508000640 1 -- 172.21.15.99:0/4283408843 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5001f7fa0 con 0x7fa500161e00 2024-03-30T13:14:15.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.282+0000 7fa508000640 1 -- 172.21.15.99:0/4283408843 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa500072870 con 0x7fa500161e00 2024-03-30T13:14:15.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.282+0000 7fa4fd600640 1 -- 172.21.15.99:0/4283408843 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa4f8014bc0 con 0x7fa500161e00 2024-03-30T13:14:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.283+0000 7fa4fd600640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa4e006c560 0x7fa4e006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.283+0000 7fa4fd600640 1 -- 172.21.15.99:0/4283408843 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fa4f808c110 con 0x7fa500161e00 2024-03-30T13:14:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.284+0000 7fa505600640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa4e006c560 0x7fa4e006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.284+0000 7fa505600640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa4e006c560 0x7fa4e006ea20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4000f60 tx=0x7fa4f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:15.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.288+0000 7fa4fd600640 1 -- 172.21.15.99:0/4283408843 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa500072870 con 0x7fa500161e00 2024-03-30T13:14:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.487+0000 7fa508000640 1 -- 172.21.15.99:0/4283408843 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa500068640 con 0x7fa500161e00 2024-03-30T13:14:15.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.490+0000 7fa4fd600640 1 -- 172.21.15.99:0/4283408843 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16926 (secure 0 0 0) 0x7fa4f805a600 con 0x7fa500161e00 2024-03-30T13:14:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:15.496 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":40,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:14:10.165267+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:12:02.458079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:12:03.597299+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 -- 172.21.15.99:0/4283408843 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa4e006c560 msgr2=0x7fa4e006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa4e006c560 0x7fa4e006ea20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4000f60 tx=0x7fa4f4009040 comp rx=0 tx=0).stop 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 -- 172.21.15.99:0/4283408843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa500161e00 msgr2=0x7fa50015b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa500161e00 0x7fa50015b9c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8007e70 tx=0x7fa4f800e4b0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 -- 172.21.15.99:0/4283408843 shutdown_connections 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa4e006c560 0x7fa4e006ea20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa500161e00 0x7fa50015b9c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa500071fe0 0x7fa50015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 --2- 172.21.15.99:0/4283408843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa50006d930 0x7fa5001f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 -- 172.21.15.99:0/4283408843 >> 172.21.15.99:0/4283408843 conn(0x7fa50006b510 msgr2=0x7fa5000d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 -- 172.21.15.99:0/4283408843 shutdown_connections 2024-03-30T13:14:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.493+0000 7fa508000640 1 -- 172.21.15.99:0/4283408843 wait complete. 2024-03-30T13:14:15.515 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:12:02.458079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:12:03.597299+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 39, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:14:15.516 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:14:15.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.717+0000 7fd32fc00640 1 Processor -- start 2024-03-30T13:14:15.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.717+0000 7fd32fc00640 1 -- start start 2024-03-30T13:14:15.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.719+0000 7fd32fc00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd32815e8b0 0x7fd3280b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.719+0000 7fd32fc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd3280b6020 0x7fd3280b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.719+0000 7fd32fc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd32806b510 0x7fd32806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.719+0000 7fd32fc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd3280b67e0 con 0x7fd3280b6020 2024-03-30T13:14:15.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.719+0000 7fd32fc00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd3280b6500 con 0x7fd32815e8b0 2024-03-30T13:14:15.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.719+0000 7fd32fc00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd3280b4470 con 0x7fd32806b510 2024-03-30T13:14:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.719+0000 7fd327e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd3280b6020 0x7fd3280b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.720+0000 7fd32dc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd32806b510 0x7fd32806b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.720+0000 7fd327e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd3280b6020 0x7fd3280b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34678/0 (socket says 172.21.15.99:34678) 2024-03-30T13:14:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.720+0000 7fd327e00640 1 -- 172.21.15.99:0/2061742287 learned_addr learned my addr 172.21.15.99:0/2061742287 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:15.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.720+0000 7fd32d200640 1 --2- 172.21.15.99:0/2061742287 >> v2:172.21.15.181:3300/0 conn(0x7fd32815e8b0 0x7fd3280b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.720+0000 7fd327e00640 1 -- 172.21.15.99:0/2061742287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd32806b510 msgr2=0x7fd32806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.720+0000 7fd327e00640 1 --2- 172.21.15.99:0/2061742287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd32806b510 0x7fd32806b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.720+0000 7fd327e00640 1 -- 172.21.15.99:0/2061742287 >> v2:172.21.15.181:3300/0 conn(0x7fd32815e8b0 msgr2=0x7fd3280b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.720+0000 7fd327e00640 1 --2- 172.21.15.99:0/2061742287 >> v2:172.21.15.181:3300/0 conn(0x7fd32815e8b0 0x7fd3280b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.720+0000 7fd327e00640 1 -- 172.21.15.99:0/2061742287 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3280b4750 con 0x7fd3280b6020 2024-03-30T13:14:15.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.720+0000 7fd32d200640 1 --2- 172.21.15.99:0/2061742287 >> v2:172.21.15.181:3300/0 conn(0x7fd32815e8b0 0x7fd3280b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:15.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.721+0000 7fd327e00640 1 --2- 172.21.15.99:0/2061742287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3280b6020 0x7fd3280b2140 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd328072120 tx=0x7fd31002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f3b4a8ede60234 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:15.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.721+0000 7fd327400640 1 -- 172.21.15.99:0/2061742287 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31002e070 con 0x7fd3280b6020 2024-03-30T13:14:15.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.722+0000 7fd327400640 1 -- 172.21.15.99:0/2061742287 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd310037070 con 0x7fd3280b6020 2024-03-30T13:14:15.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.722+0000 7fd327400640 1 -- 172.21.15.99:0/2061742287 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd310031a00 con 0x7fd3280b6020 2024-03-30T13:14:15.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.722+0000 7fd32fc00640 1 -- 172.21.15.99:0/2061742287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3280b6020 msgr2=0x7fd3280b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:15.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.722+0000 7fd32fc00640 1 --2- 172.21.15.99:0/2061742287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3280b6020 0x7fd3280b2140 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd328072120 tx=0x7fd31002b880 comp rx=0 tx=0).stop 2024-03-30T13:14:15.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.722+0000 7fd32fc00640 1 -- 172.21.15.99:0/2061742287 shutdown_connections 2024-03-30T13:14:15.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.722+0000 7fd32fc00640 1 --2- 172.21.15.99:0/2061742287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd32806b510 0x7fd32806b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.722+0000 7fd32fc00640 1 --2- 172.21.15.99:0/2061742287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3280b6020 0x7fd3280b2140 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.722+0000 7fd32fc00640 1 --2- 172.21.15.99:0/2061742287 >> v2:172.21.15.181:3300/0 conn(0x7fd32815e8b0 0x7fd3280b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.722+0000 7fd32fc00640 1 -- 172.21.15.99:0/2061742287 >> 172.21.15.99:0/2061742287 conn(0x7fd328072e40 msgr2=0x7fd3280b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:15.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.722+0000 7fd32fc00640 1 -- 172.21.15.99:0/2061742287 shutdown_connections 2024-03-30T13:14:15.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.722+0000 7fd32fc00640 1 -- 172.21.15.99:0/2061742287 wait complete. 2024-03-30T13:14:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.724+0000 7fd32fc00640 1 Processor -- start 2024-03-30T13:14:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.724+0000 7fd32fc00640 1 -- start start 2024-03-30T13:14:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.725+0000 7fd32fc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd32806b510 0x7fd3281f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.725+0000 7fd32fc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b6020 0x7fd328155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.725+0000 7fd32fc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd32815e8b0 0x7fd328147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.725+0000 7fd32fc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd3280b2680 con 0x7fd32806b510 2024-03-30T13:14:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.725+0000 7fd32fc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd3280b4b30 con 0x7fd3280b6020 2024-03-30T13:14:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.725+0000 7fd32fc00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd3281559a0 con 0x7fd32815e8b0 2024-03-30T13:14:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.725+0000 7fd32d200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd32806b510 0x7fd3281f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.725+0000 7fd32d200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd32806b510 0x7fd3281f82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34684/0 (socket says 172.21.15.99:34684) 2024-03-30T13:14:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.725+0000 7fd32d200640 1 -- 172.21.15.99:0/1112670848 learned_addr learned my addr 172.21.15.99:0/1112670848 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.725+0000 7fd32dc00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd32815e8b0 0x7fd328147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.725+0000 7fd327e00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b6020 0x7fd328155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd32d200640 1 -- 172.21.15.99:0/1112670848 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd32815e8b0 msgr2=0x7fd328147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd32d200640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd32815e8b0 0x7fd328147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd32d200640 1 -- 172.21.15.99:0/1112670848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b6020 msgr2=0x7fd328155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd32d200640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b6020 0x7fd328155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd32d200640 1 -- 172.21.15.99:0/1112670848 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd328147b60 con 0x7fd32806b510 2024-03-30T13:14:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd327e00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b6020 0x7fd328155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:15.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd32d200640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd32806b510 0x7fd3281f82e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd318009fc0 tx=0x7fd31800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:15.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd324c00640 1 -- 172.21.15.99:0/1112670848 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31801a070 con 0x7fd32806b510 2024-03-30T13:14:15.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd324c00640 1 -- 172.21.15.99:0/1112670848 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd318003bb0 con 0x7fd32806b510 2024-03-30T13:14:15.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd324c00640 1 -- 172.21.15.99:0/1112670848 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318004030 con 0x7fd32806b510 2024-03-30T13:14:15.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd32fc00640 1 -- 172.21.15.99:0/1112670848 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd328155bd0 con 0x7fd32806b510 2024-03-30T13:14:15.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.726+0000 7fd32fc00640 1 -- 172.21.15.99:0/1112670848 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd328156190 con 0x7fd32806b510 2024-03-30T13:14:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.727+0000 7fd32fc00640 1 -- 172.21.15.99:0/1112670848 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32809aee0 con 0x7fd32806b510 2024-03-30T13:14:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.728+0000 7fd324c00640 1 -- 172.21.15.99:0/1112670848 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd31801d070 con 0x7fd32806b510 2024-03-30T13:14:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.729+0000 7fd324c00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd30406c530 0x7fd30406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.729+0000 7fd324c00640 1 -- 172.21.15.99:0/1112670848 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fd31808ba40 con 0x7fd32806b510 2024-03-30T13:14:15.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.730+0000 7fd327e00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd30406c530 0x7fd30406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:15.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.730+0000 7fd327e00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd30406c530 0x7fd30406e9f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd310036000 tx=0x7fd310008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:15.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.734+0000 7fd324c00640 1 -- 172.21.15.99:0/1112670848 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd32809aee0 con 0x7fd32806b510 2024-03-30T13:14:15.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.932+0000 7fd32fc00640 1 -- 172.21.15.99:0/1112670848 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd32809f6a0 con 0x7fd32806b510 2024-03-30T13:14:15.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.933+0000 7fd324c00640 1 -- 172.21.15.99:0/1112670848 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7fd318010070 con 0x7fd32806b510 2024-03-30T13:14:15.937 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:14:15.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.935+0000 7fd32fc00640 1 -- 172.21.15.99:0/1112670848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd30406c530 msgr2=0x7fd30406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:15.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.935+0000 7fd32fc00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd30406c530 0x7fd30406e9f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd310036000 tx=0x7fd310008030 comp rx=0 tx=0).stop 2024-03-30T13:14:15.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.935+0000 7fd32fc00640 1 -- 172.21.15.99:0/1112670848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd32806b510 msgr2=0x7fd3281f82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:15.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.935+0000 7fd32fc00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd32806b510 0x7fd3281f82e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd318009fc0 tx=0x7fd31800d560 comp rx=0 tx=0).stop 2024-03-30T13:14:15.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.936+0000 7fd32fc00640 1 -- 172.21.15.99:0/1112670848 shutdown_connections 2024-03-30T13:14:15.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.936+0000 7fd32fc00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fd30406c530 0x7fd30406e9f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.936+0000 7fd32fc00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd32815e8b0 0x7fd328147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.936+0000 7fd32fc00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b6020 0x7fd328155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.936+0000 7fd32fc00640 1 --2- 172.21.15.99:0/1112670848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd32806b510 0x7fd3281f82e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:15.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.936+0000 7fd32fc00640 1 -- 172.21.15.99:0/1112670848 >> 172.21.15.99:0/1112670848 conn(0x7fd328072e40 msgr2=0x7fd32806e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:15.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.936+0000 7fd32fc00640 1 -- 172.21.15.99:0/1112670848 shutdown_connections 2024-03-30T13:14:15.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:15.936+0000 7fd32fc00640 1 -- 172.21.15.99:0/1112670848 wait complete. 2024-03-30T13:14:15.959 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:14:16.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.166+0000 7f2f17000640 1 Processor -- start 2024-03-30T13:14:16.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.167+0000 7f2f17000640 1 -- start start 2024-03-30T13:14:16.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.168+0000 7f2f17000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f101624b0 0x7f2f100b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.168+0000 7f2f17000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f100cca60 0x7f2f100d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.168+0000 7f2f17000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f1006d1b0 con 0x7f2f100ccea0 2024-03-30T13:14:16.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.168+0000 7f2f17000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2f100d0a10 con 0x7f2f101624b0 2024-03-30T13:14:16.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.168+0000 7f2f17000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1006d470 con 0x7f2f100cca60 2024-03-30T13:14:16.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.168+0000 7f2f15000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2f100ccea0 0x7f2f10162890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46108/0 (socket says 172.21.15.99:46108) 2024-03-30T13:14:16.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.168+0000 7f2f15000640 1 -- 172.21.15.99:0/2741340666 learned_addr learned my addr 172.21.15.99:0/2741340666 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:16.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.169+0000 7f2f0fe00640 1 --2- 172.21.15.99:0/2741340666 >> v2:172.21.15.181:3300/0 conn(0x7f2f101624b0 0x7f2f100b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.169+0000 7f2f0f400640 1 --2- 172.21.15.99:0/2741340666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f100cca60 0x7f2f100d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.169+0000 7f2f0ea00640 1 -- 172.21.15.99:0/2741340666 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1474470662 0 0) 0x7f2f1006d1b0 con 0x7f2f100ccea0 2024-03-30T13:14:16.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.169+0000 7f2f0ea00640 1 -- 172.21.15.99:0/2741340666 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef4003520 con 0x7f2f100ccea0 2024-03-30T13:14:16.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.169+0000 7f2f0ea00640 1 -- 172.21.15.99:0/2741340666 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3437179808 0 0) 0x7f2ef4003520 con 0x7f2f100ccea0 2024-03-30T13:14:16.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.169+0000 7f2f0f400640 1 -- 172.21.15.99:0/2741340666 >> v2:172.21.15.181:3300/0 conn(0x7f2f101624b0 msgr2=0x7f2f100b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:16.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.169+0000 7f2f0f400640 1 --2- 172.21.15.99:0/2741340666 >> v2:172.21.15.181:3300/0 conn(0x7f2f101624b0 0x7f2f100b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.169+0000 7f2f0f400640 1 -- 172.21.15.99:0/2741340666 >> v1:172.21.15.99:6789/0 conn(0x7f2f100ccea0 legacy=0x7f2f10162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.169+0000 7f2f0f400640 1 -- 172.21.15.99:0/2741340666 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1006d750 con 0x7f2f100cca60 2024-03-30T13:14:16.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.171+0000 7f2f0f400640 1 --2- 172.21.15.99:0/2741340666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f100cca60 0x7f2f100d0ea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80097a0 tx=0x7f2ef802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e818b6efbcc52ff0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:16.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.171+0000 7f2f0ea00640 1 -- 172.21.15.99:0/2741340666 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8037070 con 0x7f2f100cca60 2024-03-30T13:14:16.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.171+0000 7f2f0ea00640 1 -- 172.21.15.99:0/2741340666 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef8030510 con 0x7f2f100cca60 2024-03-30T13:14:16.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.171+0000 7f2f0ea00640 1 -- 172.21.15.99:0/2741340666 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f080019f0 con 0x7f2f100cca60 2024-03-30T13:14:16.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.172+0000 7f2f17000640 1 -- 172.21.15.99:0/2741340666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f100cca60 msgr2=0x7f2f100d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.172+0000 7f2f17000640 1 --2- 172.21.15.99:0/2741340666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f100cca60 0x7f2f100d0ea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80097a0 tx=0x7f2ef802b790 comp rx=0 tx=0).stop 2024-03-30T13:14:16.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.172+0000 7f2f17000640 1 -- 172.21.15.99:0/2741340666 shutdown_connections 2024-03-30T13:14:16.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.172+0000 7f2f17000640 1 --2- 172.21.15.99:0/2741340666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f100cca60 0x7f2f100d0ea0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.172+0000 7f2f17000640 1 --2- 172.21.15.99:0/2741340666 >> v2:172.21.15.181:3300/0 conn(0x7f2f101624b0 0x7f2f100b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.172+0000 7f2f17000640 1 -- 172.21.15.99:0/2741340666 >> 172.21.15.99:0/2741340666 conn(0x7f2f100b3f00 msgr2=0x7f2f100b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:16.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.172+0000 7f2f17000640 1 -- 172.21.15.99:0/2741340666 shutdown_connections 2024-03-30T13:14:16.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.172+0000 7f2f17000640 1 -- 172.21.15.99:0/2741340666 wait complete. 2024-03-30T13:14:16.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.174+0000 7f2f17000640 1 Processor -- start 2024-03-30T13:14:16.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.174+0000 7f2f17000640 1 -- start start 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.175+0000 7f2f17000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f100cca60 0x7f2f100b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.175+0000 7f2f17000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f100ccea0 0x7f2f1015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.175+0000 7f2f17000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f101624b0 0x7f2f100c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.175+0000 7f2f17000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1015feb0 con 0x7f2f101624b0 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.175+0000 7f2f17000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1015fd30 con 0x7f2f100cca60 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.175+0000 7f2f17000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2f10162fa0 con 0x7f2f100ccea0 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.175+0000 7f2f15000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f101624b0 0x7f2f100c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.175+0000 7f2f15000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f101624b0 0x7f2f100c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34692/0 (socket says 172.21.15.99:34692) 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.175+0000 7f2f15000640 1 -- 172.21.15.99:0/3962530679 learned_addr learned my addr 172.21.15.99:0/3962530679 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.175+0000 7f2f0f400640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f100ccea0 0x7f2f1015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.175+0000 7f2f15000640 1 -- 172.21.15.99:0/3962530679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f100ccea0 msgr2=0x7f2f1015dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.176+0000 7f2f15000640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f100ccea0 0x7f2f1015dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.176+0000 7f2f15000640 1 -- 172.21.15.99:0/3962530679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f100cca60 msgr2=0x7f2f100b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.176+0000 7f2f15000640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f100cca60 0x7f2f100b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.176+0000 7f2f15000640 1 -- 172.21.15.99:0/3962530679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f100b6c10 con 0x7f2f101624b0 2024-03-30T13:14:16.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.176+0000 7f2f15000640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f101624b0 0x7f2f100c5f40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2f08001560 tx=0x7f2f0800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:16.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.176+0000 7f2f07e00640 1 -- 172.21.15.99:0/3962530679 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08012400 con 0x7f2f101624b0 2024-03-30T13:14:16.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.176+0000 7f2f07e00640 1 -- 172.21.15.99:0/3962530679 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f080125c0 con 0x7f2f101624b0 2024-03-30T13:14:16.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.176+0000 7f2f17000640 1 -- 172.21.15.99:0/3962530679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f100b6ef0 con 0x7f2f101624b0 2024-03-30T13:14:16.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.176+0000 7f2f07e00640 1 -- 172.21.15.99:0/3962530679 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f080129b0 con 0x7f2f101624b0 2024-03-30T13:14:16.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.176+0000 7f2f17000640 1 -- 172.21.15.99:0/3962530679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f100b71d0 con 0x7f2f101624b0 2024-03-30T13:14:16.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.177+0000 7f2f17000640 1 -- 172.21.15.99:0/3962530679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1015c540 con 0x7f2f101624b0 2024-03-30T13:14:16.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.178+0000 7f2f07e00640 1 -- 172.21.15.99:0/3962530679 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2f08012b50 con 0x7f2f101624b0 2024-03-30T13:14:16.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.179+0000 7f2f07e00640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2eec06c560 0x7f2eec06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.179+0000 7f2f07e00640 1 -- 172.21.15.99:0/3962530679 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f2f0808bfe0 con 0x7f2f101624b0 2024-03-30T13:14:16.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.179+0000 7f2f0fe00640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2eec06c560 0x7f2eec06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.180+0000 7f2f0fe00640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2eec06c560 0x7f2eec06ea20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2f00006a90 tx=0x7f2f00006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:16.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.183+0000 7f2f07e00640 1 -- 172.21.15.99:0/3962530679 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2f080182b0 con 0x7f2f101624b0 2024-03-30T13:14:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.384+0000 7f2f17000640 1 -- 172.21.15.99:0/3962530679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2f100a04c0 con 0x7f2f101624b0 2024-03-30T13:14:16.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.385+0000 7f2f07e00640 1 -- 172.21.15.99:0/3962530679 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) ==== 104+0+11 (secure 0 0 0) 0x7f2f0805a530 con 0x7f2f101624b0 2024-03-30T13:14:16.390 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:14:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 -- 172.21.15.99:0/3962530679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2eec06c560 msgr2=0x7f2eec06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2eec06c560 0x7f2eec06ea20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2f00006a90 tx=0x7f2f00006a20 comp rx=0 tx=0).stop 2024-03-30T13:14:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 -- 172.21.15.99:0/3962530679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f101624b0 msgr2=0x7f2f100c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f101624b0 0x7f2f100c5f40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2f08001560 tx=0x7f2f0800a430 comp rx=0 tx=0).stop 2024-03-30T13:14:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 -- 172.21.15.99:0/3962530679 shutdown_connections 2024-03-30T13:14:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2eec06c560 0x7f2eec06ea20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f101624b0 0x7f2f100c5f40 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f100ccea0 0x7f2f1015dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 --2- 172.21.15.99:0/3962530679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f100cca60 0x7f2f100b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 -- 172.21.15.99:0/3962530679 >> 172.21.15.99:0/3962530679 conn(0x7f2f100b3f00 msgr2=0x7f2f1006fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:16.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 -- 172.21.15.99:0/3962530679 shutdown_connections 2024-03-30T13:14:16.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.388+0000 7f2f17000640 1 -- 172.21.15.99:0/3962530679 wait complete. 2024-03-30T13:14:16.412 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:14:16.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.626+0000 7f86df200640 1 Processor -- start 2024-03-30T13:14:16.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.626+0000 7f86df200640 1 -- start start 2024-03-30T13:14:16.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.627+0000 7f86df200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f86d80cf330 0x7f86d815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.628+0000 7f86df200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d815d7b0 con 0x7f86d80acf20 2024-03-30T13:14:16.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.628+0000 7f86df200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d806d840 con 0x7f86d815d190 2024-03-30T13:14:16.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.628+0000 7f86df200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f86d806db20 con 0x7f86d80cf330 2024-03-30T13:14:16.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.628+0000 7f86dd400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f86d80acf20 0x7f86d815ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46110/0 (socket says 172.21.15.99:46110) 2024-03-30T13:14:16.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.628+0000 7f86dd400640 1 -- 172.21.15.99:0/3550415320 learned_addr learned my addr 172.21.15.99:0/3550415320 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:16.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.628+0000 7f86dde00640 1 --2- 172.21.15.99:0/3550415320 >> v2:172.21.15.181:3300/0 conn(0x7f86d80cf330 0x7f86d815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.628+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441482600 0 0) 0x7f86d815d7b0 con 0x7f86d80acf20 2024-03-30T13:14:16.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.628+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86c0003520 con 0x7f86d80acf20 2024-03-30T13:14:16.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2511622276 0 0) 0x7f86c0003520 con 0x7f86d80acf20 2024-03-30T13:14:16.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 >> v2:172.21.15.181:3300/0 conn(0x7f86d80cf330 msgr2=0x7f86d815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:16.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 --2- 172.21.15.99:0/3550415320 >> v2:172.21.15.181:3300/0 conn(0x7f86d80cf330 0x7f86d815dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 >> v1:172.21.15.181:6789/0 conn(0x7f86d815d190 legacy=0x7f86d806e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d806de00 con 0x7f86d80acf20 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f86c4001670 con 0x7f86d80acf20 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 >> v1:172.21.15.99:6789/0 conn(0x7f86d80acf20 legacy=0x7f86d815ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 --2- 172.21.15.99:0/3550415320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 0x7f86c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 --2- 172.21.15.99:0/3550415320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86c0004800 0x7f86c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 --2- 172.21.15.99:0/3550415320 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86c00051c0 0x7f86c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f86d806db20 con 0x7f86c00039b0 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f86c000c060 con 0x7f86c0004800 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f86c000c260 con 0x7f86c00051c0 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.629+0000 7f86dde00640 1 --2- 172.21.15.99:0/3550415320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 0x7f86c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.630+0000 7f86dde00640 1 -- 172.21.15.99:0/3550415320 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86c00051c0 msgr2=0x7f86c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.630+0000 7f86dd400640 1 --2- 172.21.15.99:0/3550415320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86c0004800 0x7f86c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.630+0000 7f86dde00640 1 --2- 172.21.15.99:0/3550415320 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86c00051c0 0x7f86c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.630+0000 7f86dde00640 1 -- 172.21.15.99:0/3550415320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86c0004800 msgr2=0x7f86c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:16.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.630+0000 7f86dde00640 1 --2- 172.21.15.99:0/3550415320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86c0004800 0x7f86c0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.630+0000 7f86dde00640 1 -- 172.21.15.99:0/3550415320 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c0003520 con 0x7f86c00039b0 2024-03-30T13:14:16.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.630+0000 7f86de800640 1 -- 172.21.15.99:0/3550415320 reap_dead start 2024-03-30T13:14:16.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.631+0000 7f86dde00640 1 --2- 172.21.15.99:0/3550415320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 0x7f86c0003dd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009ac0 tx=0x7f86c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688c78f99a84581b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:16.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.631+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc039070 con 0x7f86c00039b0 2024-03-30T13:14:16.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.631+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc02c6d0 con 0x7f86c00039b0 2024-03-30T13:14:16.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.631+0000 7f86dca00640 1 -- 172.21.15.99:0/3550415320 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc009690 con 0x7f86c00039b0 2024-03-30T13:14:16.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.632+0000 7f86df200640 1 -- 172.21.15.99:0/3550415320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 msgr2=0x7f86c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.632+0000 7f86df200640 1 --2- 172.21.15.99:0/3550415320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 0x7f86c0003dd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009ac0 tx=0x7f86c0005830 comp rx=0 tx=0).stop 2024-03-30T13:14:16.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.632+0000 7f86df200640 1 -- 172.21.15.99:0/3550415320 shutdown_connections 2024-03-30T13:14:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.632+0000 7f86df200640 1 --2- 172.21.15.99:0/3550415320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 0x7f86c0003dd0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.632+0000 7f86df200640 1 -- 172.21.15.99:0/3550415320 >> 172.21.15.99:0/3550415320 conn(0x7f86d806bb40 msgr2=0x7f86d80b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.632+0000 7f86df200640 1 -- 172.21.15.99:0/3550415320 shutdown_connections 2024-03-30T13:14:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.632+0000 7f86df200640 1 -- 172.21.15.99:0/3550415320 wait complete. 2024-03-30T13:14:16.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.633+0000 7f86df200640 1 Processor -- start 2024-03-30T13:14:16.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.634+0000 7f86df200640 1 -- start start 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.634+0000 7f86df200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 0x7f86d81f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.634+0000 7f86df200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86d80b1d60 0x7f86d8141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.634+0000 7f86df200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86d81f2790 0x7f86d81f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86df200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f86d815e100 con 0x7f86c00039b0 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86df200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f86d815df80 con 0x7f86d81f2790 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86df200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f86d80ad3a0 con 0x7f86d80b1d60 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86dde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 0x7f86d81f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86dde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 0x7f86d81f56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34708/0 (socket says 172.21.15.99:34708) 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86dde00640 1 -- 172.21.15.99:0/2370695343 learned_addr learned my addr 172.21.15.99:0/2370695343 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86de800640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86d81f2790 0x7f86d81f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86dde00640 1 -- 172.21.15.99:0/2370695343 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86d80b1d60 msgr2=0x7f86d8141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86dd400640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86d80b1d60 0x7f86d8141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86dde00640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86d80b1d60 0x7f86d8141b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86dde00640 1 -- 172.21.15.99:0/2370695343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86d81f2790 msgr2=0x7f86d81f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86dde00640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86d81f2790 0x7f86d81f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86dde00640 1 -- 172.21.15.99:0/2370695343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d81f5d10 con 0x7f86c00039b0 2024-03-30T13:14:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.635+0000 7f86de800640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86d81f2790 0x7f86d81f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.636+0000 7f86dde00640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 0x7f86d81f56c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009ac0 tx=0x7f86cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.636+0000 7f86d2000640 1 -- 172.21.15.99:0/2370695343 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc039050 con 0x7f86c00039b0 2024-03-30T13:14:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.636+0000 7f86d2000640 1 -- 172.21.15.99:0/2370695343 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc045070 con 0x7f86c00039b0 2024-03-30T13:14:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.636+0000 7f86d2000640 1 -- 172.21.15.99:0/2370695343 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0044e0 con 0x7f86c00039b0 2024-03-30T13:14:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.636+0000 7f86df200640 1 -- 172.21.15.99:0/2370695343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d81f5ff0 con 0x7f86c00039b0 2024-03-30T13:14:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.636+0000 7f86df200640 1 -- 172.21.15.99:0/2370695343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d81420a0 con 0x7f86c00039b0 2024-03-30T13:14:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.637+0000 7f86df200640 1 -- 172.21.15.99:0/2370695343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d804f8f0 con 0x7f86c00039b0 2024-03-30T13:14:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.638+0000 7f86d2000640 1 -- 172.21.15.99:0/2370695343 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f86cc003a30 con 0x7f86c00039b0 2024-03-30T13:14:16.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.639+0000 7f86d2000640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86b806c560 0x7f86b806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:16.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.639+0000 7f86d2000640 1 -- 172.21.15.99:0/2370695343 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f86cc0ada60 con 0x7f86c00039b0 2024-03-30T13:14:16.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.639+0000 7f86dd400640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86b806c560 0x7f86b806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:16.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.640+0000 7f86dd400640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86b806c560 0x7f86b806ea20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86c4001200 tx=0x7f86c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:16.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.643+0000 7f86d2000640 1 -- 172.21.15.99:0/2370695343 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f86cc07bf50 con 0x7f86c00039b0 2024-03-30T13:14:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.841+0000 7f86df200640 1 -- 172.21.15.99:0/2370695343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f86d80b28f0 con 0x7f86c00039b0 2024-03-30T13:14:16.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.842+0000 7f86d2000640 1 -- 172.21.15.99:0/2370695343 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) ==== 100+0+11 (secure 0 0 0) 0x7f86cc07b850 con 0x7f86c00039b0 2024-03-30T13:14:16.847 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:14:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 -- 172.21.15.99:0/2370695343 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86b806c560 msgr2=0x7f86b806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86b806c560 0x7f86b806ea20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86c4001200 tx=0x7f86c4009040 comp rx=0 tx=0).stop 2024-03-30T13:14:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 -- 172.21.15.99:0/2370695343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 msgr2=0x7f86d81f56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 0x7f86d81f56c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009ac0 tx=0x7f86cc004730 comp rx=0 tx=0).stop 2024-03-30T13:14:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 -- 172.21.15.99:0/2370695343 shutdown_connections 2024-03-30T13:14:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f86b806c560 0x7f86b806ea20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86d81f2790 0x7f86d81f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86d80b1d60 0x7f86d8141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 --2- 172.21.15.99:0/2370695343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c00039b0 0x7f86d81f56c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:16.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 -- 172.21.15.99:0/2370695343 >> 172.21.15.99:0/2370695343 conn(0x7f86d806bb40 msgr2=0x7f86d80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:16.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 -- 172.21.15.99:0/2370695343 shutdown_connections 2024-03-30T13:14:16.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:16.845+0000 7f86df200640 1 -- 172.21.15.99:0/2370695343 wait complete. 2024-03-30T13:14:16.867 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:14:17.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.065+0000 7f72d0600640 1 Processor -- start 2024-03-30T13:14:17.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.066+0000 7f72d0600640 1 -- start start 2024-03-30T13:14:17.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72d0600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f72c80b3bd0 0x7f72c806c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72d0600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72c806ca60 0x7f72c806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72d0600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c81591a0 con 0x7f72c80b0350 2024-03-30T13:14:17.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72d0600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f72c8073280 con 0x7f72c80b3bd0 2024-03-30T13:14:17.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72d0600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f72c806ce90 con 0x7f72c806ca60 2024-03-30T13:14:17.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72cd200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f72c80b3bd0 0x7f72c806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72cd200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f72c80b3bd0 0x7f72c806c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34710/0 (socket says 172.21.15.99:34710) 2024-03-30T13:14:17.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72cd200640 1 -- 172.21.15.99:0/1799255318 learned_addr learned my addr 172.21.15.99:0/1799255318 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:17.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72ce600640 1 --2- 172.21.15.99:0/1799255318 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72c806ca60 0x7f72c806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72cd200640 1 -- 172.21.15.99:0/1799255318 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72c806ca60 msgr2=0x7f72c806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:17.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72cd200640 1 --2- 172.21.15.99:0/1799255318 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72c806ca60 0x7f72c806e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72cd200640 1 -- 172.21.15.99:0/1799255318 >> v1:172.21.15.181:6789/0 conn(0x7f72c80b0350 legacy=0x7f72c8072b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:17.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.068+0000 7f72cd200640 1 -- 172.21.15.99:0/1799255318 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c815f010 con 0x7f72c80b3bd0 2024-03-30T13:14:17.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.069+0000 7f72cd200640 1 --2- 172.21.15.99:0/1799255318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c80b3bd0 0x7f72c806c520 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009870 tx=0x7f72b402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c46cd6707ca230 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:17.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.070+0000 7f72c7e00640 1 -- 172.21.15.99:0/1799255318 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4035020 con 0x7f72c80b3bd0 2024-03-30T13:14:17.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.070+0000 7f72c7e00640 1 -- 172.21.15.99:0/1799255318 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b4031640 con 0x7f72c80b3bd0 2024-03-30T13:14:17.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.070+0000 7f72c7e00640 1 -- 172.21.15.99:0/1799255318 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b402d040 con 0x7f72c80b3bd0 2024-03-30T13:14:17.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.070+0000 7f72d0600640 1 -- 172.21.15.99:0/1799255318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c80b3bd0 msgr2=0x7f72c806c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:17.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.070+0000 7f72d0600640 1 --2- 172.21.15.99:0/1799255318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c80b3bd0 0x7f72c806c520 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009870 tx=0x7f72b402b8f0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.070+0000 7f72d0600640 1 -- 172.21.15.99:0/1799255318 shutdown_connections 2024-03-30T13:14:17.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.070+0000 7f72d0600640 1 --2- 172.21.15.99:0/1799255318 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72c806ca60 0x7f72c806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.070+0000 7f72d0600640 1 --2- 172.21.15.99:0/1799255318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c80b3bd0 0x7f72c806c520 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.070+0000 7f72d0600640 1 -- 172.21.15.99:0/1799255318 >> 172.21.15.99:0/1799255318 conn(0x7f72c8072050 msgr2=0x7f72c8072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:17.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.070+0000 7f72d0600640 1 -- 172.21.15.99:0/1799255318 shutdown_connections 2024-03-30T13:14:17.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.071+0000 7f72d0600640 1 -- 172.21.15.99:0/1799255318 wait complete. 2024-03-30T13:14:17.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.072+0000 7f72d0600640 1 Processor -- start 2024-03-30T13:14:17.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.072+0000 7f72d0600640 1 -- start start 2024-03-30T13:14:17.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.073+0000 7f72d0600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72c806ca60 0x7f72c8161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.073+0000 7f72d0600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c80b0350 0x7f72c814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.073+0000 7f72d0600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72c80b3bd0 0x7f72c8072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.073+0000 7f72d0600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f72c815f8b0 con 0x7f72c80b0350 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.073+0000 7f72d0600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f72c815f5d0 con 0x7f72c80b3bd0 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.073+0000 7f72d0600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f72c815ec70 con 0x7f72c806ca60 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.073+0000 7f72cd200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c80b0350 0x7f72c814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.073+0000 7f72cd200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c80b0350 0x7f72c814cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34726/0 (socket says 172.21.15.99:34726) 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.074+0000 7f72cd200640 1 -- 172.21.15.99:0/664806003 learned_addr learned my addr 172.21.15.99:0/664806003 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.074+0000 7f72cdc00640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72c806ca60 0x7f72c8161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.074+0000 7f72ce600640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72c80b3bd0 0x7f72c8072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.074+0000 7f72cd200640 1 -- 172.21.15.99:0/664806003 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72c806ca60 msgr2=0x7f72c8161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.074+0000 7f72cd200640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72c806ca60 0x7f72c8161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.074+0000 7f72cd200640 1 -- 172.21.15.99:0/664806003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72c80b3bd0 msgr2=0x7f72c8072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:17.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.074+0000 7f72cd200640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72c80b3bd0 0x7f72c8072430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.074+0000 7f72cd200640 1 -- 172.21.15.99:0/664806003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c8161bd0 con 0x7f72c80b0350 2024-03-30T13:14:17.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.074+0000 7f72cd200640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c80b0350 0x7f72c814cb50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f72b402b930 tx=0x7f72b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:17.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.074+0000 7f72c5600640 1 -- 172.21.15.99:0/664806003 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4040070 con 0x7f72c80b0350 2024-03-30T13:14:17.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.075+0000 7f72c5600640 1 -- 172.21.15.99:0/664806003 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b4039bf0 con 0x7f72c80b0350 2024-03-30T13:14:17.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.075+0000 7f72d0600640 1 -- 172.21.15.99:0/664806003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c815b670 con 0x7f72c80b0350 2024-03-30T13:14:17.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.075+0000 7f72c5600640 1 -- 172.21.15.99:0/664806003 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4035040 con 0x7f72c80b0350 2024-03-30T13:14:17.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.075+0000 7f72d0600640 1 -- 172.21.15.99:0/664806003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c815bc30 con 0x7f72c80b0350 2024-03-30T13:14:17.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.076+0000 7f72d0600640 1 -- 172.21.15.99:0/664806003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c8068d50 con 0x7f72c80b0350 2024-03-30T13:14:17.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.077+0000 7f72c5600640 1 -- 172.21.15.99:0/664806003 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f72b404b060 con 0x7f72c80b0350 2024-03-30T13:14:17.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.078+0000 7f72c5600640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f72a806c560 0x7f72a806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.078+0000 7f72c5600640 1 -- 172.21.15.99:0/664806003 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f72b40ad210 con 0x7f72c80b0350 2024-03-30T13:14:17.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.078+0000 7f72cdc00640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f72a806c560 0x7f72a806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.078+0000 7f72cdc00640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f72a806c560 0x7f72a806ea20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72c8156be0 tx=0x7f72bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:17.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.082+0000 7f72c5600640 1 -- 172.21.15.99:0/664806003 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f72c81591a0 con 0x7f72c80b0350 2024-03-30T13:14:17.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.293+0000 7f72d0600640 1 -- 172.21.15.99:0/664806003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f72c8157fa0 con 0x7f72c80b0350 2024-03-30T13:14:17.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.294+0000 7f72c5600640 1 -- 172.21.15.99:0/664806003 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7f72b407b790 con 0x7f72c80b0350 2024-03-30T13:14:17.299 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-03-30T13:14:17.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 -- 172.21.15.99:0/664806003 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f72a806c560 msgr2=0x7f72a806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:17.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f72a806c560 0x7f72a806ea20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72c8156be0 tx=0x7f72bc009040 comp rx=0 tx=0).stop 2024-03-30T13:14:17.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 -- 172.21.15.99:0/664806003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c80b0350 msgr2=0x7f72c814cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:17.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c80b0350 0x7f72c814cb50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f72b402b930 tx=0x7f72b40046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 -- 172.21.15.99:0/664806003 shutdown_connections 2024-03-30T13:14:17.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f72a806c560 0x7f72a806ea20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72c80b3bd0 0x7f72c8072430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c80b0350 0x7f72c814cb50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 --2- 172.21.15.99:0/664806003 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72c806ca60 0x7f72c8161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 -- 172.21.15.99:0/664806003 >> 172.21.15.99:0/664806003 conn(0x7f72c8072050 msgr2=0x7f72c806f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 -- 172.21.15.99:0/664806003 shutdown_connections 2024-03-30T13:14:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.297+0000 7f72d0600640 1 -- 172.21.15.99:0/664806003 wait complete. 2024-03-30T13:14:17.321 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-30T13:14:17.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:17.321 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-03-30T13:14:17.429 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:14:17.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:17.429 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-30T13:14:17.470 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:14:17.470 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:14:17.470 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:14:17.524 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053413,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249168k,nr_inodes=812292,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T13:14:17.525 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:14:17.525 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:14:17.525 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:14:17.572 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053407,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498328k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249164k,nr_inodes=812291,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498328k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T13:14:17.572 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:14:17.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.785+0000 7f2c5c200640 1 Processor -- start 2024-03-30T13:14:17.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.786+0000 7f2c5c200640 1 -- start start 2024-03-30T13:14:17.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.787+0000 7f2c5c200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2c5415c670 0x7f2c5406c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.787+0000 7f2c5c200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2c5406f060 0x7f2c5406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.787+0000 7f2c5c200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c54146230 con 0x7f2c540ad230 2024-03-30T13:14:17.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.787+0000 7f2c5c200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f2c5406dfc0 con 0x7f2c5406f060 2024-03-30T13:14:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.787+0000 7f2c5c200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2c5406e2a0 con 0x7f2c5415c670 2024-03-30T13:14:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.787+0000 7f2c58e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2c5406f060 0x7f2c5406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.787+0000 7f2c58e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2c5406f060 0x7f2c5406d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34738/0 (socket says 172.21.15.99:34738) 2024-03-30T13:14:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.787+0000 7f2c58e00640 1 -- 172.21.15.99:0/4211134124 learned_addr learned my addr 172.21.15.99:0/4211134124 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.788+0000 7f2c59800640 1 --2- 172.21.15.99:0/4211134124 >> v2:172.21.15.181:3300/0 conn(0x7f2c5415c670 0x7f2c5406c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.788+0000 7f2c58e00640 1 -- 172.21.15.99:0/4211134124 >> v2:172.21.15.181:3300/0 conn(0x7f2c5415c670 msgr2=0x7f2c5406c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.788+0000 7f2c58e00640 1 --2- 172.21.15.99:0/4211134124 >> v2:172.21.15.181:3300/0 conn(0x7f2c5415c670 0x7f2c5406c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.788+0000 7f2c58e00640 1 -- 172.21.15.99:0/4211134124 >> v1:172.21.15.181:6789/0 conn(0x7f2c540ad230 legacy=0x7f2c540ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.788+0000 7f2c58e00640 1 -- 172.21.15.99:0/4211134124 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5406e580 con 0x7f2c5406f060 2024-03-30T13:14:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.788+0000 7f2c59800640 1 --2- 172.21.15.99:0/4211134124 >> v2:172.21.15.181:3300/0 conn(0x7f2c5415c670 0x7f2c5406c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.789+0000 7f2c58e00640 1 --2- 172.21.15.99:0/4211134124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c5406f060 0x7f2c5406d930 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2c5406f960 tx=0x7f2c4002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b677c53a08ab31c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.789+0000 7f2c53e00640 1 -- 172.21.15.99:0/4211134124 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4002e070 con 0x7f2c5406f060 2024-03-30T13:14:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.789+0000 7f2c53e00640 1 -- 172.21.15.99:0/4211134124 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40037070 con 0x7f2c5406f060 2024-03-30T13:14:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.789+0000 7f2c53e00640 1 -- 172.21.15.99:0/4211134124 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40031a00 con 0x7f2c5406f060 2024-03-30T13:14:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.790+0000 7f2c5c200640 1 -- 172.21.15.99:0/4211134124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c5406f060 msgr2=0x7f2c5406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.790+0000 7f2c5c200640 1 --2- 172.21.15.99:0/4211134124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c5406f060 0x7f2c5406d930 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2c5406f960 tx=0x7f2c4002b880 comp rx=0 tx=0).stop 2024-03-30T13:14:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.790+0000 7f2c5c200640 1 -- 172.21.15.99:0/4211134124 shutdown_connections 2024-03-30T13:14:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.790+0000 7f2c5c200640 1 --2- 172.21.15.99:0/4211134124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c5406f060 0x7f2c5406d930 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.790+0000 7f2c5c200640 1 --2- 172.21.15.99:0/4211134124 >> v2:172.21.15.181:3300/0 conn(0x7f2c5415c670 0x7f2c5406c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.790+0000 7f2c5c200640 1 -- 172.21.15.99:0/4211134124 >> 172.21.15.99:0/4211134124 conn(0x7f2c5406b510 msgr2=0x7f2c5406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.790+0000 7f2c5c200640 1 -- 172.21.15.99:0/4211134124 shutdown_connections 2024-03-30T13:14:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.790+0000 7f2c5c200640 1 -- 172.21.15.99:0/4211134124 wait complete. 2024-03-30T13:14:17.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.792+0000 7f2c5c200640 1 Processor -- start 2024-03-30T13:14:17.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.792+0000 7f2c5c200640 1 -- start start 2024-03-30T13:14:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c5c200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c5406f060 0x7f2c540c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c5c200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c540ad230 0x7f2c541f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c5c200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c5415c670 0x7f2c541f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c5c200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2c540b32c0 con 0x7f2c5406f060 2024-03-30T13:14:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c5c200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5415ca50 con 0x7f2c540ad230 2024-03-30T13:14:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c5c200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2c540b3440 con 0x7f2c5415c670 2024-03-30T13:14:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c59800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c5406f060 0x7f2c540c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c59800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c5406f060 0x7f2c540c98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34740/0 (socket says 172.21.15.99:34740) 2024-03-30T13:14:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c59800640 1 -- 172.21.15.99:0/509896743 learned_addr learned my addr 172.21.15.99:0/509896743 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c58e00640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c540ad230 0x7f2c541f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c5a200640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c5415c670 0x7f2c541f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c59800640 1 -- 172.21.15.99:0/509896743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c5415c670 msgr2=0x7f2c541f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c59800640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c5415c670 0x7f2c541f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c59800640 1 -- 172.21.15.99:0/509896743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c540ad230 msgr2=0x7f2c541f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c59800640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c540ad230 0x7f2c541f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.793+0000 7f2c59800640 1 -- 172.21.15.99:0/509896743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c540cb580 con 0x7f2c5406f060 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.794+0000 7f2c5a200640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c5415c670 0x7f2c541f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.794+0000 7f2c59800640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c5406f060 0x7f2c540c98b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800c820 tx=0x7f2c4800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.794+0000 7f2c51600640 1 -- 172.21.15.99:0/509896743 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48015070 con 0x7f2c5406f060 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.794+0000 7f2c51600640 1 -- 172.21.15.99:0/509896743 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c48007a30 con 0x7f2c5406f060 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.794+0000 7f2c51600640 1 -- 172.21.15.99:0/509896743 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48007de0 con 0x7f2c5406f060 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.794+0000 7f2c5c200640 1 -- 172.21.15.99:0/509896743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c540cb800 con 0x7f2c5406f060 2024-03-30T13:14:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.794+0000 7f2c5c200640 1 -- 172.21.15.99:0/509896743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c540cbdc0 con 0x7f2c5406f060 2024-03-30T13:14:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.795+0000 7f2c5c200640 1 -- 172.21.15.99:0/509896743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c54068640 con 0x7f2c5406f060 2024-03-30T13:14:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.796+0000 7f2c51600640 1 -- 172.21.15.99:0/509896743 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2c48018070 con 0x7f2c5406f060 2024-03-30T13:14:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.798+0000 7f2c51600640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c3406c530 0x7f2c3406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.798+0000 7f2c51600640 1 -- 172.21.15.99:0/509896743 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f2c4808b6b0 con 0x7f2c5406f060 2024-03-30T13:14:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.798+0000 7f2c58e00640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c3406c530 0x7f2c3406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.799+0000 7f2c58e00640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c3406c530 0x7f2c3406e9f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2c40036000 tx=0x7f2c4003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:17.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:17.802+0000 7f2c51600640 1 -- 172.21.15.99:0/509896743 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2c540cb580 con 0x7f2c5406f060 2024-03-30T13:14:18.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.038+0000 7f2c5c200640 1 -- 172.21.15.99:0/509896743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c540718d0 con 0x7f2c5406f060 2024-03-30T13:14:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.039+0000 7f2c51600640 1 -- 172.21.15.99:0/509896743 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5181 (secure 0 0 0) 0x7f2c48059ba0 con 0x7f2c5406f060 2024-03-30T13:14:18.044 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:18.044 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1591088829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1591088829},{"type":"v1","addr":"172.21.15.99:6837","nonce":1591088829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5115,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/333253843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":333253843},{"type":"v1","addr":"172.21.15.99:6835","nonce":333253843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6834/859511813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":859511813},{"type":"v1","addr":"172.21.15.181:6834","nonce":859511813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:12:04.595024+0000","modified":"2024-03-30T13:14:06.555828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6835/1594018738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6833","nonce":1594018738},{"type":"v1","addr":"172.21.15.181:6835","nonce":1594018738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5121,"qdb_cluster":[5121]},"id":2}]} 2024-03-30T13:14:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 21 2024-03-30T13:14:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 -- 172.21.15.99:0/509896743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c3406c530 msgr2=0x7f2c3406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c3406c530 0x7f2c3406e9f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2c40036000 tx=0x7f2c4003d040 comp rx=0 tx=0).stop 2024-03-30T13:14:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 -- 172.21.15.99:0/509896743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c5406f060 msgr2=0x7f2c540c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c5406f060 0x7f2c540c98b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800c820 tx=0x7f2c4800cce0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 -- 172.21.15.99:0/509896743 shutdown_connections 2024-03-30T13:14:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2c3406c530 0x7f2c3406e9f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c5415c670 0x7f2c541f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c540ad230 0x7f2c541f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 --2- 172.21.15.99:0/509896743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c5406f060 0x7f2c540c98b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 -- 172.21.15.99:0/509896743 >> 172.21.15.99:0/509896743 conn(0x7f2c5406b510 msgr2=0x7f2c540b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 -- 172.21.15.99:0/509896743 shutdown_connections 2024-03-30T13:14:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.042+0000 7f2c5c200640 1 -- 172.21.15.99:0/509896743 wait complete. 2024-03-30T13:14:18.064 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:14:18.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.259+0000 7f60b9600640 1 Processor -- start 2024-03-30T13:14:18.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.260+0000 7f60b9600640 1 -- start start 2024-03-30T13:14:18.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.261+0000 7f60b9600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f60b409b780 0x7f60b40d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.261+0000 7f60b9600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b406c830 0x7f60b40d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.261+0000 7f60b9600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b40b1780 con 0x7f60b409aa30 2024-03-30T13:14:18.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.261+0000 7f60b9600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f60b40b14a0 con 0x7f60b409b780 2024-03-30T13:14:18.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.261+0000 7f60b9600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f60b415f050 con 0x7f60b406c830 2024-03-30T13:14:18.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b2a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f60b409aa30 0x7f60b409ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46114/0 (socket says 172.21.15.99:46114) 2024-03-30T13:14:18.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b2a00640 1 -- 172.21.15.99:0/150274403 learned_addr learned my addr 172.21.15.99:0/150274403 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b3400640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b406c830 0x7f60b40d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b2000640 1 --2- 172.21.15.99:0/150274403 >> v2:172.21.15.181:3300/0 conn(0x7f60b409b780 0x7f60b40d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671372955 0 0) 0x7f60b40b1780 con 0x7f60b409aa30 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6098003520 con 0x7f60b409aa30 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 203427707 0 0) 0x7f6098003520 con 0x7f60b409aa30 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b406c830 msgr2=0x7f60b40d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b1600640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b406c830 0x7f60b40d0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 >> v2:172.21.15.181:3300/0 conn(0x7f60b409b780 msgr2=0x7f60b40d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b1600640 1 --2- 172.21.15.99:0/150274403 >> v2:172.21.15.181:3300/0 conn(0x7f60b409b780 0x7f60b40d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b415f330 con 0x7f60b409aa30 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.262+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f609c001670 con 0x7f60b409aa30 2024-03-30T13:14:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 >> v1:172.21.15.99:6789/0 conn(0x7f60b409aa30 legacy=0x7f60b409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b1600640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60980039b0 0x7f6098003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b1600640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b406c830 0x7f6098004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b1600640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6098004d40 0x7f60980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f60b40b14a0 con 0x7f60980039b0 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f60b415f050 con 0x7f6098004d40 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f609800baa0 con 0x7f60b406c830 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b2a00640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60980039b0 0x7f6098003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b2000640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b406c830 0x7f6098004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b2a00640 1 -- 172.21.15.99:0/150274403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b406c830 msgr2=0x7f6098004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b2a00640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b406c830 0x7f6098004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b3400640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6098004d40 0x7f60980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b2a00640 1 -- 172.21.15.99:0/150274403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6098004d40 msgr2=0x7f60980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b2a00640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6098004d40 0x7f60980051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.263+0000 7f60b2a00640 1 -- 172.21.15.99:0/150274403 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6098003520 con 0x7f60980039b0 2024-03-30T13:14:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.264+0000 7f60b2a00640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60980039b0 0x7f6098003dd0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c210 tx=0x7f6098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6d0ddadba0d5ee server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.265+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c007d70 con 0x7f60980039b0 2024-03-30T13:14:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.265+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c030070 con 0x7f60980039b0 2024-03-30T13:14:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.265+0000 7f60b1600640 1 -- 172.21.15.99:0/150274403 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c02cd60 con 0x7f60980039b0 2024-03-30T13:14:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.265+0000 7f60b9600640 1 -- 172.21.15.99:0/150274403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60980039b0 msgr2=0x7f6098003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.265+0000 7f60b9600640 1 --2- 172.21.15.99:0/150274403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60980039b0 0x7f6098003dd0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c210 tx=0x7f6098005830 comp rx=0 tx=0).stop 2024-03-30T13:14:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.265+0000 7f60b3400640 1 -- 172.21.15.99:0/150274403 reap_dead start 2024-03-30T13:14:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.265+0000 7f60b9600640 1 -- 172.21.15.99:0/150274403 shutdown_connections 2024-03-30T13:14:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.265+0000 7f60b9600640 1 -- 172.21.15.99:0/150274403 >> 172.21.15.99:0/150274403 conn(0x7f60b40b3f50 msgr2=0x7f60b40b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.265+0000 7f60b9600640 1 -- 172.21.15.99:0/150274403 shutdown_connections 2024-03-30T13:14:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.265+0000 7f60b9600640 1 -- 172.21.15.99:0/150274403 wait complete. 2024-03-30T13:14:18.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.267+0000 7f60b9600640 1 Processor -- start 2024-03-30T13:14:18.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.267+0000 7f60b9600640 1 -- start start 2024-03-30T13:14:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.268+0000 7f60b9600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60980039b0 0x7f60b4152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.268+0000 7f60b9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60b40c8a30 0x7f60b4157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.268+0000 7f60b9600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b4070c90 0x7f60b4071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.268+0000 7f60b9600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f60b415fe10 con 0x7f60b40c8a30 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.268+0000 7f60b9600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f60b415f8f0 con 0x7f60980039b0 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.268+0000 7f60b9600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f60b415ece0 con 0x7f60b4070c90 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.268+0000 7f60b2000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60b40c8a30 0x7f60b4157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.268+0000 7f60b2000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60b40c8a30 0x7f60b4157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34756/0 (socket says 172.21.15.99:34756) 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.268+0000 7f60b2000640 1 -- 172.21.15.99:0/4167999358 learned_addr learned my addr 172.21.15.99:0/4167999358 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60b2a00640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60980039b0 0x7f60b4152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60b3400640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b4070c90 0x7f60b4071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60b2000640 1 -- 172.21.15.99:0/4167999358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b4070c90 msgr2=0x7f60b4071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60b2000640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b4070c90 0x7f60b4071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60b2000640 1 -- 172.21.15.99:0/4167999358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60980039b0 msgr2=0x7f60b4152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60b2000640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60980039b0 0x7f60b4152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60b2000640 1 -- 172.21.15.99:0/4167999358 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b4158420 con 0x7f60b40c8a30 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60b3400640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b4070c90 0x7f60b4071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60b2000640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60b40c8a30 0x7f60b4157ee0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f60a4007ef0 tx=0x7f60a400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60aaa00640 1 -- 172.21.15.99:0/4167999358 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4018020 con 0x7f60b40c8a30 2024-03-30T13:14:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60aaa00640 1 -- 172.21.15.99:0/4167999358 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a40145f0 con 0x7f60b40c8a30 2024-03-30T13:14:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.269+0000 7f60aaa00640 1 -- 172.21.15.99:0/4167999358 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a40149c0 con 0x7f60b40c8a30 2024-03-30T13:14:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.270+0000 7f60b9600640 1 -- 172.21.15.99:0/4167999358 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b41586a0 con 0x7f60b40c8a30 2024-03-30T13:14:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.270+0000 7f60b9600640 1 -- 172.21.15.99:0/4167999358 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b4158c60 con 0x7f60b40c8a30 2024-03-30T13:14:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.271+0000 7f60b9600640 1 -- 172.21.15.99:0/4167999358 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b4071650 con 0x7f60b40c8a30 2024-03-30T13:14:18.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.272+0000 7f60aaa00640 1 -- 172.21.15.99:0/4167999358 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f60a401b020 con 0x7f60b40c8a30 2024-03-30T13:14:18.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.273+0000 7f60aaa00640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f609006c530 0x7f609006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.273+0000 7f60aaa00640 1 -- 172.21.15.99:0/4167999358 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f60a408c300 con 0x7f60b40c8a30 2024-03-30T13:14:18.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.273+0000 7f60b2a00640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f609006c530 0x7f609006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.274+0000 7f60b2a00640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f609006c530 0x7f609006e9f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f609c034000 tx=0x7f609c007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:18.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.278+0000 7f60aaa00640 1 -- 172.21.15.99:0/4167999358 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f60a4022020 con 0x7f60b40c8a30 2024-03-30T13:14:18.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.544+0000 7f60b9600640 1 -- 172.21.15.99:0/4167999358 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60b4068d50 con 0x7f60b40c8a30 2024-03-30T13:14:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.547+0000 7f60aaa00640 1 -- 172.21.15.99:0/4167999358 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16926 (secure 0 0 0) 0x7f60b4158420 con 0x7f60b40c8a30 2024-03-30T13:14:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:18.553 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":40,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:14:10.165267+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:12:02.458079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:12:03.597299+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:14:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 -- 172.21.15.99:0/4167999358 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f609006c530 msgr2=0x7f609006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f609006c530 0x7f609006e9f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f609c034000 tx=0x7f609c007000 comp rx=0 tx=0).stop 2024-03-30T13:14:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 -- 172.21.15.99:0/4167999358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60b40c8a30 msgr2=0x7f60b4157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60b40c8a30 0x7f60b4157ee0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f60a4007ef0 tx=0x7f60a400f520 comp rx=0 tx=0).stop 2024-03-30T13:14:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 -- 172.21.15.99:0/4167999358 shutdown_connections 2024-03-30T13:14:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f609006c530 0x7f609006e9f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60b4070c90 0x7f60b4071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60b40c8a30 0x7f60b4157ee0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 --2- 172.21.15.99:0/4167999358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60980039b0 0x7f60b4152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 -- 172.21.15.99:0/4167999358 >> 172.21.15.99:0/4167999358 conn(0x7f60b40b3f50 msgr2=0x7f60b4156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 -- 172.21.15.99:0/4167999358 shutdown_connections 2024-03-30T13:14:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.550+0000 7f60b9600640 1 -- 172.21.15.99:0/4167999358 wait complete. 2024-03-30T13:14:18.573 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:10:33.468070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:12:02.458079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:12:03.597299+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 39, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:14:18.573 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:14:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.777+0000 7f8809c00640 1 Processor -- start 2024-03-30T13:14:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.777+0000 7f8809c00640 1 -- start start 2024-03-30T13:14:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.778+0000 7f8809c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f88040ca950 0x7f88040b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.778+0000 7f8809c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88040b26f0 0x7f880415be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.778+0000 7f8809c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88040cade0 con 0x7f880415b3d0 2024-03-30T13:14:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.778+0000 7f8809c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f88040b2b60 con 0x7f88040ca950 2024-03-30T13:14:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.778+0000 7f8809c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f88040c6240 con 0x7f88040b26f0 2024-03-30T13:14:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.778+0000 7f8802a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f880415b3d0 0x7f88040b49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46122/0 (socket says 172.21.15.99:46122) 2024-03-30T13:14:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8802a00640 1 -- 172.21.15.99:0/909053150 learned_addr learned my addr 172.21.15.99:0/909053150 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f87fa000640 1 --2- 172.21.15.99:0/909053150 >> v2:172.21.15.181:3300/0 conn(0x7f88040ca950 0x7f88040b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8803400640 1 --2- 172.21.15.99:0/909053150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88040b26f0 0x7f880415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505895918 0 0) 0x7f88040cade0 con 0x7f880415b3d0 2024-03-30T13:14:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87e8005730 con 0x7f880415b3d0 2024-03-30T13:14:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3508271001 0 0) 0x7f87e8005730 con 0x7f880415b3d0 2024-03-30T13:14:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88040b26f0 msgr2=0x7f880415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8802000640 1 --2- 172.21.15.99:0/909053150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88040b26f0 0x7f880415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 >> v2:172.21.15.181:3300/0 conn(0x7f88040ca950 msgr2=0x7f88040b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8802000640 1 --2- 172.21.15.99:0/909053150 >> v2:172.21.15.181:3300/0 conn(0x7f88040ca950 0x7f88040b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88040c6470 con 0x7f880415b3d0 2024-03-30T13:14:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f87f4001690 con 0x7f880415b3d0 2024-03-30T13:14:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.779+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 >> v1:172.21.15.99:6789/0 conn(0x7f880415b3d0 legacy=0x7f88040b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f8802000640 1 --2- 172.21.15.99:0/909053150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87e8005bc0 0x7f87e8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f8802000640 1 --2- 172.21.15.99:0/909053150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87e8006a10 0x7f87e8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f8802000640 1 --2- 172.21.15.99:0/909053150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88040b26f0 0x7f87e80073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f88040b2b60 con 0x7f87e8006a10 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87e800dbd0 con 0x7f87e8005bc0 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f87e800dd50 con 0x7f88040b26f0 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f87fa000640 1 --2- 172.21.15.99:0/909053150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87e8006a10 0x7f87e8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f8802a00640 1 --2- 172.21.15.99:0/909053150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87e8005bc0 0x7f87e8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f87fa000640 1 -- 172.21.15.99:0/909053150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88040b26f0 msgr2=0x7f87e80073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f87fa000640 1 --2- 172.21.15.99:0/909053150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88040b26f0 0x7f87e80073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f87fa000640 1 -- 172.21.15.99:0/909053150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87e8005bc0 msgr2=0x7f87e8005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f87fa000640 1 --2- 172.21.15.99:0/909053150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87e8005bc0 0x7f87e8005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.780+0000 7f87fa000640 1 -- 172.21.15.99:0/909053150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e8005730 con 0x7f87e8006a10 2024-03-30T13:14:18.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.781+0000 7f87fa000640 1 --2- 172.21.15.99:0/909053150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87e8006a10 0x7f87e8006e90 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009ac0 tx=0x7f87e8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9cfba3a6271d5d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:18.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.782+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec039070 con 0x7f87e8006a10 2024-03-30T13:14:18.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.782+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ec02c710 con 0x7f87e8006a10 2024-03-30T13:14:18.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.782+0000 7f8802000640 1 -- 172.21.15.99:0/909053150 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec009690 con 0x7f87e8006a10 2024-03-30T13:14:18.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.782+0000 7f8809c00640 1 -- 172.21.15.99:0/909053150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87e8006a10 msgr2=0x7f87e8006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.782+0000 7f8809c00640 1 --2- 172.21.15.99:0/909053150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87e8006a10 0x7f87e8006e90 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009ac0 tx=0x7f87e8007a40 comp rx=0 tx=0).stop 2024-03-30T13:14:18.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.782+0000 7f8803400640 1 -- 172.21.15.99:0/909053150 reap_dead start 2024-03-30T13:14:18.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.782+0000 7f8809c00640 1 -- 172.21.15.99:0/909053150 shutdown_connections 2024-03-30T13:14:18.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.782+0000 7f8809c00640 1 -- 172.21.15.99:0/909053150 >> 172.21.15.99:0/909053150 conn(0x7f88040d0450 msgr2=0x7f88040d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:18.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.782+0000 7f8809c00640 1 -- 172.21.15.99:0/909053150 shutdown_connections 2024-03-30T13:14:18.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.782+0000 7f8809c00640 1 -- 172.21.15.99:0/909053150 wait complete. 2024-03-30T13:14:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.784+0000 7f8809c00640 1 Processor -- start 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.784+0000 7f8809c00640 1 -- start start 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.785+0000 7f8809c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87e8006a10 0x7f8804159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.785+0000 7f8809c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88040c8220 0x7f88040c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.785+0000 7f8809c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88040b0d80 0x7f88040b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.785+0000 7f8809c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f88040c6a30 con 0x7f88040c8220 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.785+0000 7f8809c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f88040c7080 con 0x7f88040b0d80 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.785+0000 7f8809c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f88040c6d10 con 0x7f87e8006a10 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.785+0000 7f87fa000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88040c8220 0x7f88040c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.785+0000 7f87fa000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88040c8220 0x7f88040c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34776/0 (socket says 172.21.15.99:34776) 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.785+0000 7f87fa000640 1 -- 172.21.15.99:0/2441513121 learned_addr learned my addr 172.21.15.99:0/2441513121 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f8803400640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88040b0d80 0x7f88040b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f87fa000640 1 -- 172.21.15.99:0/2441513121 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87e8006a10 msgr2=0x7f8804159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f8802a00640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87e8006a10 0x7f8804159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f87fa000640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87e8006a10 0x7f8804159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f87fa000640 1 -- 172.21.15.99:0/2441513121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88040b0d80 msgr2=0x7f88040b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f87fa000640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88040b0d80 0x7f88040b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f87fa000640 1 -- 172.21.15.99:0/2441513121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8804159960 con 0x7f88040c8220 2024-03-30T13:14:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f8803400640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88040b0d80 0x7f88040b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f87fa000640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88040c8220 0x7f88040c86a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f87ec000c00 tx=0x7f87ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f87fb400640 1 -- 172.21.15.99:0/2441513121 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec039050 con 0x7f88040c8220 2024-03-30T13:14:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f87fb400640 1 -- 172.21.15.99:0/2441513121 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ec045070 con 0x7f88040c8220 2024-03-30T13:14:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f87fb400640 1 -- 172.21.15.99:0/2441513121 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0044e0 con 0x7f88040c8220 2024-03-30T13:14:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.786+0000 7f8809c00640 1 -- 172.21.15.99:0/2441513121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88040ca250 con 0x7f88040c8220 2024-03-30T13:14:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.787+0000 7f8809c00640 1 -- 172.21.15.99:0/2441513121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88040c99b0 con 0x7f88040c8220 2024-03-30T13:14:18.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.788+0000 7f8809c00640 1 -- 172.21.15.99:0/2441513121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f880409e520 con 0x7f88040c8220 2024-03-30T13:14:18.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.789+0000 7f87fb400640 1 -- 172.21.15.99:0/2441513121 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f87ec003a50 con 0x7f88040c8220 2024-03-30T13:14:18.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.789+0000 7f87fb400640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f87e006c530 0x7f87e006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:18.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.790+0000 7f87fb400640 1 -- 172.21.15.99:0/2441513121 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f87ec0ad400 con 0x7f88040c8220 2024-03-30T13:14:18.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.790+0000 7f8802a00640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f87e006c530 0x7f87e006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:18.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.790+0000 7f8802a00640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f87e006c530 0x7f87e006e9f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f87f4001eb0 tx=0x7f87f40011b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:18.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.794+0000 7f87fb400640 1 -- 172.21.15.99:0/2441513121 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f87ec04e020 con 0x7f88040c8220 2024-03-30T13:14:18.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.976+0000 7f8809c00640 1 -- 172.21.15.99:0/2441513121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f88040c7560 con 0x7f88040c8220 2024-03-30T13:14:18.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.977+0000 7f87fb400640 1 -- 172.21.15.99:0/2441513121 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f88040ca250 con 0x7f88040c8220 2024-03-30T13:14:18.981 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:14:18.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 -- 172.21.15.99:0/2441513121 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f87e006c530 msgr2=0x7f87e006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f87e006c530 0x7f87e006e9f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f87f4001eb0 tx=0x7f87f40011b0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 -- 172.21.15.99:0/2441513121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88040c8220 msgr2=0x7f88040c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:18.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88040c8220 0x7f88040c86a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f87ec000c00 tx=0x7f87ec004730 comp rx=0 tx=0).stop 2024-03-30T13:14:18.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 -- 172.21.15.99:0/2441513121 shutdown_connections 2024-03-30T13:14:18.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f87e006c530 0x7f87e006e9f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88040b0d80 0x7f88040b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88040c8220 0x7f88040c86a0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 --2- 172.21.15.99:0/2441513121 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87e8006a10 0x7f8804159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:18.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 -- 172.21.15.99:0/2441513121 >> 172.21.15.99:0/2441513121 conn(0x7f88040d0450 msgr2=0x7f88040b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:18.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 -- 172.21.15.99:0/2441513121 shutdown_connections 2024-03-30T13:14:18.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:18.979+0000 7f8809c00640 1 -- 172.21.15.99:0/2441513121 wait complete. 2024-03-30T13:14:19.002 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:14:19.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.203+0000 7f2a2ca00640 1 Processor -- start 2024-03-30T13:14:19.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.203+0000 7f2a2ca00640 1 -- start start 2024-03-30T13:14:19.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.205+0000 7f2a2ca00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2a280b4e40 0x7f2a280c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.205+0000 7f2a2ca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a281604d0 con 0x7f2a280b2810 2024-03-30T13:14:19.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.205+0000 7f2a2ca00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a281607b0 con 0x7f2a280b31c0 2024-03-30T13:14:19.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.205+0000 7f2a2ca00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2a280c6d60 con 0x7f2a280b4e40 2024-03-30T13:14:19.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.205+0000 7f2a26800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2a280b2810 0x7f2a280cbec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46132/0 (socket says 172.21.15.99:46132) 2024-03-30T13:14:19.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.205+0000 7f2a26800640 1 -- 172.21.15.99:0/574935580 learned_addr learned my addr 172.21.15.99:0/574935580 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:19.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.205+0000 7f2a25e00640 1 --2- 172.21.15.99:0/574935580 >> v2:172.21.15.181:3300/0 conn(0x7f2a280b4e40 0x7f2a280c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4068886185 0 0) 0x7f2a281604d0 con 0x7f2a280b2810 2024-03-30T13:14:19.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a08003520 con 0x7f2a280b2810 2024-03-30T13:14:19.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3793591889 0 0) 0x7f2a08003520 con 0x7f2a280b2810 2024-03-30T13:14:19.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 >> v2:172.21.15.181:3300/0 conn(0x7f2a280b4e40 msgr2=0x7f2a280c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:19.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 --2- 172.21.15.99:0/574935580 >> v2:172.21.15.181:3300/0 conn(0x7f2a280b4e40 0x7f2a280c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 >> v1:172.21.15.181:6789/0 conn(0x7f2a280b31c0 legacy=0x7f2a280b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a28160a90 con 0x7f2a280b2810 2024-03-30T13:14:19.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f2a20001690 con 0x7f2a280b2810 2024-03-30T13:14:19.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 >> v1:172.21.15.99:6789/0 conn(0x7f2a280b2810 legacy=0x7f2a280cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 --2- 172.21.15.99:0/574935580 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a08003a00 0x7f2a08003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 --2- 172.21.15.99:0/574935580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a08004800 0x7f2a08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 --2- 172.21.15.99:0/574935580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 0x7f2a0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2a280c6d60 con 0x7f2a08005210 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0800c160 con 0x7f2a08004800 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.206+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0800c360 con 0x7f2a08003a00 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.207+0000 7f2a26800640 1 --2- 172.21.15.99:0/574935580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 0x7f2a0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.207+0000 7f2a25400640 1 --2- 172.21.15.99:0/574935580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a08004800 0x7f2a08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.207+0000 7f2a25e00640 1 --2- 172.21.15.99:0/574935580 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a08003a00 0x7f2a08003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.207+0000 7f2a26800640 1 -- 172.21.15.99:0/574935580 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a08003a00 msgr2=0x7f2a08003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.207+0000 7f2a26800640 1 --2- 172.21.15.99:0/574935580 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a08003a00 0x7f2a08003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.207+0000 7f2a26800640 1 -- 172.21.15.99:0/574935580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a08004800 msgr2=0x7f2a08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.207+0000 7f2a26800640 1 --2- 172.21.15.99:0/574935580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a08004800 0x7f2a08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.207+0000 7f2a26800640 1 -- 172.21.15.99:0/574935580 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a08003520 con 0x7f2a08005210 2024-03-30T13:14:19.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.208+0000 7f2a26800640 1 -- 172.21.15.99:0/574935580 reap_dead start 2024-03-30T13:14:19.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.208+0000 7f2a26800640 1 --2- 172.21.15.99:0/574935580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 0x7f2a0800b9c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2a280c5c80 tx=0x7f2a08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd51711566a7403 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:19.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.208+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a20007c60 con 0x7f2a08005210 2024-03-30T13:14:19.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.208+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a20030070 con 0x7f2a08005210 2024-03-30T13:14:19.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.208+0000 7f2a24a00640 1 -- 172.21.15.99:0/574935580 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a20005d30 con 0x7f2a08005210 2024-03-30T13:14:19.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.209+0000 7f2a2ca00640 1 -- 172.21.15.99:0/574935580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 msgr2=0x7f2a0800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.209+0000 7f2a2ca00640 1 --2- 172.21.15.99:0/574935580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 0x7f2a0800b9c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2a280c5c80 tx=0x7f2a08005830 comp rx=0 tx=0).stop 2024-03-30T13:14:19.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.209+0000 7f2a2ca00640 1 -- 172.21.15.99:0/574935580 shutdown_connections 2024-03-30T13:14:19.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.209+0000 7f2a2ca00640 1 --2- 172.21.15.99:0/574935580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 0x7f2a0800b9c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.209+0000 7f2a2ca00640 1 -- 172.21.15.99:0/574935580 >> 172.21.15.99:0/574935580 conn(0x7f2a280d0450 msgr2=0x7f2a280d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:19.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.209+0000 7f2a2ca00640 1 -- 172.21.15.99:0/574935580 shutdown_connections 2024-03-30T13:14:19.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.209+0000 7f2a2ca00640 1 -- 172.21.15.99:0/574935580 wait complete. 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.211+0000 7f2a2ca00640 1 Processor -- start 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.211+0000 7f2a2ca00640 1 -- start start 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a2ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 0x7f2a281f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a2ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a280aeda0 0x7f2a280ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a2ca00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a281f74c0 0x7f2a2815b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a2ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2a280b3650 con 0x7f2a08005210 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a2ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2a280cba20 con 0x7f2a280aeda0 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a2ca00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2a280c60f0 con 0x7f2a281f74c0 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a25e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 0x7f2a281f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a25e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 0x7f2a281f59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34788/0 (socket says 172.21.15.99:34788) 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a25e00640 1 -- 172.21.15.99:0/2983416766 learned_addr learned my addr 172.21.15.99:0/2983416766 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a25400640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a280aeda0 0x7f2a280ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a26800640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a281f74c0 0x7f2a2815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a25e00640 1 -- 172.21.15.99:0/2983416766 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a281f74c0 msgr2=0x7f2a2815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a25e00640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a281f74c0 0x7f2a2815b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a25e00640 1 -- 172.21.15.99:0/2983416766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a280aeda0 msgr2=0x7f2a280ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a25e00640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a280aeda0 0x7f2a280ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.212+0000 7f2a25e00640 1 -- 172.21.15.99:0/2983416766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a280cf010 con 0x7f2a08005210 2024-03-30T13:14:19.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.213+0000 7f2a25e00640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 0x7f2a281f59e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2a18011540 tx=0x7f2a18011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:19.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.213+0000 7f2a1e000640 1 -- 172.21.15.99:0/2983416766 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18015930 con 0x7f2a08005210 2024-03-30T13:14:19.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.213+0000 7f2a1e000640 1 -- 172.21.15.99:0/2983416766 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a18015ad0 con 0x7f2a08005210 2024-03-30T13:14:19.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.213+0000 7f2a1e000640 1 -- 172.21.15.99:0/2983416766 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1800f460 con 0x7f2a08005210 2024-03-30T13:14:19.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.213+0000 7f2a2ca00640 1 -- 172.21.15.99:0/2983416766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a280cf2f0 con 0x7f2a08005210 2024-03-30T13:14:19.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.213+0000 7f2a2ca00640 1 -- 172.21.15.99:0/2983416766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a28071cc0 con 0x7f2a08005210 2024-03-30T13:14:19.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.214+0000 7f2a2ca00640 1 -- 172.21.15.99:0/2983416766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a2804f9d0 con 0x7f2a08005210 2024-03-30T13:14:19.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.215+0000 7f2a1e000640 1 -- 172.21.15.99:0/2983416766 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2a1800f600 con 0x7f2a08005210 2024-03-30T13:14:19.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.216+0000 7f2a1e000640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2a0406c560 0x7f2a0406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.216+0000 7f2a1e000640 1 -- 172.21.15.99:0/2983416766 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f2a1808bfa0 con 0x7f2a08005210 2024-03-30T13:14:19.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.216+0000 7f2a25400640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2a0406c560 0x7f2a0406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.217+0000 7f2a25400640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2a0406c560 0x7f2a0406ea20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2a10007fd0 tx=0x7f2a10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:19.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.221+0000 7f2a1e000640 1 -- 172.21.15.99:0/2983416766 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2a18019030 con 0x7f2a08005210 2024-03-30T13:14:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.407+0000 7f2a2ca00640 1 -- 172.21.15.99:0/2983416766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2a280c5cb0 con 0x7f2a08005210 2024-03-30T13:14:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.408+0000 7f2a1e000640 1 -- 172.21.15.99:0/2983416766 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) ==== 104+0+11 (secure 0 0 0) 0x7f2a1805a520 con 0x7f2a08005210 2024-03-30T13:14:19.413 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-03-30T13:14:19.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.410+0000 7f2a2ca00640 1 -- 172.21.15.99:0/2983416766 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2a0406c560 msgr2=0x7f2a0406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.410+0000 7f2a2ca00640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2a0406c560 0x7f2a0406ea20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2a10007fd0 tx=0x7f2a10009040 comp rx=0 tx=0).stop 2024-03-30T13:14:19.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.410+0000 7f2a2ca00640 1 -- 172.21.15.99:0/2983416766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 msgr2=0x7f2a281f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.410+0000 7f2a2ca00640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 0x7f2a281f59e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2a18011540 tx=0x7f2a18011a00 comp rx=0 tx=0).stop 2024-03-30T13:14:19.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.411+0000 7f2a2ca00640 1 -- 172.21.15.99:0/2983416766 shutdown_connections 2024-03-30T13:14:19.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.411+0000 7f2a2ca00640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f2a0406c560 0x7f2a0406ea20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.411+0000 7f2a2ca00640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a281f74c0 0x7f2a2815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.411+0000 7f2a2ca00640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a280aeda0 0x7f2a280ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.411+0000 7f2a2ca00640 1 --2- 172.21.15.99:0/2983416766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08005210 0x7f2a281f59e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.411+0000 7f2a2ca00640 1 -- 172.21.15.99:0/2983416766 >> 172.21.15.99:0/2983416766 conn(0x7f2a280d0450 msgr2=0x7f2a2815f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:19.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.411+0000 7f2a2ca00640 1 -- 172.21.15.99:0/2983416766 shutdown_connections 2024-03-30T13:14:19.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.411+0000 7f2a2ca00640 1 -- 172.21.15.99:0/2983416766 wait complete. 2024-03-30T13:14:19.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:14:19.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.632+0000 7ff1acc00640 1 Processor -- start 2024-03-30T13:14:19.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.633+0000 7ff1acc00640 1 -- start start 2024-03-30T13:14:19.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.634+0000 7ff1acc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a8072820 0x7ff1a80ae390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.634+0000 7ff1acc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a80aea00 con 0x7ff1a806ee50 2024-03-30T13:14:19.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.634+0000 7ff1acc00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a80aece0 con 0x7ff1a815b140 2024-03-30T13:14:19.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.634+0000 7ff1acc00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a80aefc0 con 0x7ff1a8072820 2024-03-30T13:14:19.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff19fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff1a806ee50 0x7ff1a80adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46140/0 (socket says 172.21.15.99:46140) 2024-03-30T13:14:19.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff19fe00640 1 -- 172.21.15.99:0/2319204160 learned_addr learned my addr 172.21.15.99:0/2319204160 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:19.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff1a7e00640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a8072820 0x7ff1a80ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486337340 0 0) 0x7ff1a80aea00 con 0x7ff1a806ee50 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff18c005730 con 0x7ff1a806ee50 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2900620991 0 0) 0x7ff18c005730 con 0x7ff1a806ee50 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a8072820 msgr2=0x7ff1a80ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff1a6a00640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a8072820 0x7ff1a80ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 >> v1:172.21.15.181:6789/0 conn(0x7ff1a815b140 legacy=0x7ff1a806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a80af2a0 con 0x7ff1a806ee50 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7ff190001670 con 0x7ff1a806ee50 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.635+0000 7ff1a7e00640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a8072820 0x7ff1a80ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 >> v1:172.21.15.99:6789/0 conn(0x7ff1a806ee50 legacy=0x7ff1a80adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a6a00640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c005bf0 0x7ff18c006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a6a00640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff18c006a10 0x7ff18c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a6a00640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a8072820 0x7ff18c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a80aefc0 con 0x7ff18c005bf0 2024-03-30T13:14:19.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c0076f0 con 0x7ff18c006a10 2024-03-30T13:14:19.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff18c00e110 con 0x7ff1a8072820 2024-03-30T13:14:19.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a7400640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c005bf0 0x7ff18c006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff19fe00640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff18c006a10 0x7ff18c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a7400640 1 -- 172.21.15.99:0/2319204160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a8072820 msgr2=0x7ff18c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:19.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a7400640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a8072820 0x7ff18c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a7400640 1 -- 172.21.15.99:0/2319204160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff18c006a10 msgr2=0x7ff18c006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:19.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a7400640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff18c006a10 0x7ff18c006e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.636+0000 7ff1a7400640 1 -- 172.21.15.99:0/2319204160 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18c005730 con 0x7ff18c005bf0 2024-03-30T13:14:19.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.637+0000 7ff1a7400640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c005bf0 0x7ff18c006010 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff198001750 tx=0x7ff18c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e653ce71779fc7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:19.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.638+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198001370 con 0x7ff18c005bf0 2024-03-30T13:14:19.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.638+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1980052d0 con 0x7ff18c005bf0 2024-03-30T13:14:19.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.638+0000 7ff1a6a00640 1 -- 172.21.15.99:0/2319204160 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198003830 con 0x7ff18c005bf0 2024-03-30T13:14:19.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.638+0000 7ff1acc00640 1 -- 172.21.15.99:0/2319204160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c005bf0 msgr2=0x7ff18c006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.638+0000 7ff1acc00640 1 --2- 172.21.15.99:0/2319204160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c005bf0 0x7ff18c006010 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff198001750 tx=0x7ff18c007a40 comp rx=0 tx=0).stop 2024-03-30T13:14:19.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.638+0000 7ff1a7e00640 1 -- 172.21.15.99:0/2319204160 reap_dead start 2024-03-30T13:14:19.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.638+0000 7ff1acc00640 1 -- 172.21.15.99:0/2319204160 shutdown_connections 2024-03-30T13:14:19.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.638+0000 7ff1acc00640 1 -- 172.21.15.99:0/2319204160 >> 172.21.15.99:0/2319204160 conn(0x7ff1a806bb40 msgr2=0x7ff1a80b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:19.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.638+0000 7ff1acc00640 1 -- 172.21.15.99:0/2319204160 shutdown_connections 2024-03-30T13:14:19.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.638+0000 7ff1acc00640 1 -- 172.21.15.99:0/2319204160 wait complete. 2024-03-30T13:14:19.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.640+0000 7ff1acc00640 1 Processor -- start 2024-03-30T13:14:19.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.640+0000 7ff1acc00640 1 -- start start 2024-03-30T13:14:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.641+0000 7ff1acc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff18c005bf0 0x7ff1a80cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.641+0000 7ff1acc00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a814b6f0 0x7ff1a814bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.641+0000 7ff1acc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a815b9b0 0x7ff1a815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.641+0000 7ff1acc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a80ae390 con 0x7ff1a815b9b0 2024-03-30T13:14:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.641+0000 7ff1acc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a815b520 con 0x7ff18c005bf0 2024-03-30T13:14:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.641+0000 7ff1acc00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a80ae510 con 0x7ff1a814b6f0 2024-03-30T13:14:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff1a7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a815b9b0 0x7ff1a815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff1a7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a815b9b0 0x7ff1a815be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34804/0 (socket says 172.21.15.99:34804) 2024-03-30T13:14:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff1a7e00640 1 -- 172.21.15.99:0/4288112899 learned_addr learned my addr 172.21.15.99:0/4288112899 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff1a7400640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff18c005bf0 0x7ff1a80cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff19fe00640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a814b6f0 0x7ff1a814bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff1a7e00640 1 -- 172.21.15.99:0/4288112899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a814b6f0 msgr2=0x7ff1a814bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff1a7e00640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a814b6f0 0x7ff1a814bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff1a7e00640 1 -- 172.21.15.99:0/4288112899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff18c005bf0 msgr2=0x7ff1a80cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff1a7e00640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff18c005bf0 0x7ff1a80cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff1a7e00640 1 -- 172.21.15.99:0/4288112899 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a815c720 con 0x7ff1a815b9b0 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff19fe00640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a814b6f0 0x7ff1a814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.642+0000 7ff1a7e00640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a815b9b0 0x7ff1a815be30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff1a815ecd0 tx=0x7ff1a000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.643+0000 7ff19f400640 1 -- 172.21.15.99:0/4288112899 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a001a070 con 0x7ff1a815b9b0 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.643+0000 7ff19f400640 1 -- 172.21.15.99:0/4288112899 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a0007e20 con 0x7ff1a815b9b0 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.643+0000 7ff19f400640 1 -- 172.21.15.99:0/4288112899 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0003bd0 con 0x7ff1a815b9b0 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.643+0000 7ff1acc00640 1 -- 172.21.15.99:0/4288112899 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a815ca00 con 0x7ff1a815b9b0 2024-03-30T13:14:19.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.643+0000 7ff1acc00640 1 -- 172.21.15.99:0/4288112899 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a815cfc0 con 0x7ff1a815b9b0 2024-03-30T13:14:19.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.644+0000 7ff1acc00640 1 -- 172.21.15.99:0/4288112899 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a804f8f0 con 0x7ff1a815b9b0 2024-03-30T13:14:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.645+0000 7ff19f400640 1 -- 172.21.15.99:0/4288112899 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff1a001d070 con 0x7ff1a815b9b0 2024-03-30T13:14:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.646+0000 7ff19f400640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff18406c530 0x7ff18406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.646+0000 7ff19f400640 1 -- 172.21.15.99:0/4288112899 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7ff1a008b680 con 0x7ff1a815b9b0 2024-03-30T13:14:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.646+0000 7ff1a7400640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff18406c530 0x7ff18406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.647+0000 7ff1a7400640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff18406c530 0x7ff18406e9f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff198033000 tx=0x7ff198009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:19.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.650+0000 7ff19f400640 1 -- 172.21.15.99:0/4288112899 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff1a0010070 con 0x7ff1a815b9b0 2024-03-30T13:14:19.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.849+0000 7ff1acc00640 1 -- 172.21.15.99:0/4288112899 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff1a806f8f0 con 0x7ff1a815b9b0 2024-03-30T13:14:19.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.850+0000 7ff19f400640 1 -- 172.21.15.99:0/4288112899 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) ==== 100+0+11 (secure 0 0 0) 0x7ff1a0059b60 con 0x7ff1a815b9b0 2024-03-30T13:14:19.855 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-03-30T13:14:19.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 -- 172.21.15.99:0/4288112899 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff18406c530 msgr2=0x7ff18406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff18406c530 0x7ff18406e9f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff198033000 tx=0x7ff198009030 comp rx=0 tx=0).stop 2024-03-30T13:14:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 -- 172.21.15.99:0/4288112899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a815b9b0 msgr2=0x7ff1a815be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a815b9b0 0x7ff1a815be30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff1a815ecd0 tx=0x7ff1a000d4a0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 -- 172.21.15.99:0/4288112899 shutdown_connections 2024-03-30T13:14:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7ff18406c530 0x7ff18406e9f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a815b9b0 0x7ff1a815be30 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a814b6f0 0x7ff1a814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 --2- 172.21.15.99:0/4288112899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff18c005bf0 0x7ff1a80cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 -- 172.21.15.99:0/4288112899 >> 172.21.15.99:0/4288112899 conn(0x7ff1a806bb40 msgr2=0x7ff1a806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 -- 172.21.15.99:0/4288112899 shutdown_connections 2024-03-30T13:14:19.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:19.853+0000 7ff1acc00640 1 -- 172.21.15.99:0/4288112899 wait complete. 2024-03-30T13:14:19.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:14:20.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.079+0000 7f876f000640 1 Processor -- start 2024-03-30T13:14:20.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.080+0000 7f876f000640 1 -- start start 2024-03-30T13:14:20.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.081+0000 7f876f000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f87680d1100 0x7f876809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.081+0000 7f876f000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87680ce120 0x7f876809af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.081+0000 7f876f000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f876815cb70 con 0x7f876815c790 2024-03-30T13:14:20.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.081+0000 7f876f000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f876809ba70 con 0x7f87680d1100 2024-03-30T13:14:20.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.081+0000 7f876f000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f87680cdc90 con 0x7f87680ce120 2024-03-30T13:14:20.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.081+0000 7f8767400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f87680d1100 0x7f876809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.081+0000 7f8767400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f87680d1100 0x7f876809aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34818/0 (socket says 172.21.15.99:34818) 2024-03-30T13:14:20.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.081+0000 7f8767e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f876815c790 0x7f87680d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46150/0 (socket says 172.21.15.99:46150) 2024-03-30T13:14:20.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.081+0000 7f8767400640 1 -- 172.21.15.99:0/374997177 learned_addr learned my addr 172.21.15.99:0/374997177 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.082+0000 7f876d000640 1 --2- 172.21.15.99:0/374997177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87680ce120 0x7f876809af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.082+0000 7f8767400640 1 -- 172.21.15.99:0/374997177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87680ce120 msgr2=0x7f876809af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.082+0000 7f8767400640 1 --2- 172.21.15.99:0/374997177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87680ce120 0x7f876809af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.082+0000 7f8767400640 1 -- 172.21.15.99:0/374997177 >> v1:172.21.15.99:6789/0 conn(0x7f876815c790 legacy=0x7f87680d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.082+0000 7f8767400640 1 -- 172.21.15.99:0/374997177 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87680cd080 con 0x7f87680d1100 2024-03-30T13:14:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.082+0000 7f8766a00640 1 -- 172.21.15.99:0/374997177 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365913008 0 0) 0x7f876815cb70 con 0x7f876815c790 2024-03-30T13:14:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.083+0000 7f8767400640 1 --2- 172.21.15.99:0/374997177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87680d1100 0x7f876809aa30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f8754009870 tx=0x7f875402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e34a4136b2e2b3e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:20.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.083+0000 7f8766a00640 1 -- 172.21.15.99:0/374997177 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8754034070 con 0x7f87680d1100 2024-03-30T13:14:20.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.083+0000 7f8766a00640 1 -- 172.21.15.99:0/374997177 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8754030840 con 0x7f87680d1100 2024-03-30T13:14:20.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.083+0000 7f8766a00640 1 -- 172.21.15.99:0/374997177 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8754030c10 con 0x7f87680d1100 2024-03-30T13:14:20.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.084+0000 7f876f000640 1 -- 172.21.15.99:0/374997177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87680d1100 msgr2=0x7f876809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.084+0000 7f876f000640 1 --2- 172.21.15.99:0/374997177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87680d1100 0x7f876809aa30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f8754009870 tx=0x7f875402b980 comp rx=0 tx=0).stop 2024-03-30T13:14:20.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.084+0000 7f876f000640 1 -- 172.21.15.99:0/374997177 shutdown_connections 2024-03-30T13:14:20.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.084+0000 7f876f000640 1 --2- 172.21.15.99:0/374997177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87680ce120 0x7f876809af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.084+0000 7f876f000640 1 --2- 172.21.15.99:0/374997177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87680d1100 0x7f876809aa30 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.084+0000 7f876f000640 1 -- 172.21.15.99:0/374997177 >> 172.21.15.99:0/374997177 conn(0x7f87680b3f00 msgr2=0x7f87680b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:20.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.084+0000 7f876f000640 1 -- 172.21.15.99:0/374997177 shutdown_connections 2024-03-30T13:14:20.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.084+0000 7f876f000640 1 -- 172.21.15.99:0/374997177 wait complete. 2024-03-30T13:14:20.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.085+0000 7f876f000640 1 Processor -- start 2024-03-30T13:14:20.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.085+0000 7f876f000640 1 -- start start 2024-03-30T13:14:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.086+0000 7f876f000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87680ce120 0x7f876815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.086+0000 7f876f000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f876815c790 0x7f8768153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.086+0000 7f876f000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f876815e6e0 0x7f876815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.086+0000 7f876f000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f87680cd920 con 0x7f876815e6e0 2024-03-30T13:14:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.086+0000 7f876f000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87680cd640 con 0x7f87680ce120 2024-03-30T13:14:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.086+0000 7f876f000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f87680b1d00 con 0x7f876815c790 2024-03-30T13:14:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.087+0000 7f876d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f876815e6e0 0x7f876815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.087+0000 7f876d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f876815e6e0 0x7f876815dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34826/0 (socket says 172.21.15.99:34826) 2024-03-30T13:14:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.087+0000 7f876d000640 1 -- 172.21.15.99:0/511320717 learned_addr learned my addr 172.21.15.99:0/511320717 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.087+0000 7f8767e00640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87680ce120 0x7f876815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.087+0000 7f8767400640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f876815c790 0x7f8768153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.087+0000 7f876d000640 1 -- 172.21.15.99:0/511320717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f876815c790 msgr2=0x7f8768153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.087+0000 7f876d000640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f876815c790 0x7f8768153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.087+0000 7f876d000640 1 -- 172.21.15.99:0/511320717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87680ce120 msgr2=0x7f876815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.087+0000 7f876d000640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87680ce120 0x7f876815f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.087+0000 7f876d000640 1 -- 172.21.15.99:0/511320717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876815cee0 con 0x7f876815e6e0 2024-03-30T13:14:20.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.087+0000 7f8767400640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f876815c790 0x7f8768153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:20.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.088+0000 7f876d000640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f876815e6e0 0x7f876815dca0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f876000cd20 tx=0x7f876000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:20.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.088+0000 7f875fe00640 1 -- 172.21.15.99:0/511320717 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760003b90 con 0x7f876815e6e0 2024-03-30T13:14:20.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.088+0000 7f875fe00640 1 -- 172.21.15.99:0/511320717 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8760003d30 con 0x7f876815e6e0 2024-03-30T13:14:20.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.088+0000 7f876f000640 1 -- 172.21.15.99:0/511320717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876815d1c0 con 0x7f876815e6e0 2024-03-30T13:14:20.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.088+0000 7f875fe00640 1 -- 172.21.15.99:0/511320717 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760004240 con 0x7f876815e6e0 2024-03-30T13:14:20.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.088+0000 7f876f000640 1 -- 172.21.15.99:0/511320717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876815d780 con 0x7f876815e6e0 2024-03-30T13:14:20.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.089+0000 7f876f000640 1 -- 172.21.15.99:0/511320717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8768068d50 con 0x7f876815e6e0 2024-03-30T13:14:20.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.090+0000 7f875fe00640 1 -- 172.21.15.99:0/511320717 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f87600043e0 con 0x7f876815e6e0 2024-03-30T13:14:20.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.091+0000 7f875fe00640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f874806c560 0x7f874806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.092+0000 7f875fe00640 1 -- 172.21.15.99:0/511320717 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f876008c1b0 con 0x7f876815e6e0 2024-03-30T13:14:20.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.092+0000 7f8767e00640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f874806c560 0x7f874806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.092+0000 7f8767e00640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f874806c560 0x7f874806ea20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8758000f60 tx=0x7f8758007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:20.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.096+0000 7f875fe00640 1 -- 172.21.15.99:0/511320717 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f876001d340 con 0x7f876815e6e0 2024-03-30T13:14:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.338+0000 7f876f000640 1 -- 172.21.15.99:0/511320717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87680b4ab0 con 0x7f876815e6e0 2024-03-30T13:14:20.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.339+0000 7f875fe00640 1 -- 172.21.15.99:0/511320717 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5181 (secure 0 0 0) 0x7f876005a740 con 0x7f876815e6e0 2024-03-30T13:14:20.344 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:20.344 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1591088829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1591088829},{"type":"v1","addr":"172.21.15.99:6837","nonce":1591088829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5115,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/333253843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":333253843},{"type":"v1","addr":"172.21.15.99:6835","nonce":333253843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6834/859511813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":859511813},{"type":"v1","addr":"172.21.15.181:6834","nonce":859511813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:12:04.595024+0000","modified":"2024-03-30T13:14:06.555828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6835/1594018738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6833","nonce":1594018738},{"type":"v1","addr":"172.21.15.181:6835","nonce":1594018738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5121,"qdb_cluster":[5121]},"id":2}]} 2024-03-30T13:14:20.345 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 21 2024-03-30T13:14:20.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.342+0000 7f876f000640 1 -- 172.21.15.99:0/511320717 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f874806c560 msgr2=0x7f874806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.342+0000 7f876f000640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f874806c560 0x7f874806ea20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8758000f60 tx=0x7f8758007c00 comp rx=0 tx=0).stop 2024-03-30T13:14:20.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.342+0000 7f876f000640 1 -- 172.21.15.99:0/511320717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f876815e6e0 msgr2=0x7f876815dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.342+0000 7f876f000640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f876815e6e0 0x7f876815dca0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f876000cd20 tx=0x7f876000a660 comp rx=0 tx=0).stop 2024-03-30T13:14:20.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.342+0000 7f876f000640 1 -- 172.21.15.99:0/511320717 shutdown_connections 2024-03-30T13:14:20.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.342+0000 7f876f000640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f874806c560 0x7f874806ea20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.343+0000 7f876f000640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f876815e6e0 0x7f876815dca0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.343+0000 7f876f000640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f876815c790 0x7f8768153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.343+0000 7f876f000640 1 --2- 172.21.15.99:0/511320717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87680ce120 0x7f876815f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.343+0000 7f876f000640 1 -- 172.21.15.99:0/511320717 >> 172.21.15.99:0/511320717 conn(0x7f87680b3f00 msgr2=0x7f87680cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.343+0000 7f876f000640 1 -- 172.21.15.99:0/511320717 shutdown_connections 2024-03-30T13:14:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.343+0000 7f876f000640 1 -- 172.21.15.99:0/511320717 wait complete. 2024-03-30T13:14:20.366 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:14:20.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.570+0000 7fc55f200640 1 Processor -- start 2024-03-30T13:14:20.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.570+0000 7fc55f200640 1 -- start start 2024-03-30T13:14:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.572+0000 7fc55f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc560153280 0x7fc5600b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.572+0000 7fc55f200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc560160660 0x7fc56006d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.572+0000 7fc55f200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5600ce6d0 con 0x7fc5600ce130 2024-03-30T13:14:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.572+0000 7fc55f200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc5600cf2e0 con 0x7fc560153280 2024-03-30T13:14:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.572+0000 7fc55f200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc5600ce9b0 con 0x7fc560160660 2024-03-30T13:14:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.572+0000 7fc55de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc560153280 0x7fc5600b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.572+0000 7fc557e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc5600ce130 0x7fc56015ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46158/0 (socket says 172.21.15.99:46158) 2024-03-30T13:14:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.572+0000 7fc557e00640 1 -- 172.21.15.99:0/4225988420 learned_addr learned my addr 172.21.15.99:0/4225988420 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.573+0000 7fc55e800640 1 --2- 172.21.15.99:0/4225988420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc560160660 0x7fc56006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.573+0000 7fc55de00640 1 -- 172.21.15.99:0/4225988420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc560160660 msgr2=0x7fc56006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.573+0000 7fc55de00640 1 --2- 172.21.15.99:0/4225988420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc560160660 0x7fc56006d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.573+0000 7fc55de00640 1 -- 172.21.15.99:0/4225988420 >> v1:172.21.15.99:6789/0 conn(0x7fc5600ce130 legacy=0x7fc56015ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.573+0000 7fc55de00640 1 -- 172.21.15.99:0/4225988420 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5600cec90 con 0x7fc560153280 2024-03-30T13:14:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.574+0000 7fc55de00640 1 --2- 172.21.15.99:0/4225988420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc560153280 0x7fc5600b4e50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc5500097a0 tx=0x7fc55002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac08e8b249db5b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.574+0000 7fc55d400640 1 -- 172.21.15.99:0/4225988420 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5500315a0 con 0x7fc560153280 2024-03-30T13:14:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.574+0000 7fc55d400640 1 -- 172.21.15.99:0/4225988420 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc550037070 con 0x7fc560153280 2024-03-30T13:14:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.574+0000 7fc55d400640 1 -- 172.21.15.99:0/4225988420 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550031960 con 0x7fc560153280 2024-03-30T13:14:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.575+0000 7fc55f200640 1 -- 172.21.15.99:0/4225988420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc560153280 msgr2=0x7fc5600b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.575+0000 7fc55f200640 1 --2- 172.21.15.99:0/4225988420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc560153280 0x7fc5600b4e50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc5500097a0 tx=0x7fc55002b840 comp rx=0 tx=0).stop 2024-03-30T13:14:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.575+0000 7fc55f200640 1 -- 172.21.15.99:0/4225988420 shutdown_connections 2024-03-30T13:14:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.575+0000 7fc55f200640 1 --2- 172.21.15.99:0/4225988420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc560160660 0x7fc56006d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.575+0000 7fc55f200640 1 --2- 172.21.15.99:0/4225988420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc560153280 0x7fc5600b4e50 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.575+0000 7fc55f200640 1 -- 172.21.15.99:0/4225988420 >> 172.21.15.99:0/4225988420 conn(0x7fc56006bb40 msgr2=0x7fc5600b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.575+0000 7fc55f200640 1 -- 172.21.15.99:0/4225988420 shutdown_connections 2024-03-30T13:14:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.575+0000 7fc55f200640 1 -- 172.21.15.99:0/4225988420 wait complete. 2024-03-30T13:14:20.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.577+0000 7fc55f200640 1 Processor -- start 2024-03-30T13:14:20.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.577+0000 7fc55f200640 1 -- start start 2024-03-30T13:14:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5600ce130 0x7fc560152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55f200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc560153280 0x7fc5600715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55f200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc560160660 0x7fc5601f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc560153660 con 0x7fc5600ce130 2024-03-30T13:14:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55f200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc5600b5390 con 0x7fc560160660 2024-03-30T13:14:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55f200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc5601537e0 con 0x7fc560153280 2024-03-30T13:14:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5600ce130 0x7fc560152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5600ce130 0x7fc560152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34854/0 (socket says 172.21.15.99:34854) 2024-03-30T13:14:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55de00640 1 -- 172.21.15.99:0/853285767 learned_addr learned my addr 172.21.15.99:0/853285767 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc557e00640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc560153280 0x7fc5600715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55de00640 1 -- 172.21.15.99:0/853285767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc560153280 msgr2=0x7fc5600715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55de00640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc560153280 0x7fc5600715f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55de00640 1 -- 172.21.15.99:0/853285767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc560160660 msgr2=0x7fc5601f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55e800640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc560160660 0x7fc5601f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55de00640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc560160660 0x7fc5601f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.579+0000 7fc55de00640 1 -- 172.21.15.99:0/853285767 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc560072450 con 0x7fc5600ce130 2024-03-30T13:14:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.580+0000 7fc55de00640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5600ce130 0x7fc560152b60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc550034040 tx=0x7fc5500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.580+0000 7fc556000640 1 -- 172.21.15.99:0/853285767 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550032840 con 0x7fc5600ce130 2024-03-30T13:14:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.580+0000 7fc556000640 1 -- 172.21.15.99:0/853285767 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc550032a00 con 0x7fc5600ce130 2024-03-30T13:14:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.580+0000 7fc55f200640 1 -- 172.21.15.99:0/853285767 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc560072730 con 0x7fc5600ce130 2024-03-30T13:14:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.580+0000 7fc556000640 1 -- 172.21.15.99:0/853285767 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550032df0 con 0x7fc5600ce130 2024-03-30T13:14:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.580+0000 7fc55f200640 1 -- 172.21.15.99:0/853285767 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5601f7750 con 0x7fc5600ce130 2024-03-30T13:14:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.581+0000 7fc55f200640 1 -- 172.21.15.99:0/853285767 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56004f8f0 con 0x7fc5600ce130 2024-03-30T13:14:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.582+0000 7fc556000640 1 -- 172.21.15.99:0/853285767 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc55004e430 con 0x7fc5600ce130 2024-03-30T13:14:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.583+0000 7fc556000640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53c06c530 0x7fc53c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.583+0000 7fc556000640 1 -- 172.21.15.99:0/853285767 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fc55002f030 con 0x7fc5600ce130 2024-03-30T13:14:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.583+0000 7fc557e00640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53c06c530 0x7fc53c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.584+0000 7fc557e00640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53c06c530 0x7fc53c06e9f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc560156d40 tx=0x7fc548009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.588+0000 7fc556000640 1 -- 172.21.15.99:0/853285767 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc550040070 con 0x7fc5600ce130 2024-03-30T13:14:20.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.787+0000 7fc55f200640 1 -- 172.21.15.99:0/853285767 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc56015f890 con 0x7fc5600ce130 2024-03-30T13:14:20.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.790+0000 7fc556000640 1 -- 172.21.15.99:0/853285767 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16926 (secure 0 0 0) 0x7fc55007bcf0 con 0x7fc5600ce130 2024-03-30T13:14:20.794 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:20.795 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":40,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:14:10.165267+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:12:02.458079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:12:03.597299+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:14:20.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 -- 172.21.15.99:0/853285767 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53c06c530 msgr2=0x7fc53c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53c06c530 0x7fc53c06e9f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc560156d40 tx=0x7fc548009040 comp rx=0 tx=0).stop 2024-03-30T13:14:20.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 -- 172.21.15.99:0/853285767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5600ce130 msgr2=0x7fc560152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:20.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5600ce130 0x7fc560152b60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc550034040 tx=0x7fc5500046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 -- 172.21.15.99:0/853285767 shutdown_connections 2024-03-30T13:14:20.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc53c06c530 0x7fc53c06e9f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc560160660 0x7fc5601f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc560153280 0x7fc5600715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 --2- 172.21.15.99:0/853285767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5600ce130 0x7fc560152b60 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:20.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 -- 172.21.15.99:0/853285767 >> 172.21.15.99:0/853285767 conn(0x7fc56006bb40 msgr2=0x7fc56006e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:20.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 -- 172.21.15.99:0/853285767 shutdown_connections 2024-03-30T13:14:20.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:20.792+0000 7fc55f200640 1 -- 172.21.15.99:0/853285767 wait complete. 2024-03-30T13:14:20.815 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T13:14:20.816 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:14:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.020+0000 7f5123000640 1 Processor -- start 2024-03-30T13:14:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.020+0000 7f5123000640 1 -- start start 2024-03-30T13:14:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.022+0000 7f5123000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f511c0d0f70 0x7f511c06cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.022+0000 7f5123000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f511c06d910 0x7f511c1619d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.022+0000 7f5123000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c06ddd0 con 0x7f511c0d1350 2024-03-30T13:14:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.022+0000 7f5123000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f511c06e070 con 0x7f511c06d910 2024-03-30T13:14:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.022+0000 7f5123000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f511c0d4be0 con 0x7f511c0d0f70 2024-03-30T13:14:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.022+0000 7f5122600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f511c0d1350 0x7f511c1625c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46166/0 (socket says 172.21.15.99:46166) 2024-03-30T13:14:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.022+0000 7f5122600640 1 -- 172.21.15.99:0/3450996684 learned_addr learned my addr 172.21.15.99:0/3450996684 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.022+0000 7f5121c00640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f511c0d0f70 0x7f511c06cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.022+0000 7f5121200640 1 --2- 172.21.15.99:0/3450996684 >> v2:172.21.15.181:3300/0 conn(0x7f511c06d910 0x7f511c1619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551939937 0 0) 0x7f511c06ddd0 con 0x7f511c0d1350 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5104003520 con 0x7f511c0d1350 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 796575534 0 0) 0x7f5104003520 con 0x7f511c0d1350 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f511c0d0f70 msgr2=0x7f511c06cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f511c0d0f70 0x7f511c06cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 >> v2:172.21.15.181:3300/0 conn(0x7f511c06d910 msgr2=0x7f511c1619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 --2- 172.21.15.99:0/3450996684 >> v2:172.21.15.181:3300/0 conn(0x7f511c06d910 0x7f511c1619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c0d4ec0 con 0x7f511c0d1350 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f51140019f0 con 0x7f511c0d1350 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 >> v1:172.21.15.99:6789/0 conn(0x7f511c0d1350 legacy=0x7f511c1625c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51040039b0 0x7f5104003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5104004800 0x7f5104004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f511c0d0f70 0x7f51040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f511c06e070 con 0x7f5104004800 2024-03-30T13:14:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f511c0d4be0 con 0x7f51040039b0 2024-03-30T13:14:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.023+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f510400b9c0 con 0x7f511c0d0f70 2024-03-30T13:14:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.024+0000 7f5121200640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5104004800 0x7f5104004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.024+0000 7f5121c00640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51040039b0 0x7f5104003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.024+0000 7f5122600640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f511c0d0f70 0x7f51040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.024+0000 7f5121200640 1 -- 172.21.15.99:0/3450996684 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f511c0d0f70 msgr2=0x7f51040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.024+0000 7f5121200640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f511c0d0f70 0x7f51040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.024+0000 7f5121200640 1 -- 172.21.15.99:0/3450996684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51040039b0 msgr2=0x7f5104003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.024+0000 7f5121200640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51040039b0 0x7f5104003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.024+0000 7f5121200640 1 -- 172.21.15.99:0/3450996684 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5104003520 con 0x7f5104004800 2024-03-30T13:14:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.025+0000 7f5121200640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5104004800 0x7f5104004c80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5108009a90 tx=0x7f5104005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb629ff882622aea server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.025+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108039070 con 0x7f5104004800 2024-03-30T13:14:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.025+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510802c6b0 con 0x7f5104004800 2024-03-30T13:14:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.025+0000 7f511be00640 1 -- 172.21.15.99:0/3450996684 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108009690 con 0x7f5104004800 2024-03-30T13:14:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.026+0000 7f5123000640 1 -- 172.21.15.99:0/3450996684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5104004800 msgr2=0x7f5104004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.026+0000 7f5123000640 1 --2- 172.21.15.99:0/3450996684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5104004800 0x7f5104004c80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5108009a90 tx=0x7f5104005830 comp rx=0 tx=0).stop 2024-03-30T13:14:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.026+0000 7f5122600640 1 -- 172.21.15.99:0/3450996684 reap_dead start 2024-03-30T13:14:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.026+0000 7f5123000640 1 -- 172.21.15.99:0/3450996684 shutdown_connections 2024-03-30T13:14:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.026+0000 7f5123000640 1 -- 172.21.15.99:0/3450996684 >> 172.21.15.99:0/3450996684 conn(0x7f511c08bfc0 msgr2=0x7f511c0d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.026+0000 7f5123000640 1 -- 172.21.15.99:0/3450996684 shutdown_connections 2024-03-30T13:14:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.026+0000 7f5123000640 1 -- 172.21.15.99:0/3450996684 wait complete. 2024-03-30T13:14:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.028+0000 7f5123000640 1 Processor -- start 2024-03-30T13:14:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.028+0000 7f5123000640 1 -- start start 2024-03-30T13:14:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.029+0000 7f5123000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5104004800 0x7f511c155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.029+0000 7f5123000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f511c09ead0 0x7f511c09ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.029+0000 7f5123000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0b8430 0x7f511c0b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.029+0000 7f5123000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f511c06e350 con 0x7f511c0b8430 2024-03-30T13:14:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.029+0000 7f5123000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f511c0d3340 con 0x7f511c09ead0 2024-03-30T13:14:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.029+0000 7f5123000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f511c0cef40 con 0x7f5104004800 2024-03-30T13:14:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.029+0000 7f5122600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0b8430 0x7f511c0b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.029+0000 7f5122600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0b8430 0x7f511c0b88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34874/0 (socket says 172.21.15.99:34874) 2024-03-30T13:14:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.029+0000 7f5122600640 1 -- 172.21.15.99:0/468422263 learned_addr learned my addr 172.21.15.99:0/468422263 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.030+0000 7f5121200640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f511c09ead0 0x7f511c09ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.030+0000 7f5121c00640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5104004800 0x7f511c155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.030+0000 7f5122600640 1 -- 172.21.15.99:0/468422263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5104004800 msgr2=0x7f511c155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.030+0000 7f5122600640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5104004800 0x7f511c155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.030+0000 7f5122600640 1 -- 172.21.15.99:0/468422263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f511c09ead0 msgr2=0x7f511c09ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.030+0000 7f5122600640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f511c09ead0 0x7f511c09ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.030+0000 7f5122600640 1 -- 172.21.15.99:0/468422263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c0a13f0 con 0x7f511c0b8430 2024-03-30T13:14:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.030+0000 7f5122600640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0b8430 0x7f511c0b88e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f51140013d0 tx=0x7f511400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.030+0000 7f5119600640 1 -- 172.21.15.99:0/468422263 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511400eb90 con 0x7f511c0b8430 2024-03-30T13:14:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.030+0000 7f5119600640 1 -- 172.21.15.99:0/468422263 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5114018070 con 0x7f511c0b8430 2024-03-30T13:14:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.030+0000 7f5119600640 1 -- 172.21.15.99:0/468422263 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114013420 con 0x7f511c0b8430 2024-03-30T13:14:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.031+0000 7f5123000640 1 -- 172.21.15.99:0/468422263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511c0a16d0 con 0x7f511c0b8430 2024-03-30T13:14:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.031+0000 7f5123000640 1 -- 172.21.15.99:0/468422263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f511c0a1c90 con 0x7f511c0b8430 2024-03-30T13:14:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.032+0000 7f5123000640 1 -- 172.21.15.99:0/468422263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511c04f8f0 con 0x7f511c0b8430 2024-03-30T13:14:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.033+0000 7f5119600640 1 -- 172.21.15.99:0/468422263 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f51140135c0 con 0x7f511c0b8430 2024-03-30T13:14:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.034+0000 7f5119600640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f50fc06c530 0x7f50fc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.034+0000 7f5119600640 1 -- 172.21.15.99:0/468422263 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f511408baf0 con 0x7f511c0b8430 2024-03-30T13:14:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.034+0000 7f5121c00640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f50fc06c530 0x7f50fc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.035+0000 7f5121c00640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f50fc06c530 0x7f50fc06e9f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5110009930 tx=0x7f5110008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.039+0000 7f5119600640 1 -- 172.21.15.99:0/468422263 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f511405a080 con 0x7f511c0b8430 2024-03-30T13:14:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.278+0000 7f5123000640 1 -- 172.21.15.99:0/468422263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f511c0680b0 con 0x7f511c0b8430 2024-03-30T13:14:21.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.279+0000 7f5119600640 1 -- 172.21.15.99:0/468422263 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5181 (secure 0 0 0) 0x7f5114059980 con 0x7f511c0b8430 2024-03-30T13:14:21.284 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:21.284 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1591088829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1591088829},{"type":"v1","addr":"172.21.15.99:6837","nonce":1591088829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5115,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/333253843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":333253843},{"type":"v1","addr":"172.21.15.99:6835","nonce":333253843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6834/859511813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":859511813},{"type":"v1","addr":"172.21.15.181:6834","nonce":859511813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:12:04.595024+0000","modified":"2024-03-30T13:14:06.555828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6835/1594018738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6833","nonce":1594018738},{"type":"v1","addr":"172.21.15.181:6835","nonce":1594018738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5121,"qdb_cluster":[5121]},"id":2}]} 2024-03-30T13:14:21.285 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 21 2024-03-30T13:14:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 -- 172.21.15.99:0/468422263 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f50fc06c530 msgr2=0x7f50fc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f50fc06c530 0x7f50fc06e9f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5110009930 tx=0x7f5110008040 comp rx=0 tx=0).stop 2024-03-30T13:14:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 -- 172.21.15.99:0/468422263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0b8430 msgr2=0x7f511c0b88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0b8430 0x7f511c0b88e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f51140013d0 tx=0x7f511400e530 comp rx=0 tx=0).stop 2024-03-30T13:14:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 -- 172.21.15.99:0/468422263 shutdown_connections 2024-03-30T13:14:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f50fc06c530 0x7f50fc06e9f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0b8430 0x7f511c0b88e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f511c09ead0 0x7f511c09ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 --2- 172.21.15.99:0/468422263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5104004800 0x7f511c155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 -- 172.21.15.99:0/468422263 >> 172.21.15.99:0/468422263 conn(0x7f511c08bfc0 msgr2=0x7f511c0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 -- 172.21.15.99:0/468422263 shutdown_connections 2024-03-30T13:14:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.282+0000 7f5123000640 1 -- 172.21.15.99:0/468422263 wait complete. 2024-03-30T13:14:21.304 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:14:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.498+0000 7f36c0800640 1 Processor -- start 2024-03-30T13:14:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.498+0000 7f36c0800640 1 -- start start 2024-03-30T13:14:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.500+0000 7f36c0800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f36b815c670 0x7f36b806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.500+0000 7f36c0800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b80ad940 0x7f36b806d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.500+0000 7f36c0800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36b8146230 con 0x7f36b806f060 2024-03-30T13:14:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.500+0000 7f36c0800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f36b806dfc0 con 0x7f36b815c670 2024-03-30T13:14:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.500+0000 7f36c0800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f36b806e2a0 con 0x7f36b80ad940 2024-03-30T13:14:21.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.501+0000 7f36bde00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f36b815c670 0x7f36b806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.501+0000 7f36bde00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f36b815c670 0x7f36b806c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:60686/0 (socket says 172.21.15.99:60686) 2024-03-30T13:14:21.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.501+0000 7f36bde00640 1 -- 172.21.15.99:0/2343134127 learned_addr learned my addr 172.21.15.99:0/2343134127 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:21.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.501+0000 7f36be800640 1 --2- 172.21.15.99:0/2343134127 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b80ad940 0x7f36b806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.501+0000 7f36bde00640 1 -- 172.21.15.99:0/2343134127 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b80ad940 msgr2=0x7f36b806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:21.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.501+0000 7f36bde00640 1 --2- 172.21.15.99:0/2343134127 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b80ad940 0x7f36b806d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.501+0000 7f36bde00640 1 -- 172.21.15.99:0/2343134127 >> v1:172.21.15.181:6789/0 conn(0x7f36b806f060 legacy=0x7f36b80ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.501+0000 7f36bde00640 1 -- 172.21.15.99:0/2343134127 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b806e580 con 0x7f36b815c670 2024-03-30T13:14:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.502+0000 7f36bde00640 1 --2- 172.21.15.99:0/2343134127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b815c670 0x7f36b806c030 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009870 tx=0x7f36ac02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2f2e375e4b29c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.503+0000 7f36bca00640 1 -- 172.21.15.99:0/2343134127 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac035020 con 0x7f36b815c670 2024-03-30T13:14:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.503+0000 7f36bca00640 1 -- 172.21.15.99:0/2343134127 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ac031640 con 0x7f36b815c670 2024-03-30T13:14:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.503+0000 7f36bca00640 1 -- 172.21.15.99:0/2343134127 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac02d040 con 0x7f36b815c670 2024-03-30T13:14:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.504+0000 7f36c0800640 1 -- 172.21.15.99:0/2343134127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b815c670 msgr2=0x7f36b806c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.504+0000 7f36c0800640 1 --2- 172.21.15.99:0/2343134127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b815c670 0x7f36b806c030 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009870 tx=0x7f36ac02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.504+0000 7f36c0800640 1 -- 172.21.15.99:0/2343134127 shutdown_connections 2024-03-30T13:14:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.504+0000 7f36c0800640 1 --2- 172.21.15.99:0/2343134127 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b80ad940 0x7f36b806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.504+0000 7f36c0800640 1 --2- 172.21.15.99:0/2343134127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b815c670 0x7f36b806c030 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.504+0000 7f36c0800640 1 -- 172.21.15.99:0/2343134127 >> 172.21.15.99:0/2343134127 conn(0x7f36b806b510 msgr2=0x7f36b806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:21.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.504+0000 7f36c0800640 1 -- 172.21.15.99:0/2343134127 shutdown_connections 2024-03-30T13:14:21.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.504+0000 7f36c0800640 1 -- 172.21.15.99:0/2343134127 wait complete. 2024-03-30T13:14:21.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.506+0000 7f36c0800640 1 Processor -- start 2024-03-30T13:14:21.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.506+0000 7f36c0800640 1 -- start start 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.507+0000 7f36c0800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36b806f060 0x7f36b80ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.507+0000 7f36c0800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b80ad940 0x7f36b81f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.507+0000 7f36c0800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b815c670 0x7f36b80992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.507+0000 7f36c0800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f36b80b32c0 con 0x7f36b806f060 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.507+0000 7f36c0800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f36b815ca50 con 0x7f36b815c670 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.507+0000 7f36c0800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f36b80b3440 con 0x7f36b80ad940 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.508+0000 7f36bde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36b806f060 0x7f36b80ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.508+0000 7f36bde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36b806f060 0x7f36b80ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34888/0 (socket says 172.21.15.99:34888) 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.508+0000 7f36bde00640 1 -- 172.21.15.99:0/906151527 learned_addr learned my addr 172.21.15.99:0/906151527 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.508+0000 7f36bd400640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b80ad940 0x7f36b81f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.508+0000 7f36be800640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b815c670 0x7f36b80992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.508+0000 7f36bde00640 1 -- 172.21.15.99:0/906151527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b80ad940 msgr2=0x7f36b81f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.508+0000 7f36bde00640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b80ad940 0x7f36b81f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.508+0000 7f36bde00640 1 -- 172.21.15.99:0/906151527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b815c670 msgr2=0x7f36b80992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.508+0000 7f36bde00640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b815c670 0x7f36b80992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.508+0000 7f36bde00640 1 -- 172.21.15.99:0/906151527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b815df30 con 0x7f36b806f060 2024-03-30T13:14:21.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.508+0000 7f36bde00640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36b806f060 0x7f36b80ce0d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f36ac000c00 tx=0x7f36ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.509+0000 7f36b2000640 1 -- 172.21.15.99:0/906151527 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac040070 con 0x7f36b806f060 2024-03-30T13:14:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.509+0000 7f36b2000640 1 -- 172.21.15.99:0/906151527 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ac0399f0 con 0x7f36b806f060 2024-03-30T13:14:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.509+0000 7f36b2000640 1 -- 172.21.15.99:0/906151527 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac035040 con 0x7f36b806f060 2024-03-30T13:14:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.509+0000 7f36c0800640 1 -- 172.21.15.99:0/906151527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b815e210 con 0x7f36b806f060 2024-03-30T13:14:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.509+0000 7f36c0800640 1 -- 172.21.15.99:0/906151527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b815e7d0 con 0x7f36b806f060 2024-03-30T13:14:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.510+0000 7f36c0800640 1 -- 172.21.15.99:0/906151527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b8068640 con 0x7f36b806f060 2024-03-30T13:14:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.511+0000 7f36b2000640 1 -- 172.21.15.99:0/906151527 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f36ac04b060 con 0x7f36b806f060 2024-03-30T13:14:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.512+0000 7f36b2000640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f369c06c530 0x7f369c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.512+0000 7f36b2000640 1 -- 172.21.15.99:0/906151527 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f36ac0acfd0 con 0x7f36b806f060 2024-03-30T13:14:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.512+0000 7f36bd400640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f369c06c530 0x7f369c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.513+0000 7f36bd400640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f369c06c530 0x7f369c06e9f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36b80aeb50 tx=0x7f36a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.517+0000 7f36b2000640 1 -- 172.21.15.99:0/906151527 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f36ac07b550 con 0x7f36b806f060 2024-03-30T13:14:21.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.757+0000 7f36c0800640 1 -- 172.21.15.99:0/906151527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36b806f570 con 0x7f36b806f060 2024-03-30T13:14:21.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.758+0000 7f36b2000640 1 -- 172.21.15.99:0/906151527 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5181 (secure 0 0 0) 0x7f36ac07ae50 con 0x7f36b806f060 2024-03-30T13:14:21.763 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:21.763 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1591088829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1591088829},{"type":"v1","addr":"172.21.15.99:6837","nonce":1591088829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5115,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/333253843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":333253843},{"type":"v1","addr":"172.21.15.99:6835","nonce":333253843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6834/859511813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":859511813},{"type":"v1","addr":"172.21.15.181:6834","nonce":859511813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:12:04.595024+0000","modified":"2024-03-30T13:14:06.555828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6835/1594018738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6833","nonce":1594018738},{"type":"v1","addr":"172.21.15.181:6835","nonce":1594018738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5121,"qdb_cluster":[5121]},"id":2}]} 2024-03-30T13:14:21.763 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 21 2024-03-30T13:14:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 -- 172.21.15.99:0/906151527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f369c06c530 msgr2=0x7f369c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f369c06c530 0x7f369c06e9f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36b80aeb50 tx=0x7f36a8009040 comp rx=0 tx=0).stop 2024-03-30T13:14:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 -- 172.21.15.99:0/906151527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36b806f060 msgr2=0x7f36b80ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36b806f060 0x7f36b80ce0d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f36ac000c00 tx=0x7f36ac0046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 -- 172.21.15.99:0/906151527 shutdown_connections 2024-03-30T13:14:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f369c06c530 0x7f369c06e9f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b815c670 0x7f36b80992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b80ad940 0x7f36b81f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 --2- 172.21.15.99:0/906151527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36b806f060 0x7f36b80ce0d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 -- 172.21.15.99:0/906151527 >> 172.21.15.99:0/906151527 conn(0x7f36b806b510 msgr2=0x7f36b80b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:21.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 -- 172.21.15.99:0/906151527 shutdown_connections 2024-03-30T13:14:21.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.761+0000 7f36c0800640 1 -- 172.21.15.99:0/906151527 wait complete. 2024-03-30T13:14:21.785 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:14:22.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.995+0000 7fc699600640 1 Processor -- start 2024-03-30T13:14:22.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.995+0000 7fc699600640 1 -- start start 2024-03-30T13:14:22.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.996+0000 7fc699600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc6940ad940 0x7fc69406c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.996+0000 7fc699600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc69406f060 0x7fc69406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.996+0000 7fc699600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc694146230 con 0x7fc69415c670 2024-03-30T13:14:22.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.996+0000 7fc699600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc69406dfc0 con 0x7fc6940ad940 2024-03-30T13:14:22.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.996+0000 7fc699600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc69406e2a0 con 0x7fc69406f060 2024-03-30T13:14:22.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.997+0000 7fc692a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc69415c670 0x7fc6940ad230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46168/0 (socket says 172.21.15.99:46168) 2024-03-30T13:14:22.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.997+0000 7fc692a00640 1 -- 172.21.15.99:0/1920678827 learned_addr learned my addr 172.21.15.99:0/1920678827 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:22.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.997+0000 7fc68be00640 1 --2- 172.21.15.99:0/1920678827 >> v2:172.21.15.99:3300/0 conn(0x7fc6940ad940 0x7fc69406c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.997+0000 7fc693400640 1 --2- 172.21.15.99:0/1920678827 >> v2:172.21.15.181:3300/0 conn(0x7fc69406f060 0x7fc69406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.997+0000 7fc692000640 1 -- 172.21.15.99:0/1920678827 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3736768570 0 0) 0x7fc684001110 con 0x7fc69415c670 2024-03-30T13:14:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.997+0000 7fc692000640 1 -- 172.21.15.99:0/1920678827 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc678003520 con 0x7fc69415c670 2024-03-30T13:14:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.997+0000 7fc68be00640 1 -- 172.21.15.99:0/1920678827 >> v2:172.21.15.181:3300/0 conn(0x7fc69406f060 msgr2=0x7fc69406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.997+0000 7fc68be00640 1 --2- 172.21.15.99:0/1920678827 >> v2:172.21.15.181:3300/0 conn(0x7fc69406f060 0x7fc69406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.997+0000 7fc68be00640 1 -- 172.21.15.99:0/1920678827 >> v1:172.21.15.99:6789/0 conn(0x7fc69415c670 legacy=0x7fc6940ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.997+0000 7fc68be00640 1 -- 172.21.15.99:0/1920678827 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69406e580 con 0x7fc6940ad940 2024-03-30T13:14:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.999+0000 7fc68be00640 1 --2- 172.21.15.99:0/1920678827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6940ad940 0x7fc69406c030 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc6940b54e0 tx=0x7fc67c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5014e323d6466d26 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.999+0000 7fc692000640 1 -- 172.21.15.99:0/1920678827 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0315a0 con 0x7fc6940ad940 2024-03-30T13:14:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.999+0000 7fc692000640 1 -- 172.21.15.99:0/1920678827 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67c037070 con 0x7fc6940ad940 2024-03-30T13:14:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.999+0000 7fc692000640 1 -- 172.21.15.99:0/1920678827 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c031940 con 0x7fc6940ad940 2024-03-30T13:14:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.999+0000 7fc699600640 1 -- 172.21.15.99:0/1920678827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6940ad940 msgr2=0x7fc69406c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.999+0000 7fc699600640 1 --2- 172.21.15.99:0/1920678827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6940ad940 0x7fc69406c030 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc6940b54e0 tx=0x7fc67c02b840 comp rx=0 tx=0).stop 2024-03-30T13:14:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.999+0000 7fc699600640 1 -- 172.21.15.99:0/1920678827 shutdown_connections 2024-03-30T13:14:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.999+0000 7fc699600640 1 --2- 172.21.15.99:0/1920678827 >> v2:172.21.15.181:3300/0 conn(0x7fc69406f060 0x7fc69406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.999+0000 7fc699600640 1 --2- 172.21.15.99:0/1920678827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6940ad940 0x7fc69406c030 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:21.999+0000 7fc699600640 1 -- 172.21.15.99:0/1920678827 >> 172.21.15.99:0/1920678827 conn(0x7fc69406b510 msgr2=0x7fc69406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.000+0000 7fc699600640 1 -- 172.21.15.99:0/1920678827 shutdown_connections 2024-03-30T13:14:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.000+0000 7fc699600640 1 -- 172.21.15.99:0/1920678827 wait complete. 2024-03-30T13:14:22.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.001+0000 7fc699600640 1 Processor -- start 2024-03-30T13:14:22.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.001+0000 7fc699600640 1 -- start start 2024-03-30T13:14:22.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.002+0000 7fc699600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc69406f060 0x7fc694151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.002+0000 7fc699600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6940ad940 0x7fc694099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.002+0000 7fc699600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69415c670 0x7fc6940cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.002+0000 7fc699600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc6940b32c0 con 0x7fc69415c670 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.002+0000 7fc699600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc69415ca50 con 0x7fc6940ad940 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.002+0000 7fc699600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc6940b3440 con 0x7fc69406f060 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.003+0000 7fc693400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69415c670 0x7fc6940cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.003+0000 7fc693400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69415c670 0x7fc6940cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34906/0 (socket says 172.21.15.99:34906) 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.003+0000 7fc693400640 1 -- 172.21.15.99:0/3000685001 learned_addr learned my addr 172.21.15.99:0/3000685001 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.003+0000 7fc68be00640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6940ad940 0x7fc694099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.003+0000 7fc693400640 1 -- 172.21.15.99:0/3000685001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc69406f060 msgr2=0x7fc694151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.003+0000 7fc692a00640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc69406f060 0x7fc694151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.003+0000 7fc693400640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc69406f060 0x7fc694151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.003+0000 7fc693400640 1 -- 172.21.15.99:0/3000685001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6940ad940 msgr2=0x7fc694099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.003+0000 7fc693400640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6940ad940 0x7fc694099980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.003+0000 7fc693400640 1 -- 172.21.15.99:0/3000685001 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc694099ec0 con 0x7fc69415c670 2024-03-30T13:14:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.003+0000 7fc693400640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69415c670 0x7fc6940cc6e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009dd0 tx=0x7fc68c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.004+0000 7fc68aa00640 1 -- 172.21.15.99:0/3000685001 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c018020 con 0x7fc69415c670 2024-03-30T13:14:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.004+0000 7fc68aa00640 1 -- 172.21.15.99:0/3000685001 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68c014480 con 0x7fc69415c670 2024-03-30T13:14:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.004+0000 7fc68aa00640 1 -- 172.21.15.99:0/3000685001 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c014870 con 0x7fc69415c670 2024-03-30T13:14:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.004+0000 7fc699600640 1 -- 172.21.15.99:0/3000685001 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc694072d90 con 0x7fc69415c670 2024-03-30T13:14:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.004+0000 7fc699600640 1 -- 172.21.15.99:0/3000685001 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6940cd560 con 0x7fc69415c670 2024-03-30T13:14:22.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.005+0000 7fc699600640 1 -- 172.21.15.99:0/3000685001 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc694068640 con 0x7fc69415c670 2024-03-30T13:14:22.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.006+0000 7fc68aa00640 1 -- 172.21.15.99:0/3000685001 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc68c005d10 con 0x7fc69415c670 2024-03-30T13:14:22.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.007+0000 7fc68aa00640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc67006c530 0x7fc67006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.008+0000 7fc68aa00640 1 -- 172.21.15.99:0/3000685001 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fc68c08c2e0 con 0x7fc69415c670 2024-03-30T13:14:22.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.008+0000 7fc692a00640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc67006c530 0x7fc67006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.008+0000 7fc692a00640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc67006c530 0x7fc67006e9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc6840012b0 tx=0x7fc684009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:22.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.012+0000 7fc68aa00640 1 -- 172.21.15.99:0/3000685001 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc68c022070 con 0x7fc69415c670 2024-03-30T13:14:22.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.198+0000 7fc699600640 1 -- 172.21.15.99:0/3000685001 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc69406f570 con 0x7fc69415c670 2024-03-30T13:14:22.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.199+0000 7fc68aa00640 1 -- 172.21.15.99:0/3000685001 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16926 (secure 0 0 0) 0x7fc694099ec0 con 0x7fc69415c670 2024-03-30T13:14:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:22.205 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":40,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:14:10.165267+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:12:02.458079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-30T13:12:03.597299+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.202+0000 7fc699600640 1 -- 172.21.15.99:0/3000685001 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc67006c530 msgr2=0x7fc67006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.202+0000 7fc699600640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc67006c530 0x7fc67006e9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc6840012b0 tx=0x7fc684009040 comp rx=0 tx=0).stop 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.203+0000 7fc699600640 1 -- 172.21.15.99:0/3000685001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69415c670 msgr2=0x7fc6940cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.203+0000 7fc699600640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69415c670 0x7fc6940cc6e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009dd0 tx=0x7fc68c00c490 comp rx=0 tx=0).stop 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.203+0000 7fc699600640 1 -- 172.21.15.99:0/3000685001 shutdown_connections 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.203+0000 7fc699600640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fc67006c530 0x7fc67006e9f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.203+0000 7fc699600640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69415c670 0x7fc6940cc6e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.203+0000 7fc699600640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6940ad940 0x7fc694099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.203+0000 7fc699600640 1 --2- 172.21.15.99:0/3000685001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc69406f060 0x7fc694151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.203+0000 7fc699600640 1 -- 172.21.15.99:0/3000685001 >> 172.21.15.99:0/3000685001 conn(0x7fc69406b510 msgr2=0x7fc694160090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.203+0000 7fc699600640 1 -- 172.21.15.99:0/3000685001 shutdown_connections 2024-03-30T13:14:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.203+0000 7fc699600640 1 -- 172.21.15.99:0/3000685001 wait complete. 2024-03-30T13:14:22.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-30T13:14:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.417+0000 7f4e81600640 1 Processor -- start 2024-03-30T13:14:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.417+0000 7f4e81600640 1 -- start start 2024-03-30T13:14:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.419+0000 7f4e81600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4e7c09b7e0 0x7f4e7c06c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.419+0000 7f4e81600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c0ccab0 0x7f4e7c0ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.419+0000 7f4e81600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c06d1d0 con 0x7f4e7c09aa30 2024-03-30T13:14:22.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.419+0000 7f4e81600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7c0d1b50 con 0x7f4e7c09b7e0 2024-03-30T13:14:22.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.419+0000 7f4e81600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7c06d4b0 con 0x7f4e7c0ccab0 2024-03-30T13:14:22.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.419+0000 7f4e7aa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4e7c09aa30 0x7f4e7c09ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46174/0 (socket says 172.21.15.99:46174) 2024-03-30T13:14:22.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.419+0000 7f4e7aa00640 1 -- 172.21.15.99:0/715794442 learned_addr learned my addr 172.21.15.99:0/715794442 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:22.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.419+0000 7f4e72000640 1 --2- 172.21.15.99:0/715794442 >> v2:172.21.15.181:3300/0 conn(0x7f4e7c09b7e0 0x7f4e7c06c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.419+0000 7f4e7b400640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c0ccab0 0x7f4e7c0ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.419+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375989657 0 0) 0x7f4e7c06d1d0 con 0x7f4e7c09aa30 2024-03-30T13:14:22.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e60003520 con 0x7f4e7c09aa30 2024-03-30T13:14:22.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1369969758 0 0) 0x7f4e60003520 con 0x7f4e7c09aa30 2024-03-30T13:14:22.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c0ccab0 msgr2=0x7f4e7c0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:22.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c0ccab0 0x7f4e7c0ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 >> v2:172.21.15.181:3300/0 conn(0x7f4e7c09b7e0 msgr2=0x7f4e7c06c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:22.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 --2- 172.21.15.99:0/715794442 >> v2:172.21.15.181:3300/0 conn(0x7f4e7c09b7e0 0x7f4e7c06c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c0d1350 con 0x7f4e7c09aa30 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f4e6c001670 con 0x7f4e7c09aa30 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 >> v1:172.21.15.99:6789/0 conn(0x7f4e7c09aa30 legacy=0x7f4e7c09ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c0ccab0 0x7f4e600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e60003fe0 0x7f4e60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e60004d40 0x7f4e600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c0d1b50 con 0x7f4e60004d40 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c06d4b0 con 0x7f4e60003fe0 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6000bac0 con 0x7f4e7c0ccab0 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.420+0000 7f4e7b400640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e60004d40 0x7f4e600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.421+0000 7f4e7aa00640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c0ccab0 0x7f4e600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.421+0000 7f4e72000640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e60003fe0 0x7f4e60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.421+0000 7f4e7b400640 1 -- 172.21.15.99:0/715794442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c0ccab0 msgr2=0x7f4e600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.421+0000 7f4e7b400640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c0ccab0 0x7f4e600039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.421+0000 7f4e7b400640 1 -- 172.21.15.99:0/715794442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e60003fe0 msgr2=0x7f4e60004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:22.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.421+0000 7f4e7b400640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e60003fe0 0x7f4e60004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.421+0000 7f4e7b400640 1 -- 172.21.15.99:0/715794442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e60003520 con 0x7f4e60004d40 2024-03-30T13:14:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.422+0000 7f4e7b400640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e60004d40 0x7f4e600051c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4e74007360 tx=0x7f4e60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786f9653ea303410 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.422+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74039070 con 0x7f4e60004d40 2024-03-30T13:14:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.422+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7402ccd0 con 0x7f4e60004d40 2024-03-30T13:14:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.422+0000 7f4e7a000640 1 -- 172.21.15.99:0/715794442 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74009be0 con 0x7f4e60004d40 2024-03-30T13:14:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.423+0000 7f4e81600640 1 -- 172.21.15.99:0/715794442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e60004d40 msgr2=0x7f4e600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.423+0000 7f4e81600640 1 --2- 172.21.15.99:0/715794442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e60004d40 0x7f4e600051c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4e74007360 tx=0x7f4e60005830 comp rx=0 tx=0).stop 2024-03-30T13:14:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.423+0000 7f4e7b400640 1 -- 172.21.15.99:0/715794442 reap_dead start 2024-03-30T13:14:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.423+0000 7f4e81600640 1 -- 172.21.15.99:0/715794442 shutdown_connections 2024-03-30T13:14:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.423+0000 7f4e81600640 1 -- 172.21.15.99:0/715794442 >> 172.21.15.99:0/715794442 conn(0x7f4e7c0b3f50 msgr2=0x7f4e7c0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.423+0000 7f4e81600640 1 -- 172.21.15.99:0/715794442 shutdown_connections 2024-03-30T13:14:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.423+0000 7f4e81600640 1 -- 172.21.15.99:0/715794442 wait complete. 2024-03-30T13:14:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.425+0000 7f4e81600640 1 Processor -- start 2024-03-30T13:14:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.425+0000 7f4e81600640 1 -- start start 2024-03-30T13:14:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.426+0000 7f4e81600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e60004d40 0x7f4e7c0c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.426+0000 7f4e81600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e7c0cc050 0x7f4e7c0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.426+0000 7f4e81600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c1f3c50 0x7f4e7c159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.426+0000 7f4e81600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c06d790 con 0x7f4e7c0cc050 2024-03-30T13:14:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.426+0000 7f4e81600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c06cd70 con 0x7f4e60004d40 2024-03-30T13:14:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.426+0000 7f4e81600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7c15ec50 con 0x7f4e7c1f3c50 2024-03-30T13:14:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.426+0000 7f4e72000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e7c0cc050 0x7f4e7c0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.426+0000 7f4e72000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e7c0cc050 0x7f4e7c0b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34930/0 (socket says 172.21.15.99:34930) 2024-03-30T13:14:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.426+0000 7f4e72000640 1 -- 172.21.15.99:0/846859137 learned_addr learned my addr 172.21.15.99:0/846859137 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.427+0000 7f4e72000640 1 -- 172.21.15.99:0/846859137 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c1f3c50 msgr2=0x7f4e7c159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.427+0000 7f4e72000640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c1f3c50 0x7f4e7c159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.427+0000 7f4e72000640 1 -- 172.21.15.99:0/846859137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e60004d40 msgr2=0x7f4e7c0c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.427+0000 7f4e7aa00640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e60004d40 0x7f4e7c0c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.427+0000 7f4e72000640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e60004d40 0x7f4e7c0c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.427+0000 7f4e72000640 1 -- 172.21.15.99:0/846859137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c0b5720 con 0x7f4e7c0cc050 2024-03-30T13:14:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.427+0000 7f4e72000640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e7c0cc050 0x7f4e7c0b5020 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400f520 tx=0x7f4e6400f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.427+0000 7f4e73400640 1 -- 172.21.15.99:0/846859137 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64019020 con 0x7f4e7c0cc050 2024-03-30T13:14:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.427+0000 7f4e73400640 1 -- 172.21.15.99:0/846859137 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e64014870 con 0x7f4e7c0cc050 2024-03-30T13:14:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.427+0000 7f4e81600640 1 -- 172.21.15.99:0/846859137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7c0b5a00 con 0x7f4e7c0cc050 2024-03-30T13:14:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.427+0000 7f4e73400640 1 -- 172.21.15.99:0/846859137 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64014c20 con 0x7f4e7c0cc050 2024-03-30T13:14:22.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.428+0000 7f4e81600640 1 -- 172.21.15.99:0/846859137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7c0b5fc0 con 0x7f4e7c0cc050 2024-03-30T13:14:22.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.428+0000 7f4e81600640 1 -- 172.21.15.99:0/846859137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e7c075c60 con 0x7f4e7c0cc050 2024-03-30T13:14:22.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.429+0000 7f4e73400640 1 -- 172.21.15.99:0/846859137 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4e6401c020 con 0x7f4e7c0cc050 2024-03-30T13:14:22.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.431+0000 7f4e73400640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5806c530 0x7f4e5806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.431+0000 7f4e73400640 1 -- 172.21.15.99:0/846859137 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f4e6408bec0 con 0x7f4e7c0cc050 2024-03-30T13:14:22.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.431+0000 7f4e7aa00640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5806c530 0x7f4e5806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.432+0000 7f4e7aa00640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5806c530 0x7f4e5806e9f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c001050 tx=0x7f4e6c000fe0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:22.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.435+0000 7f4e73400640 1 -- 172.21.15.99:0/846859137 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4e7c075c60 con 0x7f4e7c0cc050 2024-03-30T13:14:22.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.673+0000 7f4e81600640 1 -- 172.21.15.99:0/846859137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4e7c068d50 con 0x7f4e7c0cc050 2024-03-30T13:14:22.679 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-03-30T13:14:22.675+0000 7f9063800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T13:14:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.678+0000 7f4e73400640 1 -- 172.21.15.99:0/846859137 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7f4e64023020 con 0x7f4e7c0cc050 2024-03-30T13:14:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-30T13:14:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.681+0000 7f4e81600640 1 -- 172.21.15.99:0/846859137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5806c530 msgr2=0x7f4e5806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.681+0000 7f4e81600640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5806c530 0x7f4e5806e9f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c001050 tx=0x7f4e6c000fe0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.681+0000 7f4e81600640 1 -- 172.21.15.99:0/846859137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e7c0cc050 msgr2=0x7f4e7c0b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.681+0000 7f4e81600640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e7c0cc050 0x7f4e7c0b5020 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400f520 tx=0x7f4e6400f9e0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.681+0000 7f4e81600640 1 -- 172.21.15.99:0/846859137 shutdown_connections 2024-03-30T13:14:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.681+0000 7f4e81600640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f4e5806c530 0x7f4e5806e9f0 secure :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c001050 tx=0x7f4e6c000fe0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.681+0000 7f4e81600640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e7c1f3c50 0x7f4e7c159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.681+0000 7f4e81600640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e7c0cc050 0x7f4e7c0b5020 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.681+0000 7f4e81600640 1 --2- 172.21.15.99:0/846859137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e60004d40 0x7f4e7c0c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.681+0000 7f4e81600640 1 -- 172.21.15.99:0/846859137 >> 172.21.15.99:0/846859137 conn(0x7f4e7c0b3f50 msgr2=0x7f4e7c09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.682+0000 7f4e81600640 1 -- 172.21.15.99:0/846859137 shutdown_connections 2024-03-30T13:14:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.683+0000 7f4e81600640 1 -- 172.21.15.99:0/846859137 wait complete. 2024-03-30T13:14:22.705 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-30T13:14:22.805 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-03-30T13:14:22.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.909+0000 7f824c600640 1 Processor -- start 2024-03-30T13:14:22.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.909+0000 7f824c600640 1 -- start start 2024-03-30T13:14:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.911+0000 7f824c600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f824415e7c0 0x7f824406d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.911+0000 7f824c600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82440d0b20 0x7f82440ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.911+0000 7f824c600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824406def0 con 0x7f824406f2a0 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.911+0000 7f824c600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f824406e790 con 0x7f824415e7c0 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.911+0000 7f824c600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f824406e1d0 con 0x7f82440d0b20 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.911+0000 7f8249c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f824415e7c0 0x7f824406d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.911+0000 7f8249c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f824415e7c0 0x7f824406d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34942/0 (socket says 172.21.15.99:34942) 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.911+0000 7f8249c00640 1 -- 172.21.15.99:0/2019881626 learned_addr learned my addr 172.21.15.99:0/2019881626 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.912+0000 7f824a600640 1 --2- 172.21.15.99:0/2019881626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82440d0b20 0x7f82440ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.912+0000 7f8249c00640 1 -- 172.21.15.99:0/2019881626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82440d0b20 msgr2=0x7f82440ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.912+0000 7f8249c00640 1 --2- 172.21.15.99:0/2019881626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82440d0b20 0x7f82440ad7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.912+0000 7f8249c00640 1 -- 172.21.15.99:0/2019881626 >> v1:172.21.15.99:6789/0 conn(0x7f824406f2a0 legacy=0x7f82440d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.912+0000 7f8243e00640 1 -- 172.21.15.99:0/2019881626 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456964968 0 0) 0x7f824406def0 con 0x7f824406f2a0 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.912+0000 7f8249c00640 1 -- 172.21.15.99:0/2019881626 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824406e4b0 con 0x7f824415e7c0 2024-03-30T13:14:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.912+0000 7f824a600640 1 --2- 172.21.15.99:0/2019881626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82440d0b20 0x7f82440ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:22.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.913+0000 7f8249c00640 1 --2- 172.21.15.99:0/2019881626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824415e7c0 0x7f824406d880 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8234009870 tx=0x7f823402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f299f8ee6ae7cb6d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:22.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.913+0000 7f8243e00640 1 -- 172.21.15.99:0/2019881626 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82340317c0 con 0x7f824415e7c0 2024-03-30T13:14:22.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.913+0000 7f8243e00640 1 -- 172.21.15.99:0/2019881626 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8234037070 con 0x7f824415e7c0 2024-03-30T13:14:22.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.913+0000 7f8243e00640 1 -- 172.21.15.99:0/2019881626 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234031b80 con 0x7f824415e7c0 2024-03-30T13:14:22.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.914+0000 7f824c600640 1 -- 172.21.15.99:0/2019881626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824415e7c0 msgr2=0x7f824406d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.914+0000 7f824c600640 1 --2- 172.21.15.99:0/2019881626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824415e7c0 0x7f824406d880 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8234009870 tx=0x7f823402b860 comp rx=0 tx=0).stop 2024-03-30T13:14:22.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.914+0000 7f824c600640 1 -- 172.21.15.99:0/2019881626 shutdown_connections 2024-03-30T13:14:22.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.914+0000 7f824c600640 1 --2- 172.21.15.99:0/2019881626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82440d0b20 0x7f82440ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.914+0000 7f824c600640 1 --2- 172.21.15.99:0/2019881626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f824415e7c0 0x7f824406d880 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.914+0000 7f824c600640 1 -- 172.21.15.99:0/2019881626 >> 172.21.15.99:0/2019881626 conn(0x7f824406b6f0 msgr2=0x7f824406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.914+0000 7f824c600640 1 -- 172.21.15.99:0/2019881626 shutdown_connections 2024-03-30T13:14:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.914+0000 7f824c600640 1 -- 172.21.15.99:0/2019881626 wait complete. 2024-03-30T13:14:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.916+0000 7f824c600640 1 Processor -- start 2024-03-30T13:14:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.916+0000 7f824c600640 1 -- start start 2024-03-30T13:14:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f824c600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f824406f2a0 0x7f824414f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f824c600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82440d0b20 0x7f82441516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f824c600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f824415e7c0 0x7f8244151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f824c600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f824415eba0 con 0x7f82440d0b20 2024-03-30T13:14:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f824c600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f82440b5150 con 0x7f824406f2a0 2024-03-30T13:14:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f824c600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f82440add30 con 0x7f824415e7c0 2024-03-30T13:14:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f8249200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82440d0b20 0x7f82441516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f8249200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82440d0b20 0x7f82441516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34944/0 (socket says 172.21.15.99:34944) 2024-03-30T13:14:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f8249200640 1 -- 172.21.15.99:0/697672504 learned_addr learned my addr 172.21.15.99:0/697672504 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f8249200640 1 -- 172.21.15.99:0/697672504 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f824415e7c0 msgr2=0x7f8244151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f8249200640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f824415e7c0 0x7f8244151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f8249200640 1 -- 172.21.15.99:0/697672504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f824406f2a0 msgr2=0x7f824414f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f8249200640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f824406f2a0 0x7f824414f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.917+0000 7f8249200640 1 -- 172.21.15.99:0/697672504 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824414fae0 con 0x7f82440d0b20 2024-03-30T13:14:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.918+0000 7f8249200640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82440d0b20 0x7f82441516d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f823000c890 tx=0x7f823000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.918+0000 7f8241600640 1 -- 172.21.15.99:0/697672504 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230017070 con 0x7f82440d0b20 2024-03-30T13:14:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.918+0000 7f8241600640 1 -- 172.21.15.99:0/697672504 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8230003dc0 con 0x7f82440d0b20 2024-03-30T13:14:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.918+0000 7f8241600640 1 -- 172.21.15.99:0/697672504 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82300052b0 con 0x7f82440d0b20 2024-03-30T13:14:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.918+0000 7f824c600640 1 -- 172.21.15.99:0/697672504 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824414fdc0 con 0x7f82440d0b20 2024-03-30T13:14:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.918+0000 7f824c600640 1 -- 172.21.15.99:0/697672504 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8244150380 con 0x7f82440d0b20 2024-03-30T13:14:22.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.919+0000 7f824c600640 1 -- 172.21.15.99:0/697672504 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f824409e520 con 0x7f82440d0b20 2024-03-30T13:14:22.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.920+0000 7f8241600640 1 -- 172.21.15.99:0/697672504 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f823001a070 con 0x7f82440d0b20 2024-03-30T13:14:22.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.921+0000 7f8241600640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f822406c530 0x7f822406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:22.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.921+0000 7f8241600640 1 -- 172.21.15.99:0/697672504 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5911+0+0 (secure 0 0 0) 0x7f823008af40 con 0x7f82440d0b20 2024-03-30T13:14:22.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.921+0000 7f8249c00640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f822406c530 0x7f822406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:22.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.922+0000 7f8249c00640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f822406c530 0x7f822406e9f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8234036000 tx=0x7f8234030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:22.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:22.926+0000 7f8241600640 1 -- 172.21.15.99:0/697672504 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8230059480 con 0x7f82440d0b20 2024-03-30T13:14:23.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.164+0000 7f824c600640 1 -- 172.21.15.99:0/697672504 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f824404f9d0 con 0x7f82440d0b20 2024-03-30T13:14:23.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.682+0000 7f8241600640 1 -- 172.21.15.99:0/697672504 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f8230058d80 con 0x7f82440d0b20 2024-03-30T13:14:23.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.686+0000 7f824c600640 1 -- 172.21.15.99:0/697672504 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f822406c530 msgr2=0x7f822406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:23.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.686+0000 7f824c600640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f822406c530 0x7f822406e9f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8234036000 tx=0x7f8234030000 comp rx=0 tx=0).stop 2024-03-30T13:14:23.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.686+0000 7f824c600640 1 -- 172.21.15.99:0/697672504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82440d0b20 msgr2=0x7f82441516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:23.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.686+0000 7f824c600640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82440d0b20 0x7f82441516d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f823000c890 tx=0x7f823000cd50 comp rx=0 tx=0).stop 2024-03-30T13:14:23.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.687+0000 7f824c600640 1 -- 172.21.15.99:0/697672504 shutdown_connections 2024-03-30T13:14:23.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.687+0000 7f824c600640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f822406c530 0x7f822406e9f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:23.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.687+0000 7f824c600640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f824415e7c0 0x7f8244151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:23.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.687+0000 7f824c600640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82440d0b20 0x7f82441516d0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:23.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.687+0000 7f824c600640 1 --2- 172.21.15.99:0/697672504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f824406f2a0 0x7f824414f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:23.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.687+0000 7f824c600640 1 -- 172.21.15.99:0/697672504 >> 172.21.15.99:0/697672504 conn(0x7f824406b6f0 msgr2=0x7f82440b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:23.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.687+0000 7f824c600640 1 -- 172.21.15.99:0/697672504 shutdown_connections 2024-03-30T13:14:23.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.687+0000 7f824c600640 1 -- 172.21.15.99:0/697672504 wait complete. 2024-03-30T13:14:23.712 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-30T13:14:23.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.921+0000 7f0b46600640 1 Processor -- start 2024-03-30T13:14:23.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.922+0000 7f0b46600640 1 -- start start 2024-03-30T13:14:23.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.923+0000 7f0b46600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b4015e780 0x7f0b40162ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:23.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.923+0000 7f0b46600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0b400d4f20 0x7f0b400b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:23.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.923+0000 7f0b46600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b400b37c0 con 0x7f0b4015eb60 2024-03-30T13:14:23.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.923+0000 7f0b46600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f0b40163430 con 0x7f0b4015e780 2024-03-30T13:14:23.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.923+0000 7f0b46600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0b400cfde0 con 0x7f0b400d4f20 2024-03-30T13:14:23.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.923+0000 7f0b3f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b4015e780 0x7f0b40162ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:23.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.923+0000 7f0b3fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0b4015eb60 0x7f0b400d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46188/0 (socket says 172.21.15.99:46188) 2024-03-30T13:14:23.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.923+0000 7f0b3fe00640 1 -- 172.21.15.99:0/1904053808 learned_addr learned my addr 172.21.15.99:0/1904053808 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:23.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.924+0000 7f0b3ea00640 1 --2- 172.21.15.99:0/1904053808 >> v2:172.21.15.181:3300/0 conn(0x7f0b400d4f20 0x7f0b400b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:23.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.924+0000 7f0b3f400640 1 -- 172.21.15.99:0/1904053808 >> v2:172.21.15.181:3300/0 conn(0x7f0b400d4f20 msgr2=0x7f0b400b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:23.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.924+0000 7f0b3f400640 1 --2- 172.21.15.99:0/1904053808 >> v2:172.21.15.181:3300/0 conn(0x7f0b400d4f20 0x7f0b400b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:23.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.924+0000 7f0b3f400640 1 -- 172.21.15.99:0/1904053808 >> v1:172.21.15.99:6789/0 conn(0x7f0b4015eb60 legacy=0x7f0b400d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:23.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.924+0000 7f0b3f400640 1 -- 172.21.15.99:0/1904053808 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b400d53e0 con 0x7f0b4015e780 2024-03-30T13:14:23.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.924+0000 7f0b3e000640 1 -- 172.21.15.99:0/1904053808 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144258863 0 0) 0x7f0b400b37c0 con 0x7f0b4015eb60 2024-03-30T13:14:23.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.925+0000 7f0b3f400640 1 --2- 172.21.15.99:0/1904053808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b4015e780 0x7f0b40162ef0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0b400d1dc0 tx=0x7f0b3002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d3dca9a12b92f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:23.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.925+0000 7f0b3e000640 1 -- 172.21.15.99:0/1904053808 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30035020 con 0x7f0b4015e780 2024-03-30T13:14:23.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.925+0000 7f0b3e000640 1 -- 172.21.15.99:0/1904053808 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b30031830 con 0x7f0b4015e780 2024-03-30T13:14:23.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.925+0000 7f0b3e000640 1 -- 172.21.15.99:0/1904053808 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30031c00 con 0x7f0b4015e780 2024-03-30T13:14:23.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.926+0000 7f0b46600640 1 -- 172.21.15.99:0/1904053808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b4015e780 msgr2=0x7f0b40162ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:23.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.926+0000 7f0b46600640 1 --2- 172.21.15.99:0/1904053808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b4015e780 0x7f0b40162ef0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0b400d1dc0 tx=0x7f0b3002b8d0 comp rx=0 tx=0).stop 2024-03-30T13:14:23.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.926+0000 7f0b46600640 1 -- 172.21.15.99:0/1904053808 shutdown_connections 2024-03-30T13:14:23.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.926+0000 7f0b46600640 1 --2- 172.21.15.99:0/1904053808 >> v2:172.21.15.181:3300/0 conn(0x7f0b400d4f20 0x7f0b400b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:23.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.926+0000 7f0b46600640 1 --2- 172.21.15.99:0/1904053808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b4015e780 0x7f0b40162ef0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:23.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.926+0000 7f0b46600640 1 -- 172.21.15.99:0/1904053808 >> 172.21.15.99:0/1904053808 conn(0x7f0b4008bfc0 msgr2=0x7f0b400d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:23.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.926+0000 7f0b46600640 1 -- 172.21.15.99:0/1904053808 shutdown_connections 2024-03-30T13:14:23.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.926+0000 7f0b46600640 1 -- 172.21.15.99:0/1904053808 wait complete. 2024-03-30T13:14:23.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.927+0000 7f0b46600640 1 Processor -- start 2024-03-30T13:14:23.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.928+0000 7f0b46600640 1 -- start start 2024-03-30T13:14:23.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.928+0000 7f0b46600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b400d4f20 0x7f0b40152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:23.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.928+0000 7f0b46600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b4015e780 0x7f0b401611c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b46600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b4015eb60 0x7f0b40161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b46600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0b400cf440 con 0x7f0b4015e780 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b46600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0b400cfa70 con 0x7f0b4015eb60 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b46600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0b400d0980 con 0x7f0b400d4f20 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b3ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b4015e780 0x7f0b401611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b3ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b4015e780 0x7f0b401611c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34964/0 (socket says 172.21.15.99:34964) 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b3ea00640 1 -- 172.21.15.99:0/3728976729 learned_addr learned my addr 172.21.15.99:0/3728976729 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b3f400640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b400d4f20 0x7f0b40152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b3fe00640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b4015eb60 0x7f0b40161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b3ea00640 1 -- 172.21.15.99:0/3728976729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b400d4f20 msgr2=0x7f0b40152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b3ea00640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b400d4f20 0x7f0b40152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b3ea00640 1 -- 172.21.15.99:0/3728976729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b4015eb60 msgr2=0x7f0b40161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:23.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b3ea00640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b4015eb60 0x7f0b40161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:23.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b3ea00640 1 -- 172.21.15.99:0/3728976729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b401606a0 con 0x7f0b4015e780 2024-03-30T13:14:23.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.929+0000 7f0b3fe00640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b4015eb60 0x7f0b40161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:23.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.930+0000 7f0b3ea00640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b4015e780 0x7f0b401611c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800c7f0 tx=0x7f0b2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:23.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.930+0000 7f0b37400640 1 -- 172.21.15.99:0/3728976729 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28015070 con 0x7f0b4015e780 2024-03-30T13:14:23.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.930+0000 7f0b37400640 1 -- 172.21.15.99:0/3728976729 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b28004220 con 0x7f0b4015e780 2024-03-30T13:14:23.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.930+0000 7f0b37400640 1 -- 172.21.15.99:0/3728976729 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28007620 con 0x7f0b4015e780 2024-03-30T13:14:23.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.930+0000 7f0b46600640 1 -- 172.21.15.99:0/3728976729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b40160980 con 0x7f0b4015e780 2024-03-30T13:14:23.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.930+0000 7f0b46600640 1 -- 172.21.15.99:0/3728976729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4015f950 con 0x7f0b4015e780 2024-03-30T13:14:23.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.931+0000 7f0b46600640 1 -- 172.21.15.99:0/3728976729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b40068640 con 0x7f0b4015e780 2024-03-30T13:14:23.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.932+0000 7f0b37400640 1 -- 172.21.15.99:0/3728976729 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0b280079d0 con 0x7f0b4015e780 2024-03-30T13:14:23.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.933+0000 7f0b37400640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0b1c06c530 0x7f0b1c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:23.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.933+0000 7f0b37400640 1 -- 172.21.15.99:0/3728976729 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5911+0+0 (secure 0 0 0) 0x7f0b2808bb10 con 0x7f0b4015e780 2024-03-30T13:14:23.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.933+0000 7f0b3f400640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0b1c06c530 0x7f0b1c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:23.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.934+0000 7f0b3f400640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0b1c06c530 0x7f0b1c06e9f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0b30036000 tx=0x7f0b30008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:23.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:23.937+0000 7f0b37400640 1 -- 172.21.15.99:0/3728976729 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0b2805a0d0 con 0x7f0b4015e780 2024-03-30T13:14:24.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.134+0000 7f0b46600640 1 -- 172.21.15.99:0/3728976729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0b400d1e10 con 0x7f0b4015e780 2024-03-30T13:14:24.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.685+0000 7f0b37400640 1 -- 172.21.15.99:0/3728976729 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) ==== 181+0+0 (secure 0 0 0) 0x7f0b280599d0 con 0x7f0b4015e780 2024-03-30T13:14:24.690 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-03-30T13:14:24.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.689+0000 7f0b46600640 1 -- 172.21.15.99:0/3728976729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0b1c06c530 msgr2=0x7f0b1c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:24.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.689+0000 7f0b46600640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0b1c06c530 0x7f0b1c06e9f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0b30036000 tx=0x7f0b30008030 comp rx=0 tx=0).stop 2024-03-30T13:14:24.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.689+0000 7f0b46600640 1 -- 172.21.15.99:0/3728976729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b4015e780 msgr2=0x7f0b401611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:24.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.689+0000 7f0b46600640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b4015e780 0x7f0b401611c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800c7f0 tx=0x7f0b2800ccb0 comp rx=0 tx=0).stop 2024-03-30T13:14:24.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.690+0000 7f0b46600640 1 -- 172.21.15.99:0/3728976729 shutdown_connections 2024-03-30T13:14:24.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.690+0000 7f0b46600640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f0b1c06c530 0x7f0b1c06e9f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:24.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.690+0000 7f0b46600640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b4015eb60 0x7f0b40161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:24.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.690+0000 7f0b46600640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b4015e780 0x7f0b401611c0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:24.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.690+0000 7f0b46600640 1 --2- 172.21.15.99:0/3728976729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b400d4f20 0x7f0b40152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:24.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.690+0000 7f0b46600640 1 -- 172.21.15.99:0/3728976729 >> 172.21.15.99:0/3728976729 conn(0x7f0b4008bfc0 msgr2=0x7f0b400d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:24.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.690+0000 7f0b46600640 1 -- 172.21.15.99:0/3728976729 shutdown_connections 2024-03-30T13:14:24.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.690+0000 7f0b46600640 1 -- 172.21.15.99:0/3728976729 wait complete. 2024-03-30T13:14:24.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-30T13:14:24.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.919+0000 7f5930600640 1 Processor -- start 2024-03-30T13:14:24.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.919+0000 7f5930600640 1 -- start start 2024-03-30T13:14:24.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.920+0000 7f5930600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5928156ba0 0x7f592815d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:24.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.920+0000 7f5930600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f59280d0ba0 0x7f592806dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:24.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.920+0000 7f5930600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592806e300 con 0x7f592806d860 2024-03-30T13:14:24.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.920+0000 7f5930600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f592815db70 con 0x7f59280d0ba0 2024-03-30T13:14:24.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.920+0000 7f5930600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f592806e5e0 con 0x7f5928156ba0 2024-03-30T13:14:24.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.920+0000 7f592d200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f592806d860 0x7f59280d0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56844/0 (socket says 172.21.15.99:56844) 2024-03-30T13:14:24.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.920+0000 7f592d200640 1 -- 172.21.15.99:0/3207864743 learned_addr learned my addr 172.21.15.99:0/3207864743 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:24.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f592e600640 1 --2- 172.21.15.99:0/3207864743 >> v2:172.21.15.181:3300/0 conn(0x7f59280d0ba0 0x7f592806dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:24.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f592dc00640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5928156ba0 0x7f592815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:24.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237512561 0 0) 0x7f592806e300 con 0x7f592806d860 2024-03-30T13:14:24.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5910003520 con 0x7f592806d860 2024-03-30T13:14:24.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 742869699 0 0) 0x7f5910003520 con 0x7f592806d860 2024-03-30T13:14:24.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5928156ba0 msgr2=0x7f592815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:24.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5928156ba0 0x7f592815d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:24.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 >> v2:172.21.15.181:3300/0 conn(0x7f59280d0ba0 msgr2=0x7f592806dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:24.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 --2- 172.21.15.99:0/3207864743 >> v2:172.21.15.181:3300/0 conn(0x7f59280d0ba0 0x7f592806dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:24.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592815ce50 con 0x7f592806d860 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f5914001670 con 0x7f592806d860 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 >> v1:172.21.15.99:6789/0 conn(0x7f592806d860 legacy=0x7f59280d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59100039b0 0x7f5910003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.921+0000 7f5927e00640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 0x7f5910004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f5927e00640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5928156ba0 0x7f59100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f592815db70 con 0x7f5910004800 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f592806e5e0 con 0x7f59100039b0 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f591000ba10 con 0x7f5928156ba0 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f592d200640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 0x7f5910004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f592dc00640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59100039b0 0x7f5910003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f592e600640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5928156ba0 0x7f59100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f592d200640 1 -- 172.21.15.99:0/3207864743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5928156ba0 msgr2=0x7f59100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f592d200640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5928156ba0 0x7f59100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f592d200640 1 -- 172.21.15.99:0/3207864743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59100039b0 msgr2=0x7f5910003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f592d200640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59100039b0 0x7f5910003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.922+0000 7f592d200640 1 -- 172.21.15.99:0/3207864743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5910003520 con 0x7f5910004800 2024-03-30T13:14:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.923+0000 7f592d200640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 0x7f5910004c80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f591400c190 tx=0x7f5910005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d38f15975f8ecc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:24.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.924+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914007c80 con 0x7f5910004800 2024-03-30T13:14:24.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.924+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5914030070 con 0x7f5910004800 2024-03-30T13:14:24.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.924+0000 7f5927e00640 1 -- 172.21.15.99:0/3207864743 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914005d30 con 0x7f5910004800 2024-03-30T13:14:24.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.924+0000 7f5930600640 1 -- 172.21.15.99:0/3207864743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 msgr2=0x7f5910004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:24.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.924+0000 7f5930600640 1 --2- 172.21.15.99:0/3207864743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 0x7f5910004c80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f591400c190 tx=0x7f5910005830 comp rx=0 tx=0).stop 2024-03-30T13:14:24.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.924+0000 7f592e600640 1 -- 172.21.15.99:0/3207864743 reap_dead start 2024-03-30T13:14:24.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.924+0000 7f5930600640 1 -- 172.21.15.99:0/3207864743 shutdown_connections 2024-03-30T13:14:24.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.924+0000 7f5930600640 1 -- 172.21.15.99:0/3207864743 >> 172.21.15.99:0/3207864743 conn(0x7f592806b6f0 msgr2=0x7f592806bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:24.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.925+0000 7f5930600640 1 -- 172.21.15.99:0/3207864743 shutdown_connections 2024-03-30T13:14:24.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.925+0000 7f5930600640 1 -- 172.21.15.99:0/3207864743 wait complete. 2024-03-30T13:14:24.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.926+0000 7f5930600640 1 Processor -- start 2024-03-30T13:14:24.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.926+0000 7f5930600640 1 -- start start 2024-03-30T13:14:24.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.927+0000 7f5930600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 0x7f592814e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:24.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.927+0000 7f5930600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f592809ac10 0x7f592809b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:24.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.927+0000 7f5930600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59280b0300 0x7f59280b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.927+0000 7f5930600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f59280ad3d0 con 0x7f5910004800 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.927+0000 7f5930600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f592815cb40 con 0x7f59280b0300 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.927+0000 7f5930600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5928156f80 con 0x7f592809ac10 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.928+0000 7f592dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 0x7f592814e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.928+0000 7f592dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 0x7f592814e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43854/0 (socket says 172.21.15.99:43854) 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.928+0000 7f592dc00640 1 -- 172.21.15.99:0/3442238710 learned_addr learned my addr 172.21.15.99:0/3442238710 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.928+0000 7f592d200640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f592809ac10 0x7f592809b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.928+0000 7f592dc00640 1 -- 172.21.15.99:0/3442238710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f592809ac10 msgr2=0x7f592809b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.928+0000 7f592dc00640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f592809ac10 0x7f592809b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.928+0000 7f592dc00640 1 -- 172.21.15.99:0/3442238710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59280b0300 msgr2=0x7f59280b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.928+0000 7f592dc00640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59280b0300 0x7f59280b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:24.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.928+0000 7f592dc00640 1 -- 172.21.15.99:0/3442238710 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59280b0cc0 con 0x7f5910004800 2024-03-30T13:14:24.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.928+0000 7f592dc00640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 0x7f592814e9f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f591c011540 tx=0x7f591c011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:24.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.929+0000 7f5925600640 1 -- 172.21.15.99:0/3442238710 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c015930 con 0x7f5910004800 2024-03-30T13:14:24.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.929+0000 7f5925600640 1 -- 172.21.15.99:0/3442238710 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f591c015ad0 con 0x7f5910004800 2024-03-30T13:14:24.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.929+0000 7f5930600640 1 -- 172.21.15.99:0/3442238710 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592814f1b0 con 0x7f5910004800 2024-03-30T13:14:24.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.929+0000 7f5925600640 1 -- 172.21.15.99:0/3442238710 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c01d400 con 0x7f5910004800 2024-03-30T13:14:24.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.929+0000 7f5930600640 1 -- 172.21.15.99:0/3442238710 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592814f770 con 0x7f5910004800 2024-03-30T13:14:24.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.930+0000 7f5930600640 1 -- 172.21.15.99:0/3442238710 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f592806f6b0 con 0x7f5910004800 2024-03-30T13:14:24.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.931+0000 7f5925600640 1 -- 172.21.15.99:0/3442238710 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f591c01d5a0 con 0x7f5910004800 2024-03-30T13:14:24.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.932+0000 7f5925600640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f590806c560 0x7f590806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:24.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.932+0000 7f5925600640 1 -- 172.21.15.99:0/3442238710 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5473+0+0 (secure 0 0 0) 0x7f591c08be10 con 0x7f5910004800 2024-03-30T13:14:24.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.932+0000 7f592d200640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f590806c560 0x7f590806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:24.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.933+0000 7f592d200640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f590806c560 0x7f590806ea20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5914034000 tx=0x7f5914007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:24.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:24.936+0000 7f5925600640 1 -- 172.21.15.99:0/3442238710 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f592806f6b0 con 0x7f5910004800 2024-03-30T13:14:25.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.134+0000 7f5930600640 1 -- 172.21.15.99:0/3442238710 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5928068640 con 0x7f5910004800 2024-03-30T13:14:25.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.689+0000 7f5925600640 1 -- 172.21.15.99:0/3442238710 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) ==== 169+0+0 (secure 0 0 0) 0x7f591c08f030 con 0x7f5910004800 2024-03-30T13:14:25.694 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-03-30T13:14:25.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.692+0000 7f5930600640 1 -- 172.21.15.99:0/3442238710 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f590806c560 msgr2=0x7f590806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:25.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.692+0000 7f5930600640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f590806c560 0x7f590806ea20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5914034000 tx=0x7f5914007000 comp rx=0 tx=0).stop 2024-03-30T13:14:25.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.692+0000 7f5930600640 1 -- 172.21.15.99:0/3442238710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 msgr2=0x7f592814e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:25.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.692+0000 7f5930600640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 0x7f592814e9f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f591c011540 tx=0x7f591c011a00 comp rx=0 tx=0).stop 2024-03-30T13:14:25.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.693+0000 7f5930600640 1 -- 172.21.15.99:0/3442238710 shutdown_connections 2024-03-30T13:14:25.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.693+0000 7f5930600640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f590806c560 0x7f590806ea20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:25.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.693+0000 7f5930600640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59280b0300 0x7f59280b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:25.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.693+0000 7f5930600640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f592809ac10 0x7f592809b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:25.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.693+0000 7f5930600640 1 --2- 172.21.15.99:0/3442238710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5910004800 0x7f592814e9f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:25.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.693+0000 7f5930600640 1 -- 172.21.15.99:0/3442238710 >> 172.21.15.99:0/3442238710 conn(0x7f592806b6f0 msgr2=0x7f592815dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:25.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.693+0000 7f5930600640 1 -- 172.21.15.99:0/3442238710 shutdown_connections 2024-03-30T13:14:25.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.693+0000 7f5930600640 1 -- 172.21.15.99:0/3442238710 wait complete. 2024-03-30T13:14:25.728 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-30T13:14:25.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.929+0000 7f200e200640 1 Processor -- start 2024-03-30T13:14:25.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.929+0000 7f200e200640 1 -- start start 2024-03-30T13:14:25.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.930+0000 7f200e200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2008160700 0x7f20080b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:25.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.930+0000 7f200e200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f20080d0b20 0x7f2008166d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:25.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.930+0000 7f200e200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20081637b0 con 0x7f2008163260 2024-03-30T13:14:25.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.930+0000 7f200e200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f2008163a90 con 0x7f2008160700 2024-03-30T13:14:25.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.930+0000 7f200e200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2008163d70 con 0x7f20080d0b20 2024-03-30T13:14:25.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.931+0000 7f2007400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2008160700 0x7f20080b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:25.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.931+0000 7f2006a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2008163260 0x7f20080d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56860/0 (socket says 172.21.15.99:56860) 2024-03-30T13:14:25.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.931+0000 7f2006a00640 1 -- 172.21.15.99:0/1226052334 learned_addr learned my addr 172.21.15.99:0/1226052334 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:25.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.931+0000 7f2007400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2008160700 0x7f20080b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43868/0 (socket says 172.21.15.99:43868) 2024-03-30T13:14:25.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.931+0000 7f2007e00640 1 --2- 172.21.15.99:0/1226052334 >> v2:172.21.15.181:3300/0 conn(0x7f20080d0b20 0x7f2008166d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:25.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.931+0000 7f2007400640 1 -- 172.21.15.99:0/1226052334 >> v2:172.21.15.181:3300/0 conn(0x7f20080d0b20 msgr2=0x7f2008166d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:25.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.931+0000 7f2007400640 1 --2- 172.21.15.99:0/1226052334 >> v2:172.21.15.181:3300/0 conn(0x7f20080d0b20 0x7f2008166d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:25.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.931+0000 7f2007400640 1 -- 172.21.15.99:0/1226052334 >> v1:172.21.15.99:6789/0 conn(0x7f2008163260 legacy=0x7f20080d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:25.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.931+0000 7f2007400640 1 -- 172.21.15.99:0/1226052334 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2008164050 con 0x7f2008160700 2024-03-30T13:14:25.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.931+0000 7f2006000640 1 -- 172.21.15.99:0/1226052334 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778232653 0 0) 0x7f20081637b0 con 0x7f2008163260 2024-03-30T13:14:25.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.933+0000 7f2007400640 1 --2- 172.21.15.99:0/1226052334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2008160700 0x7f20080b37d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f20080b3250 tx=0x7f1ff802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7782454f35217a50 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:25.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.933+0000 7f2006000640 1 -- 172.21.15.99:0/1226052334 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8035020 con 0x7f2008160700 2024-03-30T13:14:25.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.933+0000 7f2006000640 1 -- 172.21.15.99:0/1226052334 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff8031830 con 0x7f2008160700 2024-03-30T13:14:25.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.933+0000 7f2006000640 1 -- 172.21.15.99:0/1226052334 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8031c00 con 0x7f2008160700 2024-03-30T13:14:25.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.934+0000 7f200e200640 1 -- 172.21.15.99:0/1226052334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2008160700 msgr2=0x7f20080b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:25.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.934+0000 7f200e200640 1 --2- 172.21.15.99:0/1226052334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2008160700 0x7f20080b37d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f20080b3250 tx=0x7f1ff802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:14:25.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.934+0000 7f200e200640 1 -- 172.21.15.99:0/1226052334 shutdown_connections 2024-03-30T13:14:25.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.934+0000 7f200e200640 1 --2- 172.21.15.99:0/1226052334 >> v2:172.21.15.181:3300/0 conn(0x7f20080d0b20 0x7f2008166d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:25.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.934+0000 7f200e200640 1 --2- 172.21.15.99:0/1226052334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2008160700 0x7f20080b37d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:25.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.934+0000 7f200e200640 1 -- 172.21.15.99:0/1226052334 >> 172.21.15.99:0/1226052334 conn(0x7f200806b6f0 msgr2=0x7f200806bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:25.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.934+0000 7f200e200640 1 -- 172.21.15.99:0/1226052334 shutdown_connections 2024-03-30T13:14:25.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.934+0000 7f200e200640 1 -- 172.21.15.99:0/1226052334 wait complete. 2024-03-30T13:14:25.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.935+0000 7f200e200640 1 Processor -- start 2024-03-30T13:14:25.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.936+0000 7f200e200640 1 -- start start 2024-03-30T13:14:25.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.936+0000 7f200e200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20080d0b20 0x7f20080ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:25.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.936+0000 7f200e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2008160700 0x7f20080ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.936+0000 7f200e200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2008163260 0x7f200815eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f200e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f20080cc9a0 con 0x7f2008160700 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f200e200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f20080cc820 con 0x7f2008163260 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f200e200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2008160ae0 con 0x7f20080d0b20 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f2006a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2008160700 0x7f20080ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f2006a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2008160700 0x7f20080ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43870/0 (socket says 172.21.15.99:43870) 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f2006a00640 1 -- 172.21.15.99:0/2800295639 learned_addr learned my addr 172.21.15.99:0/2800295639 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f2007400640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20080d0b20 0x7f20080ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f2006a00640 1 -- 172.21.15.99:0/2800295639 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20080d0b20 msgr2=0x7f20080ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f2007e00640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2008163260 0x7f200815eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f2006a00640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20080d0b20 0x7f20080ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f2006a00640 1 -- 172.21.15.99:0/2800295639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2008163260 msgr2=0x7f200815eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:25.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f2006a00640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2008163260 0x7f200815eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:25.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f2006a00640 1 -- 172.21.15.99:0/2800295639 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20080cf320 con 0x7f2008160700 2024-03-30T13:14:25.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.937+0000 7f2007400640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20080d0b20 0x7f20080ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:25.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.938+0000 7f2006a00640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2008160700 0x7f20080ce590 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000c430 tx=0x7f1ff000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:25.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.938+0000 7f1fff400640 1 -- 172.21.15.99:0/2800295639 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff00074e0 con 0x7f2008160700 2024-03-30T13:14:25.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.938+0000 7f1fff400640 1 -- 172.21.15.99:0/2800295639 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff00047e0 con 0x7f2008160700 2024-03-30T13:14:25.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.938+0000 7f1fff400640 1 -- 172.21.15.99:0/2800295639 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0004bd0 con 0x7f2008160700 2024-03-30T13:14:25.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.938+0000 7f200e200640 1 -- 172.21.15.99:0/2800295639 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20080cf600 con 0x7f2008160700 2024-03-30T13:14:25.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.938+0000 7f200e200640 1 -- 172.21.15.99:0/2800295639 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20080ae9a0 con 0x7f2008160700 2024-03-30T13:14:25.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.939+0000 7f200e200640 1 -- 172.21.15.99:0/2800295639 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200809e520 con 0x7f2008160700 2024-03-30T13:14:25.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.940+0000 7f1fff400640 1 -- 172.21.15.99:0/2800295639 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1ff0011070 con 0x7f2008160700 2024-03-30T13:14:25.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.941+0000 7f1fff400640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1fe406c530 0x7f1fe406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:25.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.941+0000 7f1fff400640 1 -- 172.21.15.99:0/2800295639 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f1ff008b0c0 con 0x7f2008160700 2024-03-30T13:14:25.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.941+0000 7f2007400640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1fe406c530 0x7f1fe406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:25.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.942+0000 7f2007400640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1fe406c530 0x7f1fe406e9f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8036000 tx=0x7f1ff8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:25.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:25.946+0000 7f1fff400640 1 -- 172.21.15.99:0/2800295639 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1ff00599d0 con 0x7f2008160700 2024-03-30T13:14:26.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.164+0000 7f200e200640 1 -- 172.21.15.99:0/2800295639 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f20080afb10 con 0x7f2008160700 2024-03-30T13:14:26.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.168+0000 7f1fff400640 1 -- 172.21.15.99:0/2800295639 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f1ff00592d0 con 0x7f2008160700 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 -- 172.21.15.99:0/2800295639 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1fe406c530 msgr2=0x7f1fe406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1fe406c530 0x7f1fe406e9f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8036000 tx=0x7f1ff8008030 comp rx=0 tx=0).stop 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 -- 172.21.15.99:0/2800295639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2008160700 msgr2=0x7f20080ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2008160700 0x7f20080ce590 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000c430 tx=0x7f1ff000c8f0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 -- 172.21.15.99:0/2800295639 shutdown_connections 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1fe406c530 0x7f1fe406e9f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2008163260 0x7f200815eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2008160700 0x7f20080ce590 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 --2- 172.21.15.99:0/2800295639 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20080d0b20 0x7f20080ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 -- 172.21.15.99:0/2800295639 >> 172.21.15.99:0/2800295639 conn(0x7f200806b6f0 msgr2=0x7f2008071bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 -- 172.21.15.99:0/2800295639 shutdown_connections 2024-03-30T13:14:26.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.171+0000 7f200e200640 1 -- 172.21.15.99:0/2800295639 wait complete. 2024-03-30T13:14:26.194 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining' 2024-03-30T13:14:26.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.376+0000 7f2984000640 1 Processor -- start 2024-03-30T13:14:26.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.376+0000 7f2984000640 1 -- start start 2024-03-30T13:14:26.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.377+0000 7f2984000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f297c15c670 0x7f297c06c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:26.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.377+0000 7f2984000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c06f060 0x7f297c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:26.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.377+0000 7f2984000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297c146230 con 0x7f297c0ad230 2024-03-30T13:14:26.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.377+0000 7f2984000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f297c06dfc0 con 0x7f297c15c670 2024-03-30T13:14:26.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.377+0000 7f2984000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f297c06e2a0 con 0x7f297c06f060 2024-03-30T13:14:26.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.377+0000 7f2982000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f297c0ad230 0x7f297c0b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56870/0 (socket says 172.21.15.99:56870) 2024-03-30T13:14:26.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f2982000640 1 -- 172.21.15.99:0/2276134594 learned_addr learned my addr 172.21.15.99:0/2276134594 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f2981600640 1 --2- 172.21.15.99:0/2276134594 >> v2:172.21.15.181:3300/0 conn(0x7f297c15c670 0x7f297c06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f2980c00640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c06f060 0x7f297c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280448517 0 0) 0x7f2974001490 con 0x7f297c0ad230 2024-03-30T13:14:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2964003520 con 0x7f297c0ad230 2024-03-30T13:14:26.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1046629722 0 0) 0x7f2964003520 con 0x7f297c0ad230 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c06f060 msgr2=0x7f297c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f297be00640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c06f060 0x7f297c06d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 >> v2:172.21.15.181:3300/0 conn(0x7f297c15c670 msgr2=0x7f297c06c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f297be00640 1 --2- 172.21.15.99:0/2276134594 >> v2:172.21.15.181:3300/0 conn(0x7f297c15c670 0x7f297c06c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c06e580 con 0x7f297c0ad230 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.378+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f2974001bc0 con 0x7f297c0ad230 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 >> v1:172.21.15.99:6789/0 conn(0x7f297c0ad230 legacy=0x7f297c0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f297be00640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 0x7f2964003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f297be00640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2964004800 0x7f2964004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f297be00640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c06f060 0x7f29640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f297c06dfc0 con 0x7f29640039b0 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f297c06e2a0 con 0x7f2964004800 2024-03-30T13:14:26.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f296400b9f0 con 0x7f297c06f060 2024-03-30T13:14:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f2981600640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 0x7f2964003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f2980c00640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2964004800 0x7f2964004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f2981600640 1 -- 172.21.15.99:0/2276134594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c06f060 msgr2=0x7f29640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f2982000640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c06f060 0x7f29640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f2981600640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c06f060 0x7f29640051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f2981600640 1 -- 172.21.15.99:0/2276134594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2964004800 msgr2=0x7f2964004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f2981600640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2964004800 0x7f2964004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.379+0000 7f2981600640 1 -- 172.21.15.99:0/2276134594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2964003520 con 0x7f29640039b0 2024-03-30T13:14:26.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.380+0000 7f2981600640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 0x7f2964003dd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2970009ac0 tx=0x7f2964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9320c6414cef35e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:26.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.381+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970039070 con 0x7f29640039b0 2024-03-30T13:14:26.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.381+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297002c6d0 con 0x7f29640039b0 2024-03-30T13:14:26.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.381+0000 7f297be00640 1 -- 172.21.15.99:0/2276134594 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970009690 con 0x7f29640039b0 2024-03-30T13:14:26.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.381+0000 7f2984000640 1 -- 172.21.15.99:0/2276134594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 msgr2=0x7f2964003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:26.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.381+0000 7f2984000640 1 --2- 172.21.15.99:0/2276134594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 0x7f2964003dd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2970009ac0 tx=0x7f2964005830 comp rx=0 tx=0).stop 2024-03-30T13:14:26.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.381+0000 7f2982000640 1 -- 172.21.15.99:0/2276134594 reap_dead start 2024-03-30T13:14:26.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.381+0000 7f2984000640 1 -- 172.21.15.99:0/2276134594 shutdown_connections 2024-03-30T13:14:26.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.381+0000 7f2984000640 1 -- 172.21.15.99:0/2276134594 >> 172.21.15.99:0/2276134594 conn(0x7f297c06b510 msgr2=0x7f297c06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:26.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.382+0000 7f2984000640 1 -- 172.21.15.99:0/2276134594 shutdown_connections 2024-03-30T13:14:26.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.382+0000 7f2984000640 1 -- 172.21.15.99:0/2276134594 wait complete. 2024-03-30T13:14:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.383+0000 7f2984000640 1 Processor -- start 2024-03-30T13:14:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.383+0000 7f2984000640 1 -- start start 2024-03-30T13:14:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.384+0000 7f2984000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 0x7f297c1f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.384+0000 7f2984000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f297c159590 0x7f297c159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.384+0000 7f2984000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c0ca7f0 0x7f297c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.384+0000 7f2984000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f297c06d930 con 0x7f29640039b0 2024-03-30T13:14:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.384+0000 7f2984000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f297c15ca50 con 0x7f297c159590 2024-03-30T13:14:26.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.384+0000 7f2984000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f297c06dab0 con 0x7f297c0ca7f0 2024-03-30T13:14:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.385+0000 7f2981600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 0x7f297c1f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:26.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.385+0000 7f2981600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 0x7f297c1f4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43890/0 (socket says 172.21.15.99:43890) 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.385+0000 7f2981600640 1 -- 172.21.15.99:0/3656258251 learned_addr learned my addr 172.21.15.99:0/3656258251 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.385+0000 7f2982000640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c0ca7f0 0x7f297c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.385+0000 7f2980c00640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f297c159590 0x7f297c159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.385+0000 7f2981600640 1 -- 172.21.15.99:0/3656258251 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c0ca7f0 msgr2=0x7f297c0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.385+0000 7f2981600640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c0ca7f0 0x7f297c0caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.385+0000 7f2981600640 1 -- 172.21.15.99:0/3656258251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f297c159590 msgr2=0x7f297c159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.385+0000 7f2981600640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f297c159590 0x7f297c159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.385+0000 7f2981600640 1 -- 172.21.15.99:0/3656258251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c0718d0 con 0x7f29640039b0 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.385+0000 7f2981600640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 0x7f297c1f4220 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2970000c00 tx=0x7f2970004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.386+0000 7f2979600640 1 -- 172.21.15.99:0/3656258251 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970039050 con 0x7f29640039b0 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.386+0000 7f2979600640 1 -- 172.21.15.99:0/3656258251 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2970045070 con 0x7f29640039b0 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.386+0000 7f2984000640 1 -- 172.21.15.99:0/3656258251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297c0cb600 con 0x7f29640039b0 2024-03-30T13:14:26.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.386+0000 7f2979600640 1 -- 172.21.15.99:0/3656258251 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970003a70 con 0x7f29640039b0 2024-03-30T13:14:26.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.386+0000 7f2984000640 1 -- 172.21.15.99:0/3656258251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f297c0cbbc0 con 0x7f29640039b0 2024-03-30T13:14:26.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.387+0000 7f2984000640 1 -- 172.21.15.99:0/3656258251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297c159f50 con 0x7f29640039b0 2024-03-30T13:14:26.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.388+0000 7f2979600640 1 -- 172.21.15.99:0/3656258251 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2970003c10 con 0x7f29640039b0 2024-03-30T13:14:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.389+0000 7f2979600640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f295c06c560 0x7f295c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.389+0000 7f2979600640 1 -- 172.21.15.99:0/3656258251 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f29700ad5a0 con 0x7f29640039b0 2024-03-30T13:14:26.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.389+0000 7f2980c00640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f295c06c560 0x7f295c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:26.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.390+0000 7f2980c00640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f295c06c560 0x7f295c06ea20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f297c15a120 tx=0x7f2968008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:26.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.393+0000 7f2979600640 1 -- 172.21.15.99:0/3656258251 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f297007beb0 con 0x7f29640039b0 2024-03-30T13:14:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.665+0000 7f2984000640 1 -- 172.21.15.99:0/3656258251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]} v 0) -- 0x7f297c068640 con 0x7f29640039b0 2024-03-30T13:14:26.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.692+0000 7f2979600640 1 -- 172.21.15.99:0/3656258251 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]}]=0 v189) ==== 147+0+0 (secure 0 0 0) 0x7f297007b7b0 con 0x7f29640039b0 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 -- 172.21.15.99:0/3656258251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f295c06c560 msgr2=0x7f295c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f295c06c560 0x7f295c06ea20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f297c15a120 tx=0x7f2968008040 comp rx=0 tx=0).stop 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 -- 172.21.15.99:0/3656258251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 msgr2=0x7f297c1f4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 0x7f297c1f4220 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2970000c00 tx=0x7f2970004730 comp rx=0 tx=0).stop 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 -- 172.21.15.99:0/3656258251 shutdown_connections 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f295c06c560 0x7f295c06ea20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f297c0ca7f0 0x7f297c0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f297c159590 0x7f297c159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 --2- 172.21.15.99:0/3656258251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29640039b0 0x7f297c1f4220 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 -- 172.21.15.99:0/3656258251 >> 172.21.15.99:0/3656258251 conn(0x7f297c06b510 msgr2=0x7f297c0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 -- 172.21.15.99:0/3656258251 shutdown_connections 2024-03-30T13:14:26.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:26.695+0000 7f2984000640 1 -- 172.21.15.99:0/3656258251 wait complete. 2024-03-30T13:14:26.721 INFO:tasks.cephfs_test_runner:test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) ... ERROR 2024-03-30T13:14:26.721 INFO:tasks.cephfs_test_runner: 2024-03-30T13:14:26.721 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-30T13:14:26.721 INFO:tasks.cephfs_test_runner:ERROR: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:14:26.721 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-30T13:14:26.721 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-30T13:14:26.721 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 322, in test_data_uninlining 2024-03-30T13:14:26.721 INFO:tasks.cephfs_test_runner: self.run_test_worker(opt_clear_cache, 2024-03-30T13:14:26.721 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 219, in run_test_worker 2024-03-30T13:14:26.721 INFO:tasks.cephfs_test_runner: self.fs.mds_tell(['cache', 'drop'], i) 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1313, in mds_tell 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: return self.rank_tell(*args, **kwargs) 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1332, in rank_tell 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: return self.mds_tell(*args, mds_id=f"{self.id}:{rank}", **kwargs) 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1319, in mds_tell 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: out = self.get_ceph_cmd_stdout("tell", f"mds.{mds_id}", *args, **kwargs) 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-03-30T13:14:26.722 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 447, in run 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: r = RemoteProcess(client, args, check_status=check_status, hostname=name, 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 65, in __init__ 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: self.command = quote(args) 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 257, in quote 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: return ' '.join(_quote(args)) 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 255, in _quote 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: yield pipes.quote(a) 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/shlex.py", line 325, in quote 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: if _find_unsafe(s) is None: 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner:TypeError: expected string or bytes-like object 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner:Ran 1 test in 174.356s 2024-03-30T13:14:26.723 INFO:tasks.cephfs_test_runner: 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner: 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner:ERROR: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 322, in test_data_uninlining 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner: self.run_test_worker(opt_clear_cache, 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 219, in run_test_worker 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner: self.fs.mds_tell(['cache', 'drop'], i) 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1313, in mds_tell 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner: return self.rank_tell(*args, **kwargs) 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1332, in rank_tell 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner: return self.mds_tell(*args, mds_id=f"{self.id}:{rank}", **kwargs) 2024-03-30T13:14:26.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1319, in mds_tell 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: out = self.get_ceph_cmd_stdout("tell", f"mds.{mds_id}", *args, **kwargs) 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 447, in run 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: r = RemoteProcess(client, args, check_status=check_status, hostname=name, 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 65, in __init__ 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: self.command = quote(args) 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 257, in quote 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: return ' '.join(_quote(args)) 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 255, in _quote 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: yield pipes.quote(a) 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/shlex.py", line 325, in quote 2024-03-30T13:14:26.725 INFO:tasks.cephfs_test_runner: if _find_unsafe(s) is None: 2024-03-30T13:14:26.726 INFO:tasks.cephfs_test_runner:TypeError: expected string or bytes-like object 2024-03-30T13:14:26.726 INFO:tasks.cephfs_test_runner: 2024-03-30T13:14:26.726 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:14:26.961 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=60ea57b241c9427fb83096af644adb38 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:14:26.963 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-30T13:14:26.972 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-30T13:14:27.012 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-30T13:14:27.012 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:14:27.012 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:14:27.070 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053413,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249168k,nr_inodes=812292,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T13:14:27.070 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:14:27.070 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:14:27.120 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053413,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249168k,nr_inodes=812292,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T13:14:27.120 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:14:27.121 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:14:27.176 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053407,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498328k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249164k,nr_inodes=812291,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498328k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T13:14:27.176 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:14:27.176 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:14:27.226 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053407,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498328k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249164k,nr_inodes=812291,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498328k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T13:14:27.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:27.226 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-03-30T13:14:27.282 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T13:14:27.282 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-30T13:14:27.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:27.284 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:14:27.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:27.379 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:14:27.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:27.466 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-03-30T13:14:27.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:27.613 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-03-30T13:14:27.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:27.661 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-03-30T13:14:27.801 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-03-30T13:14:27.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:14:27.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:27.806 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-03-30T13:14:27.861 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-30T13:14:27.861 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-30T13:14:27.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:27.862 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:14:27.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:27.954 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:14:28.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:28.040 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-03-30T13:14:28.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:28.187 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-03-30T13:14:28.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:28.235 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-03-30T13:14:28.372 INFO:teuthology.orchestra.run.smithi181.stderr:Cannot find device "ceph-brx" 2024-03-30T13:14:28.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:14:28.377 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-30T13:14:28.386 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-30T13:14:28.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:14:28.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.601+0000 7faa1d400640 1 Processor -- start 2024-03-30T13:14:28.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.601+0000 7faa1d400640 1 -- start start 2024-03-30T13:14:28.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.602+0000 7faa1d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa1815c670 0x7faa1806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:28.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.602+0000 7faa1d400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa1806f060 0x7faa1806d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:28.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.602+0000 7faa1d400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7faa180ad230 0x7faa180ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:28.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.602+0000 7faa1d400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7faa18146230 con 0x7faa1815c670 2024-03-30T13:14:28.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.602+0000 7faa1d400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7faa1806dfc0 con 0x7faa180ad230 2024-03-30T13:14:28.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.602+0000 7faa1d400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7faa1806e2a0 con 0x7faa1806f060 2024-03-30T13:14:28.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa16800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa1815c670 0x7faa1806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:28.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa16800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa1815c670 0x7faa1806c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43896/0 (socket says 172.21.15.99:43896) 2024-03-30T13:14:28.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa16800640 1 -- 172.21.15.99:0/1935951395 learned_addr learned my addr 172.21.15.99:0/1935951395 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa15e00640 1 --2- 172.21.15.99:0/1935951395 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa1806f060 0x7faa1806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa17200640 1 --2- 172.21.15.99:0/1935951395 >> v2:172.21.15.181:3300/0 conn(0x7faa180ad230 0x7faa180ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa16800640 1 -- 172.21.15.99:0/1935951395 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa1806f060 msgr2=0x7faa1806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa16800640 1 --2- 172.21.15.99:0/1935951395 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa1806f060 0x7faa1806d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa16800640 1 -- 172.21.15.99:0/1935951395 >> v2:172.21.15.181:3300/0 conn(0x7faa180ad230 msgr2=0x7faa180ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa16800640 1 --2- 172.21.15.99:0/1935951395 >> v2:172.21.15.181:3300/0 conn(0x7faa180ad230 0x7faa180ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa16800640 1 -- 172.21.15.99:0/1935951395 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1806e580 con 0x7faa1815c670 2024-03-30T13:14:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa15e00640 1 --2- 172.21.15.99:0/1935951395 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa1806f060 0x7faa1806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.603+0000 7faa17200640 1 --2- 172.21.15.99:0/1935951395 >> v2:172.21.15.181:3300/0 conn(0x7faa180ad230 0x7faa180ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.605+0000 7faa16800640 1 --2- 172.21.15.99:0/1935951395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa1815c670 0x7faa1806c030 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faa1806fc20 tx=0x7faa0802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7267d84235b006ac server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.605+0000 7faa15400640 1 -- 172.21.15.99:0/1935951395 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0802e070 con 0x7faa1815c670 2024-03-30T13:14:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.605+0000 7faa15400640 1 -- 172.21.15.99:0/1935951395 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa08037070 con 0x7faa1815c670 2024-03-30T13:14:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.605+0000 7faa15400640 1 -- 172.21.15.99:0/1935951395 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08031a00 con 0x7faa1815c670 2024-03-30T13:14:28.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.606+0000 7faa1d400640 1 -- 172.21.15.99:0/1935951395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa1815c670 msgr2=0x7faa1806c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:28.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.606+0000 7faa1d400640 1 --2- 172.21.15.99:0/1935951395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa1815c670 0x7faa1806c030 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faa1806fc20 tx=0x7faa0802b880 comp rx=0 tx=0).stop 2024-03-30T13:14:28.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.606+0000 7faa1d400640 1 -- 172.21.15.99:0/1935951395 shutdown_connections 2024-03-30T13:14:28.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.606+0000 7faa1d400640 1 --2- 172.21.15.99:0/1935951395 >> v2:172.21.15.181:3300/0 conn(0x7faa180ad230 0x7faa180ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:28.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.606+0000 7faa1d400640 1 --2- 172.21.15.99:0/1935951395 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa1806f060 0x7faa1806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:28.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.606+0000 7faa1d400640 1 --2- 172.21.15.99:0/1935951395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa1815c670 0x7faa1806c030 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:28.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.606+0000 7faa1d400640 1 -- 172.21.15.99:0/1935951395 >> 172.21.15.99:0/1935951395 conn(0x7faa1806b510 msgr2=0x7faa1806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:28.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.606+0000 7faa1d400640 1 -- 172.21.15.99:0/1935951395 shutdown_connections 2024-03-30T13:14:28.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.606+0000 7faa1d400640 1 -- 172.21.15.99:0/1935951395 wait complete. 2024-03-30T13:14:28.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.609+0000 7faa1d400640 1 Processor -- start 2024-03-30T13:14:28.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.609+0000 7faa1d400640 1 -- start start 2024-03-30T13:14:28.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.610+0000 7faa1d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa1806f060 0x7faa180c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.610+0000 7faa1d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa180ad230 0x7faa180ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.610+0000 7faa1d400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa1815c670 0x7faa180ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.610+0000 7faa1d400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faa180b32c0 con 0x7faa180ad230 2024-03-30T13:14:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.610+0000 7faa1d400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faa1815ca50 con 0x7faa1806f060 2024-03-30T13:14:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.610+0000 7faa1d400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7faa180b3440 con 0x7faa1815c670 2024-03-30T13:14:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.610+0000 7faa15e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa180ad230 0x7faa180ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.610+0000 7faa15e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa180ad230 0x7faa180ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43904/0 (socket says 172.21.15.99:43904) 2024-03-30T13:14:28.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.610+0000 7faa15e00640 1 -- 172.21.15.99:0/2660343999 learned_addr learned my addr 172.21.15.99:0/2660343999 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:28.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa16800640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa1806f060 0x7faa180c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:28.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa17200640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa1815c670 0x7faa180ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:28.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa15e00640 1 -- 172.21.15.99:0/2660343999 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa1815c670 msgr2=0x7faa180ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:28.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa15e00640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa1815c670 0x7faa180ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:28.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa15e00640 1 -- 172.21.15.99:0/2660343999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa1806f060 msgr2=0x7faa180c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:28.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa15e00640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa1806f060 0x7faa180c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:28.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa15e00640 1 -- 172.21.15.99:0/2660343999 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa18072530 con 0x7faa180ad230 2024-03-30T13:14:28.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa15e00640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa180ad230 0x7faa180ca200 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7faa0400c7c0 tx=0x7faa0400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:28.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa0ea00640 1 -- 172.21.15.99:0/2660343999 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04015070 con 0x7faa180ad230 2024-03-30T13:14:28.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa0ea00640 1 -- 172.21.15.99:0/2660343999 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa04007a30 con 0x7faa180ad230 2024-03-30T13:14:28.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa0ea00640 1 -- 172.21.15.99:0/2660343999 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04007e00 con 0x7faa180ad230 2024-03-30T13:14:28.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa1d400640 1 -- 172.21.15.99:0/2660343999 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa18072810 con 0x7faa180ad230 2024-03-30T13:14:28.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.611+0000 7faa1d400640 1 -- 172.21.15.99:0/2660343999 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa18072dd0 con 0x7faa180ad230 2024-03-30T13:14:28.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.613+0000 7faa1d400640 1 -- 172.21.15.99:0/2660343999 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa18068640 con 0x7faa180ad230 2024-03-30T13:14:28.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.614+0000 7faa0ea00640 1 -- 172.21.15.99:0/2660343999 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faa04018070 con 0x7faa180ad230 2024-03-30T13:14:28.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.614+0000 7faa0ea00640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9f806c560 0x7fa9f806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:28.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.615+0000 7faa0ea00640 1 -- 172.21.15.99:0/2660343999 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7faa0408b260 con 0x7faa180ad230 2024-03-30T13:14:28.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.615+0000 7faa16800640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9f806c560 0x7fa9f806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:28.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.616+0000 7faa16800640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9f806c560 0x7fa9f806ea20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faa08036000 tx=0x7faa08008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.619+0000 7faa0ea00640 1 -- 172.21.15.99:0/2660343999 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7faa04059c10 con 0x7faa180ad230 2024-03-30T13:14:28.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.815+0000 7faa1d400640 1 -- 172.21.15.99:0/2660343999 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faa180722e0 con 0x7fa9f806c560 2024-03-30T13:14:28.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.817+0000 7faa0ea00640 1 -- 172.21.15.99:0/2660343999 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13534 (secure 0 0 0) 0x7faa180722e0 con 0x7fa9f806c560 2024-03-30T13:14:28.861 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:28.863 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:14:28.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.819+0000 7faa1d400640 1 -- 172.21.15.99:0/2660343999 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9f806c560 msgr2=0x7fa9f806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:28.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.819+0000 7faa1d400640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9f806c560 0x7fa9f806ea20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faa08036000 tx=0x7faa08008030 comp rx=0 tx=0).stop 2024-03-30T13:14:28.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.819+0000 7faa1d400640 1 -- 172.21.15.99:0/2660343999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa180ad230 msgr2=0x7faa180ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:28.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.819+0000 7faa1d400640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa180ad230 0x7faa180ca200 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7faa0400c7c0 tx=0x7faa0400cc80 comp rx=0 tx=0).stop 2024-03-30T13:14:28.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.820+0000 7faa1d400640 1 -- 172.21.15.99:0/2660343999 shutdown_connections 2024-03-30T13:14:28.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.820+0000 7faa1d400640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fa9f806c560 0x7fa9f806ea20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:28.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.820+0000 7faa1d400640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa1815c670 0x7faa180ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:28.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.820+0000 7faa1d400640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa180ad230 0x7faa180ca200 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:28.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.820+0000 7faa1d400640 1 --2- 172.21.15.99:0/2660343999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa1806f060 0x7faa180c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:28.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.820+0000 7faa1d400640 1 -- 172.21.15.99:0/2660343999 >> 172.21.15.99:0/2660343999 conn(0x7faa1806b510 msgr2=0x7faa18160090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:28.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.820+0000 7faa1d400640 1 -- 172.21.15.99:0/2660343999 shutdown_connections 2024-03-30T13:14:28.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:28.820+0000 7faa1d400640 1 -- 172.21.15.99:0/2660343999 wait complete. 2024-03-30T13:14:28.865 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-03-30T13:14:27.509849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":597192,"kb_used_data":351920,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754377528,"statfs":{"total":773094113280,"available":772482588672,"internally_reserved":0,"allocated":360366080,"data_stored":357779408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-177553901,"num_objects":-139,"num_object_clones":0,"num_object_copies":-278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-139,"num_whiteouts":0,"num_read":-202,"num_read_kb":-168596,"num_write":-931,"num_write_kb":-176218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001575"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":208,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:14:22.682712+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:14:22.682712+0000","last_peered":"2024-03-30T13:14:22.682712+0000","last_clean":"2024-03-30T13:14:22.682712+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:14:22.682712+0000","last_undegraded":"2024-03-30T13:14:22.682712+0000","last_fullsized":"2024-03-30T13:14:22.682712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476784,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72848,"kb_used_data":45828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94298992,"statfs":{"total":96636764160,"available":96562167808,"internally_reserved":0,"allocated":46927872,"data_stored":46604041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476785,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89380,"kb_used_data":58200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282460,"statfs":{"total":96636764160,"available":96545239040,"internally_reserved":0,"allocated":59596800,"data_stored":59264196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476785,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74060,"kb_used_data":42880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94297780,"statfs":{"total":96636764160,"available":96560926720,"internally_reserved":0,"allocated":43909120,"data_stored":43596981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476784,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76964,"kb_used_data":45784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94294876,"statfs":{"total":96636764160,"available":96557953024,"internally_reserved":0,"allocated":46882816,"data_stored":46565890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85064,"kb_used_data":53884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94286776,"statfs":{"total":96636764160,"available":96549658624,"internally_reserved":0,"allocated":55177216,"data_stored":54836993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49556,"kb_used_data":18376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322284,"statfs":{"total":96636764160,"available":96586018816,"internally_reserved":0,"allocated":18817024,"data_stored":18489157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80588,"kb_used_data":49412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94291252,"statfs":{"total":96636764160,"available":96554242048,"internally_reserved":0,"allocated":50597888,"data_stored":50273916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542193,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68732,"kb_used_data":37556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94303108,"statfs":{"total":96636764160,"available":96566382592,"internally_reserved":0,"allocated":38457344,"data_stored":38148234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:14:28.865 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:14:29.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.071+0000 7fcc4fa00640 1 Processor -- start 2024-03-30T13:14:29.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.071+0000 7fcc4fa00640 1 -- start start 2024-03-30T13:14:29.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.073+0000 7fcc4fa00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4815e9b0 0x7fcc480d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.073+0000 7fcc4fa00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcc480d3300 0x7fcc48162f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.073+0000 7fcc4fa00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc480d54f0 con 0x7fcc480d4f30 2024-03-30T13:14:29.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.073+0000 7fcc4fa00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fcc481634b0 con 0x7fcc480d3300 2024-03-30T13:14:29.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.073+0000 7fcc4fa00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcc480cfcf0 con 0x7fcc4815e9b0 2024-03-30T13:14:29.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.073+0000 7fcc47e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcc480d4f30 0x7fcc480d2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56872/0 (socket says 172.21.15.99:56872) 2024-03-30T13:14:29.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.073+0000 7fcc47e00640 1 -- 172.21.15.99:0/3727562165 learned_addr learned my addr 172.21.15.99:0/3727562165 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:29.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc4da00640 1 --2- 172.21.15.99:0/3727562165 >> v2:172.21.15.181:3300/0 conn(0x7fcc480d3300 0x7fcc48162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc4d000640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4815e9b0 0x7fcc480d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3686807669 0 0) 0x7fcc480d54f0 con 0x7fcc480d4f30 2024-03-30T13:14:29.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc2c003520 con 0x7fcc480d4f30 2024-03-30T13:14:29.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4294086989 0 0) 0x7fcc2c003520 con 0x7fcc480d4f30 2024-03-30T13:14:29.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4815e9b0 msgr2=0x7fcc480d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:29.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4815e9b0 0x7fcc480d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 >> v2:172.21.15.181:3300/0 conn(0x7fcc480d3300 msgr2=0x7fcc48162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:29.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 --2- 172.21.15.99:0/3727562165 >> v2:172.21.15.181:3300/0 conn(0x7fcc480d3300 0x7fcc48162f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc480cf3c0 con 0x7fcc480d4f30 2024-03-30T13:14:29.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fcc380019f0 con 0x7fcc480d4f30 2024-03-30T13:14:29.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc4da00640 1 --2- 172.21.15.99:0/3727562165 >> v2:172.21.15.181:3300/0 conn(0x7fcc480d3300 0x7fcc48162f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:29.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 >> v1:172.21.15.99:6789/0 conn(0x7fcc480d4f30 legacy=0x7fcc480d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2c0039b0 0x7fcc2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc2c004800 0x7fcc2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4815e9b0 0x7fcc2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcc481634b0 con 0x7fcc2c0039b0 2024-03-30T13:14:29.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480cfcf0 con 0x7fcc2c004800 2024-03-30T13:14:29.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.074+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2c00b9c0 con 0x7fcc4815e9b0 2024-03-30T13:14:29.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.075+0000 7fcc4d000640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2c0039b0 0x7fcc2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.075+0000 7fcc47e00640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc2c004800 0x7fcc2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.075+0000 7fcc4da00640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4815e9b0 0x7fcc2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.075+0000 7fcc4d000640 1 -- 172.21.15.99:0/3727562165 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4815e9b0 msgr2=0x7fcc2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:29.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.075+0000 7fcc4d000640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4815e9b0 0x7fcc2c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.075+0000 7fcc4d000640 1 -- 172.21.15.99:0/3727562165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc2c004800 msgr2=0x7fcc2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:29.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.075+0000 7fcc4d000640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc2c004800 0x7fcc2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.075+0000 7fcc4d000640 1 -- 172.21.15.99:0/3727562165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2c003520 con 0x7fcc2c0039b0 2024-03-30T13:14:29.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.076+0000 7fcc4d000640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2c0039b0 0x7fcc2c003dd0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009ac0 tx=0x7fcc2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6263e9e991becef server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:29.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.076+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30039070 con 0x7fcc2c0039b0 2024-03-30T13:14:29.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.077+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3002c6b0 con 0x7fcc2c0039b0 2024-03-30T13:14:29.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.077+0000 7fcc47400640 1 -- 172.21.15.99:0/3727562165 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30009690 con 0x7fcc2c0039b0 2024-03-30T13:14:29.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.077+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3727562165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2c0039b0 msgr2=0x7fcc2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.077+0000 7fcc4fa00640 1 --2- 172.21.15.99:0/3727562165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2c0039b0 0x7fcc2c003dd0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009ac0 tx=0x7fcc2c005830 comp rx=0 tx=0).stop 2024-03-30T13:14:29.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.077+0000 7fcc4da00640 1 -- 172.21.15.99:0/3727562165 reap_dead start 2024-03-30T13:14:29.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.077+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3727562165 shutdown_connections 2024-03-30T13:14:29.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.077+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3727562165 >> 172.21.15.99:0/3727562165 conn(0x7fcc4808bfc0 msgr2=0x7fcc480d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:29.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.077+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3727562165 shutdown_connections 2024-03-30T13:14:29.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.077+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3727562165 wait complete. 2024-03-30T13:14:29.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.079+0000 7fcc4fa00640 1 Processor -- start 2024-03-30T13:14:29.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.079+0000 7fcc4fa00640 1 -- start start 2024-03-30T13:14:29.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.080+0000 7fcc4fa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc2c0039b0 0x7fcc480b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.080+0000 7fcc4fa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc480cccd0 0x7fcc480cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.080+0000 7fcc4fa00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4809e2f0 0x7fcc4809e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.080+0000 7fcc4fa00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4815ed90 con 0x7fcc480cccd0 2024-03-30T13:14:29.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.080+0000 7fcc4fa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480cf980 con 0x7fcc2c0039b0 2024-03-30T13:14:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.080+0000 7fcc4fa00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcc480d0180 con 0x7fcc4809e2f0 2024-03-30T13:14:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.080+0000 7fcc47e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc480cccd0 0x7fcc480cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.080+0000 7fcc47e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc480cccd0 0x7fcc480cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43924/0 (socket says 172.21.15.99:43924) 2024-03-30T13:14:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.080+0000 7fcc47e00640 1 -- 172.21.15.99:0/3157731209 learned_addr learned my addr 172.21.15.99:0/3157731209 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc4d000640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc2c0039b0 0x7fcc480b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc4da00640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4809e2f0 0x7fcc4809e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc47e00640 1 -- 172.21.15.99:0/3157731209 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4809e2f0 msgr2=0x7fcc4809e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc47e00640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4809e2f0 0x7fcc4809e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc47e00640 1 -- 172.21.15.99:0/3157731209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc2c0039b0 msgr2=0x7fcc480b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc47e00640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc2c0039b0 0x7fcc480b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc47e00640 1 -- 172.21.15.99:0/3157731209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4809fc50 con 0x7fcc480cccd0 2024-03-30T13:14:29.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc4d000640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc2c0039b0 0x7fcc480b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:29.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc47e00640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc480cccd0 0x7fcc480cd150 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcc38007b90 tx=0x7fcc3800e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:29.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc44c00640 1 -- 172.21.15.99:0/3157731209 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38004b60 con 0x7fcc480cccd0 2024-03-30T13:14:29.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc44c00640 1 -- 172.21.15.99:0/3157731209 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc38004d20 con 0x7fcc480cccd0 2024-03-30T13:14:29.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc44c00640 1 -- 172.21.15.99:0/3157731209 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38005020 con 0x7fcc480cccd0 2024-03-30T13:14:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.081+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3157731209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc480b1720 con 0x7fcc480cccd0 2024-03-30T13:14:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.082+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3157731209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc4809f600 con 0x7fcc480cccd0 2024-03-30T13:14:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.083+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3157731209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc48068640 con 0x7fcc480cccd0 2024-03-30T13:14:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.083+0000 7fcc44c00640 1 -- 172.21.15.99:0/3157731209 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcc3801a020 con 0x7fcc480cccd0 2024-03-30T13:14:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.084+0000 7fcc44c00640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcc2406c530 0x7fcc2406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.084+0000 7fcc44c00640 1 -- 172.21.15.99:0/3157731209 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7fcc3808b600 con 0x7fcc480cccd0 2024-03-30T13:14:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.085+0000 7fcc4d000640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcc2406c530 0x7fcc2406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.085+0000 7fcc4d000640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcc2406c530 0x7fcc2406e9f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc30036000 tx=0x7fcc30030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:29.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.089+0000 7fcc44c00640 1 -- 172.21.15.99:0/3157731209 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcc38059f10 con 0x7fcc480cccd0 2024-03-30T13:14:29.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.285+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3157731209 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc4814d7c0 con 0x7fcc2406c530 2024-03-30T13:14:29.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.287+0000 7fcc44c00640 1 -- 172.21.15.99:0/3157731209 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13534 (secure 0 0 0) 0x7fcc4814d7c0 con 0x7fcc2406c530 2024-03-30T13:14:29.292 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:29.292 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:14:29.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3157731209 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcc2406c530 msgr2=0x7fcc2406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcc2406c530 0x7fcc2406e9f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc30036000 tx=0x7fcc30030000 comp rx=0 tx=0).stop 2024-03-30T13:14:29.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3157731209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc480cccd0 msgr2=0x7fcc480cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc480cccd0 0x7fcc480cd150 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcc38007b90 tx=0x7fcc3800e5f0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3157731209 shutdown_connections 2024-03-30T13:14:29.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fcc2406c530 0x7fcc2406e9f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc4809e2f0 0x7fcc4809e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc480cccd0 0x7fcc480cd150 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 --2- 172.21.15.99:0/3157731209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc2c0039b0 0x7fcc480b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3157731209 >> 172.21.15.99:0/3157731209 conn(0x7fcc4808bfc0 msgr2=0x7fcc480b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:29.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3157731209 shutdown_connections 2024-03-30T13:14:29.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.290+0000 7fcc4fa00640 1 -- 172.21.15.99:0/3157731209 wait complete. 2024-03-30T13:14:29.316 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-03-30T13:14:27.509849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":597192,"kb_used_data":351920,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754377528,"statfs":{"total":773094113280,"available":772482588672,"internally_reserved":0,"allocated":360366080,"data_stored":357779408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-177553901,"num_objects":-139,"num_object_clones":0,"num_object_copies":-278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-139,"num_whiteouts":0,"num_read":-202,"num_read_kb":-168596,"num_write":-931,"num_write_kb":-176218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001575"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":208,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:14:22.682712+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:14:22.682712+0000","last_peered":"2024-03-30T13:14:22.682712+0000","last_clean":"2024-03-30T13:14:22.682712+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:14:22.682712+0000","last_undegraded":"2024-03-30T13:14:22.682712+0000","last_fullsized":"2024-03-30T13:14:22.682712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476784,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72848,"kb_used_data":45828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94298992,"statfs":{"total":96636764160,"available":96562167808,"internally_reserved":0,"allocated":46927872,"data_stored":46604041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476785,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89380,"kb_used_data":58200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282460,"statfs":{"total":96636764160,"available":96545239040,"internally_reserved":0,"allocated":59596800,"data_stored":59264196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476785,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74060,"kb_used_data":42880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94297780,"statfs":{"total":96636764160,"available":96560926720,"internally_reserved":0,"allocated":43909120,"data_stored":43596981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476784,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76964,"kb_used_data":45784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94294876,"statfs":{"total":96636764160,"available":96557953024,"internally_reserved":0,"allocated":46882816,"data_stored":46565890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85064,"kb_used_data":53884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94286776,"statfs":{"total":96636764160,"available":96549658624,"internally_reserved":0,"allocated":55177216,"data_stored":54836993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49556,"kb_used_data":18376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322284,"statfs":{"total":96636764160,"available":96586018816,"internally_reserved":0,"allocated":18817024,"data_stored":18489157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80588,"kb_used_data":49412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94291252,"statfs":{"total":96636764160,"available":96554242048,"internally_reserved":0,"allocated":50597888,"data_stored":50273916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542193,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68732,"kb_used_data":37556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94303108,"statfs":{"total":96636764160,"available":96566382592,"internally_reserved":0,"allocated":38457344,"data_stored":38148234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:14:29.317 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-30T13:14:29.317 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:14:29.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.508+0000 7fb7f7800640 1 Processor -- start 2024-03-30T13:14:29.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.508+0000 7fb7f7800640 1 -- start start 2024-03-30T13:14:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.510+0000 7fb7f7800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f009b440 0x7fb7f0160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.510+0000 7fb7f7800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f009b920 con 0x7fb7f01607c0 2024-03-30T13:14:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.510+0000 7fb7f7800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f009bc00 con 0x7fb7f01610e0 2024-03-30T13:14:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.510+0000 7fb7f7800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f00d0240 con 0x7fb7f009b440 2024-03-30T13:14:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.510+0000 7fb7f4e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb7f01607c0 0x7fb7f00b5320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56874/0 (socket says 172.21.15.99:56874) 2024-03-30T13:14:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.510+0000 7fb7f4e00640 1 -- 172.21.15.99:0/842724338 learned_addr learned my addr 172.21.15.99:0/842724338 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.510+0000 7fb7e7e00640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f009b440 0x7fb7f0160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.510+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017377088 0 0) 0x7fb7f009b920 con 0x7fb7f01607c0 2024-03-30T13:14:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7d4003520 con 0x7fb7f01607c0 2024-03-30T13:14:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2572569126 0 0) 0x7fb7d4003520 con 0x7fb7f01607c0 2024-03-30T13:14:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f009b440 msgr2=0x7fb7f0160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f009b440 0x7fb7f0160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 >> v1:172.21.15.181:6789/0 conn(0x7fb7f01610e0 legacy=0x7fb7f015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f00d0520 con 0x7fb7f01607c0 2024-03-30T13:14:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fb7e0001670 con 0x7fb7f01607c0 2024-03-30T13:14:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 >> v1:172.21.15.99:6789/0 conn(0x7fb7f01607c0 legacy=0x7fb7f00b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 0x7fb7d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7d4004800 0x7fb7d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f009b440 0x7fb7d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00d0240 con 0x7fb7d40039e0 2024-03-30T13:14:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d400baa0 con 0x7fb7d4004800 2024-03-30T13:14:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d400bca0 con 0x7fb7f009b440 2024-03-30T13:14:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.511+0000 7fb7f4e00640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 0x7fb7d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.512+0000 7fb7e7e00640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7d4004800 0x7fb7d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.512+0000 7fb7f5800640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f009b440 0x7fb7d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.512+0000 7fb7f4e00640 1 -- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f009b440 msgr2=0x7fb7d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.512+0000 7fb7f4e00640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f009b440 0x7fb7d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.512+0000 7fb7f4e00640 1 -- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7d4004800 msgr2=0x7fb7d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.512+0000 7fb7f4e00640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7d4004800 0x7fb7d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.512+0000 7fb7f4e00640 1 -- 172.21.15.99:0/842724338 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d4003520 con 0x7fb7d40039e0 2024-03-30T13:14:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.512+0000 7fb7f5800640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f009b440 0x7fb7d40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.513+0000 7fb7f4e00640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 0x7fb7d4003e00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c160 tx=0x7fb7d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c86daabc0e3a5e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:29.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.513+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0007c60 con 0x7fb7d40039e0 2024-03-30T13:14:29.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.513+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0030070 con 0x7fb7d40039e0 2024-03-30T13:14:29.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.513+0000 7fb7efe00640 1 -- 172.21.15.99:0/842724338 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0005d50 con 0x7fb7d40039e0 2024-03-30T13:14:29.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.514+0000 7fb7f7800640 1 -- 172.21.15.99:0/842724338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 msgr2=0x7fb7d4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.514+0000 7fb7f7800640 1 --2- 172.21.15.99:0/842724338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 0x7fb7d4003e00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c160 tx=0x7fb7d4005830 comp rx=0 tx=0).stop 2024-03-30T13:14:29.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.514+0000 7fb7f5800640 1 -- 172.21.15.99:0/842724338 reap_dead start 2024-03-30T13:14:29.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.514+0000 7fb7f7800640 1 -- 172.21.15.99:0/842724338 shutdown_connections 2024-03-30T13:14:29.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.514+0000 7fb7f7800640 1 -- 172.21.15.99:0/842724338 >> 172.21.15.99:0/842724338 conn(0x7fb7f00b3fc0 msgr2=0x7fb7f00b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.514+0000 7fb7f7800640 1 -- 172.21.15.99:0/842724338 shutdown_connections 2024-03-30T13:14:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.514+0000 7fb7f7800640 1 -- 172.21.15.99:0/842724338 wait complete. 2024-03-30T13:14:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.516+0000 7fb7f7800640 1 Processor -- start 2024-03-30T13:14:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.516+0000 7fb7f7800640 1 -- start start 2024-03-30T13:14:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.517+0000 7fb7f7800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 0x7fb7f006dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.517+0000 7fb7f7800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f006c620 0x7fb7f00cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.517+0000 7fb7f7800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7f00c89e0 0x7fb7f0158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.517+0000 7fb7f7800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f0160190 con 0x7fb7d40039e0 2024-03-30T13:14:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.517+0000 7fb7f7800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f0160010 con 0x7fb7f00c89e0 2024-03-30T13:14:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.517+0000 7fb7f7800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f0160310 con 0x7fb7f006c620 2024-03-30T13:14:29.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.517+0000 7fb7f4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 0x7fb7f006dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.517+0000 7fb7f4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 0x7fb7f006dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43936/0 (socket says 172.21.15.99:43936) 2024-03-30T13:14:29.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.517+0000 7fb7f4e00640 1 -- 172.21.15.99:0/243131435 learned_addr learned my addr 172.21.15.99:0/243131435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:29.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.518+0000 7fb7f4e00640 1 -- 172.21.15.99:0/243131435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f006c620 msgr2=0x7fb7f00cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.518+0000 7fb7f4e00640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f006c620 0x7fb7f00cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.518+0000 7fb7f4e00640 1 -- 172.21.15.99:0/243131435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7f00c89e0 msgr2=0x7fb7f0158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.518+0000 7fb7f4e00640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7f00c89e0 0x7fb7f0158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.518+0000 7fb7f4e00640 1 -- 172.21.15.99:0/243131435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f006cbe0 con 0x7fb7d40039e0 2024-03-30T13:14:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.518+0000 7fb7f4e00640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 0x7fb7f006dc80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb7e002c480 tx=0x7fb7e0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.518+0000 7fb7ed600640 1 -- 172.21.15.99:0/243131435 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0045070 con 0x7fb7d40039e0 2024-03-30T13:14:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.518+0000 7fb7ed600640 1 -- 172.21.15.99:0/243131435 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0004bf0 con 0x7fb7d40039e0 2024-03-30T13:14:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.518+0000 7fb7ed600640 1 -- 172.21.15.99:0/243131435 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0007c60 con 0x7fb7d40039e0 2024-03-30T13:14:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.518+0000 7fb7f7800640 1 -- 172.21.15.99:0/243131435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f006cec0 con 0x7fb7d40039e0 2024-03-30T13:14:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.518+0000 7fb7f7800640 1 -- 172.21.15.99:0/243131435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f006d480 con 0x7fb7d40039e0 2024-03-30T13:14:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.519+0000 7fb7f7800640 1 -- 172.21.15.99:0/243131435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f0068d50 con 0x7fb7d40039e0 2024-03-30T13:14:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.520+0000 7fb7ed600640 1 -- 172.21.15.99:0/243131435 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb7e0007070 con 0x7fb7d40039e0 2024-03-30T13:14:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.521+0000 7fb7ed600640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c530 0x7fb7cc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.521+0000 7fb7ed600640 1 -- 172.21.15.99:0/243131435 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7fb7e00ac4f0 con 0x7fb7d40039e0 2024-03-30T13:14:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.521+0000 7fb7e7e00640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c530 0x7fb7cc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.522+0000 7fb7e7e00640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c530 0x7fb7cc06e9f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb7f006e310 tx=0x7fb7d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:29.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.526+0000 7fb7ed600640 1 -- 172.21.15.99:0/243131435 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb7e007adf0 con 0x7fb7d40039e0 2024-03-30T13:14:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.724+0000 7fb7f7800640 1 -- 172.21.15.99:0/243131435 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7f00b4c20 con 0x7fb7cc06c530 2024-03-30T13:14:29.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.726+0000 7fb7ed600640 1 -- 172.21.15.99:0/243131435 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13535 (secure 0 0 0) 0x7fb7f00b4c20 con 0x7fb7cc06c530 2024-03-30T13:14:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:29.731 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:14:29.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.728+0000 7fb7f7800640 1 -- 172.21.15.99:0/243131435 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c530 msgr2=0x7fb7cc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.728+0000 7fb7f7800640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c530 0x7fb7cc06e9f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb7f006e310 tx=0x7fb7d8008040 comp rx=0 tx=0).stop 2024-03-30T13:14:29.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.728+0000 7fb7f7800640 1 -- 172.21.15.99:0/243131435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 msgr2=0x7fb7f006dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.728+0000 7fb7f7800640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 0x7fb7f006dc80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb7e002c480 tx=0x7fb7e0001970 comp rx=0 tx=0).stop 2024-03-30T13:14:29.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.728+0000 7fb7f7800640 1 -- 172.21.15.99:0/243131435 shutdown_connections 2024-03-30T13:14:29.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.728+0000 7fb7f7800640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7cc06c530 0x7fb7cc06e9f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.728+0000 7fb7f7800640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7f00c89e0 0x7fb7f0158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.728+0000 7fb7f7800640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7f006c620 0x7fb7f00cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.728+0000 7fb7f7800640 1 --2- 172.21.15.99:0/243131435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d40039e0 0x7fb7f006dc80 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.728+0000 7fb7f7800640 1 -- 172.21.15.99:0/243131435 >> 172.21.15.99:0/243131435 conn(0x7fb7f00b3fc0 msgr2=0x7fb7f00cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:29.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.729+0000 7fb7f7800640 1 -- 172.21.15.99:0/243131435 shutdown_connections 2024-03-30T13:14:29.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.729+0000 7fb7f7800640 1 -- 172.21.15.99:0/243131435 wait complete. 2024-03-30T13:14:29.750 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-03-30T13:14:29.510145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":440484,"kb_used_data":195192,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754534236,"statfs":{"total":773094113280,"available":772643057664,"internally_reserved":0,"allocated":199876608,"data_stored":197420116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-177553901,"num_objects":-139,"num_object_clones":0,"num_object_copies":-278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-139,"num_whiteouts":0,"num_read":-202,"num_read_kb":-168596,"num_write":-931,"num_write_kb":-176218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.829268"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":208,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:14:22.682712+0000","last_change":"2024-03-30T13:10:34.973926+0000","last_active":"2024-03-30T13:14:22.682712+0000","last_peered":"2024-03-30T13:14:22.682712+0000","last_clean":"2024-03-30T13:14:22.682712+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:14:22.682712+0000","last_undegraded":"2024-03-30T13:14:22.682712+0000","last_fullsized":"2024-03-30T13:14:22.682712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:10:33.936682+0000","last_clean_scrub_stamp":"2024-03-30T13:10:33.936682+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:55.991502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476784,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72848,"kb_used_data":45828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94298992,"statfs":{"total":96636764160,"available":96562167808,"internally_reserved":0,"allocated":46927872,"data_stored":46604041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476785,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89380,"kb_used_data":58200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282460,"statfs":{"total":96636764160,"available":96545239040,"internally_reserved":0,"allocated":59596800,"data_stored":59264196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476785,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74060,"kb_used_data":42880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94297780,"statfs":{"total":96636764160,"available":96560926720,"internally_reserved":0,"allocated":43909120,"data_stored":43596981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476784,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76964,"kb_used_data":45784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94294876,"statfs":{"total":96636764160,"available":96557953024,"internally_reserved":0,"allocated":46882816,"data_stored":46565890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31664,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":491520,"data_stored":199660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1085440,"data_stored":790028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31664,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":491520,"data_stored":199660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31660,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":491520,"data_stored":199660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:14:29.751 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:14:29.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.928+0000 7f12ad000640 1 Processor -- start 2024-03-30T13:14:29.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.928+0000 7f12ad000640 1 -- start start 2024-03-30T13:14:29.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.929+0000 7f12ad000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f12a815e600 0x7f12a80ae240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.930+0000 7f12ad000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a8162fb0 con 0x7f12a806cbe0 2024-03-30T13:14:29.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.930+0000 7f12ad000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a815e9e0 con 0x7f12a80b4ac0 2024-03-30T13:14:29.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.930+0000 7f12ad000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f12a80b58d0 con 0x7f12a815e600 2024-03-30T13:14:29.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.930+0000 7f12a7e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f12a806cbe0 0x7f12a81628a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56886/0 (socket says 172.21.15.99:56886) 2024-03-30T13:14:29.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.930+0000 7f12a7e00640 1 -- 172.21.15.99:0/3641364159 learned_addr learned my addr 172.21.15.99:0/3641364159 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:29.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.930+0000 7f12a7400640 1 --2- 172.21.15.99:0/3641364159 >> v2:172.21.15.181:3300/0 conn(0x7f12a815e600 0x7f12a80ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.930+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1977603415 0 0) 0x7f12a8162fb0 con 0x7f12a806cbe0 2024-03-30T13:14:29.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.930+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f128c003520 con 0x7f12a806cbe0 2024-03-30T13:14:29.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4269131528 0 0) 0x7f128c003520 con 0x7f12a806cbe0 2024-03-30T13:14:29.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 >> v2:172.21.15.181:3300/0 conn(0x7f12a815e600 msgr2=0x7f12a80ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:29.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 --2- 172.21.15.99:0/3641364159 >> v2:172.21.15.181:3300/0 conn(0x7f12a815e600 0x7f12a80ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 >> v1:172.21.15.181:6789/0 conn(0x7f12a80b4ac0 legacy=0x7f12a8162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a80b5030 con 0x7f12a806cbe0 2024-03-30T13:14:29.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f12a0001670 con 0x7f12a806cbe0 2024-03-30T13:14:29.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 >> v1:172.21.15.99:6789/0 conn(0x7f12a806cbe0 legacy=0x7f12a81628a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 --2- 172.21.15.99:0/3641364159 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f128c003a00 0x7f128c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 --2- 172.21.15.99:0/3641364159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f128c004800 0x7f128c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 --2- 172.21.15.99:0/3641364159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128c0052e0 0x7f128c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f12a80b58d0 con 0x7f128c0052e0 2024-03-30T13:14:29.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f128c00c1e0 con 0x7f128c004800 2024-03-30T13:14:29.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f128c00c3e0 con 0x7f128c003a00 2024-03-30T13:14:29.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.931+0000 7f12a7e00640 1 --2- 172.21.15.99:0/3641364159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128c0052e0 0x7f128c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.932+0000 7f12a7e00640 1 -- 172.21.15.99:0/3641364159 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f128c003a00 msgr2=0x7f128c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:29.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.932+0000 7f12a7e00640 1 --2- 172.21.15.99:0/3641364159 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f128c003a00 0x7f128c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.932+0000 7f12a7e00640 1 -- 172.21.15.99:0/3641364159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f128c004800 msgr2=0x7f128c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:29.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.932+0000 7f12a7e00640 1 --2- 172.21.15.99:0/3641364159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f128c004800 0x7f128c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.932+0000 7f12a7e00640 1 -- 172.21.15.99:0/3641364159 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128c003520 con 0x7f128c0052e0 2024-03-30T13:14:29.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.933+0000 7f12a7e00640 1 -- 172.21.15.99:0/3641364159 reap_dead start 2024-03-30T13:14:29.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.933+0000 7f12a7e00640 1 --2- 172.21.15.99:0/3641364159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128c0052e0 0x7f128c00b9c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c160 tx=0x7f128c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33abe730e6ff9f77 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:29.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.933+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0007c60 con 0x7f128c0052e0 2024-03-30T13:14:29.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.933+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a0030070 con 0x7f128c0052e0 2024-03-30T13:14:29.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.933+0000 7f12a6a00640 1 -- 172.21.15.99:0/3641364159 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0005d10 con 0x7f128c0052e0 2024-03-30T13:14:29.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.934+0000 7f12ad000640 1 -- 172.21.15.99:0/3641364159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128c0052e0 msgr2=0x7f128c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.934+0000 7f12ad000640 1 --2- 172.21.15.99:0/3641364159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128c0052e0 0x7f128c00b9c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c160 tx=0x7f128c005830 comp rx=0 tx=0).stop 2024-03-30T13:14:29.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.934+0000 7f12ad000640 1 -- 172.21.15.99:0/3641364159 shutdown_connections 2024-03-30T13:14:29.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.934+0000 7f12ad000640 1 --2- 172.21.15.99:0/3641364159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128c0052e0 0x7f128c00b9c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.934+0000 7f12ad000640 1 -- 172.21.15.99:0/3641364159 >> 172.21.15.99:0/3641364159 conn(0x7f12a80d0890 msgr2=0x7f12a80d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:29.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.934+0000 7f12ad000640 1 -- 172.21.15.99:0/3641364159 shutdown_connections 2024-03-30T13:14:29.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.934+0000 7f12ad000640 1 -- 172.21.15.99:0/3641364159 wait complete. 2024-03-30T13:14:29.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.935+0000 7f12ad000640 1 Processor -- start 2024-03-30T13:14:29.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.936+0000 7f12ad000640 1 -- start start 2024-03-30T13:14:29.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.936+0000 7f12ad000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f128c0052e0 0x7f12a81566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.936+0000 7f12ad000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12a815ced0 0x7f12a8158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.936+0000 7f12ad000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a814f630 0x7f12a815b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.936+0000 7f12ad000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f12a80b55f0 con 0x7f12a814f630 2024-03-30T13:14:29.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f12ad000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f12a806b740 con 0x7f12a815ced0 2024-03-30T13:14:29.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f12ad000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f12a80b3bc0 con 0x7f128c0052e0 2024-03-30T13:14:29.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f12a7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a814f630 0x7f12a815b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f12a7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a814f630 0x7f12a815b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43962/0 (socket says 172.21.15.99:43962) 2024-03-30T13:14:29.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f12a7e00640 1 -- 172.21.15.99:0/1075794919 learned_addr learned my addr 172.21.15.99:0/1075794919 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:29.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f12a7400640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f128c0052e0 0x7f12a81566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f129ea00640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12a815ced0 0x7f12a8158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f12a7e00640 1 -- 172.21.15.99:0/1075794919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f128c0052e0 msgr2=0x7f12a81566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f12a7e00640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f128c0052e0 0x7f12a81566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f12a7e00640 1 -- 172.21.15.99:0/1075794919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12a815ced0 msgr2=0x7f12a8158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:29.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f12a7e00640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12a815ced0 0x7f12a8158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:29.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.937+0000 7f12a7e00640 1 -- 172.21.15.99:0/1075794919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a815b240 con 0x7f12a814f630 2024-03-30T13:14:29.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.938+0000 7f12a7e00640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a814f630 0x7f12a815b9e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c160 tx=0x7f12a0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:29.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.938+0000 7f129fe00640 1 -- 172.21.15.99:0/1075794919 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a003a070 con 0x7f12a814f630 2024-03-30T13:14:29.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.938+0000 7f129fe00640 1 -- 172.21.15.99:0/1075794919 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a002de20 con 0x7f12a814f630 2024-03-30T13:14:29.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.938+0000 7f129fe00640 1 -- 172.21.15.99:0/1075794919 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0007c60 con 0x7f12a814f630 2024-03-30T13:14:29.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.938+0000 7f12ad000640 1 -- 172.21.15.99:0/1075794919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a80cdd70 con 0x7f12a814f630 2024-03-30T13:14:29.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.938+0000 7f12ad000640 1 -- 172.21.15.99:0/1075794919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a80ce330 con 0x7f12a814f630 2024-03-30T13:14:29.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.939+0000 7f12ad000640 1 -- 172.21.15.99:0/1075794919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a804f8f0 con 0x7f12a814f630 2024-03-30T13:14:29.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.940+0000 7f129fe00640 1 -- 172.21.15.99:0/1075794919 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f12a0004bf0 con 0x7f12a814f630 2024-03-30T13:14:29.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.941+0000 7f129fe00640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f128406c530 0x7f128406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:29.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.942+0000 7f129fe00640 1 -- 172.21.15.99:0/1075794919 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f12a00abf90 con 0x7f12a814f630 2024-03-30T13:14:29.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.942+0000 7f12a7400640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f128406c530 0x7f128406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:29.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.943+0000 7f12a7400640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f128406c530 0x7f128406e9f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1298004b30 tx=0x7f129800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:29.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:29.946+0000 7f129fe00640 1 -- 172.21.15.99:0/1075794919 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f12a0046030 con 0x7f12a814f630 2024-03-30T13:14:30.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.147+0000 7f12ad000640 1 -- 172.21.15.99:0/1075794919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12a806e5b0 con 0x7f12a814f630 2024-03-30T13:14:30.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.148+0000 7f129fe00640 1 -- 172.21.15.99:0/1075794919 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+13022 (secure 0 0 0) 0x7f12a007a8a0 con 0x7f12a814f630 2024-03-30T13:14:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:30.153 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":43,"fsid":"e28e230a-999b-4d07-a5bd-ee507abf8d14","created":"2024-03-30T13:10:20.371694+0000","modified":"2024-03-30T13:14:25.686582+0000","last_up_change":"2024-03-30T13:10:33.936682+0000","last_in_change":"2024-03-30T13:10:24.717053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:10:33.468070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dfb124e-0c71-4a4b-91f7-fcb7ac8baeb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6822","nonce":4232364975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6825","nonce":4232364975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6831","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6833","nonce":4232364975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6827","nonce":4232364975},{"type":"v1","addr":"172.21.15.99:6829","nonce":4232364975}]},"public_addr":"172.21.15.99:6822/4232364975","cluster_addr":"172.21.15.99:6825/4232364975","heartbeat_back_addr":"172.21.15.99:6833/4232364975","heartbeat_front_addr":"172.21.15.99:6829/4232364975","state":["exists","up"]},{"osd":1,"uuid":"c50d9187-00e9-4737-8ecc-6adda3776c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6819","nonce":3090465725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6824","nonce":3090465725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6832","nonce":3090465725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3090465725},{"type":"v1","addr":"172.21.15.99:6828","nonce":3090465725}]},"public_addr":"172.21.15.99:6819/3090465725","cluster_addr":"172.21.15.99:6824/3090465725","heartbeat_back_addr":"172.21.15.99:6832/3090465725","heartbeat_front_addr":"172.21.15.99:6828/3090465725","state":["exists","up"]},{"osd":2,"uuid":"263da3f3-3f63-46f9-b01b-951f50bc1200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6808","nonce":1541384038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6812","nonce":1541384038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6817","nonce":1541384038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1541384038},{"type":"v1","addr":"172.21.15.99:6815","nonce":1541384038}]},"public_addr":"172.21.15.99:6808/1541384038","cluster_addr":"172.21.15.99:6812/1541384038","heartbeat_back_addr":"172.21.15.99:6817/1541384038","heartbeat_front_addr":"172.21.15.99:6815/1541384038","state":["exists","up"]},{"osd":3,"uuid":"daa541ec-08f2-4a10-ae99-dd366ad5f8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6803","nonce":1545943262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6805","nonce":1545943262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6813","nonce":1545943262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":1545943262},{"type":"v1","addr":"172.21.15.99:6809","nonce":1545943262}]},"public_addr":"172.21.15.99:6803/1545943262","cluster_addr":"172.21.15.99:6805/1545943262","heartbeat_back_addr":"172.21.15.99:6813/1545943262","heartbeat_front_addr":"172.21.15.99:6809/1545943262","state":["exists","up"]},{"osd":4,"uuid":"9f92ef13-fc60-45f1-943a-bf0cccf1e3b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6801","nonce":599260275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6803","nonce":599260275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6807","nonce":599260275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":599260275},{"type":"v1","addr":"172.21.15.181:6805","nonce":599260275}]},"public_addr":"172.21.15.181:6801/599260275","cluster_addr":"172.21.15.181:6803/599260275","heartbeat_back_addr":"172.21.15.181:6807/599260275","heartbeat_front_addr":"172.21.15.181:6805/599260275","state":["exists","up"]},{"osd":5,"uuid":"dc0751e0-e85a-43f3-b448-e24aa675e599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6818","nonce":3756128771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6821","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6823","nonce":3756128771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6831","nonce":3756128771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3756128771},{"type":"v1","addr":"172.21.15.181:6828","nonce":3756128771}]},"public_addr":"172.21.15.181:6818/3756128771","cluster_addr":"172.21.15.181:6823/3756128771","heartbeat_back_addr":"172.21.15.181:6831/3756128771","heartbeat_front_addr":"172.21.15.181:6828/3756128771","state":["exists","up"]},{"osd":6,"uuid":"9ca858b8-ab1e-4a5c-8706-9dffffd1d793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6809","nonce":2603803749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6811","nonce":2603803749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6815","nonce":2603803749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2603803749},{"type":"v1","addr":"172.21.15.181:6813","nonce":2603803749}]},"public_addr":"172.21.15.181:6809/2603803749","cluster_addr":"172.21.15.181:6811/2603803749","heartbeat_back_addr":"172.21.15.181:6815/2603803749","heartbeat_front_addr":"172.21.15.181:6813/2603803749","state":["exists","up"]},{"osd":7,"uuid":"8dff6b7a-96d0-47b7-9b86-7d9726045c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6819","nonce":2806450372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6822","nonce":2806450372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6829","nonce":2806450372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2806450372},{"type":"v1","addr":"172.21.15.181:6825","nonce":2806450372}]},"public_addr":"172.21.15.181:6819/2806450372","cluster_addr":"172.21.15.181:6822/2806450372","heartbeat_back_addr":"172.21.15.181:6829/2806450372","heartbeat_front_addr":"172.21.15.181:6825/2806450372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.090875+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.093475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.804386+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.990096+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.960197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.085345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:30.068185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:10:29.582383+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6835/1594018738":"2024-03-31T13:14:22.675764+0000","172.21.15.181:6833/1594018738":"2024-03-31T13:14:22.675764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:14:30.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 -- 172.21.15.99:0/1075794919 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f128406c530 msgr2=0x7f128406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:30.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f128406c530 0x7f128406e9f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1298004b30 tx=0x7f129800d040 comp rx=0 tx=0).stop 2024-03-30T13:14:30.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 -- 172.21.15.99:0/1075794919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a814f630 msgr2=0x7f12a815b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:30.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a814f630 0x7f12a815b9e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c160 tx=0x7f12a0001970 comp rx=0 tx=0).stop 2024-03-30T13:14:30.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 -- 172.21.15.99:0/1075794919 shutdown_connections 2024-03-30T13:14:30.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f128406c530 0x7f128406e9f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:30.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a814f630 0x7f12a815b9e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:30.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12a815ced0 0x7f12a8158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:30.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 --2- 172.21.15.99:0/1075794919 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f128c0052e0 0x7f12a81566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:30.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 -- 172.21.15.99:0/1075794919 >> 172.21.15.99:0/1075794919 conn(0x7f12a80d0890 msgr2=0x7f12a8162a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:30.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 -- 172.21.15.99:0/1075794919 shutdown_connections 2024-03-30T13:14:30.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:30.151+0000 7f12ad000640 1 -- 172.21.15.99:0/1075794919 wait complete. 2024-03-30T13:14:31.175 INFO:tasks.ceph:Scrubbing osd.0 2024-03-30T13:14:31.175 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:14:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.387+0000 7f0098a00640 1 Processor -- start 2024-03-30T13:14:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.387+0000 7f0098a00640 1 -- start start 2024-03-30T13:14:31.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.388+0000 7f0098a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f00940ccad0 0x7f00940ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0098a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f00940ce640 0x7f00940cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0098a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00940b5520 con 0x7f009415c4d0 2024-03-30T13:14:31.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0098a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f00940cd470 con 0x7f00940ce640 2024-03-30T13:14:31.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0098a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f009406f320 con 0x7f00940ccad0 2024-03-30T13:14:31.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0093200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f00940ce640 0x7f00940cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0093200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f00940ce640 0x7f00940cead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43968/0 (socket says 172.21.15.99:43968) 2024-03-30T13:14:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0093200640 1 -- 172.21.15.99:0/625208253 learned_addr learned my addr 172.21.15.99:0/625208253 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0091e00640 1 --2- 172.21.15.99:0/625208253 >> v2:172.21.15.181:3300/0 conn(0x7f00940ccad0 0x7f00940ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0093200640 1 -- 172.21.15.99:0/625208253 >> v2:172.21.15.181:3300/0 conn(0x7f00940ccad0 msgr2=0x7f00940ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0093200640 1 --2- 172.21.15.99:0/625208253 >> v2:172.21.15.181:3300/0 conn(0x7f00940ccad0 0x7f00940ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0093200640 1 -- 172.21.15.99:0/625208253 >> v1:172.21.15.181:6789/0 conn(0x7f009415c4d0 legacy=0x7f00940b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.389+0000 7f0093200640 1 -- 172.21.15.99:0/625208253 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009406ea80 con 0x7f00940ce640 2024-03-30T13:14:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.391+0000 7f0093200640 1 --2- 172.21.15.99:0/625208253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940ce640 0x7f00940cead0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0094070e90 tx=0x7f008c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d368582c014b6a0f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.391+0000 7f0091400640 1 -- 172.21.15.99:0/625208253 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c02ca80 con 0x7f00940ce640 2024-03-30T13:14:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.391+0000 7f0091400640 1 -- 172.21.15.99:0/625208253 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008c02cc20 con 0x7f00940ce640 2024-03-30T13:14:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.391+0000 7f0091400640 1 -- 172.21.15.99:0/625208253 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c0343f0 con 0x7f00940ce640 2024-03-30T13:14:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.392+0000 7f0098a00640 1 -- 172.21.15.99:0/625208253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940ce640 msgr2=0x7f00940cead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.392+0000 7f0098a00640 1 --2- 172.21.15.99:0/625208253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940ce640 0x7f00940cead0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0094070e90 tx=0x7f008c02bee0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.392+0000 7f0098a00640 1 -- 172.21.15.99:0/625208253 shutdown_connections 2024-03-30T13:14:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.392+0000 7f0098a00640 1 --2- 172.21.15.99:0/625208253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940ce640 0x7f00940cead0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.392+0000 7f0098a00640 1 --2- 172.21.15.99:0/625208253 >> v2:172.21.15.181:3300/0 conn(0x7f00940ccad0 0x7f00940ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.392+0000 7f0098a00640 1 -- 172.21.15.99:0/625208253 >> 172.21.15.99:0/625208253 conn(0x7f00940b1db0 msgr2=0x7f00940b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:31.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.392+0000 7f0098a00640 1 -- 172.21.15.99:0/625208253 shutdown_connections 2024-03-30T13:14:31.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.392+0000 7f0098a00640 1 -- 172.21.15.99:0/625208253 wait complete. 2024-03-30T13:14:31.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.393+0000 7f0098a00640 1 Processor -- start 2024-03-30T13:14:31.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.394+0000 7f0098a00640 1 -- start start 2024-03-30T13:14:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.394+0000 7f0098a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940ccad0 0x7f00941f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.394+0000 7f0098a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f00940ce640 0x7f00940afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.394+0000 7f0098a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f009415c4d0 0x7f00940b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.394+0000 7f0098a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f00940ce120 con 0x7f00940ccad0 2024-03-30T13:14:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.394+0000 7f0098a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f009406f040 con 0x7f009415c4d0 2024-03-30T13:14:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.394+0000 7f0098a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f009415c8b0 con 0x7f00940ce640 2024-03-30T13:14:31.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.395+0000 7f0092800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940ccad0 0x7f00941f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.395+0000 7f0092800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940ccad0 0x7f00941f4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43982/0 (socket says 172.21.15.99:43982) 2024-03-30T13:14:31.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.395+0000 7f0092800640 1 -- 172.21.15.99:0/1484885147 learned_addr learned my addr 172.21.15.99:0/1484885147 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:31.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.395+0000 7f0092800640 1 -- 172.21.15.99:0/1484885147 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f00940ce640 msgr2=0x7f00940afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.395+0000 7f0092800640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f00940ce640 0x7f00940afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.395+0000 7f0092800640 1 -- 172.21.15.99:0/1484885147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f009415c4d0 msgr2=0x7f00940b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.395+0000 7f0092800640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f009415c4d0 0x7f00940b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.395+0000 7f0092800640 1 -- 172.21.15.99:0/1484885147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00941573b0 con 0x7f00940ccad0 2024-03-30T13:14:31.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.395+0000 7f0092800640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940ccad0 0x7f00941f4020 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f008400c440 tx=0x7f008400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:31.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.395+0000 7f008aa00640 1 -- 172.21.15.99:0/1484885147 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084017070 con 0x7f00940ccad0 2024-03-30T13:14:31.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.396+0000 7f008aa00640 1 -- 172.21.15.99:0/1484885147 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00840035f0 con 0x7f00940ccad0 2024-03-30T13:14:31.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.396+0000 7f0098a00640 1 -- 172.21.15.99:0/1484885147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0094157690 con 0x7f00940ccad0 2024-03-30T13:14:31.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.396+0000 7f008aa00640 1 -- 172.21.15.99:0/1484885147 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00840039e0 con 0x7f00940ccad0 2024-03-30T13:14:31.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.396+0000 7f0098a00640 1 -- 172.21.15.99:0/1484885147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0094157c50 con 0x7f00940ccad0 2024-03-30T13:14:31.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.397+0000 7f0098a00640 1 -- 172.21.15.99:0/1484885147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f009404f8f0 con 0x7f00940ccad0 2024-03-30T13:14:31.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.398+0000 7f008aa00640 1 -- 172.21.15.99:0/1484885147 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f008401a070 con 0x7f00940ccad0 2024-03-30T13:14:31.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.398+0000 7f008aa00640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f007406c530 0x7f007406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.399+0000 7f008aa00640 1 -- 172.21.15.99:0/1484885147 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f008408a850 con 0x7f00940ccad0 2024-03-30T13:14:31.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.399+0000 7f0091e00640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f007406c530 0x7f007406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.399+0000 7f008aa00640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] conn(0x7f00740723f0 0x7f0074074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.399+0000 7f008aa00640 1 -- 172.21.15.99:0/1484885147 --> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0084013e50 con 0x7f00740723f0 2024-03-30T13:14:31.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.399+0000 7f008aa00640 1 -- 172.21.15.99:0/1484885147 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f008408f2a0 con 0x7f00940ccad0 2024-03-30T13:14:31.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.399+0000 7f0093200640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] conn(0x7f00740723f0 0x7f0074074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.399+0000 7f0091e00640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f007406c530 0x7f007406e9f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f009406f970 tx=0x7f0080008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:31.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.400+0000 7f0093200640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] conn(0x7f00740723f0 0x7f0074074810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:31.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.400+0000 7f008aa00640 1 -- 172.21.15.99:0/1484885147 <== osd.0 v2:172.21.15.99:6820/4232364975 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0084013e50 con 0x7f00740723f0 2024-03-30T13:14:31.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.415+0000 7f0098a00640 1 -- 172.21.15.99:0/1484885147 --> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f00940cd0d0 con 0x7f00740723f0 2024-03-30T13:14:31.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.415+0000 7f008aa00640 1 -- 172.21.15.99:0/1484885147 <== osd.0 v2:172.21.15.99:6820/4232364975 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f00940cd0d0 con 0x7f00740723f0 2024-03-30T13:14:31.420 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:14:31.420 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:31.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.416+0000 7f0098a00640 1 -- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] conn(0x7f00740723f0 msgr2=0x7f0074074810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.416+0000 7f0098a00640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:6820/4232364975,v1:172.21.15.99:6822/4232364975] conn(0x7f00740723f0 0x7f0074074810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.416+0000 7f0098a00640 1 -- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f007406c530 msgr2=0x7f007406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.416+0000 7f0098a00640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f007406c530 0x7f007406e9f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f009406f970 tx=0x7f0080008040 comp rx=0 tx=0).stop 2024-03-30T13:14:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.416+0000 7f0098a00640 1 -- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940ccad0 msgr2=0x7f00941f4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.416+0000 7f0098a00640 1 --2- 172.21.15.99:0/1484885147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940ccad0 0x7f00941f4020 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f008400c440 tx=0x7f008400c900 comp rx=0 tx=0).stop 2024-03-30T13:14:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.416+0000 7f0093200640 1 -- 172.21.15.99:0/1484885147 reap_dead start 2024-03-30T13:14:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.416+0000 7f0098a00640 1 -- 172.21.15.99:0/1484885147 shutdown_connections 2024-03-30T13:14:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.416+0000 7f0098a00640 1 -- 172.21.15.99:0/1484885147 >> 172.21.15.99:0/1484885147 conn(0x7f00940b1db0 msgr2=0x7f00940b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.416+0000 7f0098a00640 1 -- 172.21.15.99:0/1484885147 shutdown_connections 2024-03-30T13:14:31.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.416+0000 7f0098a00640 1 -- 172.21.15.99:0/1484885147 wait complete. 2024-03-30T13:14:31.436 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-30T13:14:31.467 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:31.486 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:31.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.616+0000 7f4601a00640 1 Processor -- start 2024-03-30T13:14:31.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.616+0000 7f4601a00640 1 -- start start 2024-03-30T13:14:31.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.618+0000 7f4601a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f45fc1605e0 0x7f45fc0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.618+0000 7f4601a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc0ccb70 0x7f45fc0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.618+0000 7f4601a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45fc0cd4d0 con 0x7f45fc0c5020 2024-03-30T13:14:31.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.618+0000 7f4601a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f45fc0c5b80 con 0x7f45fc1605e0 2024-03-30T13:14:31.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.618+0000 7f4601a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f45fc0add40 con 0x7f45fc0ccb70 2024-03-30T13:14:31.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.618+0000 7f45fb400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f45fc0c5020 0x7f45fc0c5470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56896/0 (socket says 172.21.15.99:56896) 2024-03-30T13:14:31.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.618+0000 7f45fb400640 1 -- 172.21.15.99:0/1725220862 learned_addr learned my addr 172.21.15.99:0/1725220862 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:31.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.618+0000 7f45faa00640 1 --2- 172.21.15.99:0/1725220862 >> v2:172.21.15.181:3300/0 conn(0x7f45fc1605e0 0x7f45fc0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.618+0000 7f45fa000640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc0ccb70 0x7f45fc0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 363728403 0 0) 0x7f45fc0cd4d0 con 0x7f45fc0c5020 2024-03-30T13:14:31.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45e0003520 con 0x7f45fc0c5020 2024-03-30T13:14:31.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3538102010 0 0) 0x7f45e0003520 con 0x7f45fc0c5020 2024-03-30T13:14:31.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc0ccb70 msgr2=0x7f45fc0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc0ccb70 0x7f45fc0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 >> v2:172.21.15.181:3300/0 conn(0x7f45fc1605e0 msgr2=0x7f45fc0b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 --2- 172.21.15.99:0/1725220862 >> v2:172.21.15.181:3300/0 conn(0x7f45fc1605e0 0x7f45fc0b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc1609c0 con 0x7f45fc0c5020 2024-03-30T13:14:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f45f40019f0 con 0x7f45fc0c5020 2024-03-30T13:14:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 >> v1:172.21.15.99:6789/0 conn(0x7f45fc0c5020 legacy=0x7f45fc0c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc0ccb70 0x7f45e00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e0003f30 0x7f45e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc0c5b80 con 0x7f45e0004d40 2024-03-30T13:14:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc0add40 con 0x7f45e0003f30 2024-03-30T13:14:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f45e000ba10 con 0x7f45fc0ccb70 2024-03-30T13:14:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.619+0000 7f45fb400640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.620+0000 7f45fa000640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e0003f30 0x7f45e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.620+0000 7f45fb400640 1 -- 172.21.15.99:0/1725220862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc0ccb70 msgr2=0x7f45e00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.620+0000 7f45faa00640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc0ccb70 0x7f45e00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.620+0000 7f45fb400640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc0ccb70 0x7f45e00039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.620+0000 7f45fb400640 1 -- 172.21.15.99:0/1725220862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e0003f30 msgr2=0x7f45e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.620+0000 7f45fb400640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e0003f30 0x7f45e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.620+0000 7f45fb400640 1 -- 172.21.15.99:0/1725220862 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e0003520 con 0x7f45e0004d40 2024-03-30T13:14:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.621+0000 7f45fb400640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f45f400a8d0 tx=0x7f45e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ee53311976d4a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.621+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f400a4c0 con 0x7f45e0004d40 2024-03-30T13:14:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.621+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f4034650 con 0x7f45e0004d40 2024-03-30T13:14:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.621+0000 7f45f9600640 1 -- 172.21.15.99:0/1725220862 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4034a80 con 0x7f45e0004d40 2024-03-30T13:14:31.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.622+0000 7f4601a00640 1 -- 172.21.15.99:0/1725220862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45e0004d40 msgr2=0x7f45e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.622+0000 7f4601a00640 1 --2- 172.21.15.99:0/1725220862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f45f400a8d0 tx=0x7f45e0005830 comp rx=0 tx=0).stop 2024-03-30T13:14:31.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.622+0000 7f45fb400640 1 -- 172.21.15.99:0/1725220862 reap_dead start 2024-03-30T13:14:31.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.622+0000 7f4601a00640 1 -- 172.21.15.99:0/1725220862 shutdown_connections 2024-03-30T13:14:31.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.622+0000 7f4601a00640 1 -- 172.21.15.99:0/1725220862 >> 172.21.15.99:0/1725220862 conn(0x7f45fc06b510 msgr2=0x7f45fc06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:31.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.622+0000 7f4601a00640 1 -- 172.21.15.99:0/1725220862 shutdown_connections 2024-03-30T13:14:31.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.622+0000 7f4601a00640 1 -- 172.21.15.99:0/1725220862 wait complete. 2024-03-30T13:14:31.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.624+0000 7f4601a00640 1 Processor -- start 2024-03-30T13:14:31.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.624+0000 7f4601a00640 1 -- start start 2024-03-30T13:14:31.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.625+0000 7f4601a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc15e7f0 0x7f45fc0b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.625+0000 7f4601a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45fc15ebd0 0x7f45fc0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.625+0000 7f4601a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45fc0cf230 0x7f45fc0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.625+0000 7f4601a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc0ad6f0 con 0x7f45fc15ebd0 2024-03-30T13:14:31.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.625+0000 7f4601a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc0ad410 con 0x7f45fc0cf230 2024-03-30T13:14:31.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.625+0000 7f4601a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f45fc0ad9d0 con 0x7f45fc15e7f0 2024-03-30T13:14:31.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.625+0000 7f45fa000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45fc15ebd0 0x7f45fc0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.625+0000 7f45fa000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45fc15ebd0 0x7f45fc0b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44008/0 (socket says 172.21.15.99:44008) 2024-03-30T13:14:31.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.625+0000 7f45fa000640 1 -- 172.21.15.99:0/2235131039 learned_addr learned my addr 172.21.15.99:0/2235131039 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:31.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f45fb400640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45fc0cf230 0x7f45fc0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f45faa00640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc15e7f0 0x7f45fc0b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f45fa000640 1 -- 172.21.15.99:0/2235131039 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc15e7f0 msgr2=0x7f45fc0b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f45fa000640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc15e7f0 0x7f45fc0b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f45fa000640 1 -- 172.21.15.99:0/2235131039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45fc0cf230 msgr2=0x7f45fc0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f45fa000640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45fc0cf230 0x7f45fc0cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f45fa000640 1 -- 172.21.15.99:0/2235131039 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc163f60 con 0x7f45fc15ebd0 2024-03-30T13:14:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f45fa000640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45fc15ebd0 0x7f45fc0b0d90 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f45e8011570 tx=0x7f45e8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f45f2a00640 1 -- 172.21.15.99:0/2235131039 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8015930 con 0x7f45fc15ebd0 2024-03-30T13:14:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f45f2a00640 1 -- 172.21.15.99:0/2235131039 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e8015ad0 con 0x7f45fc15ebd0 2024-03-30T13:14:31.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f45f2a00640 1 -- 172.21.15.99:0/2235131039 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e800f460 con 0x7f45fc15ebd0 2024-03-30T13:14:31.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.626+0000 7f4601a00640 1 -- 172.21.15.99:0/2235131039 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc1631a0 con 0x7f45fc15ebd0 2024-03-30T13:14:31.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.627+0000 7f4601a00640 1 -- 172.21.15.99:0/2235131039 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc163760 con 0x7f45fc15ebd0 2024-03-30T13:14:31.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.628+0000 7f4601a00640 1 -- 172.21.15.99:0/2235131039 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc068640 con 0x7f45fc15ebd0 2024-03-30T13:14:31.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.628+0000 7f45f2a00640 1 -- 172.21.15.99:0/2235131039 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f45e800f600 con 0x7f45fc15ebd0 2024-03-30T13:14:31.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.629+0000 7f45f2a00640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f45dc06c560 0x7f45dc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:31.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.629+0000 7f45f2a00640 1 -- 172.21.15.99:0/2235131039 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f45e808bd10 con 0x7f45fc15ebd0 2024-03-30T13:14:31.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.630+0000 7f45faa00640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f45dc06c560 0x7f45dc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:31.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.630+0000 7f45faa00640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f45dc06c560 0x7f45dc06ea20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009990 tx=0x7f45ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:31.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.634+0000 7f45f2a00640 1 -- 172.21.15.99:0/2235131039 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f45e8091020 con 0x7f45fc15ebd0 2024-03-30T13:14:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.831+0000 7f4601a00640 1 -- 172.21.15.99:0/2235131039 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f45fc0998a0 con 0x7f45dc06c560 2024-03-30T13:14:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.832+0000 7f45f2a00640 1 -- 172.21.15.99:0/2235131039 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f45fc0998a0 con 0x7f45dc06c560 2024-03-30T13:14:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 0 to deep-scrub 2024-03-30T13:14:31.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.834+0000 7f4601a00640 1 -- 172.21.15.99:0/2235131039 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f45dc06c560 msgr2=0x7f45dc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.834+0000 7f4601a00640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f45dc06c560 0x7f45dc06ea20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009990 tx=0x7f45ec008040 comp rx=0 tx=0).stop 2024-03-30T13:14:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.834+0000 7f4601a00640 1 -- 172.21.15.99:0/2235131039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45fc15ebd0 msgr2=0x7f45fc0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.834+0000 7f4601a00640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45fc15ebd0 0x7f45fc0b0d90 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f45e8011570 tx=0x7f45e8011a30 comp rx=0 tx=0).stop 2024-03-30T13:14:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.834+0000 7f4601a00640 1 -- 172.21.15.99:0/2235131039 shutdown_connections 2024-03-30T13:14:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.834+0000 7f4601a00640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f45dc06c560 0x7f45dc06ea20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.834+0000 7f4601a00640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45fc0cf230 0x7f45fc0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.834+0000 7f4601a00640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45fc15ebd0 0x7f45fc0b0d90 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.834+0000 7f4601a00640 1 --2- 172.21.15.99:0/2235131039 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45fc15e7f0 0x7f45fc0b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.834+0000 7f4601a00640 1 -- 172.21.15.99:0/2235131039 >> 172.21.15.99:0/2235131039 conn(0x7f45fc06b510 msgr2=0x7f45fc06d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:31.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.835+0000 7f4601a00640 1 -- 172.21.15.99:0/2235131039 shutdown_connections 2024-03-30T13:14:31.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:31.835+0000 7f4601a00640 1 -- 172.21.15.99:0/2235131039 wait complete. 2024-03-30T13:14:31.857 INFO:tasks.ceph:Scrubbing osd.1 2024-03-30T13:14:31.858 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:14:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.111+0000 7fb7d8600640 1 Processor -- start 2024-03-30T13:14:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.111+0000 7fb7d8600640 1 -- start start 2024-03-30T13:14:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.112+0000 7fb7d8600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb7d015ab00 0x7fb7d00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.112+0000 7fb7d8600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7d00ad660 con 0x7fb7d0072870 2024-03-30T13:14:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.112+0000 7fb7d8600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7d00b4ab0 con 0x7fb7d015e7b0 2024-03-30T13:14:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.112+0000 7fb7d8600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d006d860 con 0x7fb7d015ab00 2024-03-30T13:14:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.113+0000 7fb7d6600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb7d0072870 0x7fb7d006e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56906/0 (socket says 172.21.15.99:56906) 2024-03-30T13:14:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.113+0000 7fb7d6600640 1 -- 172.21.15.99:0/2117321344 learned_addr learned my addr 172.21.15.99:0/2117321344 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.113+0000 7fb7d5c00640 1 --2- 172.21.15.99:0/2117321344 >> v2:172.21.15.181:3300/0 conn(0x7fb7d015ab00 0x7fb7d00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.113+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1012235608 0 0) 0x7fb7c8001490 con 0x7fb7d0072870 2024-03-30T13:14:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.113+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7b8005730 con 0x7fb7d0072870 2024-03-30T13:14:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3418804176 0 0) 0x7fb7b8005730 con 0x7fb7d0072870 2024-03-30T13:14:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 >> v2:172.21.15.181:3300/0 conn(0x7fb7d015ab00 msgr2=0x7fb7d00b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 --2- 172.21.15.99:0/2117321344 >> v2:172.21.15.181:3300/0 conn(0x7fb7d015ab00 0x7fb7d00b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 >> v1:172.21.15.181:6789/0 conn(0x7fb7d015e7b0 legacy=0x7fb7d006dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d00b4d90 con 0x7fb7d0072870 2024-03-30T13:14:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7fb7c8001bc0 con 0x7fb7d0072870 2024-03-30T13:14:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 >> v1:172.21.15.99:6789/0 conn(0x7fb7d0072870 legacy=0x7fb7d006e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 --2- 172.21.15.99:0/2117321344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7b8005bc0 0x7fb7b8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 --2- 172.21.15.99:0/2117321344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7b8006a10 0x7fb7b8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 --2- 172.21.15.99:0/2117321344 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7b80073d0 0x7fb7b800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d006d860 con 0x7fb7b8006a10 2024-03-30T13:14:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b800e370 con 0x7fb7b8005bc0 2024-03-30T13:14:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b800e570 con 0x7fb7b80073d0 2024-03-30T13:14:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.114+0000 7fb7d5200640 1 --2- 172.21.15.99:0/2117321344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7b8006a10 0x7fb7b8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.115+0000 7fb7d5c00640 1 --2- 172.21.15.99:0/2117321344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7b8005bc0 0x7fb7b8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.115+0000 7fb7d5200640 1 -- 172.21.15.99:0/2117321344 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7b80073d0 msgr2=0x7fb7b800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.115+0000 7fb7d5200640 1 --2- 172.21.15.99:0/2117321344 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7b80073d0 0x7fb7b800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.115+0000 7fb7d5200640 1 -- 172.21.15.99:0/2117321344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7b8005bc0 msgr2=0x7fb7b8005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:32.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.115+0000 7fb7d5200640 1 --2- 172.21.15.99:0/2117321344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7b8005bc0 0x7fb7b8005fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.115+0000 7fb7d5200640 1 -- 172.21.15.99:0/2117321344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b8005730 con 0x7fb7b8006a10 2024-03-30T13:14:32.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.115+0000 7fb7d6600640 1 -- 172.21.15.99:0/2117321344 reap_dead start 2024-03-30T13:14:32.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.116+0000 7fb7d5200640 1 --2- 172.21.15.99:0/2117321344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7b8006a10 0x7fb7b8006e90 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc001750 tx=0x7fb7b8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a58ca676d79c67 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:32.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.116+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc001370 con 0x7fb7b8006a10 2024-03-30T13:14:32.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.116+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7bc0052d0 con 0x7fb7b8006a10 2024-03-30T13:14:32.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.116+0000 7fb7cfe00640 1 -- 172.21.15.99:0/2117321344 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc003830 con 0x7fb7b8006a10 2024-03-30T13:14:32.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.116+0000 7fb7d8600640 1 -- 172.21.15.99:0/2117321344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7b8006a10 msgr2=0x7fb7b8006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.116+0000 7fb7d8600640 1 --2- 172.21.15.99:0/2117321344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7b8006a10 0x7fb7b8006e90 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc001750 tx=0x7fb7b8007a40 comp rx=0 tx=0).stop 2024-03-30T13:14:32.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.117+0000 7fb7d8600640 1 -- 172.21.15.99:0/2117321344 shutdown_connections 2024-03-30T13:14:32.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.117+0000 7fb7d8600640 1 --2- 172.21.15.99:0/2117321344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7b8006a10 0x7fb7b8006e90 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.117+0000 7fb7d8600640 1 -- 172.21.15.99:0/2117321344 >> 172.21.15.99:0/2117321344 conn(0x7fb7d006b6f0 msgr2=0x7fb7d006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:32.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.117+0000 7fb7d8600640 1 -- 172.21.15.99:0/2117321344 shutdown_connections 2024-03-30T13:14:32.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.117+0000 7fb7d8600640 1 -- 172.21.15.99:0/2117321344 wait complete. 2024-03-30T13:14:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.118+0000 7fb7d8600640 1 Processor -- start 2024-03-30T13:14:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.118+0000 7fb7d8600640 1 -- start start 2024-03-30T13:14:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.119+0000 7fb7d8600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7b8006a10 0x7fb7d00cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.119+0000 7fb7d8600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d00cb740 0x7fb7d00ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.119+0000 7fb7d8600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7d01f5760 0x7fb7d00aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.119+0000 7fb7d8600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d015aee0 con 0x7fb7d00cb740 2024-03-30T13:14:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.119+0000 7fb7d8600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d006db40 con 0x7fb7b8006a10 2024-03-30T13:14:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.119+0000 7fb7d8600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d015b060 con 0x7fb7d01f5760 2024-03-30T13:14:32.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.120+0000 7fb7d5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d00cb740 0x7fb7d00ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.120+0000 7fb7d5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d00cb740 0x7fb7d00ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44016/0 (socket says 172.21.15.99:44016) 2024-03-30T13:14:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.120+0000 7fb7d5200640 1 -- 172.21.15.99:0/2783700602 learned_addr learned my addr 172.21.15.99:0/2783700602 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.120+0000 7fb7d5c00640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7b8006a10 0x7fb7d00cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.120+0000 7fb7d5200640 1 -- 172.21.15.99:0/2783700602 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7d01f5760 msgr2=0x7fb7d00aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.120+0000 7fb7d5200640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7d01f5760 0x7fb7d00aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.120+0000 7fb7d5200640 1 -- 172.21.15.99:0/2783700602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7b8006a10 msgr2=0x7fb7d00cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.120+0000 7fb7d5200640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7b8006a10 0x7fb7d00cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.120+0000 7fb7d5200640 1 -- 172.21.15.99:0/2783700602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d01f61f0 con 0x7fb7d00cb740 2024-03-30T13:14:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.121+0000 7fb7d5200640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d00cb740 0x7fb7d00ce470 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc005040 tx=0x7fb7bc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.121+0000 7fb7cd600640 1 -- 172.21.15.99:0/2783700602 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc041070 con 0x7fb7d00cb740 2024-03-30T13:14:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.121+0000 7fb7cd600640 1 -- 172.21.15.99:0/2783700602 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7bc005480 con 0x7fb7d00cb740 2024-03-30T13:14:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.121+0000 7fb7cd600640 1 -- 172.21.15.99:0/2783700602 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc001370 con 0x7fb7d00cb740 2024-03-30T13:14:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.121+0000 7fb7d8600640 1 -- 172.21.15.99:0/2783700602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d01f6490 con 0x7fb7d00cb740 2024-03-30T13:14:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.121+0000 7fb7d8600640 1 -- 172.21.15.99:0/2783700602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d01f6a50 con 0x7fb7d00cb740 2024-03-30T13:14:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.122+0000 7fb7d8600640 1 -- 172.21.15.99:0/2783700602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7d0068640 con 0x7fb7d00cb740 2024-03-30T13:14:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.123+0000 7fb7cd600640 1 -- 172.21.15.99:0/2783700602 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb7bc044070 con 0x7fb7d00cb740 2024-03-30T13:14:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.124+0000 7fb7cd600640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7b006c530 0x7fb7b006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.124+0000 7fb7cd600640 1 -- 172.21.15.99:0/2783700602 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7fb7bc0ace00 con 0x7fb7d00cb740 2024-03-30T13:14:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.124+0000 7fb7cd600640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] conn(0x7fb7b00723f0 0x7fb7b0074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.124+0000 7fb7cd600640 1 -- 172.21.15.99:0/2783700602 --> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7bc0052d0 con 0x7fb7b00723f0 2024-03-30T13:14:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.124+0000 7fb7cd600640 1 -- 172.21.15.99:0/2783700602 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fb7bc0af500 con 0x7fb7d00cb740 2024-03-30T13:14:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.124+0000 7fb7d5c00640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7b006c530 0x7fb7b006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.125+0000 7fb7d6600640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] conn(0x7fb7b00723f0 0x7fb7b0074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.125+0000 7fb7d5c00640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7b006c530 0x7fb7b006e9f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00afc50 tx=0x7fb7c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.125+0000 7fb7d6600640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] conn(0x7fb7b00723f0 0x7fb7b0074810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.126+0000 7fb7cd600640 1 -- 172.21.15.99:0/2783700602 <== osd.1 v2:172.21.15.99:6818/3090465725 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7bc0052d0 con 0x7fb7b00723f0 2024-03-30T13:14:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.140+0000 7fb7d8600640 1 -- 172.21.15.99:0/2783700602 --> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb7d00b3520 con 0x7fb7b00723f0 2024-03-30T13:14:32.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.141+0000 7fb7cd600640 1 -- 172.21.15.99:0/2783700602 <== osd.1 v2:172.21.15.99:6818/3090465725 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb7d00b3520 con 0x7fb7b00723f0 2024-03-30T13:14:32.145 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:32.146 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:14:32.146 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.141+0000 7fb7d8600640 1 -- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] conn(0x7fb7b00723f0 msgr2=0x7fb7b0074810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.141+0000 7fb7d8600640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:6818/3090465725,v1:172.21.15.99:6819/3090465725] conn(0x7fb7b00723f0 0x7fb7b0074810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.141+0000 7fb7d8600640 1 -- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7b006c530 msgr2=0x7fb7b006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.141+0000 7fb7d8600640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fb7b006c530 0x7fb7b006e9f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00afc50 tx=0x7fb7c4008040 comp rx=0 tx=0).stop 2024-03-30T13:14:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.141+0000 7fb7d8600640 1 -- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d00cb740 msgr2=0x7fb7d00ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.141+0000 7fb7d8600640 1 --2- 172.21.15.99:0/2783700602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7d00cb740 0x7fb7d00ce470 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc005040 tx=0x7fb7bc001120 comp rx=0 tx=0).stop 2024-03-30T13:14:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.141+0000 7fb7d6600640 1 -- 172.21.15.99:0/2783700602 reap_dead start 2024-03-30T13:14:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.142+0000 7fb7d8600640 1 -- 172.21.15.99:0/2783700602 shutdown_connections 2024-03-30T13:14:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.142+0000 7fb7d8600640 1 -- 172.21.15.99:0/2783700602 >> 172.21.15.99:0/2783700602 conn(0x7fb7d006b6f0 msgr2=0x7fb7d0155760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.142+0000 7fb7d8600640 1 -- 172.21.15.99:0/2783700602 shutdown_connections 2024-03-30T13:14:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.142+0000 7fb7d8600640 1 -- 172.21.15.99:0/2783700602 wait complete. 2024-03-30T13:14:32.164 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-30T13:14:32.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.368+0000 7f94c3c00640 1 Processor -- start 2024-03-30T13:14:32.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.368+0000 7f94c3c00640 1 -- start start 2024-03-30T13:14:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.370+0000 7f94c3c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c6850 0x7f94bc0cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.370+0000 7f94c3c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94bc160480 con 0x7f94bc15fc20 2024-03-30T13:14:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.370+0000 7f94c3c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94bc160760 con 0x7f94bc0c5020 2024-03-30T13:14:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.370+0000 7f94c3c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f94bc161090 con 0x7f94bc0c6850 2024-03-30T13:14:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.370+0000 7f94c1200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f94bc15fc20 0x7f94bc0c6140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56916/0 (socket says 172.21.15.99:56916) 2024-03-30T13:14:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.370+0000 7f94c1200640 1 -- 172.21.15.99:0/1175946244 learned_addr learned my addr 172.21.15.99:0/1175946244 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.370+0000 7f94bbe00640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c6850 0x7f94bc0cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.370+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052900979 0 0) 0x7f94bc160480 con 0x7f94bc15fc20 2024-03-30T13:14:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94a4003520 con 0x7f94bc15fc20 2024-03-30T13:14:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2654771478 0 0) 0x7f94a4003520 con 0x7f94bc15fc20 2024-03-30T13:14:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c6850 msgr2=0x7f94bc0cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c6850 0x7f94bc0cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 >> v1:172.21.15.181:6789/0 conn(0x7f94bc0c5020 legacy=0x7f94bc0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc160a40 con 0x7f94bc15fc20 2024-03-30T13:14:32.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f94b0001670 con 0x7f94bc15fc20 2024-03-30T13:14:32.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bbe00640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c6850 0x7f94bc0cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:32.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 >> v1:172.21.15.99:6789/0 conn(0x7f94bc15fc20 legacy=0x7f94bc0c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 0x7f94a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94a4004800 0x7f94a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c6850 0x7f94a40052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc161090 con 0x7f94a40039e0 2024-03-30T13:14:32.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f94a400bba0 con 0x7f94a4004800 2024-03-30T13:14:32.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f94a400bda0 con 0x7f94bc0c6850 2024-03-30T13:14:32.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.371+0000 7f94c1200640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 0x7f94a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.372+0000 7f94bbe00640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94a4004800 0x7f94a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.372+0000 7f94c1200640 1 -- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c6850 msgr2=0x7f94a40052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:32.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.372+0000 7f94c1c00640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c6850 0x7f94a40052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.372+0000 7f94c1200640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c6850 0x7f94a40052b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.372+0000 7f94c1200640 1 -- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94a4004800 msgr2=0x7f94a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.372+0000 7f94c1200640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94a4004800 0x7f94a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.372+0000 7f94c1200640 1 -- 172.21.15.99:0/1175946244 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a4003520 con 0x7f94a40039e0 2024-03-30T13:14:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.373+0000 7f94c1200640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 0x7f94a4003e00 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c190 tx=0x7f94a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7c716f6a063e32 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.373+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0007c60 con 0x7f94a40039e0 2024-03-30T13:14:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.373+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b0030070 con 0x7f94a40039e0 2024-03-30T13:14:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.373+0000 7f94bb400640 1 -- 172.21.15.99:0/1175946244 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0005d50 con 0x7f94a40039e0 2024-03-30T13:14:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.374+0000 7f94c3c00640 1 -- 172.21.15.99:0/1175946244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 msgr2=0x7f94a4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.374+0000 7f94c3c00640 1 --2- 172.21.15.99:0/1175946244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 0x7f94a4003e00 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c190 tx=0x7f94a4005830 comp rx=0 tx=0).stop 2024-03-30T13:14:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.374+0000 7f94c1c00640 1 -- 172.21.15.99:0/1175946244 reap_dead start 2024-03-30T13:14:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.374+0000 7f94c3c00640 1 -- 172.21.15.99:0/1175946244 shutdown_connections 2024-03-30T13:14:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.374+0000 7f94c3c00640 1 -- 172.21.15.99:0/1175946244 >> 172.21.15.99:0/1175946244 conn(0x7f94bc06b510 msgr2=0x7f94bc06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.374+0000 7f94c3c00640 1 -- 172.21.15.99:0/1175946244 shutdown_connections 2024-03-30T13:14:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.374+0000 7f94c3c00640 1 -- 172.21.15.99:0/1175946244 wait complete. 2024-03-30T13:14:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.376+0000 7f94c3c00640 1 Processor -- start 2024-03-30T13:14:32.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.376+0000 7f94c3c00640 1 -- start start 2024-03-30T13:14:32.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.377+0000 7f94c3c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 0x7f94bc06e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.377+0000 7f94c3c00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c9b10 0x7f94bc15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.377+0000 7f94c3c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94bc06eed0 0x7f94bc0cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.377+0000 7f94c3c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc160260 con 0x7f94a40039e0 2024-03-30T13:14:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.377+0000 7f94c3c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc1600e0 con 0x7f94bc06eed0 2024-03-30T13:14:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.377+0000 7f94c3c00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f94bc0b4b20 con 0x7f94bc0c9b10 2024-03-30T13:14:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.377+0000 7f94c1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 0x7f94bc06e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.377+0000 7f94c1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 0x7f94bc06e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44044/0 (socket says 172.21.15.99:44044) 2024-03-30T13:14:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.377+0000 7f94c1200640 1 -- 172.21.15.99:0/2298770696 learned_addr learned my addr 172.21.15.99:0/2298770696 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94c1c00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94bc06eed0 0x7f94bc0cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94c1200640 1 -- 172.21.15.99:0/2298770696 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c9b10 msgr2=0x7f94bc15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94bbe00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c9b10 0x7f94bc15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94c1200640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c9b10 0x7f94bc15cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94c1200640 1 -- 172.21.15.99:0/2298770696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94bc06eed0 msgr2=0x7f94bc0cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94c1200640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94bc06eed0 0x7f94bc0cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94c1200640 1 -- 172.21.15.99:0/2298770696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc0cdd30 con 0x7f94a40039e0 2024-03-30T13:14:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94c1c00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94bc06eed0 0x7f94bc0cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94c1200640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 0x7f94bc06e990 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c190 tx=0x7f94b0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94b8c00640 1 -- 172.21.15.99:0/2298770696 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0045070 con 0x7f94a40039e0 2024-03-30T13:14:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94b8c00640 1 -- 172.21.15.99:0/2298770696 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b00049f0 con 0x7f94a40039e0 2024-03-30T13:14:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94c3c00640 1 -- 172.21.15.99:0/2298770696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94bc15bd10 con 0x7f94a40039e0 2024-03-30T13:14:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.378+0000 7f94b8c00640 1 -- 172.21.15.99:0/2298770696 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0007c60 con 0x7f94a40039e0 2024-03-30T13:14:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.379+0000 7f94c3c00640 1 -- 172.21.15.99:0/2298770696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94bc0ce5b0 con 0x7f94a40039e0 2024-03-30T13:14:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.380+0000 7f94c3c00640 1 -- 172.21.15.99:0/2298770696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94bc06f690 con 0x7f94a40039e0 2024-03-30T13:14:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.381+0000 7f94b8c00640 1 -- 172.21.15.99:0/2298770696 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f94b0007070 con 0x7f94a40039e0 2024-03-30T13:14:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.382+0000 7f94b8c00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f949c06c530 0x7f949c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.382+0000 7f94b8c00640 1 -- 172.21.15.99:0/2298770696 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f94b00ac100 con 0x7f94a40039e0 2024-03-30T13:14:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.382+0000 7f94bbe00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f949c06c530 0x7f949c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.383+0000 7f94bbe00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f949c06c530 0x7f949c06e9f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0ca330 tx=0x7f94a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:32.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.387+0000 7f94b8c00640 1 -- 172.21.15.99:0/2298770696 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f94bc06f690 con 0x7f94a40039e0 2024-03-30T13:14:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.586+0000 7f94c3c00640 1 -- 172.21.15.99:0/2298770696 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f94bc068640 con 0x7f949c06c530 2024-03-30T13:14:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.587+0000 7f94b8c00640 1 -- 172.21.15.99:0/2298770696 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f94bc068640 con 0x7f949c06c530 2024-03-30T13:14:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 1 to deep-scrub 2024-03-30T13:14:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.589+0000 7f94c3c00640 1 -- 172.21.15.99:0/2298770696 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f949c06c530 msgr2=0x7f949c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.589+0000 7f94c3c00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f949c06c530 0x7f949c06e9f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0ca330 tx=0x7f94a8008040 comp rx=0 tx=0).stop 2024-03-30T13:14:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.589+0000 7f94c3c00640 1 -- 172.21.15.99:0/2298770696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 msgr2=0x7f94bc06e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.589+0000 7f94c3c00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 0x7f94bc06e990 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c190 tx=0x7f94b0001970 comp rx=0 tx=0).stop 2024-03-30T13:14:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.589+0000 7f94c3c00640 1 -- 172.21.15.99:0/2298770696 shutdown_connections 2024-03-30T13:14:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.589+0000 7f94c3c00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f949c06c530 0x7f949c06e9f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.589+0000 7f94c3c00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94bc06eed0 0x7f94bc0cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.589+0000 7f94c3c00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94bc0c9b10 0x7f94bc15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.589+0000 7f94c3c00640 1 --2- 172.21.15.99:0/2298770696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94a40039e0 0x7f94bc06e990 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.589+0000 7f94c3c00640 1 -- 172.21.15.99:0/2298770696 >> 172.21.15.99:0/2298770696 conn(0x7f94bc06b510 msgr2=0x7f94bc0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.590+0000 7f94c3c00640 1 -- 172.21.15.99:0/2298770696 shutdown_connections 2024-03-30T13:14:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.590+0000 7f94c3c00640 1 -- 172.21.15.99:0/2298770696 wait complete. 2024-03-30T13:14:32.612 INFO:tasks.ceph:Scrubbing osd.2 2024-03-30T13:14:32.612 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:14:32.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.822+0000 7f9059400640 1 Processor -- start 2024-03-30T13:14:32.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.823+0000 7f9059400640 1 -- start start 2024-03-30T13:14:32.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.824+0000 7f9059400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f905415d630 0x7f90540d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.824+0000 7f9059400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f90540d09d0 0x7f9054160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.824+0000 7f9059400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905406e300 con 0x7f9054156ba0 2024-03-30T13:14:32.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.824+0000 7f9059400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f905406e5e0 con 0x7f90540d09d0 2024-03-30T13:14:32.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.824+0000 7f9059400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f905415ce50 con 0x7f905415d630 2024-03-30T13:14:32.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.824+0000 7f9049e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f905415d630 0x7f90540d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.825+0000 7f9053200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f90540d09d0 0x7f9054160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.825+0000 7f9049e00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f905415d630 0x7f90540d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:38090/0 (socket says 172.21.15.99:38090) 2024-03-30T13:14:32.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.825+0000 7f9049e00640 1 -- 172.21.15.99:0/2013889857 learned_addr learned my addr 172.21.15.99:0/2013889857 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:32.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.825+0000 7f9049e00640 1 -- 172.21.15.99:0/2013889857 >> v2:172.21.15.181:3300/0 conn(0x7f90540d09d0 msgr2=0x7f9054160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:32.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.825+0000 7f9049e00640 1 --2- 172.21.15.99:0/2013889857 >> v2:172.21.15.181:3300/0 conn(0x7f90540d09d0 0x7f9054160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.825+0000 7f9049e00640 1 -- 172.21.15.99:0/2013889857 >> v1:172.21.15.181:6789/0 conn(0x7f9054156ba0 legacy=0x7f905406d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.825+0000 7f9049e00640 1 -- 172.21.15.99:0/2013889857 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905415d130 con 0x7f905415d630 2024-03-30T13:14:32.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.827+0000 7f9049e00640 1 --2- 172.21.15.99:0/2013889857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f905415d630 0x7f90540d0490 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f903c009e50 tx=0x7f903c02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f835af8038574d62 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:32.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.827+0000 7f9051e00640 1 -- 172.21.15.99:0/2013889857 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c02ca70 con 0x7f905415d630 2024-03-30T13:14:32.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.827+0000 7f9051e00640 1 -- 172.21.15.99:0/2013889857 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c02cc10 con 0x7f905415d630 2024-03-30T13:14:32.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.827+0000 7f9051e00640 1 -- 172.21.15.99:0/2013889857 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0343f0 con 0x7f905415d630 2024-03-30T13:14:32.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.828+0000 7f9059400640 1 -- 172.21.15.99:0/2013889857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f905415d630 msgr2=0x7f90540d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.828+0000 7f9059400640 1 --2- 172.21.15.99:0/2013889857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f905415d630 0x7f90540d0490 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f903c009e50 tx=0x7f903c02bed0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.828+0000 7f9059400640 1 -- 172.21.15.99:0/2013889857 shutdown_connections 2024-03-30T13:14:32.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.828+0000 7f9059400640 1 --2- 172.21.15.99:0/2013889857 >> v2:172.21.15.181:3300/0 conn(0x7f90540d09d0 0x7f9054160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.828+0000 7f9059400640 1 --2- 172.21.15.99:0/2013889857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f905415d630 0x7f90540d0490 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.828+0000 7f9059400640 1 -- 172.21.15.99:0/2013889857 >> 172.21.15.99:0/2013889857 conn(0x7f905406b6f0 msgr2=0x7f905406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:32.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.828+0000 7f9059400640 1 -- 172.21.15.99:0/2013889857 shutdown_connections 2024-03-30T13:14:32.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.828+0000 7f9059400640 1 -- 172.21.15.99:0/2013889857 wait complete. 2024-03-30T13:14:32.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.830+0000 7f9059400640 1 Processor -- start 2024-03-30T13:14:32.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.830+0000 7f9059400640 1 -- start start 2024-03-30T13:14:32.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9059400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90540d09d0 0x7f90540b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9059400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9054156ba0 0x7f905415b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9059400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f905415d630 0x7f905415bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9059400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f90540ad3d0 con 0x7f9054156ba0 2024-03-30T13:14:32.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9059400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f905415dac0 con 0x7f905415d630 2024-03-30T13:14:32.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9059400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f9054156f80 con 0x7f90540d09d0 2024-03-30T13:14:32.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9049e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9054156ba0 0x7f905415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9049e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9054156ba0 0x7f905415b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44048/0 (socket says 172.21.15.99:44048) 2024-03-30T13:14:32.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9049e00640 1 -- 172.21.15.99:0/1616161297 learned_addr learned my addr 172.21.15.99:0/1616161297 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:32.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9053200640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f905415d630 0x7f905415bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9052800640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90540d09d0 0x7f90540b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9049e00640 1 -- 172.21.15.99:0/1616161297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90540d09d0 msgr2=0x7f90540b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9049e00640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90540d09d0 0x7f90540b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9049e00640 1 -- 172.21.15.99:0/1616161297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f905415d630 msgr2=0x7f905415bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9049e00640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f905415d630 0x7f905415bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.831+0000 7f9049e00640 1 -- 172.21.15.99:0/1616161297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9054072700 con 0x7f9054156ba0 2024-03-30T13:14:32.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.832+0000 7f9049e00640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9054156ba0 0x7f905415b620 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f903c02c4e0 tx=0x7f903c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:32.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.832+0000 7f904b400640 1 -- 172.21.15.99:0/1616161297 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c044020 con 0x7f9054156ba0 2024-03-30T13:14:32.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.832+0000 7f904b400640 1 -- 172.21.15.99:0/1616161297 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c040670 con 0x7f9054156ba0 2024-03-30T13:14:32.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.832+0000 7f904b400640 1 -- 172.21.15.99:0/1616161297 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c009510 con 0x7f9054156ba0 2024-03-30T13:14:32.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.832+0000 7f9059400640 1 -- 172.21.15.99:0/1616161297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90540729e0 con 0x7f9054156ba0 2024-03-30T13:14:32.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.832+0000 7f9059400640 1 -- 172.21.15.99:0/1616161297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9054072fa0 con 0x7f9054156ba0 2024-03-30T13:14:32.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.833+0000 7f9059400640 1 -- 172.21.15.99:0/1616161297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9054068640 con 0x7f9054156ba0 2024-03-30T13:14:32.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.834+0000 7f904b400640 1 -- 172.21.15.99:0/1616161297 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f903c047020 con 0x7f9054156ba0 2024-03-30T13:14:32.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.835+0000 7f904b400640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f903006c530 0x7f903006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.835+0000 7f904b400640 1 -- 172.21.15.99:0/1616161297 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f903c0add90 con 0x7f9054156ba0 2024-03-30T13:14:32.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.835+0000 7f9052800640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f903006c530 0x7f903006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.835+0000 7f904b400640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] conn(0x7f90300723f0 0x7f9030074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:32.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.835+0000 7f904b400640 1 -- 172.21.15.99:0/1616161297 --> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9030074ec0 con 0x7f90300723f0 2024-03-30T13:14:32.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.835+0000 7f904b400640 1 -- 172.21.15.99:0/1616161297 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f903c0b0430 con 0x7f9054156ba0 2024-03-30T13:14:32.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.836+0000 7f9053200640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] conn(0x7f90300723f0 0x7f9030074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:32.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.836+0000 7f9052800640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f903006c530 0x7f903006e9f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9044001640 tx=0x7f9044009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:32.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.836+0000 7f9053200640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] conn(0x7f90300723f0 0x7f9030074810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:32.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.837+0000 7f904b400640 1 -- 172.21.15.99:0/1616161297 <== osd.2 v2:172.21.15.99:6806/1541384038 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9030074ec0 con 0x7f90300723f0 2024-03-30T13:14:32.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.852+0000 7f9059400640 1 -- 172.21.15.99:0/1616161297 --> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f905406d9d0 con 0x7f90300723f0 2024-03-30T13:14:32.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.853+0000 7f904b400640 1 -- 172.21.15.99:0/1616161297 <== osd.2 v2:172.21.15.99:6806/1541384038 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f905406d9d0 con 0x7f90300723f0 2024-03-30T13:14:32.858 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:32.858 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:14:32.858 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:32.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.854+0000 7f9059400640 1 -- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] conn(0x7f90300723f0 msgr2=0x7f9030074810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.854+0000 7f9059400640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:6806/1541384038,v1:172.21.15.99:6808/1541384038] conn(0x7f90300723f0 0x7f9030074810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:32.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.854+0000 7f9059400640 1 -- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f903006c530 msgr2=0x7f903006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.854+0000 7f9059400640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f903006c530 0x7f903006e9f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9044001640 tx=0x7f9044009040 comp rx=0 tx=0).stop 2024-03-30T13:14:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.854+0000 7f9059400640 1 -- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9054156ba0 msgr2=0x7f905415b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.854+0000 7f9059400640 1 --2- 172.21.15.99:0/1616161297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9054156ba0 0x7f905415b620 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f903c02c4e0 tx=0x7f903c004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.854+0000 7f9053200640 1 -- 172.21.15.99:0/1616161297 reap_dead start 2024-03-30T13:14:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.854+0000 7f9059400640 1 -- 172.21.15.99:0/1616161297 shutdown_connections 2024-03-30T13:14:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.854+0000 7f9059400640 1 -- 172.21.15.99:0/1616161297 >> 172.21.15.99:0/1616161297 conn(0x7f905406b6f0 msgr2=0x7f905415f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.854+0000 7f9059400640 1 -- 172.21.15.99:0/1616161297 shutdown_connections 2024-03-30T13:14:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:32.854+0000 7f9059400640 1 -- 172.21.15.99:0/1616161297 wait complete. 2024-03-30T13:14:32.876 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-30T13:14:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.077+0000 7f18f3a00640 1 Processor -- start 2024-03-30T13:14:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.077+0000 7f18f3a00640 1 -- start start 2024-03-30T13:14:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18f3a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f18ec15fc20 0x7f18ec0c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18f3a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f18ec0c5020 0x7f18ec0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18f3a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18ec0b4b20 0x7f18ec0d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18f3a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f18ec161090 con 0x7f18ec0c5020 2024-03-30T13:14:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18f3a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f18ec160480 con 0x7f18ec15fc20 2024-03-30T13:14:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18f3a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f18ec160760 con 0x7f18ec0b4b20 2024-03-30T13:14:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18ebe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f18ec0c5020 0x7f18ec0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18ebe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f18ec0c5020 0x7f18ec0c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44056/0 (socket says 172.21.15.99:44056) 2024-03-30T13:14:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18ebe00640 1 -- 172.21.15.99:0/2071259589 learned_addr learned my addr 172.21.15.99:0/2071259589 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18ebe00640 1 -- 172.21.15.99:0/2071259589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18ec0b4b20 msgr2=0x7f18ec0d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18ebe00640 1 --2- 172.21.15.99:0/2071259589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18ec0b4b20 0x7f18ec0d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18ebe00640 1 -- 172.21.15.99:0/2071259589 >> v2:172.21.15.181:3300/0 conn(0x7f18ec15fc20 msgr2=0x7f18ec0c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18ebe00640 1 --2- 172.21.15.99:0/2071259589 >> v2:172.21.15.181:3300/0 conn(0x7f18ec15fc20 0x7f18ec0c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.079+0000 7f18ebe00640 1 -- 172.21.15.99:0/2071259589 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec160a40 con 0x7f18ec0c5020 2024-03-30T13:14:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.080+0000 7f18ebe00640 1 --2- 172.21.15.99:0/2071259589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18ec0c5020 0x7f18ec0c6680 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0d1200 tx=0x7f18d802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2bcd4cecbb34aa server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.081+0000 7f18eb400640 1 -- 172.21.15.99:0/2071259589 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d802e070 con 0x7f18ec0c5020 2024-03-30T13:14:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.081+0000 7f18eb400640 1 -- 172.21.15.99:0/2071259589 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d8037070 con 0x7f18ec0c5020 2024-03-30T13:14:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.081+0000 7f18eb400640 1 -- 172.21.15.99:0/2071259589 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8031a00 con 0x7f18ec0c5020 2024-03-30T13:14:33.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.081+0000 7f18f3a00640 1 -- 172.21.15.99:0/2071259589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18ec0c5020 msgr2=0x7f18ec0c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.081+0000 7f18f3a00640 1 --2- 172.21.15.99:0/2071259589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18ec0c5020 0x7f18ec0c6680 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0d1200 tx=0x7f18d802b880 comp rx=0 tx=0).stop 2024-03-30T13:14:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.082+0000 7f18f3a00640 1 -- 172.21.15.99:0/2071259589 shutdown_connections 2024-03-30T13:14:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.082+0000 7f18f3a00640 1 --2- 172.21.15.99:0/2071259589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18ec0b4b20 0x7f18ec0d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.082+0000 7f18f3a00640 1 --2- 172.21.15.99:0/2071259589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18ec0c5020 0x7f18ec0c6680 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.082+0000 7f18f3a00640 1 --2- 172.21.15.99:0/2071259589 >> v2:172.21.15.181:3300/0 conn(0x7f18ec15fc20 0x7f18ec0c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.082+0000 7f18f3a00640 1 -- 172.21.15.99:0/2071259589 >> 172.21.15.99:0/2071259589 conn(0x7f18ec06b510 msgr2=0x7f18ec06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.082+0000 7f18f3a00640 1 -- 172.21.15.99:0/2071259589 shutdown_connections 2024-03-30T13:14:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.082+0000 7f18f3a00640 1 -- 172.21.15.99:0/2071259589 wait complete. 2024-03-30T13:14:33.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.083+0000 7f18f3a00640 1 Processor -- start 2024-03-30T13:14:33.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.084+0000 7f18f3a00640 1 -- start start 2024-03-30T13:14:33.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.084+0000 7f18f3a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18ec0b4b20 0x7f18ec14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.084+0000 7f18f3a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18ec0c5020 0x7f18ec0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18f3a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18ec15fc20 0x7f18ec06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18f3a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec160260 con 0x7f18ec0c5020 2024-03-30T13:14:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18f3a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec1600e0 con 0x7f18ec0b4b20 2024-03-30T13:14:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18f3a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f18ec0d0630 con 0x7f18ec15fc20 2024-03-30T13:14:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18ebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18ec0c5020 0x7f18ec0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18ebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18ec0c5020 0x7f18ec0cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44058/0 (socket says 172.21.15.99:44058) 2024-03-30T13:14:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18ebe00640 1 -- 172.21.15.99:0/1732288827 learned_addr learned my addr 172.21.15.99:0/1732288827 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18f1000640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18ec0b4b20 0x7f18ec14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18ebe00640 1 -- 172.21.15.99:0/1732288827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18ec15fc20 msgr2=0x7f18ec06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18f1a00640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18ec15fc20 0x7f18ec06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18ebe00640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18ec15fc20 0x7f18ec06e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18ebe00640 1 -- 172.21.15.99:0/1732288827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18ec0b4b20 msgr2=0x7f18ec14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18ebe00640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18ec0b4b20 0x7f18ec14cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18ebe00640 1 -- 172.21.15.99:0/1732288827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec14fa80 con 0x7f18ec0c5020 2024-03-30T13:14:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.085+0000 7f18f1000640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18ec0b4b20 0x7f18ec14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.086+0000 7f18ebe00640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18ec0c5020 0x7f18ec0cf4a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f18d802b8c0 tx=0x7f18d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.086+0000 7f18e8c00640 1 -- 172.21.15.99:0/1732288827 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8032880 con 0x7f18ec0c5020 2024-03-30T13:14:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.086+0000 7f18e8c00640 1 -- 172.21.15.99:0/1732288827 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d8032a20 con 0x7f18ec0c5020 2024-03-30T13:14:33.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.086+0000 7f18f3a00640 1 -- 172.21.15.99:0/1732288827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ec14fd60 con 0x7f18ec0c5020 2024-03-30T13:14:33.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.086+0000 7f18e8c00640 1 -- 172.21.15.99:0/1732288827 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8032e10 con 0x7f18ec0c5020 2024-03-30T13:14:33.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.086+0000 7f18f3a00640 1 -- 172.21.15.99:0/1732288827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ec150320 con 0x7f18ec0c5020 2024-03-30T13:14:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.087+0000 7f18f3a00640 1 -- 172.21.15.99:0/1732288827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18ec068640 con 0x7f18ec0c5020 2024-03-30T13:14:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.088+0000 7f18e8c00640 1 -- 172.21.15.99:0/1732288827 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f18d804c060 con 0x7f18ec0c5020 2024-03-30T13:14:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.089+0000 7f18e8c00640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18cc06c530 0x7f18cc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.089+0000 7f18e8c00640 1 -- 172.21.15.99:0/1732288827 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f18d80ad140 con 0x7f18ec0c5020 2024-03-30T13:14:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.089+0000 7f18f1000640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18cc06c530 0x7f18cc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.090+0000 7f18f1000640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18cc06c530 0x7f18cc06e9f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f18e000a870 tx=0x7f18e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:33.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.094+0000 7f18e8c00640 1 -- 172.21.15.99:0/1732288827 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f18d8040070 con 0x7f18ec0c5020 2024-03-30T13:14:33.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.293+0000 7f18f3a00640 1 -- 172.21.15.99:0/1732288827 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f18ec14d330 con 0x7f18cc06c530 2024-03-30T13:14:33.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.294+0000 7f18e8c00640 1 -- 172.21.15.99:0/1732288827 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f18ec14d330 con 0x7f18cc06c530 2024-03-30T13:14:33.298 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 2 to deep-scrub 2024-03-30T13:14:33.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.296+0000 7f18f3a00640 1 -- 172.21.15.99:0/1732288827 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18cc06c530 msgr2=0x7f18cc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.296+0000 7f18f3a00640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18cc06c530 0x7f18cc06e9f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f18e000a870 tx=0x7f18e0008040 comp rx=0 tx=0).stop 2024-03-30T13:14:33.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.296+0000 7f18f3a00640 1 -- 172.21.15.99:0/1732288827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18ec0c5020 msgr2=0x7f18ec0cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.296+0000 7f18f3a00640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18ec0c5020 0x7f18ec0cf4a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f18d802b8c0 tx=0x7f18d80046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.296+0000 7f18f3a00640 1 -- 172.21.15.99:0/1732288827 shutdown_connections 2024-03-30T13:14:33.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.296+0000 7f18f3a00640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f18cc06c530 0x7f18cc06e9f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.296+0000 7f18f3a00640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18ec15fc20 0x7f18ec06e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.296+0000 7f18f3a00640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18ec0c5020 0x7f18ec0cf4a0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.296+0000 7f18f3a00640 1 --2- 172.21.15.99:0/1732288827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18ec0b4b20 0x7f18ec14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.296+0000 7f18f3a00640 1 -- 172.21.15.99:0/1732288827 >> 172.21.15.99:0/1732288827 conn(0x7f18ec06b510 msgr2=0x7f18ec0ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:33.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.296+0000 7f18f3a00640 1 -- 172.21.15.99:0/1732288827 shutdown_connections 2024-03-30T13:14:33.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.297+0000 7f18f3a00640 1 -- 172.21.15.99:0/1732288827 wait complete. 2024-03-30T13:14:33.320 INFO:tasks.ceph:Scrubbing osd.3 2024-03-30T13:14:33.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:14:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.527+0000 7f83d5200640 1 Processor -- start 2024-03-30T13:14:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.527+0000 7f83d5200640 1 -- start start 2024-03-30T13:14:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.529+0000 7f83d5200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f83d015e6a0 0x7f83d00cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.529+0000 7f83d5200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f83d009b140 0x7f83d00b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.529+0000 7f83d5200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d00d06d0 con 0x7f83d015ea80 2024-03-30T13:14:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.529+0000 7f83d5200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f83d00d09b0 con 0x7f83d009b140 2024-03-30T13:14:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.529+0000 7f83d5200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f83d00d0c90 con 0x7f83d015e6a0 2024-03-30T13:14:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.530+0000 7f83ce800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f83d009b140 0x7f83d00b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.530+0000 7f83ce800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f83d009b140 0x7f83d00b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44068/0 (socket says 172.21.15.99:44068) 2024-03-30T13:14:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.530+0000 7f83ce800640 1 -- 172.21.15.99:0/1436514928 learned_addr learned my addr 172.21.15.99:0/1436514928 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.530+0000 7f83cde00640 1 --2- 172.21.15.99:0/1436514928 >> v2:172.21.15.181:3300/0 conn(0x7f83d015e6a0 0x7f83d00cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.530+0000 7f83ce800640 1 -- 172.21.15.99:0/1436514928 >> v2:172.21.15.181:3300/0 conn(0x7f83d015e6a0 msgr2=0x7f83d00cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.530+0000 7f83ce800640 1 --2- 172.21.15.99:0/1436514928 >> v2:172.21.15.181:3300/0 conn(0x7f83d015e6a0 0x7f83d00cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.530+0000 7f83ce800640 1 -- 172.21.15.99:0/1436514928 >> v1:172.21.15.181:6789/0 conn(0x7f83d015ea80 legacy=0x7f83d009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.530+0000 7f83ce800640 1 -- 172.21.15.99:0/1436514928 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d00d0f70 con 0x7f83d009b140 2024-03-30T13:14:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.531+0000 7f83ce800640 1 --2- 172.21.15.99:0/1436514928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d009b140 0x7f83d00b1db0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f83d00d2360 tx=0x7f83c802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42845c00f5925ab server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:33.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.532+0000 7f83cca00640 1 -- 172.21.15.99:0/1436514928 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c802ca80 con 0x7f83d009b140 2024-03-30T13:14:33.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.532+0000 7f83cca00640 1 -- 172.21.15.99:0/1436514928 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c802cc20 con 0x7f83d009b140 2024-03-30T13:14:33.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.532+0000 7f83cca00640 1 -- 172.21.15.99:0/1436514928 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c80343f0 con 0x7f83d009b140 2024-03-30T13:14:33.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.532+0000 7f83d5200640 1 -- 172.21.15.99:0/1436514928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d009b140 msgr2=0x7f83d00b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.532+0000 7f83d5200640 1 --2- 172.21.15.99:0/1436514928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d009b140 0x7f83d00b1db0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f83d00d2360 tx=0x7f83c802bee0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.533+0000 7f83d5200640 1 -- 172.21.15.99:0/1436514928 shutdown_connections 2024-03-30T13:14:33.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.533+0000 7f83d5200640 1 --2- 172.21.15.99:0/1436514928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d009b140 0x7f83d00b1db0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.533+0000 7f83d5200640 1 --2- 172.21.15.99:0/1436514928 >> v2:172.21.15.181:3300/0 conn(0x7f83d015e6a0 0x7f83d00cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.533+0000 7f83d5200640 1 -- 172.21.15.99:0/1436514928 >> 172.21.15.99:0/1436514928 conn(0x7f83d00b3ef0 msgr2=0x7f83d00b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:33.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.533+0000 7f83d5200640 1 -- 172.21.15.99:0/1436514928 shutdown_connections 2024-03-30T13:14:33.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.533+0000 7f83d5200640 1 -- 172.21.15.99:0/1436514928 wait complete. 2024-03-30T13:14:33.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.535+0000 7f83d5200640 1 Processor -- start 2024-03-30T13:14:33.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.535+0000 7f83d5200640 1 -- start start 2024-03-30T13:14:33.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.536+0000 7f83d5200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83d009b140 0x7f83d00c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.536+0000 7f83d5200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83d015e6a0 0x7f83d00c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.536+0000 7f83d5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d00b6640 0x7f83d0152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.536+0000 7f83d5200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f83d00b2470 con 0x7f83d00b6640 2024-03-30T13:14:33.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.536+0000 7f83d5200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f83d00b22f0 con 0x7f83d009b140 2024-03-30T13:14:33.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.536+0000 7f83d5200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f83d00b25f0 con 0x7f83d015e6a0 2024-03-30T13:14:33.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.536+0000 7f83ce800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d00b6640 0x7f83d0152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.537+0000 7f83ce800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d00b6640 0x7f83d0152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44072/0 (socket says 172.21.15.99:44072) 2024-03-30T13:14:33.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.537+0000 7f83ce800640 1 -- 172.21.15.99:0/2548087643 learned_addr learned my addr 172.21.15.99:0/2548087643 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:33.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.537+0000 7f83cd400640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83d015e6a0 0x7f83d00c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.537+0000 7f83ce800640 1 -- 172.21.15.99:0/2548087643 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83d015e6a0 msgr2=0x7f83d00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.537+0000 7f83ce800640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83d015e6a0 0x7f83d00c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.537+0000 7f83ce800640 1 -- 172.21.15.99:0/2548087643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83d009b140 msgr2=0x7f83d00c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.537+0000 7f83cde00640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83d009b140 0x7f83d00c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.537+0000 7f83ce800640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83d009b140 0x7f83d00c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.537+0000 7f83ce800640 1 -- 172.21.15.99:0/2548087643 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d00b6bb0 con 0x7f83d00b6640 2024-03-30T13:14:33.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.537+0000 7f83cd400640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83d015e6a0 0x7f83d00c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:33.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.537+0000 7f83ce800640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d00b6640 0x7f83d0152500 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f83c8036040 tx=0x7f83c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:33.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.538+0000 7f83c6000640 1 -- 172.21.15.99:0/2548087643 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8043020 con 0x7f83d00b6640 2024-03-30T13:14:33.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.538+0000 7f83c6000640 1 -- 172.21.15.99:0/2548087643 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c803e450 con 0x7f83d00b6640 2024-03-30T13:14:33.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.538+0000 7f83d5200640 1 -- 172.21.15.99:0/2548087643 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d00b6e90 con 0x7f83d00b6640 2024-03-30T13:14:33.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.538+0000 7f83c6000640 1 -- 172.21.15.99:0/2548087643 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8009510 con 0x7f83d00b6640 2024-03-30T13:14:33.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.538+0000 7f83d5200640 1 -- 172.21.15.99:0/2548087643 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d00b7450 con 0x7f83d00b6640 2024-03-30T13:14:33.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.539+0000 7f83d5200640 1 -- 172.21.15.99:0/2548087643 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83d00b7820 con 0x7f83d00b6640 2024-03-30T13:14:33.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.540+0000 7f83c6000640 1 -- 172.21.15.99:0/2548087643 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f83c8046020 con 0x7f83d00b6640 2024-03-30T13:14:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.541+0000 7f83c6000640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f83b006c560 0x7f83b006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.541+0000 7f83c6000640 1 -- 172.21.15.99:0/2548087643 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f83c80ada50 con 0x7f83d00b6640 2024-03-30T13:14:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.541+0000 7f83c6000640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] conn(0x7f83b0072420 0x7f83b0074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.541+0000 7f83c6000640 1 -- 172.21.15.99:0/2548087643 --> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83c8039e50 con 0x7f83b0072420 2024-03-30T13:14:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.541+0000 7f83c6000640 1 -- 172.21.15.99:0/2548087643 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f83c80b22a0 con 0x7f83d00b6640 2024-03-30T13:14:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.541+0000 7f83cde00640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f83b006c560 0x7f83b006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.542+0000 7f83cd400640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] conn(0x7f83b0072420 0x7f83b0074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.542+0000 7f83cde00640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f83b006c560 0x7f83b006ea20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f83c0006fd0 tx=0x7f83c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.542+0000 7f83cd400640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] conn(0x7f83b0072420 0x7f83b0074840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.543+0000 7f83c6000640 1 -- 172.21.15.99:0/2548087643 <== osd.3 v2:172.21.15.99:6802/1545943262 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83c8039e50 con 0x7f83b0072420 2024-03-30T13:14:33.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.558+0000 7f83d5200640 1 -- 172.21.15.99:0/2548087643 --> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f83d0068640 con 0x7f83b0072420 2024-03-30T13:14:33.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.558+0000 7f83c6000640 1 -- 172.21.15.99:0/2548087643 <== osd.3 v2:172.21.15.99:6802/1545943262 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f83d0068640 con 0x7f83b0072420 2024-03-30T13:14:33.563 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:33.563 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:14:33.563 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:33.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.558+0000 7f83d5200640 1 -- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] conn(0x7f83b0072420 msgr2=0x7f83b0074840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.558+0000 7f83d5200640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:6802/1545943262,v1:172.21.15.99:6803/1545943262] conn(0x7f83b0072420 0x7f83b0074840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.559+0000 7f83d5200640 1 -- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f83b006c560 msgr2=0x7f83b006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.559+0000 7f83d5200640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f83b006c560 0x7f83b006ea20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f83c0006fd0 tx=0x7f83c0008040 comp rx=0 tx=0).stop 2024-03-30T13:14:33.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.559+0000 7f83d5200640 1 -- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d00b6640 msgr2=0x7f83d0152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.559+0000 7f83d5200640 1 --2- 172.21.15.99:0/2548087643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d00b6640 0x7f83d0152500 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f83c8036040 tx=0x7f83c8004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:33.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.559+0000 7f83ce800640 1 -- 172.21.15.99:0/2548087643 reap_dead start 2024-03-30T13:14:33.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.559+0000 7f83d5200640 1 -- 172.21.15.99:0/2548087643 shutdown_connections 2024-03-30T13:14:33.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.559+0000 7f83d5200640 1 -- 172.21.15.99:0/2548087643 >> 172.21.15.99:0/2548087643 conn(0x7f83d00b3ef0 msgr2=0x7f83d006c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:33.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.559+0000 7f83d5200640 1 -- 172.21.15.99:0/2548087643 shutdown_connections 2024-03-30T13:14:33.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.559+0000 7f83d5200640 1 -- 172.21.15.99:0/2548087643 wait complete. 2024-03-30T13:14:33.580 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-30T13:14:33.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.766+0000 7f7b5ac00640 1 Processor -- start 2024-03-30T13:14:33.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.766+0000 7f7b5ac00640 1 -- start start 2024-03-30T13:14:33.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b5ac00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b54159fe0 0x7f7b540ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b5ac00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b5415c9d0 con 0x7f7b540cd100 2024-03-30T13:14:33.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b5ac00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b5415cc90 con 0x7f7b540cee00 2024-03-30T13:14:33.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b5ac00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7b5415cf70 con 0x7f7b54159fe0 2024-03-30T13:14:33.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b5a200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7b540cd100 0x7f7b5415fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56920/0 (socket says 172.21.15.99:56920) 2024-03-30T13:14:33.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b5a200640 1 -- 172.21.15.99:0/4293587112 learned_addr learned my addr 172.21.15.99:0/4293587112 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:33.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b59800640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b54159fe0 0x7f7b540ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025872047 0 0) 0x7f7b5415c9d0 con 0x7f7b540cd100 2024-03-30T13:14:33.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b3c003520 con 0x7f7b540cd100 2024-03-30T13:14:33.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1408908027 0 0) 0x7f7b3c003520 con 0x7f7b540cd100 2024-03-30T13:14:33.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b54159fe0 msgr2=0x7f7b540ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:33.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b54159fe0 0x7f7b540ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 >> v1:172.21.15.181:6789/0 conn(0x7f7b540cee00 legacy=0x7f7b540cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5415d250 con 0x7f7b540cd100 2024-03-30T13:14:33.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f7b4c0019f0 con 0x7f7b540cd100 2024-03-30T13:14:33.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 >> v1:172.21.15.99:6789/0 conn(0x7f7b540cd100 legacy=0x7f7b5415fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b3c0039e0 0x7f7b3c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b54159fe0 0x7f7b3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b3c004d40 0x7f7b3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5415cf70 con 0x7f7b3c004d40 2024-03-30T13:14:33.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c00ba70 con 0x7f7b3c0039e0 2024-03-30T13:14:33.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3c00bc70 con 0x7f7b54159fe0 2024-03-30T13:14:33.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.768+0000 7f7b5a200640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b3c004d40 0x7f7b3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.769+0000 7f7b58e00640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b54159fe0 0x7f7b3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.769+0000 7f7b59800640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b3c0039e0 0x7f7b3c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.769+0000 7f7b5a200640 1 -- 172.21.15.99:0/4293587112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b54159fe0 msgr2=0x7f7b3c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.769+0000 7f7b5a200640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b54159fe0 0x7f7b3c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.769+0000 7f7b5a200640 1 -- 172.21.15.99:0/4293587112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b3c0039e0 msgr2=0x7f7b3c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.769+0000 7f7b5a200640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b3c0039e0 0x7f7b3c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.769+0000 7f7b5a200640 1 -- 172.21.15.99:0/4293587112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3c003520 con 0x7f7b3c004d40 2024-03-30T13:14:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.770+0000 7f7b5a200640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b3c004d40 0x7f7b3c0051c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f7b540cd7d0 tx=0x7f7b3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aecafd4e666366f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.770+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c00a480 con 0x7f7b3c004d40 2024-03-30T13:14:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.770+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b4c034630 con 0x7f7b3c004d40 2024-03-30T13:14:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.770+0000 7f7b53e00640 1 -- 172.21.15.99:0/4293587112 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c034a60 con 0x7f7b3c004d40 2024-03-30T13:14:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.771+0000 7f7b5ac00640 1 -- 172.21.15.99:0/4293587112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b3c004d40 msgr2=0x7f7b3c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.771+0000 7f7b5ac00640 1 --2- 172.21.15.99:0/4293587112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b3c004d40 0x7f7b3c0051c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f7b540cd7d0 tx=0x7f7b3c005830 comp rx=0 tx=0).stop 2024-03-30T13:14:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.771+0000 7f7b5a200640 1 -- 172.21.15.99:0/4293587112 reap_dead start 2024-03-30T13:14:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.771+0000 7f7b5ac00640 1 -- 172.21.15.99:0/4293587112 shutdown_connections 2024-03-30T13:14:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.771+0000 7f7b5ac00640 1 -- 172.21.15.99:0/4293587112 >> 172.21.15.99:0/4293587112 conn(0x7f7b540b1e20 msgr2=0x7f7b540b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.771+0000 7f7b5ac00640 1 -- 172.21.15.99:0/4293587112 shutdown_connections 2024-03-30T13:14:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.771+0000 7f7b5ac00640 1 -- 172.21.15.99:0/4293587112 wait complete. 2024-03-30T13:14:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.773+0000 7f7b5ac00640 1 Processor -- start 2024-03-30T13:14:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.773+0000 7f7b5ac00640 1 -- start start 2024-03-30T13:14:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b5ac00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b3c004d40 0x7f7b541551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b5ac00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b54155dd0 0x7f7b540c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b5ac00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b541e6500 0x7f7b541e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b5ac00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7b540cc750 con 0x7f7b54155dd0 2024-03-30T13:14:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b5ac00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7b540cc5d0 con 0x7f7b3c004d40 2024-03-30T13:14:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b5ac00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7b541605e0 con 0x7f7b541e6500 2024-03-30T13:14:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b58e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b54155dd0 0x7f7b540c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b58e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b54155dd0 0x7f7b540c5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44088/0 (socket says 172.21.15.99:44088) 2024-03-30T13:14:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b58e00640 1 -- 172.21.15.99:0/833855846 learned_addr learned my addr 172.21.15.99:0/833855846 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b5a200640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b541e6500 0x7f7b541e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b59800640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b3c004d40 0x7f7b541551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b58e00640 1 -- 172.21.15.99:0/833855846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b541e6500 msgr2=0x7f7b541e69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b58e00640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b541e6500 0x7f7b541e69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b58e00640 1 -- 172.21.15.99:0/833855846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b3c004d40 msgr2=0x7f7b541551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b58e00640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b3c004d40 0x7f7b541551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.774+0000 7f7b58e00640 1 -- 172.21.15.99:0/833855846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b540c60a0 con 0x7f7b54155dd0 2024-03-30T13:14:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.775+0000 7f7b58e00640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b54155dd0 0x7f7b540c5870 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000e500 tx=0x7f7b4000e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.775+0000 7f7b51600640 1 -- 172.21.15.99:0/833855846 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b400053a0 con 0x7f7b54155dd0 2024-03-30T13:14:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.775+0000 7f7b51600640 1 -- 172.21.15.99:0/833855846 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b40018070 con 0x7f7b54155dd0 2024-03-30T13:14:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.775+0000 7f7b5ac00640 1 -- 172.21.15.99:0/833855846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b540c6380 con 0x7f7b54155dd0 2024-03-30T13:14:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.775+0000 7f7b51600640 1 -- 172.21.15.99:0/833855846 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b40003830 con 0x7f7b54155dd0 2024-03-30T13:14:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.775+0000 7f7b5ac00640 1 -- 172.21.15.99:0/833855846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b540ad7b0 con 0x7f7b54155dd0 2024-03-30T13:14:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.776+0000 7f7b5ac00640 1 -- 172.21.15.99:0/833855846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b5404f8f0 con 0x7f7b54155dd0 2024-03-30T13:14:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.777+0000 7f7b51600640 1 -- 172.21.15.99:0/833855846 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7b400039d0 con 0x7f7b54155dd0 2024-03-30T13:14:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.778+0000 7f7b51600640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7b3406c560 0x7f7b3406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.778+0000 7f7b51600640 1 -- 172.21.15.99:0/833855846 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f7b4008b0d0 con 0x7f7b54155dd0 2024-03-30T13:14:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.778+0000 7f7b59800640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7b3406c560 0x7f7b3406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.779+0000 7f7b59800640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7b3406c560 0x7f7b3406ea20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009950 tx=0x7f7b48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.783+0000 7f7b51600640 1 -- 172.21.15.99:0/833855846 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7b40059a00 con 0x7f7b54155dd0 2024-03-30T13:14:33.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.986+0000 7f7b5ac00640 1 -- 172.21.15.99:0/833855846 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f7b5406ee40 con 0x7f7b3406c560 2024-03-30T13:14:33.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.987+0000 7f7b51600640 1 -- 172.21.15.99:0/833855846 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7b5406ee40 con 0x7f7b3406c560 2024-03-30T13:14:33.992 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 3 to deep-scrub 2024-03-30T13:14:33.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 -- 172.21.15.99:0/833855846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7b3406c560 msgr2=0x7f7b3406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7b3406c560 0x7f7b3406ea20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009950 tx=0x7f7b48008040 comp rx=0 tx=0).stop 2024-03-30T13:14:33.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 -- 172.21.15.99:0/833855846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b54155dd0 msgr2=0x7f7b540c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:33.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b54155dd0 0x7f7b540c5870 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000e500 tx=0x7f7b4000e9c0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 -- 172.21.15.99:0/833855846 shutdown_connections 2024-03-30T13:14:33.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f7b3406c560 0x7f7b3406ea20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b541e6500 0x7f7b541e69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b54155dd0 0x7f7b540c5870 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 --2- 172.21.15.99:0/833855846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b3c004d40 0x7f7b541551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:33.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 -- 172.21.15.99:0/833855846 >> 172.21.15.99:0/833855846 conn(0x7f7b540b1e20 msgr2=0x7f7b540b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:33.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 -- 172.21.15.99:0/833855846 shutdown_connections 2024-03-30T13:14:33.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:33.990+0000 7f7b5ac00640 1 -- 172.21.15.99:0/833855846 wait complete. 2024-03-30T13:14:34.012 INFO:tasks.ceph:Scrubbing osd.4 2024-03-30T13:14:34.012 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:14:34.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.226+0000 7f5975600640 1 Processor -- start 2024-03-30T13:14:34.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.226+0000 7f5975600640 1 -- start start 2024-03-30T13:14:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.227+0000 7f5975600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f597015b350 0x7f597015efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.227+0000 7f5975600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59700b4cf0 0x7f597015c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.227+0000 7f5975600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f59700d0490 0x7f59700d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.227+0000 7f5975600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f597015bdd0 con 0x7f597015b350 2024-03-30T13:14:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.227+0000 7f5975600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f597015bad0 con 0x7f59700d0490 2024-03-30T13:14:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.227+0000 7f5975600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f597015f7e0 con 0x7f59700b4cf0 2024-03-30T13:14:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f597015b350 0x7f597015efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f597015b350 0x7f597015efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44102/0 (socket says 172.21.15.99:44102) 2024-03-30T13:14:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596ea00640 1 -- 172.21.15.99:0/2269931245 learned_addr learned my addr 172.21.15.99:0/2269931245 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596ea00640 1 -- 172.21.15.99:0/2269931245 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59700b4cf0 msgr2=0x7f597015c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596e000640 1 --2- 172.21.15.99:0/2269931245 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59700b4cf0 0x7f597015c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596f400640 1 --2- 172.21.15.99:0/2269931245 >> v2:172.21.15.181:3300/0 conn(0x7f59700d0490 0x7f59700d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596ea00640 1 --2- 172.21.15.99:0/2269931245 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59700b4cf0 0x7f597015c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596ea00640 1 -- 172.21.15.99:0/2269931245 >> v2:172.21.15.181:3300/0 conn(0x7f59700d0490 msgr2=0x7f59700d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596ea00640 1 --2- 172.21.15.99:0/2269931245 >> v2:172.21.15.181:3300/0 conn(0x7f59700d0490 0x7f59700d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596ea00640 1 -- 172.21.15.99:0/2269931245 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597015fac0 con 0x7f597015b350 2024-03-30T13:14:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596e000640 1 --2- 172.21.15.99:0/2269931245 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59700b4cf0 0x7f597015c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596f400640 1 --2- 172.21.15.99:0/2269931245 >> v2:172.21.15.181:3300/0 conn(0x7f59700d0490 0x7f59700d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596ea00640 1 --2- 172.21.15.99:0/2269931245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597015b350 0x7f597015efb0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f597006f0f0 tx=0x7f596002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2b2980f8ba6748 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.228+0000 7f596d600640 1 -- 172.21.15.99:0/2269931245 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596002ca80 con 0x7f597015b350 2024-03-30T13:14:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.230+0000 7f596d600640 1 -- 172.21.15.99:0/2269931245 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596002cc20 con 0x7f597015b350 2024-03-30T13:14:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.230+0000 7f596d600640 1 -- 172.21.15.99:0/2269931245 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59600343f0 con 0x7f597015b350 2024-03-30T13:14:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.230+0000 7f5975600640 1 -- 172.21.15.99:0/2269931245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597015b350 msgr2=0x7f597015efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.230+0000 7f5975600640 1 --2- 172.21.15.99:0/2269931245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597015b350 0x7f597015efb0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f597006f0f0 tx=0x7f596002bee0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.230+0000 7f5975600640 1 -- 172.21.15.99:0/2269931245 shutdown_connections 2024-03-30T13:14:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.230+0000 7f5975600640 1 --2- 172.21.15.99:0/2269931245 >> v2:172.21.15.181:3300/0 conn(0x7f59700d0490 0x7f59700d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.230+0000 7f5975600640 1 --2- 172.21.15.99:0/2269931245 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59700b4cf0 0x7f597015c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.230+0000 7f5975600640 1 --2- 172.21.15.99:0/2269931245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597015b350 0x7f597015efb0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.230+0000 7f5975600640 1 -- 172.21.15.99:0/2269931245 >> 172.21.15.99:0/2269931245 conn(0x7f597006b6f0 msgr2=0x7f597006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.230+0000 7f5975600640 1 -- 172.21.15.99:0/2269931245 shutdown_connections 2024-03-30T13:14:34.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.230+0000 7f5975600640 1 -- 172.21.15.99:0/2269931245 wait complete. 2024-03-30T13:14:34.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.231+0000 7f5975600640 1 Processor -- start 2024-03-30T13:14:34.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.231+0000 7f5975600640 1 -- start start 2024-03-30T13:14:34.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f5975600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59700b4cf0 0x7f597009dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f5975600640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59700d0490 0x7f59700ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f5975600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597015b350 0x7f5970156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f5975600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f597015b730 con 0x7f597015b350 2024-03-30T13:14:34.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f5975600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f597015fda0 con 0x7f59700b4cf0 2024-03-30T13:14:34.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f5975600640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f597015b8b0 con 0x7f59700d0490 2024-03-30T13:14:34.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f596f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597015b350 0x7f5970156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f596f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597015b350 0x7f5970156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44118/0 (socket says 172.21.15.99:44118) 2024-03-30T13:14:34.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f596f400640 1 -- 172.21.15.99:0/869125458 learned_addr learned my addr 172.21.15.99:0/869125458 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:34.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f596e000640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59700d0490 0x7f59700ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f596ea00640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59700b4cf0 0x7f597009dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f596f400640 1 -- 172.21.15.99:0/869125458 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59700d0490 msgr2=0x7f59700ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f596f400640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f59700d0490 0x7f59700ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f596f400640 1 -- 172.21.15.99:0/869125458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59700b4cf0 msgr2=0x7f597009dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f596f400640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59700b4cf0 0x7f597009dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.233+0000 7f596f400640 1 -- 172.21.15.99:0/869125458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59701f53a0 con 0x7f597015b350 2024-03-30T13:14:34.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.235+0000 7f596f400640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597015b350 0x7f5970156770 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f596800c7f0 tx=0x7f596800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:34.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.235+0000 7f5966a00640 1 -- 172.21.15.99:0/869125458 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968015070 con 0x7f597015b350 2024-03-30T13:14:34.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.235+0000 7f5966a00640 1 -- 172.21.15.99:0/869125458 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5968007820 con 0x7f597015b350 2024-03-30T13:14:34.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.235+0000 7f5966a00640 1 -- 172.21.15.99:0/869125458 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968007c10 con 0x7f597015b350 2024-03-30T13:14:34.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.235+0000 7f5975600640 1 -- 172.21.15.99:0/869125458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59701f5680 con 0x7f597015b350 2024-03-30T13:14:34.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.235+0000 7f5975600640 1 -- 172.21.15.99:0/869125458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59701f5c40 con 0x7f597015b350 2024-03-30T13:14:34.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.236+0000 7f5975600640 1 -- 172.21.15.99:0/869125458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5970068640 con 0x7f597015b350 2024-03-30T13:14:34.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.237+0000 7f5966a00640 1 -- 172.21.15.99:0/869125458 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5968018070 con 0x7f597015b350 2024-03-30T13:14:34.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.237+0000 7f5966a00640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f594c06c560 0x7f594c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.237+0000 7f5966a00640 1 -- 172.21.15.99:0/869125458 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f596808b390 con 0x7f597015b350 2024-03-30T13:14:34.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.237+0000 7f596ea00640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f594c06c560 0x7f594c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.237+0000 7f5966a00640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] conn(0x7f594c072420 0x7f594c074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.237+0000 7f5966a00640 1 -- 172.21.15.99:0/869125458 --> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f596801de50 con 0x7f594c072420 2024-03-30T13:14:34.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.237+0000 7f5966a00640 1 -- 172.21.15.99:0/869125458 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f5968092050 con 0x7f597015b350 2024-03-30T13:14:34.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.239+0000 7f596e000640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] conn(0x7f594c072420 0x7f594c074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.239+0000 7f596ea00640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f594c06c560 0x7f594c06ea20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5960035000 tx=0x7f5960030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:34.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.240+0000 7f596e000640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] conn(0x7f594c072420 0x7f594c074840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:34.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.242+0000 7f5966a00640 1 -- 172.21.15.99:0/869125458 <== osd.4 v2:172.21.15.181:6800/599260275 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f596801de50 con 0x7f594c072420 2024-03-30T13:14:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.257+0000 7f5975600640 1 -- 172.21.15.99:0/869125458 --> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f597015ef90 con 0x7f594c072420 2024-03-30T13:14:34.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.258+0000 7f5966a00640 1 -- 172.21.15.99:0/869125458 <== osd.4 v2:172.21.15.181:6800/599260275 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f597015ef90 con 0x7f594c072420 2024-03-30T13:14:34.261 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:14:34.262 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:34.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.258+0000 7f5975600640 1 -- 172.21.15.99:0/869125458 >> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] conn(0x7f594c072420 msgr2=0x7f594c074840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.258+0000 7f5975600640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.181:6800/599260275,v1:172.21.15.181:6801/599260275] conn(0x7f594c072420 0x7f594c074840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.258+0000 7f5975600640 1 -- 172.21.15.99:0/869125458 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f594c06c560 msgr2=0x7f594c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.258+0000 7f5975600640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f594c06c560 0x7f594c06ea20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5960035000 tx=0x7f5960030000 comp rx=0 tx=0).stop 2024-03-30T13:14:34.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.258+0000 7f5975600640 1 -- 172.21.15.99:0/869125458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597015b350 msgr2=0x7f5970156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.258+0000 7f5975600640 1 --2- 172.21.15.99:0/869125458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597015b350 0x7f5970156770 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f596800c7f0 tx=0x7f596800ccb0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.258+0000 7f596f400640 1 -- 172.21.15.99:0/869125458 reap_dead start 2024-03-30T13:14:34.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.258+0000 7f5975600640 1 -- 172.21.15.99:0/869125458 shutdown_connections 2024-03-30T13:14:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.258+0000 7f5975600640 1 -- 172.21.15.99:0/869125458 >> 172.21.15.99:0/869125458 conn(0x7f597006b6f0 msgr2=0x7f59700b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.259+0000 7f5975600640 1 -- 172.21.15.99:0/869125458 shutdown_connections 2024-03-30T13:14:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.259+0000 7f5975600640 1 -- 172.21.15.99:0/869125458 wait complete. 2024-03-30T13:14:34.279 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-30T13:14:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.477+0000 7f1f06000640 1 Processor -- start 2024-03-30T13:14:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.477+0000 7f1f06000640 1 -- start start 2024-03-30T13:14:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1f06000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f0015fc20 0x7f1f000c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1f06000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1f000c5020 0x7f1f000c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1f06000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f000b4b20 0x7f1f000d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1f06000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f1f00161090 con 0x7f1f0015fc20 2024-03-30T13:14:34.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1f06000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1f00160480 con 0x7f1f000c5020 2024-03-30T13:14:34.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1f06000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1f00160760 con 0x7f1f000b4b20 2024-03-30T13:14:34.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1eff400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f0015fc20 0x7f1f000c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1eff400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f0015fc20 0x7f1f000c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44130/0 (socket says 172.21.15.99:44130) 2024-03-30T13:14:34.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1eff400640 1 -- 172.21.15.99:0/3698114022 learned_addr learned my addr 172.21.15.99:0/3698114022 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:34.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1eff400640 1 -- 172.21.15.99:0/3698114022 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f000b4b20 msgr2=0x7f1f000d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:34.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1effe00640 1 --2- 172.21.15.99:0/3698114022 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f000b4b20 0x7f1f000d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1efea00640 1 --2- 172.21.15.99:0/3698114022 >> v2:172.21.15.181:3300/0 conn(0x7f1f000c5020 0x7f1f000c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.479+0000 7f1eff400640 1 --2- 172.21.15.99:0/3698114022 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f000b4b20 0x7f1f000d00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.480+0000 7f1eff400640 1 -- 172.21.15.99:0/3698114022 >> v2:172.21.15.181:3300/0 conn(0x7f1f000c5020 msgr2=0x7f1f000c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:34.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.480+0000 7f1eff400640 1 --2- 172.21.15.99:0/3698114022 >> v2:172.21.15.181:3300/0 conn(0x7f1f000c5020 0x7f1f000c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.480+0000 7f1eff400640 1 -- 172.21.15.99:0/3698114022 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f00160a40 con 0x7f1f0015fc20 2024-03-30T13:14:34.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.480+0000 7f1effe00640 1 --2- 172.21.15.99:0/3698114022 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f000b4b20 0x7f1f000d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:34.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.480+0000 7f1efea00640 1 --2- 172.21.15.99:0/3698114022 >> v2:172.21.15.181:3300/0 conn(0x7f1f000c5020 0x7f1f000c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:34.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.481+0000 7f1eff400640 1 --2- 172.21.15.99:0/3698114022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f0015fc20 0x7f1f000c6140 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1f000d0030 tx=0x7f1ef002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d4ee6ea3911ace server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:34.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.481+0000 7f1efe000640 1 -- 172.21.15.99:0/3698114022 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef002e070 con 0x7f1f0015fc20 2024-03-30T13:14:34.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.481+0000 7f1efe000640 1 -- 172.21.15.99:0/3698114022 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef0037070 con 0x7f1f0015fc20 2024-03-30T13:14:34.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.481+0000 7f1efe000640 1 -- 172.21.15.99:0/3698114022 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0031a00 con 0x7f1f0015fc20 2024-03-30T13:14:34.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.482+0000 7f1f06000640 1 -- 172.21.15.99:0/3698114022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f0015fc20 msgr2=0x7f1f000c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.482+0000 7f1f06000640 1 --2- 172.21.15.99:0/3698114022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f0015fc20 0x7f1f000c6140 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1f000d0030 tx=0x7f1ef002b880 comp rx=0 tx=0).stop 2024-03-30T13:14:34.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.482+0000 7f1f06000640 1 -- 172.21.15.99:0/3698114022 shutdown_connections 2024-03-30T13:14:34.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.482+0000 7f1f06000640 1 --2- 172.21.15.99:0/3698114022 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f000b4b20 0x7f1f000d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.482+0000 7f1f06000640 1 --2- 172.21.15.99:0/3698114022 >> v2:172.21.15.181:3300/0 conn(0x7f1f000c5020 0x7f1f000c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.482+0000 7f1f06000640 1 --2- 172.21.15.99:0/3698114022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f0015fc20 0x7f1f000c6140 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.482+0000 7f1f06000640 1 -- 172.21.15.99:0/3698114022 >> 172.21.15.99:0/3698114022 conn(0x7f1f0006b510 msgr2=0x7f1f0006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.482+0000 7f1f06000640 1 -- 172.21.15.99:0/3698114022 shutdown_connections 2024-03-30T13:14:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.482+0000 7f1f06000640 1 -- 172.21.15.99:0/3698114022 wait complete. 2024-03-30T13:14:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.483+0000 7f1f06000640 1 Processor -- start 2024-03-30T13:14:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.484+0000 7f1f06000640 1 -- start start 2024-03-30T13:14:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1f06000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f000b4b20 0x7f1f001537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1f06000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f000c5020 0x7f1f00072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1f06000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f0015fc20 0x7f1f00072c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1f06000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00160260 con 0x7f1f000c5020 2024-03-30T13:14:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1f06000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1f001600e0 con 0x7f1f000b4b20 2024-03-30T13:14:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1f06000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1f000d0630 con 0x7f1f0015fc20 2024-03-30T13:14:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1efea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f000c5020 0x7f1f00072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1efea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f000c5020 0x7f1f00072700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44144/0 (socket says 172.21.15.99:44144) 2024-03-30T13:14:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1efea00640 1 -- 172.21.15.99:0/310606510 learned_addr learned my addr 172.21.15.99:0/310606510 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1effe00640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f0015fc20 0x7f1f00072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1eff400640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f000b4b20 0x7f1f001537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1efea00640 1 -- 172.21.15.99:0/310606510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f0015fc20 msgr2=0x7f1f00072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1efea00640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f0015fc20 0x7f1f00072c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1efea00640 1 -- 172.21.15.99:0/310606510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f000b4b20 msgr2=0x7f1f001537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1efea00640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f000b4b20 0x7f1f001537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.485+0000 7f1efea00640 1 -- 172.21.15.99:0/310606510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f000c84e0 con 0x7f1f000c5020 2024-03-30T13:14:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.486+0000 7f1efea00640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f000c5020 0x7f1f00072700 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00c820 tx=0x7f1eec00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.486+0000 7f1ef7400640 1 -- 172.21.15.99:0/310606510 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec015070 con 0x7f1f000c5020 2024-03-30T13:14:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.486+0000 7f1ef7400640 1 -- 172.21.15.99:0/310606510 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eec007a30 con 0x7f1f000c5020 2024-03-30T13:14:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.486+0000 7f1ef7400640 1 -- 172.21.15.99:0/310606510 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec007e00 con 0x7f1f000c5020 2024-03-30T13:14:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.486+0000 7f1f06000640 1 -- 172.21.15.99:0/310606510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f00153cf0 con 0x7f1f000c5020 2024-03-30T13:14:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.486+0000 7f1f06000640 1 -- 172.21.15.99:0/310606510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f000c7720 con 0x7f1f000c5020 2024-03-30T13:14:34.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.487+0000 7f1f06000640 1 -- 172.21.15.99:0/310606510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f00068640 con 0x7f1f000c5020 2024-03-30T13:14:34.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.488+0000 7f1ef7400640 1 -- 172.21.15.99:0/310606510 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1eec018070 con 0x7f1f000c5020 2024-03-30T13:14:34.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.489+0000 7f1ef7400640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1ee006c560 0x7f1ee006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.489+0000 7f1ef7400640 1 -- 172.21.15.99:0/310606510 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f1eec08b410 con 0x7f1f000c5020 2024-03-30T13:14:34.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.489+0000 7f1eff400640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1ee006c560 0x7f1ee006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.490+0000 7f1eff400640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1ee006c560 0x7f1ee006ea20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0036000 tx=0x7f1ef0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:34.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.493+0000 7f1ef7400640 1 -- 172.21.15.99:0/310606510 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1eec059c90 con 0x7f1f000c5020 2024-03-30T13:14:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.692+0000 7f1f06000640 1 -- 172.21.15.99:0/310606510 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f1f0006f6c0 con 0x7f1ee006c560 2024-03-30T13:14:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.693+0000 7f1ef7400640 1 -- 172.21.15.99:0/310606510 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1f0006f6c0 con 0x7f1ee006c560 2024-03-30T13:14:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 4 to deep-scrub 2024-03-30T13:14:34.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.695+0000 7f1f06000640 1 -- 172.21.15.99:0/310606510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1ee006c560 msgr2=0x7f1ee006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.695+0000 7f1f06000640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1ee006c560 0x7f1ee006ea20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0036000 tx=0x7f1ef0008030 comp rx=0 tx=0).stop 2024-03-30T13:14:34.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.695+0000 7f1f06000640 1 -- 172.21.15.99:0/310606510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f000c5020 msgr2=0x7f1f00072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.695+0000 7f1f06000640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f000c5020 0x7f1f00072700 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00c820 tx=0x7f1eec00cc20 comp rx=0 tx=0).stop 2024-03-30T13:14:34.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.696+0000 7f1f06000640 1 -- 172.21.15.99:0/310606510 shutdown_connections 2024-03-30T13:14:34.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.696+0000 7f1f06000640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1ee006c560 0x7f1ee006ea20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.696+0000 7f1f06000640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f0015fc20 0x7f1f00072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.696+0000 7f1f06000640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f000c5020 0x7f1f00072700 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.696+0000 7f1f06000640 1 --2- 172.21.15.99:0/310606510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f000b4b20 0x7f1f001537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.696+0000 7f1f06000640 1 -- 172.21.15.99:0/310606510 >> 172.21.15.99:0/310606510 conn(0x7f1f0006b510 msgr2=0x7f1f0006dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:34.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.696+0000 7f1f06000640 1 -- 172.21.15.99:0/310606510 shutdown_connections 2024-03-30T13:14:34.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.696+0000 7f1f06000640 1 -- 172.21.15.99:0/310606510 wait complete. 2024-03-30T13:14:34.717 INFO:tasks.ceph:Scrubbing osd.5 2024-03-30T13:14:34.717 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:14:34.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.923+0000 7f5360a00640 1 Processor -- start 2024-03-30T13:14:34.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.924+0000 7f5360a00640 1 -- start start 2024-03-30T13:14:34.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.925+0000 7f5360a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f535c15d630 0x7f535c0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.925+0000 7f5360a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f535c0d09d0 0x7f535c160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.925+0000 7f5360a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535c06e300 con 0x7f535c156ba0 2024-03-30T13:14:34.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.925+0000 7f5360a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f535c06e5e0 con 0x7f535c0d09d0 2024-03-30T13:14:34.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.925+0000 7f5360a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f535c15ce50 con 0x7f535c15d630 2024-03-30T13:14:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.926+0000 7f535a800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f535c0d09d0 0x7f535c160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.926+0000 7f5359400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f535c15d630 0x7f535c0d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.926+0000 7f5359400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f535c15d630 0x7f535c0d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.99:46386/0 (socket says 172.21.15.99:46386) 2024-03-30T13:14:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.926+0000 7f5359e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f535c156ba0 0x7f535c06d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:57152/0 (socket says 172.21.15.99:57152) 2024-03-30T13:14:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.926+0000 7f5359400640 1 -- 172.21.15.99:0/3799486923 learned_addr learned my addr 172.21.15.99:0/3799486923 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.927+0000 7f5359400640 1 -- 172.21.15.99:0/3799486923 >> v2:172.21.15.181:3300/0 conn(0x7f535c0d09d0 msgr2=0x7f535c160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.927+0000 7f5359400640 1 --2- 172.21.15.99:0/3799486923 >> v2:172.21.15.181:3300/0 conn(0x7f535c0d09d0 0x7f535c160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.927+0000 7f5359400640 1 -- 172.21.15.99:0/3799486923 >> v1:172.21.15.181:6789/0 conn(0x7f535c156ba0 legacy=0x7f535c06d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.927+0000 7f5359400640 1 -- 172.21.15.99:0/3799486923 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c15d130 con 0x7f535c15d630 2024-03-30T13:14:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.928+0000 7f5359400640 1 --2- 172.21.15.99:0/3799486923 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f535c15d630 0x7f535c0d0490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5348009870 tx=0x7f534802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b980247031bbdf3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.929+0000 7f5358a00640 1 -- 172.21.15.99:0/3799486923 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348035020 con 0x7f535c15d630 2024-03-30T13:14:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.929+0000 7f5358a00640 1 -- 172.21.15.99:0/3799486923 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5348031640 con 0x7f535c15d630 2024-03-30T13:14:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.929+0000 7f5358a00640 1 -- 172.21.15.99:0/3799486923 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534802d040 con 0x7f535c15d630 2024-03-30T13:14:34.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.929+0000 7f5360a00640 1 -- 172.21.15.99:0/3799486923 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f535c15d630 msgr2=0x7f535c0d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.929+0000 7f5360a00640 1 --2- 172.21.15.99:0/3799486923 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f535c15d630 0x7f535c0d0490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5348009870 tx=0x7f534802b8f0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.929+0000 7f5360a00640 1 -- 172.21.15.99:0/3799486923 shutdown_connections 2024-03-30T13:14:34.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.929+0000 7f5360a00640 1 --2- 172.21.15.99:0/3799486923 >> v2:172.21.15.181:3300/0 conn(0x7f535c0d09d0 0x7f535c160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.929+0000 7f5360a00640 1 --2- 172.21.15.99:0/3799486923 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f535c15d630 0x7f535c0d0490 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.929+0000 7f5360a00640 1 -- 172.21.15.99:0/3799486923 >> 172.21.15.99:0/3799486923 conn(0x7f535c06b6f0 msgr2=0x7f535c06bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:34.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.929+0000 7f5360a00640 1 -- 172.21.15.99:0/3799486923 shutdown_connections 2024-03-30T13:14:34.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.930+0000 7f5360a00640 1 -- 172.21.15.99:0/3799486923 wait complete. 2024-03-30T13:14:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.932+0000 7f5360a00640 1 Processor -- start 2024-03-30T13:14:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.932+0000 7f5360a00640 1 -- start start 2024-03-30T13:14:34.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.933+0000 7f5360a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f535c0d09d0 0x7f535c1f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.933+0000 7f5360a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f535c156ba0 0x7f535c14ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.933+0000 7f5360a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f535c15d630 0x7f535c0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.933+0000 7f5360a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f535c0ad3d0 con 0x7f535c0d09d0 2024-03-30T13:14:34.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.933+0000 7f5360a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f535c15dac0 con 0x7f535c15d630 2024-03-30T13:14:34.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.933+0000 7f5360a00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f535c156f80 con 0x7f535c156ba0 2024-03-30T13:14:34.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.933+0000 7f5359e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f535c0d09d0 0x7f535c1f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f5359e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f535c0d09d0 0x7f535c1f7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45858/0 (socket says 172.21.15.99:45858) 2024-03-30T13:14:34.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f5359e00640 1 -- 172.21.15.99:0/2203527646 learned_addr learned my addr 172.21.15.99:0/2203527646 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:34.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f535a800640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f535c15d630 0x7f535c0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f5359400640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f535c156ba0 0x7f535c14ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f5359e00640 1 -- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f535c156ba0 msgr2=0x7f535c14ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f5359e00640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f535c156ba0 0x7f535c14ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f5359e00640 1 -- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f535c15d630 msgr2=0x7f535c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f5359e00640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f535c15d630 0x7f535c0b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f5359e00640 1 -- 172.21.15.99:0/2203527646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c152000 con 0x7f535c0d09d0 2024-03-30T13:14:34.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f535a800640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f535c15d630 0x7f535c0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:34.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f5359e00640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f535c0d09d0 0x7f535c1f7770 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f534c00c4d0 tx=0x7f534c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:34.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.934+0000 7f5352000640 1 -- 172.21.15.99:0/2203527646 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c018070 con 0x7f535c0d09d0 2024-03-30T13:14:34.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.935+0000 7f5352000640 1 -- 172.21.15.99:0/2203527646 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534c007480 con 0x7f535c0d09d0 2024-03-30T13:14:34.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.935+0000 7f5352000640 1 -- 172.21.15.99:0/2203527646 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c0049e0 con 0x7f535c0d09d0 2024-03-30T13:14:34.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.935+0000 7f5360a00640 1 -- 172.21.15.99:0/2203527646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535c152630 con 0x7f535c0d09d0 2024-03-30T13:14:34.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.935+0000 7f5360a00640 1 -- 172.21.15.99:0/2203527646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535c1f7cb0 con 0x7f535c0d09d0 2024-03-30T13:14:34.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.936+0000 7f5360a00640 1 -- 172.21.15.99:0/2203527646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f535c068640 con 0x7f535c0d09d0 2024-03-30T13:14:34.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.937+0000 7f5352000640 1 -- 172.21.15.99:0/2203527646 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f534c004b80 con 0x7f535c0d09d0 2024-03-30T13:14:34.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.938+0000 7f5352000640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f533c06c530 0x7f533c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.938+0000 7f5352000640 1 -- 172.21.15.99:0/2203527646 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f534c08a5a0 con 0x7f535c0d09d0 2024-03-30T13:14:34.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.938+0000 7f5359400640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f533c06c530 0x7f533c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.938+0000 7f5352000640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] conn(0x7f533c0723f0 0x7f533c074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:34.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.938+0000 7f5352000640 1 -- 172.21.15.99:0/2203527646 --> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f534c016e50 con 0x7f533c0723f0 2024-03-30T13:14:34.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.938+0000 7f5352000640 1 -- 172.21.15.99:0/2203527646 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f534c091050 con 0x7f535c0d09d0 2024-03-30T13:14:34.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.939+0000 7f5359400640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f533c06c530 0x7f533c06e9f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5348036000 tx=0x7f5348008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:34.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.939+0000 7f535a800640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] conn(0x7f533c0723f0 0x7f533c074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:34.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.940+0000 7f535a800640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] conn(0x7f533c0723f0 0x7f533c074810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:34.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.942+0000 7f5352000640 1 -- 172.21.15.99:0/2203527646 <== osd.5 v2:172.21.15.181:6816/3756128771 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f534c016e50 con 0x7f533c0723f0 2024-03-30T13:14:34.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.956+0000 7f5360a00640 1 -- 172.21.15.99:0/2203527646 --> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f535c146db0 con 0x7f533c0723f0 2024-03-30T13:14:34.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.957+0000 7f5352000640 1 -- 172.21.15.99:0/2203527646 <== osd.5 v2:172.21.15.181:6816/3756128771 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f535c146db0 con 0x7f533c0723f0 2024-03-30T13:14:34.961 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:34.961 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:14:34.961 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:34.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.958+0000 7f5360a00640 1 -- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] conn(0x7f533c0723f0 msgr2=0x7f533c074810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.958+0000 7f5360a00640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.181:6816/3756128771,v1:172.21.15.181:6818/3756128771] conn(0x7f533c0723f0 0x7f533c074810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.958+0000 7f5360a00640 1 -- 172.21.15.99:0/2203527646 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f533c06c530 msgr2=0x7f533c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.958+0000 7f5360a00640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f533c06c530 0x7f533c06e9f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5348036000 tx=0x7f5348008030 comp rx=0 tx=0).stop 2024-03-30T13:14:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.958+0000 7f5360a00640 1 -- 172.21.15.99:0/2203527646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f535c0d09d0 msgr2=0x7f535c1f7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.958+0000 7f5360a00640 1 --2- 172.21.15.99:0/2203527646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f535c0d09d0 0x7f535c1f7770 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f534c00c4d0 tx=0x7f534c00c990 comp rx=0 tx=0).stop 2024-03-30T13:14:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.958+0000 7f535a800640 1 -- 172.21.15.99:0/2203527646 reap_dead start 2024-03-30T13:14:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.958+0000 7f5360a00640 1 -- 172.21.15.99:0/2203527646 shutdown_connections 2024-03-30T13:14:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.958+0000 7f5360a00640 1 -- 172.21.15.99:0/2203527646 >> 172.21.15.99:0/2203527646 conn(0x7f535c06b6f0 msgr2=0x7f535c15f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.958+0000 7f5360a00640 1 -- 172.21.15.99:0/2203527646 shutdown_connections 2024-03-30T13:14:34.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:34.958+0000 7f5360a00640 1 -- 172.21.15.99:0/2203527646 wait complete. 2024-03-30T13:14:34.980 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-30T13:14:35.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.184+0000 7f24c2000640 1 Processor -- start 2024-03-30T13:14:35.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.185+0000 7f24c2000640 1 -- start start 2024-03-30T13:14:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.186+0000 7f24c2000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f24bc15fc20 0x7f24bc0c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.186+0000 7f24c2000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ccbe0 0x7f24bc0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.186+0000 7f24c2000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24bc160480 con 0x7f24bc0c5020 2024-03-30T13:14:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.186+0000 7f24c2000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f24bc161090 con 0x7f24bc15fc20 2024-03-30T13:14:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.186+0000 7f24c2000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f24bc160760 con 0x7f24bc0ccbe0 2024-03-30T13:14:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.186+0000 7f24b3e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f24bc0c5020 0x7f24bc0d00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45542/0 (socket says 172.21.15.99:45542) 2024-03-30T13:14:35.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.186+0000 7f24b3e00640 1 -- 172.21.15.99:0/484146464 learned_addr learned my addr 172.21.15.99:0/484146464 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:35.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24bb400640 1 --2- 172.21.15.99:0/484146464 >> v2:172.21.15.181:3300/0 conn(0x7f24bc15fc20 0x7f24bc0c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24bbe00640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ccbe0 0x7f24bc0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51983507 0 0) 0x7f24bc160480 con 0x7f24bc0c5020 2024-03-30T13:14:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24a0003520 con 0x7f24bc0c5020 2024-03-30T13:14:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 245020007 0 0) 0x7f24a0003520 con 0x7f24bc0c5020 2024-03-30T13:14:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ccbe0 msgr2=0x7f24bc0c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24baa00640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ccbe0 0x7f24bc0c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 >> v2:172.21.15.181:3300/0 conn(0x7f24bc15fc20 msgr2=0x7f24bc0c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24baa00640 1 --2- 172.21.15.99:0/484146464 >> v2:172.21.15.181:3300/0 conn(0x7f24bc15fc20 0x7f24bc0c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc160a40 con 0x7f24bc0c5020 2024-03-30T13:14:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1585066904 0 0) 0x7f24a4001670 con 0x7f24bc0c5020 2024-03-30T13:14:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.187+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 >> v1:172.21.15.99:6789/0 conn(0x7f24bc0c5020 legacy=0x7f24bc0d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24baa00640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ccbe0 0x7f24a00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24baa00640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a0003f80 0x7f24a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24baa00640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 0x7f24a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc161090 con 0x7f24a0004d40 2024-03-30T13:14:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc160760 con 0x7f24a0003f80 2024-03-30T13:14:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f24a000ba70 con 0x7f24bc0ccbe0 2024-03-30T13:14:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24bbe00640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 0x7f24a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24b3e00640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a0003f80 0x7f24a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24bb400640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ccbe0 0x7f24a00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24bbe00640 1 -- 172.21.15.99:0/484146464 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ccbe0 msgr2=0x7f24a00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24bbe00640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ccbe0 0x7f24a00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24bbe00640 1 -- 172.21.15.99:0/484146464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a0003f80 msgr2=0x7f24a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24bbe00640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a0003f80 0x7f24a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.188+0000 7f24bbe00640 1 -- 172.21.15.99:0/484146464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a0003520 con 0x7f24a0004d40 2024-03-30T13:14:35.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.189+0000 7f24bbe00640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 0x7f24a00051c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009f90 tx=0x7f24a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bee5c8f6c5faca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:35.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.190+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4039070 con 0x7f24a0004d40 2024-03-30T13:14:35.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.190+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b402cbd0 con 0x7f24a0004d40 2024-03-30T13:14:35.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.190+0000 7f24baa00640 1 -- 172.21.15.99:0/484146464 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4009c10 con 0x7f24a0004d40 2024-03-30T13:14:35.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.190+0000 7f24c2000640 1 -- 172.21.15.99:0/484146464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 msgr2=0x7f24a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.190+0000 7f24c2000640 1 --2- 172.21.15.99:0/484146464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 0x7f24a00051c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009f90 tx=0x7f24a0005830 comp rx=0 tx=0).stop 2024-03-30T13:14:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.190+0000 7f24bbe00640 1 -- 172.21.15.99:0/484146464 reap_dead start 2024-03-30T13:14:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.190+0000 7f24c2000640 1 -- 172.21.15.99:0/484146464 shutdown_connections 2024-03-30T13:14:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.190+0000 7f24c2000640 1 -- 172.21.15.99:0/484146464 >> 172.21.15.99:0/484146464 conn(0x7f24bc06b510 msgr2=0x7f24bc06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.190+0000 7f24c2000640 1 -- 172.21.15.99:0/484146464 shutdown_connections 2024-03-30T13:14:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.190+0000 7f24c2000640 1 -- 172.21.15.99:0/484146464 wait complete. 2024-03-30T13:14:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.192+0000 7f24c2000640 1 Processor -- start 2024-03-30T13:14:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.192+0000 7f24c2000640 1 -- start start 2024-03-30T13:14:35.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.193+0000 7f24c2000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 0x7f24bc099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.193+0000 7f24c2000640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ad330 0x7f24bc0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.193+0000 7f24c2000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24bc0c7230 0x7f24bc0c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.193+0000 7f24c2000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc160260 con 0x7f24a0004d40 2024-03-30T13:14:35.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.193+0000 7f24c2000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1600e0 con 0x7f24bc0c7230 2024-03-30T13:14:35.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.193+0000 7f24c2000640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f24bc0b4b20 con 0x7f24bc0ad330 2024-03-30T13:14:35.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.193+0000 7f24bb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 0x7f24bc099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.194+0000 7f24bb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 0x7f24bc099900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45872/0 (socket says 172.21.15.99:45872) 2024-03-30T13:14:35.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.194+0000 7f24bb400640 1 -- 172.21.15.99:0/1437544708 learned_addr learned my addr 172.21.15.99:0/1437544708 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:35.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.194+0000 7f24b3e00640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ad330 0x7f24bc0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.194+0000 7f24bb400640 1 -- 172.21.15.99:0/1437544708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ad330 msgr2=0x7f24bc0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.194+0000 7f24bb400640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ad330 0x7f24bc0ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.194+0000 7f24bb400640 1 -- 172.21.15.99:0/1437544708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24bc0c7230 msgr2=0x7f24bc0c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.194+0000 7f24bb400640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24bc0c7230 0x7f24bc0c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.194+0000 7f24bb400640 1 -- 172.21.15.99:0/1437544708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc0cea90 con 0x7f24a0004d40 2024-03-30T13:14:35.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.194+0000 7f24bb400640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 0x7f24bc099900 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f24ac011700 tx=0x7f24ac011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:35.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.195+0000 7f24b3400640 1 -- 172.21.15.99:0/1437544708 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00f8e0 con 0x7f24a0004d40 2024-03-30T13:14:35.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.195+0000 7f24b3400640 1 -- 172.21.15.99:0/1437544708 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ac00fa80 con 0x7f24a0004d40 2024-03-30T13:14:35.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.195+0000 7f24b3400640 1 -- 172.21.15.99:0/1437544708 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00fe30 con 0x7f24a0004d40 2024-03-30T13:14:35.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.195+0000 7f24c2000640 1 -- 172.21.15.99:0/1437544708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc0ced70 con 0x7f24a0004d40 2024-03-30T13:14:35.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.195+0000 7f24c2000640 1 -- 172.21.15.99:0/1437544708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24bc0cf330 con 0x7f24a0004d40 2024-03-30T13:14:35.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.196+0000 7f24c2000640 1 -- 172.21.15.99:0/1437544708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24bc160480 con 0x7f24a0004d40 2024-03-30T13:14:35.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.197+0000 7f24b3400640 1 -- 172.21.15.99:0/1437544708 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f24ac015460 con 0x7f24a0004d40 2024-03-30T13:14:35.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.198+0000 7f24b3400640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f249806c560 0x7f249806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.198+0000 7f24b3400640 1 -- 172.21.15.99:0/1437544708 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f24ac08bd70 con 0x7f24a0004d40 2024-03-30T13:14:35.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.198+0000 7f24b3e00640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f249806c560 0x7f249806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.199+0000 7f24b3e00640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f249806c560 0x7f249806ea20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0cfea0 tx=0x7f24a4000ff0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:35.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.203+0000 7f24b3400640 1 -- 172.21.15.99:0/1437544708 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f24bc160480 con 0x7f24a0004d40 2024-03-30T13:14:35.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.401+0000 7f24c2000640 1 -- 172.21.15.99:0/1437544708 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f24bc068640 con 0x7f249806c560 2024-03-30T13:14:35.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.402+0000 7f24b3400640 1 -- 172.21.15.99:0/1437544708 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f24bc068640 con 0x7f249806c560 2024-03-30T13:14:35.405 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 5 to deep-scrub 2024-03-30T13:14:35.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.404+0000 7f24c2000640 1 -- 172.21.15.99:0/1437544708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f249806c560 msgr2=0x7f249806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.404+0000 7f24c2000640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f249806c560 0x7f249806ea20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0cfea0 tx=0x7f24a4000ff0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.404+0000 7f24c2000640 1 -- 172.21.15.99:0/1437544708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 msgr2=0x7f24bc099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.404+0000 7f24c2000640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 0x7f24bc099900 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f24ac011700 tx=0x7f24ac011bc0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.404+0000 7f24c2000640 1 -- 172.21.15.99:0/1437544708 shutdown_connections 2024-03-30T13:14:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.404+0000 7f24c2000640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f249806c560 0x7f249806ea20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.404+0000 7f24c2000640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24bc0c7230 0x7f24bc0c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.404+0000 7f24c2000640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24bc0ad330 0x7f24bc0ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.404+0000 7f24c2000640 1 --2- 172.21.15.99:0/1437544708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24a0004d40 0x7f24bc099900 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.404+0000 7f24c2000640 1 -- 172.21.15.99:0/1437544708 >> 172.21.15.99:0/1437544708 conn(0x7f24bc06b510 msgr2=0x7f24bc0b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:35.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.405+0000 7f24c2000640 1 -- 172.21.15.99:0/1437544708 shutdown_connections 2024-03-30T13:14:35.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.405+0000 7f24c2000640 1 -- 172.21.15.99:0/1437544708 wait complete. 2024-03-30T13:14:35.428 INFO:tasks.ceph:Scrubbing osd.6 2024-03-30T13:14:35.429 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:14:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.636+0000 7fba8ae00640 1 Processor -- start 2024-03-30T13:14:35.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.637+0000 7fba8ae00640 1 -- start start 2024-03-30T13:14:35.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.638+0000 7fba8ae00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba8415c4d0 0x7fba840b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.638+0000 7fba8ae00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fba840b5350 0x7fba840ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.638+0000 7fba8ae00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba8406ea80 con 0x7fba840cd010 2024-03-30T13:14:35.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.638+0000 7fba8ae00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fba8406f320 con 0x7fba840b5350 2024-03-30T13:14:35.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.638+0000 7fba8ae00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fba8406ed60 con 0x7fba8415c4d0 2024-03-30T13:14:35.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.639+0000 7fba89000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fba840b5350 0x7fba840ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.639+0000 7fba89a00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba8415c4d0 0x7fba840b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.639+0000 7fba8a400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fba840cd010 0x7fba84160130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:57156/0 (socket says 172.21.15.99:57156) 2024-03-30T13:14:35.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.639+0000 7fba8a400640 1 -- 172.21.15.99:0/2537790562 learned_addr learned my addr 172.21.15.99:0/2537790562 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:35.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.640+0000 7fba89a00640 1 -- 172.21.15.99:0/2537790562 >> v2:172.21.15.181:3300/0 conn(0x7fba840b5350 msgr2=0x7fba840ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:35.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.640+0000 7fba89a00640 1 --2- 172.21.15.99:0/2537790562 >> v2:172.21.15.181:3300/0 conn(0x7fba840b5350 0x7fba840ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.640+0000 7fba89a00640 1 -- 172.21.15.99:0/2537790562 >> v1:172.21.15.181:6789/0 conn(0x7fba840cd010 legacy=0x7fba84160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.640+0000 7fba89a00640 1 -- 172.21.15.99:0/2537790562 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8406f040 con 0x7fba8415c4d0 2024-03-30T13:14:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.641+0000 7fba89a00640 1 --2- 172.21.15.99:0/2537790562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba8415c4d0 0x7fba840b4e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba780097a0 tx=0x7fba7802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e6c24df22226e8f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.642+0000 7fba83e00640 1 -- 172.21.15.99:0/2537790562 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78035020 con 0x7fba8415c4d0 2024-03-30T13:14:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.642+0000 7fba83e00640 1 -- 172.21.15.99:0/2537790562 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba78031810 con 0x7fba8415c4d0 2024-03-30T13:14:35.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.642+0000 7fba83e00640 1 -- 172.21.15.99:0/2537790562 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78031be0 con 0x7fba8415c4d0 2024-03-30T13:14:35.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.643+0000 7fba8ae00640 1 -- 172.21.15.99:0/2537790562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba8415c4d0 msgr2=0x7fba840b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.643+0000 7fba8ae00640 1 --2- 172.21.15.99:0/2537790562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba8415c4d0 0x7fba840b4e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba780097a0 tx=0x7fba7802b8b0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.643+0000 7fba8ae00640 1 -- 172.21.15.99:0/2537790562 shutdown_connections 2024-03-30T13:14:35.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.643+0000 7fba8ae00640 1 --2- 172.21.15.99:0/2537790562 >> v2:172.21.15.181:3300/0 conn(0x7fba840b5350 0x7fba840ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.643+0000 7fba8ae00640 1 --2- 172.21.15.99:0/2537790562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba8415c4d0 0x7fba840b4e10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.643+0000 7fba8ae00640 1 -- 172.21.15.99:0/2537790562 >> 172.21.15.99:0/2537790562 conn(0x7fba840b1db0 msgr2=0x7fba840b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:35.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.643+0000 7fba8ae00640 1 -- 172.21.15.99:0/2537790562 shutdown_connections 2024-03-30T13:14:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.643+0000 7fba8ae00640 1 -- 172.21.15.99:0/2537790562 wait complete. 2024-03-30T13:14:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.645+0000 7fba8ae00640 1 Processor -- start 2024-03-30T13:14:35.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.645+0000 7fba8ae00640 1 -- start start 2024-03-30T13:14:35.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.646+0000 7fba8ae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba840b5350 0x7fba8409abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.646+0000 7fba8ae00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba840cd010 0x7fba8414c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.646+0000 7fba8ae00640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba8415c4d0 0x7fba841581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.646+0000 7fba8ae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fba8415ca30 con 0x7fba840b5350 2024-03-30T13:14:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.646+0000 7fba8ae00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fba8415c8b0 con 0x7fba840cd010 2024-03-30T13:14:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.646+0000 7fba8ae00640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fba8406e610 con 0x7fba8415c4d0 2024-03-30T13:14:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.647+0000 7fba89a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba840b5350 0x7fba8409abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.647+0000 7fba89a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba840b5350 0x7fba8409abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45874/0 (socket says 172.21.15.99:45874) 2024-03-30T13:14:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.647+0000 7fba89a00640 1 -- 172.21.15.99:0/2092265822 learned_addr learned my addr 172.21.15.99:0/2092265822 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.647+0000 7fba89000640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba840cd010 0x7fba8414c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.647+0000 7fba8a400640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba8415c4d0 0x7fba841581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.647+0000 7fba89a00640 1 -- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba8415c4d0 msgr2=0x7fba841581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.647+0000 7fba89a00640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba8415c4d0 0x7fba841581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.647+0000 7fba89a00640 1 -- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba840cd010 msgr2=0x7fba8414c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.647+0000 7fba89a00640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba840cd010 0x7fba8414c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.647+0000 7fba89a00640 1 -- 172.21.15.99:0/2092265822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8415cbb0 con 0x7fba840b5350 2024-03-30T13:14:35.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.647+0000 7fba89000640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba840cd010 0x7fba8414c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:35.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.648+0000 7fba89a00640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba840b5350 0x7fba8409abb0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fba780098c0 tx=0x7fba780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:35.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.648+0000 7fba81600640 1 -- 172.21.15.99:0/2092265822 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78041070 con 0x7fba840b5350 2024-03-30T13:14:35.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.648+0000 7fba81600640 1 -- 172.21.15.99:0/2092265822 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7803ad00 con 0x7fba840b5350 2024-03-30T13:14:35.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.648+0000 7fba8ae00640 1 -- 172.21.15.99:0/2092265822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8415ce90 con 0x7fba840b5350 2024-03-30T13:14:35.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.648+0000 7fba81600640 1 -- 172.21.15.99:0/2092265822 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78035040 con 0x7fba840b5350 2024-03-30T13:14:35.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.648+0000 7fba8ae00640 1 -- 172.21.15.99:0/2092265822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8415d450 con 0x7fba840b5350 2024-03-30T13:14:35.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.649+0000 7fba8ae00640 1 -- 172.21.15.99:0/2092265822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fba8409b0f0 con 0x7fba840b5350 2024-03-30T13:14:35.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.650+0000 7fba81600640 1 -- 172.21.15.99:0/2092265822 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fba78038020 con 0x7fba840b5350 2024-03-30T13:14:35.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.651+0000 7fba81600640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fba6406c530 0x7fba6406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.651+0000 7fba81600640 1 -- 172.21.15.99:0/2092265822 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7fba780ad070 con 0x7fba840b5350 2024-03-30T13:14:35.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.651+0000 7fba89000640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fba6406c530 0x7fba6406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.651+0000 7fba81600640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] conn(0x7fba640723f0 0x7fba64074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.652+0000 7fba81600640 1 -- 172.21.15.99:0/2092265822 --> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba7804be50 con 0x7fba640723f0 2024-03-30T13:14:35.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.652+0000 7fba81600640 1 -- 172.21.15.99:0/2092265822 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fba780b4050 con 0x7fba840b5350 2024-03-30T13:14:35.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.652+0000 7fba89000640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fba6406c530 0x7fba6406e9f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fba8409a810 tx=0x7fba70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:35.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.652+0000 7fba8a400640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] conn(0x7fba640723f0 0x7fba64074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.653+0000 7fba8a400640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] conn(0x7fba640723f0 0x7fba64074810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:35.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.655+0000 7fba81600640 1 -- 172.21.15.99:0/2092265822 <== osd.6 v2:172.21.15.181:6808/2603803749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fba7804be50 con 0x7fba640723f0 2024-03-30T13:14:35.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.670+0000 7fba8ae00640 1 -- 172.21.15.99:0/2092265822 --> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fba8404f8f0 con 0x7fba640723f0 2024-03-30T13:14:35.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.671+0000 7fba81600640 1 -- 172.21.15.99:0/2092265822 <== osd.6 v2:172.21.15.181:6808/2603803749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fba8404f8f0 con 0x7fba640723f0 2024-03-30T13:14:35.675 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:35.675 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:14:35.675 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.672+0000 7fba8ae00640 1 -- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] conn(0x7fba640723f0 msgr2=0x7fba64074810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.672+0000 7fba8ae00640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.181:6808/2603803749,v1:172.21.15.181:6809/2603803749] conn(0x7fba640723f0 0x7fba64074810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.672+0000 7fba8ae00640 1 -- 172.21.15.99:0/2092265822 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fba6406c530 msgr2=0x7fba6406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.672+0000 7fba8ae00640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fba6406c530 0x7fba6406e9f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fba8409a810 tx=0x7fba70008040 comp rx=0 tx=0).stop 2024-03-30T13:14:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.672+0000 7fba8ae00640 1 -- 172.21.15.99:0/2092265822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba840b5350 msgr2=0x7fba8409abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.672+0000 7fba8ae00640 1 --2- 172.21.15.99:0/2092265822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba840b5350 0x7fba8409abb0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fba780098c0 tx=0x7fba780046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.672+0000 7fba8a400640 1 -- 172.21.15.99:0/2092265822 reap_dead start 2024-03-30T13:14:35.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.672+0000 7fba8ae00640 1 -- 172.21.15.99:0/2092265822 shutdown_connections 2024-03-30T13:14:35.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.672+0000 7fba8ae00640 1 -- 172.21.15.99:0/2092265822 >> 172.21.15.99:0/2092265822 conn(0x7fba840b1db0 msgr2=0x7fba8406d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:35.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.672+0000 7fba8ae00640 1 -- 172.21.15.99:0/2092265822 shutdown_connections 2024-03-30T13:14:35.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.672+0000 7fba8ae00640 1 -- 172.21.15.99:0/2092265822 wait complete. 2024-03-30T13:14:35.695 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-30T13:14:35.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.909+0000 7f6ad8200640 1 Processor -- start 2024-03-30T13:14:35.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.909+0000 7f6ad8200640 1 -- start start 2024-03-30T13:14:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.911+0000 7f6ad8200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6ad00d1730 0x7f6ad009b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.911+0000 7f6ad8200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ad006fa80 0x7f6ad015e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.911+0000 7f6ad8200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad0070020 con 0x7f6ad0162400 2024-03-30T13:14:35.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.911+0000 7f6ad8200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad0070300 con 0x7f6ad006fa80 2024-03-30T13:14:35.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.911+0000 7f6ad8200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad00705e0 con 0x7f6ad00d1730 2024-03-30T13:14:35.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.911+0000 7f6ad6200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ad006fa80 0x7f6ad015e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.911+0000 7f6ad6200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ad006fa80 0x7f6ad015e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45884/0 (socket says 172.21.15.99:45884) 2024-03-30T13:14:35.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.911+0000 7f6ad5800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6ad0162400 0x7f6ad01627e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45554/0 (socket says 172.21.15.99:45554) 2024-03-30T13:14:35.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.911+0000 7f6ad6200640 1 -- 172.21.15.99:0/3574519251 learned_addr learned my addr 172.21.15.99:0/3574519251 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:35.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.912+0000 7f6ad4e00640 1 --2- 172.21.15.99:0/3574519251 >> v2:172.21.15.181:3300/0 conn(0x7f6ad00d1730 0x7f6ad009b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.912+0000 7f6ad6200640 1 -- 172.21.15.99:0/3574519251 >> v2:172.21.15.181:3300/0 conn(0x7f6ad00d1730 msgr2=0x7f6ad009b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:35.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.912+0000 7f6ad6200640 1 --2- 172.21.15.99:0/3574519251 >> v2:172.21.15.181:3300/0 conn(0x7f6ad00d1730 0x7f6ad009b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.912+0000 7f6ad6200640 1 -- 172.21.15.99:0/3574519251 >> v1:172.21.15.99:6789/0 conn(0x7f6ad0162400 legacy=0x7f6ad01627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.912+0000 7f6ad6200640 1 -- 172.21.15.99:0/3574519251 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad00708c0 con 0x7f6ad006fa80 2024-03-30T13:14:35.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.913+0000 7f6ad6200640 1 --2- 172.21.15.99:0/3574519251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ad006fa80 0x7f6ad015e020 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009e50 tx=0x7f6ac802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e058a509b6174981 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:35.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.913+0000 7f6acfe00640 1 -- 172.21.15.99:0/3574519251 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac802cb20 con 0x7f6ad006fa80 2024-03-30T13:14:35.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.914+0000 7f6acfe00640 1 -- 172.21.15.99:0/3574519251 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac802ccc0 con 0x7f6ad006fa80 2024-03-30T13:14:35.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.914+0000 7f6acfe00640 1 -- 172.21.15.99:0/3574519251 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8034610 con 0x7f6ad006fa80 2024-03-30T13:14:35.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.914+0000 7f6ad8200640 1 -- 172.21.15.99:0/3574519251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ad006fa80 msgr2=0x7f6ad015e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.914+0000 7f6ad8200640 1 --2- 172.21.15.99:0/3574519251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ad006fa80 0x7f6ad015e020 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009e50 tx=0x7f6ac802bf80 comp rx=0 tx=0).stop 2024-03-30T13:14:35.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.914+0000 7f6ad8200640 1 -- 172.21.15.99:0/3574519251 shutdown_connections 2024-03-30T13:14:35.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.914+0000 7f6ad8200640 1 --2- 172.21.15.99:0/3574519251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ad006fa80 0x7f6ad015e020 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.914+0000 7f6ad8200640 1 --2- 172.21.15.99:0/3574519251 >> v2:172.21.15.181:3300/0 conn(0x7f6ad00d1730 0x7f6ad009b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.914+0000 7f6ad8200640 1 -- 172.21.15.99:0/3574519251 >> 172.21.15.99:0/3574519251 conn(0x7f6ad00d23b0 msgr2=0x7f6ad00d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:35.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.914+0000 7f6ad8200640 1 -- 172.21.15.99:0/3574519251 shutdown_connections 2024-03-30T13:14:35.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.914+0000 7f6ad8200640 1 -- 172.21.15.99:0/3574519251 wait complete. 2024-03-30T13:14:35.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.916+0000 7f6ad8200640 1 Processor -- start 2024-03-30T13:14:35.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.916+0000 7f6ad8200640 1 -- start start 2024-03-30T13:14:35.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.917+0000 7f6ad8200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ad006fa80 0x7f6ad00aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.917+0000 7f6ad8200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ad00d1730 0x7f6ad01f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.917+0000 7f6ad8200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ad0162400 0x7f6ad01f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.917+0000 7f6ad8200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad00ce720 con 0x7f6ad006fa80 2024-03-30T13:14:35.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.917+0000 7f6ad8200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad009bb10 con 0x7f6ad0162400 2024-03-30T13:14:35.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.917+0000 7f6ad8200640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad00ce8a0 con 0x7f6ad00d1730 2024-03-30T13:14:35.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.917+0000 7f6ad5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ad006fa80 0x7f6ad00aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.917+0000 7f6ad5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ad006fa80 0x7f6ad00aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45894/0 (socket says 172.21.15.99:45894) 2024-03-30T13:14:35.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.917+0000 7f6ad5800640 1 -- 172.21.15.99:0/166189218 learned_addr learned my addr 172.21.15.99:0/166189218 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:35.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6ad6200640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ad0162400 0x7f6ad01f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6ad5800640 1 -- 172.21.15.99:0/166189218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ad00d1730 msgr2=0x7f6ad01f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6ad4e00640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ad00d1730 0x7f6ad01f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6ad5800640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ad00d1730 0x7f6ad01f7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6ad5800640 1 -- 172.21.15.99:0/166189218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ad0162400 msgr2=0x7f6ad01f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:35.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6ad5800640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ad0162400 0x7f6ad01f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:35.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6ad5800640 1 -- 172.21.15.99:0/166189218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad01f6180 con 0x7f6ad006fa80 2024-03-30T13:14:35.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6ad6200640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ad0162400 0x7f6ad01f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:35.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6ad4e00640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ad00d1730 0x7f6ad01f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:35.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6ad5800640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ad006fa80 0x7f6ad00aff60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400c400 tx=0x7f6ac400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:35.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6acd600640 1 -- 172.21.15.99:0/166189218 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac40074e0 con 0x7f6ad006fa80 2024-03-30T13:14:35.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6acd600640 1 -- 172.21.15.99:0/166189218 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac4007680 con 0x7f6ad006fa80 2024-03-30T13:14:35.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.918+0000 7f6ad8200640 1 -- 172.21.15.99:0/166189218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad00b05b0 con 0x7f6ad006fa80 2024-03-30T13:14:35.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.919+0000 7f6acd600640 1 -- 172.21.15.99:0/166189218 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4004a00 con 0x7f6ad006fa80 2024-03-30T13:14:35.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.919+0000 7f6ad8200640 1 -- 172.21.15.99:0/166189218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad00b24e0 con 0x7f6ad006fa80 2024-03-30T13:14:35.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.920+0000 7f6ad8200640 1 -- 172.21.15.99:0/166189218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad0068d50 con 0x7f6ad006fa80 2024-03-30T13:14:35.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.921+0000 7f6acd600640 1 -- 172.21.15.99:0/166189218 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6ac401a020 con 0x7f6ad006fa80 2024-03-30T13:14:35.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.921+0000 7f6acd600640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6ab006c560 0x7f6ab006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:35.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.922+0000 7f6acd600640 1 -- 172.21.15.99:0/166189218 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f6ac408abd0 con 0x7f6ad006fa80 2024-03-30T13:14:35.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.922+0000 7f6ad4e00640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6ab006c560 0x7f6ab006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:35.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.922+0000 7f6ad4e00640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6ab006c560 0x7f6ab006ea20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6abc006fd0 tx=0x7f6abc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:35.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:35.926+0000 7f6acd600640 1 -- 172.21.15.99:0/166189218 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6ac4010300 con 0x7f6ad006fa80 2024-03-30T13:14:36.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.123+0000 7f6ad8200640 1 -- 172.21.15.99:0/166189218 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f6ad0162160 con 0x7f6ab006c560 2024-03-30T13:14:36.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.124+0000 7f6acd600640 1 -- 172.21.15.99:0/166189218 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6ad0162160 con 0x7f6ab006c560 2024-03-30T13:14:36.127 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 6 to deep-scrub 2024-03-30T13:14:36.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.126+0000 7f6ad8200640 1 -- 172.21.15.99:0/166189218 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6ab006c560 msgr2=0x7f6ab006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.126+0000 7f6ad8200640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6ab006c560 0x7f6ab006ea20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6abc006fd0 tx=0x7f6abc008040 comp rx=0 tx=0).stop 2024-03-30T13:14:36.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.126+0000 7f6ad8200640 1 -- 172.21.15.99:0/166189218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ad006fa80 msgr2=0x7f6ad00aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.126+0000 7f6ad8200640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ad006fa80 0x7f6ad00aff60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400c400 tx=0x7f6ac400c8c0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.126+0000 7f6ad8200640 1 -- 172.21.15.99:0/166189218 shutdown_connections 2024-03-30T13:14:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.126+0000 7f6ad8200640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f6ab006c560 0x7f6ab006ea20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.126+0000 7f6ad8200640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ad0162400 0x7f6ad01f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.126+0000 7f6ad8200640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ad00d1730 0x7f6ad01f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.126+0000 7f6ad8200640 1 --2- 172.21.15.99:0/166189218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ad006fa80 0x7f6ad00aff60 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.126+0000 7f6ad8200640 1 -- 172.21.15.99:0/166189218 >> 172.21.15.99:0/166189218 conn(0x7f6ad00d23b0 msgr2=0x7f6ad006dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.127+0000 7f6ad8200640 1 -- 172.21.15.99:0/166189218 shutdown_connections 2024-03-30T13:14:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.127+0000 7f6ad8200640 1 -- 172.21.15.99:0/166189218 wait complete. 2024-03-30T13:14:36.150 INFO:tasks.ceph:Scrubbing osd.7 2024-03-30T13:14:36.151 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:14:36.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.361+0000 7f9996400640 1 Processor -- start 2024-03-30T13:14:36.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.361+0000 7f9996400640 1 -- start start 2024-03-30T13:14:36.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.363+0000 7f9996400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f999015d630 0x7f99900d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.363+0000 7f9996400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999006e300 con 0x7f99900d09d0 2024-03-30T13:14:36.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.363+0000 7f9996400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999006e5e0 con 0x7f9990156ba0 2024-03-30T13:14:36.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.363+0000 7f9996400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f99900d0e40 con 0x7f999015d630 2024-03-30T13:14:36.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.363+0000 7f9986a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f999015d630 0x7f99900d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.363+0000 7f9986a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f999015d630 0x7f99900d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45908/0 (socket says 172.21.15.99:45908) 2024-03-30T13:14:36.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.363+0000 7f9986a00640 1 -- 172.21.15.99:0/2749594838 learned_addr learned my addr 172.21.15.99:0/2749594838 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:36.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.364+0000 7f9986a00640 1 -- 172.21.15.99:0/2749594838 >> v1:172.21.15.181:6789/0 conn(0x7f9990156ba0 legacy=0x7f999006d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.364+0000 7f9986a00640 1 -- 172.21.15.99:0/2749594838 >> v1:172.21.15.99:6789/0 conn(0x7f99900d09d0 legacy=0x7f9990160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.364+0000 7f9986a00640 1 -- 172.21.15.99:0/2749594838 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999015ce50 con 0x7f999015d630 2024-03-30T13:14:36.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.365+0000 7f9986a00640 1 --2- 172.21.15.99:0/2749594838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f999015d630 0x7f99900d0490 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9978009870 tx=0x7f997802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b034508b34592b1c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.365+0000 7f998ea00640 1 -- 172.21.15.99:0/2749594838 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978035020 con 0x7f999015d630 2024-03-30T13:14:36.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.365+0000 7f998ea00640 1 -- 172.21.15.99:0/2749594838 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9978031870 con 0x7f999015d630 2024-03-30T13:14:36.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.365+0000 7f998ea00640 1 -- 172.21.15.99:0/2749594838 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978031c40 con 0x7f999015d630 2024-03-30T13:14:36.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.366+0000 7f9996400640 1 -- 172.21.15.99:0/2749594838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f999015d630 msgr2=0x7f99900d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.366+0000 7f9996400640 1 --2- 172.21.15.99:0/2749594838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f999015d630 0x7f99900d0490 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9978009870 tx=0x7f997802b910 comp rx=0 tx=0).stop 2024-03-30T13:14:36.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.366+0000 7f9996400640 1 -- 172.21.15.99:0/2749594838 shutdown_connections 2024-03-30T13:14:36.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.366+0000 7f9996400640 1 --2- 172.21.15.99:0/2749594838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f999015d630 0x7f99900d0490 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.366+0000 7f9996400640 1 -- 172.21.15.99:0/2749594838 >> 172.21.15.99:0/2749594838 conn(0x7f999006b6f0 msgr2=0x7f999006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:36.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.366+0000 7f9996400640 1 -- 172.21.15.99:0/2749594838 shutdown_connections 2024-03-30T13:14:36.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.366+0000 7f9996400640 1 -- 172.21.15.99:0/2749594838 wait complete. 2024-03-30T13:14:36.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.368+0000 7f9996400640 1 Processor -- start 2024-03-30T13:14:36.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.368+0000 7f9996400640 1 -- start start 2024-03-30T13:14:36.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.369+0000 7f9996400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99900d09d0 0x7f9990099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.369+0000 7f9996400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9990156ba0 0x7f9990071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.369+0000 7f9996400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f999015d630 0x7f99900b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.369+0000 7f9996400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f999015dac0 con 0x7f999015d630 2024-03-30T13:14:36.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.369+0000 7f9996400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f999015cb40 con 0x7f9990156ba0 2024-03-30T13:14:36.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.369+0000 7f9996400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f99900ad3d0 con 0x7f99900d09d0 2024-03-30T13:14:36.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.369+0000 7f998fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f999015d630 0x7f99900b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.369+0000 7f998fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f999015d630 0x7f99900b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45918/0 (socket says 172.21.15.99:45918) 2024-03-30T13:14:36.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.369+0000 7f998fe00640 1 -- 172.21.15.99:0/3066494163 learned_addr learned my addr 172.21.15.99:0/3066494163 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:36.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.369+0000 7f9986a00640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9990156ba0 0x7f9990071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.369+0000 7f998f400640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99900d09d0 0x7f9990099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f998fe00640 1 -- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99900d09d0 msgr2=0x7f9990099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f998fe00640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99900d09d0 0x7f9990099980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f998fe00640 1 -- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9990156ba0 msgr2=0x7f9990071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f998fe00640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9990156ba0 0x7f9990071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f998fe00640 1 -- 172.21.15.99:0/3066494163 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9990099ec0 con 0x7f999015d630 2024-03-30T13:14:36.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f9986a00640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9990156ba0 0x7f9990071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:36.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f998f400640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99900d09d0 0x7f9990099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:36.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f998fe00640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f999015d630 0x7f99900b0580 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9988001eb0 tx=0x7f998800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f9987e00640 1 -- 172.21.15.99:0/3066494163 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988017070 con 0x7f999015d630 2024-03-30T13:14:36.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f9987e00640 1 -- 172.21.15.99:0/3066494163 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99880052d0 con 0x7f999015d630 2024-03-30T13:14:36.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f9996400640 1 -- 172.21.15.99:0/3066494163 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9990072620 con 0x7f999015d630 2024-03-30T13:14:36.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f9987e00640 1 -- 172.21.15.99:0/3066494163 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988003810 con 0x7f999015d630 2024-03-30T13:14:36.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.370+0000 7f9996400640 1 -- 172.21.15.99:0/3066494163 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9990072be0 con 0x7f999015d630 2024-03-30T13:14:36.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.371+0000 7f9996400640 1 -- 172.21.15.99:0/3066494163 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9990068640 con 0x7f999015d630 2024-03-30T13:14:36.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.372+0000 7f9987e00640 1 -- 172.21.15.99:0/3066494163 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f998801a070 con 0x7f999015d630 2024-03-30T13:14:36.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.373+0000 7f9987e00640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f996c06c530 0x7f996c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.373+0000 7f9987e00640 1 -- 172.21.15.99:0/3066494163 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f998808a7a0 con 0x7f999015d630 2024-03-30T13:14:36.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.373+0000 7f998f400640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f996c06c530 0x7f996c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.373+0000 7f9987e00640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] conn(0x7f996c0723f0 0x7f996c074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.373+0000 7f9987e00640 1 -- 172.21.15.99:0/3066494163 --> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9988015e70 con 0x7f996c0723f0 2024-03-30T13:14:36.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.373+0000 7f9987e00640 1 -- 172.21.15.99:0/3066494163 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f9988091050 con 0x7f999015d630 2024-03-30T13:14:36.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.374+0000 7f998f400640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f996c06c530 0x7f996c06e9f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9980004520 tx=0x7f9980009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.374+0000 7f9986a00640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] conn(0x7f996c0723f0 0x7f996c074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.375+0000 7f9986a00640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] conn(0x7f996c0723f0 0x7f996c074810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.377+0000 7f9987e00640 1 -- 172.21.15.99:0/3066494163 <== osd.7 v2:172.21.15.181:6817/2806450372 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9988015e70 con 0x7f996c0723f0 2024-03-30T13:14:36.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.392+0000 7f9996400640 1 -- 172.21.15.99:0/3066494163 --> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f999006f070 con 0x7f996c0723f0 2024-03-30T13:14:36.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.393+0000 7f9987e00640 1 -- 172.21.15.99:0/3066494163 <== osd.7 v2:172.21.15.181:6817/2806450372 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f999006f070 con 0x7f996c0723f0 2024-03-30T13:14:36.397 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:14:36.397 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:14:36.397 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:14:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.393+0000 7f9996400640 1 -- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] conn(0x7f996c0723f0 msgr2=0x7f996c074810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.393+0000 7f9996400640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.181:6817/2806450372,v1:172.21.15.181:6819/2806450372] conn(0x7f996c0723f0 0x7f996c074810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.394+0000 7f9996400640 1 -- 172.21.15.99:0/3066494163 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f996c06c530 msgr2=0x7f996c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.394+0000 7f9996400640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f996c06c530 0x7f996c06e9f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9980004520 tx=0x7f9980009040 comp rx=0 tx=0).stop 2024-03-30T13:14:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.394+0000 7f9996400640 1 -- 172.21.15.99:0/3066494163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f999015d630 msgr2=0x7f99900b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.394+0000 7f9996400640 1 --2- 172.21.15.99:0/3066494163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f999015d630 0x7f99900b0580 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9988001eb0 tx=0x7f998800c890 comp rx=0 tx=0).stop 2024-03-30T13:14:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.394+0000 7f998fe00640 1 -- 172.21.15.99:0/3066494163 reap_dead start 2024-03-30T13:14:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.394+0000 7f9996400640 1 -- 172.21.15.99:0/3066494163 shutdown_connections 2024-03-30T13:14:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.394+0000 7f9996400640 1 -- 172.21.15.99:0/3066494163 >> 172.21.15.99:0/3066494163 conn(0x7f999006b6f0 msgr2=0x7f99900b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.394+0000 7f9996400640 1 -- 172.21.15.99:0/3066494163 shutdown_connections 2024-03-30T13:14:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.394+0000 7f9996400640 1 -- 172.21.15.99:0/3066494163 wait complete. 2024-03-30T13:14:36.416 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-30T13:14:36.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.614+0000 7f1a79400640 1 Processor -- start 2024-03-30T13:14:36.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.614+0000 7f1a79400640 1 -- start start 2024-03-30T13:14:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.615+0000 7f1a79400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a7415fc20 0x7f1a740c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.615+0000 7f1a79400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1a740c5020 0x7f1a740c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a79400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1a740b4b20 0x7f1a740d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a79400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f1a74161090 con 0x7f1a740b4b20 2024-03-30T13:14:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a79400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1a74160480 con 0x7f1a740c5020 2024-03-30T13:14:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a79400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1a74160760 con 0x7f1a7415fc20 2024-03-30T13:14:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a73200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1a740b4b20 0x7f1a740d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a73200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1a740b4b20 0x7f1a740d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45926/0 (socket says 172.21.15.99:45926) 2024-03-30T13:14:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a73200640 1 -- 172.21.15.99:0/3340585 learned_addr learned my addr 172.21.15.99:0/3340585 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a6be00640 1 --2- 172.21.15.99:0/3340585 >> v2:172.21.15.181:3300/0 conn(0x7f1a740c5020 0x7f1a740c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a72800640 1 --2- 172.21.15.99:0/3340585 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a7415fc20 0x7f1a740c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a73200640 1 -- 172.21.15.99:0/3340585 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a7415fc20 msgr2=0x7f1a740c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a73200640 1 --2- 172.21.15.99:0/3340585 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a7415fc20 0x7f1a740c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a73200640 1 -- 172.21.15.99:0/3340585 >> v2:172.21.15.181:3300/0 conn(0x7f1a740c5020 msgr2=0x7f1a740c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a73200640 1 --2- 172.21.15.99:0/3340585 >> v2:172.21.15.181:3300/0 conn(0x7f1a740c5020 0x7f1a740c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a73200640 1 -- 172.21.15.99:0/3340585 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a74160a40 con 0x7f1a740b4b20 2024-03-30T13:14:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.616+0000 7f1a72800640 1 --2- 172.21.15.99:0/3340585 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a7415fc20 0x7f1a740c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.618+0000 7f1a73200640 1 --2- 172.21.15.99:0/3340585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a740b4b20 0x7f1a740d00f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1a740cff40 tx=0x7f1a6c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edc42e981ec7a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.618+0000 7f1a71e00640 1 -- 172.21.15.99:0/3340585 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c02c9e0 con 0x7f1a740b4b20 2024-03-30T13:14:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.618+0000 7f1a71e00640 1 -- 172.21.15.99:0/3340585 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6c02cb80 con 0x7f1a740b4b20 2024-03-30T13:14:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.618+0000 7f1a71e00640 1 -- 172.21.15.99:0/3340585 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c0343f0 con 0x7f1a740b4b20 2024-03-30T13:14:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.618+0000 7f1a79400640 1 -- 172.21.15.99:0/3340585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a740b4b20 msgr2=0x7f1a740d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.618+0000 7f1a79400640 1 --2- 172.21.15.99:0/3340585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a740b4b20 0x7f1a740d00f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1a740cff40 tx=0x7f1a6c02be40 comp rx=0 tx=0).stop 2024-03-30T13:14:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.619+0000 7f1a79400640 1 -- 172.21.15.99:0/3340585 shutdown_connections 2024-03-30T13:14:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.619+0000 7f1a79400640 1 --2- 172.21.15.99:0/3340585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a740b4b20 0x7f1a740d00f0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.619+0000 7f1a79400640 1 --2- 172.21.15.99:0/3340585 >> v2:172.21.15.181:3300/0 conn(0x7f1a740c5020 0x7f1a740c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.619+0000 7f1a79400640 1 --2- 172.21.15.99:0/3340585 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a7415fc20 0x7f1a740c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.619+0000 7f1a79400640 1 -- 172.21.15.99:0/3340585 >> 172.21.15.99:0/3340585 conn(0x7f1a7406b510 msgr2=0x7f1a7406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.619+0000 7f1a79400640 1 -- 172.21.15.99:0/3340585 shutdown_connections 2024-03-30T13:14:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.619+0000 7f1a79400640 1 -- 172.21.15.99:0/3340585 wait complete. 2024-03-30T13:14:36.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.620+0000 7f1a79400640 1 Processor -- start 2024-03-30T13:14:36.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.621+0000 7f1a79400640 1 -- start start 2024-03-30T13:14:36.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.621+0000 7f1a79400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a740b4b20 0x7f1a74156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.621+0000 7f1a79400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a740c5020 0x7f1a740ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.621+0000 7f1a79400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a7415fc20 0x7f1a740cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a79400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1a74160260 con 0x7f1a740b4b20 2024-03-30T13:14:36.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a79400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1a741600e0 con 0x7f1a7415fc20 2024-03-30T13:14:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a79400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1a740d0630 con 0x7f1a740c5020 2024-03-30T13:14:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a72800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a740b4b20 0x7f1a74156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a72800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a740b4b20 0x7f1a74156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45928/0 (socket says 172.21.15.99:45928) 2024-03-30T13:14:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a72800640 1 -- 172.21.15.99:0/2205934482 learned_addr learned my addr 172.21.15.99:0/2205934482 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a6be00640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a740c5020 0x7f1a740ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a73200640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a7415fc20 0x7f1a740cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a72800640 1 -- 172.21.15.99:0/2205934482 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a740c5020 msgr2=0x7f1a740ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a72800640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a740c5020 0x7f1a740ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a72800640 1 -- 172.21.15.99:0/2205934482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a7415fc20 msgr2=0x7f1a740cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a72800640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a7415fc20 0x7f1a740cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a72800640 1 -- 172.21.15.99:0/2205934482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a740c73d0 con 0x7f1a740b4b20 2024-03-30T13:14:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.622+0000 7f1a72800640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a740b4b20 0x7f1a74156800 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400c7f0 tx=0x7f1a6400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.623+0000 7f1a6aa00640 1 -- 172.21.15.99:0/2205934482 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64015070 con 0x7f1a740b4b20 2024-03-30T13:14:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.623+0000 7f1a6aa00640 1 -- 172.21.15.99:0/2205934482 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a64007820 con 0x7f1a740b4b20 2024-03-30T13:14:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.623+0000 7f1a6aa00640 1 -- 172.21.15.99:0/2205934482 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64007bd0 con 0x7f1a740b4b20 2024-03-30T13:14:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.623+0000 7f1a79400640 1 -- 172.21.15.99:0/2205934482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a740c76b0 con 0x7f1a740b4b20 2024-03-30T13:14:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.623+0000 7f1a79400640 1 -- 172.21.15.99:0/2205934482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a740c7c70 con 0x7f1a740b4b20 2024-03-30T13:14:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.624+0000 7f1a79400640 1 -- 172.21.15.99:0/2205934482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a74068640 con 0x7f1a740b4b20 2024-03-30T13:14:36.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.625+0000 7f1a6aa00640 1 -- 172.21.15.99:0/2205934482 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1a64018070 con 0x7f1a740b4b20 2024-03-30T13:14:36.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.626+0000 7f1a6aa00640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a5006c530 0x7f1a5006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.626+0000 7f1a6aa00640 1 -- 172.21.15.99:0/2205934482 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f1a6408b410 con 0x7f1a740b4b20 2024-03-30T13:14:36.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.626+0000 7f1a6be00640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a5006c530 0x7f1a5006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.627+0000 7f1a6be00640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a5006c530 0x7f1a5006e9f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1a740738d0 tx=0x7f1a5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.630+0000 7f1a6aa00640 1 -- 172.21.15.99:0/2205934482 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1a64059c90 con 0x7f1a740b4b20 2024-03-30T13:14:36.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.830+0000 7f1a79400640 1 -- 172.21.15.99:0/2205934482 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f1a740b1b20 con 0x7f1a5006c530 2024-03-30T13:14:36.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.831+0000 7f1a6aa00640 1 -- 172.21.15.99:0/2205934482 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1a740b1b20 con 0x7f1a5006c530 2024-03-30T13:14:36.835 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 7 to deep-scrub 2024-03-30T13:14:36.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.833+0000 7f1a79400640 1 -- 172.21.15.99:0/2205934482 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a5006c530 msgr2=0x7f1a5006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.833+0000 7f1a79400640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a5006c530 0x7f1a5006e9f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1a740738d0 tx=0x7f1a5c008040 comp rx=0 tx=0).stop 2024-03-30T13:14:36.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.833+0000 7f1a79400640 1 -- 172.21.15.99:0/2205934482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a740b4b20 msgr2=0x7f1a74156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.833+0000 7f1a79400640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a740b4b20 0x7f1a74156800 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400c7f0 tx=0x7f1a6400ccb0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.834+0000 7f1a79400640 1 -- 172.21.15.99:0/2205934482 shutdown_connections 2024-03-30T13:14:36.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.834+0000 7f1a79400640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f1a5006c530 0x7f1a5006e9f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.834+0000 7f1a79400640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a7415fc20 0x7f1a740cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.834+0000 7f1a79400640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1a740c5020 0x7f1a740ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.834+0000 7f1a79400640 1 --2- 172.21.15.99:0/2205934482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a740b4b20 0x7f1a74156800 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.834+0000 7f1a79400640 1 -- 172.21.15.99:0/2205934482 >> 172.21.15.99:0/2205934482 conn(0x7f1a7406b510 msgr2=0x7f1a740af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:36.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.834+0000 7f1a79400640 1 -- 172.21.15.99:0/2205934482 shutdown_connections 2024-03-30T13:14:36.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:36.834+0000 7f1a79400640 1 -- 172.21.15.99:0/2205934482 wait complete. 2024-03-30T13:14:36.857 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:14:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.056+0000 7f628a800640 1 Processor -- start 2024-03-30T13:14:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.056+0000 7f628a800640 1 -- start start 2024-03-30T13:14:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.058+0000 7f628a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6284153280 0x7f62840b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.058+0000 7f628a800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6284160660 0x7f628406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.058+0000 7f628a800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62840ce6d0 con 0x7f62840ce130 2024-03-30T13:14:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.058+0000 7f628a800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f62840cf2e0 con 0x7f6284153280 2024-03-30T13:14:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.058+0000 7f628a800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f62840ce9b0 con 0x7f6284160660 2024-03-30T13:14:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.058+0000 7f6289400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6284153280 0x7f62840b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.058+0000 7f6288a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f62840ce130 0x7f628415ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45584/0 (socket says 172.21.15.99:45584) 2024-03-30T13:14:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.058+0000 7f6288a00640 1 -- 172.21.15.99:0/2875504964 learned_addr learned my addr 172.21.15.99:0/2875504964 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-03-30T13:14:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.059+0000 7f6289e00640 1 --2- 172.21.15.99:0/2875504964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6284160660 0x7f628406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.059+0000 7f6289400640 1 -- 172.21.15.99:0/2875504964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6284160660 msgr2=0x7f628406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.059+0000 7f6289400640 1 --2- 172.21.15.99:0/2875504964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6284160660 0x7f628406d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.059+0000 7f6289400640 1 -- 172.21.15.99:0/2875504964 >> v1:172.21.15.99:6789/0 conn(0x7f62840ce130 legacy=0x7f628415ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.059+0000 7f6289400640 1 -- 172.21.15.99:0/2875504964 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62840cec90 con 0x7f6284153280 2024-03-30T13:14:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.059+0000 7f6283e00640 1 -- 172.21.15.99:0/2875504964 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012800454 0 0) 0x7f62840ce6d0 con 0x7f62840ce130 2024-03-30T13:14:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.059+0000 7f6289e00640 1 --2- 172.21.15.99:0/2875504964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6284160660 0x7f628406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.060+0000 7f6289400640 1 --2- 172.21.15.99:0/2875504964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6284153280 0x7f62840b4e50 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f62780097a0 tx=0x7f627802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a576a19108fa9dd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.060+0000 7f6283e00640 1 -- 172.21.15.99:0/2875504964 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278031780 con 0x7f6284153280 2024-03-30T13:14:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.060+0000 7f6283e00640 1 -- 172.21.15.99:0/2875504964 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6278037070 con 0x7f6284153280 2024-03-30T13:14:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.060+0000 7f6283e00640 1 -- 172.21.15.99:0/2875504964 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278031b40 con 0x7f6284153280 2024-03-30T13:14:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.061+0000 7f628a800640 1 -- 172.21.15.99:0/2875504964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6284153280 msgr2=0x7f62840b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.061+0000 7f628a800640 1 --2- 172.21.15.99:0/2875504964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6284153280 0x7f62840b4e50 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f62780097a0 tx=0x7f627802b820 comp rx=0 tx=0).stop 2024-03-30T13:14:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.061+0000 7f628a800640 1 -- 172.21.15.99:0/2875504964 shutdown_connections 2024-03-30T13:14:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.061+0000 7f628a800640 1 --2- 172.21.15.99:0/2875504964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6284160660 0x7f628406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.061+0000 7f628a800640 1 --2- 172.21.15.99:0/2875504964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6284153280 0x7f62840b4e50 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.061+0000 7f628a800640 1 -- 172.21.15.99:0/2875504964 >> 172.21.15.99:0/2875504964 conn(0x7f628406bb40 msgr2=0x7f62840b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.061+0000 7f628a800640 1 -- 172.21.15.99:0/2875504964 shutdown_connections 2024-03-30T13:14:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.061+0000 7f628a800640 1 -- 172.21.15.99:0/2875504964 wait complete. 2024-03-30T13:14:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.063+0000 7f628a800640 1 Processor -- start 2024-03-30T13:14:37.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.063+0000 7f628a800640 1 -- start start 2024-03-30T13:14:37.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f628a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62840ce130 0x7f628409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f628a800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6284153280 0x7f6284145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f628a800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6284160660 0x7f628415b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f628a800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6284153660 con 0x7f62840ce130 2024-03-30T13:14:37.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f628a800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f62840b5390 con 0x7f6284160660 2024-03-30T13:14:37.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f628a800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f62841537e0 con 0x7f6284153280 2024-03-30T13:14:37.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f6289400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62840ce130 0x7f628409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f6289400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62840ce130 0x7f628409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45940/0 (socket says 172.21.15.99:45940) 2024-03-30T13:14:37.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f6289400640 1 -- 172.21.15.99:0/3810100138 learned_addr learned my addr 172.21.15.99:0/3810100138 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:37.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f6289400640 1 -- 172.21.15.99:0/3810100138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6284153280 msgr2=0x7f6284145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f6289400640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6284153280 0x7f6284145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f6289400640 1 -- 172.21.15.99:0/3810100138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6284160660 msgr2=0x7f628415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f6289400640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6284160660 0x7f628415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.064+0000 7f6289400640 1 -- 172.21.15.99:0/3810100138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628409c840 con 0x7f62840ce130 2024-03-30T13:14:37.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.065+0000 7f6289400640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62840ce130 0x7f628409aa30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f62780098c0 tx=0x7f62780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:37.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.065+0000 7f6281600640 1 -- 172.21.15.99:0/3810100138 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278032820 con 0x7f62840ce130 2024-03-30T13:14:37.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.065+0000 7f6281600640 1 -- 172.21.15.99:0/3810100138 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62780329e0 con 0x7f62840ce130 2024-03-30T13:14:37.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.065+0000 7f628a800640 1 -- 172.21.15.99:0/3810100138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628409cab0 con 0x7f62840ce130 2024-03-30T13:14:37.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.065+0000 7f6281600640 1 -- 172.21.15.99:0/3810100138 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278032dd0 con 0x7f62840ce130 2024-03-30T13:14:37.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.065+0000 7f628a800640 1 -- 172.21.15.99:0/3810100138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628409b0d0 con 0x7f62840ce130 2024-03-30T13:14:37.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.066+0000 7f628a800640 1 -- 172.21.15.99:0/3810100138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628404f8f0 con 0x7f62840ce130 2024-03-30T13:14:37.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.067+0000 7f6281600640 1 -- 172.21.15.99:0/3810100138 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f627804e440 con 0x7f62840ce130 2024-03-30T13:14:37.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.068+0000 7f6281600640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626406c530 0x7f626406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.068+0000 7f6281600640 1 -- 172.21.15.99:0/3810100138 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f62780ad300 con 0x7f62840ce130 2024-03-30T13:14:37.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.068+0000 7f6288a00640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626406c530 0x7f626406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.069+0000 7f6288a00640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626406c530 0x7f626406e9f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6270007fd0 tx=0x7f6270007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:37.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.073+0000 7f6281600640 1 -- 172.21.15.99:0/3810100138 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6278040070 con 0x7f62840ce130 2024-03-30T13:14:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.268+0000 7f628a800640 1 -- 172.21.15.99:0/3810100138 --> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f628409d1b0 con 0x7f626406c530 2024-03-30T13:14:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.270+0000 7f6281600640 1 -- 172.21.15.99:0/3810100138 <== mgr.4101 v2:172.21.15.99:6800/310744192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13419 (secure 0 0 0) 0x7f628409d1b0 con 0x7f626406c530 2024-03-30T13:14:37.274 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:14:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.272+0000 7f628a800640 1 -- 172.21.15.99:0/3810100138 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626406c530 msgr2=0x7f626406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.272+0000 7f628a800640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626406c530 0x7f626406e9f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6270007fd0 tx=0x7f6270007960 comp rx=0 tx=0).stop 2024-03-30T13:14:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.272+0000 7f628a800640 1 -- 172.21.15.99:0/3810100138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62840ce130 msgr2=0x7f628409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.272+0000 7f628a800640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62840ce130 0x7f628409aa30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f62780098c0 tx=0x7f62780046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.272+0000 7f628a800640 1 -- 172.21.15.99:0/3810100138 shutdown_connections 2024-03-30T13:14:37.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.272+0000 7f628a800640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f626406c530 0x7f626406e9f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.272+0000 7f628a800640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6284160660 0x7f628415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.272+0000 7f628a800640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6284153280 0x7f6284145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.272+0000 7f628a800640 1 --2- 172.21.15.99:0/3810100138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62840ce130 0x7f628409aa30 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.272+0000 7f628a800640 1 -- 172.21.15.99:0/3810100138 >> 172.21.15.99:0/3810100138 conn(0x7f628406bb40 msgr2=0x7f628406dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:37.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.273+0000 7f628a800640 1 -- 172.21.15.99:0/3810100138 shutdown_connections 2024-03-30T13:14:37.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.273+0000 7f628a800640 1 -- 172.21.15.99:0/3810100138 wait complete. 2024-03-30T13:14:37.296 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-03-30T13:14:35.511085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":250296,"kb_used_data":5000,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754724424,"statfs":{"total":773094113280,"available":772837810176,"internally_reserved":0,"allocated":5120000,"data_stored":2778016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-173890432,"num_objects":-116,"num_object_clones":0,"num_object_copies":-232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-116,"num_whiteouts":0,"num_read":-191,"num_read_kb":-168572,"num_write":-562,"num_write_kb":-172415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001739"},"pg_stats":[{"pgid":"1.0","version":"43'119","reported_seq":224,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-03-30T13:14:33.540101+0000","last_change":"2024-03-30T13:14:33.540101+0000","last_active":"2024-03-30T13:14:33.540101+0000","last_peered":"2024-03-30T13:14:33.540101+0000","last_clean":"2024-03-30T13:14:33.540101+0000","last_became_active":"2024-03-30T13:10:34.973176+0000","last_became_peered":"2024-03-30T13:10:34.973176+0000","last_unstale":"2024-03-30T13:14:33.540101+0000","last_undegraded":"2024-03-30T13:14:33.540101+0000","last_fullsized":"2024-03-30T13:14:33.540101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2024-03-30T13:14:33.539892+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2024-03-30T13:14:33.539892+0000","last_clean_scrub_stamp":"2024-03-30T13:14:33.539892+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:46:24.593235+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":199660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476787,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31664,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":491520,"data_stored":199660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476787,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1085440,"data_stored":790028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31664,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":491520,"data_stored":199660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31664,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":491520,"data_stored":199660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509492,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1085440,"data_stored":790028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31664,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":491520,"data_stored":199660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31660,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":491520,"data_stored":199660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:14:37.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-30T13:14:37.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.497+0000 7fbda1400640 1 Processor -- start 2024-03-30T13:14:37.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.498+0000 7fbda1400640 1 -- start start 2024-03-30T13:14:37.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.499+0000 7fbda1400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbd9c0b4e40 0x7fbd9c0c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.499+0000 7fbda1400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9c0b2810 0x7fbd9c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.499+0000 7fbda1400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c1604d0 con 0x7fbd9c0b31c0 2024-03-30T13:14:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.499+0000 7fbda1400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fbd9c0c6d60 con 0x7fbd9c0b4e40 2024-03-30T13:14:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.499+0000 7fbda1400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9c0cba20 con 0x7fbd9c0b2810 2024-03-30T13:14:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.499+0000 7fbd9a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbd9c0b4e40 0x7fbd9c0c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.499+0000 7fbd9a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbd9c0b4e40 0x7fbd9c0c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45950/0 (socket says 172.21.15.99:45950) 2024-03-30T13:14:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.499+0000 7fbd9a800640 1 -- 172.21.15.99:0/2707977487 learned_addr learned my addr 172.21.15.99:0/2707977487 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.500+0000 7fbd9b200640 1 --2- 172.21.15.99:0/2707977487 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9c0b2810 0x7fbd9c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.500+0000 7fbd9a800640 1 -- 172.21.15.99:0/2707977487 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9c0b2810 msgr2=0x7fbd9c0cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.500+0000 7fbd9a800640 1 --2- 172.21.15.99:0/2707977487 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9c0b2810 0x7fbd9c0cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.500+0000 7fbd9a800640 1 -- 172.21.15.99:0/2707977487 >> v1:172.21.15.181:6789/0 conn(0x7fbd9c0b31c0 legacy=0x7fbd9c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.500+0000 7fbd9a800640 1 -- 172.21.15.99:0/2707977487 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c1607b0 con 0x7fbd9c0b4e40 2024-03-30T13:14:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.501+0000 7fbd9a800640 1 --2- 172.21.15.99:0/2707977487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c0b4e40 0x7fbd9c0c6820 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009e50 tx=0x7fbd8c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c566755a7e24cf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.501+0000 7fbd99400640 1 -- 172.21.15.99:0/2707977487 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c02c9e0 con 0x7fbd9c0b4e40 2024-03-30T13:14:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.501+0000 7fbd99400640 1 -- 172.21.15.99:0/2707977487 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8c02cb80 con 0x7fbd9c0b4e40 2024-03-30T13:14:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.502+0000 7fbd99400640 1 -- 172.21.15.99:0/2707977487 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0343f0 con 0x7fbd9c0b4e40 2024-03-30T13:14:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.502+0000 7fbda1400640 1 -- 172.21.15.99:0/2707977487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c0b4e40 msgr2=0x7fbd9c0c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.502+0000 7fbda1400640 1 --2- 172.21.15.99:0/2707977487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c0b4e40 0x7fbd9c0c6820 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009e50 tx=0x7fbd8c02be40 comp rx=0 tx=0).stop 2024-03-30T13:14:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.502+0000 7fbda1400640 1 -- 172.21.15.99:0/2707977487 shutdown_connections 2024-03-30T13:14:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.502+0000 7fbda1400640 1 --2- 172.21.15.99:0/2707977487 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9c0b2810 0x7fbd9c0cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.502+0000 7fbda1400640 1 --2- 172.21.15.99:0/2707977487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c0b4e40 0x7fbd9c0c6820 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.502+0000 7fbda1400640 1 -- 172.21.15.99:0/2707977487 >> 172.21.15.99:0/2707977487 conn(0x7fbd9c0d0450 msgr2=0x7fbd9c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.502+0000 7fbda1400640 1 -- 172.21.15.99:0/2707977487 shutdown_connections 2024-03-30T13:14:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.502+0000 7fbda1400640 1 -- 172.21.15.99:0/2707977487 wait complete. 2024-03-30T13:14:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.504+0000 7fbda1400640 1 Processor -- start 2024-03-30T13:14:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.504+0000 7fbda1400640 1 -- start start 2024-03-30T13:14:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.505+0000 7fbda1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c0b2810 0x7fbd9c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.505+0000 7fbda1400640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9c0b31c0 0x7fbd9c151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.505+0000 7fbda1400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd9c0b4e40 0x7fbd9c1f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.505+0000 7fbda1400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c0b3650 con 0x7fbd9c0b2810 2024-03-30T13:14:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.505+0000 7fbda1400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c160d70 con 0x7fbd9c0b4e40 2024-03-30T13:14:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.505+0000 7fbda1400640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9c0c60f0 con 0x7fbd9c0b31c0 2024-03-30T13:14:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.505+0000 7fbd9a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c0b2810 0x7fbd9c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.506+0000 7fbd9a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c0b2810 0x7fbd9c0cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45962/0 (socket says 172.21.15.99:45962) 2024-03-30T13:14:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.506+0000 7fbd9a800640 1 -- 172.21.15.99:0/264006122 learned_addr learned my addr 172.21.15.99:0/264006122 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.506+0000 7fbd9a800640 1 -- 172.21.15.99:0/264006122 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9c0b31c0 msgr2=0x7fbd9c151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.506+0000 7fbd9a800640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9c0b31c0 0x7fbd9c151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.506+0000 7fbd9a800640 1 -- 172.21.15.99:0/264006122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd9c0b4e40 msgr2=0x7fbd9c1f8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.506+0000 7fbd9a800640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd9c0b4e40 0x7fbd9c1f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.506+0000 7fbd9a800640 1 -- 172.21.15.99:0/264006122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c158020 con 0x7fbd9c0b2810 2024-03-30T13:14:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.506+0000 7fbd9a800640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c0b2810 0x7fbd9c0cf5a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009e50 tx=0x7fbd8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.506+0000 7fbd92a00640 1 -- 172.21.15.99:0/264006122 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c043020 con 0x7fbd9c0b2810 2024-03-30T13:14:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.507+0000 7fbd92a00640 1 -- 172.21.15.99:0/264006122 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8c03e450 con 0x7fbd9c0b2810 2024-03-30T13:14:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.507+0000 7fbda1400640 1 -- 172.21.15.99:0/264006122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9c06e440 con 0x7fbd9c0b2810 2024-03-30T13:14:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.507+0000 7fbd92a00640 1 -- 172.21.15.99:0/264006122 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c009510 con 0x7fbd9c0b2810 2024-03-30T13:14:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.507+0000 7fbda1400640 1 -- 172.21.15.99:0/264006122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9c06e6e0 con 0x7fbd9c0b2810 2024-03-30T13:14:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.508+0000 7fbda1400640 1 -- 172.21.15.99:0/264006122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd9c0af710 con 0x7fbd9c0b2810 2024-03-30T13:14:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.509+0000 7fbd92a00640 1 -- 172.21.15.99:0/264006122 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbd8c005d10 con 0x7fbd9c0b2810 2024-03-30T13:14:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.510+0000 7fbd92a00640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd7806c530 0x7fbd7806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.510+0000 7fbd92a00640 1 -- 172.21.15.99:0/264006122 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7fbd8c0ae030 con 0x7fbd9c0b2810 2024-03-30T13:14:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.510+0000 7fbd99e00640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd7806c530 0x7fbd7806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.511+0000 7fbd99e00640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd7806c530 0x7fbd7806e9f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c152df0 tx=0x7fbd840079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.514+0000 7fbd92a00640 1 -- 172.21.15.99:0/264006122 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fbd8c07c8b0 con 0x7fbd9c0b2810 2024-03-30T13:14:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.715+0000 7fbda1400640 1 -- 172.21.15.99:0/264006122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbd9c0c5cb0 con 0x7fbd9c0b2810 2024-03-30T13:14:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.721+0000 7fbd92a00640 1 -- 172.21.15.99:0/264006122 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fbd8c07c1b0 con 0x7fbd9c0b2810 2024-03-30T13:14:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.722+0000 7fbd92a00640 1 -- 172.21.15.99:0/264006122 <== mon.0 v2:172.21.15.99:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbd8c080560 con 0x7fbd9c0b2810 2024-03-30T13:14:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 -- 172.21.15.99:0/264006122 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd7806c530 msgr2=0x7fbd7806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd7806c530 0x7fbd7806e9f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c152df0 tx=0x7fbd840079b0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 -- 172.21.15.99:0/264006122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c0b2810 msgr2=0x7fbd9c0cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c0b2810 0x7fbd9c0cf5a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009e50 tx=0x7fbd8c004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 -- 172.21.15.99:0/264006122 shutdown_connections 2024-03-30T13:14:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7fbd7806c530 0x7fbd7806e9f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd9c0b4e40 0x7fbd9c1f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9c0b31c0 0x7fbd9c151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 --2- 172.21.15.99:0/264006122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c0b2810 0x7fbd9c0cf5a0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 -- 172.21.15.99:0/264006122 >> 172.21.15.99:0/264006122 conn(0x7fbd9c0d0450 msgr2=0x7fbd9c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 -- 172.21.15.99:0/264006122 shutdown_connections 2024-03-30T13:14:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.724+0000 7fbda1400640 1 -- 172.21.15.99:0/264006122 wait complete. 2024-03-30T13:14:37.746 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T13:14:37.747 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:14:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.948+0000 7f61ba800640 1 Processor -- start 2024-03-30T13:14:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.948+0000 7f61ba800640 1 -- start start 2024-03-30T13:14:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.950+0000 7f61ba800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b415c670 0x7f61b406c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.950+0000 7f61ba800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f61b40ad940 0x7f61b406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.950+0000 7f61ba800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b4146230 con 0x7f61b406f060 2024-03-30T13:14:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.950+0000 7f61ba800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f61b406dfc0 con 0x7f61b40ad940 2024-03-30T13:14:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.950+0000 7f61ba800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f61b406e2a0 con 0x7f61b415c670 2024-03-30T13:14:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.950+0000 7f61b3e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f61b40ad940 0x7f61b406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.951+0000 7f61b3e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f61b40ad940 0x7f61b406d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:33506/0 (socket says 172.21.15.99:33506) 2024-03-30T13:14:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.951+0000 7f61b3e00640 1 -- 172.21.15.99:0/3710911173 learned_addr learned my addr 172.21.15.99:0/3710911173 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.951+0000 7f61b3400640 1 --2- 172.21.15.99:0/3710911173 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b415c670 0x7f61b406c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.951+0000 7f61b3e00640 1 -- 172.21.15.99:0/3710911173 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b415c670 msgr2=0x7f61b406c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.951+0000 7f61b3e00640 1 --2- 172.21.15.99:0/3710911173 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b415c670 0x7f61b406c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.951+0000 7f61b3e00640 1 -- 172.21.15.99:0/3710911173 >> v1:172.21.15.181:6789/0 conn(0x7f61b406f060 legacy=0x7f61b40ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.951+0000 7f61b3e00640 1 -- 172.21.15.99:0/3710911173 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b406e580 con 0x7f61b40ad940 2024-03-30T13:14:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.953+0000 7f61b3e00640 1 --2- 172.21.15.99:0/3710911173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b40ad940 0x7f61b406d930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009e50 tx=0x7f61ac02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a4fcf9ff252477c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.953+0000 7f61b2a00640 1 -- 172.21.15.99:0/3710911173 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac02ca70 con 0x7f61b40ad940 2024-03-30T13:14:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.953+0000 7f61b2a00640 1 -- 172.21.15.99:0/3710911173 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f61ac02cc10 con 0x7f61b40ad940 2024-03-30T13:14:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.953+0000 7f61b2a00640 1 -- 172.21.15.99:0/3710911173 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0343f0 con 0x7f61b40ad940 2024-03-30T13:14:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.954+0000 7f61ba800640 1 -- 172.21.15.99:0/3710911173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b40ad940 msgr2=0x7f61b406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.954+0000 7f61ba800640 1 --2- 172.21.15.99:0/3710911173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b40ad940 0x7f61b406d930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009e50 tx=0x7f61ac02bed0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.954+0000 7f61ba800640 1 -- 172.21.15.99:0/3710911173 shutdown_connections 2024-03-30T13:14:37.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.954+0000 7f61ba800640 1 --2- 172.21.15.99:0/3710911173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b40ad940 0x7f61b406d930 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.954+0000 7f61ba800640 1 --2- 172.21.15.99:0/3710911173 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b415c670 0x7f61b406c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.954+0000 7f61ba800640 1 -- 172.21.15.99:0/3710911173 >> 172.21.15.99:0/3710911173 conn(0x7f61b406b510 msgr2=0x7f61b406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:37.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.954+0000 7f61ba800640 1 -- 172.21.15.99:0/3710911173 shutdown_connections 2024-03-30T13:14:37.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.954+0000 7f61ba800640 1 -- 172.21.15.99:0/3710911173 wait complete. 2024-03-30T13:14:37.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.956+0000 7f61ba800640 1 Processor -- start 2024-03-30T13:14:37.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.956+0000 7f61ba800640 1 -- start start 2024-03-30T13:14:37.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.957+0000 7f61ba800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61b406f060 0x7f61b4144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.957+0000 7f61ba800640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b40ad940 0x7f61b41f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.957+0000 7f61ba800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b415c670 0x7f61b4144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.957+0000 7f61ba800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f61b40b32c0 con 0x7f61b406f060 2024-03-30T13:14:37.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.957+0000 7f61ba800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f61b415ca50 con 0x7f61b415c670 2024-03-30T13:14:37.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.957+0000 7f61ba800640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f61b40b3440 con 0x7f61b40ad940 2024-03-30T13:14:37.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.958+0000 7f61b3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61b406f060 0x7f61b4144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.958+0000 7f61b3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61b406f060 0x7f61b4144e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45964/0 (socket says 172.21.15.99:45964) 2024-03-30T13:14:37.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.958+0000 7f61b3400640 1 -- 172.21.15.99:0/526128601 learned_addr learned my addr 172.21.15.99:0/526128601 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-03-30T13:14:37.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.958+0000 7f61b3e00640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b415c670 0x7f61b4144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.958+0000 7f61b3400640 1 -- 172.21.15.99:0/526128601 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b40ad940 msgr2=0x7f61b41f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.958+0000 7f61b3400640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b40ad940 0x7f61b41f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.958+0000 7f61b3400640 1 -- 172.21.15.99:0/526128601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b415c670 msgr2=0x7f61b4144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:37.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.958+0000 7f61b3400640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b415c670 0x7f61b4144090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:37.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.958+0000 7f61b3400640 1 -- 172.21.15.99:0/526128601 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b4155300 con 0x7f61b406f060 2024-03-30T13:14:37.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.959+0000 7f61b3400640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61b406f060 0x7f61b4144e00 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f61a400e870 tx=0x7f61a400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:37.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.959+0000 7f61abe00640 1 -- 172.21.15.99:0/526128601 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4017070 con 0x7f61b406f060 2024-03-30T13:14:37.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.959+0000 7f61abe00640 1 -- 172.21.15.99:0/526128601 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f61a400c940 con 0x7f61b406f060 2024-03-30T13:14:37.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.959+0000 7f61abe00640 1 -- 172.21.15.99:0/526128601 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a400cd50 con 0x7f61b406f060 2024-03-30T13:14:37.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.959+0000 7f61ba800640 1 -- 172.21.15.99:0/526128601 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b415f910 con 0x7f61b406f060 2024-03-30T13:14:37.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.959+0000 7f61ba800640 1 -- 172.21.15.99:0/526128601 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b415bad0 con 0x7f61b406f060 2024-03-30T13:14:37.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.960+0000 7f61ba800640 1 -- 172.21.15.99:0/526128601 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b4161100 con 0x7f61b406f060 2024-03-30T13:14:37.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.961+0000 7f61abe00640 1 -- 172.21.15.99:0/526128601 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f61a401a070 con 0x7f61b406f060 2024-03-30T13:14:37.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.962+0000 7f61abe00640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f619006c560 0x7f619006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:37.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.962+0000 7f61abe00640 1 -- 172.21.15.99:0/526128601 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f61a408b740 con 0x7f61b406f060 2024-03-30T13:14:37.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.962+0000 7f61aaa00640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f619006c560 0x7f619006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:37.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.963+0000 7f61aaa00640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f619006c560 0x7f619006ea20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f619c000f60 tx=0x7f619c0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:37.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:37.966+0000 7f61abe00640 1 -- 172.21.15.99:0/526128601 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f61b4161100 con 0x7f61b406f060 2024-03-30T13:14:38.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.199+0000 7f61ba800640 1 -- 172.21.15.99:0/526128601 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61b4068640 con 0x7f61b406f060 2024-03-30T13:14:38.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.200+0000 7f61abe00640 1 -- 172.21.15.99:0/526128601 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+3869 (secure 0 0 0) 0x7f61a4059fb0 con 0x7f61b406f060 2024-03-30T13:14:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:14:38.204 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1591088829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1591088829},{"type":"v1","addr":"172.21.15.99:6837","nonce":1591088829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5024,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1284211217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6833","nonce":1284211217},{"type":"v1","addr":"172.21.15.181:6835","nonce":1284211217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5115,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/333253843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":333253843},{"type":"v1","addr":"172.21.15.99:6835","nonce":333253843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6834/859511813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":859511813},{"type":"v1","addr":"172.21.15.181:6834","nonce":859511813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-03-30T13:14:38.205 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 23 2024-03-30T13:14:38.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 -- 172.21.15.99:0/526128601 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f619006c560 msgr2=0x7f619006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f619006c560 0x7f619006ea20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f619c000f60 tx=0x7f619c0079d0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 -- 172.21.15.99:0/526128601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61b406f060 msgr2=0x7f61b4144e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61b406f060 0x7f61b4144e00 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f61a400e870 tx=0x7f61a400ed30 comp rx=0 tx=0).stop 2024-03-30T13:14:38.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 -- 172.21.15.99:0/526128601 shutdown_connections 2024-03-30T13:14:38.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.99:6800/310744192,v1:172.21.15.99:6801/310744192] conn(0x7f619006c560 0x7f619006ea20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b415c670 0x7f61b4144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b40ad940 0x7f61b41f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 --2- 172.21.15.99:0/526128601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61b406f060 0x7f61b4144e00 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 -- 172.21.15.99:0/526128601 >> 172.21.15.99:0/526128601 conn(0x7f61b406b510 msgr2=0x7f61b4160090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 -- 172.21.15.99:0/526128601 shutdown_connections 2024-03-30T13:14:38.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-30T13:14:38.203+0000 7f61ba800640 1 -- 172.21.15.99:0/526128601 wait complete. 2024-03-30T13:14:38.224 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-30T13:14:38.224 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-30T13:14:38.224 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-30T13:14:38.224 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.244 INFO:tasks.ceph.mds.a:Stopped 2024-03-30T13:14:38.244 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-30T13:14:38.244 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.311 INFO:tasks.ceph.mds.c:Stopped 2024-03-30T13:14:38.312 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-30T13:14:38.312 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.333 INFO:tasks.ceph.mds.b:Stopped 2024-03-30T13:14:38.334 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-30T13:14:38.334 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.390 INFO:tasks.ceph.mds.d:Stopped 2024-03-30T13:14:38.390 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-30T13:14:38.390 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-30T13:14:38.390 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.462 INFO:tasks.ceph.osd.0:Stopped 2024-03-30T13:14:38.462 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-30T13:14:38.462 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.534 INFO:tasks.ceph.osd.1:Stopped 2024-03-30T13:14:38.534 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-30T13:14:38.534 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.607 INFO:tasks.ceph.osd.2:Stopped 2024-03-30T13:14:38.608 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-30T13:14:38.608 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.671 INFO:tasks.ceph.osd.3:Stopped 2024-03-30T13:14:38.671 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-30T13:14:38.671 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.728 INFO:tasks.ceph.osd.4:Stopped 2024-03-30T13:14:38.728 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.780 INFO:tasks.ceph.osd.5:Stopped 2024-03-30T13:14:38.780 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-30T13:14:38.780 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.830 INFO:tasks.ceph.osd.6:Stopped 2024-03-30T13:14:38.830 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-30T13:14:38.830 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.878 INFO:tasks.ceph.osd.7:Stopped 2024-03-30T13:14:38.878 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-30T13:14:38.878 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-30T13:14:38.879 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:38.963 INFO:tasks.ceph.mgr.y:Stopped 2024-03-30T13:14:38.963 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-30T13:14:38.963 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:39.055 INFO:tasks.ceph.mgr.x:Stopped 2024-03-30T13:14:39.056 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-30T13:14:39.056 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-30T13:14:39.056 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:39.091 INFO:tasks.ceph.mon.a:Stopped 2024-03-30T13:14:39.091 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-30T13:14:39.092 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:39.116 INFO:tasks.ceph.mon.b:Stopped 2024-03-30T13:14:39.116 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-30T13:14:39.116 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:14:39.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-30T13:14:39.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-30T13:14:39.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-30T13:14:39.201 INFO:tasks.ceph.mon.c:Stopped 2024-03-30T13:14:39.201 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-30T13:14:39.201 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-03-30T13:14:39.308 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:14:39.308 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-30T13:14:39.673 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:14:39.673 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-30T13:14:39.828 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:14:39.828 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-30T13:14:39.974 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:14:39.975 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-30T13:14:40.116 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:14:40.116 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-30T13:14:40.607 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:14:40.607 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-30T13:14:40.764 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:14:40.764 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-30T13:14:40.939 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:14:40.940 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-30T13:14:41.112 INFO:tasks.ceph:Archiving mon data... 2024-03-30T13:14:41.114 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148/data/mon.a.tgz 2024-03-30T13:14:41.114 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-03-30T13:14:41.171 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.Z1P6y5SCfx 2024-03-30T13:14:41.171 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Z1P6y5SCfx 2024-03-30T13:14:41.331 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.Z1P6y5SCfx 2024-03-30T13:14:41.480 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.Z1P6y5SCfx is 335KB 2024-03-30T13:14:41.585 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.Z1P6y5SCfx 2024-03-30T13:14:41.640 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148/data/mon.b.tgz 2024-03-30T13:14:41.641 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-03-30T13:14:41.697 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.hRJVBuPqyH 2024-03-30T13:14:41.697 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hRJVBuPqyH 2024-03-30T13:14:41.899 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.hRJVBuPqyH 2024-03-30T13:14:42.046 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.hRJVBuPqyH is 438KB 2024-03-30T13:14:42.155 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.hRJVBuPqyH 2024-03-30T13:14:42.212 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148/data/mon.c.tgz 2024-03-30T13:14:42.212 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-03-30T13:14:42.261 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.dF4NG3D0w2 2024-03-30T13:14:42.261 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.dF4NG3D0w2 2024-03-30T13:14:42.444 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.dF4NG3D0w2 2024-03-30T13:14:42.592 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.dF4NG3D0w2 is 438KB 2024-03-30T13:14:42.698 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.dF4NG3D0w2 2024-03-30T13:14:42.755 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-30T13:14:42.755 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-30T13:14:42.763 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-30T13:14:42.913 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-30T13:14:42.970 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-30T13:14:42.970 INFO:tasks.ceph:Archiving crash dumps... 2024-03-30T13:14:42.972 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148/remote/smithi099/crash 2024-03-30T13:14:42.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-30T13:14:43.072 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148/remote/smithi181/crash 2024-03-30T13:14:43.074 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-30T13:14:43.165 INFO:tasks.ceph:Shutting down logrotate 2024-03-30T13:14:43.166 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:43.174 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:43.358 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:43.451 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:43.550 INFO:tasks.ceph:Compressing logs... 2024-03-30T13:14:43.551 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T13:14:43.559 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T13:14:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49812.log 2024-03-30T13:14:43.644 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47137.log 2024-03-30T13:14:43.645 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49037.log 2024-03-30T13:14:43.645 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49812.log.gz 2024-03-30T13:14:43.646 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47137.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47137.log.gz 2024-03-30T13:14:43.647 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41971.log 2024-03-30T13:14:43.648 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50232.log 2024-03-30T13:14:43.648 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49037.log.gz 2024-03-30T13:14:43.649 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41971.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41971.log.gz 2024-03-30T13:14:43.649 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42632.log 2024-03-30T13:14:43.650 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-30T13:14:43.650 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50232.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-30T13:14:43.651 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50232.log.gz 2024-03-30T13:14:43.652 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37145.log 2024-03-30T13:14:43.652 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37105.log 2024-03-30T13:14:43.652 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49896.log 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42632.log.gz 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48739.log 2024-03-30T13:14:43.654 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37145.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37145.log.gz 2024-03-30T13:14:43.654 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42375.log 2024-03-30T13:14:43.654 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49392.log 2024-03-30T13:14:43.655 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37225.log 2024-03-30T13:14:43.655 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7%/var/log/ceph/ceph-client.admin.48739.log: -- replaced with /var/log/ceph/ceph-client.admin.49896.log.gz 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46546.log 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48739.log.gz 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51934.log 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49392.log.gz 2024-03-30T13:14:43.658 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48433.log 2024-03-30T13:14:43.658 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46546.log.gz 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37105.log: /var/log/ceph/ceph-client.1.42375.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42375.log.gz 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi181.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37105.log.gz 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37225.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi181.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37225.log.gz 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42789.log 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.4.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37185.log 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46858.log 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51934.log.gz 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55641.log 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48433.log.gz 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44334.log 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46858.log.gz 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46774.log 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55641.log.gz 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55557.log 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44334.log.gz 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48055.log 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46774.log.gz 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.3.42789.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42789.log.gz 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37185.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37185.log.gz 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37305.log 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42394.log 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37305.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi181.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37305.log.gz 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.1.42394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42394.log.gz 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55557.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55557.log.gz 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54410.log 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46252.log 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48055.log.gz 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52198.log 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54410.log.gz 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47095.log 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46252.log.gz 2024-03-30T13:14:43.674 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37265.log 2024-03-30T13:14:43.674 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.37265.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-30T13:14:43.674 INFO:teuthology.orchestra.run.smithi181.stderr: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-30T13:14:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51208.log 2024-03-30T13:14:43.675 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52198.log.gz 2024-03-30T13:14:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47221.log 2024-03-30T13:14:43.675 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47095.log.gz 2024-03-30T13:14:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45018.log 2024-03-30T13:14:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47221.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51208.log.gz 2024-03-30T13:14:43.675 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47221.log.gz 2024-03-30T13:14:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56462.log 2024-03-30T13:14:43.678 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43414.log 2024-03-30T13:14:43.678 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.b.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37265.log.gz 93.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-30T13:14:43.678 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-03-30T13:14:43.678 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.1.43414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43414.log.gz 2024-03-30T13:14:43.678 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-30T13:14:43.679 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55851.log 2024-03-30T13:14:43.679 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45018.log.gz 2024-03-30T13:14:43.679 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44085.log 2024-03-30T13:14:43.679 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56462.log.gz 2024-03-30T13:14:43.679 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43361.log 2024-03-30T13:14:43.680 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55851.log.gz 2024-03-30T13:14:43.680 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49686.log 2024-03-30T13:14:43.680 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44085.log.gz 2024-03-30T13:14:43.684 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54146.log 2024-03-30T13:14:43.685 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43361.log.gz 2024-03-30T13:14:43.685 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46942.log 2024-03-30T13:14:43.685 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49686.log.gz 2024-03-30T13:14:43.685 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50350.log 2024-03-30T13:14:43.686 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54146.log.gz 2024-03-30T13:14:43.686 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42720.log 2024-03-30T13:14:43.686 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46942.log.gz 2024-03-30T13:14:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37345.log 2024-03-30T13:14:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-client.admin.37345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43418.log 2024-03-30T13:14:43.688 INFO:teuthology.orchestra.run.smithi181.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-30T13:14:43.688 INFO:teuthology.orchestra.run.smithi181.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37345.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-30T13:14:43.688 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-03-30T13:14:43.689 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.1.43418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43418.log.gz 2024-03-30T13:14:43.689 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37385.log 2024-03-30T13:14:43.689 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.37385.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37385.log.gz 2024-03-30T13:14:43.689 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42793.log 2024-03-30T13:14:43.692 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48013.log 2024-03-30T13:14:43.693 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50350.log.gz 2024-03-30T13:14:43.693 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42720.log.gz 2024-03-30T13:14:43.693 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45825.log 2024-03-30T13:14:43.693 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54080.log 2024-03-30T13:14:43.693 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48013.log.gz 2024-03-30T13:14:43.693 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.2.45825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45825.log.gz 2024-03-30T13:14:43.693 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43359.log 2024-03-30T13:14:43.693 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55085.log 2024-03-30T13:14:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43359.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54080.log.gz 2024-03-30T13:14:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51274.log 2024-03-30T13:14:43.694 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43359.log.gz 2024-03-30T13:14:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42972.log 2024-03-30T13:14:43.694 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55085.log.gz 2024-03-30T13:14:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42325.log 2024-03-30T13:14:43.694 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51274.log.gz 2024-03-30T13:14:43.696 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.3.42793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42793.log.gz 2024-03-30T13:14:43.697 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46816.log 2024-03-30T13:14:43.697 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42972.log.gz 2024-03-30T13:14:43.697 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42325.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.49560.log 2024-03-30T13:14:43.697 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42325.log.gz 2024-03-30T13:14:43.697 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47845.log 2024-03-30T13:14:43.698 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46816.log.gz 2024-03-30T13:14:43.698 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57205.log 2024-03-30T13:14:43.698 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49560.log.gz 2024-03-30T13:14:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51142.log 2024-03-30T13:14:43.699 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47845.log.gz 2024-03-30T13:14:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57205.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57205.log.gz 2024-03-30T13:14:43.699 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57079.log 2024-03-30T13:14:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49602.log 2024-03-30T13:14:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57079.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51142.log.gz 2024-03-30T13:14:43.701 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51406.log 2024-03-30T13:14:43.701 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57079.log.gz 2024-03-30T13:14:43.702 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54476.log 2024-03-30T13:14:43.702 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49602.log.gz 2024-03-30T13:14:43.703 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50492.log 2024-03-30T13:14:43.703 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51406.log.gz 2024-03-30T13:14:43.704 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44032.log 2024-03-30T13:14:43.705 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54476.log.gz 2024-03-30T13:14:43.705 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49178.log 2024-03-30T13:14:43.706 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44032.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50492.log.gz 2024-03-30T13:14:43.706 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44032.log.gz 2024-03-30T13:14:43.707 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52462.log 2024-03-30T13:14:43.707 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56827.log 2024-03-30T13:14:43.708 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49178.log.gz 2024-03-30T13:14:43.708 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42674.log 2024-03-30T13:14:43.709 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52462.log.gz 2024-03-30T13:14:43.710 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42409.log 2024-03-30T13:14:43.710 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56827.log.gz 2024-03-30T13:14:43.711 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46084.log 2024-03-30T13:14:43.711 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42674.log.gz 2024-03-30T13:14:43.712 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43684.log 2024-03-30T13:14:43.712 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42409.log.gz 2024-03-30T13:14:43.714 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49222.log 2024-03-30T13:14:43.714 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46084.log.gz 2024-03-30T13:14:43.715 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47179.log 2024-03-30T13:14:43.715 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43684.log.gz 2024-03-30T13:14:43.715 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49222.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49222.log.gzgzip 2024-03-30T13:14:43.715 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53864.log 2024-03-30T13:14:43.716 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44460.log 2024-03-30T13:14:43.717 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47179.log.gz 2024-03-30T13:14:43.717 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48349.log 2024-03-30T13:14:43.718 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53864.log.gz 2024-03-30T13:14:43.719 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44796.log 2024-03-30T13:14:43.719 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44460.log.gz 2024-03-30T13:14:43.720 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48349.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48349.log.gz 2024-03-30T13:14:43.720 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43694.log 2024-03-30T13:14:43.720 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53948.log 2024-03-30T13:14:43.721 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44796.log.gz 2024-03-30T13:14:43.722 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51802.log 2024-03-30T13:14:43.722 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43694.log.gz 2024-03-30T13:14:43.723 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49476.log 2024-03-30T13:14:43.724 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51802.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53948.log.gz 2024-03-30T13:14:43.724 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43691.log 2024-03-30T13:14:43.724 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51802.log.gz 2024-03-30T13:14:43.725 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46900.log 2024-03-30T13:14:43.725 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49476.log.gz 2024-03-30T13:14:43.726 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48824.log 2024-03-30T13:14:43.727 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43691.log.gz 2024-03-30T13:14:43.727 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46900.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46900.log.gz 2024-03-30T13:14:43.728 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57247.log 2024-03-30T13:14:43.728 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55253.log 2024-03-30T13:14:43.729 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48824.log.gz 2024-03-30T13:14:43.729 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49136.log 2024-03-30T13:14:43.730 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57247.log.gz 2024-03-30T13:14:43.731 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48265.log 2024-03-30T13:14:43.731 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55253.log.gz 2024-03-30T13:14:43.732 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2024-03-30T13:14:43.732 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49136.log.gz 2024-03-30T13:14:43.733 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43699.log 2024-03-30T13:14:43.733 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48265.log.gz 2024-03-30T13:14:43.735 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44037.log 2024-03-30T13:14:43.735 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2024-03-30T13:14:43.735 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53534.log 2024-03-30T13:14:43.735 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43699.log.gz 2024-03-30T13:14:43.736 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44037.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44037.log.gz 2024-03-30T13:14:43.736 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57287.log 2024-03-30T13:14:43.737 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56659.log 2024-03-30T13:14:43.738 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57287.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53534.log.gz 2024-03-30T13:14:43.738 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55725.log 2024-03-30T13:14:43.739 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57287.log.gz 2024-03-30T13:14:43.739 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43700.log 2024-03-30T13:14:43.740 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56659.log.gz 2024-03-30T13:14:43.740 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55725.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55725.log.gz 2024-03-30T13:14:43.741 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53468.log 2024-03-30T13:14:43.742 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52902.log 2024-03-30T13:14:43.742 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43700.log.gz 2024-03-30T13:14:43.743 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2024-03-30T13:14:43.744 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52902.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53468.log.gz 2024-03-30T13:14:43.745 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52396.log 2024-03-30T13:14:43.745 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52902.log.gz 2024-03-30T13:14:43.747 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43987.log 2024-03-30T13:14:43.747 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2024-03-30T13:14:43.747 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51472.log 2024-03-30T13:14:43.749 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43987.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52396.log.gz 2024-03-30T13:14:43.750 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43987.log.gzgzip 2024-03-30T13:14:43.750 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48391.log 2024-03-30T13:14:43.750 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43355.log 2024-03-30T13:14:43.751 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51472.log.gz 2024-03-30T13:14:43.751 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55211.log 2024-03-30T13:14:43.751 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48391.log.gz 2024-03-30T13:14:43.756 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47683.log 2024-03-30T13:14:43.756 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43355.log.gz 2024-03-30T13:14:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55211.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55211.log.gz 2024-03-30T13:14:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49094.log 2024-03-30T13:14:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48223.log 2024-03-30T13:14:43.757 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47683.log.gz 2024-03-30T13:14:43.758 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49962.log 2024-03-30T13:14:43.758 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49094.log.gz 2024-03-30T13:14:43.758 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47557.log 2024-03-30T13:14:43.758 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48223.log.gz 2024-03-30T13:14:43.759 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49962.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49962.log.gz 2024-03-30T13:14:43.759 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46126.log 2024-03-30T13:14:43.767 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42539.log 2024-03-30T13:14:43.767 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47557.log.gz 2024-03-30T13:14:43.768 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49266.log 2024-03-30T13:14:43.768 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46126.log.gz 2024-03-30T13:14:43.768 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42539.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-30T13:14:43.768 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42539.log.gz 2024-03-30T13:14:43.768 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49266.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49266.log.gz 2024-03-30T13:14:43.768 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56557.log 2024-03-30T13:14:43.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48139.log 2024-03-30T13:14:43.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48097.log 2024-03-30T13:14:43.769 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56557.log.gz 2024-03-30T13:14:43.769 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-30T13:14:43.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55977.log 2024-03-30T13:14:43.769 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48139.log.gz 2024-03-30T13:14:43.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48097.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48097.log.gz 2024-03-30T13:14:43.769 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42367.log 2024-03-30T13:14:43.770 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46504.log 2024-03-30T13:14:43.770 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55977.log.gz 2024-03-30T13:14:43.770 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48307.log 2024-03-30T13:14:43.770 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42367.log.gz 2024-03-30T13:14:43.770 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46732.log 2024-03-30T13:14:43.772 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46504.log.gz 2024-03-30T13:14:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48307.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48307.log.gz 2024-03-30T13:14:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50558.log 2024-03-30T13:14:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47725.log 2024-03-30T13:14:43.773 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46732.log.gz 2024-03-30T13:14:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55373.log 2024-03-30T13:14:43.773 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50558.log.gz 2024-03-30T13:14:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42804.log 2024-03-30T13:14:43.774 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47725.log.gz 2024-03-30T13:14:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55373.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55373.log.gz 2024-03-30T13:14:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49350.log 2024-03-30T13:14:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53336.log 2024-03-30T13:14:43.776 INFO:teuthology.orchestra.run.smithi099.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42804.log.gz 2024-03-30T13:14:43.776 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56869.log 2024-03-30T13:14:43.776 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49350.log.gz 2024-03-30T13:14:43.776 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46000.log 2024-03-30T13:14:43.776 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53336.log.gz 2024-03-30T13:14:43.778 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43364.log 2024-03-30T13:14:43.778 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56869.log.gz 2024-03-30T13:14:43.778 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46000.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46000.log.gz 2024-03-30T13:14:43.778 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53798.log 2024-03-30T13:14:43.779 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43345.log 2024-03-30T13:14:43.779 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43364.log.gz 2024-03-30T13:14:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42159.log 2024-03-30T13:14:43.780 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53798.log.gz 2024-03-30T13:14:43.781 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49854.log 2024-03-30T13:14:43.781 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43345.log.gz 2024-03-30T13:14:43.782 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42159.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42159.log.gz 2024-03-30T13:14:43.782 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42063.log 2024-03-30T13:14:43.783 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53600.log 2024-03-30T13:14:43.783 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49854.log.gz 2024-03-30T13:14:43.784 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56911.log 2024-03-30T13:14:43.784 INFO:teuthology.orchestra.run.smithi099.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42063.log.gz 2024-03-30T13:14:43.784 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46606.log 2024-03-30T13:14:43.786 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56911.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53600.log.gz 2024-03-30T13:14:43.786 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56911.log.gz 2024-03-30T13:14:43.786 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44026.log 2024-03-30T13:14:43.787 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48658.log 2024-03-30T13:14:43.787 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46606.log.gz 2024-03-30T13:14:43.788 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56615.log 2024-03-30T13:14:43.788 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44026.log.gz 2024-03-30T13:14:43.789 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53402.log 2024-03-30T13:14:43.789 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48658.log.gz 2024-03-30T13:14:43.790 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55331.log 2024-03-30T13:14:43.790 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53402.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56615.log.gz 2024-03-30T13:14:43.791 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-30T13:14:43.791 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53402.log.gz 2024-03-30T13:14:43.792 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48950.log 2024-03-30T13:14:43.792 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55331.log.gz 2024-03-30T13:14:43.793 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47599.log 2024-03-30T13:14:43.794 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48950.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48950.log.gz 2024-03-30T13:14:43.794 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51340.log 2024-03-30T13:14:43.795 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54608.log 2024-03-30T13:14:43.795 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47599.log.gz 2024-03-30T13:14:43.796 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52528.log 2024-03-30T13:14:43.797 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51340.log.gz 2024-03-30T13:14:43.798 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44754.log 2024-03-30T13:14:43.798 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54608.log.gz 2024-03-30T13:14:43.799 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54806.log 2024-03-30T13:14:43.799 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52528.log.gz 2024-03-30T13:14:43.800 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48578.log 2024-03-30T13:14:43.800 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44754.log.gz 2024-03-30T13:14:43.801 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44838.log 2024-03-30T13:14:43.802 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54806.log.gz 2024-03-30T13:14:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43687.log 2024-03-30T13:14:43.803 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48578.log.gz 2024-03-30T13:14:43.804 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44838.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44838.log.gz 2024-03-30T13:14:43.804 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46294.log 2024-03-30T13:14:43.805 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52264.log 2024-03-30T13:14:43.805 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43687.log.gz 2024-03-30T13:14:43.806 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46294.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46294.log.gz 2024-03-30T13:14:43.806 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44376.log 2024-03-30T13:14:43.807 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48536.log 2024-03-30T13:14:43.808 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52264.log.gz 2024-03-30T13:14:43.808 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46462.log 2024-03-30T13:14:43.809 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44376.log.gz 2024-03-30T13:14:43.809 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47641.log 2024-03-30T13:14:43.810 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48536.log.gz 2024-03-30T13:14:43.810 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42495.log 2024-03-30T13:14:43.811 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46462.log.gz 2024-03-30T13:14:43.811 INFO:teuthology.orchestra.run.smithi181.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-30T13:14:43.812 INFO:teuthology.orchestra.run.smithi181.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-30T13:14:43.813 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47803.log 2024-03-30T13:14:43.813 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47641.log.gz 2024-03-30T13:14:43.813 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47467.log 2024-03-30T13:14:43.813 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42495.log.gz 2024-03-30T13:14:43.814 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47803.log: gzip 89.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.47803.log.gz --verbose 2024-03-30T13:14:43.814 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.57037.log 2024-03-30T13:14:43.815 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52000.log 2024-03-30T13:14:43.815 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47467.log.gz 2024-03-30T13:14:43.816 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43140.log 2024-03-30T13:14:43.816 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57037.log.gz 2024-03-30T13:14:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55809.log 2024-03-30T13:14:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43140.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52000.log.gz 2024-03-30T13:14:43.819 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57121.log 2024-03-30T13:14:43.819 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43140.log.gz 2024-03-30T13:14:43.820 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47425.log 2024-03-30T13:14:43.820 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55809.log.gz 2024-03-30T13:14:43.821 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51736.log 2024-03-30T13:14:43.821 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57121.log.gz 2024-03-30T13:14:43.822 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47425.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47425.log.gz 2024-03-30T13:14:43.822 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47929.log 2024-03-30T13:14:43.823 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49728.log 2024-03-30T13:14:43.824 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47929.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51736.log.gz 88.7% 2024-03-30T13:14:43.824 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47929.log.gz 2024-03-30T13:14:43.824 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44502.log 2024-03-30T13:14:43.825 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45958.log 2024-03-30T13:14:43.825 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49728.log.gz 2024-03-30T13:14:43.826 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45821.log 2024-03-30T13:14:43.826 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44502.log.gz 2024-03-30T13:14:43.827 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52610.log 2024-03-30T13:14:43.827 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45958.log.gz 2024-03-30T13:14:43.828 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.2.45821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45821.log.gz 2024-03-30T13:14:43.829 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56377.log 2024-03-30T13:14:43.830 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52610.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-30T13:14:43.831 INFO:teuthology.orchestra.run.smithi099.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52610.log.gz 2024-03-30T13:14:43.832 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48908.log 2024-03-30T13:14:43.833 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56377.log.gz 2024-03-30T13:14:43.833 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52066.log 2024-03-30T13:14:43.833 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48908.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48908.log.gz 2024-03-30T13:14:43.834 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48781.log 2024-03-30T13:14:43.834 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51670.log 2024-03-30T13:14:43.836 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52066.log: /var/log/ceph/ceph-client.admin.48781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44712.log 2024-03-30T13:14:43.836 INFO:teuthology.orchestra.run.smithi099.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48781.log.gz 2024-03-30T13:14:43.836 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52066.log.gz 2024-03-30T13:14:43.837 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42888.log 2024-03-30T13:14:43.837 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51670.log.gz 2024-03-30T13:14:43.838 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42590.log 2024-03-30T13:14:43.838 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44712.log.gz 2024-03-30T13:14:43.839 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42888.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42888.log.gz 2024-03-30T13:14:43.840 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52330.log 2024-03-30T13:14:43.840 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54542.log 2024-03-30T13:14:43.841 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42590.log: /var/log/ceph/ceph-client.admin.52330.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42590.log.gz 2024-03-30T13:14:43.842 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56953.log 2024-03-30T13:14:43.843 INFO:teuthology.orchestra.run.smithi099.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.52330.log.gz 2024-03-30T13:14:43.843 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44544.log 2024-03-30T13:14:43.844 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54542.log.gz 2024-03-30T13:14:43.844 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45384.log 2024-03-30T13:14:43.845 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56953.log.gz 2024-03-30T13:14:43.846 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56507.log 2024-03-30T13:14:43.846 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44544.log.gz 2024-03-30T13:14:43.847 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.45384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45384.log.gz 2024-03-30T13:14:43.847 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48992.log 2024-03-30T13:14:43.848 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48181.log 2024-03-30T13:14:43.849 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48992.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56507.log.gz 2024-03-30T13:14:43.850 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36932.log 2024-03-30T13:14:43.850 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48992.log.gz 2024-03-30T13:14:43.851 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48181.log: gzip -5 89.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.48181.log.gz -- 2024-03-30T13:14:43.851 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.55457.log 2024-03-30T13:14:43.852 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44250.log 2024-03-30T13:14:43.852 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55457.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.36932.log.gz 2024-03-30T13:14:43.853 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30903.log 2024-03-30T13:14:43.853 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55457.log.gz 2024-03-30T13:14:43.854 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42846.log 2024-03-30T13:14:43.855 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44250.log.gz 2024-03-30T13:14:43.856 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.tmp-client.admin.30903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44418.log 2024-03-30T13:14:43.856 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30903.log.gz 2024-03-30T13:14:43.857 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46420.log 2024-03-30T13:14:43.857 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42846.log.gz 2024-03-30T13:14:43.858 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54014.log 2024-03-30T13:14:43.858 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44418.log.gz 2024-03-30T13:14:43.859 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53732.log 2024-03-30T13:14:43.860 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46420.log.gz 2024-03-30T13:14:43.860 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47053.log 2024-03-30T13:14:43.861 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54014.log.gz 2024-03-30T13:14:43.862 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47971.log 2024-03-30T13:14:43.862 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53732.log.gz 2024-03-30T13:14:43.863 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55415.log 2024-03-30T13:14:43.863 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47053.log.gz 2024-03-30T13:14:43.864 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43349.log 2024-03-30T13:14:43.865 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47971.log.gz 2024-03-30T13:14:43.866 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55415.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55415.log.gz 2024-03-30T13:14:43.866 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-30T13:14:43.867 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55499.log 2024-03-30T13:14:43.867 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43349.log.gz 2024-03-30T13:14:43.868 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54740.log 2024-03-30T13:14:43.869 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47383.log 2024-03-30T13:14:43.869 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55499.log.gz 2024-03-30T13:14:43.871 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57329.log 2024-03-30T13:14:43.872 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0%/var/log/ceph/ceph-client.admin.47383.log: -- replaced with /var/log/ceph/ceph-client.admin.54740.log.gz 2024-03-30T13:14:43.872 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44023.log 2024-03-30T13:14:43.872 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47383.log.gz 2024-03-30T13:14:43.873 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43182.log 2024-03-30T13:14:43.873 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57329.log.gz 2024-03-30T13:14:43.875 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37379.log 2024-03-30T13:14:43.875 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44023.log.gz 2024-03-30T13:14:43.876 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46042.log 2024-03-30T13:14:43.876 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43182.log.gz 2024-03-30T13:14:43.877 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50154.log 2024-03-30T13:14:43.877 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37379.log.gz 2024-03-30T13:14:43.879 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56019.log 2024-03-30T13:14:43.879 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46042.log.gz 2024-03-30T13:14:43.879 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.50154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50154.log.gz 2024-03-30T13:14:43.880 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55935.log 2024-03-30T13:14:43.881 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55767.log 2024-03-30T13:14:43.881 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56019.log.gz 2024-03-30T13:14:43.883 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56103.log 2024-03-30T13:14:43.883 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55935.log.gz 2024-03-30T13:14:43.883 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2024-03-30T13:14:43.884 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55767.log.gz 2024-03-30T13:14:43.885 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52132.log 2024-03-30T13:14:43.885 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56103.log.gz 2024-03-30T13:14:43.886 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55127.log 2024-03-30T13:14:43.887 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2024-03-30T13:14:43.887 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44880.log 2024-03-30T13:14:43.888 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55127.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52132.log.gz 2024-03-30T13:14:43.889 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46210.log 2024-03-30T13:14:43.889 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55127.log.gz 2024-03-30T13:14:43.890 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46690.log 2024-03-30T13:14:43.893 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44880.log.gz 2024-03-30T13:14:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50150.log 2024-03-30T13:14:43.895 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46210.log.gz 2024-03-30T13:14:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57163.log 2024-03-30T13:14:43.895 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46690.log.gz 2024-03-30T13:14:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.50150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50150.log.gz 2024-03-30T13:14:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52818.log 2024-03-30T13:14:43.896 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44670.log 2024-03-30T13:14:43.896 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57163.log.gz 2024-03-30T13:14:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56187.log 2024-03-30T13:14:43.897 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52818.log.gz 2024-03-30T13:14:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43356.log 2024-03-30T13:14:43.898 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44670.log.gz 2024-03-30T13:14:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42451.log 2024-03-30T13:14:43.899 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56187.log.gz 2024-03-30T13:14:43.901 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50642.log 2024-03-30T13:14:43.901 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43356.log.gz 2024-03-30T13:14:43.902 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43098.log 2024-03-30T13:14:43.902 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42451.log.gz 2024-03-30T13:14:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50642.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-30T13:14:43.904 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43098.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50642.log.gz 2024-03-30T13:14:43.904 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55169.log 2024-03-30T13:14:43.905 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43098.log.gz 2024-03-30T13:14:43.906 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43682.log 2024-03-30T13:14:43.907 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42282.log 2024-03-30T13:14:43.907 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55169.log.gz 2024-03-30T13:14:43.909 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43682.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43682.log.gz 2024-03-30T13:14:43.909 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37201.log 2024-03-30T13:14:43.910 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42282.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42282.log.gz 2024-03-30T13:14:43.910 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42240.log 2024-03-30T13:14:43.912 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44628.log 2024-03-30T13:14:43.912 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37201.log.gz 2024-03-30T13:14:43.913 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51604.log 2024-03-30T13:14:43.913 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42240.log.gz 2024-03-30T13:14:43.915 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44628.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44628.log.gz 2024-03-30T13:14:43.915 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46336.log 2024-03-30T13:14:43.917 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51604.log: gzip -5 --verbose 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51604.log.gz 2024-03-30T13:14:43.917 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.49308.log 2024-03-30T13:14:43.918 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46336.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46336.log.gz 2024-03-30T13:14:43.918 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53666.log 2024-03-30T13:14:43.920 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56785.log 2024-03-30T13:14:43.920 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49308.log.gz 2024-03-30T13:14:43.921 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53666.log: /var/log/ceph/ceph-client.admin.56785.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53666.log.gz 2024-03-30T13:14:43.922 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56785.log.gz 2024-03-30T13:14:43.923 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45365.log 2024-03-30T13:14:43.926 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43698.log 2024-03-30T13:14:43.927 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.45365.log: 85.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-30T13:14:43.927 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45365.log.gz 2024-03-30T13:14:43.927 INFO:teuthology.orchestra.run.smithi181.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-30T13:14:43.928 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55893.log 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43698.log.gz 2024-03-30T13:14:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-30T13:14:43.931 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55893.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55893.log.gz 2024-03-30T13:14:43.932 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47341.log 2024-03-30T13:14:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.47341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56419.log 2024-03-30T13:14:43.937 INFO:teuthology.orchestra.run.smithi099.stderr: 91.4% 89.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-30T13:14:43.938 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47341.log.gz 2024-03-30T13:14:43.938 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44034.log 2024-03-30T13:14:43.938 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56419.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56419.log.gz 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54344.log 2024-03-30T13:14:43.941 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44034.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44034.log.gz 2024-03-30T13:14:43.942 INFO:teuthology.orchestra.run.smithi181.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-30T13:14:43.943 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54344.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54344.log.gz 2024-03-30T13:14:43.943 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45517.log 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44586.log 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45517.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45517.log.gz 2024-03-30T13:14:43.947 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44586.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44586.log.gz 2024-03-30T13:14:43.947 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46168.log 2024-03-30T13:14:43.949 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54278.log 2024-03-30T13:14:43.950 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46168.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46168.log.gz 2024-03-30T13:14:43.952 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54278.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54278.log.gz 2024-03-30T13:14:43.953 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47887.log 2024-03-30T13:14:43.954 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54212.log 2024-03-30T13:14:43.956 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47887.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47887.log.gz 2024-03-30T13:14:43.957 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44292.log 2024-03-30T13:14:43.958 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54212.log.gz 2024-03-30T13:14:43.959 INFO:teuthology.orchestra.run.smithi099.stderr: 90.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43363.log 2024-03-30T13:14:43.959 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-30T13:14:43.960 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51538.log 2024-03-30T13:14:43.960 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44292.log.gz 2024-03-30T13:14:43.962 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43363.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43363.log.gz 2024-03-30T13:14:43.962 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56701.log 2024-03-30T13:14:43.963 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51538.log: gzip 90.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.51538.log.gz -- 2024-03-30T13:14:43.964 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.43056.log 2024-03-30T13:14:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43014.log 2024-03-30T13:14:43.965 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56701.log.gz 2024-03-30T13:14:43.966 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42762.log 2024-03-30T13:14:43.966 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43056.log.gz 2024-03-30T13:14:43.968 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49518.log 2024-03-30T13:14:43.968 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43014.log.gz 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55599.log 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42762.log.gz 2024-03-30T13:14:43.970 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56061.log 2024-03-30T13:14:43.970 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49518.log.gz 2024-03-30T13:14:43.971 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55599.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55599.log.gz 2024-03-30T13:14:43.972 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52752.log 2024-03-30T13:14:43.973 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56061.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56061.log.gz 2024-03-30T13:14:43.973 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54674.log 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55683.log 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52752.log.gz 2024-03-30T13:14:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54674.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54674.log.gz 2024-03-30T13:14:43.977 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42930.log 2024-03-30T13:14:43.977 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55683.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55683.log.gz 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46378.log 2024-03-30T13:14:43.979 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50274.log 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42930.log.gz 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46378.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46378.log.gz 2024-03-30T13:14:43.982 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50274.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50274.log.gz 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56995.log 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47299.log 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56995.log: 91.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi099.stderr:gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56995.log.gz -5 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48493.log 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56743.log 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48493.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47299.log.gz 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48493.log.gz 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51868.log 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49644.log 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56743.log.gz 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51868.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51868.log.gz 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49644.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49644.log.gz 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46648.log 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi181.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-30T13:14:43.994 INFO:teuthology.orchestra.run.smithi099.stderr: 94.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56145.log 2024-03-30T13:14:43.994 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49434.log 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46648.log.gz 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49770.log 2024-03-30T13:14:43.997 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56145.log.gz 2024-03-30T13:14:43.998 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51076.log 2024-03-30T13:14:43.998 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49434.log.gz 2024-03-30T13:14:43.999 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49770.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49770.log.gz 2024-03-30T13:14:44.001 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51076.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51076.log.gz 2024-03-30T13:14:44.010 INFO:teuthology.orchestra.run.smithi181.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-30T13:14:44.047 INFO:teuthology.orchestra.run.smithi099.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-30T13:14:44.097 INFO:teuthology.orchestra.run.smithi099.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-30T13:14:44.138 INFO:teuthology.orchestra.run.smithi099.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-30T13:14:44.181 INFO:teuthology.orchestra.run.smithi099.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-30T13:14:44.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-30T13:14:44.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-30T13:14:44.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-30T13:14:44.184 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:14:44.185 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m0.580s 2024-03-30T13:14:44.185 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m1.464s 2024-03-30T13:14:44.185 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m0.895s 2024-03-30T13:14:44.620 INFO:teuthology.orchestra.run.smithi181.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-30T13:14:44.625 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-03-30T13:14:44.625 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m1.016s 2024-03-30T13:14:44.625 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m2.266s 2024-03-30T13:14:44.625 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.306s 2024-03-30T13:14:44.626 INFO:tasks.ceph:Archiving logs... 2024-03-30T13:14:44.627 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148/remote/smithi099/log 2024-03-30T13:14:44.628 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T13:14:45.177 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148/remote/smithi181/log 2024-03-30T13:14:45.178 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T13:14:45.601 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-30T13:14:45.611 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-30T13:14:45.612 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T13:14:45.619 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T13:14:45.765 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-30T13:14:45.775 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-30T13:14:45.776 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:14:45.783 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:14:45.830 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-03-30T13:14:45.837 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-03-30T13:14:45.840 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T13:14:45.841 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-03-30T13:14:45.841 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 54 +78us[ +97us] +/- 93ms 2024-03-30T13:14:45.841 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv02.front.sepia.ceph.com 3 6 377 54 -191us[ -172us] +/- 51ms 2024-03-30T13:14:45.841 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 +191us[ +191us] +/- 65ms 2024-03-30T13:14:45.841 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:14:45.847 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T13:14:45.848 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-03-30T13:14:45.848 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 55 +94us[ +96us] +/- 93ms 2024-03-30T13:14:45.848 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv02.front.sepia.ceph.com 3 6 377 54 -200us[ -199us] +/- 51ms 2024-03-30T13:14:45.848 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +202us[ +203us] +/- 65ms 2024-03-30T13:14:45.848 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:14:45.849 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-30T13:14:45.859 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-30T13:14:45.859 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-30T13:14:45.886 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-30T13:14:46.108 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-30T13:14:46.318 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-30T13:14:46.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:14:46.422 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-30T13:14:46.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:14:46.526 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-30T13:14:46.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-30T13:14:46.552 INFO:teuthology.task.internal:Duration was 910.091289 seconds 2024-03-30T13:14:46.553 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-30T13:14:46.577 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-30T13:14:46.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T13:14:46.585 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T13:14:46.743 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T13:14:46.754 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T13:14:46.991 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-30T13:14:46.992 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:14:46.992 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T13:14:47.053 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:14:47.053 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T13:14:47.135 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-30T13:14:47.135 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T13:14:47.143 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T13:14:47.238 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-30T13:14:47.238 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T13:14:47.244 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T13:14:47.426 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-30T13:14:47.453 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-30T13:14:47.453 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T13:14:47.546 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T13:14:47.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-30T13:14:47.653 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:14:47.661 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:14:47.764 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-03-30T13:14:47.768 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-03-30T13:14:47.824 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:14:47.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:14:47.874 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:14:47.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:14:47.929 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-30T13:14:47.940 INFO:teuthology.task.internal:Transferring archived files... 2024-03-30T13:14:47.941 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148/remote/smithi099 2024-03-30T13:14:47.941 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T13:14:48.047 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148/remote/smithi181 2024-03-30T13:14:48.047 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T13:14:48.151 INFO:teuthology.task.internal:Removing archive directory... 2024-03-30T13:14:48.151 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T13:14:48.158 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T13:14:48.214 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-30T13:14:48.226 INFO:teuthology.task.internal:Not uploading archives. 2024-03-30T13:14:48.226 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-30T13:14:48.245 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-30T13:14:48.245 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T13:14:48.253 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T13:14:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 13:14 /home/ubuntu/cephtest 2024-03-30T13:14:48.309 INFO:teuthology.orchestra.run.smithi181.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 13:14 /home/ubuntu/cephtest 2024-03-30T13:14:48.313 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-30T13:14:48.324 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-30T13:14:48.370 INFO:teuthology.nuke:Checking targets against current locks 2024-03-30T13:14:48.396 DEBUG:teuthology.nuke:shortname: smithi099 2024-03-30T13:14:48.397 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T13:14:48.420 DEBUG:teuthology.nuke:shortname: smithi181 2024-03-30T13:14:48.420 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T13:14:48.424 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:48:50.672603', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDZULCtdpAoiI+VPGR22ZzcGvpezNcmJBRbXqUsn+mA96c3DhVejkFteJv2TM5YffEKHKFC/mmHqqmHSv0+TKxk='} 2024-03-30T13:14:48.445 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629148', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:48:50.671127', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBn+oUoitFPlnaBPd+LEUHydfuxrtCvEzj4aACGLaJ2Zmxr+uQT5Smte+l5jyHFm1gEF53mO2IDokoMkom8tAfk='} 2024-03-30T13:14:48.474 INFO:teuthology.orchestra.console.smithi099:Power off 2024-03-30T13:14:48.474 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T13:14:48.500 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-03-30T13:14:48.500 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:14:48.518 INFO:teuthology.orchestra.console.smithi181:Power off 2024-03-30T13:14:48.519 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T13:14:48.528 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-03-30T13:14:48.541 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-03-30T13:14:48.542 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:14:48.565 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-03-30T13:14:52.529 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:14:52.565 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:14:52.640 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-03-30T13:14:52.676 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-03-30T13:14:56.642 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:14:56.677 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:14:56.753 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-03-30T13:14:56.788 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-03-30T13:14:56.854 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-03-30T13:15:00.790 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:15:00.901 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-03-30T13:15:01.002 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-03-30T13:15:01.108 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 client.1-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining} duration: 910.0912885665894 failure_reason: 'Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=60ea57b241c9427fb83096af644adb38 status: fail success: false 2024-03-30T13:15:01.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T13:15:01.189 INFO:teuthology.run:FAIL